CHAPTER TWO: LITERATURE REVIEW

2.1 Introduction

The study examines the performance of Monitoring and Evaluation systems in cervical cancer units with M&E Functions, Human Capacity for M&E, Routine program monitoring and Data dissemination and use.

The dependent variable is performance of cervical cancer units in selected facilities in Wakiso district while the independent variables are the components of the monitoring and evaluation system. Performance of the cervical units shall be measured by the effectiveness, timeliness, accuracy, competence, productivity, knowledge, efficiency, responsiveness, and target management of the health workers.

This chapter presents a review of literature on the topic under investigation. The chapter presents a review of the relevant theories. It also presents empirical literature on the monitoring and evaluation systems and performance of cervical cancer units.

2.2 Theoretical Review

This study is grounded in the General Systems Theory (GST). GST, originally formulated by Bertalanffy in 1934 as cited in Tama (1987), serves as a foundational framework for examining the impact of planning on performance.

General Systems Theory (GST) is a conceptual framework that was developed to understand and describe the fundamental principles of systems, regardless of their specific type or nature. It provides a way to analyse and comprehend the complex interactions and interdependencies that exist within various systems, whether they are natural, social, or artificial (Chatterjee, 2021).

Some of the Key concepts and principles of General Systems Theory include; Holism indicating that one of the central tenets of GST is holism, which emphasizes that a system should be studied as a whole rather than as a sum of its individual parts. It recognizes that the interactions and relationships among components are essential for understanding the system’s behaviour, it further analyses Systems, a system is defined as an organized assembly of components or elements that interact with one another to achieve a common goal or function. These components can include people, processes, materials, information, or any other relevant entities (Klein, Solinger, & Duflot, 2022).

Interdependence further indicating that GST emphasizes the idea that the components within a system are interconnected and interdependent. Changes in one part of the system can have ripple effects on other parts, and these interactions can be both direct and indirect, the Hierarchy, this also further states that the Systems can often be structured hierarchically, with subsystems nested within larger systems. This hierarchical organization allows for the examination of systems at different levels, from small-scale subsystems to larger, more complex systems. Boundaries; Systems are defined by boundaries that separate them from their environment. These boundaries serve to delineate what is included within the system and what is external to it. Information and energy can flow across these boundaries, influencing the system’s behaviour (Rottleuthner,2022).

As articulated by Bertalanffy in 1968, a system is a complex unity composed of interconnected components, subcomponents, and subsystems, all organized according to a predetermined scheme or plan. The key attributes of a system include: Comprising various parts, subparts, and sub-systems, with each part potentially housing multiple subparts. Exhibiting interdependence among its constituent parts, both directly and indirectly, within the context of the whole. Allowing for the possibility that changes in one part can reverberate and affect other parts of the system (Albert, 2022).

A system serves the vital function of converting inputs into outputs, a transformation that is essential for the system’s continued existence. This transformation process involves three core elements: inputs, a mediator, and outputs. Inputs are drawn from the external environment and are subsequently converted into outputs, which are then returned to the environment. Inputs encompass a wide range of elements, including information, financial resources, materials, and human capital. Outputs may take the form of goods and services. This overall relationship constitutes the input-output process, with the system acting as a mediator in this process (Ali, 2022).

The principles of systems theory have found application across various fields, including community development. In this particular study, we focus on specific factors such as; Human capacity for M&E which Includes knowledge & skills, Routine program monitoring and dissemination of results by considering factors such as; Data dissemination and use, Data collection, Data source, Data accuracy and Data analysis (Hiver, Al-Hoorie, & Larsen-Freeman, 2022).

2.3 Conceptual Review

This section presents the literature review as reviewed by various scholars in line with the study objectives and conceptual frame work.

Monitoring and Evaluation (M&E) systems are essential components of any project, program, or organization. They help assess the effectiveness and efficiency of activities, track progress toward goals, and ensure accountability. Here’s a comprehensive overview of monitoring and evaluation systems.

Monitoring involves the systematic collection, analysis, and use of information to track the progress of a project or program and to ensure that activities are on course.

Components; Gathering feedback from beneficiaries and stakeholders, Qualitative methods for in-depth understanding, Detailed examination of specific instances within a project, For in-depth quantitative analysis. Ensure that findings from monitoring activities feed into the evaluation process, enabling real-time adjustments.

An effective monitoring and evaluation system is crucial for evidence-based decision-making, learning, and demonstrating accountability. It provides the necessary insights to improve programs, policies, and projects, ultimately leading to more impactful outcomes.

2.4 Actual Review

This section presents the the discussion of the study inline with the study objectives and conceptual frame work as discussed by various scholars.

2.4.1 Human capacity for M&E

Establishing a sufficient pool of human resources is essential for ensuring the long-term viability of the Monitoring and Evaluation (M&E) system, and this remains a continuous challenge (Tengan, Aigbavboa, & Thwala, 2019). It’s important to acknowledge that nurturing capable evaluators demands a more extensive focus on technically oriented M&E training and growth compared to what can typically be accomplished through a few isolated workshops (McKenzie, Neiger, B& Thackeray, 2022). The process of developing evaluators necessitates a combination of structured education and hands-on experience. Multiple avenues for training and growth are available, including engagement in the public sector, participation in the private sector, enrolment in universities, involvement with professional associations, task assignments, and mentorship programs (Nyauma, 2022).

The Monitoring and Evaluation intervention is a systematic process that involves the integration of strategies aimed at achieving sustainability within community-based conservancies Kabonga (2018). The elements of monitoring and evaluation practices geared toward sustainability encompass the following: establishing program objectives and goals, collecting data, conducting analysis, disseminating findings, and utilizing the research outcomes, as articulated by Tubey (2020). By integrating monitoring and evaluation practices into community-based conservancies, the effectiveness of the program is ensured. These interventions in monitoring and evaluation play a pivotal role in program management, as they promote the most efficient allocation of resources. Ultimately, monitoring and evaluation interventions guarantee that conservancy programs can adequately address the needs of both the present and future generations (Warinda, 2019).

Adequate human capital, when equipped with the right training and experience, plays a crucial role in generating Monitoring and Evaluation (M&E) outcomes. Ensuring an effective M&E workforce, both in terms of quantity and quality, necessitates the implementation of M&E human resource management practices to establish and retain a stable M&E team, as emphasized by the World Bank in 2011. This is because the competence of personnel poses a significant challenge when selecting M&E systems, as pointed out by Koffi-Tessio in 2002. Given that M&E is a relatively new professional domain, it encounters difficulties in delivering results effectively. Consequently, there is a substantial demand for proficient professionals, capacity enhancement for M&E systems, the alignment of training programs, and the provision of technical guidance, as underscored by (Gorgens & Kusek , 2019).

Monitoring and evaluation (M&E) of projects enhances overall project planning, management, and implementation efficiency, and as a result, a variety of projects are launched with the express purpose of improving the socio-political and economic status of residents in a specific region (Estrella, 2017). Monitoring is the project-long process of ensuring that the plan has been followed, that any deviations have been identified, and that remedial action has been performed in a timely manner (ADRA, 2017). As the project progresses, the information is gathered in an orderly and sequential manner. An ongoing or completed project, program, or policy, as well as its design, implementation, and outcomes, is evaluated in a systematic and objective manner (Rumenya, & Kisimbi, 2020), It is a systematic and objective evaluation of a current or completed policy, program, or initiative, including its conception, implementation, and outcomes. The goal is to provide timely assessments of intervention relevance, efficiency, effectiveness, impact, and sustainability, as well as overall progress toward original goals. Monitoring and evaluation, according to Ballard (2017), is a process that uses objective evidence to assist program implementers in making educated decisions about program operations, service delivery, and program effectiveness.

The UNDP (2009) handbook on planning, monitoring and evaluation for development results, emphasizes that human resource is vital for an effective monitoring and evaluation, by stating that staff working should possess the required technical expertise in the area in order to ensure high-quality monitoring and evaluation. Implementing of an effective M&E demands for the staff to undergo training as well as possess skills in research and project management, hence capacity building is critical (Nabris, 2012). In-turn numerous training manuals, handbooks and toolkits have been developed for NGO staffs working in project, in order to provide them with practical tools that will enhance result-based management by strengthening awareness in M&E (Hunter, 2009). They also give many practical examples and exercises, which are useful since they provide the staff with ways of becoming efficient, effective and have impact on the projects (Shapiro, 2011).

Competent Personnel, when monitoring and evaluation tasks are entrusted to individuals lacking proper training and experience, the consequences are likely to include prolonged timeframes, increased costs, and the production of results that may lack practicality and relevance (Obura et al., 2019), Consequently, the overall success of projects is at risk, as noted by Nabris in 2002. In the evaluation of Civil Society Organizations (CSOs) in the Pacific, the United Nations Development Programme (UNDP) in 2011 (p. 12) addresses certain obstacles in organizational development, notably highlighting the presence of insufficient monitoring and evaluation systems. Additionally, the deficiency in staff capabilities and limited opportunities for technical skill development in this domain remains a critical consideration. During the consultation processes, consensus emerged among CSOs that the absence of monitoring and evaluation mechanisms and skills represented a significant systemic gap across the region. Moreover, while CSOs may not require exceedingly intricate monitoring and evaluation systems, there is an undeniable need for them to possess fundamental knowledge of and proficiency in utilizing reporting, monitoring, and evaluation systems (Masvaure, & Fish, 2022).

The M&E system cannot function without skilled people who effectively execute the M&E tasks for which they are responsible (Clemente, 2020). Therefore, understanding the skills needed and the capacity of people involved in the M&E system (undertaking human capacity assessments) and addressing capacity gaps (through structured capacity development programs) is at the heart of the M&E system. In its framework for a functional M&E system, UNAIDS (2008) notes that, not only is it necessary to have dedicated and adequate numbers of M&E staff, it is essential for this staff to have the right skills for the work (Kaberia, & Mburugu, 2019). Moreover, M&E human capacity building requires a wide range of activities, including formal training, in-service training, mentorship, coaching and internships. Lastly, M&E capacity building should focus not only on the technical aspects of M&E, but also address skills in leadership, financial management, facilitation, supervision, advocacy and communication (Kabeyi, 2019).

A study conducted by White in (2016) concerning best practices in monitoring and evaluation within development International Non-Governmental Organizations (INGOs) highlights several challenges faced by INGOs in the implementation and management of M&E activities. One such challenge is the insufficient M&E capacity, where M&E personnel typically advise multiple projects concurrently and carry out regional or sectoral responsibilities with extensive portfolios. Moreover, taking on M&E responsibilities for numerous individual projects strains the limited M&E capacity and results in rapid burnout among M&E staff. This high burnout rate and frequent staff turnover further complicate the recruitment of skilled M&E professionals and constrain the organizational expertise available for supporting M&E development. Mibey’s study in 2011, on factors influencing the execution of monitoring and evaluation programs in the “Kazi Kwa Kijana” project recommends the inclusion of capacity building as a central component of the project throughout Kenya. This underscores the need for increased investment in training and human resource development, particularly in the critical technical field of monitoring and evaluation.

Human capacity plays a pivotal role in ensuring effective monitoring and evaluation (M&E) processes. Here are some key aspects of human capacity in M&E; Technical Expertise, Individuals involved in M&E need to possess technical knowledge and skills related to data collection, analysis, and reporting (Gathege, N. W., & Yusuf, M. (2019). This includes familiarity with relevant data collection methods, statistical tools, and data analysis software. Proficiency in various M&E methodologies and frameworks is essential for designing and implementing effective M&E systems (Kanyamuna, Kotzé, & Phiri, 2019). This includes understanding the difference between impact evaluations, process evaluations, and other evaluation types, Data Collection Skills, M&E professionals should be skilled in designing data collection instruments, conducting surveys, interviews, and focus groups, and ensuring data quality and accuracy, the ability to analyse data, identify trends, and draw meaningful conclusions is crucial. M&E practitioners should be comfortable working with data to inform decision-making (Warinda, 2019).

2.4.2 Routine program monitoring

Routine program monitoring and evaluation (M&E) play a crucial role in enhancing the performance of cervical cancer hospitals. Routine M&E is essential for cervical cancer hospitals to ensure that they are meeting their objectives effectively and efficiently (Abdi, Majdzadeh, & Ahmadnezhad, 2019). It helps in M&E enables hospitals to continually assess the quality of cervical cancer screening, diagnosis, treatment, and patient care (Adamou, Iskarpatyoti, Agala, & Mejia, 2019), Through data analysis, hospitals can identify areas where resources need to be allocated or reallocated for optimal results, M&E allows hospitals to measure the impact of their programs on reducing cervical cancer incidence and mortality rates (Ruel-Bergeron, et al., 2019).

Methodologies for Routine Program Monitoring and Evaluation, collecting data on key performance indicators such as screening rates, treatment outcomes, and patient satisfaction is crucial (Dixon et al., 2019). Statistical analysis and data visualization tools can help hospitals make sense of the collected data and identify trends and patterns, establishing feedback mechanisms with healthcare providers and patients can provide valuable insights into the hospital’s performance (Sithomola, & Auriacombe, 2019).

Frequent data collection leads to an increased number of data points, which in turn empowers managers to monitor trends and comprehend the dynamics of interventions. Consequently, the more frequently measurements are conducted, the less uncertainty there will be concerning events occurring between specific measurement intervals (Milner et al., 2019). However, when more time elapses between measurements, the likelihood of missing out on events and changes within the system increases (Gebremedhin et al., 2010). Mulandi (2013) shares this perspective, emphasizing that for information to be valuable, it should be gathered at strategic moments and with a specific frequency. Furthermore, unless mutually agreed-upon indicators are genuinely comprehended by all involved parties and everyone’s schedules are considered, identifying optimal moments for data collection and analysis becomes challenging (Waylen et al., 2019).

Enhancing project or program effectiveness: Bourckaert, Verhoest, and De Corte (2009) note that identifying indicators for evaluating program performance can be challenging unless the results from monitoring and evaluation are delivered promptly. Thus, it is crucial to establish a well-defined system of indicators for timely measurement and monitoring of program performance. Supporting this notion, a study conducted by Cunnen (2006) underscores the need for a timely system of over two thousand societal indicators to measure outcomes for Canadians across various sectors.

Pertinent Information, In a study report from an Australian NGO conducted by Spooner and Dermott (2018), staff members expressed uncertainty about the effectiveness of the current monitoring and evaluation system as the organization, known as WAYS, evolved over time. Furthermore, there was a lack of dedicated resources for data analysis, resulting in infrequent data analysis (Cherian et al., 2020), A notable issue with data analysis was that program managers, who were responsible for it, had limited time to analyse data that was not mandated by funding agencies. Some staff members mentioned that they were tasked with data collection and analysis but faced challenges due to their limited research skills (Sithomola, & Auriacombe, 2019). Lastly, certain staff members highlighted the absence of a feedback mechanism within the existing system. While they reported their activities to management, they remained unaware of what happened to the information after reporting (Kissi, et al., 2019).

In the context of African countries and potentially other regions, a common problem is the collection of various performance data by sector ministries, often characterized by poor data quality (Boehmer, & Zaytsev, 2019), This problem stems from the fact that the responsibility for data collection primarily rests on overburdened officials at the facility level. These officials are tasked with providing data to officials at district offices and the capital but seldom receive feedback on whether or how the data are actually utilized (Lavoie et al., 2023). This dilemma contributes to another issue, data quality suffers because the data are underutilized, and conversely, they are underutilized because their quality is subpar. Consequently, in such countries, there is an abundance of data but a scarcity of meaningful information (Mackay, 2006).

Well-articulated; In a study examining Results-Based Management (RBM) in Northern Ghana, Obure (2008) highlights an issue concerning the post-collection management of data. Field officers often confessed to ineffective handling of data storage, processing, and interpretation. The study’s findings strongly underscore a systemic weakness stemming from stakeholders’ inability to manage and process data in a meaningful manner. The challenge could potentially result in the mere accumulation of large volumes of data that may ultimately prove unhelpful. It is imperative to collect and regularly analyse data concerning objectives and intermediate outcomes (Binnendijk, 2019).

Furthermore, the Performance Monitoring, Evaluation, and Reporting (PME&R) system offers three tiers of information, encompassing project, activity, and organizational levels (Leiter, 2021). Data from all organizations involved in a specific activity can be aggregated to the activity level, and data from all activities can be aggregated to the project level (Booth, Ebrahim, & Morin, 2008).

In a study investigating the factors influencing the utilization of Monitoring and Evaluation (M&E) results in malaria control projects in Uganda, Gamba (2016) identified that evaluation quality and effective communication of M&E results had a notably positive impact on utilization. Additionally, the timeliness of M&E activities had a moderately positive effect on the utilization of M&E findings across various organizations during the implementation of the Malaria Control Program (MCP) activities.

A study conducted by Barton (2007) suggests that when designing an M&E system, the primary objective is to gather indicator data from a variety of sources, including the target population, to monitor the progress of a project (Bennett, , Schuhbauer, Skerritt, & Ebrahim, 2021), The methods employed for data collection within the M&E system encompass various approaches, such as engaging in discussions or conversations with relevant individuals, conducting community or group interviews, undertaking field visits, reviewing records, conducting key informant interviews, participating in observations, facilitating focus group interviews, directly observing activities, administering questionnaires, conducting one-time surveys, implementing panel surveys, carrying out censuses, and conducting field experiments (Chen et al., 2019).

Kusek and Rist (2014), on the other hand, argue that the development of key indicators to monitor outcomes provides managers with the means to evaluate the extent to which the intended or promised outcomes are being realized. Consequently, collecting data at regular intervals results in more data points, allowing managers to utilize them effectively for tracking trends and comprehending the dynamics of interventions (Collyer et al., 2020), This, in turn, reduces the need for guesswork concerning events occurring between specific measurement intervals (Cherian et al., 2020).

Ability to have a dedicated team ready to learn; In this context, learning is defined as formulating responses to identified constraints and implementing them in real time. Useful at project/plan level are knowledge-sharing and learning instruments which can pick up information and analysis from the M&E systems as studies (Kanyamuna, Mubita, & Kotzé, 2020), such as; summarized studies and publications on lessons learned, case studies documenting successes and failures, publicity material including newsletters, radio and television programmes, formation of national and regional learning networks, periodic meetings and workshops to share knowledge and lessons learned, research-extension liaison or feedback meetings, national and regional study tours, preparation and distribution of technical literature on improved practices; and routine supervision missions, mid-term reviews or evaluations and project completion (end-of-project) reports (Orubu, Zaman, Rahman, & Wirtz, 2020).

Assefa, (2021) overwhelmingly support the assertion that indicators measured are just as important as the timing of M&E. This means that it is imperative to get the measurement correct, but also be done in such a way that when the said information is needed, it is readily available for its utilization. Kusek and colleagues note that the practice of using inappropriate baselines defeats the whole concept of “data quality triangle”, which encompasses elements of data reliability, data validity and data timeliness, for its usability (Uwizeyimana, 2020).

Methodologically sound, as per Cornielje, Velema, and Finkenflugel (2008), it is only when the users take ownership of the monitoring system that it becomes likely to produce valid and dependable information. However, it is all too common that these very users may find themselves overwhelmed by their daily workload, which they often perceive as more significant than data collection (Karimi, Mulwa, & Kyalo, 2021), Consequently, the system may deteriorate or lose its integrity. Their conclusion stresses the utmost importance of involving frontline workers in both monitoring and evaluation while keeping them informed about the status of the services and activities they primarily deliver, in collaboration with other stakeholders and beneficiaries (Kibukho, 2021).

Empirical evidence suggests that the quality of evaluations significantly influences the utilization of evaluation findings. According to an IFAD (2008:26) annual report on results and impact, recurrent criticisms directed at M&E systems include limitations in scope, complexity, poor data quality, insufficient resources, weak institutional capacity, and a lack of baseline surveys, resulting in limited utilization. Additionally, the most common critique of M&E systems in IFAD projects pertains to the nature of information included in these systems. While most IFAD projects gather and process data on project activities, the average IFAD project fails to provide information regarding the achievements at the purpose or impact level. For example, the M&E system of the Tafilalet and Dades Rural Development project in Morocco exclusively focused on financial operations and lacked the capacity for impact assessment. In the Pakistan IFAD Country Program Evaluation, cases were reported where contradictory logical frameworks were combined with arbitrary and irrelevant indicators, while in Belize, two different logical frameworks were created, resulting in increased confusion and complexity. The Ethiopia IFAD Country Program Evaluation highlighted that project appraisal documents inadequately accounted for systematic baseline surveys and subsequent beneficiary surveys. In one Ethiopian project, for instance, the baseline survey was conducted 2-3 years after the project’s initiation.

A study by Guijt, (1999) also finds that useful information needs to be collected at optimal moments and with a certain frequency, if it is to be of quality. Moreover, unless negotiated indicators are genuinely understood by all involved, and everyone’s timetable is consulted, optimal moments for collection and analysis will be difficult to identify. On the other hand, Cornielje, Velema and Finkenflugel (2008) report that it is only when the monitoring system is owned by the users that it can generate quality data that is valid and reliable for utilization in future projects. The author however notes that all too often, the very same users may be overwhelmed by the amount of daily work, which, in their view, is seen as more important than collecting data; and that subsequently, the system may become corrupted and thus not usable in subsequent implementations.

2.4.4 Data Dissemination

Data dissemination in monitoring and evaluation (M&E) is a crucial step in the M&E process that involves sharing information and findings with relevant stakeholders to inform decision-making, improve program effectiveness, and enhance transparency and accountability. Effective data dissemination ensures that the insights and lessons learned from M&E activities are put to practical use (Gu et al., 2023). Here are some key considerations and steps for data dissemination in monitoring and evaluation; Identify the key stakeholders who will benefit from the M&E data and findings (Chambers, 2023). These may include program managers, funders, policymakers, project beneficiaries, and other relevant parties. Develop a Dissemination Plan; Create a comprehensive plan that outlines the objectives, methods, and timelines for data dissemination. Consider how different audiences prefer to receive information (e.g., reports, presentations, dashboards, or infographics). Present data in a clear and accessible manner (Geng, Yang, Wang, Zhou, & Geng, 2023). Use charts, graphs, tables, and other visualization tools to make complex information easier to understand. Customize the message and format for each target audience. Stakeholders may have varying levels of technical expertise, so adapt your communication to their needs and interests (Liu, Tian, & Zhu, 2023).

Employ a variety of communication channels, including meetings, workshops, reports, websites, newsletters, and social media, to reach different stakeholders effectively. Encourage active engagement and discussion when presenting findings. Answer questions, seek feedback, and promote a two-way dialogue to ensure that stakeholders understand and can use the information (Paul, & Das, 2023).

Despite the global efforts, monitoring and evaluation data continues to be affected by a lack of standards, insufficient guidelines, and support services hindering its adoption in low developing countries (Fuhr, 2019). Monitoring and evaluation Data management has been given lukewarm attention in low developing countries and as a consequence, it remains in formative years, fragmented, and lacking (Patterton, 2016; Patterton, et al., 2018) . This may be attributed to continued research data loss, mishandling, misuse, and inaccessibility when needed (Chawinga and Zinn, 2020a) . Studies carried out in the Republic of South Africa, Kenya, Tanzania, Malawi, and Zimbabwe revealed several challenges obstructing RDM practices (Chawinga, 2019; Chiparausha and Chigwada, 2019; Mushi, et al., 2020; Ng' Eno, 2018 ). The challenges identified included: lack of legal/policy frameworks and standards to guide the research life cycle processes, absence of technological infrastructure and related services, a diverse range of types of data, and low-quality data associated with inconsistencies in collection methods (Fuhr, 2019 ; Antell, et al., 2014) .

Other challenges noted were: limited funding, lack of training and leadership as well as the absence of funders’ proactive role to manage research data better (Ashiq, et al., 2020 ; Carter, 2020) . Though there is plenty of literature in the developed nations about RDM, supportive literature in low developing nations is scarce and only emerging due to participation in international research collaborations (Mohammed and Ibrahim, 2019; Mushi, et al., 2020; Tripathi, et al., 2017).

The credibility of reported results relies significantly on the quality of evaluations, underscoring the importance of incorporating data from diverse sources to validate discoveries. Additionally, primary data, which the M&E system collects directly for its monitoring and evaluation purposes, differs from secondary data, gathered by other organizations for purposes unrelated to M&E (Gebremedhin, Getachew & Amha, 2010:24). In the M&E system’s design, the goal is to gather indicator data from various origins, including the target population, to monitor project progress (Barton, 1997). Methods for data collection within the M&E system encompass various approaches, such as engaging in discussions or conversations with relevant individuals, conducting community or group interviews, undertaking field visits, reviewing records, conducting key informant interviews, participating in observations, facilitating focus group interviews, directly observing activities, administering questionnaires, conducting one-time surveys, implementing panel surveys, conducting censuses, and carrying out field experiments. Furthermore, the development of key indicators for monitoring outcomes empowers managers to assess the extent to which intended or promised results are being realized.

Gebremedhin, Getachew, and Amha (2010) emphasize the critical role of the data source in establishing the credibility of reported performance results and their potential utilization in future program implementations. The author underscores the significance of incorporating data from diverse origins to validate the outcomes. The Result-Based Management (RBM) approach, encompassing planning, monitoring, and evaluation processes, is designed to facilitate decision-making in pursuit of specific objectives. Planning aids in concentrating efforts on meaningful results, while monitoring and evaluation promote learning from past achievements and challenges encountered during implementation. Key components of an M&E system, developed in collaboration with relevant stakeholders, serve to encourage participation and enhance ownership of a project or plan (Impouma et al., 2021).

Result Frameworks or Logframes (RF), These tools organize intended results, defining measurable developmental changes. RFs inform the development of the M&E plan and must align with it. The M&E plan, in turn, outlines the functions required to collect pertinent data, the associated methods, and tools. It systematically coordinates data collection, designating the roles and responsibilities of project/plan stakeholders. This ensures the regular collection, processing, and analysis of relevant progress and performance data, enabling evidence-based decision-making (Andriani, & Mbato, 2021).

Monitoring Processes and Methods: These encompass various techniques such as regular input and output data gathering and review, participatory monitoring, and process monitoring, Evaluation methods include impact evaluation, thematic assessments, surveys, and economic analyses of efficiency. Management Information System: This serves as an organized repository of data, aiding in the management of crucial numeric information related to the project/plan and facilitating analysis (Cheney et al., 2023).

Furthermore, while primary data are collected directly by the M&E system for M&E purposes, secondary data are those collected by other organizations for purposes different from M&E. However, a study by Booth, Ebrahim and Morin, (2008) reports that the Monitoring and Evaluation system allows for three levels of information by project, activity and organization, where the data for all organizations involved in a specific activity (Waaswa, Nkurumwa, & Kibe, 2021). These can be averaged up to the activity level, and the data for all activities can be averaged up to the project level, easing utilization (Bhatt et al., 2021).

M&E systems will only add value to project implementation through interpretation and analysis, by drawing on information from other sources and adapting it for use by project decision makers and a range of key partners (Fan et al., 2021). Knowledge generated by the M&E efforts should never stop at basic capturing of information or relying exclusively on quantitative indicators, but also to address the “why” questions. Here the importance of more qualitative and participatory approaches become particularly important, to analyse relationship between project activities and results (Meenaakshi Sundhari, et al., 2021). Evaluation therefore serves the purpose to establish attribution and causality, and forms a basis for accountability and learning by staff, management and clients (Gupta, Bouadjenek, & Robles-Kelly, 2023).

2.5 Empirical review

2.5.1 Human capacity for M&E

Empirical Literature on Human Capacity in Monitoring and Evaluation (M&E) , Importance of Technical Expertise in M&E:The effectiveness of M&E processes relies heavily on the technical expertise of individuals involved. This includes proficiency in data collection methods, statistical tools, and data analysis software (Gathege, N. W., & Yusuf, M., 2019).

Data Collection Skills and Quality Assurance; M&E professionals need strong skills in designing data collection instruments, conducting surveys, interviews, and focus groups. Ensuring data quality and accuracy is paramount to the credibility of M&E outcomes (Kanyamuna, Kotzé, & Phiri, 2019).

Data Analysis and Interpretation; Competence in data analysis is crucial. M&E practitioners must be capable of analyzing data, identifying trends, and drawing meaningful conclusions. This analytical ability is vital for utilizing data effectively in decision-making processes (Warinda, 2019).

Combination of Education and Experience; Developing skilled evaluators requires a combination of structured education and hands-on experience. Training avenues include public and private sector engagement, university programs, professional associations, task assignments, and mentorship programs (Nyauma, 2022).

Addressing Capacity Gaps; M&E capacity building should encompass various activities such as formal training, in-service training, mentorship, coaching, and internships. These activities should not only focus on technical aspects but also address skills in leadership, financial management, facilitation, supervision, advocacy, and communication (Kabeyi, 2019).

Challenges and Solutions in M&E Capacity; Insufficient M&E Capacity in INGOs; INGOs often face challenges due to insufficient M&E capacity. Overburdened M&E staff handling multiple projects can lead to burnout and staff turnover. Investment in training and human resource development is crucial, especially in the technical field of M&E (White, 2016).

Need for Fundamental Knowledge in CSOs; Civil Society Organizations (CSOs) require fundamental knowledge and proficiency in reporting, monitoring, and evaluation systems. Lack of monitoring and evaluation mechanisms and skills poses a significant gap in organizational development (Masvaure, & Fish, 2022).

Role of Training Manuals and Toolkits; Capacity Building through Manuals:

Manuals, handbooks, and toolkits have been developed to provide practical tools to NGO staff. These resources enhance result-based management by strengthening awareness in M&E. Practical examples and exercises are crucial for staff efficiency and effectiveness (Hunter, 2009; Shapiro, 2011).

The empirical literature underscores the critical importance of human capacity in ensuring effective M&E processes. This capacity encompasses technical expertise, data collection skills, analysis capabilities, and a combination of education and practical experience. Addressing capacity gaps, especially in organizations such as INGOs and CSOs, requires targeted training programs and resources. The availability of comprehensive training materials and the integration of fundamental M&E knowledge into organizational practices are essential for building a proficient M&E workforce.

Routine program monitoring

The empirical literature on routine program monitoring and evaluation (M&E) in the context of cervical cancer hospitals reveals several key themes and challenges. This body of research emphasizes the critical role of timely and accurate data collection, proper analysis, and effective utilization of the gathered information. Several studies highlight the following aspects:

Importance of Routine Program Monitoring and Evaluation; Enhancing Program Effectiveness; Routine M&E is essential for assessing the quality of cervical cancer screening, diagnosis, treatment, and patient care. Proper data analysis allows for the identification of areas needing resource allocation or reallocation. Monitoring the impact of programs aids in reducing cervical cancer incidence and mortality rates.

Challenges in Data Collection and Analysis; Limited resources and skills hinder effective data analysis. Absence of a feedback mechanism results in a lack of understanding about the fate of reported data, Overburdened officials in certain regions lead to poor data quality and underutilization.

Data Quality and Utilization; Importance of appropriate baseline data for meaningful analysis. Involvement of frontline workers in monitoring and evaluation is crucial for data validity and reliability.

Learning and Adaptability; Importance of a dedicated team for real-time learning and adaptation based on M&E results. Knowledge-sharing mechanisms, such as case studies and workshops, aid in disseminating lessons learned.

Methodologies and Indicators; Various methodologies for data collection, including interviews, surveys, and field visits. Development of key indicators to monitor outcomes facilitates effective program evaluation. Negotiated and mutually understood indicators are vital for meaningful data collection and analysis.

Standardization and Coordination; Standardization of data collection methods and indicators across different regions. Coordination between various levels of healthcare administration to ensure seamless data flow and utilization.

Routine program monitoring and evaluation are vital components of improving cervical cancer hospitals’ performance. Addressing challenges related to resource allocation, feedback mechanisms, and capacity building is crucial for ensuring the effectiveness of M&E systems. Standardization and coordination across different levels of healthcare administration can further enhance the quality and utilization of collected data.

Data Dissemination

The empirical literature provided presents a comprehensive overview of the challenges and considerations in data dissemination within the context of monitoring and evaluation (M&E) processes.

Importance of Data Dissemination in M&E; Informing Decision-Making and Transparency; Data dissemination is crucial for informing decision-making processes, enhancing program effectiveness, and ensuring transparency and accountability (Gu et al., 2023).

Identifying Key Stakeholders; It is essential to identify stakeholders such as program managers, funders, policymakers, and project beneficiaries who would benefit from M&E data (Chambers, 2023).

Effective Dissemination Strategies; Developing a dissemination plan is essential. This plan should consider the preferences of different audiences in terms of information format (reports, presentations, etc.) and employ clear and accessible visualization tools (Geng, Yang, Wang, Zhou, & Geng, 2023).

Customized Communication; Messages and formats should be customized for different stakeholders based on their technical expertise and interests (Liu, Tian, & Zhu, 2023).

Engaging Stakeholders; Various communication channels, such as meetings, workshops, reports, websites, newsletters, and social media, should be utilized to engage stakeholders effectively (Paul & Das, 2023).

Challenges in Data Management and Dissemination; Lack of Standards and Support; Low developing countries face challenges due to the absence of legal frameworks, technological infrastructure, funding, and training, hindering effective data management and dissemination (Fuhr, 2019; Antell et al., 2014; Ashiq et al., 2020).

Diversity of Data and Quality Issues; Challenges include handling diverse types of data and ensuring data quality through consistent collection methods (Fuhr, 2019; Chawinga & Zinn, 2020a).

Limited Supportive Literature; Supportive literature in low developing nations is limited, with emerging research due to international collaborations (Mohammed & Ibrahim, 2019; Tripathi et al., 2017).

Data Collection Methods in M&E; Diverse Data Sources: The credibility of reported results depends on the quality of evaluations, emphasizing the incorporation of data from various sources to validate findings (Gebremedhin, Getachew & Amha, 2010).

Primary and Secondary Data; Primary data collected directly by M&E systems differ from secondary data collected by other organizations. M&E systems should integrate information at different levels to enhance utilization (Booth, Ebrahim, & Morin, 2008; Waaswa, Nkurumwa, & Kibe, 2021).

Qualitative and Participatory Approaches; Qualitative and participatory approaches are vital to understanding the relationship between project activities and results, addressing the “why” questions, and establishing attribution and causality (Meenaakshi Sundhari et al., 2021; Gupta, Bouadjenek, & Robles-Kelly, 2023).

In conclusion, effective data dissemination in M&E requires careful planning, customization, engagement of diverse stakeholders, and the incorporation of various data sources. Addressing challenges, especially in low developing countries, necessitates the development of supportive frameworks, technology infrastructure, and funding, along with a focus on qualitative and participatory methods to enhance the credibility and usability of M&E data.

2.6 Synthesis of the literature review.

Monitoring and Evaluation (M&E) in development projects is a multifaceted process crucial for ensuring project effectiveness, accountability, and sustainability. The literature presents a comprehensive view of the challenges, methodologies, and importance of M&E systems. Here is a synthesized overview of key themes and insights from the literature:

Human Capacity for M&E:

Developing a competent M&E workforce is essential for effective M&E systems. Training and experience are fundamental, and a combination of structured education and hands-on practice is necessary.

Various avenues such as public sector engagement, private sector participation, university programs, professional associations, task assignments, and mentorship programs contribute to building capable evaluators.

Adequate human capital, equipped with proper training, is vital for generating meaningful M&E outcomes. Challenges include selecting suitable M&E systems due to staff competence issues.

Civil Society Organizations (CSOs) often lack monitoring and evaluation mechanisms. Fundamental knowledge and proficiency in utilizing reporting, monitoring, and evaluation systems are crucial for CSOs.

Routine Program Monitoring:

Routine M&E is indispensable in enhancing the performance of projects, such as in cervical cancer hospitals. It involves continuous data collection, analysis, and feedback mechanisms to ensure program quality and effectiveness.

Frequent data collection enables timely identification of trends and dynamic intervention planning. However, challenges exist in balancing the frequency of data collection with its quality and usability.

Data Dissemination:

Effective data dissemination is vital for informing decision-making and improving program effectiveness. Tailoring the message and format for various stakeholders is essential.

Challenges in data dissemination include lack of standards, insufficient guidelines, and support services in low-developing countries. Legal frameworks, technological infrastructure, and training are vital components for successful data dissemination.

Data Sources and Credibility:

The credibility of reported results depends on the quality of evaluations. Incorporating data from diverse sources, both primary and secondary, validates outcomes and strengthens M&E findings.

Properly designed Result Frameworks (RF) and Logframes are essential for organizing intended results and guiding the M&E process. Monitoring processes and methods, along with robust Management Information Systems (MIS), facilitate effective data collection, processing, and analysis.

Challenges in M&E include staff burnout, limited resources, inadequate training, and issues in data analysis. Addressing these challenges requires increased investment in training, better human resource management, and proactive funders’ role in managing research data.

Utilizing qualitative and participatory approaches alongside quantitative data analysis is crucial. Evaluation serves to establish causality, attribution, and accountability, forming the basis for organizational learning and project improvement.

Conclusion

Monitoring and Evaluation, when conducted with skilled human resources, robust methodologies, and proper dissemination strategies, significantly enhance the effectiveness and impact of development projects. Addressing challenges and investing in capacity building are fundamental steps toward creating meaningful and sustainable M&E systems. Ongoing research and international collaboration are necessary to refine existing frameworks and overcome emerging challenges in the field of M&E.

Research consultancy