1. Background and rationale
The World Health Organization (WHO) estimates that between 50,000 to 100,000 women and girls worldwide develop obstetric fistula each year.[1] In the National Strategic Framework for the Elimination of Obstetric Fistula in Nigeria (2019-2023), the Federal Ministry of Health stated that Nigeria accounts for 40% of the worldwide fistula prevalence with approximately 150,000 to 200,000 cases and 12,000 new cases yearly in Nigeria this makes a disproportionate 7.5% of this global burden. According to the 2008 Nigeria Demographic and Health Survey (NDHS), the prevalence history of leaking urine among women aged 15-49 years was approximated to represent the prevalence of fistula is 0.4%. Although, the majority of obstetric fistula can be surgically closed, and continence regained, about 10% of Vesico- Vaginal Fistula (VVF) remain incontinent despite the closure of the fistula because of the involvement of the urinary sphincter[2].
To address the problem of obstetric fistula in Nigeria, CBM Global and its partners designed a four-year Comprehensive and Inclusive Women’s Health in Nigeria (CIWHIN) projects that commenced on 1st May 2023. The programme is implemented in FCT, Gombe, Katsina, Kebbi, Sokoto, Taraba and Zamfara state. Both projects are funded by CBM Australia, CBM New Zealand, and CBM UK. The programme aimed at contributing to improved quality of life for every woman and girl of reproductive age. The specific objective of the CIWHIN programme is improved economic integration, rights and access of all women and girls to affordable, quality, and sustainable reproductive health services.
With the programme at its halfway point, the review will provide CBM Global and its partners with an in-depth understanding of its progress, successes, and challenges. The findings will guide the implementation of the remainder of the project by informing broader strategies for addressing observable deviations from the original course of the project. Of particular importance, the MTR offers an opportunity to review the project’s SBCC intervention approaches towards improving on them.
2. Purpose
The purpose of the mid-term review is to assess the performance of both projects to determine the extent to which the project is on track to achieving its objectives, and document lessons that will be used to improve the remaining life span of the project.
Specifically, the objectives of the mid-term review include:
- To ascertain the extent to which the project objectives, planned indicators, and results at the project mid-term have been achieved.
- To identify the changes (if any) to be made to set the project on track to achieve its intended results and outcomes.
- To find out if the strategies used will contribute effectively and efficiently to the achievement of the desired results.
- To identify barriers to achievement of objectives and make recommendations based on findings that will guide the CIWHIN programme staff through the second half of the project.
3. Expected deliverables
- An inception report (including methodology, information collection plan, and review/evaluation matrix before the field data collection)
- A stakeholder workshop to validate the findings of the MTR and discuss the recommendations with the selected stakeholders.
- A draft mid-term review report produced
- A final mid-term report produced. This needs to be written according to the evaluation report template that CBM Global will share.
- Data sets for all collected data, transcribed for CBM Global and its partners future use submitted together with the final mid-term review report.
- PowerPoint presentation summarizing the key findings from the mid-term review submitted together with the final mid-term review report.
- A policy brief on the learnings and outcomes of the project demonstrating its contribution to strategic objectives of the Federal Government.
Both the Inception report and the Mid-term review reports should be presented in the standard evaluation report format of CBM Global.
4. Scope of Work
The mid-term review will be conducted in FCT, Gombe, Katsina, Kebbi, Sokoto, and Taraba states for a period of 31 working days. CBM Global Country Office will engage an external consultant to lead the mid-term review with a scope of covering the period of project implementation from 1st May 2023 – 31st December 2024. The mid-term review will be conducted in selected communities in FCT, Gombe, Katsina, Kebbi, Sokoto, Taraba and Zamfara States. The MTR will assess the projects’ progress across the result areas and indicators, document the findings, and provide recommendations to improve the projects implementation as required.
The consultant will assess the following categories of project progress.
A. Project design
The consultant is expected to review the following:
i. The challenges that the CIWHIN programme addresses, the underlying assumptions, and whether the projects’ result areas are still relevant in addressing the problem.
ii. The likely effect of any incorrect assumptions or anticipated changes to the achievement of the project results as outlined in the log frame.
iii. Whether (or not) stakeholders were taken into consideration during the project design and implementation phase.
iv. The extent to which gender and disability were considered in the project design.
B. Progress towards results
The consultant is expected to do the following:
i. Conduct a progress-towards-outcome analysis using appropriate tools. This should indicate progress made for each objective and result level indicator on the log frame.
ii. Identify barriers to achieving the project’s objectives in the remaining project timeframe.
iii. As may be required, make recommendations for achieving the project targets.
C. Project management and Project efficiency
The consultant is expected to conduct the following:
i. Critical analysis of the both projects log frame, indicators, and targets, and assessthe practicability of the project activities towards achieving the project objectives and results within the project timeframe and whether the end-of-project targets are still achievable considering the project’s prevailing context.
ii. Clarity of roles and responsibilities of the project partners and other stakeholders involved in the projects and the effectiveness of the performance of those roles and responsibilities.
iii. Analyse the cost-effectiveness of the current approach in mobilizing for the project services and proffer suggestions for improvement where applicable.
iv. Determine whether (or not) the current projects work plan is result-based and suggest ways of improving the process.
v. Determine the extent to which the project uses the log frame as a management tool.
vi. Critical analysis of the quality of support that CBM Global provides to its partners.
vii. Determine whether (or not) there have been changes to fund allocations because of budget revisions, the factors responsible, the extent of implementation of the changes, and the effects of those changes on the project.
D. Project Monitoring, Evaluation, Accountability, and Learning system
The consultant is expected to review the following:
i. Review the monitoring tools in use and comment on the quality of the data collected, the data collection methods, and whether they are sufficiently robust and are aligned with national guidelines and tools and meet CBM Global reporting needs.
ii. Assess the level to which stakeholders are provided with needed project data for informed decision-making.
iii. Assess whether sufficient resources are allocated to monitoring and evaluation.
iv. Assess whether the reporting and decision-making timelines were in line with donor requirements.
v. Assess whether progress reporting meets CBM Global standards.
vi. Document management processes, lessons learned, and at least two (2) human interest stories for each project.
E. Stakeholder involvement
The consultant is expected to review the following:
i. Participation and contribution of health authorities across the three tiers of government and their level of involvement in the governance of the project.
ii. Level of engagement with private, mission and public health facilities, State Ministries of Health, Primary Healthcare Development Agencies, and Hospitals Management Boards in delivery quality and inclusive fistula and MCH care services. In addition, the engagement approaches at the community level such as women’s groups, health champions (CHATs, CART), traditional and religious leaders, and Organizations of Persons with Disabilities (OPDs)
iii. Assess whether stakeholder involvement and community outreaches contributed to the progress towards achieving programme objectives.
F. Sustainability
The consultant is expected to do the following:
i. Identify and document likely financial risks to sustainability.
ii. Identify and document likely socio-economic risks to sustainability.
iii. Analyse the sustainability of the current referral pathway taking cognizance of the projects’ context.
iv. Analyse the level of ownership of the project by the government in the projects states.
G. Gender and Disability Inclusion
The consultant is expected to do the following:
i. Identify the level of involvement and participation of men, women, boys, and girls in the projects.
ii. Identify the extent to which organizations of persons with disabilities are participating in project activities.
iii. Ensure active participation of persons with disabilities in the MTR process.
5. Methodology
The consultant is expected to develop the mid-term review methodology in line with the framework of the available budget for this task in collaboration with partners and CBM Global. The consultant is expected to submit a brief inception report where a mid-term review methodology should be proposed. The mid-term review must meet the principles of being inclusive, participatory, and interactive, involving both male and female beneficiaries. As a minimum, the mid-term review process should include the following key steps:
- Review and analysis of relevant project documents:
- Project proposal, budget, log-frame, activity schedule, risk register, M&E plan, and reporting plan.
- Financial and narrative reports from May 2023 to December 2024.
- Memorandum of Understanding and Agreements with partners.
- Programme data.
- Initial briefing sessions with CBM Global and CIWHIN programme teams.
- Application of appropriate data collection tools.
The data that are being collected and stored by the project in various formats are stored in Excel, and others collected as descriptive and so, are stored as narrative reports. The data collected are disaggregated according to gender, age and disability or impairments.
The qualitative methods to be used could include open-ended questions on questionnaires, personal interviews, observation, logs, journals, records, etc. Quantitative methods to be used could include surveys, close-ended questions on questionnaires, observation checklists, etc.
Regarding confidentiality or data protection, the consultant must take all reasonable steps to ensure that the respondents are not adversely affected by taking part in the mid-term review. The consultant must keep the responses from respondents confidential, unless their permission is granted, and must not do anything with their responses that they are not informed about at the time. Also, particular care must be taken with children and teenagers by ensuring that permission is granted by a parent or responsible adult, such as a teacher, for interviews with children aged under 18. The CBM Global Child and Adults-at-risk Safeguarding and Protection from Sexual Exploitation, Abuse and Harassment (PSEAH) policies should be applied in all circumstances.
During the mid-term review, the stakeholders consulted by the consultant should include project staff (personal interviews) and management; consultants and field staff; beneficiaries; key community leaders where applicable (traditional rulers, religious leaders, and other sectional leaders in the community); representatives of the Federal Ministry of Health, State Ministry of Women Affairs, State Primary Health Care Development Agency, Hospital Management Board; healthcare providers; CBM Global Country Team.
Following data collection and analysis, the consultant will share preliminary findings with CBM Global and its partners. This shall be achieved through debrief sessions at CBM Global and project stakeholders at the evaluation sites. The sharing of preliminary findings is an opportunity for the stakeholders to hear and validate what the mid-term review has found and to be involved in thinking through the recommendations. It should include constructive discussions around the key issues identified by the mid-term review.
6. Timeframe and duration
This mid-term review is expected to be conducted over four (4) weeks, anticipated to start on the day of contract signing. The consultant will be required to share their detailed workplan for conducting this piece of work.
7. Place/ location of service delivered
The consultant’s regular place of work for this contract is in FCT, Gombe, Katsina, Kebbi, Sokoto, Taraba and Zamfara states.
8. Required Expert Profile
The consultant will be an experienced evaluator, who will be responsible for the overall MTR process and the production of the MTR report and related products.
The consultant must sign the CBM Global Safeguarding and PSEAH policies before they embark on field work. S/he should be familiar with disability-inclusive approaches in evaluations in line with international standards.
The consultant will be selected based on the following criteria:
- Seven (7) to 10 years of proven experience in programme design, implementation, and evaluation with three (3) to five (5) of those years in evaluating public health programmes.
- Advanced degree/MSc degree in Public Health, Social sciences, International Development, or other relevant fields.
- A strong background in sexual and reproductive health and maternal and child health programming – especially in fistula.
- Familiarity with delivery of disability-inclusive and participatory approaches is an added advantage.
- Ability to draw practical conclusions and to prepare well‐written reports promptly and available during the proposed period.
- Ability to provide strategic recommendations to key stakeholders.
- Excellent interpersonal and communication skills including ability to facilitate and work in a multidisciplinary team.
- Strong analytical skills, proven through submission of reports of similar work conducted.
- Submission of references to include clients and other team members.
9. Coordination and Logistics
CBM Global has responsibility for*:*
- Overall coordination of the mid-term review process.
- Recruitment of evaluator.
- Gathering documents and data for the consultant in collaboration with BhUTH and SFHF.
- Liaising with BhUTH and SFHF.
- Organizing post-evaluation debriefing with the consultant, including BhUTH and SFHF in the process.
- Signing off on the deliverables for this mid-term review.
BhUTH and SFHFhas responsibility for*:*
- Working with CBM Global Country Office to organize meeting schedule for the evaluation team.
- Identifying safe, secure, “neutral” and disability accessible locations for interviews/ meetings to take place (where people will feel free to speak as openly as possible).
- Organizing interviews with project beneficiaries and community leaders according to the consultant’s requests/methodology.
- Organizing interviews with the stakeholders in the partners facilities in FCT, Gombe, Katsina, Kebbi, Sokoto, Taraba and Zamfara states, according to the consultant’s requests/methodology.
- Organizing for interpreters for the evaluation exercise as required.
- Provision of guidance on security and safety at the field sites.
10. Payment schedule
The consultant will be paid upon presentation of invoices after each milestone under this consultancy has been completed. At the point of contracting, CBM Global will provide the Consultancy Invoice Information form, which gives the requirements for the formal content of such invoices. CBM Global will only settle invoices in the agreed currency.
The schedule of payment for this consultancy includes:
- Signing Contract: First advance – 25%.
- Submission and acceptance of inception report and data tools: Second advance – 25%.
- Submission and acceptance of final report, datasets, transcripts, and PowerPoint Summary by CBM Global and its partners: Final payment – 50%.
Qualified and interested evaluation consultants should submit via email to: EOI.Apply@cbm-global.org
- A cover letter expressing their interest.
- Curriculum Vitae.
- A short summary of their understanding of the Terms of Reference (ToR).
- Three previous project mid-term review or evaluation reports.
- A technical offer, which must include the technical requirements and the mid-term review approach/methods, and the work plan and the timeframe to address them. It would also be an opportunity for the consultant to challenge the ToR and offer options.
- A financial offer, including a budget for the evaluation. This should include the evaluation team’s daily rates for the assignment, detailing professional fees and per-diems. CBM Global will negotiate with them the final fees in line with the budget available for this evaluation and based on the experience of the chosen candidate.
12. Diversity Policy Statement
Everyone has the right to be treated with consideration and respect. CBM Global is committed to achieving a truly inclusive environment for all, by developing better working relationships that release the full potential, creativity and productivity of each individual. CBM Global aims to ensure that all staff, volunteers, donors, partners, contractors, and the general public are treated fairly. This will be regardless of sex, sexual orientation, gender re-assignment, marital or civil partnership status, race (including colour, nationality, ethnicity, or national origin), disability, medical status, age, religion or belief, political opinion, social or economic status.
13. Application Closing date:
9th April 2025.
Qualified and interested evaluation consultants should submit their application via email to: EOI.Apply@cbm-global.org