Consultant, NE-CORE Consortium Final Performance Evaluation 18 views0 applications

Background

FHI 360, Mercy Corps (MC), Danish Refugee Council (DRC), and INTERSOS collectively form the NECORE consortium and are implementing an integrated multisectoral program with lifesaving and life-sustaining food assistance and nutrition, health, water and sanitation, and protection services in northeastern Nigeria. This is complemented with life-building income-generating activities, agriculture and food assistance, multi-purpose cash assistance, and shelter and settlement NFI provision. The project was designed in accordance with minimum standard package requirements and guidance by USAID/BHA FY23/24 Northeast Strategic plan for each sector and sub-sector. The consortium partners each have substantial experience in implementing humanitarian projects in northeast Nigeria, and this consortium complements efforts of previous projects implemented independently by each partner.

Based on this background, FHI 360 is looking to hire a consultant to conduct a final evaluation of the NE-CORE consortium project.

Scope of Work

The scope of the evaluation is intended to cover the duration of the NE-CORE project i.e., May 1, 2023, to April 30, 2025. The core sectors implemented by the NE-CORE are Health, Nutrition, Water, Hygiene, and Sanitation (WASH), Protection, Shelter and Settlement, Food Assistance, Agriculture, and Multi-Purpose Cash Assistance (MPCA). The project is being implemented in three local government areas (LGA) of Borno State, namely Bama, Ngala, and Mobbar LGAs. Therefore, only these three LGAs will constitute the geographical coverage for this evaluation.

Objectives of the Survey and the Evaluation Questions

The evaluation shall follow the OECD Development Assistance Committee (DAC) criteria for evaluations. In line with this, the DAC criteria for evaluations will also be utilized to guide the criteria for evaluation and the key evaluation questions. The key evaluation criteria will include efficiency, effectiveness, relevance, impact and coverage of activities shall be critically examined. The evaluation will seek to address the following questions:

Relevance and Appropriateness:

To what extent were project activities aligned with the Nigeria Humanitarian Response Plan and Humanitarian Needs Overview to the needs and priorities for northeast Nigeria?

Evaluate the extent to which NE-CORE interventions met the needs and priorities of affected populations. FHI 360 expects to gather insights into what the community considers their humanitarian needs and gauge what targeted populations (IDPs, Returnees, and Host communities) would have preferred receiving.

Effectiveness:

How effective was the project in delivering services through a consortium approach compared to operating as individual partner organizations?

Connectedness and sustainability:

How effective were coordination mechanisms among the partners within the Consortium and linkages to humanitarian coordination units, and what lessons and recommendations can be gained on coordination?

Impact:

What has been the impact of the project interventions on the community and targeted beneficiaries?

Evaluation Methodology

While FHI 360 has provided a brief description of the methodology below, the final study methodology (including sampling approach and parameters) will be discussed and agreed upon between the consultant/firm and FHI 360 at the inception stage. The consultant will be primarily responsible for designing the study methodology and data collection tools. FHI 360 and its partners, through the Evaluation Management Team (EMT), will jointly review the proposed methodology and data collection tools and following satisfactory reviews with the consultant, validate the final methodology and tools.

The endline evaluation consultant is expected to develop a detailed technical proposal/inception report for the assignment. This should explain the proposed study design and data collection methodology and include a tentative work schedule for the execution of the assignment. FHI 360 expects the consultant to consider both quantitative and qualitative data to key outcome indicators and ensure that diverse perspectives are captured. In addition, the proposed methodology should promote the participation of different stakeholder groups at the community, LGA and State levels.

Quantitative approach: The technical proposal should describe the sampling approach and sample size determination for the quantitative component. FHI 360 anticipates that the sampling procedure proposed will be statistically acceptable for the outcome indicators and representative of the project target population. In addition, the consultant will provide parameters for sampling and indicator calculations such as design effect, confidence level and margin of error applicable for the study.

FHI 360 will aim to use a methodology that uses a 95% confidence interval in its sampling calculation, and a margin of error of no more than 5%. This can be further adjusted to account for non-responses. In addition, FHI 360 anticipates that a beneficiary-based, two-stage multi-cluster sampling method will be used, with samples taken proportionately according to the population sizes of the targeted locations. Though the sampling units will be determined with the consultant according to operational accessibility at the time of survey, FHI 360 will also ensure that the targeted populations are stratified by key variables, like displacement status and gender.

Qualitative approach: The consultant should include a proposed qualitative study approach in their technical proposal. This should consider a variety of qualitative data collection methods, such as semi-structured in-depth interviews, Key Informant Interviews, Focus Group Discussions, and direct observations (for example, water points, home gardens, shelter status, among others). The qualitative study should engage a broad range of stakeholders, including key project staff, relevant government representatives, and community members, thus ensuring that diverse perspectives are captured. FHI 360 anticipates that the qualitative study will be gender sensitive, ensuring a balanced representation of both male and female viewpoints. Additionally, the approach should enable participation of individuals with specific vulnerabilities, such as people with disabilities, those with chronic illnesses, single-headed female households, and child-headed households, to ensure that their unique perspectives are adequately captured.

Data quality control: The consultant will also describe quality control procedures for data collection, management, and analysis. This can include a data collection supervision plan to enable quality management throughout data collection. In addition, data collection will be digitized and collected using a platform the consultant and FHI 360 will agree upon, such as Kobocollect or CommCare.

Data analysis plan: The endline study consultant will be expected to propose and design the data analysis plan for both quantitative and qualitative data. This should also describe the tools/software for use in analysis of data. The data collection and analysis should consider to the extent possible disaggregation by gender, age, disability status and other underrepresented groups. The final data analysis plan will be discussed and agreed upon with the consultant and the consortium members prior to the start of the consultancy.

Ethical considerations and informed consent: The proposed methodology should also outline the ethical considerations underpinning the study. These will govern personnel conduct during data collection, child safeguarding, protection of personally identifiable information to ensure do-no-harm principles are adequately addressed as well as promote responsible use of data. All persons involved in the data collection shall adhere to FHI 360’s policies on Code of Ethics and Conduct, Safeguarding and Protecting Program Participants from Sexual Exploitation and Abuse. FHI 360 shall schedule a briefing session to orient the study team on these policies.

The study must respect the rights of the people interviewed by guaranteeing confidentiality and security. Respondents shall not be exposed to any risks and discomfort at any stage of the exercise. As such data collection tools will be pre-tested and study activities will provide a safe space for participants to express their thoughts confidently and freely. Enumerators (male and female) will be trained on ethical data collection techniques.

Information ownership: All ownership and copyright of the data collected are held by FHI 360. Information obtained during the performance of the assignment should be treated as confidential. This confidentiality obligation applies both during the contract period and after its conclusion. The consultant shall not disclose any information to third parties without prior written authorization from FHI 360.

Operational and logistical considerations

To facilitate the exercise, FHI 360 will provide operational and logistical support. FHI 360 will arrange travel to field sites and accommodation for the study team. Costs related to travel (both in-country and international) and accommodation will be assumed by FHI 360. However, the durations for which these expenses can be covered should be agreed upon prior to commencement of fieldwork.

Due to the operational contexts, FHI 360 cannot transport enumerators to and from Maiduguri for centralized training. Consequently, the consultant is expected to adapt to the possibility of remote training or a phased de-centralized approach to training.

Movements to field locations will be done through UN Humanitarian Air Services (UNHAS) which operates a standardized rotation schedule to field implementation sites on a weekly basis. No field movements will be conducted by road. Thus, FHI 360 will orient the consultant on the schedules and anticipate the consultant to draft a workable field movement schedule based on the UNHAS schedules. Where field accommodation is required, FHI 360 will arrange suitable accommodation, including UN Hubs where possible.

All financial arrangements will be agreed upon at the inception phase. This will include, for example, costs that should be assumed by FHI 360 and conditions under which various costs may be reimbursed. The consultant is expected to be upfront at the inception phase and clearly communicate any concerns regarding the study assignment (for example, timelines available versus the expected workload, payment modalities, etc.)

FHI 360 anticipates conducting the evaluation in the field between February 2025 and March 2025. The consultant is expected to complete the evaluation activity within this timeframe. The level of effort for this assignment is approximately 40-60 days.

Location of Work

Borno state, Nigeria: Maiduguri, Bama, Ngala, and Mobbar LGAs. The exact locations will be determined at the beginning of the consultancy.

Travel

The final evaluation will be conducted on-site in implementing areas in Borno state, Nigeria, tentatively from February 2025 to March 2025. FHI 360 will coordinate travel.

Qualifications

The evaluation consultant or firm is expected to have a thorough understanding of the humanitarian context in northeastern Nigeria as well as awareness of the latest humanitarian trends. The consultant/team is expected to possess the following qualifications:

1. A minimum of a masters’ degree from a recognized university in one of the following fields: Monitoring and Evaluation, Humanitarian Studies, Public Health, Development Studies, Research, or a relevant discipline.
2. At least 8 years of previous work experience in humanitarian settings and multi-sectoral projects. Expertise in at least four of the sectors under the project will be an asset.
3. Substantial experience in conducting similar assignments in Nigeria or similar humanitarian context.
4. High proficiency in using qualitative data analysis techniques and software.
5. Ability to manage available time and resources effectively, producing high-quality work under strict deadlines.
6. Experience in managing and supervising evaluation teams.
7. Strong skills in report writing, analytical, interpersonal communication, and collaboration.
8. Fluency in English with the ability to write clear and concise reports.
9. Demonstrated experience in working with USAID/BHA-funded projects/studies and understanding of USAID/BHA requirements for similar studies will be an added advantage.
10. The evaluation team lead should be fully acquainted with the USAID donor requirements and have relevant experience in the region/sector of programming.

Consultancy firm: If applying as a consultancy firm, the consultancy firm is encouraged to provide the core study team and the roles/expertise of each team member. Inclusion of the CV/resumes for proposed staff is also encouraged.