Terms of Reference (ToR)
Endline Evaluation of the Regional Programme in East Africa
Project Title: Humanitarian response in WASH and Food Security for people affected by multiple natural hazards and conflicts in Somalia, Ethiopia, Somaliland and Sudan
Project Code: HA-22-AA-01 / AFR 07/22
Project Duration: 01 July 2022 – 30 September 2025
Donor: German Federal Foreign Office (GFFO)
Implementing Organization: arche noVa e.V. (AN) with OWDA, PAH, ASEP, FPDO, HOPE Sudan
1. Introduction
This Terms of Reference outlines the scope and responsibilities for the Endline Evaluation (EE) of the above regional programme. The evaluation aims to assess the overall performance of the project, its contribution to improved WASH and food security outcomes, and its strategic relevance and sustainability in the context of humanitarian and transitional programming.
2. Background
The project supports approximately 156,900 people in communities affected by drought, conflict, disease outbreaks, and displacement across Somalia, Somaliland, Ethiopia, and Sudan. Its focus includes:
- Riverine and pastoralist communities
- Urban/peri-urban IDP settlements
- Schools and health centres
Outcomes and Outputs
Outcome:
Improved access to emergency and sustained water, sanitation, food security, and strengthened resilience for IDPs and communities.
Outputs:
- Enhanced access to inclusive WASH services (Somalia, Somaliland, Ethiopia, Sudan)
- Increased food security through improved productivity and livelihoods (Somalia, Sudan)
- Improved Disaster Risk Reduction and emergency response (Somalia, Ethiopia)
- Strengthened capacity of local actors and authorities in humanitarian response (Somalia, Somaliland, Ethiopia, Sudan)
A detailed logframe with indicators is available in the annex to the project proposal.
3. Objectives of the Evaluation
The EE will:
- Measure progress against intended results (outcome and outputs)
- Assess relevance, effectiveness, coherence, efficiency, impact, and sustainability
- Identify good practices and lessons learned
- Assess the efficiency and effectiveness of the organizational structure of the consortium
4. Scope of Work
Evaluation Criteria and Key Questions
Relevance
- To what extent was the project design appropriate for the needs of target populations?
- How well did the intervention align with local priorities, including those of affected communities, local authorities, and clusters?
Effectiveness
- To what extent were the planned outputs and outcomes achieved?
- Were there any unanticipated positive or negative outcomes?
Efficiency
- Were inputs (funds, expertise, time) used efficiently to achieve results?
- Were the management and coordination structures fit for purpose?
Coherence
- How did the intervention complement or duplicate other interventions by local, national, or international actors?
- How aligned was it with national humanitarian policies?
Impact
- What observable changes (intended/unintended) have occurred in the target communities?
- How did the intervention contribute to improved resilience?
Sustainability
- Are project benefits likely to continue beyond the end of funding?
- What systems (community, institutional, technical) are in place to support sustainability?
5. Methodology
The EE must be methodologically sound, participatory, and gender- and conflict-sensitive. The consultant is expected to:
- Conduct desk review of project documents, including baseline reports and interim progress reports
- Review monitoring data (quantitative and qualitative)
- Conduct remote (and where possible in-person) interviews and FGDs with staff, partners, beneficiaries, and local authorities
- Triangulate findings to ensure reliability
A detailed Inception Report (maximum 10 pages) must be submitted prior to field data collection, outlining:
- Refined evaluation questions
- Proposed methodology and data collection tools
- Limitations and mitigation strategies
- Detailed work plan and timeline
- Detailed financial proposal
6. Deliverables
Deliverable Description Deadline
Inception Report Methodology, tools, work plan 20 August 2025
Online/ field mission Interviews and data collection in all countries 30/08–30/09 2025
Debriefing presentation Preliminary findings shared with AN and partners 15 October 2025
Draft Report Full draft with analysis and recommendations 25 October 2025
Final Report Incorporating comments and final submission 05 November 2025
The report should include:
- Executive summary (max. 3 pages)
- Background and context
- Methodology
- Findings by evaluation criterion
- Conclusions and lessons learned
- Actionable recommendations
- Annexes (tools, ToR, data tables, etc.)
7. Evaluation Team Composition
The evaluation will be conducted by an independent consultant. The consultant must not have been involved in the implementation of the project and must disclose any potential conflicts of interest.
Required Qualifications
- A minimum of five years of relevant experience in evaluating humanitarian or WASH/DRR projects
- Prior experience conducting multi-country or regional evaluations
- Proven knowledge of donor-funded projects (GFFO experience is an asset)
- Expertise in gender, equity, disability, and social inclusion (GEDSI) analysis
- Strong report writing and communication skills
- Master’s degree in relevant field
- Business Registration/ Certification
Desirable Qualifications and Additional Considerations
- Presence of team members or collaborators based in East Africa with access to the project countries (Somalia, Somaliland, Ethiopia, Sudan) is highly desirable. This is to enable in-person interviews and site visits, especially in areas where remote evaluation methods may not capture sufficient depth or nuance.
- Preference will be given to applicants who can demonstrate secure access to the project locations and local contextual understanding through affiliated national staff or consultants.
8. Ethical Considerations
The consultant must adhere to ethical evaluation principles, including:
- Informed consent
- Confidentiality
- Do No Harm
- Data protection (especially for vulnerable populations)
All data must be anonymised and stored securely.
9. Payment Modalities
Milestone Amount
Upon approval of Inception Report 25%
Upon submission of draft report 45%
Upon approval of final report 30%
The total available budget for this consultancy must not exceed 15.000 EUR (including all applicable taxes, fees, and reimbursable costs). Proposals exceeding this ceiling will not be considered.
10. Selection Criteria for Consultant
The consultant will be selected through a competitive process based on a combination of technical and financial proposals. The selection process will prioritize technical quality and relevant experience. There will be a shortlist of candidates who will be informed and be provided with relevant documentation for the preparation of their inception report.
Evaluation Criteria and Weighing 1st round (for shortlisting)
Criteria, Description & Weight
- Technical knowledge and past experience
Proven experience in conducting endline or similar evaluations for humanitarian WASH, Food Security, or DRR programmes; familiarity with German donor (GFFO) requirements is an asset. 30%
- Quality of submitted past evaluation report and references
Clarity, structure, and insightfulness of a previous evaluation report authored/co-authored by the applicant; relevance and strength of at least two professional references. 20%
- National presence and contextual access
Demonstrated presence or ability to deploy qualified staff/consultants in project countries(Somalia, Somaliland, Ethiopia, Sudan) to access intervention sites and conduct in-person interviews or focus groups. Local contextual understanding and secure access are highly desirable. 30%
- Value for money
Realism and cost-effectiveness of the financial proposal, including clarity of daily rates, travel assumptions (if any), and value offered for the expected scope of work. 20%
Evaluation Criteria and Weighting 2nd round
- Technical Proposal 70%
- Understanding of the ToR, objectives, and context 15%
- Soundness and relevance of proposed methodology 20%
- Appropriateness of work plan and deliverables 10%
- Clarity and structure of the inception report outline 5%
- Consideration of gender, inclusion, conflict-sensitivity and ethics 10%
- Experience conducting similar evaluations in East Africa or humanitarian contexts 10%
- Financial Proposal 30%
- Cost-effectiveness and value for money 20%
- Realism of budget and justification of costs 10%
How to apply
Applicants must submit the following before the 25th of July to the following e-mail address: [email protected]:
- CV(s) of lead consultant and any supporting team members
- Financial Proposal in Euros, indicating daily rates and expected expenses
- List of team members in-country (if applicable), indicating their role and location
- At least two references from recent, comparable evaluations
- One recent evaluation report (authored or co-authored by the applicant)
