Provision of End-Line Evaluation Consultancy 20 views0 applications

Who is the Danish Refugee Council?

Founded in 1956, the Danish Refugee Council (DRC) is a leading international NGO (non-governmental organization) present in 40 countries, with over 9,000 employees and supported by 7,500 volunteers. DRC protects, advocates, and builds sustainable futures for refugees and other displacement-affected people and communities. DRC works during displacement at all stages: in acute crisis, in displacement, when settling and integrating in a new place, or upon return. DRC provides protection and life-saving humanitarian assistance, supports displaced persons in becoming self-reliant and included in hosting societies. It works with civil society and responsible authorities to promote the protection of rights and peaceful coexistence. DRC has been operational in Kenya since 2005 and is one of the United Nations High Commissioner for Refugees’ (UNHCR) largest implementing partners in the refugee response. DRC is present in Garissa (Dadaab & Garissa), Turkana (Kakuma, Kalobeyei & Lodwar), Nairobi, Isiolo, Marsabit, Lamu, and Mandera counties.

Project Background

The micro-entrepreneurship ecosystem in Kenya is vibrant yet many entrepreneurs face a growth ceiling. Since 2015, the Danish Refugee Council (DRC) has successfully supported Community Savings and Loans Associations (CSLAs). These informal lending outfits provide vital financing opportunities to those micro businesses cut off from mainstream banking. As these businesses mature, they encounter systemic barriers that prevent them from accessing formal financial and business support services essential for long-term resilience.

Refugees in Kenya, particularly those in urban centers like Nairobi and border counties like Mandera, navigate a complex regulatory landscape. Despite the progressive Refugee Act 2021 which recognizes the Refugee ID as a valid KYC (Know Your Customer) document for financial services and business registration, financial institutions remain hesitant to lend to this demographic group due to lack of information and refugees’ perceived flight risk. The exclusion from mainstream financing leaves refugees leaves with no much option but to rely on informal CSLA funds, which are often insufficient for significant business expansion.

The SDACKED project employs a Market Systems Development (MSD) approach to unblock these barriers. By working at a systems level, DRC facilitates linkages between CSLAs and formal institutions like KCB Bank, while simultaneously advocating for policy coherence and supporting the digitization of group records. In Mandera, the project addresses thinner markets by exploring value chains in livestock and farming and promoting Sharia-compliant financial products.

Objectives of the Consultancy

The consultant is expected to conduct the end-line evaluation to the required standards. S/he will be expected to lead in the day-to-day management of the activities, including, coordinating field-level data collection, analysis, and report writing. The consultant is expected to regularly consult DRC staff while implementing the assignment.

The specific objectives of this evaluation are:

1. To evaluate the project’s effectiveness, relevance, coherence, efficiency, sustainability, and impact with a primary focus on assessing the project’s meeting of the expected results, objectives, and overarching goal.
2. To ensure accountability by evaluating whether resources invested have led to desired results.
3. To compare end-line data with baseline data to understand the magnitude of achievement and of change over time.
4. To identify pivotal lessons and potential practices for organizational learning.
5. To assess challenges, best practices, lessons learnt, and document outcomes of evidence-based recommendations, to inform future processes.
6. To conduct an outcome harvesting exercise aimed at identifying behavioural changes among the targeted community/participants, and systematically capture outcomes related to business performance, including changes in monthly income levels, income consistency, and stability.

End-line Evaluation Criteria

The end-line evaluation will employ specific OECD (Organization for Economic Co-operation and Development) evaluation criteria for humanitarian action, to guide the study, with special emphasis on sustainability.

Key Objectives/Evaluation Criteria

Key Questions to be Asked

1. Relevance/ Appropriateness

The extent to which the intervention objectives and design responded to the beneficiaries’ needs.

1. Were the project inputs, targets, and strategy (including its assumptions and theory of change) realistic and appropriate?
2. Were the project’s activities and objectives designed and implemented in a way that avoids future harm?
3. To what extent did the community and stakeholders participate in the planning and implementation of project interventions?
4. What tangible benefits or changes did the project bring to the target audience or community?
5. Did the project respond to the needs and priorities of the target groups?
6. To what extent did beneficiaries (host and refugee girls, women, boys, and men) and partners participate?
7. Was the selected target group relevant/significant?

2. Coherence

The compatibility of the intervention with other interventions.

1. Did the project’s logic allow the achievement of its objectives and results (Quality of ToC)?
2. Were the approaches coherently used?
3. Did project activities overlap and duplicate other similar interventions (funded nationally and /or by other donors)?
4. Have diverse stakeholder perspectives been integrated coherently into the project design and implementation?
5. Is there consistency in how stakeholder feedback and input have been incorporated throughout the project life cycle?

3. Effectiveness

The extent to which the intervention achieved, or is expected to achieve, its objectives and results.

1. To what extent did the project achieve its outputs, outcomes, and goals?
2. What were the major factors influencing the achievement or non-achievement of the objectives?
3. Have critical components for strengthening resilience been implemented and shown intended results?
4. Are the project outcomes likely to be sustained beyond the project’s lifespan?
5. What lessons were learned during project implementation, and how were they applied to improve effectiveness?

4. Coverage

The extent to which the intervention reached the intended beneficiaries and the geographical areas targeted.

1. Did the intervention cover all the geographical regions identified as priority areas for assistance?
2. What proportion of the intended beneficiary population was reached by the project?
3. To what extent did the interventions cover the range of services intended for the targeted population?
4. What were the key challenges or barriers that affected the coverage of the intervention?

5. Efficiency

The extent to which the intervention delivers, or is likely to deliver, results in an economic and timely way.

1. What was the relationship between the resources invested and the outcomes achieved?
2. Were the intervention activities implemented cost-effectively?
3. Were the intervention activities carried out promptly, considering the urgency of the humanitarian situation?
4. How effectively were the operational processes managed, including procurement and logistics?
5. To what extent were innovative approaches or technology utilized to improve the efficiency of the intervention?
6. How effectively did the actors collaborate and coordinate their efforts to avoid duplication and maximize efficiency?

6. Impact

The extent to which the intervention has generated or is expected to generate significant positive or negative, intended, or unintended, higher-level effects.

1. What positive and negative, intended and unintended changes has the SDACKED project generated at the individual, household, community, and market systems levels?
2. What tangible and intangible differences has the intervention made in the lives of project participants; including changes in business performance (e.g., monthly income levels, income consistency, business growth trends, financial inclusion, access to income), and the role of financial services in influencing income and business outcomes?
3. To what extent has the project contributed to strengthening community and stakeholder resilience, including improved coping strategies, access to formal financial services, strengthened CSLA systems, and enhanced linkages with market actors and institutions?
4. What broader changes, if any, have occurred within the entrepreneurship and financial inclusion ecosystem (e.g., financial institutions, local markets, service providers, policy or practice shifts) as a result of the project’s Market Systems Development approach?
5. How likely is it that the observed positive changes will be sustained in the short- and medium-term at both beneficiary and systems levels, and what factors may enable or constrain sustainability?

7. Sustainability

The extent to which the net benefits of the intervention continue or are likely to continue.

1. To what extent did the planning and implementation of the interventions take longer-term and interconnected problems into account?
2. Did the project plan and implement an adequate transition and exit strategy that ensures longer-term positive effects while reducing the risk of dependency?
3. How effective is the exit strategy and approach to phase out assistance provided by the project, including support for public policy dialogue?
4. How well are the project’s outputs linked to more long-term focused objectives?
5. What are the key factors/areas that will require additional support/attention to improve prospects of sustainability of the project outcomes and the potential for replication of this approach?

8. Learning and Replicability

What worked well, lessons learned, and potential for replicating successful approaches.

1. What are some of the key lessons learned as a result of this project that can be shared and replicated?
2. What are the recommendations for similar future interventions?
3. What mechanisms have been established to capture, document, and share the lessons learned and the best practices from the project within the community and other stakeholders?
4. Can the knowledge and skills acquired through this project be easily replicated and used in similar contexts in other regions?
5. How have the project activities contributed to building the capacity and knowledge of the community members?
6. What evidence exists to support the replicability of the project’s approach and outcomes in other settings?

5. Responsibilities

The general responsibilities of the consultant are:

• Propose a sound evaluation methodology and tools, in line with the stated objectives.
• Develop a consultancy work plan.
• Review project documents, prepare an inception report, and data collection tools for review and feedback.
• Review existing secondary literature to inform development of the conceptual framework and data collection tools.
• Develop the end-line data collection schedule and suggest respondents to be selected to participate in interviews.
• Conduct data collection in line with data protection regulations and perform data quality checks to ensure accuracy, validity, and integrity.
• Conduct field visits and interviews with project stakeholders, beneficiaries, and partners.
• Conduct data cleaning, processing, and analysis.
• Prepare and submit a draft evaluation report for review and feedback.
• Validate findings with DRC, i.e., preliminary presentation of the report.
• Participate in a project outcomes event to be convened by DRC which will be geared towards showcasing successes and lessons from the implementation of the project.
• Submit a comprehensive final evaluation report and annexes.

The general responsibilities of DRC are:

• Provide access to project documents, reports, and relevant data for the evaluation.
• Facilitate the consultant’s access to project sites, beneficiaries, and key informants.
• Brief stakeholders about the purpose of the evaluation.
• Participate in key informant interviews and discussions as required.
• Review the evaluation methodology, including data collection tools designed by the consultant.
• Review and provide feedback on the draft evaluation report.
• Act on the recommendations provided by the evaluator to improve future project planning and implementation.
• Prepare and effect payment to the consultant, in instalments as agreed upon completion of the set milestones in the assignment.

6. Scope of Work & Methodology

The evaluation should be done within the existing national, legal, and regulatory frameworks. The methodology should entail a comprehensive assessment of the SDACKED project as per the project design. It will also involve conducting a thorough evaluation, utilizing a mixed-method approach, integrating both qualitative and quantitative data collection methods. The sample size should be a representation of the total population, both sexes, age groups, communities, and coverage. The evaluation will assess the effectiveness, efficiency, impact, relevance, sustainability, and coherence of the intervention in relation to relevant policies and best practices. The assessment will focus on engagement, ensuring the participation of diverse stakeholders such as the targeted population, project team, implementing partners, and local authorities, throughout the evaluation process.

The final deliverable will be a detailed evaluation report containing key findings, analysis, and actionable recommendations, all while upholding the highest ethical standards in data collection and analysis. The evaluation is expected to be completed within a maximum period of 30 days (within the month of April 2026) from the time of signing the contract with the successful bidder.

The evaluation will follow a collaborative and participatory mixed methods approach that draws on both existing and new quantitative and qualitative data to answer the questions. There should be combined evaluation tools based on international standards and guidelines for evaluating humanitarian action.

The methodology design should be developed by the consultant in consideration of the information outlined in this ToR to ensure accuracy and rigor.

To assess change over time, end-line findings will be systematically compared against baseline values for all common indicators using the project’s approved monitoring and evaluation framework. The evaluation will assess emergent and contribution-based indicators related to business performance and general financial inclusion. These indicators are critical for understanding the project’s contribution to changes in income, income stability, and business growth. Measurement will rely on retrospective self-reported data, financial records where available, qualitative narratives, and outcome harvesting techniques to triangulate findings and assess the plausibility of contribution.

As part of the end-line evaluation, an outcome harvesting approach will be integrated to systematically identify, document, and verify significant intended and unintended outcomes that have emerged during project implementation. The outcome harvesting process will intentionally capture outcomes related to business performance improvements, income stability, changes in access to and use of financial services, and shifts in relationships between entrepreneurs and financial institutions, including evidence of how access to finance has influenced business outcomes. The outcome harvesting process will draw on key informant interviews, focus group discussions, document review, and stakeholder validation to ensure credibility and relevance of the identified outcomes.

Detailed methodology and data collection methods will be included in the technical proposal, which will be further defined and fine-tuned during the evaluation´s inception phase, in consultation with all key stakeholders. Modalities of communication, feedback mechanisms, and contact with stakeholders will be discussed further during the inception phase.

The tools that will guide the development of the methodology include:

• Desk Review

A desk review will be conducted by the consultancy firm to inform the methodology and development of the tools. In addition, the conducted desk review should cover the following documents: project proposal, M&E plan, interim reports, existing data collection tools, and secondary literature related to the measurement of goal and outcome level indicators. The desk review process should serve as a guide for the consultant to continue gathering resources that would enable him/her to carry out the development of tools.

• Documents Review

The consultant will be furnished with relevant documentation to support the desk review of secondary information. The consultant will be encouraged to identify any other sources for appropriate additional information that may be required to supplement what is provided by the project. Project documents available include:

• Project proposal.
• Project progress reports.
• Monitoring data (Indicator Performance Tracking Tables & Monthly Monitoring Tools), and any other appropriate additional information that may be required to supplement what is provided by the project, including assessment and evaluation reports by other financial inclusion programmes.

Other components/aspects to factor in the methodology for the evaluation are:

1. Quantitative Component

• Target population

The end-line evaluation will cover areas in Nairobi across six clusters (Kasarani A, Kasarani B, Kasarani C, Kawangware, Kitengela, and Eastleigh) and Mandera across three clusters (Central, Neboi, and Township), where the SDACKED project activities were implemented. The key informants will include DRC SDACKED project team, CSLAs (Community Savings & Loans Associations), local leadership, relevant line national and county government ministries/departments, and other partners within the areas of implementation.

• Sample size

The sampling strategy will be identified and described by the consultant and approved by DRC. It should be representative and randomized. It should also be selected from all relevant settings targeted by the project to ensure, representation of all community members from all age groups, nationalities, sexes, and areas of residence.

• Sampling process

The sampling process will be identified and described by the independent consultant/consultancy firm as relevant to the target groups.

• Tools

All the tools (questionnaires and interview guides) will be developed by the consultant. All tools should be pre-tested in some selected project locations before application.

• Data Collection and Quality Check

Before data collection, enumerators will be recruited by the consultant, in coordination with DRC Kenya. They will be informed about the study, its objectives, and the methodological approach, and trained on the tools’ administration (detailed review of the tool and practice), ethical considerations, safeguarding, child protection, data confidentiality, and field logistics. DRC Kenya will co-facilitate the training, especially on the code of conduct and project scope.

The data collection process will be done through face-to-face interviews (household surveys), applying accepted standard procedure as per policy requirements. Digital and paper-based data collection will be completed using mobile phones and/or paper (hard copies), depending on the setting, resource availability, and feasibility from the consultant’s end, while ensuring accuracy and quality. All data sets and documents will be submitted by the consultant to DRC Kenya for its record and verification.

As for quality assurance, it will be ensured by the consultancy firm throughout the data collection process through regular follow-up with enumerators during field visits, as well as debriefs after the end of each day. There shall be a regular review of data sets (directly retrieved; in the case of mobile data collection).

DRC Kenya MEAL (Monitoring, Evaluation Accountability & Learning) and the project team will also randomly review the data sets for validation purposes. Data will be entered into statistical software and cleaned and analyzed by the consultant.

1. Qualitative Component

Qualitative data collection (FGDs- Focus Group Discussions, KIIs- Key Informant Interviews, and case studies) will complement and validate the quantitative component and will further explore the perceptions of the targeted beneficiaries regarding the proposed intervention in the targeted areas.

• Target population

The target population will consist of the project team and partners, entrepreneurs, respective national and county government representatives, stakeholder organizations, and target host and refugee community members.

• Sampling

The qualitative sampling strategy should be identified and described by the consultant and approved by DRC Kenya. It should consider the organizational and scientific standards. The overall sample should be representative. It should also be selected from all relevant settings targeted by the project, to ensure representation of all the age groups, nationalities, gender and targeted locations.

• Selection criteria

The selection of participants for the FGDs will depend on the target population and is to be described by the consultant in detail. The selection of participants of the KIIs depends on the relevant stakeholders to be interviewed and is to be described by the consultant in detail.

• Data collection, management, and analysis

The consultant is responsible for the qualitative data collection. Selected participants will be contacted by the project team and partners and invited to participate in the FGDs/KIIs after explaining the purpose of the meeting and ensuring the confidentiality of discussions and ideas shared.

The consultant should ensure that notes are taken. The note takers should also observe the interaction of the FGD/KIIs participants during the meetings. DRC Kenya will ensure the quality of the process and track the schedule and number of FGDs/KIIs conducted. Once data is collected, all FGDs/KIIs will be transcribed by the consultant as notes, coded, and analyzed using qualitative data processing and analysis methodology.

The consultant is expected to propose scientifically, culturally, and socially appropriate approaches that will be used to answer the questions raised in this ToR. A mixed method will be used (both quantitative and qualitative) to assess the impact and multiplier effect of the interventions.

1. Ethical Considerations

The end-line evaluation will respect the essential ethical guidelines concerning conducting a study. It is crucial to ensure that risks of potential harm to participants resulting from the data collection process are minimized and are outweighed by the potential benefits of the outcomes of the study.

Generally, the consultant will consider the following key ethical considerations during the evaluation process:

1. Respect for Beneficiaries: The consultant should consider the dignity, rights, and well-being of the project beneficiaries, ensuring their informed consent and meaningful participation in the evaluation process.
2. Data Confidentiality: The consultant must safeguard the confidentiality of all sensitive data collected during the evaluation, ensuring that personal information and individual responses remain secure and anonymous.
3. Avoiding Harm: The consultant should assess potential risks and ensure that the evaluation process does not inadvertently cause harm or distress to the project beneficiaries or community members.
4. Transparency and Accountability: The consultant should provide transparent explanations of the evaluation methods, purposes, and potential impact to all relevant stakeholders, fostering trust and accountability in the evaluation process.
5. Cultural Sensitivity: The consultant must demonstrate cultural sensitivity and respect for local norms, traditions, religious convictions, and customs, adapting the evaluation approach to align with the cultural/religious context of the project area.
6. Key Deliverables
7. Inception report (describing):

• A detailed methodology on how the information and data will be collected and analyzed. The conceptual framework should be included as part of the methodology.
• A detailed sampling framework for location, respondents, and relevant documents for review.
• A detailed plan of action on quality control measures to be applied.
• Detailed work plan and indicative work load.
• Presentation of the methodology, sampling, data collection tools, and action plan.

1. First draft evaluation report, submitted for review by DRC Kenya.
2. One validation workshop to present key findings and recommendations to DRC for validation.
3. The consultant shall also be required to make a presentation on the key findings of the end-line evaluation and outcome harvesting activity to a larger stakeholder audience during the project results event.
4. Final report: A comprehensive evaluation report highlighting the findings and practical recommendations (incorporating feedback from DRC), stakeholders and project participants.
5. Annexes including:

• Datasets (raw data, photos, etc.)
• Validation workshop presentation.
• Feedback from the project outcome event.

1. Duration, Timeline & Payment

The consultant will submit the following deliverables as mentioned below:

Phase

Expected deliverables

Indicative description tasks

Maximum expected timeframe

Phase 1: Inception

Inception Report

• Prepare a detailed work plan with clear timelines and deadlines.
• Review key project documents and reports.
• Refine the evaluation framework and methodology.
• Develop data collection and analysis methodology, including the conceptual framework.
• Design a detailed sampling framework for locations, respondents, and document review.
• Deliver a presentation on methodology, sampling, data collection tools, and the implementation plan.

7 days

Phase 2: Field Work, Analysis, and Report

• Draft end-line evaluation report.
• Final end-line evaluation report.
• Conduct data collection.
• Perform data quality checks to ensure accuracy, validity, and integrity of the data collected.
• Conduct data cleaning, processing, and analysis.
• Prepare and submit a draft evaluation report and other products for review and feedback.
• Address feedback and submit the final evaluation report and annexes.

22 days

Phase 3: Validation of Findings

• One validation workshop facilitated.
• Validation workshop presentation
• Present key findings and recommendations to DRC and other stakeholders.

1 day

The budget should include the consultant’s fee and taxes, any travel and expenses that might be required for data collection (keeping in mind that data collection will also be conducted in Nairobi and Mandera East sub-county), and any costs related to telephone, transcriptions, software licenses, and office material.

DRC Kenya will pay the full consultancy fee in Kenya shillings, as agreed upon in the contract. Payment will be made on approval of the key deliverables, to DRC Kenya in the following distribution:

• 30% of the fees will be paid upon submission of a satisfactory Inception Report.
• 30% upon completion and submission of the first of the Final Report.
• 40% will be paid after submission and acceptance of the final report, which shall include additional contributions from the validation workshop and project outcome event.

1. Proposed Composition of the Consultancy Team

The consultancy team should comprise of:

• Lead and assistant consultant.
• Enumerators.
• Data Analysts.

1. Eligibility, Qualification, and Required Experience

The desired specification and qualities of the consultant(s) are:

• Must be registered under the Laws of Kenya;
• Should have at least 5 years’ experience in conducting end-line surveys/evaluations, with a proven track record related to assessment of CSLAs, micro-enterprises, and general work on financial inclusion;
• Advanced degree in Statistics, Monitoring and Evaluation, Development Studies, Economics, Social Sciences, or related fields; with extensive experience in research and data management.
• Excellent spoken and written communication skills in English and Kiswahili. Knowledge of Somali will be an added advantage.
• Good data analysis, presentation, and visualization skills.
• Excellent written and speaking skills with ability to articulate ideas clearly and accurately.
• Expertise in preparation of reports.

Desirable:

•Working experience with hosts and refugees in Nairobi and Mandera is an added advantage;

•Strong interpersonal and analytical skills with the ability to establish and maintain effective working relations.

•A solid understanding of Kenya’s economic and cultural context especially in refugee space.

1. Technical Supervision

The selected consultant will work under the supervision of the:

• SDACKED Project Manager.
• DRC MEAL team.

1. Location and Support

The assignment will be coordinated from the DRC Eastleigh Urban program office, although part of the work shall also be supervised from the DRC Mandera Field Office. The consultant will use his/her computer and telephone to do the exercise.

DRC will provide relevant documentation and background information, approve data collection tools and reports, participate in data collection as one of the informants, support in the mobilization of community-level stakeholders, provide consolidated feedback/guidance on draft reports and stakeholder mobilization during the validation workshop.

1. Travel

The Consultant will be expected to arrange for his/her own transportation, meals, and accommodation in the field areas (Nairobi and Mandera, for data collection). The consultant is also expected to make adequate provisions for this in the Financial Proposal.

1. Submission Process

Interested applicants who meet the requirements are invited to submit an expression of interest, including:

• A suitability statement including CV(s) of participating consultant(s) with details of qualifications, skills, and experience.
  • Technical proposal that summarizes understanding of the TOR, methodology, and tools to be used.
  • Work plan indicating the activity schedule.
  • Financial proposal providing cost estimates and consultancy fees.
  • At least two sample reports presented for a previous end-line consultancy assignment conducted in the recent past.
  • Contact details of three organizations that have recently contracted the consultant to carry out an end-line evaluation.

How to apply

The bidding documents are available and can be accessed through the following link; RFP 0035620 – Provision of End-Line Evaluation Consultancy

Proposals must be submitted to the following address: [email protected] with ‘Provision of End-line Evaluation Consultancy’ in the subject line. The deadline for submitting the proposals is 25th March 2026 at 1700HRS EAT