END PROJECT EVALUATION-HEALTH, WASH AND PROTECTION FOR IDPs AND RETURNEES IN BAIDOA 96 views0 applications

TERMS OF REFERNCE FOR

END OF PROJECT EVALUATION

HEALTH, WASH AND PROTECTION FOR IDPs AND RETURNEES IN BAIDOA

JANUARY 2021.

GLOSSARY

AWD Acute Watery Diarrhea

CBO Community Based Organization

CMR comprehensive medication review

CWB Child Wellbeing

DME Design Monitoring & Evaluation

EARO East African Regional Office

FGD Focus Group Discussion

GAC Global Affairs Canada

GBV Gender Based Violence

H/Hs Households

IDP Internally Displaced Persons

ITT Indicator Tracking Table

KIs Key Informants

MCHCs Maternal Child Health Centers

MoE Ministry of Environment

MoH Ministry of Health

NFI Non Food Items

NGO Non-Governmental Organization

NO National Office

ODK Open Data Kit

PDU Programme Development Unit

QA&S Quality Assurance & Startegy

SLT Senior Leadership Team

SO Support Office

SPSS Statistical Package for Social Sciences

SWS South West State

ToR Term of Reference

UASC Unaccompanied and Separated Children

UN United Nations

WASH Water Sanitation and Hygiene

WVC World Vision Canada

WVI World Vision International

WVSOM World Vision Somalia

1.0. INTRODUCTION

Description of the project to be evaluated

In April 2019, WV Somalia received funding from GAC to implement a two-year project in Baidoa district, South West State of Somalia. The project specifically targeted IDPs in Baidoa town and surrounding villages due to the identified need and vulnerabilities. This two-year project started on 1^st April 2019 and is scheduled to end on 31^st march 2021. The project adopted an integrated approach aimed at maximize impact in targeted areas thus focused on three inter-connected sectors i.e. health, WASH, child protection and GBV at both household and institutional level (Maternal Child Health Centers – MCHCs, Health posts and schools). This approach has allowed World Vision to build on previous achievements and existing relationships so that richer gains, such as mitigation of risks associated with GBV, behavior change in longstanding sanitation practices and transition of programming, can be realized. Owing to the challenging context and the enormous needs in Baidoa, World Vision collaborated with South West State Government ministries (MOH, MOEWR, Min of Gender) in delivering the project to IDPs, returnees and host communities.

The project targeted reaching out to 358,001 people (147,442 women 73,174 girls, 66,850 boys and 70,535 men) in Baidoa affected by May 2018 floods, cyclical droughts, continuous Al-shabab offense and forced eviction. The project was designed to capitalize on the trusted relationships that have been fostered in the previous support and would use approaches to reduce reliance on external agencies. Through the project, World Vision was to operate ten health posts, two mobile clinics, two maternal, and child health centers. Preventative health measures would be taken in the form of routine immunization and continuous screening to allow health workers to properly refer and treat acutely malnourished children under five and pregnant/lactating mother for appropriate care in Outpatient Therapeutic Programs, Targeted Supplementary Feeding Programs or Stabilization Centers using a community management approach. Infant youth and child feeding (IYCF) practices were also to be promoted amongst caregivers and leaders. The project was also to drill and equip one borehole and restore and construct seven shallow wells in communities and at MCHs. Two MCHs were also planned to have institutional latrines and garbage pits to enhance sanitation. Seven Community Management Committees would be equipped and trained to provide leadership in the cause of sanitation. Hygiene campaigns were to be accompanied by provision of WASH NFIs for household usage. In addition to addressing health and WASH needs, the project sought to respond to underlying risks of GBV and CP. INTERSOS was to lead the process of strengthening referral systems, training health facility staff in comprehensive medication review CMR and providing case management for survivors of GBV and unaccompanied and separated children. The project planned to continue chipping away at deep-rooted assumptions about gender equality and child rights by leading community-wide and targeted GBV and CP awareness raising campaigns with women, men, girls and boys.

1.1 Project Goal

Lives saved, suffering alleviated and human dignity maintained for people and communities in Somalia continuing to experience humanitarian crisis as a result of conflict and cyclical food insecurity

Table1: Project Outcome and Outputs

Narrative

Outcome

Indicator(s)

Project outcomes

1. Increased access to emergency nutrition services and lifesaving primary healthcare services, particularly for women and girls, with emphasis on disease prevention, treatment, and healthcare system strengthening

· # of medical consultations provided by age group and gender

· % of pregnant women who attended at least 4 ANC visits

· Proportion of infants whose births were attended by a skilled birth attendant

· Proportion of children exclusively breast-fed until 6 months

1. Improved access to and use of sustainable sources of safe water, sanitation facilities and hygiene practices conforming to cultural norms, gender, and protection needs of users

· % of targeted household population using minimum of 7.5L/person/day

· % of population using a safe water source.

· % of targeted households using latrines on a daily basis

· % of targeted households practicing hand washing after critical times

1. Increased access to protective services, particularly for gender-based violence survivors and children vulnerable to protection violations

· % cases identified referred by different service providers (health, nutrition and education including outreach staff)

· % cases identified referred to services by community focal points

Project outputs

· Health systems and clinical support for PHC services improved

· Access to reproductive, maternal and newborn healthcare services increased

· Immunization services and communicable disease management provided

· Improved nutrition care services provided to beneficiaries

· Community water points rehabilitated and/or constructed

· Sanitation facilitates constructed

· Community management structures for water and sanitation facilities maintained

· Knowledge of safe health and hygiene practices improved among households and communities

· Referral system strengthened among service providers and community actors

· Case management, psychosocial support and interim care for gender-based violence survivors and vulnerable children provided

· Men, women, boys and girls community members and duty bearers actively engaged to protect women and children from protection risks

Embedded in the Performance Management Framework attached as annex 1

Primary Sector/s

§ Health & Nutrition

§ WASH

§ Protection (including GBV)

NA

Project Duration

· 1^st June 2019 – 31^st March 2021

NA

2.0. EVALUATION OBJECTIVE

Objective: The evaluation is intended to establish the extent to which the project’s objectives (Outcomes and outputs) were achieved, understand the project’s contribution to child wellbeing, facilitate analysis of lessons learnt (what went well and what did not go well), and make recommendations that will influence future interventions in Baidoa and similar contexts. Largely the evaluation will help in informing all project stakeholders on the extent to which the intended outcome and output objectives were achieved as well as highlight the relevance, appropriateness, effectiveness, sustainability, impact and lessons learnt from the interventions.**

This will be an external assessment which will necessitate, undertaking a complete review and analysis of the program design document (Narrative Proposal) and its annexes including: Budget, Log frame, M&E plan and ITT together with progress reports (financial, narrative & monitoring) and available strategies (Somalia NDP & WVS NO Strategy).

Scope

Geographic area and target population

Since the project has been implemented in selected areas within Baidoa district, the evaluation will take place in these primary project areas. **

Depth of investigation

Since this is the summative evaluation, it will assess the progress of the project towards the project goal and outcome starting April 2017 to March 2021 and delve into the details in table 3.

Community level partners

The evaluation will involve all stakeholders that were involved in the project design and implementation including:

· Community groups and committees involved in project implementation (WASH, H&N and Protection

· Implementing partners (INTERSOS, Ministry of Health, Ministry of Gender, Ministry of Water and Mineral Resources)

· Local Administration offices involved in the project implementation – District Commissioner’s office

3.0. METHODOLOGY

3.1. Study design

This will be a cross sectional and will employ a mixed method approach in data collection, triangulation and analysis drawing on quantitative and qualitative data. Both primary and secondary data will be collected, reviewed and analyzed. Household questionnaire survey (HS), focus group discussions (FGDs) and key informant interviews (KIIs) will be used to gather primary data involving both direct beneficiaries & indirect beneficiaries. The study will have three phases intertwined in the evaluation process:

§ Phase one: – will involve a comprehensive review of secondary information based on the existing project information from the proposal, detailed implementation plans, quarterly & annual reports, monitoring reports, and any other relevant reports.

§ Phase two:- quantitative household survey using structured questionnaire

§ Phase three: – qualitative information gathering using observations, FGDs and KIIs

In order to further ensure the quality of evidence, the evaluation will be designed with reference to the Bond Evidence Principles Checklist. Specific reference will be made to the 5 key dimensions of voice and inclusion, appropriateness, triangulation, contribution and transparency.

3.2 Rationale for the choice of mixed methods design.

The mixed design focuses on both quantitative and qualitative approaches in data collection, analysis and presentation[1]. Mixed methods approach has emerged as a practical methodology in conducting assessments and evaluations for projects as it gives greater insight into phenomena through information validation and triangulation. Advantages of the methodology include the following:

§ Data from different sources provides an opportunity to understand changes from different standpoints. One data source may not be enough to give explanations to behavior, results and practices

§ Peculiarity in data collection leads to greater validity as information omitted by one method can be augmented by another source.

§ This method answers evaluation question from a number of viewpoints. It Ensures that there are no ‘gaps’ to the information collected

§ The method is helpful when one methodology does not provide all the information required.

§ It’s a good methodology for social, health and behavioral studies as it interacts with several stakeholders and utilizes all available from multiple levels and lines of evidence n to reach a conclusion.

To actualize this design, the evaluation will target different stakeholders and population groups using different data collection methods i.e. structured questionnaires and focus group discussions for targeted households (both direct and indirect beneficiaries), key informant interviews for project partners, staffs, government technical units (MoH & Ministry of Interior), document reviews for secondary data, observations for WASH and health infrastructure established and oral narratives for selected beneficiaries. All information gathered from these sources will be synthesized and analyzed to answer the evaluation question.

This evaluation will be led by consultant with overall leadership from WV Somalia Quality Assurance and technical support from WASH, Health & Nutrition and Protection Technical team. The consultant will adopt appropriate tools including interview/discussion guides, household questionnaire, and observation checklist. Upon the finalization of tools (FGD guide, KIIs and household questionnaires), a training will be organized in Baidoa targeting all evaluation team members including enumerators, project partners and staff. This training will aim to empower the evaluation team with the project logic model and evaluation criteria, survey scope, instruments, planning and management of the survey.

3.3 Sampling Design

Quantitative Data: While designing the survey tool, the consultant will consider various factors. For this evaluation, quantitative approach will only be employed in gathering information at household level with focus on mothers with under five children and/or household care takers. The sources of indicator vary for different indicators. Items covered in the questionnaire will be framed from project outputs, outcomes and goal. Further in this approach, the evaluation team will adopt probability proportional to size (PPS) sampling technique designed by Taro Yamane (1967) with taking into consideration sample size used at baseline. This should be well elaborated in the inception report. With the help of local administration, the household numbers for the target villages will be obtained before commencement of study to facilitate scientific determination of the sample size. This will be based on the household numbers from each village falling within the project scope. Probabilistic methods will then be used to sample the key respondents at household level.

Scientific sampling will guarantee randomness in selection of respondents, validity and reliability of data collected. To generate the sample size from the population, the team will use the online sample calculator (generator) to arrive at the total households to be targeted for the evaluation.

Qualitative Data: Physical observations, Focus Group Discussions (FGDs) and Key Informant Interviews (KIIs) will be carried out with beneficiaries and stakeholders to understand the extent to which the project achieved the intended objectives and addressed community needs. The FGD guides will contain a checklist of questions generated from the main project objectives and activities. The evaluation team working together with project staff will select the participants of the FGDs based on the focus of the study. Mothers with children under five will be purposively included for the FGD.

The focus groups will target key stakeholders including beneficiaries, comprising; Pregnant and lactating Women (PLW), CHWs, WASH Committees, Protection Committees, facility staff, camp leaders, youth clubs and children’s clubs among others. Every FGD will have standard 6-12 participants within the project areas. For purposes of plural investigation, the exercise will be conducted with a broad range of representation within the community to enable triangulation of findings and incorporate wide-ranging perspectives.

Key Informant Interviews (KIIs) will be conducted with a wide range of stakeholders including; WV Project staff, Government officials from MOH, MoEWR & Min of Gender, Health facility in-charges and other implementing partners working within the project area.

Note: The evaluation team will also consider gathering information on the impacts of COVID-19 as a cross cutting theme by deliberately incorporating key questionnaires related to the pandemic. Key questions will be developed by the evaluation team or provided by WV QA&S team.

3.4 Documents review

The evaluation team will undertake a thorough review of all available project documents as deemed necessary to gather vital information on the project design, implementation and monitoring processes as well as capture significant lessons registered over the lifetime of the project. Of necessity, the evaluation team will review the following literature:

ž Project proposal including logic model, M&E Plan, ITT, DIP & Budget

ž World Vision Somalia National Office Strategy 2016-2020/25

ž Field Level Agreements signed between WVSOM and GAC.

ž MOUs signed with line ministries

ž Project progress reports

ž Activity Reports

ž Any other relevant documents by FSNAU, UNICEF, UNOCHA, INGOs etc.

Additionally the team will look at government strategic documents and reports, SDG targets and WVI child wellbeing outcomes to enable comparisons (where applicable) and validation of the findings.

3.5 Field Processes

Selection and training of enumerators: Enumerators with previous research experience and the ability to speak Somali language will be recruited. Key government official from Ministry of health and Water resources and social affairs will be engaged in order to support the process. Depending on sample size, a total of [xxx male, xxx female] enumerators will be engaged for evaluation and these will work hand-in-hand with M&E Officers during data collection. The field team (enumerators & M&E Officers) will be trained in data collection techniques using KOBO platform and mastery of the data collection tools before field data collection exercise. During the training, the field team will also be briefed on the objectives of the evaluation, how to identify the appropriate respondents at various levels and how to fill in the questionnaire appropriately. Emphasis will be put on research ethics, accuracy, and completeness among others

Data collections tools and methods: As indicated, the evaluation will use both quantitative and qualitative tools and methods for data collection, analysis and presentation. Information triangulation (using different methods) will be used to guarantee that the evidence supporting any conclusion drawn is representative of the situation. The evaluation will employ the following data collection methods during the evaluation;

· Household interviews will be conducted using structured questionnaires

· Key Informant interview will be conducted using KII Guide

· Focus group discussions will be conducted using Focus Group Discussion Guide

Research ethical code will be applied throughout the study design, data collection and analysis phases. This will be reinforced during the survey team training.

Field data collection:** The team will use mobile phones configured with KOBO mobile application for data collection (Uses WV server). The interviews and discussions will be conducted mainly in Somali language. Focus group discussions will be conducted by a key researcher using a predetermined focus group guide with relevant themes and sub-themes, while Key informant interviews will be conducted using a predetermined guide with open ended questions for specific informants.

Analytical framework:** The evaluation team will use the project logic model and the evaluation criteria set out below to address the evaluation objectives as attached below. The tools and data collection will be aligned to this framework with emphasis on gender and social inclusion, and other cross cutting issues such as COVID-19 and locust invasion.

Table 2: Evaluation criteria and questions[2]**

Evaluation Objectives

Suggested Key Questions

Rationale for asking Key Questions

Suggested Approach (To explore key question)

Assess the Relevance and appropriateness of the project design to the community needs

· Was the project in line with local needs and priorities, targeting the right areas, people with the right interventions?

· Was the project sensitive to the culture, gender and social inclusion of women, girls, boys and men?

· Were the interventions in line with government National plans/strategies?

· Was the intervention aligned to the child wellbeing outcomes and WVS Strategy (FY2016-2020/25)?

· Was the selection criteria appropriate for identifying and reaching target communities and households?

· What measures were put in place to ensure that the project stakeholders were adequately informed of the project interventions and their roles in it?

· To what extent did the key stakeholder groups (desegregated by age/sex and other level of vulnerability) participate in the management and implementation of the food aid project?

· Did the activities contribute to the outcome and the objective of the project? Were there gaps in any sector, if yes, what are they and what more or different could WV Somalia, WVC, GAC and other stakeholders do to address the problem?

A thorough elaboration on these questions, will enable world Vision and stakeholders;

· Clearly understand whether the project design was based on community priority needs.

· Understand whether the design and implementation took care of cultural sensitivities given that the fragile context.

· Clearly document whether the project was aligned to government plans, CWB targets and WVS strategy for purposes of compliance.

· Understand the beneficiary selection criteria used and whether it conformed to the set standards.

· Establish and properly document the contribution of the project to intended changes in the communities

· Establish and document whether the project management were responsive to community needs

1. Thorough document review should be conducted to establish the set strategies and how they were addressed by the design.
2. A comprehensive household survey will be implemented to measure outcome indicators that were set in the design and any other indicators that are critical for child wellbeing

Assess the efficiency of the project in delivering and achieving project outputs and outcomes.

· Were the outputs and activities appropriate for achieving project outcomes?

· Did the project adopt the most efficient approach in implementation?

· How well did the management structure support/facilitate program implementation? Was project management responsive to changing conditions on the ground?

· Was the project implementation in line with the planned objectives?

· How successful was the project in integrating with other sectors (beyond WASH, Health and Protection)?

· How the project was efficient in terms of budget spent compared to the number of people who benefited from the project. How efficient is this project compared to other similar interventions either by WV or local partners?

The key questions will enable WV and partners to:

· Clearly understand and document the extent to which outputs were adequate for achievement of outcomes.

· Assess the approaches adopted during implementation, and their appropriateness in delivering results.

· Clearly understand the management structure and its contribution to the success implementation of the project.

·

1. A comprehensive household survey will be implemented to measure outcome indicators that were set in the design and any other indicators that are critical for child wellbeing;
2. Key informant interviews and focus group discussions will include questions on key impact; attribution; enabling factors; unmet needs; etc.
3. Thorough document review should be conducted to establish the set strategies and how they were addressed by the design

Assess project effectiveness (progress of implementation and key outcomes achieved including the contribution on wellbeing of children)

· Did the project achieve the objectives and the targets?

· Were project activities implemented effectively to achieve maximum benefit within the context; including community engagement, trainings, community sensitisation etc.?

· What are the factors that hindered/assisted the effectiveness of the project?

· How did beneficiaries perceive the value of the project compared with other alternatives?

· Have there been any un-intended benefits or negative consequences? How did the project mitigate these consequences?

· How did the project relate with other partners or stakeholder? What were the challenges in working with other partners or stakeholders? How did the project try to address these challenges

· Did WVS put in place adequate and effective systems for ensuring accountability and transparency in the management and implementation of the project? Were these systems adhered to? Why or Why not?

These questions will enable WV and partners to:

· Clearly document the impact of IHA interventions to the communities

· Identify and document any un-intended consequences of interventions (both positive and negative)

· Assess the extent to which any observed impact(s) could be attributed to WV or other partners?

· Analyse the performance of the projects against set targets (projects, critical activities, outputs) and document factors that contributed to meeting/not meeting/exceeding targets

1. A comprehensive household survey will be implemented to measure outcome indicators that were set in the design and any other indicators that are critical for child wellbeing;
2. Key informant interviews and focus group discussions will include questions on key impact; attribution; enabling factors; unmet needs; etc.
3. Thorough document review should be conducted to establish the set strategies and how they were addressed by the design.
4. Key informant interviews and focus group discussions will include questions on key impact; attribution; enabling factors; unmet needs; etc.

Assessing sustainability of key activities, outputs and outcomes that have been initiated by project

· What mechanisms have been put in place in order to sustain the key activities, outputs and outcomes that were initiated by the project activities?

· Who are the key partners WV has worked with? What roles did they play? What motivations /mechanisms exist for partners to continue playing these roles?

· What key behavioral changes have the project facilitated? What is the likelihood of continuity of these changes

· What, if any are the risks facing sustainability of key activities, outputs and outcomes? What can be done to strengthen sustainability during the next phase of the program?

Under this objective, WV and partners will be able to:

· Identify key enablers of sustainability that can be strengthened during the next phase

· Identify key risks of sustainability that need to be addressed in order to achieve broader impact and sustainability.

1. Key informant interviews and focus group discussions will explore strengths and weaknesses related to sustainability;
2. Through household survey, document reviews and observation, the survey team will assess the likelihood of continuity of key project outputs (e.g., infrastructure constructed, community groups’ set-up, etc.)

To establish and document key lessons learned during the project implementation

· What key lessons were learnt by staff, management and stakeholders throughout the implementation of the program

· What key challenges were experienced/witnessed by staff and management in the implementation of the program? How were they able to address the challenges

· What possible recommendations do staff and stakeholders put forward for any related future interventions

· What best practices emerged from the project implementation across the different sectors? To what extent can they be scaled up?

· What innovations were integrated in delivering humanitarian response across the different sectors during COVID-19?

· Have COVID-19 preventive and control measures implemented by the targeted communities?

· What specific impacts COVID-19 brought out to the targeted community?

This will help WV and Partners;

· Clearly understand the key lessons that were learnt during the program implementation. This would be able to inform future designs.

· Document best practices and innovations for possible scale them up in future projects.

· Assess if the COVID-19 preventive and control measures were well implemented in the project area

· Assess negative impacts of COVID-19 to the targeted community

1. Key informant interviews and focus group discussions will explore strengths and weaknesses related to sustainability.

3.6 Analysis and reporting:

The household questionnaire will be automated using Kobo collect application and completed questionnaires on Kobo will be uploaded to the server and later exported into Statistical Package for Social Sciences (SPSS) package Vs. 21 for analysis. Descriptive statistics including the frequencies, percentages and proportions will be used in the quantitative analysis based on responses under each question. Cross tabulations will be used to measure variation of information among different groups of respondents and from various administrative units where necessary. Qualitative data will be analyzed using thematic and content analysis by the help of analysis sheets.

Finding and conclusions: Findings and key indicators will be presented in form of text, graphics and tables. The survey lead team will prepare the report in a user-friendly format, following the structure provided at end of the TOR. This section will present findings as statements of fact that are based on analysis of the data. The evaluation findings will be structured around the evaluation criteria and questions so that report users can readily make the connection between what was asked and what was found. Variances between planned and actual results will be explained, as well as factors affecting the achievement of intended results. The assumptions or risks in the project design that subsequently affected implementation will also be discussed. The conclusion section will be comprehensive and balanced; it will highlight the strengths, weaknesses and outcomes of the intervention. The conclusion section will be substantiated by the evidence and logically connected to the evaluation findings. The conclusion will also respond to key evaluation questions and provide insights into the identification of and/or solutions to important problems or issues pertinent to the decision-making.

3.7 Data quality control & Survey Ethics

All data quality control measures will be adhered to during the evaluation including; reviewing of the study tools, translation of the tools into local languages, standardization of the training (pre-testing and ensuring that the enumerators are familiar with local terminology), review of evidences against bond evidence parameters, using GPS functionality in Kobo to geo-reference the data, regular supervision and data cleaning. The administered tools will be checked regularly for correctness, completeness, and consistency. After entry, the data will crosschecked to ensure accuracy of the information obtained from the field then compared and validated. During analysis, validation will be done by comparing the emerging information with secondary data to ensure that any outliers are addressed.

Ethical Consideration: The following ethical considerations will be adhered to during the evaluation process:

§ The rights of privacy of individuals

§ Voluntary nature of participation – and the rights of individuals to withdraw partially or completely from the process

§ Consent and possible deception of participants

§ Maintenance of the confidentiality of data provided by individuals or identifiable participants and their anonymity

§ Reactions of participants to the ways in which researchers seek to collect data.

§ Effects on participants of the way in which data is analyzed and reported.

§ Behavior and objectivity of the evaluator.

4.0. EVALUATION PLAN

To be shared by consultant

5.0. EVALUATION STUDY LIMITATIONS

Security in Baidoa is volatile with likelihood of disruptions that may restrict staff from accessing some field locations hence affecting the quality of the evaluation. This will be mitigated by working together with our local line ministry staff right from the inception to the end, as this will empower them to adequately supervise the evaluation and update lead evaluators on a daily basis.

6.0. RESPONSIBILITY AND AUTHORITY

Support from WV Somalia

World Vision will be responsible for the following:

· Recruit the external Consultant and finalize the consultancy agreement

· Share all necessary documents to the Consultant to finalize the evaluation design, protocols and tools for data collection tools. This includes provision of previous baseline report to be considered while revising the tools.

· Provide inputs in the evaluation survey methodology, data collection tools and report

· Ensure that input from WVS is coordinated and shared with the Consultant. Approves survey protocols/ inception reports.

· Flight expenses for the Consultant to Baidoa (as per the agreement in the contract)

· Vehicle hire to support the evaluation process

· Working space for the Consultant while in the field

· Recruitment and payment of enumerators (or depend up on agreement with the consultant)

· Stationery for data collection**

· Overall accountability of the evaluation process

· Guidance and coordination throughout all the phases of evaluation keeping communication with the Consultant throughout all phases

· Provide support to the Consultant during field visit processes

· Closely supervise the data collection process, ensuring quality control, daily debriefing, meeting the timelines set for assignment;

· Inform the evaluation audience including MoH for their involvement and validation of the findings.

· Approves final report

The Consultant will be responsible for the following:

· The Consultant will be required to provide a detailed description of the technical and budget for undertaking this assignment.

· Develop the inception report and have the protocol to be presented to sector Clusters for their approval.

· Review all the relevant documents for the evaluation

· Develop evaluation design including the methodology and the data collection tools as appropriate including a field manual for training in consultation with WVS sector team.

· Develop the field work schedule in consultation with WVS team

· Facilitate the training of enumerators and supervisors on the tools and data collection processes.

· Supervise the data collection process, give advice and ensure the quality of the data

· Data analysis and report writing. It is expected that at least 2 drafts be provided to WVS and nutrition cluster with feedback addressed in each round before submission of the final report

· Provide the required raw data that is complete and labelled in English (variables and values)

· Provide final versions of data collection tools.

· Add key questionnaires into the household questionnaires in order to assess the impacts of COVID-19 on projects outcomes.

· Provide daily field briefing to the DME and Project Manager on progress and any challenges from the field.

Qualifications of the Consultant

Education: The consultant should hold an Advanced University Degree in Water Resources, Nutrition, Public Health, Epidemiology, Biostatistics, Social Sciences, Monitoring & Evaluation or related discipline with the relevant technical knowledge in Survey Methodology, Research Methods etc.

Experience: Extensive experience (7-10 years) in coordinating and managing SMART nutrition surveys is mandatory, proven team leading and managerial experience, knowledge of working with conflict-affected populations and experience in managing surveys in fragile contexts will be considered a plus.

Technical competence:

· The consultant must have a strong background in statistics and data analysis. Must know EPI info and Emergency Nutrition Assessment (ENA) and all relevant computer applications in general.

· Excellent reporting and presentation skills.

· Excellent knowledge of Somalia and other fragile context

· Excellent knowledge of and experience with humanitarian guidelines and principles.

· Fluency in English and local languages spoken in the working area is an advantage.

· Computer literacy in ENA Software, Epi Info or alternate statistical package, MS Word, MS Excel and PowerPoint.

7.0. LOGISTICS

• Organizing workspace for the evaluation team throughout the fieldwork period
• Putting together documents for review, availing them to members through the evaluation exercise.
• Getting the enumerators on board and sign agreements with them for the assignment
• Draw a schedule for community visits, data collection and focus groups discussions
• Arrange logistics in terms transport for planned trips
• Organize for meals for evaluation team members
• Purchase materials and other required supplies for trainings and data collection
• Ensure printing/copying materials are readily available for the evaluation team

8.0. EVALUATION DELIVERABLES

As part of this Evaluation survey the evaluation team will perform the following tasks:

• Conduct a comprehensive documentation review.
• Develop appropriate research instruments for fieldwork.
• Refine key research questions.
• Present a draft report for comments within the stipulated time.

The deliverables resulting from this evaluation will be:

• A comprehensive draft report not exceeding 25 pages- excluding annexes.
• Clean quantitative and qualitative data set and/or summaries

9.0. EVALUATION BUDGET

The evaluation is carried out ONLY in Baidoa district.

10.0. DOCUMENTS

During the planning process (and throughout the evaluation process), the Evaluation team will review/use the following key program and other documents.

§ World Vision Somalia National Office Strategy 2016-2020/25

§ Project Proposal (inclusive of log frame, M&E Plan, ITT, budget, etc.)

§ Field Level Agreements signed between WVSOM and GAC.

§ Project narrative reports

§ Detailed implementation plans

§ Activity Reports

§ Partner reports

§ Somalia NDP

§ Monitoring reports

11.0. EVALUATION REPORT TEMPLATE

Final Evaluation report will be structured as below:

i. Table of Contents

ii. Glossary/Acronyms and Abbreviations

iii. Introduction

1. Executive Summary
2. Survey Introduction/Background
3. Methodology
4. Limitations
5. Findings
6. Conclusions and Recommendations
7. Lessons Learned from the evaluation Process
8. Appendices

12.0. APPLICATION PROCESS AND REQUIREMENTS

Qualified and interested parties are asked to submit the following;

§ Letter of interest in submission of a proposal

§ A detailed technical proposal clearly demonstrating a thorough understanding of this ToR and including but not limited to the following;

o Consultant/Company Profile

o Description of the Methodology

o Demonstrated previous and excellent experience in evaluation is required and qualifications outlined in this ToR (with submission of at least TWO most recent evaluation reports as evidence).

o Proposed data management plan (collection, processing and analysis).

o Proposed timeframe detailing activities and a work plan.

o Team composition and level of effort of each proposed team member (include CVs of each team member).

§ A financial proposal with a detailed breakdown of costs for the study quoted in United States dollars.

Application Process

All interested bidders are requested to submit their Technical Proposals and Financial Proposals in Separate documents as attachments (Bidders who will combine both technical and financial proposals shall be disqualified) via email [email protected] on or before 25th February 2021.

Bids received after deadline shall not be considered.

Email title should be; –Endline Project Evaluation- HEALTH, WASH AND PROTECTION FOR IDPs AND RETURNEES IN BAIDOA

Your financial proposal should have your professional fee and any other related cost well tabulated . Financial proposal should not be part of the technical proposal, it should be a separate document.

Note:

As part of the Consultant selection process, the best candidates will be required to make a presentation of the technical proposal to the Supply Chain and Core Project Technical team to inform the final decision on the award of the contract. **

[1] Creswell, J. W., & Plano Clark, V. L. (2011). Designing and conducting mixed methods research (2^nd Ed.). Thousand Oaks, CA: Sage Publications, Inc.

[2] All data collection tools should be designed by aligning the research questions with a gender and social inclusion emphasis.