Final External Project Evaluation at IIRR 94 views0 applications

INTERNATIONAL INSTITUTE OF RURAL RECONSTRUCTION

Terms of Reference (ToR) – Final Project Evaluation

Project Title: Stop Violence against Women and Girls in Samburu, Marsabit and Isiolo Counties in Northern Kenya

1.0 Background and Context

1.1 About International Institute of Rural Reconstruction (IIRR)

The International Institute of Rural Reconstruction (IIRR) was established 51 years ago as a global development organization with its Headquarters in Asia. It is founded on four thematic areas namely: Education for Pastoralists and Other Marginalized Communities, Food Security and Sustainable Wealth Creation; Disaster Risk Reduction and Climate Change Adaptation; and Applied Learning.

IIRR has pioneered participatory, people-centered and sustainable development aimed at enabling all people attain their full potential and live a life of quality and dignity. IIRR-Africa operates in 5 countries namely: Kenya, Ethiopia, Uganda, South Sudan and Zimbabwe. IIRR in Kenya has chosen Education for Pastoralists and Marginalized Communities as its flagship program, during implementation of the IIRR global strategy for the period 2016 – 2020, and thus IIRR has invested significantly in pastoralist’s children education in the Counties of Marssabit, Samburu and Isiolo in Northern Kenya. However, the gains of this valuable investment are being eroded by effects of Sexual Gender Based Violence (SGBV), especially Female Genital Mutilation (FGM) and Early Forced Marriage, with prevalence of 86%, 91.7% and 97.7% for Samburu, Marsabit and Isiolo counties respectively.

1.2 Project Description

With a grant from the United Nations Trust Fund (UNTF) to End Violence against Women (EVAW), since January 2016, IIRR has been implementing the project entitled; Stop Violence against Women and Girls in Samburu, Marsabit and Isiolo Counties in Northern Kenya. The 3 year project (01/01/16 – 31/12/18) seeks to create enabling environment for greater gender equality, translating commitments into action to reduce Sexual-Gender Based Violence (SGBV), specifically Female Genital Mutilation or Cutting (FGM/C), early forced marriage, beading for sexual exploitation and other forms of domestic violence. The project goal is for Women and girls in Marsabit, Samburu and Isiolo counties to be better protected from SGBV and other harmful cultural practices and survivors to have improved access to services and support (psycho-social, medical, and legal) by December 2018.

During the 3 years of implementation, the project is to reach at least 6,775 primary beneficiaries (or beneficiaries at goal level) including 5,000 women and girls, 1,200 women/girls survivors of violence, 500 women/girls living with HIV and AIDS and 75 Female political activists/human rights defenders; and also reach about 10,600 secondary beneficiaries including 10,000 members of community groups, 180 community resource persons (30 Trainers -ToT’s, and 150 Community Conversation facilitators-CCF’s), 120 educational professionals (teachers), 50 social/welfare workers, 45 health care workers, 30 uniformed personnel (police), 30 paralegals and 180 community leaders in all the 3 counties. The women and girls are of all ages and come from rural and informal settings.

The project is committed to the provision of both prevention and response to SGBV interventions in the communities. The response part mainly focuses on case management, psychosocial well-being for survivors and case referral; prevention strategies focuses on strengthening community-based approaches through capacity building training, sensitization sessions, engaging men into behavior change and communication sessions, community dialogues and women and girls empowerment on SGBV prevention and response in the community.

1.3 Geographic context

IIRR is implementing the project activities in selected SGBV hotspot locations; Kargi and Korr in Marsabit County, Merti in Isiolo County and Wamba in Samburu County respectively. These are areas in the North Eastern region of Kenya, characterized by harsh weather conditions (dry and hot climate) with the larger population being of low income and education status. The communities in these areas are highly marginalized, i.e. socially, politically and economically, and these areas are the least developed in Kenya, especially in terms of infrastructure and provision of basic services like education, health and sanitation among others. The communities are impoverished and SGBV is common where the main form-Female Genital Mutilation and Cutting (FGM/C) prevalence is 97%, with other forms of SGBV like beading and early forced marriage also happening in great magnitudes.

Currently the project has 3 more months of implementation before closure (December 2018), by which time IIRR intends to have successfully completed implementation of all the planned activities.

1.4 Project Strategy and Results Chain

Strategy

Building on IIRR’s deep experience in community-led development, the project aimed at raising awareness, change behaviors, build capacity of local actors and support survivors. IIRR planned to: –

a) Apply its proven community-led approach called Learning Our Way Out (LOWO). Working through a community centered approach, IIRR influences sustainable change in attitude, behavior, and knowledge. IIRR believes the approach is effective in addressing sensitive issues rooted in cultural and religious factors. It is IIRR’s hypothesis or theory of change that by working through the community to discuss and address the issues, the community develops ownership and identifies ways in which it will accept change in customs and behavior within the target area.

b) Establish a community-based multi – sector referral system for victims/survivors of SGBV and other harmful practices. IIRR planned to pilot a new approach of linking communities and survivors/victims to a range of needed services including legal support, medical services, psychosocial therapy, shelter and protection. Capacity development for health care providers, psychosocial counselors and sensitization of the law enforcement agencies was to be done in order to improve service delivery. IIRR planned to create linkages with all these actors so as to establish and strengthen SGBV referral systems at the community level.

c) Strengthen law enforcement structures for SGBV survivors/victims; engaging with law enforcement agencies to strengthen enforcement of Kenya’s laws that protect women and girls from violence. This is especially at the community level.

d) Employ a community-led approach using Community Trainers (ToT’s) and Community Conversation Facilitators (CCF’s). IIRR has developed an effective model for mobilizing communities for change using ToT’s/CCFs. The approach has proven effective in promoting community dialogue and community-based solutions to sensitive issues. An important part of the approach that was also to be scaled up was networking and partnership with community-based organizations for synergy and added impact.

e) Undertake a “writeshop”, IIRR’s participator methodology of bringing key project constituents together to generate and document knowledge about lessons learned, best practices, case studies and innovative methodologies/strategies used in the project.

f) Use participatory approaches to effect behavior change. Through its experience working at the community level affecting change on sensitive issues, IIRR believes the key to effecting behavior change is through the use of participatory approaches. This approach entails engaging a wide range of actors at the community, regional and national levels. Issues such as SGBV and FGM are complex, sensitive and deep rooted in cultural and religious practices. Therefore, communities must be engaged in addressing them and ending violence against women.

g) In partnership with local organizations, IIRR planned to employ strategies including: strategically designed awareness creation activities, capacity building trainings; use of simplified IEC materials and local media sensitization, community-facilitated sensitization and dialogue sessions; and building key actors’ capacity to sustainably address the issues.

Key expected results of the project are:-

i) Improved access for women and girls to essential, safe and adequate multi-sectoral services to end VAW/G.

ii) Service providers (health, social, legal, police) are better able to provide safe and adequate response and care for Women/Girls survivors of violence.

iii) Community, youth and other groups mobilize people to change behavior, attitudes and practices with regard to women and girls’ legal/human rights and take action to prevent VAW/G.

iv) Community leaders and/or key decision makers and authorities advocate for changes in behaviours, attitudes or practices and take action to prevent and end VAW/G.

v) Institutions responsible for addressing VAW/G improve effectiveness to prevent and respond to VAW/G (e.g. through improving capacity, resources, efficiency or coordination etc.).

1.5 Key Partners Involved in the Project

The implementing organization is IIRR which has been working together with several key stakeholders including: –

• Loyangalani police station
• Laisamis police station
• Wamba police station
• Merti police station
• Administration police in Loyangalani, Laisamis, Wamba, Merti, Korr and Kargi
• Chiefs, Assistant Chiefs, Ward administrators in Wamba, Merti, Korr and Kargi
• Health sector officials in Wamba, Merti, Korr and Kargi
• Local community leaders
• Community cultural and religious leaders
• Local women’s groups and other CBOs
• School girls
• Samburu Faith Unit
• Reformed Women Circumcisers
• Safe homes mothers
• Samburu Girls Foundation
• Centre for Advocacy and Gender Equity (CAGE)
• Wamba Nomadic Children’s Rescue Center
• Merti Integrated Development Programme (MIDP)
• PACIDA
• Radio Serian in Samburu County
• Radio Jangwani in Marsabit County

2.0 Purpose of the Final Evaluation

The evaluation is being undertaken so as to assess levels of accomplishments in relation to the goal, results (outcomes and outputs) and activities of the project. The evaluation is intended principally for shared learning purposes. It will generate relevant findings, lessons learnt, best practices and recommendations which will be shared with key stakeholders of the project and be used by IIRR (the implementing organization) and other relevant stakeholders to guide and inform future similar projects. Outcomes of this evaluation will help IIRR better design similar projects in future; knowing what works and what doesn’t work. This information will also help IIRR decide whether to replicate or scale up the interventions applied during this project, as well as fundraise for the same.

2.1 Scope of the Evaluation

Timeframe: The evaluation will cover the entire project duration from January 2016 – December 2018 and all the project sites;

Geographical Coverage: The evaluation will cover the 4 project locations i.e. Kargi and Korr in Marsabit County, Merti in Isiolo County and Wamba in Samburu County.

Target groups to be covered: The evaluation will cover both the primary and secondary beneficiaries as outlined earlier in this document. These are beneficiaries that have been engaged during the project implementation, including women and girls, ToTs/CCFs, community members sensitized during the project, teachers and school girls sensitized, community leaders, community cultural and religious leaders, community dialogue groups, women groups, health care providers, psycho-social counselors, paralegals, police, administration police, Kenya police reservists, and gender activists/human rights defenders at the minimum. It will also cover broader stakeholders engaged throughout the project period including the local administration, rescue homes among others.

3.0 Objectives of the Evaluation

The main objectives are:

i) To assess the overall progress of the project towards achieving its goal, outcomes and outputs

ii) To evaluate the entire project against effectiveness, relevance, efficiency, sustainability and impact, as well as the cross cutting gender equality and human rights criteria (defined below).

iii) Identify and document the relevant findings; key lessons learnt, promising or emerging best practices and challenges. This is in the field of ending violence against women and girls; for learning purposes (as defined under the knowledge generation criteria below)

iv) Provide advice and practical recommendations based on the findings of the evaluation.

3.1 Evaluation Questions

The following questions define the information that the evaluation needs to generate. These questions when answered will give intended users of the evaluation the information they seek to make decisions, act or add to knowledge. A response/answer to each of these questions must be provided by the evaluator in the final evaluation report.

i) Effectiveness: To what extent was the intended project goal, outcomes and outputs (project results) achieved and how?

ii) Relevance: To what extent do the achieved results (project goal, outcomes and outputs) continue to be relevant to the needs of women and girls in Northern Kenya?

iii) Efficiency: To what extent was the project efficiently and cost-effectively implemented?

iv) Sustainability: To what extent will the achieved results, especially any positive changes in the lives of women and girls (project goal level), be sustained after this project ends?

v) Impact: To what extent has the project contributed to ending violence against women, gender equality and/or women’s empowerment (both intended and unintended impact)?

3.2 Evaluation Methodology

The consultant will propose the best design, methodology and approach in conducting this evaluation. The proposed methodology to be used must include but not limited to desk review of project reports and any other relevant document, field visits to the project locations, participatory and robust methodologies in sampling and collection of information and data (both qualitative and quantitative); data analysis methods and reporting. Participatory methodologies and approaches are emphasized, involving all stakeholders engaged in the project.

The likely data sources and information available to the successful evaluator are:-

a) List of project sites

b) List of key stakeholders/institutions – see 1.7 above

c) Relevant national legislative documents

d) The project document and theory of change (proposal)

e) The Results and Resources Framework

f) Baseline Report

g) Progress and annual reports of the project

h) Mid Term Review Report

i) Any data collection tools, monitoring plans, indicators and collected data

j) Any other relevant reports e.g. activity reports, writing clinic report, writeshop report e.t.c.

Specific Tasks

The consultant is expected to undertake the following:

i) Review all project documents and reports in order to have an informed understanding of the project.

ii) Design appropriate tools, both qualitative and quantitative for data collection.

iii) Hold participatory discussions with all the project stakeholders.

iv) Visit the project sites in Marsabit, Samburu and Isiolo to conduct data collection and interviews with field based stakeholders, communities and staff.

v) Compile a high quality, concise analytical report documenting evaluation findings, lessons learnt, best practices identified challenges, recommendations and conclusions.

3.3 Evaluation Ethics

The evaluation must be conducted in accordance with the principles outlined in the UNEG ‘Ethical Guidelines for Evaluation’.

The evaluator must put in place specific safeguards and protocols to protect the safety (both physical and psychological) of respondents and those collecting the data, as well as to prevent harm. This must ensure the rights of the individual(s) are protected and participation in the evaluation does not result in further violation of their rights. Note: –

a) The evaluator must have a plan in place to protect the rights of respondents, including privacy and confidentiality;

b) The plan must elaborate on how informed consent will be obtained and to ensure that the names of individuals consulted during data collection will not be made public;

c) The evaluator/s must consider additional risks and need for parental consent where children under 18 years old are involved;

d) The evaluator/s must be trained in collecting sensitive information and specifically data relating to violence against women.

e) Data collection tools must be designed in a way that is culturally and religiously appropriate and does not create distress for respondents;

f) Data collection visits should be organized at the appropriate time and place to minimize risk to respondents;

g) The interviewer or data collector must be able to provide information on how individuals in situations of risk can seek support (for example by giving referrals to organizations that can provided counseling support etc.).

All the above should be clearly addressed in the consultant’s proposal.

Key resource materials:

• WHO, “Ethical and safety recommendations for intervention research on violence against women “, (2016)
• WHO, “Ethical and safely recommendations for researching, documenting and monitoring sexual violence in emergencies” (2007)
• WHO/PATH, “Researching violence against women: a practical guide for researchers and activists”, (2005)
• UNICEF’s “Child and youth participation guide” (various resources)
• UNEG guidance document, “Integrating human rights and gender equality in evaluations”, (2011) Chapter 3

* A child means every human being below the age of eighteen years unless under the law applicable to the child, majority is attained earlier.

3.4 Key Deliverables of Evaluators and Timeframe

i) Evaluation Inception Report: By 20^th of November 2018

ii) Data Collection: to be completed by 31^st December 2018

iii) Draft Evaluation Report and debriefing: By 15th of January 2019

iv) Review of draft report: By 31st of January 2019

v) Final Evaluation Report after incorporation of comments: By 10th of February 2019

4.0 Evaluation Team Composition and Required Competencies

Evaluators must be independent from any organization(s) that have been involved in designing, executing, managing or advising any aspect of the project that is the subject of the evaluation and any other UN Trust Fund-funded projects.

4.1 Evaluation Team Composition and Roles and Responsibilities

The evaluation will be undertaken by one national consultant, either as an individual or as a firm. The evaluator will be responsible for undertaking the evaluation from start to finish, with the assistance of the IIRR SGBV Project team and the supervision of the evaluation task manager from IIRR (Country Director – Kenya). This will cover data collection and analysis, as well as report drafting and finalization in English.

4.2 Management arrangement of the evaluation

a) IIRR and Evaluation Task Manager will be available to;

i) Oversee the entire evaluation process from beginning to end.

ii) Mobilize other relevant IIRR staff to provide all the necessary documents, contacts, logistics and any other support required to facilitate a successful evaluation.

iii) Review and give comments on the inception report, draft and final evaluation reports to the consultant for refinement.

b) Consultant will report to the Evaluation Task Manager. Consultant’s key deliverables will include;

i) To evaluate the entire project against effectiveness, relevance, efficiency, sustainability and impact criteria, as well as the cross cutting gender equality and human rights criteria (defined elsewhere in this document).

ii) To undertake a desk review of all relevant documents, undertake field visits to collect data and thereafter analyze it.

iii) To develop and submit an inception report, data collection tools, evaluation methodology, draft evaluation report and final evaluation report, having taken into account comments from the evaluation task manager, stakeholder group and UNTF.

c) Stakeholder’s/project constituents will report directly to the Consultant. Their roles will be;

i) To assist the evaluation process by reviewing and providing feedback on the inception report, draft evaluation report and final evaluation report to ensure they are credible, comprehensive and give a clear and true picture of the project progress and success/failure.

5.0 Financial Proposal

The evaluator is expected to submit a financial proposal alongside the expression of interest quoting the expected fees, broken down with details of how the overall fee is arrived at, covering all evaluation costs.

6.0 Required competencies of evaluators

i. Evaluation experience of not less than 8 years in conducting external evaluations, with mixed-methods evaluation skills and having flexibility in using non-traditional and innovative evaluation methods.

ii. Experience with program design and theory of change, gender-responsive evaluation, participatory approaches and stakeholder engagement.

iii. Expertise in gender and human-rights based approaches to evaluation and issues of violence against women and girls.

iv. Specific evaluation experiences in the areas of ending violence against women and girls.

v. In-depth knowledge of gender equality and women’s empowerment.

vi. Experience in collecting and analysing quantitative and qualitative data as well as data visualization.

vii. A strong commitment to delivering timely and high-quality results, i.e. a credible evaluation and its report that can be used by decision makers to influence programming in GBV

viii. A strong team leadership and management track record, as well as interpersonal and communication skills to help ensure that the evaluation is understood and used.

ix. Good communication skills and ability to communicate with various stakeholders and to express concisely and clearly ideas and concepts

x. A good understanding of the North Eastern region of Kenya (especially Samburu, Marsabit and Isiolo Counties), its dynamics and communities is desirable. Experience of working in the region and/or knowledge of any of the local languages is an added advantage.

xi. Fluency in English and Swahili is mandatory; therefore Kenyan based evaluators will have an added advantage.

7.0 How to express interest

Interested consultants should send an Expression of Interest (EOI) with a technical and financial proposal. The technical proposal should include; consultants understanding of the TOR, methodology, work plan or activity schedule and the final report table of contents. Consultant should also submit detailed CV(s) of the consultant(s) and copies of reports of 2 recently conducted evaluations. The financial proposal should include professional fees and any other expenses required to undertake the study.

7.1 The evaluation criteria below will be used among others to determine the most successful bidder;

i. Successful consultant will be selected on the basis of an assessment of both the technical and financial proposals submitted. The financial offer has to be presented as a detailed budget disclosing all relevant costs.

ii. The proposal should include as a minimum; a description of proposed evaluation methodology including corresponding sampling techniques, target groups and sizes.

iii. A time plan for the evaluation in accordance with table in section 5.0 above.

iv. A reference list of previous clients including a short description of similar assignments completed in similar contexts as well as contact details of references.

v. Copies of Curriculum Vitae (CVs) of the proposed consultant team members. The composition of the team should take into consideration the points described under section 7.0 above. It will be considered an advantage if the consultant team includes both male/female members.

vi. If the consultant is a registered company, a copy of the registration certificate will be required

vii. A financial offer with a detailed breakdown of costs.