TOR – Evaluation Services; QUALITATIVE STUDY TO EVALUATE HEALTH / HEALTH SERVICES AS PART OF HUMANITARIAN ASSISTANCE PROVIDED BY MDM SPAIN IN ANGOLA.
Doctors of the World (Médicos del Mundo – MdM) is an international human rights organization providing emergency and long-term medical care to vulnerable people. MdM Spain in Angola is recruiting a company or a specialist (consultant or team of consultants) to participate in specific tasks that form part of a participatory assessment of health and mental health services for refugees from the DRC in the Lovua Settlement / Lunda-Norte Province.
MdM Spain’s assessment seeks to engage with the refugee community in the Lovua Settlement, through participatory methods to better understand their perspective and satisfaction of activities implemented since 2017 until now. The assessment services will focus on conducting the analysis of qualitative data and writing the final report.
Assessment services (MAIN TASKS):
• Meet with the country’s coordination to organize the work and have access to the necessary information.
• Meet with the evaluators at the community level to understand their work, have access to the data collected during the interviews (secondary data).
• Analysis, and synthesis of a set of transcripts of the focus group interviews with the community.
• Organize a workshop to triangulate the preliminary results with community members
• Provide the final report of the evaluation in ENGLISH or PORTUGUESE.
Requirements:
- Specialist with a university degree in social sciences and in qualitative project evaluation methods.
- Experience in evaluating humanitarian projects.
- Fully proficient in French (interview data will be in French).
- Excellent report writing in ENGLISH or PORTUGUES.
Additional and ideal characteristics: 1. Specialist with solid knowledge and practical experience in the theme of gender and participatory approach. 2. speaks Lingala or Tchiluba. 3. Previous experience with refugees from the Congo, specifically from the Kasi region / relevant experience in the region.
To submit the application, the technical offer must include:
CV:
• Detailed CV of the individual consultants OR detailed CV of the members of the assessment team of the bidding company // Detailed company CV (if applicable)**
Methodology and work plan
• Methodological aspects to carry out data analysis and the triangulation workshop
• the work plan;
Estimated budget for carrying out the evaluation:
Budget (proforma invoice format) must include all expenses incurred in carrying out the specific tasks mentioned above. The maximum budget will be 11,000 USD and must be adjusted in case the consultant cannot travel to Lunda Norte.
Applications will be reviewed on an ongoing basis until the delivery date.
Application deadline date 16 November 2020. (interview until the 19; signing of the contract on 20 November).
Applications must be sent via mail: [email protected], or hand in physical files to MdM at Rua do Banco BPC, Dundo, Lunda-Norte.
** Candidates currently in Angola, with the possibility of traveling to Lunda Norte will have preference during our selection process.
* consultants limited by the complications associated with traveling to Angola and in some cases even within the country must adapt their technical proposal so that the work is done ONLINE.**
FOR MORE INFORMATION, SEE THE FULL TOR BELOW OR CONSLUT: [email protected]**
COMPLETE TERMS OF REFERENCE
FOR THE PROVISION OF FINAL ASSESSMENT SERVICES
Evaluation of intervention in primary care and mental health services for refugees from the DRC in the Lovua Settlement: A Community-Based and Participatory Approach.
Região
Africa
País
Angola
Financiador
ACNUR
1. CONTEXT
In 2016/17 thousands of Congolese fled due to violence in the Kasai region, in the Democratic Republic of Congo, towards northern Angola. UNHCR, the UN Refugee Agency, participated in the relocation of more than 33,000 Congolese refugees from overcrowded reception centers in northern Angola to the Lovua settlement, about 100 kilometers inland. the border with the Democratic Republic of Congo. Currently, the Lovua settlement has 6,500 residents. MdM Spain in Angola has been present in the Lovua settlement since June 2017 with programs in primary health and mental health and psychosocial support.
2. OBJECTIVES OF THE EVALUATION
MdM is carrying out an internal assessment. The purpose of the assessment is to engage with the refugee community in the Lovua settlement, through participatory methods, to better understand the perspective and satisfaction of the community on the activities implemented since 2017 until now.
Second, the assessment will provide guidance and direction on future MdM policies and programs in other similar contexts.
Main objective: Gather an in-depth insight regarding the Lovua community’s perception of the MdM health and mental health activities (from the beginning of the intervention until now).
Specifics:
· Better understand the level of satisfaction with health and mental health services by the community.
· Identification by the community of the strengths and weaknesses of the health and mental health services offered by the MdM.
· To better understand the perspective of the cultural adequacy of MdM activities and services by the community (in the process of planning and implementing activities and their influence on the satisfaction of services).
Evaluation questions:
- How do members of the Lovua settlement community feel about the quality of care they receive and access to health and mental health services?
- Do members of the Lovua settlement community believe that they were treated with dignity and respect during their medical and mental health consultations?
- Do members of the Lovua settlement community believe that health and mental health services respected their cultural and religious beliefs?
- Do members of the Lovua settlement community believe that health and mental health activities met their needs and the different needs among them (men, women, girls and boys)?
- Do members of the Lovua settlement community believe that the quality of care has changed over time? If so, has it improved or worsened? Why?
- What do members of the Lovua settlement community believe are the strengths of MdM services? And the weakest points?
- What would members of the Lovua settlement community point to as the greatest achievements of MdM?
- What would members of the Lovua settlement community recommend maintaining (best practices) or changing in other similar contexts?
3. METHODOLOGY
3.1. Organization and management of evaluation
The evaluation will have a reference group:
· The Responsible Emergency Unit together with the Country Director, will establish evaluation objectives and the fundamental methodological aspects;
· The MdM Evaluation and Quality Unit, whose main functions are to provide technical support;
· The Country Director has the main function of training evaluators at community level, supervising the entire process and taking care of their quality;
Evaluators at community level:
· Community agents will be trained in community-level, participatory based and qualitive methodologies to carry out focus groups with the community to identify weaknesses in the community.
· The data will be collected and documented in a systematic way.
· This data source will be shared with the consultant to be analyzed and synthesized.
Assessment services (MAIN TASKS):
· Meet with the Country Director to organize the work and have access to the necessary information.
· Meet with the evaluators at the community level to understand their work, have access to the data collected during the interviews (secondary data).
· Analysis, data synthesis.
· Present first results to the community to triangulate conclusions; present first results to country coordination
· Final summaries, and make final report of the evaluation.
3.2.Methodology of the assessment
Qualitative methods
The evaluation is about opinions, satisfaction and gathering information about the point of view of the community in the settlement of Louva about MdM services. Qualitative methods provide a rich and detailed insight into certain cultural phenomena, therefore, making it the appropriate way to explore how members of the Lovua settlement community view the quality and activities of MdM, health and mental health services. Below is an outline of in-depth interviews and focus groups that should be taken into account.**
Sample size
Due to the nature of qualitative studies, an exact number of the sample size will not be predetermined in a fixed way. Instead, theoretical sampling will be applied, to ensure that saturation is achieved (Sixsmith et al. 2003). As a minimum standard, 2 FGDs will be carried out with each demographic category (boys, girls, men, women).
Types of FGD
Conducted by
Refugees who live in Louva
- Minimum 2 focus groups with girls
- Minimum 2 focus groups with boys
- Minimum 2 focus groups with women
- Minimum 2 focus groups with men
* The conduct of these interviews are NOT part of the work of the consultant / consultants. Consultant / consultants will have access to the methodology and transcripts to make the analysis and synthesis of results.**
Community-level evaluators
Participatory approach
The participatory approach will be a key aspect of the evaluation. A participatory approach means (i) an assessment conducted jointly by several stakeholders, including the refugees and refugees they own; (ii) an assessment in which a wide variety of stakeholders are actively participating in the entire process, from planning the assessment, gathering and analyzing information and planning actions to improve execution.
Gender lens
The use of the ‘Gender lens’ will be applied during the development of tools to collect data and during analysis. The question guides took into account questions that try to capture the differences between the needs of men and women (girls and boys), the influence on gender roles. Gender analysis will also be present during data analysis. For more information, please search for ‘Gender Analysis Toolkit for Health Systems’ (JHPIEGO / USAID, 2016).
3.3.Process and phases of the evaluation
The evaluation process will be done in 6 phases as described below.**
The professionals / group of professionals hired for the evaluation service will be involved in phases C-E.
A. Preparation Phase.
· Preparation and development of tools that will be used for data collection.
· Training with community agents on qualitative methods and participatory approach.
· Pilot the question guides.
· Make transcription guide.
· Training with community agents on the method of transcription.
· Hire consultant/s for the analysis and report writing.
· Finalize the work plan.
B. Data Collection Phase
· The evaluation team must guarantee the rights of the evaluation participants.
· Make transcripts of the interviews.
C. Data analysis and synthesis
Analysis of primary and secondary data.
Apply cross-gender analyzes during data analysis.
D. Triangulation phases with community members/sharig of preliminary results
The evaluation team will present the primary results at seminars:
Seminar 1, workshop with refugees from the community of Louva: Host a workshop in which to present main conclusions, contrast results with community members, consult if the conclusions of the analysis are accurate.
Seminar 2, meeting with the project coordination and Reference Group: present your preliminary results.
Detailed notes of meetings will be done, and noteworthy points should be integrated into final conclusions.
E. Final synthesis and final report
This phase is mainly dedicated to the preparation of the final report. The report must be done in accordance with ANNEX 1.
If the person supervising the assessment considers that the quality of the report is fit, he / she should distribute it in order to collect comments from the members of the reference group and should convene a meeting at which the team evaluation.
Based on the observations made by the members of the reference group, and collected by the person responsible for the evaluation, the evaluation team will have to modify and revise the draft report. Comments that require improvements in methodological quality should be taken into account, except when there is an evident impossibility to make them; in that case, the assessment team must give a full justification of the situation. Comments on the content of the report can be accepted or rejected. In the latter case, the evaluation team must explain the reasons for its refusal in writing.
- Sharing of results
- MdM will share final report with donor and key actors.
4. Information required – Application Procedure
Presentation of the final report
Reports must meet quality standards. The report text will include maps and tables; it is necessary to insert a map of the project intervention area (which must be presented as an attachment).
The consultant will present the following reports in Portuguese or English:
- Primary results report. The report should describe the first results of this study, the difficulties foreseen in the data collection and / or other difficulties identified (information provided by MdM). It will be the basis for discussions. ** It must be accompanied with materials that will be used to facilitate the triangulation workshop with members of the community. Maximum delivery: December 15th.
- Final report. The final report must take into account the specifications in Annex 1. Maximum delivery: December 21st.
5. Qualifications and Experience Required from Consultancy Services
The evaluation will be done by a specialist person or group of specialists with the following profiles and qualifications:
Requirements:
- Specialist with a university degree in social sciences and in qualitative project evaluation methods.
- Experience in evaluating humanitarian projects.
- Fully proficient in French (interview data will be in French).
- Excellent writing of reports in ENGLISH or PORTUGUES.
Additional and ideal features:
- Specialist with solid knowledge and practical experience in the theme of gender and participation in citizenship / participatory approach.
- Speak Lingala or Tchiluba.
The composition of the team of experts must be balanced so that there is total coverage of the different aspects of project evaluation (methods and techniques of analysis and triangulation workshop) as established in these terms of reference, including cross-cutting issues.
** Candidates currently in Angola, with the possibility of traveling to Lunda Norte will have preference during our selection process.
*** Because of the complications associated with traveling to Angola, consultants outside the country must adapt their technical proposal so that the work is done ONLINE.
6. Requirements for technical proposals
Technical proposals must respect the following characteristics in order to be presented:
1-Cover page where indicated:
• Company name or appraiser (independent)
• Evaluation title (Final external evaluation and project title)
• Contact details of the company or individual (independent) appraiser
2-Technical offer that includes:
• Detailed CV of the appraiser or individual appraiser OR detailed CV of the members of the assessment team of the bidding company
• Detailed company CV (if applicable)
3-Methodology and work plan
• Proposed evaluation matrix and technical considerations
• Concrete methodology to carry out the different phases of the evaluation and work plan.
4-Estimated budget for carrying out the evaluation:
• Budget with all expenses resulting from the assessment and the proposed form of payment, in a pro-forma invoice format.**
7. Deadlines for turn-in of technical proposal and hiring timeline
· Applications will be reviewed on an ongoing basis until the delivery date. Early turn-in date highly recommended if possible.
· Receipt of technical proposals until 16 November 2020, via e-mail, [email protected], indicating in the subject “Avaliação projeto Lunda Norte”.
· Interview with candidates until 19 November.
· Maximum date for the communication of results: November 19, 2020; sign the contract on November 20th.
· Consultancy closing date (delivery of final report): 21 December 2020.
8. Evaluation criteria used for assessing technical proposals
The maximum budget for the consultant’s tasks will be 11,000 USD, with taxes included, which should include all expenses, such as necessary tickets, accommodation. The budget must be adjusted in case the consultant cannot travel to Lunda Norte.
The evaluation criteria for the offers received will be as follows:
CRIT
Criteria
Value
Factors
Value per factor
Professional experience of professional or team
25%
Relevant experience and technical capacity.
25%
Academic training
35%**
Gender perspective, social determinants of health
Experience in Lunda Norte, Angola or with DRC refuguees
Education in intl development/research/project evaluation
5%
5%
25%
Quality of technical offer
40%**
Added value of methodology presented in TOR
Possibility to travel to Lunda Norte
Budget implications**
20%
10%
10%1
9. Work plan and GENERAL timetable
The dates mentioned in the table can be modified with the agreement of all interested parties.
Activities
Dates
Preparation phase
6-20 Nov.
Data collection phase
23 Nov. – 4 Dec.
Phase analysis of data
*Start-date will vary as
until 15 Dec.
Triangulation phase, phase of sharing first results
16 – 17 Dec.
Final sythesis and report writing
21 de Dec.
How to apply
Applications will be reviewed on an ongoing basis until the delivery date.
Receipt of technical proposals until 16 November 2020, via e-mail, [email protected], indicating in the subject “Avaliação projeto Lunda Norte”.
To submit the application, the technical offer must include:
CV:
• Detailed CV of the individual consultants OR detailed CV of the members of the assessment team of the bidding company // Detailed company CV (if applicable)**
Methodology and work plan
• Methodological aspects to carry out data analysis and the triangulation workshop
• the work plan;
Estimated budget for carrying out the evaluation:
Budget (proforma invoice format) must include all expenses incurred in carrying out the specific tasks mentioned above. The maximum budget will be 11,000 USD and must be adjusted in case the consultant cannot travel to Lunda Norte.
More Information
- Job City Luanda
