Terms of Reference Consultancy Assignment for Endline Evaluation for Emergency Food Security and Protection project in Eastern Equatoria Implemented by Care South Sudan Organization overview Programme Overview Founded in 1945, CARE is a leading international humanitarian organization fighting global poverty. In more than 80 countries, CARE’s work in Sudan began in 1993. Responding to the context, throughout the 1990s CARE’s work in the South has largely been humanitarian response, with little longer-term programming. CARE works with the poorest communities, local and international partners to address the underlying causes of poverty through improving basic health and education, enhancing rural livelihoods and food security, increasing access to clean water and sanitation, expanding economic opportunity, helping vulnerable people adapt to climate change and providing lifesaving assistance during emergencies.

Programme Overview CARE is currently implementing Emergency Food Security and Protection in Eastern Equatoria in

Pageri Administrative Area (Nimule & Mugali Payams) and Torit County (Nyong Payam) with a goal “To provide lifesaving assistance to the most vulnerable women, men, boys and girls affected by the current conflict in Eastern Equatoria State”. The expected outcomes are: 1. Increased access to essential food and nutrition by women, men, boy and girl IDPs and host communities 2. Emergency multi-sectoral GBV response services are set-up, referral pathways are established and adhered to, and GBV prevention and information provision activities are conducted for women, men, boys and girls in Eastern Equatoria State 3. Support follow-up and technical capacity building for the former VSLAs/FFS beneficiaries of the Beyond the Harvest Project (for sustainability). Specifically, program activities include but are not limited to:  

   

Distribute cash/vouchers to vulnerable IDPs and host community to meet basic needs Distribution of fast maturing vegetable seeds and tools for kitchen gardens Train frontline service providers on Clinical Management of Rape (CMR) Strengthen community support mechanisms for survivors of GBV and undertake awareness sessions for IDPs and host community women, men, boys and girls – through the training and mentorship of GBV Information Volunteers. Train women’s focused CBOs and women’s groups to deliver community-based case work, psychosocial support and referral Formation of VSLA group and conduct business skills and financial training for the group

1

Consultancy Objectives: In arriving at lessons learned, the consultant will be responsible for identifying the programme’s successes and shortcomings in all stages of programmes design and delivery. Specifically, the evaluation should evaluate each programme activity as they relate to:      

Relevance: Analyse the appropriateness of the project design, strategies and approaches in the light of the operational context, the timeliness of the response and its adaptation to the livelihoods security situations. Effectiveness: Analyse the extent to which the project results and objectives as stated in the programme proposal have been achieved. This should include an analysis of programme implementation strategies employed to reach desired results. Efficiency: Analyse how economically the programme resources were used to achieve expected results, both in reaching overall programme objectives and day-to-day tasks. Sustainability: Assess the extent to which the project interventions took into consideration longer term needs of the target population and to what extent programme results will be sustainable after programme closure. Coverage and Target: Assess the extent to which the planned coverage and targets were achieved, their appropriateness to the local context, and implications of retargeting that has taken place over the course of implementation. Impact: Assess the extent to which the project interventions has brought changes in people's lives and society at large

In summary, the programme evaluation should focus on assessing the quality of the current programme, response in terms of meeting humanitarian needs, timeliness and adherence to humanitarian standards (CHS and Sphere) and – based on the findings of the above – generate a section of key lessons learned and best practices that make realistic and feasible recommendations for improving humanitarian assistance while strengthening local disaster preparedness response capacity and overall community resilience for in the counties of Torit County and Nimule (Pageri Administrative area) in Eastern Equatoria states and other similar contexts in South Sudan. Purpose of the Evaluation The purpose of the evaluation is to review project experiences to date and provide a comprehensive analysis of impact providing evidence based findings and lessons learned to determine if the project is an effective mechanism through which CARE can support communities with early recovery and emerging humanitarian needs as well as future FSL Programming. Specific Objectives:  

Assess the extent to which the project achieved its objectives with special emphasis on the outcomes and impact and/or most significant changes attributable to the project. To assess the relevance, efficiency, effectiveness, impact, reporting and sustainability of the project

2

 

       

To make key observations, draw conclusions and make recommendations to inform future interventions Assess the relevance, effectiveness and efficiency of the project strategy with special emphasis on: o Community needs at the time of project identification. o Results as articulated in the project log frame o Cross cutting issues of Gender, etc. o Capacity building of target groups and its relevance to project implementation. o The external environment (context) within which the programme was operational and its influence on project successes and/or failures. Assess the efficacy of processes of beneficiary engagement against best practices in the sector Assess project efficiency in utilization of mobilized and committed resources in the implementation of the project and procurement of project inputs. Assess synergy with other CARE supported projects in this geographic area and make recommendation aimed at achieving the program synergy objective. Assess the project sustainability at various levels (target groups/ households, Local Government (Agriculture department) Authority with focus on technical, financial, institutional sustainability. Assess the effectiveness and efficiency of the project monitoring and evaluation system with special focus on CARE’s monitoring tools and how these could be strengthened in future projects. Assess the relevance, efficiency and effectiveness of networking and/or coordination with other actors in the sector within Nimule and Torit County in Eastern Equatoria states Assess the overall impact of the action, negative or positive and made recommendations for future interventions. Assess the suitability of approaches used and their effectiveness and impact and multiplier effects on services delivering.

Methodology: The evaluation will combine a desk review of programme documentation and primary research to be conducted in Torit and Nimule County in Eastern Equatoria states and in communities surrounding (specific villages to be covered in the evaluation will be agreed upon with the programme team before commencing the study). The precise methodology will be agreed upon between the consultant and CARE before evaluation activities commence, with the methodological outline provided by the consultant as per this tender at starting point. The evaluation design should consider ex-post and ex-ante project scenario to assess impact of project. Communities/ groups that have received project support should be purposively sampled for the study to ensure adequate representation of social strata. Á combination of appropriate quantitative and qualitative methods of data collection and analysis should be employed including but not limited to: 1. Direct observation of the conditions of beneficiaries for evidence of project support. 2. Photographs of household and children who have been beneficiaries of project.

3

3. Documentation of case studies of women as well as men whose lives have been impacted by the project. 4. Use of Participatory Learning Action/Participation Rural Appraisal techniques such as mapping, community meetings, Focus Group Discussions with specified groups including children; Venn diagrams, ranking scores, etc 5. Semi structured interviews 6. Key informant interviews held with local authorities and other relevant persons at field level. CARE shall provide a copy of the project proposal, budget, contract, interim and project reports plus any other technical documentation deemed essential for effective evaluation of the project: The consultant is expected to use diverse methods in obtaining required qualitative and quantitative data. The methods should be as participatory as possible and feasible within the time frame. These methods could include: a) Literature review The consultant is expected to review the following project documents and reports as a way of familiarizing himself/herself with the project and to assess the extent to which project outputs have been achieved: I. CARE’s Strategic Plan for South Sudan II. Project Documents including: Narrative Proposal, log frame, work plan, budget III. Project narrative and financial reports IV. Any other relevant material b) Field Visit.  The consultant will be expected to visit the project sites and conduct interviews with project beneficiaries, County Officials, project staff, and other agencies operating in the project area. CARE expects the exercise to be as participatory as possible using techniques appropriate techniques/ approaches. c) Sampling techniques  The consultant is expected to use purposive sampling or any other appropriate sampling methods to obtain a fair view of the project information as articulated in this TOR. Additional information will be provided to aid in the final selection of areas to visit when the contract is awarded. d) Data collection methods.  Participatory approaches in data collection will be employed throughout the evaluation. An open atmosphere that can also accommodate unexpected information and critical remarks should be created by the team. The evaluation is expected to suggest data collection methods that provide both quantitative and qualitative information. It is critical that information is triangulated in order to increase the validity of findings. Data collection methodology shall be a combination of various methods which includes but not limited to Household Survey, Focus group discussion, Key Informant Interviews, review of available secondary data and information, etc. The time frame and costs should be a key consideration in the selection of data collection methods.

4

e) Dissemination of findings  The consultant is expected to debrief CARE, and its partners on the evaluation findings. Upon obtaining feedback from the team, he/she will finalise and submit a final report to CARE. f) Scope of the Evaluation The evaluation shall be limited to assessing the project’s impact in Torit and Nimule in Eastern Equatoria states where the interventions were implemented. G) Deliverables and timeline A comprehensive final evaluation report not more than 30 pages (without appendices), fully addressing all the specific objectives outlined above and should address all the components mentioned in the final report section below. The consultant will be responsible for three key deliverables: 1. Inception Report: The Inception Report will detail the agreed upon methodologies to be employed in the evaluation to achieve the objectives outlined above. The Inception Report should also include the finalised activity plan and a structural outline of the final evaluation report. The inception report should be shared and approved by CARE before commencement of the data collection and analysis. An inception report in preparation of the field work, in which the consultant establishes:  a detailed methodology for implementation of the baseline (include samples size and methodology, enumerators, etc.);  a detailed schedule for the study;  the indicators that fall within the scope of the baseline study;  the indicators for which the Endline value can only be established at a later stage;  draft data collection tools for all indicators and the means to verify them.  Draft questionnaires  work plan that sets out the preparatory activities and specific deliverables as well as timeline related to the baseline study 2. Draft Report: The Draft Report, in addition to addressing the aforementioned consultancy objectives, the report must contain: an introduction including programme summary and purpose of evaluation; a detailed methodology (including limitations); key findings (covering both document review and primary research); recommendations; a conclusion; and, annexes. Annexes should include, at minimum: the consultant’s expression of interest, the evaluation budget, field sites visited, and a list of key informants. A soft copy of the Draft Report will be shared with relevant programme staff within 10 days of completing field site visits. The Draft Report is to be no more than 30 pages, excluding cover pages and annexes. 3. Final Report: The Final Report (maximum 30 pages, excluding cover pages and annexes) with photos and infographics should be submitted to CARE no later than one week after

5

the consultant has received feedback from all relevant programme staff on the Draft Report. It should be submitted via email to the relevant programme staff. The final report should include but not be limited to the following points:  A quantitative review of the extent to which CARE has achieved the indicators and targets set forward in the project proposal documents (to include a review of supporting documents)  A qualitative review of CARE’s achievements, preferably conducted by the collection of a variety of case stories, conducting focus group discussions and a semi-formal post-distribution utilisation survey  Analysis of enabling and disabling factors and how they have impacted project implementation  Evidence-based recommendations for future Livelihoods and Resilience-building project implementation in comparable contexts  A final report in English not exceeding a length of 30 pages (excluding annexes) which includes:  Executive Summary (max. 1 page)  Introduction (including a description of context and main stakeholders)  Methodology, including sampling and selection procedure  Analysis and findings of the study (on outcome level)  Conclusions, recommendations and best practices The aforementioned deliverables will be accompanied by regular communication with and feedback to the Programme Team. A validation workshop where the preliminary results of the study are presented to the CARE.. The assignment should be completed by May 26th 2017 The table below gives an indicative planning. Activity Selection of consultant through interview with CARE Desk review of relevant documents, development of baseline design with detailed methodology, and writing inception report Integrate feedback from CARE inception report Develop data collection tools, possibly training of enumerators Data collection and analysis Report writing Integrating feedback first draft Report finalisation and submission

Timeline May 5th May 7th

May 11th May 12th May 13th to 20th May 23rd 2017 May 26th 2017 May 27th 2017

Cost of the Evaluation: should be summarised as follows with a detailed breakdown attached No. 1

Details Consultant’s fees (including data enumerators’ costs)

Unit

Rate (US$)

# of Units (Quantity)

Cost (US$)

6

2 3

4

Transport cost Subsistence costs (e.g. accommodation, communication, meals, etc) Any other costs that are critical, but not provided for by CARE Total

g) Logistical Support Logistical support (scheduling of interviews, arrangement of field accommodation during data collection, access to official facilities including internet, documentation—printing, photocopying of tools etc) will be provided by CARE. CARE will arrange transportation and accommodation in the program operation area in field location Note:  The consultant is responsible to pay the enumerators, printing and data entry and analysis cost.  The consultant will be responsible of any tax or other fees related.  The payments will be in one instalment after the completion of the task and submission of final acceptable report to CARE  Please note that a partial payment hold-back will be in effect until a final report has been approved by CARE.

Reporting: The consultant will be working primarily with the Program Coordinator in consultation with the DM&E Coordinator. Essential Qualifications and experience required: -Academic degree in International Development Studies, Humanitarian Action or a related field; -Demonstrated experience in humanitarian response and knowledge of humanitarian standards (CHS, Sphere, Code of Conduct). -Demonstrated experience of leading evaluations of humanitarian response programmes -Demonstrated experience with quantitative and qualitative research, data base management and statistical data analysis -Experience of working in South Sudan/East Africa -Experience of evaluating consortia/joined responses -Proven record of communicating with beneficiaries, also with children using child friendly methods -Demonstrated knowledge of Dutch development and funding streams and access to the Dutch Ministry for an interview. -Ability to assess and further develop a conceptual evaluation tool -Relevant subject matter knowledge and experience regarding the thematic areas of this SSJR -Ability to deal with hardship and remote area field work Preferred -Strong understanding of humanitarian and evaluation ethics and a commitment to ethical working practices -Advanced English writing skills Deep understanding of CHF and UN Strategic Response Plan -Experience in/ understanding of measuring the added value of partnerships/ cooperation -Experience of working in insecure environments in South Sudan and managing security risks

7

-Action-oriented and evidence based approach and strong drive for results; -Highly developed self-management, and communication skills;

Guiding Principles and Values: Adherence to CARE Code of conduct, Child Safeguarding practices and confidentiality when interviewing or photographing children. Application process Interested Parties are requested to submit a proposal explaining their comprehension of the proposed consultancy, and how they would approach this assignment with a summary of their methodology especially in terms of how the party plans to meet the objectives. Additionally, they should submit one or two examples of similar evaluations conducted previously. The application should include a team composition with Lead Consultant and at least 2-3 experienced evaluators. The application should include minimum three CVs of the persons to be involved in the assignment, relevant experience, a detailed budget in USD and time availability.

The deadline for submission of proposals from interested parties is 5th May 2017, Proposals should contain a proposed methodology, work plan and budget. Proposals can be submitted to [email protected] and CC Sylvia@[email protected] and [email protected]

8