Title of Consultancy :Consultancy For End-Line Evaluation For Som Integrated Lifesaving Assistance for Drought-Affected Communities in Somaliland.
For over 90 years, Save the Children has been making a difference in children’s lives in more than 120 countries. We are the world’s largest independent child rights organization, underpinned by a vision in a world in which every child attains the right to survival, protection, development and participation. Our mission to inspire breakthroughs in the way the world treats children, and to achieve immediate and lasting change in their lives.
Save the Children is an organization for talented people with different backgrounds and perspectives. We are proud that our people are representative of the children we work with and we thrive on our diversity. We are an equal opportunity organization dedicated to our core values of Accountability, Ambition, and Collaboration. Our culture is embedded in these values, along with a strong commitment to our Child Safeguarding Protocol, ensuring that all representatives of Save the Children demonstrate the highest standards of behaviour towards children both in their private and professional lives.
Save the Children has been working in Somalia/Somaliland for over 40 years. Save the Children Somalia/Somaliland country office is implementing an Integrated life-saving health, nutrition, WASH and CP assistance for drought-affected communities in Somaliland. The purpose of this project is to reduce vulnerability of drought-affected people especially women and children, in El-Afeyn (Sanaag), Buro (Togdheer) and Aynabo districts of Somaliland through integrated healthcare, income, nutrition, WASH and CP response. The action aims to achieve four key result areas: 1) (Health): Improve access to life saving emergency primary healthcare services to the drought-affected communities of Somaliland. 2) (Nutrition): Reduction of nutrition related morbidity and mortality rates to below emergency threshold in Somaliland through treatment of acute malnutrition and IYCF promotion among children under 5 and PLWs. 3) (WASH): Provide immediate life-saving WASH services to 10.000 vulnerable households affected by the drought in Somaliland 4: (FSL): Provide unconditional cash transfers to meet lifesaving needs of 1.335 (600 before) vulnerable households affected by drought in Somaliland . 5) (child protection): Vulnerable boys and girls in the selected drought affected areas are provided with basic psychosocial support through participation in child friendly spaces activities , The project financed by The project financed by European Commission – Federal Foreign Office Strategy for Humanitarian Assistance, Federal Foreign Office Funding Policy.
Purpose of the End-Line Evaluation
The objective of this assignment is to conduct End-Line Evaluation For Som Integrated Lifesaving Assistance for Drought-Affected Communities in Somaliland to figure out project impact, accountability and lessons learnt.
This end-line evaluation will assess the performance of the project against key parameters including the project’s relevance, effectiveness, efficiency, sustainability, timelines of activity implementation and its strengths and weaknesses. The purpose of documentation of good practices is mainly to draw lessons learnt and document most significant change or success stories from the various beneficiaries of the project.
Hence, this end-line evaluation is expected to generate relevant findings, lessons, and practical recommendations for improving humanitarian assistance to drought-affected communities in Somaliland. This evaluation is expected to guide and inform implementing agency and other stakeholders in the sector for their future programming of integrated Health, Nutrition, WASH, CP and Livelihoods in Somaliland. The project under evaluation has gone under successive phases; it started as direct emergency relief, later added some WASH infrastructures, Cash program, and economic promotion (IGA) and later in the project, ICCM and child protection with some activities i.e. CFS of which communities will take over was added. Hence, the action tried bridge the gap between emergency and reconstruction/rehabilitation/recovery. Therefore, the evaluation aims to draw some additional learnings on this.
Specific objectives of the assignment
The evaluation will take into account the agreements made with regard to FFO-funded evaluations as stated in the Organisation Protocol
- The OECD DAC criteria for disaster response evaluations http://www.oecd.org/dac/evaluation/daccriteriaforevaluatingdevelopmentas… in accordance with the ALNAP Quality Proforma for assessment of the quality of humanitarian evaluations. https://www.alnap.org/system/files/content/resource/files/main/alnap-qua…
- The Sphere minimum standards in Humanitarian Response during the intervention. http://www.spherehandbook.org/
- The Code of Conduct for The International Red Cross and Red Crescent Movement and NGOs in Disaster Response Programmes during the intervention. https://www.icrc.org/eng/assets/files/publications/icrc-002-1067.pdf
The OECD/DAC framework is an evaluation tool developed for the development sector based on five criteria to which two have been added specifically for humanitarian contexts:
- Relevance – the extent to which an aid activity corresponds to the priorities and policies of the target group, partners or funding bodies.
- Effectiveness – the extent to which an aid activity meets its objectives.
- Efficiency – outputs considered – qualitatively and quantitatively – in relation to resources used/inputs.
- Impact – the positive and negative, direct or indirect, intended or unintended effect of an intervention.
- Sustainability – whether the benefits of the activity are likely to persist once the funding body has withdrawn funding.
- Coverage – the extent to which major population groups facing life-threatening suffering were reached by humanitarian action.
- Coherence – the extent to which security, developmental, trade, and military policies as well as humanitarian policies, are consistent and take into account humanitarian and human rights considerations.
The Core Humanitarian Standards on Quality and Accountability (CHS) sets out nine commitments for humanitarian and development actors to measure and improve the quality and effectiveness of their assistance. However a number of concepts very important for the quality and accountability of a project are not addressed by the OECD-DAC criteria alone (e.g. participation, learning, etc.). Therefore the evaluation team will measure the project against the DAC, the CHS, and the Quality and Accountability Compass (see diagram below – source URD):
The ALNAP Quality Proforma will be used for two purposes: 1) to offer criteria and measures to assess the intervention and 2) as a checklist to assess and improve quality of the evaluation itself. With regards to assessing the project’s success, the Proforma has the following criteria:
- Application of OECD/DAC standards
- The extent to which agency policies and principles were applied
- The agency’s management and HR procedures and practices and their effect on the intervention
- The quality of needs and livelihoods assessments
- The relevance of the intervention objectives to the contextual analysis and needs/livelihoods assessments
- The quality of programme cycle processes, including: Quality of planning, implementation, monitoring and/or real-time evaluative mechanisms, intervention expenditure.
The Proforma’s first criteria for assessing the project overlaps with those above, however, the some of the others (agency policies, HR procedures, and programme cycle processes) are not addressed by the above frameworks. The project will be assessed against these additionally.
Sphere’s Core Standards (People-centred humanitarian response, Coordination and collaboration, Assessment, Design and response, Performance, transparency and learning, and Aid worker performance) also overlap almost entirely with other criteria above, however its standards on transparency and its Protection Principles are welcome additions that the evaluation will hold the project accountable to. The four Protection Principles are:
- Avoid exposing people to further harm as a result of your actions
- Ensure people’s access to impartial assistance – in proportion to need and without discrimination
- Protect people from physical and psychological harm arising from violence and coercion
- Assist people to claim their rights, access available remedies and recover from the effects of abuse
Based on the findings of the above generate lessons learnt, challenges, and best practices make realistic and feasible recommendations for improving humanitarian assistance while strengthening local emergency preparedness, response capacity and resilience for communities in Somaliland.
Scope of Work
The consultant will drive or calculate the sample size from the list of villages under Som Integrated Lifesaving Assistance for Drought-Affected Communities in Somaliland projects target locations. The end-line evaluation will be conducted in Somaliland, Togdheer, Sool, and Sanaag. The consultant is also expected to find out how the shift from a primary humanitarian project to a more integrated project with more structural and transitional components has worked out. In doing so the consultant will focus all relevant project indicators.
In addition to the above indicators, the consultant is also expected to give much attention the following points as well.
For the FSL the following below indicators need to be evaluated:
- Was the cash intervention aligned to the findings from the malnutrition screenings and can we demonstrate less relapses into malnutrition in the cash-recipient families?
- Did the cash contribute to children staying in school (or attending school at the new location with reference to displaced families)?
- Exclusive focus on cash? In case a significant number of cash-recipient households (including IGA beneficiaries) would show labour availability, would there have been different modalities to better engage the households in recovery-oriented activities WHILE doing life-saving assistance
For the Health and Nutrition the following below indicators need to be evaluated:
- Regarding the mobile teams, what about a cost-benefit analysis in terms of reaching beneficiaries with this modality, in addition to this how the shift from mobile teams to fixed health facilities and ICCM has worked out, how the local actors perceive it?
- Was the project helpful in increasing the Health facility utilization rate? If yes, by how much?
- Immunization coverage rate in supported districts
- Was there an improved ANC uptake as a result of the project interventions?
In terms of technical standards, the project will be measured against the following Sphere standards and indicators:
Correction of malnutrition standard 1: moderate malnutrition:
• The proportion of exits from targeted supplementary feeding programmes who have died is <3%, recovered is >75% and defaulted is <15%
• Admission of individuals is based on assessment against internationally accepted anthropometric criteria
• Targeted supplementary feeding programmes are linked to any existing health structure and protocols are followed to identify health problems and refer accordingly
• Supplementary feeding is based on the distribution of dry take-home rations unless there is a clear rationale for on-site feeding
Correction of malnutrition standard 2: severe malnutrition in OTP
• The proportion of exits from therapeutic care who have died is <10%, recovered is >75% and defaulted is <15%
• Discharge criteria include non-anthropometric indices such as good appetite and the absence of diarrhea, fever, parasitic infestation and other untreated illness
• Nutritional and medical care is provided according to internationally recognized therapeutic care protocols
• As much attention is attached to breastfeeding and psychosocial support, hygiene and community outreach as to clinical care
The Code of Conduct for The International Red Cross and Red Crescent Movement and NGOs in Disaster Response Programmes during the intervention also overlaps with the other frameworks, with a heavier emphasis on impartiality, respect for culture, and accountability:
- The humanitarian imperative comes first
- Aid is given regardless of the race, creed or nationality of the recipients and without adverse distinction of any kind
- Aid priorities are calculated on the basis of need alone
- Aid will not be used to further a particular political or religious standpoint
- We shall endeavour not to act as instruments of government foreign policy
- We shall respect culture and custom
- We shall attempt to build disaster response on local capacities
- Ways shall be found to involve programme beneficiaries in the management of relief aid
- Relief aid must strive to reduce future vulnerabilities to disaster as well as meeting basic needs
- We hold ourselves accountable to both those we seek to assist and those from whom we accept resources
- In our information, publicity and advertising activities, we shall recognise disaster victims as dignified humans, not hopeless objects
For the Child protection, the following below indicators need to be evaluated:
- How does the Child resilience and PSS trainings have impact to the children’s wellbeing
- How and what % Parents/caregivers (women and men), and children demonstrate and understand of the role of family in child resilience
- At what % does the awareness among communities to protect children and youth from violence increased
- How and what % community based child protection structures and mechanisms functioning and engaged to reduce violence against children and youth
For the WASH the following below indicators need to be evaluated:
- What % of crisis affected households have reported increased access to clean and safe water according to Sphere standards
- What % of drought affected people in our target locations that can demonstrate satisfactory health and hygiene knowledge and practices
- What is the average liters/person/per-day that drought affected communities in our target locations can access from their current sources
- Percent of households targeted by latrine construction/hygiene promotion program whose latrines are completed and clean
- Average number of users per functioning toilet in our target areas
- Percent of people targeted by the hygiene promotion program who report using a latrine the last time they defecated
- Percent of people targeted by the hygiene promotion program who know at least three (3) of the five (5) critical times to wash hands
The end-line evaluation will use a mix of qualitative and quantitative methods that will include but not be limited to review of existing literature on the humanitarian situation in Somalia, SC’s response and other relevant literature, analysis of the project monitoring data, focus group discussions, key informant interviews, observations and a survey covering a sample of targeted beneficiaries.
Participatory methods that maximise the meaningful participation of children and their carers will be important. The evaluators shall present an inception report detailing key evaluation questions with respect to each evaluation criteria; source of information/data; sampling procedures and the sample size, data collection method and tools, data analysis plan and a report structure. The inception report shall be refined in consultation with SC Somalia/Somaliland staff and approved before commencing data collection.
The end-line evaluation shall as far as possible use tools that were used to establish the project baseline (FSL , Health and Nutrition and Wash sectors), mid-term; any adaptations to the tools should still enable comparison with baseline and mid-line data in measuring results.
The evaluators will work with the respective technical specialists and teams in the field for FSL, Wash, CP and Health/Nutrition as well as the MEAL team for technical and quality backstopping.
Planning and Logistics
The data collection exercise for the Som Integrated Lifesaving Assistance for Drought-Affected Communities in Somaliland end-line evaluation is expected to start early December 2019 and assignment days will be 25 days. Below is a draft schedule of activities
The actual sites will be agreed in the planning day, but this end-line evaluation will target sample villages of Som Integrated Lifesaving Assistance for Drought-Affected Communities in Somaliland intervention areas of Togdheer, Sool, and Sanaag regions.
Presentation of the Results
The following outputs are expected of the consultant
- Detailed methodology and data tools
- 1 field monitoring reports of no more than 18 pages summarizing findings of the field monitoring and recommendations after every field visit.
- A set of pictures with GPS coordinates taken during the monitoring exercise shall be appended separately. Pictures must show supported facilities, beneficiaries receiving services and all other information that depicts the quality of services being offered
- SCG, SCI and the implementing partners will disseminate the findings and lessons learnt, which means the consultancy shall have no exclusive copyright of the report.
Organization, Roles and Responsibility The consultancy will be contracted by and report to Save the Children. The project team, country office MEAL staff and technical advisors will provide all the necessary support for the end-line evaluation process. They will provide project documents and also will provide technical assistance (e.g. avail any other documents and information needed etc).
Period of Consultancy: 25 days starting from contracting date.
Consultant type required: Individual or Firm
Responsibility for Logistics arrangements and Costs: Save the Children will provide Enumerators and logistical issues (Transportation arrangement during the data collection exercise in the field) and as per the consultancy agreement. The consultant will be responsible for all other related expenses, including Accommodation, Meals, etc.
Taxation Provisions: Consultant shall be responsible for all Taxes arising from the consultancy in line with the Somaliland Tax regulations applicable at the SCI Hargeisa Office
Travel requirements: Consultant will manage any travel costs outside Hargeisa
Security requirements:Consultant will comply with standard Save the Children Security procedures, including the completion of SCI online security training prior to travel to Somaliland
Qualification and Experience
- A minimum of first degree relevant to the area of the task (e.g. statistics, Sociology, social work, community psychology, gender studies etc.).
- Proven experience in conducting quality third part monitoring, baseline studies and evaluation, assessing development programmes
- Thorough knowledge on the relevant thematic area of focus and Somaliland context
- English essential; local language skills would also be helpful.
The consultant must meet the required qualifications and experience defined above and completeness of application.
Interested consultants should submit their applications via email to [firstname.lastname@example.org ].
The applications should be submitted in PDF format as one document comprising Technical and Financial sections as detailed below.
a) Technical proposal – including but not limited to :
- Consultants understanding of the assignment and context
- Approach to the assignment
- Key staff bio-data (Resume)
b) Financial proposal – providing a breakdown of all charges related to the assignment.
c) CV(s) of consultant(s) with minimum of 3 traceable and recent references and Company’s Profile & Lead consultant(s) CV(s) (for firms Only).
d) Sample report of the same activity previously done.
Applicants should also indicate the date they are available to start working on the consultancy
All applications MUST be submitted on or before the closing date below to be considered for the assignment.
Only shortlisted Candidates will be contacted.