CALL FOR EXPRESSIONS OF INTEREST - EVALUATION - Medica Mondiale
←
→
Page content transcription
If your browser does not render page correctly, please read the page content below
CALL FOR EXPRESSIONS OF INTEREST – EVALUATION
1. Overview
medica mondiale e.V. seeks a FEMALE EVALUATOR / TEAM OF EVALUATORS for a final evaluation:
Overview
Desired data collection period in-country (field December 2020
work planned pending developing of the
Covid-19 situation)
Project Title Comprehensive South Kivu Support
Programme
Country Democratic Republic of the Congo (South
Kivu)
Project Duration 04/2018 – 03/2021
Project background, evaluation objectives / scope / questions / methodology / timeline / outputs
This TOR provides information about the purpose and objectives of the evaluation, background
information about the project, and details about the scope of work, evaluation questions,
methodological requirements as well as the projected timeline for the evaluation with outputs and
deliverables.
Application procedure
Applications with the subject line ‘Final Evaluation South Kivu Support Programme’ are received
under evaluation@medicamondiale.org until 1 November 2020. Questions can be asked under
evaluation@medicamondiale.org. Please send the entire offer in one pdf file with a maximum of
2MB, including your daily rate and a budget (not exceeding 40,000 euro). Only short
listed/successful candidates will be contacted. The interviews are likely to take place in the
second week of November.
Professional qualifications
The key selection criteria are the methodological evaluation expertise and experience in qualitative
and quantitative methods, professional expertise and experience especially in the areas of
psychosocial support and services for SGBV survivors, capacity development and empowerment;
cultural and conflict sensitivity; gender- and trauma-sensitivity; a feminist and intersectional
research perspective; regional competency, including language proficiency; analytical, verbal and
written communication skills.
About medica mondiale e.V.
medica mondiale e.V. is a non-governmental organisation based in Cologne, Germany. As a feminist
women’s rights and aid organisation, medica mondiale e.V. supports women and girls in war and
crisis zones throughout the world. Through own programmes and in cooperation with local women’s
organisations we offer holistic support to women and girl survivors of sexualised and gender-based
violence. On the political level, we pro-actively promote women’s rights, call for a rigorous
punishment of crimes as well as effective protection, justice, and political participation for survivors
of violence. Currently medica mondiale e.V. is working in Northern Iraq/Kurdistan, in Afghanistan,
in Liberia, in Kosovo, in Bosnia and Herzegovina as well as the African Great Lakes Region.
Through programmes and in partnership with local women’s rights organisations, medica mondiale
e.V. takes a multi-level approach to address the various factors contributing to violence against
women and girls: On the individual level, medica mondiale e.V. provides access to holistic services
(psychosocial, health, legal, economic) for survivors of s/gbv. On the level of women’s and girls’
social environment, medica mondiale e.V. supports communities to recognize and protect women’s
1
medica mondiale e.V., Hülchrather Straße 4, 50670 Cologne, Germany,
https://www.medicamondiale.org/and girls’ rights and to support survivors of s/gbv. On the institutional level, medica mondiale e.V.
capacitates public institutions from the health and legal sector to adopt a stress- and trauma-
sensitive approach towards survivors and to establish cross-institutional referral and support
systems. On the political level, medica mondiale e.V. advocates for laws, policies and resolutions
that address s/gbv and promote women’s political participation. On the societal level, medica
mondiale e.V. campaigns against sexism and gender stereotypes, raises awareness on s/gbv or
the long-term impacts of trauma within societies.
Further information on medica mondiale e.V. can be found on our website:
www.medicamondiale.org
2. Purpose and Objectives of Evaluation
This final evaluation serves as important participatory learning process for all stakeholders involved
in the project. The purpose of the final evaluation is to provide decision makers at medica mondiale
e.V. with sufficient information to make an informed decision about the performance of the project,
document lessons learnt and provide practical recommendations for follow-up actions and similar
future projects.
As general standard, this final project evaluation shall include an assessment of the project’s
impact, effectiveness, relevance, efficiency, coherence, and sustainability. The success of the
project shall be assessed regarding its stated objectives. The final evaluation should generate
practical hands-on recommendations that can be implemented by the project actors within their
sphere of control as follow-up actions for this project and beyond. The evaluation will be used to
gain more knowledge on effects and impacts to inform future management and programming.
medica mondiale e.V. will share the evaluation results with the partner organisations and other
recipients.
3. Background
Initial Situation and Project Site
The UN estimated that about 200,000 women and girls were victims of sexualised violence in
Eastern DR Congo since 1998. Due to the successive normalisation of violence and patriarchal
structures these cases also include violence inflicted by civil authorities or family members next to
war-related crimes. Sexualised violence continues negatively impact the well-being of women and
girls and hampers peaceful and sustainable development in the DR Congo (DRC).
The psychosocial and health consequences for the women and girls are manifold, including
reproductive health problems, post-traumatic symptoms like anxiety, nightmares or flashbacks and
psychosomatic problems. In the communities, rape is highly stigmatised, frequently resulting in
spousal expulsion, limited opportunities to marriage, rejection by the community and poverty. Given
their traumatising experiences, many survivors require long-term support based on stable and
trustful relations.
In South Kivu, a province of the DR Congo bordering Rwanda, Burundi and Tanzania, more than
2.600 incidents of sexual gender-based violence (SGBV) were registered according to a report by
the Ministry of Gender, Family and Children (MINIGEFAE) and UNFPA. Many cases, however, remain
unreported. While national laws concerning sexual violence, a national strategy and the National
Action Plan on combating sexual and gender-based violence do exist, the specific needs and
situation of women in the local communities are not sufficiently taken into consideration. Even
declarations by (inter-)national political forums such as the International Conference of the Great
Lakes Region (ICGLR) have little effect given the insufficient political will and resources invested by
2
medica mondiale e.V., Hülchrather Straße 4, 50670 Cologne, Germany,
https://www.medicamondiale.org/national governments. Although national strategies and legislation are in place, state action against
SGBV is weak in DRC.
Small local initiatives and women's organisations, among them partners of medica mondiale,
support survivors of sexualised violence in local communities even in times of intense violence or
when an immediate crisis has ceased. An everyday challenge for these organisations is the
overwhelming number of survivors, the volatile security situation and poor infrastructure. In the
absence of professional exchange, they often have to identify appropriate approaches by
themselves to assist survivors and reintegrate them into their families and communities. A joint
assessment by medica mondiale and the EED from 2009 highlighted that many of these
organisations need organisational capacity development, further qualification and to improve their
cooperation.
Psychological knowledge is primarily centralised in urban areas and within specific programmes.
Exchanges of expertise between professionals as well as between urban and rural areas are rare.
Women’s organisations supporting SGBV survivors often face high stress levels and conflicts in
teams, frequent staff turnover or work absences due to burnout or illness. It is not adequately taken
into consideration that staff members are themselves affected by traumatic experiences of war and
(sexualised) violence and that, therefore, all staff members need to know methods of self-care and
basic trauma- and stress-sensitivity.
Background information about the Project „South Kivu Support Programme”
In the Great Lakes Region medica mondiale has built trustful partnerships with women’s
organisations since 2004. In project cooperation’s, medica mondiale contributed to their
professionalisation and the quality of their services by providing technical and financial support.
The purely financial support by medica mondiale’s Small Grants Program proved to be successful
to get to know a variety of local women’s organisations. However, in particular in South Kivu the
lack of appropriate qualification of many of these small organisations remained a serious
challenge.
As a response, medica mondiale developed the South Kivu Support Programme which consists of
5 main elements: organisational capacity development (1); qualification in trauma-sensitive
psychosocial work (2); knowledge exchange and networking amongst the organisations (3); joint
advocacy (4); increased awareness on self-care/ security (5); stress- and trauma sensitivity in
health care work (6). By strengthening local capacities, it contributes to the empowerment of
women and girls, in particular survivors of sexualised and other forms of violence, in South Kivu,
DRC. In order to pursue its regional objectives more efficiently medica mondiale opened a regional
office in Bujumbura/Burundi in 2015.
The comprehensive South Kivu Support Programme currently consists of two components, one
focuses on the support of the partner organisations’ micro projects, capacity development and
organisational development, and the other on psychosocial qualification:
The project “Local women’s organisations rise for women’s rights and against sexualized violence
in South Kivu, DRC (Phase 2)” (04/2018 – 03/2021), co-funded by the Medicor Foundation, is
supporting 6 local women’s organisations through grants, capacity development, and networking.
The organisations receive annual grants for their own micro-projects. The specific objectives are to
strengthen women and girls affected by SGBV in their self-help capacities, to improve the
assistance to and protection of women and girls affected by SGBV by a more informed and
responsive social environment and to support partner organisations in taking concerted action
against SGBV and violation of women's rights in South Kivu.
The second project „Consolidation and upscaling of local psychosocial capacities as a contribution
to the promotion peace in the Great Lakes Region“ (04/2018 – 03/2021), co-funded by the
3
medica mondiale e.V., Hülchrather Straße 4, 50670 Cologne, Germany,
https://www.medicamondiale.org/Fondation Smartpeace, aims at contributing to the promotion of a positive peace in the Great Lakes
Region by breaking cycles of violence and increasing the target group’s participation in social
processes. Civil society actors are strengthened through qualification measures, professional
exchange and knowledge transfer in regard to psychosocial approaches and enabled to provide
effective stress- and trauma-sensitive counselling. One objective is the consolidation of a pool of
psychosocial experts (women from Burundi and DR Congo), which was established in the previous
project phase. The project is implemented in South Kivu in DRC, and includes experts from Burundi
and Rwanda.
The project is implemented in cooperation with six partner organisations. The following table
provides a short description of the six local women’s organization:
Name of organisation Date of foundation and Strategic goals Location in DRC
Association des femmes pour la Founded in Kibila in 1999 Uvira,
promotion et le développement AFPDE’s mission is to help people help themselves, to Uvira Territory, South Kivu
endogène (AFPDE) promote the protection of human rights and to improve the
social, health, economic and political status of women. AFPDE
also provides assistance for children in difficult
circumstances. .
Ensemble pour la Promotion de Founded in Fizi in 2002 Uvira,
la Femme et Famille (EPF) EPF’s mission is to reduce poverty and to improve health and Uvira Territory, South Kivu
economic development for women and children.
Haki , Amani na Maendeleo ya Founded in Uvira in 2004 Uvira,
Akina Mama (HAM) HAM’s mission is to improve the socio-economic conditions of Uvira Territory, South Kivu
vulnerable women and girls by promoting their rights and
supporting their socio-economic empowerment.
La Floraison Founded in Baraka in 2008 Baraka,
The organisation is dedicated to the defence of women's and Fizi Territory, South Kivu
children's rights in rural areas and the socio-economic
empowerment of women. The mission is to increase the
knowledge and skills of young people in Fizi Territory.
Réseau associatif pour la Founded in Bukavu in 2011 Bukavu
psychologie intégrale (RAPI) RAPI’s mission is to improve the mental health of SGBV Bukavu, South Kivu
survivors, to support their socio-economic reintegration and
to provide legal support for the SGBV survivors. RAPI is a
network of grass-roots organizations. The implementing
network member is FOPADEKI, a women’s group in Fizi
Territory which is technically supported by the network.
Réseau des Femmes pour les Founded in Bukavu in 1999 Bukavu, South Kivu
Droits et la Paix (RFDP) RFPD’s mission is peace building, the promotion of human
rights and equal opportunities for women and men in the
community.
The overall approach of the project combined includes diverse actors: several small women’s
organisations, one regional psychosocial consultant, one regional consultant for organisational
development, the pool of experts, and the medica mondiale regional office staff in Burundi. Both
projects are interwoven and contribute to each other, medica mondiale therefore decided to tender
an evaluation handling both projects as one programme.
Overall objective (impact): Le projet contribue à la promotion d’une paix stable dans la Région des
Grands Lacs, en rompant des cycles de violence et en permettant la participation au processus
sociaux, et à l’autonomisation, des femmes et filles affectées par la violence sexuelle et basée sure
le genre.
Project goal: Les femmes et les filles ont renforcé leurs capacités d’auto prise en charge (Assistance
holistique).
Target groups:
4
medica mondiale e.V., Hülchrather Straße 4, 50670 Cologne, Germany,
https://www.medicamondiale.org/• Members of the expert pool
• Partner organisations’ staff, including psychosocial assistants, their supervisors, and
directors
• Staff of regional health facilities
• Community members
• At least 2000 women and girls in South Kivu who are affected by sexualised and gender-
based violence
Measures to achieve the objectives include:
• Consolidation du pool d’expertes
• Mis en œuvre d’un mécanisme de coordination entre les OP
• Sur base desstratégies de plaidoyer des OP, créer des alliances autour d’une action
conjoint de plaidoyer, réaliser des actions concertées de plaidoyer au niveau local et
provincial auprèsdes acteursclés
• Réalisation des actions de sensibilisation communautaire
• Réaliser la PEC psychosocial des survivantes de VSBSF
Project sub-goals with targets / results model (in French, shortened for the purpose of these TOR)
Description Champs d’observation Indicateurs Source
A.1. Niveau de société :
Le projet contribue à la
promotion d’une paix stable
dans la région, en rompant des
cycles de violence et en
permettant la participation au
processus sociaux des femmes
et filles affectées par la
violence.
A.2. Niveau des bénéficiaires :
Le projet contribue à
l’autonomisation des femmes et
filles, notamment des
survivantes des violences
sexuelles et basées sur le genre.
B.1. Objectif générale: Etat psychologique I.B.1.1. 1200 - Rapport annuel des OP
Les femmes et les filles ont sur 2000 clientes (60%) constatent - Rapports mensuels des APS
renforcé leurs capacités d’auto avoir retrouvé un - Fiche de suivi individuelle des
prise en charge (Assistance équilibre psychologique à travers clientes
holistique) l’assistance
Intégration sociale I.B.1.3. 120 clientes sur 2000 clientes - Rapport annuel des OP
(6%) sont plus intégrées dans les - Rapports mensuels des APS
familles et communautés (p.ex. - Fiche de suivi individuelle des
observations des APS, animatrices, clientes
constat des femmes mêmes)
Situation économique I.B.1.4. 150 clientes développent des - Fiches suivi des groupes
AGR et sont en mesure de combler AGR/épargnes
leurs besoins de base (p.ex. 2 repas - Interviews avant et après
par jour, soins médicaux et scolarité créations AGR
des enfants) - Rapport d’évaluation final du
programme
B.2. Objectif Spécifique 1 : Prise de décision conjointe, I.B.2.1. Le comité de Coordination - Compte rendu de réunions
Les organisations partenaires basée aux résultats se rencontre chaque trimestre trimestrielles
prennent des mesures pour analyser les progrès accomplis,
concertées contre les VS et les problèmes à résoudre et prend
contre les violations des droits des décisions partagées
des femmes au Sud Kivu en Système de référencement I.B.2.2. 150 références réussies - Fiche de référence et contre-
ligne avec les standards du STA. qui fonctionne documentées et ventilées par service référence
- Rapport sur le questionnaire
de satisfaction des clientes
B3. Objectif Spécifique 2: Attitude de la Famille / I.B.3.1. 300 femmes et filles rapport - Rapport des OP
Le milieu social et institutionnel communauté qu’elles ont été encouragées ou - Rapport des APS
améliore l’assistance et la encourageants soutenues par un membre de la - Fiches de suivi individuelle des
protection des femmes et filles famille ou de la communauté à clientes
affectées par les VSBG chercher l’assistance d’une APS
locale
5
medica mondiale e.V., Hülchrather Straße 4, 50670 Cologne, Germany,
https://www.medicamondiale.org/L’attitude des autorités I.B.3.2. Au moins 1 changements de - Communications de décideurs
locales lois, de politiques et de pratiques est émises en privé
intervenu - Déclarations de décideurs
dans le domaine public
- Projets de loi (ordonnance,
règlement, décret)
Institutionnalisation et I.B.3.4. Le - Baseline : Diagnostique des
qualité du STA (il y a plus personnel des services sanitaires services sanitaires
d’offre de services de ciblés (6 hôpitaux et 19 CdS) qualifié - Rapport de suivi des expertes
PEC holistique de bonne en STA applique l’approche dans les psychosociales
qualité) hôpitaux conformément aux critères
de qualités du STA
C.1. Qualification en STA : Compétence des I.C.1.1. Les expertes psychosociales - Rapports d’évaluation
participants des formations du pool appliquent les méthodes sur individuelle des expertes du
Une expertise psychosociale lesquelles elles ont été pool du département trauma
locale et régionale en STA est formées, conformément aux critères
développée. de qualités du STA
I.C.1.2. Les APS appliquent les - Rapport de coaching des
méthodes sur lesquelles elles ont été expertes du pool
formées, conformément aux critères
de qualité du STA
I.C.1.3. Au moins 60 % du personnel - Rapport des OP
des OP qualifié en STA - Rapport des formations
C.2. Renforcement de capacités Existence et fonctionnement I.C.2.1. Les 6 OP appliquent les - Manuel de suivi et
organisationnelles des OP: d’un système de suivi et documents de suivi appropriés et évaluation,
évaluation des adaptés au projet, conformément au - Documentation des réunions
Une structure de coordination et microprojets manuel de suivi et évaluation) de suivi et évaluation du comité
collaboration plus efficace des de coordination
OP du Sud Kivu est mise en
place.
Renforcement des I.C.2.3. Existence et degré de mise en - Plans de renforcement des
capacités systématique œuvre des plans de renforcement des capacités
et continué selon les capacités - Rapport semestriel des OP sur
besoins la mise en œuvre du plan
C.3. Plaidoyer conjoint: Quantité et qualité des I.C.3.1. 2 campagnes de - Rapport des journées
Les communautés et les actions de plaidoyer et plaidoyer conjoints des OP réalisés spécifiques de plaidoyer
autorités traditionnels et sensibilisation
communautaires sont plus
informés et qualifiés sur
l’assistance et la protection des
VVSBF.
I.C.3.3. Au moins 5 réunions et 20 - Rapport des journées
émissions radio diffusées d’actions de spécifiques de plaidoyer
plaidoyer menées envers les
autorités
I.C.3.4. 60% des hommes, femmes et - Rapport semestriel des OP à
adolescents bénéficiaires des partir des questionnaires à
sensibilisations de aux moins 150 chaude (échantillon)
village (aprox. 60.000 d’un total
de 200.000 personnes, nombre exact
pour définir) connaissent les
questions clés relatives à la protection
et préventions des VS
C.4. Offre des services Quantité e qualité des I.C.4.1. 1400 de 2000 bénéficiaires - Rapport annuel des OP
holistiques services offerts (70%) des services de PEC Rapport sur le questionnaire de
psychosociale et orientation et satisfaction des clients
Les OP offrent des services référencement médical et juridique
plurisectoriels et durables aux offerts par les OP sont satisfaits des
survivantes des VVSBG services reçus.
Quantité AGR et initiatives Quantité et qualité AGR: voir I.B.1.4
d’épargnes réalisés
I.C.4.2. 50 initiatives d’épargnes et - Rapport des OP et des APS
des crédits des clientes réalisées - Rapport semestriel
des groupes d’épargnes et des
crédits.
D.1.1. Consolidation du pool Numéros des activités, et I. D.1.1.1. Chacune des expertes - Rapport des formations de
d’expertes quelques critères de psychosociales locales a participé au qualification
Finaliser la Formation du qualité. moins à un module de qualification en - Rapport des counselings
premier groupe (certification) tant que co-formatrice. (11 expertes
Formation de nouvelle du premier cycle de formation, 3-4
expertes (réalisée par les expertes supplémentaires)
expertes tu première group)
6
medica mondiale e.V., Hülchrather Straße 4, 50670 Cologne, Germany,
https://www.medicamondiale.org/Élaboration d'un cadre I. D.1.1.2. Chacune des expertes
institutionnel du pool d'expertes psychosociales locales a donné au
et promotion du pool moins une formation sur le TSA et
réalisé un coaching pour les APS. (11
expertes du premier cycle de
formation, 3-4 expertes
additionnelles)
D.1.3. Qualification des OP en I. D.1.3.1. Max. 12 nouvelles APS + 3 - Rapports des formations
STA7: Superviseurs par cycle ; (2 cycles à 15
Réaliser deuxième cycle de personnes ou 3 cycles de 10
formation des personnes) (total = 30 personnes)
nouvelles APS8 et superviseurs qualifiés dans les 4 modules +
des APS coaching et visites au postes.
Formation des directrices en
STA I.D.1.3.2. 6 directrices (1 par OP)
Formation des équipes sur la formés en TSA
culture STA
I.D.1.3.3. Equipes complètes des OP
formés en TSA
D.2.3. Mis en œuvre d’un I.D.2.3.1. Document que décrit le - Document qui décrit le
mécanisme de coordination mécanisme de coordination entre les mécanisme de coordination
entre les OP. OP disponible entre les OP
- Rapports trimestriels de
I.D.2.3.4. Manuel de suivi mensuel et coordination
trimestriel des micro-projets et du - Rapports des réunions de
programme disponible et utilisés par synergie
les OP (inclus critères de qualité pour - Document de la
indicateurs, le plan de suivi, des cartographie
fiches pour collectionner les donnes, - Manuel de suivi mensuel et
et la définition des rôles et taches trimestriel des micro-projets et
pour le suivi du progrès) du programme
- Rapport des OP à
medica mondiale
D.3.1. Créer des alliances autour I.D.3.1.1. 10 associations locales, - Accord de collaboration avec
d’une action de plaidoyer nationales, internationales impliquées les associations locales,
par activités de plaidoyer. nationales, internationales
impliquées pour les activités
de plaidoyer
D.3.2. Réaliser des actions I.D.3.2.1. Existence d’un document - Stratégie de plaidoyer
concertées de plaidoyer au sur le plan ou la stratégie de plaidoyer conjoint en soi
niveau local et provincial auprès conjoint - Documents en soi : vidéo, ou
des acteurs clés documents écrits
I.D.3.2.2. Nombre de programmes,
matériels écrits et audiovisuels
produits et utilisés
D.3.3. Réalisation des actions I.D.3.3.1. 600 autorités - Rapport des sensibilisations
de sensibilisation communautaires participent des APS
communautaire activement aux sensibilisations - Rapport semestriel des OP à
partir des questionnaires à
I.D.3.3.2. 30% de la population totale chaude
des zones cibles est exposées à des
messages de prévention de la
violence et sur les droits des femmes
D.4.1. Réaliser la PEC I.D.4.1.1. 2000 femmes - Rapport annuel des OP
psychosocial des survivantes de accompagnées et prises en charge au - Rapport des APS
VSBSF (inclus le niveau psychosociale – économique – - Bon de références et contre
perfectionnement des juridique directement par les OP références
maison d’écoutes) - Fiches de suivi des APS
D.4.2. Orientation médical et I.D.4.1.2. 500 survivantes référées
judicaire des survivantes et vers d’autres services publics ou
référencement aux privés et prise en charge au niveau
services/institutions sanitaires et médicale et juridique
judicaires étatiques ou non-
étatiques
D.4.3. Réaliser des conventions I.D.4.3.1. Convention de partenariat - Document : Convention de
de partenariat avec les avec les structures sanitaires pour le partenariat
structures sanitaires pour le référencement médical et l’orientation
référencement médicale et l’ psychosociale vers les OPs disponible
orientation psychosociale vers
les OPs
D.4.4. Developpement et support Quantité et qualité AGR: voir I.B.1.4
des AGR des survivantes de
VSBSF (support financier,
groupes d’épargnes, formation
7
medica mondiale e.V., Hülchrather Straße 4, 50670 Cologne, Germany,
https://www.medicamondiale.org/de compétences
entrepreneurials)
4. Scope of Work
Final evaluation of the project. As part of the evaluation, different project sites will be visited.
Assessment – DeGEval Standards and DAC evaluation criteria
The evaluation shall be conducted in line with the DeGEval Evaluation Standards: Utility, Feasibility,
Propriety and Accuracy. The evaluation shall include a performance assessment based on the latest
OECD-DAC criteria and provide feasible lessons learned for future programming. Evaluation
questions will be developed to assess the following areas:
1. Relevance: Do we follow the right approach/ are we doing the right things? To what extent
does the approach with its objectives and design respond to the beneficiaries’, global,
country, and partner/institution* needs, policies, and priorities? What are the differences
and trade-offs between needs or priorities? To what extent will the approach remain
relevant if circumstances change? What can be or has been adapted for the approach to
remain relevant if the context changes/ when the context changed?
*government (national, regional, local), civil society organisations, private entities and international bodies
involved in funding, implementing, and/or overseeing the intervention
2. Coherence: To what extent is the project compatible with other projects in the country,
sector, or institution? To what extent do other projects and/or policies support or undermine
the approach, and vice versa? What can be stated about the internal coherence
(synergies/links with other projects by same actor, and consistency with norms/standards
followed by same actor)? What can be stated about the external coherence (consistency
with other actors’ projects in same context)?
3. Effectiveness: Do we implement the approach in an effective way? To what extent has the
project generated positive changes / what are the key changes experienced so far? Are
there any differences between groups affected by or related to certain objectives? To what
extent are the objectives likely to be achieved? What are the major factors influencing the
achievement or non-achievement of the objectives?
4. Efficiency: Were inputs and activities used and realized in a cost-effective way? Have
objectives been achieved in an economic and timely way/ on time? Has the project been
implemented in the most efficient way compared to possible alternatives? What can be
stated about the efficient use of resources (comparison: resources – results)
5. Impact: What is the impact of the project/ to what extent has the project generated
significant positive or negative, intended or unintended, higher-level effects? What can be
stated about the impact on the overall situation of beneficiaries? What real difference has
the project made to the beneficiaries and how many people have been reached overall?
6. Sustainability: What can be stated about the sustainability of the project’s positive impact
after donor funding will cease/to what extent are the benefits of the project likely to
continue? What are the major factors influencing the achievement or non-achievement of
sustainability? What needs to be changed to ensure sustainability? What financial,
economic, social, environmental, and institutional capacities are needed to sustain the
benefits? What elements of the project (in order of prioritization) should be continued if
additional funding becomes available?
8
medica mondiale e.V., Hülchrather Straße 4, 50670 Cologne, Germany,
https://www.medicamondiale.org/The achievement of the project’s goals / sub-goals shall be analysed and assessed. Lessons
learned from the project implementation shall be derived to inform and improve the development
of future programming, management and organizational structure and strategy. Regarding any
major issues and problems affecting progress, recommendations shall be made and action points
identified. Necessary feasible recommendations shall be provided and be addressed to different
recipients.
Additionally, every DAC Criterion should be assessed and rated according to a provided rating scale
(overall assessment).
Further key questions of the evaluation
Further key questions of this evaluation are (French below):
• Mapping of all actors involved in the two projects
• Is the overall approach, as outlined in the project description, including diverse and
relatively small actors and a support structure facilitated by the regional office in Burundi
reasonable? Is the approach effective and does it make an impact?
• To what extent is the current intervention logic reasonable and how could it be improved?
• What were particular challenges with regards to the security situation in South Kivu?
• What can be stated about the psychosocial qualification measures, partially supported by
the pool of experts? What can be stated about changes experienced by women of the
partners’ target groups through psychosocial counselling?
• What is the capacity of the pool of experts, what are strengths and challenges? What is the
role of medica mondiale in empowering the group of experts? How can sustainability be
improved?
• What can be said about the medium and long-term effects of income-generating activities
on the daily lives of women? How does professional training contribute to economic and
social empowerment? How does it impact gender relations?
• Have partner organisations been strengthened? What can be said about their
organisational/capacity development?
• What can be stated about the collaboration between the partner organisations, and their
motivation and capacities to coordinate autonomously? What were the challenges,
strenghts and weaknesses?
• How have feminist principles been integrated into the work of partner organisations? What
are the obstacles the partner organisations as feminist actors are facing in achieving their
objectives?
• Are local actors and beneficiaries involved in the identification, planning, management and
evaluation of PO’s micro-projects?
• What were successes and challenges of advocacy work, in particular regarding access to
justice? What have been the impacts of community sensitisation interventions on
community behaviour changes?
• Has the project contributed to peacebuilding and justice in the region?
• What can be stated about the monitoring system, the indicators used and the theory of
change?
Des autres questions clés de cette évaluation sont les suivantes:
• Cartographie de tous les acteurs impliquées dans les deux projets
• L'approche globale, telle que décrite dans la description du projet, incluant des acteurs
divers et relativement petits et une structure de soutien facilitée par le bureau régional au
Burundi, est-elle raisonnable ? L'approche est-elle efficace et a-t-elle un impact ?
9
medica mondiale e.V., Hülchrather Straße 4, 50670 Cologne, Germany,
https://www.medicamondiale.org/• Dans quelle mesure la logique d'intervention actuelle est-elle raisonnable et comment
pourrait-elle être améliorée ?
• Quels étaient les défis particuliers concernant la situation sécuritaire au Sud-Kivu ?
• Que peut-on dire des mesures de qualification psychosociale, partiellement soutenues par
le pool d'experts ? Que peut-on dire sur les changements vécus par les femmes des groupes
cibles des partenaires grâce à l'accompagnement psychosocial ?
• Quelle est la capacité du groupe d'experts, quels sont les points forts et les défis ? Quel est
le rôle de medica mondiale dans l'autonomisation du groupe d'experts ? Comment peut-on
améliorer la durabilité ?
• Que peut-on dire sur les effets à moyen et long terme des activités génératrices de revenus
sur la vie quotidienne des femmes ? Comment la formation professionnelle contribue-t-elle
à l'autonomisation économique et sociale ? Quel est son impact sur les relations entre les
sexes ?
• Les organisations partenaires ont-elles été renforcées ? Que peut-on dire sur le
développement de leur organisation/capacité ?
• Que peut-on dire de la collaboration entre les organisations partenaires, de leur motivation
et de leur capacité à se coordonner de manière autonome ? Quels ont été les défis, les
points forts et les points faibles ?
• Comment les principes féministes ont-ils été intégrés dans le travail des organisations
partenaires ? Quels sont les obstacles auxquels les organisations partenaires, en tant
qu'actrices féministes, sont confrontées pour atteindre leurs objectifs ?
• Les acteurs et bénéficiaires locaux sont-ils impliqués dans l'identification, la planification,
la gestion et l'évaluation des micro-projets des OP ?
• Quels ont été les succès et les défis du travail de plaidoyer, en particulier en ce qui concerne
l'accès à la justice ? Quels ont été les impacts des interventions de sensibilisation de la
communauté sur les changements de comportement de la communauté ?
• Le projet a-t-il contribué à la consolidation de la paix et à la justice dans la région ?
• Que peut-on dire sur le système de suivi, les indicateurs utilisés et la théorie du changement
?
In addition, the following questions are part of all standard TORs of medica mondiale e.V. to
contribute to overall organizational learning.
• What can be stated about the effects/impacts on different levels of medica mondiale e.V.’s
multilevel approach?
• What can be stated about the application and impact of the stress- trauma-sensitive
approach (STA)?
• What can be stated about the projects’ contribution to peacebuilding?
The findings, derived conclusions and recommendations should be answered in an extra chapter
in the final report.
5. Methodology
The evaluation team should use a mixed method design, using quantitative and qualitative data.
The design should be based on a participatory approach and centre learning in all phases of the
evaluation process, e.g. by designing data collection instruments in a way that data collection by
itself allows for learning experiences on the part of stakeholders involved. In general, a trauma-
sensitive way of working is important to us in the context of working with survivors of sexualised
violence and ethical standards should be applied accordingly.
1. Desk review and analysis of documentation – available reports and other documents from
medica mondiale e.V. and the partner organization shall be analysed and the
methodology further refined in an inception report. For preparation purposes, initial Skype
10
medica mondiale e.V., Hülchrather Straße 4, 50670 Cologne, Germany,
https://www.medicamondiale.org/and phone interviews with relevant stakeholders shall take place before the field phase.
The project staff shall already be involved during the preparation. A planning meeting
shall take place in Cologne or remotely.
2. Interviews and focus group discussions shall take place with girls and women of the
partner organisation’s target groups, community members, and staff of the partner
organisations.
3. Workshop with all relevant stakeholders shall be conducted to present and discuss the
preliminary evaluation results and to present the initial recommendations.
4. Data triangulation and analysis shall be conducted in order to interpret the results and
draft the report.
We appreciate applications to consider alternative data collection to in-country visits due to the
uncertainty about the development of the current COVID-19 pandemic.
The final methodology will be defined and agreed upon in close cooperation with medica mondiale
e.V. during the preparation and before the data collection of the evaluation. This ensures
transparency. Furthermore, the dialogue is important to achieve “ownership” of the evaluation by
medica mondiale e.V. and partner staff and with this the acceptance and use of the evaluation
results.
All data collection conducted for medica mondiale e.V. should follow the WHO (World Health
Organisation) guidelines for ethical data collection “Putting women first: Ethical and safety
recommendations for research on domestic violence against women” and “WHO Ethical and safety
recommendations for researching, documenting and monitoring sexual violence in emergencies.”
6. Deliverables
• The evaluation team is expected to compile an inception report with the final specified
methodology, evaluation matrix, analysis methods, data collection instruments and work
plan in English.
• The evaluation team is expected to give a presentation of preliminary findings and
recommendations in French to partner organisations and other relevant stakeholders at
the end of the data collection phase. This workshop is an essential component in the
evaluation process. Possible follow-up steps and actions can be discussed and a learning
process takes place that is moderated by the evaluation team. The discussions and
results of this “initial findings sharing workshop” have to be included in the evaluation
process and its report.
• The evaluation team is expected to compile a draft report in English within 14 days after
completion of the data collection phase, which has to be shared first with medica
mondiale e.V.’s Evaluation Advisor.
• There will be two rounds of feedback, which the Evaluation Advisor coordinates internally,
after which the draft report has to be revised and returned.
• A presentation of the findings and recommendations to medica mondiale e.V. (in Cologne
or remotely).
• The evaluation team is expected to compile the final report (60 pages max. excluding
appendix) in English and French based on the feedback on the draft report. Quality
criteria for the report will be provided in advance.
• An assessment of the project according to the quality principles/features of medica
mondiale e.V. (assessment grid will be provided in advance).
• A summary of the evaluation report in English (max. 10 pages) for the website of medica
mondiale e.V..
11
medica mondiale e.V., Hülchrather Straße 4, 50670 Cologne, Germany,
https://www.medicamondiale.org/7. Timeline
Timeframe Evaluation phase Description of phase Maximum # days
November/December Preparation Analysis of relevant 10
2020 documents and
project
documentation;
Development of
evaluation tools and
inception report, and
planning meeting with
medica mondiale e.V.;
Skype meetings with
the regional office in
Bujumbura and
project stakeholders
January/February Data collection with Interviews and focus 10
2021 site visits in South group discussions
Kivu with key personnel of
partner organizations
/ stakeholders; Focus
group discussions/
workshops with girls
and women of the
target group (both
new and previous
clients), male
community members,
including story telling
methods or other
participative
methods; one-day
“initial findings
sharing workshop”
with partner
organisations to
present, discuss and
refine preliminary
conclusions and
recommendations
February – April 2021 Analysis and report Analysis and 15
writing triangulation of
evaluation results
and drafting of the
report; Presentation
and discussion of the
evaluation results
and
recommendations to
medica mondiale e.V.;
Write and send the
final evaluation report
after feedback and
presentation;
12
medica mondiale e.V., Hülchrather Straße 4, 50670 Cologne, Germany,
https://www.medicamondiale.org/Write brief summary
of evaluation report
to be published on
website of medica
mondiale e.V.
8. Management of the Evaluation
The selected evaluation team will be responsible for producing the final report. The Department of
Evaluation and Quality of medica mondiale e.V. will lead and manage the evaluation process, e.g.
consultant selection, contracting, and the provision and coordination of internal feedback on the
reports. The Department is an independent unit within medica mondiale e.V., distinguished from
programme departments, to enhance impartiality and credibility of the evaluation results.
The independency of the team towards medica mondiale e.V. and the partner organisations has to
be guaranteed. For us, this independency is a key requirement for a project evaluation and the
resulting findings and recommendations. Drawing on different competencies of each evaluator is
an important necessity for us to produce beneficial results and recommendations.
9. Evaluation Report – Requirements
The report shall be written in readily understandable language. The report shall clearly describe the
background and goal of the project as well as the evaluation methodology, process, and results in
order to offer comprehensive and understandable content. A transparent line of arguments shall
be kept throughout analysis, assessment, and recommendations so that every recommendation
can be comprehensibly attributed to the results that are based on data analysis. As per the principle
of usefulness, the recommendations shall be guided by the terms of reference and the information
needs and be clearly directed at particular recipients. A document detailing quality criteria for
evaluation reports will be provided by medica mondiale e.V. in advance.
13
medica mondiale e.V., Hülchrather Straße 4, 50670 Cologne, Germany,
https://www.medicamondiale.org/You can also read
