Deutsch Englisch
Navigation

Dr. Susanne Johanna Väth

 

Wome

Senior Project Manager

(CEval GmbH)

E-Mail: s.vaeth(at)ceval.de
Telephone: +49 (0)6 81 - 3 02 - 49 37
Fax: +49 (0)6 81 - 3 02 - 38 99
Office hours: by appointment
Address:
CEval GmbH
Im Stadtwald, Building C 5.3
66123 Saarbruecken
Areas of responsibility:
Contract research
Business development
Project management
Main areas of emphasis:
Impact Evaluation
Meta-Evaluation
Quantitative and qualitative methods
Development Economics
Development Cooperation
Organizational Development

 

Professional Career

Since 01.2015  Senior Project Manager at the CEval GmbH
04.2014 - 12.2014 Research associate at the Center for Evaluation (CEval), Saarland University
06.2009 - 03.2013

Research associate at the Institute for Co-operation in Developing Countries, Marburg University

Joint project "Regional Networks of Excellence on Land Policy and Land Administration" with GIZ, conducting policy consultations, reviewing initiatives and drafting position papers, participating in strategy meetings, contributing to impact monitoring and operatinal planning workshops of GIZ, monitoring project budgets, field research in Ghana and Kenya (9 months)

10.2011 - 12.2011
04.2010 - 06.2010

Consultant for the GIZ in Ghana

Analyses of the land governance system and large-scale investment in the oil palm sector

05.2007 - 05.2009 Student assistan at the Institute for Co-operation in Developing Countries
07.2008 - 10.2008
02.2008 - 04.2008
Student apprentice in the "Market-oriented Agriculture Programme" for GIZ in Ghana

Education

06.2009 - 03.2014 Doctorate at Chair of Economis at Marburg University
Thesis on: "Processes and Impacts of Investment in Land”
10.2006 - 06.2009 Master of Arts in "International Development Studies" (Economics and Political Science) at Marburg University
07.2005 - 12.2005 Studies in Economics at Stellenbosch University in South Africa
10.2003 - 08.2006 Bachelor of Arts in "Philosophy and Economics" at Bayreuth University
06.2003 Abitur (school leaving examination) at Peter-Wust-Gymnasium in Merzig
[Top]

Articles

YearTitleAuthor
2016Evaluation internationaler Forschungsförderung am Beispiel des Deutsch-Ägyptischen Forschungsfonds (GERF). Zeitschrift für Evaluation - ZfEv, 15. Jahrgang, Heft 2, Oktober 2016Väth, Susanne Johanna; Rohde, Oliver
2015Interplay of land governance and large-scale agricultural investement: evidence from Ghana and Kenya. The Journal of Modern African Studies, Volume 53, Issue 1 March 2015, pp.69-92Nolte, Kerstin; Väth, Susanne Johanna
2015Impact Evaluation Guidebook for Climate Change Adaption Projects. Deutsche Gesellschaft für Internationale Zusammenarbeit (GIZ), Global Project Effective Adaption Finance (M&E Adapt), Bonn und EschbornSilvestrini, Stefan; Bellino, Ines; Väth, Susanne Johanna
2014Do property rights and contract farming matter for rural development? Evidence from a large-scale investment in Ghana. MAGKS Joint Discussion Paper Series in Economics, No. 16-2014.Väth, Susanne Johanna; Kirk, Michael
2014Life satisfaction, contract farming and property rights: Evidence from Ghana. MAGKS Joint Discussion Paper Series in Economics, No. 15-2014.Väth, Susanne Johanna; Gobien, Simone; Kirk, Michael
2014Processes and Impacts of Investment in Land. PhD Thesis, MarburgVäth, Susanne Johanna
2013Gaining neighbours or big Losers – What happened when large-scale, land based investment in the Ghanaian oil palm sector met the local population? LDPI Working Paper No. 24.Väth, Susanne Johanna
2010Big push for development or erosion of local livelihood? – Insights from Cambodia, Laos, Madagascar and Mali. Rural 21 – International Journal for Rural Development 44 (2): 19-23.Väth, Susanne Johanna
2009Foreign direct investment (FDI) in land in developing countries. Eschborn: Gesellschaft für Technische Zusammenarbeit (GTZ), Division 45 – Agriculture, Fisheries and Food, Eschborn.Görgen, Matthias; Rudloff, Bettina; Simons, Johannes; Üllenberg, Alfons; Väth, Susanne Johanna; Wimmer, Lena
[Top]

On-going Projects

ProjectBeginEndClient
Ex-post assessment of the Strategic Fairtrade Funding Programme (SFFP), Phase II (2010-2013)9/201810/2018

Project Manager: Dr. Susanne Johanna Väth

Contact Person: Dr. Susanne Johanna Väth

Staff: M.Sc. Elisabeth Schneider

Description

One of the key objectives of the Swiss Department on Trade Promotion is to support fair trading conditions with developing countries to which private labels and standards substantially contribute. Accordingly, as part of a donor consortium, the State Secretariat for Economic Affairs (SECO) contributed to the Strategic Fairtrade Funding Programme (SFFP) in Phase I from 2008 to 2009 and Phase II from 2010 to 2013. Main purpose of the harmonized funding was to enable disadvantaged producers to establish stronger linkages to consumers, to gain improved market access and to be empowered for combating poverty.

In 2014/2015 an evaluation was already carried out which examined Phase II of the funding programme. Further research on Fairtrade conducted include, among others, a follow-up impact study at the producer-level, covering six product and context settings, implemented by the Center for Evaluation (CEval GmbH) in 2017/2018. Four years after the SFFP ended, it is now of interest for SECO to assess the level of achievement of the strategic indicators set in the Logical Framework of the SFFP as well as SECO’s contribution to the same.

The objective of the ex-post assessment is hence threefold: (i) to valorise existing information on the effectiveness and impact of SECO’s support to the Fairtrade system, (ii) to complement findings from previous studies with new data on relevance and sustainability of the programme and (iii) to distill key findings, recommendations and lessons learnt in view of the SECO’s future engagement in Fairtrade. To this end CEval will review relevant secondary data and collect additional primary data among stakeholders at FT headquarters, three FT regional networks and FT USA.
Evaluation of hazard prevention and damage after the heavy rain events in Saarland in May/June 20188/201810/2018Ministerium für Umwelt und Verbraucherschutz des Saarlandes

Project Manager: Dr. Stefan Silvestrini

Contact Person: Dr. Susanne Johanna Väth

Staff: Dr. Hansjörg Gaus, Fabian Otto

Description

In May and June 2018, Saarland was hit by heavy rainfalls which caused high damages in a number of municipalities. The Saarland Ministry for the Environment and Consumer Protection (MUV) would like to review the measures of hazard prevention and disaster management in the wake of these events. For this purpose, an analysis of strengths and weaknesses of hazard prevention and disaster management with regard to prevention, deployment and after-care should be carried out. It will lay the foundation to identify potential improvements and evidence-based recommendations. In addition, the damages caused by the heavy rainfalls will be assessed.

To analyse the strengths and weaknesses of hazard prevention and disaster management, around 90 guided interviews will be conducted with representatives of the Ministry of Interior, Construction and Sport, fire-fighting coordinators, local aid organisations and mayors of the municipalities most affected. The results of the content analysis of these interviews form the basis for identifying potential for improvement and deriving concrete recommendations for action. The evaluation of damages in the area of municipal infrastructure, agriculture and private households is carried out quantitatively on the basis of the data provided by the client.
Evaluation of a Capacity Development Project on Child Protection Systems in Ethiopia and India8/201812/2018Kindernothilfe e.V.

Project Manager: Dr. Susanne Johanna Väth

Contact Person: Dr. Susanne Johanna Väth

Staff: M.A. Tatjana Mauthofer

Description

Worldwide across all socio-economic backgrounds, cultures and religions, children are exposed to a wide spectrum of risk factors in their daily lives. Considering the complexity and interconnectedness of underlying causes, functioning child protection systems have proven to be key to address risk factors and prevent violence, exploitation and abuse. Kindernothilfe, jointly with Karl Kübel Stiftung, Child Fund and terre des hommes, initiated the project titled “Development and implementation of institutional child safeguarding policies as well as networking with local child protection systems through at least 240 organizations in nine countries in Asia and Africa” in 2014. With the project ending in December 2018, the consortium commissioned the Center for Evaluation in August 2018 to conduct an evaluation to understand the impact of the project as well as retrieve learnings and recommendations for future interventions of similar character. A crucial part of the assignment is to retrospectively develop the Theory of Change (ToC) of the project in a participatory manner, integrating consortium members, national trainers as well as the target group and final beneficiaries in the process. The ToC will guide the evaluation while being further validated during the course of the evaluation. Field visits take place in Ethiopia and South India in October 2018. In total, six partner organizations are visited and interviews and focus group discussions are hold. Children are included in the evaluation by making use of participatory research tools, such as Picture Talk and Smiley-face scales. Each field visit ends with a one-day workshop to which all participating organizations of the respective region are invited. During the workshop preliminary findings and the ToC are shared, discussed and validated. Eventually, data from both field visits is analyzed and findings are reported to the consortium partners.
Evaluation of the Project "Protecting, promoting and involving children in refugee camps (Hamburg)"4/20186/2018Plan International Deutschland e.V.

Project Manager: Dr. Susanne Johanna Väth

Contact Person: Dr. Susanne Johanna Väth

Staff: M.A. Sandra Bäthge

Description

Plan International Deutschland e. V. is committed to implement the international minimum standards for the protection of children in humanitarian crises. The project "Protecting, promoting and involving children in refugee camps" is implemented in two refugee camps in Hamburg between July 2017 and June 2018. It aims at strengthening the safety of refugee children and youth, creating a child-friendly environment and ensuring child protection in refugee camps. The overall goal of the project is to reduce the risks for children and young people to such an extent that their well-being is ensured. This is done by creating a positive environment for children and young people in which children's rights are respected.

The overall objective of the evaluation is to assess the project in a summative way. At the same time, in view of the ongoing work with children and young people in refugee contexts, this evaluation also identifies potential for improvement and gives evidence-based recommendations for action. With a strong focus on the OECD/DAC evaluation criterion of effectiveness, this evaluation will show to what extent the project was able to achieve its goals and to what extent its activities were appropriate in this regard.

From a methodological point of view, a participatory evaluation approach and a multi-method approach are applied. The combination of different data collection and evaluation methods will take into account the special requirements of the subject matter and the target group of children and young people. Therefore, the evaluation team will conduct guideline-based expert interviews and focus group discussions and will apply creative methods for qualitative data collection amongst children.

Meta-Evaluation of 34 evaluation reports of World Vision Deutschland12/20173/2018World Vision Deutschland e.V. (WVD)

Project Manager: Dr. Stefan Silvestrini

Contact Person: M.A. Tatjana Mauthofer

Staff: M.A. Tatjana Mauthofer, Dr. Susanne Johanna Väth

Description

For the third time, World Vision Germany (WVG) commissioned CEval to conduct a meta-evaluation of evaluation reports of its supported development programmes. In total, 34 evaluation reports of the financial years of 2016 and 2017 have been included, aiming at analyzing their quality and validity.

The evaluation is based on an analysis matrix, jointly created by CEval and WVG, which is structured along the main criteria of voice and inclusion, transparency, methodology, triangulation, contribution, satisfaction of information needs, conceptualization of findings and the newly added criterion of sustainability. Firstly, criteria are assessed systematically along pre-defined sub-questions and corresponding scales. Secondly, results are then aggregated and visualized. Lastly, the results are compared with previous meta-evaluations and trends were discussed.
Meta-evaluation and synthesis of Christoffel Blindenmission evaluation reports12/20172/2018Christoffel-Blindenmission (CBM)

Project Manager: Dr. Stefan Silvestrini

Contact Person: M.Sc. Elisabeth Schneider

Staff: M.A. Tatjana Mauthofer, Dr. Susanne Johanna Väth

Description

On behalf of the Christoffel Blindenmission (CBM), CEval conducted a meta-evaluation of 24 evaluation reports from 2016 and 2017. With its mandate to “transform the lives of disabled people in the world’s poorest countries” the project focus of CBM is an exhaustive collaboration with as well as the promotion of local partners in developing countries and conflict areas.

The primary purpose of the meta-evaluation was to summarize findings of the independent evaluation reports and to draw up general learnings along CBM’s mandate areas. It examined the actual contribution of joint projects to changes for CBM partners and clients as well as the usage and usefulness of the evaluation reports for CBM staff members in seven world regions.

Focus of the evaluation was an exhaustive analysis of the submitted evaluation reports. In a first step, to ensure homogeneity of data, the quality of reports was assessed systematically. Reports that fulfil minimum quality standards were then subjected to an in-depth analysis based on the evaluation questions of CBM. Additional quantitative and qualitative data regarding the usage and usefulness of evaluation reports were collected by means of an online survey addressing all end users of CBM’s evaluation reports.
Accompanying and consulting of the impact assessment/baseline update of HEKS Bangladesh country program5/20164/2018Hilfswerk der Evangelischen Kirchen Schweiz (HEKS)

Project Manager: Dr. Stefan Silvestrini

Contact Person: Dr. Stefan Silvestrini

Staff: Dr. Susanne Johanna Väth

Description

The HEKS/EPER Bangladesh country programme 2013-2016 aims to promote social inclusion of marginalized and disenfranchised minority groups in North-West Bangladesh. The various projects comprised, specifically target the urban and rural Dalit and plain land Adibashi communities who face complex forms of discrimination. The exclusion process is often a driving factor of conflict between the minority communities and the mainstream society. Applying a Human Rights Based Approach and a Value Chain Approach HEKS/EPER wants to foster social inclusion.

After not assessing the impact properly in the past program phase, HEKS now strives to obtain valid baseline data for the following program phase and at the same time to use this data to evaluate the prior program phase. CEval will provide methodological support during the whole process.

The impact assessment of the program will combine a quantitative survey with a contribution analysis. CEval supports HEKS mainly with the quantitative part. It provides the quantitative sampling strategy, gives methodological advice on how to best use before collected data, supervises the development of the data collection tools, and will take over parts of the quantitative data analysis (i.e. match the comparison group).
Impact Evaluation of WIENCO Ghana Ltd. Out-grower Schemes10/201512/2020Common fund for Commodities

Project Manager: Dr. Stefan Silvestrini

Contact Person: Dr. Stefan Silvestrini

Staff: Dr. Susanne Johanna Väth, Dipl.Reg.Wiss. Christina Gollan, Felix Stips

Partner: German Institute of Global and Area Studies

Description

The overall objective of the impact evaluation is to measure and evaluate the investment of the Agricultural Trade and Investment Fund (AATIF) in two of WIENCO¡¦s out-grower schemes in Ghana. In particular, two out-grower arrangements, the Cocoa Abrabopa Association for cocoa farmers and the Masara N¡¦Arziki for maize farmers, are under investigation. The main interest lies in identifying the causal link between participating in WIENCO¡¦s out-grower arrangements and the following outcomes and their development over time:

  • Productivity Levels
  • Employment opportunities
  • Farm and overall household income
  • Living and working conditions
  • Risk exposure regarding total household income; and
  • Farm-households¡¦ risk coping strategies and mechanisms.

    This shall provide AATIF with evidence on the effectiveness of funding out-grower schemes. In addition a simplified tool allowing WIENCO to collect data on the key outcomes shall be designed.

    The 5-year evaluation will be conducted by a consortium of the Center for Evaluation (CEval) and the German Institute for Global and Area Studies (GIGA), together with Ghanaian partners. A mixed-method approach will be embedded in a profound contextual analysis. The evaluation will combine a quantitative analysis of household and village surveys with qualitative insight into WIENCO's impacts derived from focus group discussions (FGDs) and expert interviews. The reports will provide the counterpart with robust evaluation results while also presenting practical recommendations to improve WIENCO's activities.

Former Projects

ProjectBeginEndClient
Meta-Evaluation of Plan International evaluation reports2/20184/2018Plan International Deutschland e.V.

Project Manager: Dr. Stefan Silvestrini

Contact Person: Dr. Stefan Silvestrini

Staff: Dr. Cornelia Römling, M.A. Sandra Bäthge, Dr. Susanne Johanna Väth

Description

Plan International is working for many years now in Africa, Asia and the Americas to promote child rights and lift children out of poverty. The German National Office of Plan International was founded in 1989, and has been contributing to funding development projects and programs as well as funding and commissioning external evaluations. Plan International Germany decided to implement a meta-evaluation of evaluation reports conducted between 2013 and 2017 covering all geographical working areas. The primary objectives of the meta-evaluation were to assess the strengths and weaknesses by analyzing the quality of the evaluation reports, to identify the success and risk factors that may affect their quality and to give recommendations. A particular focus was laid upon the influence of the type of evaluation (i.e. by whom it is coordinated and implemented) and the available resources and timeframe. The meta-evaluation was based on the analysis of the evaluation reports. The document analysis was structured in two phases. While in the first phase (pre-rating) the completeness of the evaluation reports was assessed, in a second phase (in-depth analysis), a more comprehensive set of quality assessment criteria was applied on a sample of reports, to allow for a more detailed assessment of the validity of their findings and usefulness to their addressees. Comprehensive analysis tools were used to analyze the completeness of the reports as well as the validity of findings and the usefulness of evaluation reports.
Meta-evaluation of project and programme evaluations 2015-20179/20172/2018Finnisches Außenministerium

Project Manager: Dr. Stefan Silvestrini

Contact Person: Dr. Stefan Silvestrini

Staff: Dr. Cornelia Römling, Dr. Susanne Johanna Väth, M.A. Tatjana Mauthofer

Description

The Ministry for Foreign Affairs of Finland commissioned CEval together with Particip and Indufor to conduct a meta-evaluation of their evaluations of development cooperation programmes and projects. The Finnish Ministry is regularly conducting meta-evaluations and subject to this meta-evaluation are the evaluations from 2015-2017.

The meta-evaluation has been initiated to improve evaluation reports, evaluation management practices and evaluation capacity development and furthermore to identify possible gaps in the Finnish evaluation practice. Furthermore, also the content of the evaluation reports was the focus e.g. the success in achieving the DAC-Criteria and further Finnish Cross Cutting Topics like gender equality or climate sustainability were evaluated.

A document analysis of the evaluation reports has been at the heart of the meta-evaluation to assess first the quality and afterwards the content of the evaluation reports. Different assessment tools were developed to provide a feasible and reliable assessment process. In the quality check the evaluation reports were reviewed for the existence of information essential to understand the evaluation object, process and results. Additionally, methodological requirements were assessed e.g. data and method triangulation or the logical flow from data over findings and conclusions to recommendations. Another tool was used for the content analysis in which the achievements with respect to the different evaluation criteria as well as conclusions and recommendations were analysed in detail in a semi-structured way.
Formative Evaluation of the Out-of-School-Children Initiative (OOSCI)3/20172/2018United Nations International Children’s Fund (UNICEF)

Project Manager: Dr. Stefan Silvestrini

Contact Person: Dr. Stefan Silvestrini

Staff: Dr. Cornelia Römling, Dr. Susanne Johanna Väth

Description

The focus of this evaluation was the Out-of-School-Children Initiative (OOSCI) by UNICEF and UNESCO Institute for Statistics (UIS). The initiative was launched in 2010 to achieve a reduction in the number of children out of school in participating countries. Means to achieve this goal were to create comprehensive profiles of out-of-School children in each Country, identify the barriers that push children out of school and to propose changes in the policies and strategies of the partner country to address these barriers.

The evaluation aimed at testing the validity of the theory of change and its assumptions. It is used to strengthen the program logic and to provide a formative assessment of the progress towards the overall goal of achieving a reduction in out-of-school children. The evaluation also provides an in-depth insight into benefits for the different stakeholders and their involvement in the initiative. Furthermore, the findings of the evaluation are used to meet the accountability requirements by the donors of OOSCI.

Main source of information of this evaluation have been documents like OOSCI country studies, OOSCI regional studies, government plans and documents from other donors (e.g. the World Bank, UNESCO, foreign donors etc.). In a document review we assessed progress made through OOSCI for a sample of 42 countries and assessed the contents within the document using a 4-step coding. These codings were used for a descriptive analysis and additionally for a Qualitative Comparative Analysis (QCA). QCA enabled us to analyze thoroughly which set of conditions leads to which outcome. Further instrument of data collection has been an online survey to all country offices. Additional qualitative data has been collected in the US and during eight country visits. The evaluation has been conducted together with Proman and further Consultants. CEval took over the lead with regard to the evaluation methodology.
External Evaluation of the empowering people. Network2/20173/2018Siemens Stiftung

Project Manager: Dr. Susanne Johanna Väth

Contact Person: Dr. Susanne Johanna Väth

Description

On behalf of Siemens Stiftung CEval GmbH implemented an external evaluation of the empowering people. Network. Founded in 2013, the network brings together inventors and social enterprises to develop solutions to address basic supply problems in fields such as health, food or education in developing countries. The empowering people. Award aims to identify simple and appropriate technological innovations with business potential and make them visible and accessible to everyone. As members of the empowering people. Network, currently 80 organizations that are implementing best-practice approaches receive long-term support in terms of organizational development, professionalization, and networking with partners.

In 2017, the empowering people. Network was evaluated for the first time since its foundation. The evaluation covered the entire lifetime of the network and its purpose was to account for progress and goals achieved so far and to gain lessons for strategic development. It therefore examined what impacts could be achieved by the respective modules and how these were assessed with regard to the overarching objectives. Leading questions of the evaluation were guided by the OECD-DAC evaluation criteria. It was characterized by a participative multi-methods approach and drew on contribution analysis that combined document/secondary analyses with qualitative (interviews, focus group discussions, case studies) as well as quantitative methods (partly standardized surveys). Lessons learnt and recommendations for the future development of the network were derived from the findings.
Evaluation of the International Climate Protection Fellowship for Young climate experts from developing countries12/201610/2017Alexander von Humboldt-Stiftung (AvH)

Project Manager: Dr. Stefan Silvestrini

Contact Person: Dr. Vera Hennefeld

Staff: Dr. Susanne Johanna Väth

Description

In 2009, the Alexander von Humboldt-Foundation (AvH) initiated the International Climate Protection Fellowship (ICPF) for young climate experts from non-European developing/emerging countries. From 2010 to 2015, they supported 100 future leaders from academic and non-academic fields.

The target Groups of ICPF are young academics and future leaders form industry/politics from developing/emerging countries with higher education. Those Groups participate in developing/applying measures of (1) climate protection, (2) climate-related protection of resources, and (3) adapting to climate Change in developing/emerging countries. The ICPF's Goal is to accompany their fellows over a long way: 12-months Fellowship for conducting their own research/research-related projects in cooperation with partners/Hosts in Germany, (2) participation in an alumni program (e.g., fundings for further stays in Germany, invitations to their home institutions abroad for their German partnsers/Hosts, invitations to AvH's Network).

The Evaluation of ICPF examined the extent to which its effects contributed to (1) climate protection and climate-related protection of resources, (2) adapting to climate change in developing/emerging countries. Vital aspects of the evaluation were program-level examination of relevant goal achievements and the analysis of already testable program effects.

The evaluation was based on the DAC criteria. Combining document/secondary analyses with qualitative (extensive partly standarized interviews, case studies)as well as quantitative methods (partly standarized surveys), the evaluation can be characterized by its multi-method approach. Evaluation report
Evaluation of the Guidelines to reward successful preventive measurements of members of the accident insurance UKS9/20163/2017Unfallkasse des Saarlandes (UKS)

Project Manager: Dr. Susanne Johanna Väth

Contact Person: Dr. Susanne Johanna Väth

Description

UKS, the Unfallkasse des Saarlandes is the insurance Provider of the legal accident insurance for the public sector of the federal province Saarland. UKS aims at prevention of occupational diseases, work-related health hazards and accidents at work. An important aspect of its efforts in prevention is a premium System to reward members who successfully implemented work safety and health measurements in their operational Organisation and thus did not or only to a small extent rely on expenses by UKS. Beyond rewarding, the earmarked premium is an incentive to enhance the state of health and safety Standards in public sector Enterprises.

In the course of reviewing the premium System UKS engaged CEval to evaluate its guideline to reward successful preventive measurements. The aim of the consultancy Service is the Provision of an improved key-figures based formula to calculate disbursements in premium class 1, which contains the 52 towns and communities of the Saarland.
Meta-evaluation of project evaluations 2014-20156/201610/2016MISEREOR

Project Manager: Dr. Susanne Johanna Väth

Contact Person: Dr. Susanne Johanna Väth

Staff: Dr. Cornelia Römling

Partner: .Evaluation.Consulting (Jens Koy)

Description

Misereor supports a wide range of projects in development cooperation which are conducted by partner organizations. Misereor or the partner organizations assign evaluations for a part of the projects to receive detailed information about the projects and to learn about their achievements and challenges.

Together with .Evaluation.Consulting CEval is in charge of a meta-evaluation of the evaluations conducted from 2014 to 2015. By means of this meta-evaluation Misereor aims to gain information about the quality of evaluations. With the results of the meta-evaluation Misereor can induce adjustments to support the improvement of quality of evaluations regarding different aspects.

The meta-evaluation is guided mainly by the DAC principles and standards. In a first basic check a representative number of studies is analyzed to gain insights into the general quality of evaluation studies. The main criteria of this first check are completeness and appropriateness of documentation and independency, credibility and usefulness of the evaluations. These criteria are assessed by a set of detailed questions which are aggregated in the end.

In a second step a detailed check is conducted for a fraction of studies which appear to be especially useful for learning from them. Additionally to the before mentioned criteria which are analyzed in-depth in this second detailed check, participation and the terms of references are part of the second analysis. The results of the two analyses are evaluated and used to develop recommendations for the evaluation process of Misereor. CEval is in particular responsible for the development of the analysis grids and sample selection. Furthermore, CEval is conducting together with .Evaluation.Consulting the data collection and data analysis.
Evaluation and Consultancy Service: The QUIZ-Compass under Critical Review4/20169/2016Friedrich-Ebert-Stiftung (FES)

Project Manager: Dr. Susanne Johanna Väth

Contact Person: Dr. Susanne Johanna Väth

Partner: Ute Metje

Description

In 2006, the department of International Development Coorperation of Friedrich-Ebert-Foundation (FES) developed a document to improve Quality Management in international development cooperation, called the QUIZ-Compass. After several pilots and revisions the document became mandatory for all country projects in 2010. About the same time the Federal German Ministry for Economic Cooperation and Development (BMZ) began to work on an improved reporting and porposal System. Thus, in 2012 BMZ introduced new formats which became mandatory for all political foundations.

Given thes developments requirements by the QUIZ-Compass and by the BMZ regulations turned out to be partly overlapping and contradictory. Therefore FES decided to critically Review the QUIZ-Compass. The aim of the evaluation and consultancy Services was first to check whether it is still line with state of the art insights by the impact debate in development cooperation. Secondly, the practicability of the tool was tested. Finally, recommendations to enhance the QUIZ-Compass were derived.
Meta-Evaluation World Vision Germany3/20165/2016World Vision Deutschland e.V. (WVD)

Project Manager: Dr. Stefan Silvestrini

Contact Person: Dr. Stefan Silvestrini

Staff: Dr. Susanne Johanna Väth

Description

For the second time World Vision Germany (WVG) has engaged CEval to conduct a meta-evaluation of 29 evaluation reports of its long-term Area Development Programmes. The aim of the evaluation was to analyze the reports with regard to their quality and validity. Beyond this assessment, CEval provided recommendations to enhance the design and implementation of future evaluation. Based on the OECD/DAC evaluation criteria relevance, effectiveness, efficiency, impact and sustainability, CEval implemented a two-tier analysis method. According to WVG’s quality criteria (i.e. voice and inclusion, transparency, appropriateness of evaluation methods, methodology, triangulation, and contribution) we first assessed to which extent the evaluation reports complied with various sub-criteria within one criterion. In a second step, we consolidated findings and deviated one aggregated rating per criterion. CEval additionally examined the criteria “satisfaction of information needs” and “organization of findings/conceptualization of change”.

This year, additionally an online survey investigating the utility, usage and usefulness of evaluation findings within WV has been conducted. The semi-standardized questionnaire contained questions concerning the quality of evaluation reports against several criteria, similar to the above mentioned ones to compare the perception of quality within WV with the results from the document analysis. Furthermore, qualitative data has been collected to get insights into the usage, utility and usefulness of evaluation results.

Moreover, CEval evaluated the transparency of WVG’s published impact report. It critically reviewed the report and rated it against the following criteria: comprehensibility, presentation of the relevant information for the target group, methodological approach, validity of the used data and sources, objectivity, and access.
Project Evaluation of GIZ's Sector Project Inclusion of persons with Disabilities4/201510/2015Deutsche Gesellschaft für internationale Zusammenarbeit (GIZ)

Project Manager: Dr. Stefan Silvestrini

Contact Person: Dr. Stefan Silvestrini

Staff: Dr. Susanne Johanna Väth

Description

Im Rahmen der Projektevaluierung wurde geprüft inwiefern das Sektorvorhaben Inklusion von Menschen mit Behinderungen der Deutschen Gesellschaft für Internationale Zusammenarbeit (GIZ) entwicklungspolitische Wirkungen entfalten konnte.

In Anlehnung an die OECD-DAC Kriterien wurden Experteninterviews und Fokusgruppendiskussionen geführt sowie M&E-Daten des Sektorvorhabens und weiterführende Dokumente systematisch ausgewertet. Damit wurde ein Beitrag zur Rechenschaftslegung gegenüber dem Bundesministerium für wirtschaftliche Zusammenarbeit und Entwicklung (BMZ) geleistet, durch die Veröffentlichung eines Kurzberichts den Anforderungen der International Aid Transparency Initiative (IATI) nachgekommen sowie die Grundlage für die Planung einer Folgemaßnahme gelegt.

Development of an operational guidebook for integrating and using impact evaluation-based M&E approaches in the field of climate change adaption12/20149/2015Deutsche Gesellschaft für Internationale Zusammenarbeit (GIZ), Bundesministerium für wirtschaftliche Zusammenarbeit und Entwicklung (BMZ)

Project Manager: Dr. Stefan Silvestrini

Contact Person: Dr. Stefan Silvestrini

Staff: Dr. Susanne Johanna Väth

Description

Climate change adaption projects require methodologically elaborated Monitoring and Evaluation (M&E) Systems that are not limited to measuring Project Outputs but also Need to include outcomes and further Impacts as well as their attribution to the measures undertaken.

GIZ engaged the Center for Evaluation (CEval) for technical support to develop an operationally viable impact evaluation and provided examples for their applicability in adaptation projects. Results were presented in a guidebook for integrating and using impact evaluation-based M&E approaches in the field of climate change Adaptation. Target Groups of the Framework are ministries, donors, and other related institutions that are looking for the underlying Drivers of Adaptation and evidence-based findings to improve the design of future climate change adaptation projects.
Meta-Evaluation: Project Evaluations of international development co-operation of the Friedrich-Ebert-Foundation (FES)10/20144/2015Friedrich-Ebert-Stiftung (FES)

Project Manager: Dr. Stefan Silvestrini

Contact Person: Dr. Susanne Johanna Väth

Staff: Dr. Susanne Johanna Väth

Description

Um die eigene Arbeit kontinuierlich zu verbessern, um als Organisation aus gesammelten Erfahrungen Lernprozesse zu initiieren und um der Rechenschaftspflicht gegenüber dem Zuwendungsgeber nachzukommen, gibt die Abteilung Internationale Entwicklungszusammenarbeit (IEZ) der Friedrich-Ebert-Stiftung (FES) pro Jahr circa zehn externe Evaluierungen in Auftrag.

\r\nIm Rahmen einer Meta-Evaluierung wurde das Centrum für Evaluation (CEval) mit der Analyse von 18 Evaluierungsberichten beauftragt, die zwischen 2012 und 2014 in einer Phase erstellt wurden in der sich das Qualitätsmanagement der IEZ stark weiterentwickelt hat. Ziel der Meta-Evaluierung ist es systematische Stärken und Schwächen der gängigen Evaluierungspraxis zu identifizieren, daraus Erkenntnisse für die Verbesserung der Qualität von künftigen Evaluierungen abzuleiten und so deren Nützlichkeit für Projektleitungen und die zuständigen Referate zu erhöhen.

\r\nWährend die Qualität der Evaluierungsberichte in einer Deskstudie analysiert wird, finden darüber hinaus vertiefende Experteninterviews und Fokusgruppendiskussionen innerhalb der FES statt um die Nützlichkeit der Evaluierungen zu bewerten.

Improving the Monitoring and reporting System to implement the Action plan "Inclusion of Persons with disabilities" in the German development co-operation10/20143/2017Deutsche Gesellschaft für internationale Zusammenarbeit (GIZ), Bundesministerium für wirtschaftliche Zusammenarbeit und Entwicklung (BMZ)

Project Manager: Dr. Susanne Johanna Väth

Contact Person: Dr. Susanne Johanna Väth

Description

In February 2013, the Federal Ministry for Economic Cooperation and Development (BMZ) published an action plan for the inclusion of persons with disabilities (PWDs). In doing so, it follows ist duties emanating from Article 32 of the UN Convention on the rights of PWDs. The action plan provides Information on strategic Goals and Actions to design development cooperation of the Federal Republic of Germany towards a better inclusion of PWDs.

To assess the progress and to steer the implementation of planned acitivities an appropriate Monitoring and reporting System is necessary. Hence, the Center of Evaluation (CEval) has been contracted to Support the sector Project "Inclusion of PWDs" of the German Agency for International Cooperation (GIZ) and the departement 300 of the BMZ with its methodological expertise to develop an Analysis grid to evaluate the implementation of the action plan.
Evaluation of the PTB blended-learning course ‘Quality Infrastructure for Sustainable Development’ (QuISP)6/20149/2014Physikalisch-Technische Bundesanstalt (PTB)

Project Manager: Dr. Stefan Silvestrini

Contact Person: Dr. Stefan Silvestrini

Staff: Dr. Susanne Johanna Väth

Description

The Center for Evaluation (CEval) has been mandated to conduct an evaluation of the blended-learning course ‘Quality Infrastructure for Sustainable Development’ (QuISP) which was developed and implemented by the Physikalisch-Technische Bundesanstalt (PTB). The course aims at improving the Quality Infrastructure (QI) in developing countries by building up individual and institutional capacities particularly with regard to standardisation and related disciplines.

The objective of the evaluation is to provide relevant information for the improvement of the QuISP training course with regard to its future implementation and potential scaling up.

Evaluation of the German Egyptian Research Fund6/201410/2014Deutsches Zentrum für Luft- und Raumfahrt (DLR), Bundesministerium für Bildung und Forschung (BMBF)

Project Manager: Dr. Stefan Silvestrini

Contact Person: Dr. Stefan Silvestrini

Staff: Dr. Susanne Johanna Väth

Description

On behalf of the Federal Ministry for Education and Research the Project Management Agency of the German Aerospace Centre (DLR) implements the programme activities of the German-Egyptian Research Fund (GERF). The programme activities to evaluate comprise two rounds of funding (GERF I: 2009-2011, GERF II: 2011-2013/14) supporting German-Egyptian research projects in the fields of Biotechnology, Energy Efficiency, Renewable Energies, Water Desalination, Health, and Natural Resource Management.

CEval was contracted to conduct both, an ex-post evaluation of GERF I and a mid-term evaluation of GERF II. Hence, we do not only assess the outcomes of GERF I, the downstream impacts as well as their sustainability, but also analyse the implementation process of GERF II with regard to design and efficiency. Finally, we derive recommendations for pursuing GERF II and for future funding cycles.

External Evaluation of Four Different Projects in the Field of Awareness Raising and a Synthesis6/20146/2015Christoffel-Blindenmission (CBM)

Project Manager: Dr. Stefan Silvestrini

Contact Person: Dr. Susanne Johanna Väth

Staff: Dr. Susanne Johanna Väth

Description

As international Christian development organisation, the Christian Blind Mission (CBM) aims at improving the human rights situation and the inclusion of people with disabilities. Awareness raising is one important component to achieve this target successfully. To learn how awareness raising activities are implemented, how they contribute to CBM’s overall aim and how project and country specifics produce different results, CBM Germany has engaged CEval to evaluate four projects and to compile findings and recommendations in a synthesis report.

With co-funding, either by the European Union or by the German Federal Ministry for Economic Cooperation and Development, CBM Germany implements two projects addressing the needs of people with hearing impairment in the Palestine Territories (Gaza and Gaza Strip), one project to improve eye care and rehabilitation in India, and one project to strengthen disability rights and inclusion in Swaziland. Given the diversity of these projects, issues of awareness raising can be studied from various perspectives. Thus, analysing the different underlying assumptions and needs which in turn lead to various approaches and expected outcomes, will contribute to a better understanding of the overall topic of awareness raising. While the projects in Gaza and India require a mid-term evaluation as they are still on-going, the projects in Gaza Strip and Swaziland are close to their end and will be finally evaluated

Meta-evaluation of 34 evaluation reports on the Area Development Programmes of World Vision Germany4/20147/2014World Vision Deutschland e.V. (WVD)

Project Manager: Dr. Stefan Silvestrini

Contact Person: Dr. Stefan Silvestrini

Staff: Dr. Susanne Johanna Väth

Description

World Vision Germany (WVG) has engaged CEval to conduct a meta-evaluation of 34 evaluation reports of its Area Development Programmes. The aim of the evaluation is to analyse the reports with regard to their quality and validity. Beyond this assessment, CEval will provide recommendations to enhance the design and implementation of future evaluation. Based on the evaluation criteria relevance, effectiveness, efficiency, impact and sustainability, CEval will implement a two-tier analysis method. According to WVG’s quality criteria (i.e. voice and inclusion, transparency, appropriateness of evaluation methods, methodology, triangulation, and contribution) we first assess to which extent the evaluation reports comply with various sub-criteria within one criterion. In a second step, we consolidate findings and deviate one aggregated rating per criterion.

Moreover, CEval supports WVG in the production of their impact reports by critical commenting and methodological counselling.

University Cooperation with Universidad de Costa Rica (UCR), with Funding Provided by the DAAD Program “Subject-Specific Partnerships with Universities in Developing Countries”1/201212/2015Deutscher Akademischer Austauschdienst (DAAD)

Project Manager: Prof. Dr. Reinhard Stockmann

Contact Person: Dr. Stefan Silvestrini

Staff: M.A. Sandra Bäthge, Dr. Susanne Johanna Väth

Description

Having completed a successful 3-year cooperation focusing on the further development of the postgraduate study programme “Project and Programme Evaluation for Social Development” established at Universidad de Costa Rica (UCR) in 1995, the Center for Evaluation (CEval) and the Universidad de Costa Rica (UCR) identified and realised new areas of cooperation. Since 2008, the German Academic Exchange Service (DAAD) has supported this cooperation with its funding project for sending German academics to universities in developing countries. Since 2012, the DAAD has also provided funding through the programme “Subject-Specific Partnerships with Universities in Developing Countries” (2012-2015), financially ensuring the plans to enhance the partnership between the two universities in Germany and Costa Rica.

The goal of the DAAD programme was to improve the teaching situation and to set up sustainable teaching structures in developing countries by facilitating academic exchange. Therefore, the international exchange between students, PhD candidates and lecturers was one of the most important aspects in the context of this enhanced cooperation. The focus also laid on opening up the master programme to other Central-American areas (regionalisation), embedding the partnership into an existing, international network (internationalisation), and adapting teaching of the master programme at UCR to regional demands and ensuing educational needs (creating a distinct programme profile). The four year partnership helped establishing or expanding regional and international professional networks and developing additional capacities regarding teaching and research.

It is planned to continue with the partnership in 2017 and integrate another Latinamerican university into the cooperation.
[Top]