On 3rd April 2019, Prof. Dr. Reinhard Stockmann gave a lecture on "Institutionalization of Evaluation in Europe" during the XXII National Congress. He was invited by the Italian Evaluation Association Associazione Italiana di Valutazione (AIV) and he presented results of the research project "Evaluation Globe". The project aims at recording the status of the institutionalization of evaluation in the political, social and professionalization system for all relevant countries worldwide. The Europe volume, which will be published by Macmillan at the end of the year, contains 16 country case studies, a European chapter and a synthesis. This shows that, despite all the regional, cultural, political and social differences in the countries studied, administrative modernisation, in the wake of new public management concepts and the EU's requirements, especially in the allocation of funds from the Structural Funds, was the dominant driving force behind the institutionalisation of evaluation in the countries studied.
CEval organizes vocational training conference together with BIBB
On behalf of the Vocational Training Research Network Working Group (Arbeitsgemeinschaft Berufsbildungsforschungsnetz (AG BFN)), the Center for Evaluation together with the German Federal Institute for Vocational Training have organized a conference on the topic "Evaluation and Impact Research in Vocational Training". The conference took place from the 29 to 30 November 2018 at the Wissenschaftszentrum Bonn. Interest was correspondingly high. CEval was not only involved in the conception of the conference, but also contributed with a series of lectures.
In his keynote speech, Professor Dr. Reinhard Stockmann presented the "Systematic Evaluation Analysis (SEA)", which he has developed as an instrument for impact evaluation. The approach combines elements of meta-evaluation, meta-analysis and systematic review. The aim was to identify success factors responsible for effectiveness, impact and sustainability of vocational training projects. For this purpose, over 80 projects and programs of vocational training cooperation - that were evaluated by CEval between 1992 and 2017 - have been assessed. Whereas in the individual evaluations emphasis was placed on the internal validity of results, SEA aims above all at a high external validity. Content results are synthesized, structured, classified and subsumed according to selected criteria in order to generate cumulative findings that allow generalizations. In this way, the success variables determined in individual project and program evaluations were condensed into four core variables that can be assigned to three clusters (compare Figure 1):
Figure 1: Model of the key variables of sustainable BBZ
These three "success clusters" were distilled from around 80 individual evaluations of projects and programs from the last 40 years. These evaluations were subject to a major conceptual change and were carried out in a wide variety of socio-cultural contexts and political systems. Therefore, it can be assumed that these "success factors" present a high degree of temporal and regional stability.
Further contributions of CEval have been lectures of Dr. Stefan Silvestrini on "Ex-ante Evaluation" and on "Meta-Evaluation in Vocational Education and Training", as well as a lecture of Dr. Wolfgang Meyer, who questioned the (quasi) experimental design for impact assessment in vocational training research in his lecture "Long-term effects through long-term care".
The conference closed with a panel on the question: How must evaluation and impact research in vocational education and training develop further?
A new international Master's degree programme in the field of international cooperation and development is now being offered jointly by Saarland University and Kaiserslautern University of Technologie. The Englisch-language programme, whose official title is 'Master (Blended Learning) of Evaluation MABLE', combines on-campus block courses with modern forms of e-learning and is unique in its field in Europe. The first intake of international students have already completed the primary e-learning phase and have spent the first of two weeks in Saarbrücken attending on-campus taught courses. Students interested in joining the programme in October 2018 must submit their applications by 15 August.
Altough global demand for monitoring and evaluatin specialists continues to rise, the number of suitable academic programmes in this area is failing to keep pace. The Englisch-language Master's programme MABLE has been designed to provide postgratuate training to professionals with some experience in the field of international cooperation and development. The programme has a blended-learning format, combining self-directed study using e-learning tools with periods of on-campus ('classroom-based') teaching. It is the only Master's programme of its kind in Europe. The twelve students currently in the programme come from a broad group of countries, including Afghanistan, Chile, Nigeria, Trinidad and Tobago, Uganda and Sri Lanka.
The MABLE programme provides participants with an opportunity to design and implement evaluations in an international context. Case studies enable students to acquire valuable insight into real-world practical applications. The focus of the programme is on evaluation in the field of international cooperation and development. The programme aims to teachs students the academic methodologies required to address questions and problems relating to evaluation, while also providing them with the skills needed to work as expert consultants in the field, to understand contract award and procurement processes and to manage evaluation projects. The Master's programme teaches students the core competencies required in monitoring, quality management, organizational development and project and programme management. Graduates work as evaluators, evaluations managers, quality managers, monitoring officers and project managers.
For further information click here.
At Fairtrade Germany's annual press conference in Berlin on 15 May 2018, the study "Impact of Fair Trade on poverty reduction through rural development" prepared by the Centre for Evaluation (CEval) was presented to the public.
Building on the 2011/12 baseline study, CEval was commissioned by Fairtrade Germany, Max Havelaar Foundation Switzerland, Fairtrade Austria and the Swiss State Secretariat for Economic Affairs (SECO) to carry out this 2017/18 follow-up study.
The aim of the study was to assess whether and how the presence of Fairtrade certified producer organizations has contributed to an improvement in living conditions of Fairtrade producers and their immediate environment. With the help of expert interviews, focus group discussions, participating observations and participatory, quantitative seed assessment methods, development paths with a view to social, economic and ecological changes could be traced and evaluated over time. The follow-up study covers the same products (bananas, cocoa, coffee, cotton, flowers and tea), producer types (Small Producer Organizations (SPO), Hired Labor (HL) and Contract Production (CP)) and countries (Peru, Ghana, Kenya and India) as the 2011/12 study.
The complete study can be downloaded here.
In 2017, the Finnish Foreign Ministry commissioned a meta-evaluation and a systematic review of 51 decentralised evaluation reports and ToR of bi-, multi- and multi-bilateral development interventions. The study was conceptualised and implemented at CEval in sub-contract of Particip by a team of five, headed by Susanne Johanna Väth. Besides Cornelia Römling (co-development and application of standardised assessment tools) and Stefan Silvestrini (backstopping and quality assurance), Petra Mikkolainen from Indufor and Michael Lieckefett from Particip (both systematic review) participated in the study. The published report and the webinar can be accessed via the following link: http://um.fi/public/default.aspx?contentid=374185&nodeid=49729&contentlan=2&culture=en-US