|
Session Title: Metaevaluation as a Values Framework to Enhance Evaluation Use: An International Example
|
|
Panel Session 205 to be held in California C on Thursday, Nov 3, 8:00 AM to 9:30 AM
|
|
Sponsored by the Evaluation Use TIG
|
| Chair(s): |
| Michael Patton, Utilization-Focused Evaluation, mqpatton@prodigy.net
|
| Abstract:
This session will present an international example of metaevaluation. The Paris Declaration (PD), endorsed in 2005 by international leaders, aims to improve the quality and impact of development aid. An independent, multi-phased, cross-country and synthesis evaluation of the PD was completed in mid-2011, as was an independent metaevaluation. This session reports on that metaevaluation. The Development Assistance Committee (DAC) of the OECD established standards for evaluation in 2010. Those standards were the basis for the metaevaluation. The PD metaevaluation offers an opportunity to compare the DAC standards and the Joint Committee standards as alternative frameworks for valuing and evaluating evaluations. This session will describe the processes and methods used to evaluate the Paris Declaration evaluation by the person who led the metaevaluation, discuss the issues raised based on international values and standards, and get reactions from those who commissioned the metaevaluation and from the evaluation leader whose evaluation was evaluated.
|
|
Metaevaluation of The Paris Declaration Evaluation: Processes and Methods in Support of Credibility and Utility
|
| Michael Patton, Utilization-Focused Evaluation, mqpatton@prodigy.net
|
|
The Paris Declaration (PD), endorsed in 2005 by international leaders, aims to improve the quality and impact of development aid. An independent, multi-phased and cross-country evaluation of the PD was completed in mid-2011, as was an independent metaevaluation. This session reports on that metaevaluation. The Development Assistance Committee (DAC) of the OECD established standards for evaluation in 2010. The DAC standards informed the evaluation of the PD Paris - and were the basis for the metaevaluation of the evaluation. The Paris Declaration metaevaluation offers an opportunity to compare and contrast the DAC standards and the Joint Committee standards as alternative value frameworks for evaluating evaluations, especially with regard to utility. This session will describe the processes and methods used to evaluate the Paris Declaration evaluation, and the issues raised about undertaking a metaevaluation based on international values and standards.
|
|
|
Rationale and Purposes for Evaluating the Evaluation of the Implementation of the Paris Declaration
|
| Niels Dabelstein, Danish Institute for International Studies, nda@diis.dk
|
| Ted Kliest, Netherlands Ministry of Foreing Affairs, tj.kliest@minbuza.nl
|
|
An International Reference Group of key stakeholders was established to provide strategic guidance to the evaluation of the Paris Declaration (PD). The International Reference Group was composed of members of the DAC Network on Development Evaluation, representatives from partner countries, and representatives from civil society. The Reference Group appointed a small Management Group tasked with day-to-day management of the evaluation. The Reference Group and Management Group were supported by a small Evaluation Secretariat headquartered in Copenhagen. In this session, the leaders of the Management Group and the Evaluation Secretariat will discuss and explain their decision to commission an independent evaluation of the PD evaluation, including their views on the process used and the utility of the metaevaluation.
| |
|
The Experience of and Perspectives on Having One's Evaluation Independently Evaluated (Metaevaluation)
|
| Bernard Wood, International Development & Strategies, bwood@magma.ca
|
|
The second phase of the evaluation of the implementation of the Paris Declaration comprised 28 evaluations of donors and developing countries. It was conducted during 2010/2011 with the Synthesis Report published in June 2011. The focus of phase 2 was on the effects of the Paris Declaration on aid effectiveness and development results. This presentation by the leader of the independent evaluation team will reflect on what it was like to have a metaevaluation being conducted in parallel to the actual evaluation and reactions to the actual findings of the evaluation of the evaluation.
| |