Evaluation 2008 Banner

Return to search form  

Contact emails are provided for one-to-one contact only and may not be used for mass emailing or group solicitations.

Session Title: Challenges in Evaluating Work of International Nongovernmental Organizations
Multipaper Session 284 to be held in Room 108 in the Convention Center on Thursday, Nov 6, 10:55 AM to 12:25 PM
Sponsored by the International and Cross-cultural Evaluation TIG
Chair(s):
Barry B Cohen,  Rainbow Research Inc,  bcohen@rainbowresearch.org
Evaluating Sustainability in Non-Governmental Organization (NGO) Programs: Findings, Challenges and Lessons Learned From an Ex-Post Field Study
Presenter(s):
Joe Dickman,  Mercy Corps,  jdickman@bos.mercycorps.org
Gretchen Shanks,  Mercy Corps,  gshanks@mercycorps.org
Sandy Sheard,  University of California Berkeley,  sandy_sheard@berkeley.edu
Brandy Westerman,  Mercy Corps,  brandy@tj.mercycorps.org
Abstract: In 2007, Mercy Corps, an international Non-governmental Organization (NGO), undertook a research study to analyze lasting behavior change and project sustainability stemming from two large multi-year, multi-site programs funded by the U.S. Agency for International Development (USAID) in Central Asia. Implementation of program activities in the target communities had finished one to five years prior to conducting the study. The research team analyzed the programs’ impact in communities according to three themes: participation, accountability and collective community action. The study found significant evidence of sustainability both in terms of project outputs and lasting behavioral change, while noting key differences among sub-groups and project types and acknowledging various methodological constraints. The paper provides a brief overview of the study’s key findings and recommendations, and discusses the methodological challenges and lessons learned for evaluating program impact and sustainability ex-post in dynamic, transitional environments.
An Analysis of the Efforts to Improve the Quality of International Aid Evaluations
Presenter(s):
Thomaz Chianca,  COMEA Communication and Evaluation Ltd,  thomaz.chianca@gmail.com
Abstract: This paper analyzes the 16 most prominent and documented efforts in place to improve the quality of aid evaluations until 2007. The efforts were classified into five groups: (i) consortia of organizations (e.g., 3IE and NONIE); (ii) multilateral and bilateral organizations (e.g., OECD/DAC and UNEG); (iii) International Nongovernmental Organizations (e.g., InterAction); one had INGOs as the leading agencies; (iv) professional associations or networks (e.g., IDEAS and IOCE); and (v) international development research groups and think tanks (J-PAL and SEGA). While most of the reviewed efforts propose more holistic approaches to move the field forward, at least six of them were solely focused on improving the quality of impact evaluations including a few advocating strongly for the use of randomized control trials to improve aid evaluation. This paper describes and provides a critical review of those efforts, indicating opportunities for advancing the field.

 Return to Evaluation 2008

Add to Custom Program