|
Programme Evaluation in the African Context: Negotiating Your Way Through Political, Language and Cultural Maze
|
| Presenter(s):
|
| Octavia Mkhabela, Unleash Potential Unlimited, octavia@uphr.co.za
|
| Abstract:
Programme evaluation is in the best of times not politically neutral. The African context presents a unique set of challenges brought to bear by the intersection of culture and politics which in some instances is diametrically opposed to evaluation ethics. Political expediency often leads to parachuting of social programmes that are not carefully thought through and planned. The needs of the beneficiaries are often not assessed and the effect of nuisance variables not propoerly anticipated and mitigated. Evaluators in this context have an unenviable task of pointing these shortcomings out at the end of the programmes whose impact is negligable due to sometimes poor conceptualisation, inadequate design, and shoddy implementation in a cultural environment that puts a premium on respect for authority, and sometimes unquestioning loyalty to those in positions of authority. It becomes important to bring these shortcomings to the fore, while keeping to ethics of evaluation despite pressure from commissioners of evaluation. This requires objectivity and sensitivity to avoid dicontinuation of programmes meant to benefit the poor.
|
|
Twaweza: Evaluating an Ecosystem of Change
|
| Presenter(s):
|
| Gretchen Rossman, Center for International Education, gretchen@educ.umass.edu
|
| Abstract:
The Center for International Education (CIE) is serving as the independent evaluation entity for the Twaweza initiative based in Dar es Salaam, Tanzania. Twaweza ("we can make it happen" in Swahili) is a ten-year initiative, funded by a consortium of five donors and hosted by the Dutch development organizations Hivos. Its overall goal is to foster citizen-driven change and to empower East African citizens (in Tanzania, Kenya, and Uganda) to advocate for access to and the quality of basic services (particularly basic education, clean water, and health services).
The evaluation components consist of national household and facilities surveys and annual case studies—throughout Tanzania, Kenya, and Uganda. CIE has formed partnerships with three Universities in East Africa to implement the evaluation. This paper reports on the evaluation conceptual framework and the results of the baseline studies.
|
|
Personalizing Outcomes: Feasibility and Utilization of Individual Goal-Setting in an International Context
|
| Presenter(s):
|
| Melissa Velazquez, Christian Foundation for Children and Aging, melissav@cfcausa.org
|
| Abstract:
Nonprofits working internationally in development and poverty reduction face complex and dynamic contexts that present challenges to establishing universal outcome measures and traditional needs assessments. Responsive programs call for adaptable, yet credible, ways to engage participants in shaping program development toward the outcomes most relevant to diverse stakeholders. This paper opens a discussion on creatively addressing evaluation and responsive program improvement in an organization where individuals and families are the units and loci of long-term, comprehensive development. Personal program goals set by program participants and monitored over time present a potential complement to geographic or sector based indicators as markers for measuring program outcomes, assessing fidelity to diverse participant needs, and as a guide for improvement. The author examines issues of logistical and cultural feasibility of goal-setting and documentation, explores scaled utilization within an international organization, and provides practical insight from an on-going, multi-country pilot initiative.
|
|
Do Evaluation Frameworks Support Equity and Social Justice? Lessons Learned in East Central and South-Eastern Europe
|
| Presenter(s):
|
| Linda E Lee, Proactive Information Services Inc, linda@proactive.mb.ca
|
| Larry K Bremner, Proactive Information Services Inc, larry@proactive.mb.ca
|
| Abstract:
The authors have worked on education-related evaluations in numerous countries in Central, Eastern and South-eastern Europe. The paper is based on the evaluations of four programs designed to support marginalized and disenfranchised populations, including Roma youth who experience racism and discrimination and children vulnerable to being trafficked for labour and sexual exploitation. Beginning with an examination of the definitions and benefits of evaluation, the paper then compares the four evaluation frameworks on six dimensions (evaluation focus, purpose/intended benefits, audience, evaluator role, methods, timeframe). The paper then describes the utilization of results and levels of client and beneficiary participation in the evaluation process. The authors address the challenges of creating evaluations that retain their rigour, credibility and quality, while promoting participation and equity. The paper concludes with the authors’ reflections regarding ways to relinquish power and engage communities in creating the evaluation frameworks and approaches that can indeed support equity and social justice.
|
| | | |