Empathy in Evaluation: A Meta-Analysis Comparing Evaluation Models in Refugee and Displaced Settings by Fatima T. Zahra

Date: Friday, May 2, 2025

Hello, AEA365 community! Liz DiLuzio here, Lead Curator of the blog. This week is Individuals Week, which means we take a break from our themed weeks and spotlight the Hot Tips, Cool Tricks, Rad Resources and Lessons Learned from any evaluator interested in sharing. Would you like to contribute to future individuals weeks? Email me at AEA365@eval.org with an idea or a draft and we will make it happen.

Hello, AEA365 readers! My name is Fatima T. Zahra, and I am an Assistant Professor of Evaluation, Statistics, and Methodology at the University of Tennessee, Knoxville. My research focuses on the intersection of human development, labor markets, and evaluation in marginalized populations. Over the past decade, I have worked on projects that explore how evaluation can shape educational and labor market outcomes in refugee and crisis-affected settings. Today, I want to discuss something often overlooked but deeply consequential: empathy in evaluation (EIE) and how it enhances stakeholder engagement, program effectiveness, and sustainability.

This meta-analysis, examining 40 studies across participatory, culturally responsive, and traditional evaluation models, reveals that empathy-centered evaluation enhances outcomes and long-term impact. Here are key findings and practical strategies for implementing these approaches in displaced settings.

Lessons Learned: Evaluation Implications in Displaced Settings

1. Participatory and Culturally Responsive Evaluations Drive Engagement

• Participatory evaluations (as explained by Chouinard & Cousins, 2015) showed 71-78% attendance/participation rates, accelerating deeper community involvement.
• Culturally responsive models, as explained by Hood et al. (2015), significantly improved mental health outcomes (Cohen’s d = 0.72) and knowledge acquisition.
• Traditional evaluation models had more mixed results, often struggling with engagement and cultural relevance.

2. Sustainability is Linked to Community Ownership

• Programs with strong community engagement, as described in Mertens’ (2008) work,  were more likely to be sustained beyond evaluation periods
• Capacity building and system integration played crucial roles in program longevity.
• Traditional evaluation approaches, when adapted for cultural responsiveness, showed improved long-term viability in contexts of forced displacement.

3. Evaluation Models Shape Power Dynamics

• Participatory models redistributed decision-making power, leading to stronger program adaptation and impact.
• Culturally responsive evaluations incorporated local knowledge, increasing community trust and participation.
• Traditional models often maintained top-down evaluation structures, limiting stakeholder agency.

Cool Tricks: Applying Empathy in Evaluation in Practice

Scenario Analysis for Assumption Testing: Inspired by Brookfield’s work on critical thinking, using scenario analysis helps teams identify biases and refine evaluation questions to be more inclusive and context-aware.

Building Local Capacity for Evaluation Leadership: Like Mertens’ (2008) pointed out earlier, the meta-analysis supports that training community members to co-lead evaluations cultivates ownership and ensures long-term program relevance.

Embedding Reflective Spaces in Evaluation: Structured reflection allows evaluators and stakeholders to co-interpret findings and enhance methodological adaptability.

Hot Tips: Strengthening Evaluation in Displaced Contexts

• Host Panel Discussions with Local Leaders: Bringing together evaluation experts and community stakeholders generates valuable insights and prioritizes knowledge exchange.
• Integrate Cultural Competency in Evaluation Training: Developing evaluator awareness of cultural norms and values enhances engagement and data validity.
• Align Evaluation with Policy and System Integration: Embedding EIE principles within strategic planning helps sustain program impact and informs policy decisions.

Empathy in evaluation transforms assessment processes by centering stakeholder voices and adapting methodologies to reflect the realities of displaced populations. What role has empathy played in your evaluation work? Share your thoughts in the comments or tag a colleague who should read this!

Do you have questions, concerns, kudos, or content to extend this aea365 contribution? Please add them in the comments section for this post on the aea365 webpage so that we may enrich our community of practice. Would you like to submit an aea365 Tip? Please send a note of interest to aea365@eval.org . aea365 is sponsored by the American Evaluation Association and provides a Tip-a-Day by and for evaluators. The views and opinions expressed on the AEA365 blog are solely those of the original authors and other contributors. These views and opinions do not necessarily represent those of the American Evaluation Association, and/or any/all contributors to this site.