| Session Title: Quality Evaluation: Avoiding Hypocrisy by Formative Evaluation of Evaluation's Outcomes, Processes, and Costs |
| Think Tank Session 805 to be held in BONHAM D on Saturday, Nov 13, 10:55 AM to 12:25 PM |
| Sponsored by the Costs, Effectiveness, Benefits, and Economics TIG |
| Presenter(s): |
| Sarah Hornack, American University, sarah.hornack@gmail.com |
| Discussant(s): |
| Brian Yates, American University, brian.yates@me.com |
| Jose Hermida, American University, hermidaj@gmail.com |
| Abstract: This Think Tank addresses the Presidential Theme of Evaluation Quality by asking, “Is evaluation worth it?” More specifically, does evaluation achieve the outcomes desired, at what cost, and how does evaluation compare to other paths to achieving similar outcomes with lower costs? We begin with the common hypocrisy of evaluations not being themselves evaluated. Then, three questions of meta-evaluation are raised in break-out groups: a) how should we judge the outcomes of an evaluation? b) how, and should, we judge the process of being evaluated, and c) how, should, we measure the costs of an evaluation? We reassemble the groups for summaries directed at answering d) how can we measure the cost-effectiveness or cost-benefit of evaluation? and finally e) how can one best conduct an evaluation within the constraints of limited resources while achieving the highest possible quality? |