| Session Title: The Rubric Revolution: Evaluative Blending of Mixed Method Evidence |
| Demonstration Session 102 to be held in Pacific B on Wednesday, Nov 2, 4:30 PM to 6:00 PM |
| Sponsored by the Mixed Methods Evaluation TIG |
| Presenter(s): |
| Jane Davidson, Real Evaluation Ltd, jane@realevaluation.com |
| Abstract: Two major challenges in mixed methods evaluation are (1) truly 'mixing' methods, i.e. blending or synthesizing the evidence, rather than simply using 'both' methods, and (2) being explicitly evaluative in the synthesis and interpretation of mixed method evidence, e.g. being able to say how worthwhile outcomes are. One powerful tool for this is the evaluative rubric. A rubric is an evaluative interpretation guide with descriptions of what the mix of evidence looks like at multiple different levels of quality, value, or effectiveness. It avoids simple cut points and mechanistic thinking, instead providing a basis for nuanced judgement and evaluative conversations. Rubrics are particularly effective in participatory evaluations, but also work well to clarify how evaluative conclusions are draw in all types of evaluation. Principles and tips for designing useful rubrics will be presented, along with examples of how to design interview and survey items that produce more interpretable evidence. |