| Roundtable: Use of Implementation Rubrics as Indicators of Evaluation Quality |
| Roundtable Presentation 832 to be held in GOLIAD on Saturday, Nov 13, 1:40 PM to 2:25 PM |
| Sponsored by the Qualitative Methods TIG |
| Presenter(s): |
| Elise Arruda Laorenza, Brown University, elise_laorenza@brown.edu |
| Stephanie Feger, Brown University, stephanie_feger@brown.edu |
| Joye Whitney, Brown University, joye_whitney@brown.edu |
| Abstract: In this roundtable, we propose to share our experiences (1) developing two qualitative evaluation rubrics measuring program implementation levels, and (2) ensuring the evaluation rubrics are useful for program planning and policy decision-making. The roundtable discussion will raise questions of how evaluators determine the quality of implementation evaluations when the focus is on qualitative data. We propose to use our experience with implementation rubrics to frame the dialogue around two key indicators of quality, evaluation use and mixed methods. A completed evaluation study of a summer learning program provides an opportunity to reflect on how program stakeholders and evaluators identify factors of quality. While evidence suggests that usefulness was attained, focusing stakeholders on program descriptions rather than quantitative data was a challenge. The roundtable will address the dilemma of when and how to assess the quality of qualitative evaluation designs, and strategies developed to enhance use of evaluation tools. |