| Session Title: Expanding Evaluation’s Utility and Quality Through System-Oriented Data Synthesis |
| Demonstration Session 743 to be held in Lone Star B on Saturday, Nov 13, 10:00 AM to 10:45 AM |
| Sponsored by the Systems in Evaluation TIG |
| Presenter(s): |
| Beverly A Parsons, InSites, bparsons@insites.org |
| Pat Jessup, InSites, pjessup@insites.org |
| Abstract: Many evaluations using multiple data collection instruments report analyses separately by instrument or subscales. Such reports give the reader interesting facts but little or no synthesis across data collection instruments that helps the evaluation user understand how to take actions that have high likelihood of increasing the value or merit of the evaluand. A systems dynamics framework can be a powerful tool for synthesizing the analyses and making meaning of the findings. This session uses three evaluation examples to demonstrate how evaluators used an understanding of two types of system dynamics—organized and self-organizing dynamics—to synthesize data across multiple sources and identify levers for transformative change that support sustainability and scale-up. The examples involve introducing online learning in a multi-year professional development initiative for teachers, a whole school change initiative to improve student achievement in low performing schools, and a partnership for supporting the prevention of child maltreatment. |