|
Applying an Ecological Model to the Comparison of Two Case Studies of Evaluation Use
|
| Presenter(s):
|
| Judith Ottoson, Independent Consultant, jottoson@comcast.net
|
| Diane Martinez, The American Institutes for Research, diane.j.martinez@gmail.com
|
| Laura Leviton, The Robert Wood Johnson Foundation, llevito@rwjf.org
|
| Abstract:
Two case studies of evaluation use, sponsored by the Robert Wood Johnson Foundation, are compared using the Ecological Model of Evaluation Use. Following a literature review and using Yin's approach to case study methodology, study questions were clarified, conceptual frameworks identified, and two study designs initiated. Use of the Active for Life and Covering Kids and Families evaluations were explored through snowball samples of twenty-three and twenty-six key informants respectively, as well as use-related artifacts. Study findings were member-checked with informants. Strikingly different patterns of use and non-use were found between the two cases. Findings confirmed familiar types of evaluation use, such as conceptual use, and added new ones, such as valuing use. The interrelationship among use categories was explored sequentially by tracing antecedents and sequels of use, as well as leveraged use across sectors, time, and stakeholders. An ecological understanding complements current approaches to the study of evaluation use.
|
|
Lessons From Applying Developmental Evaluation Approaches to Heart and Stroke Foundation's Spark Together for Healthy Kids
|
| Presenter(s):
|
| Jennifer Yessis, University of Waterloo, jyessis@uwaterloo.ca
|
| Barb Riley, University of Waterloo, briley@uwaterloo.ca
|
| Sharon Brodovsky, Heart and Stroke Foundation of Ontario, sbrodovsky@hsf.on.ca
|
| Shirley Von Sychowski, Heart and Stroke Foundation of Ontario, svonsychowski@hsf.on.ca
|
| Lisa Stockton, Propel Centre for Population Health Impact, lstockton@uwaterloo.ca
|
| Michelle Halligan, Heart and Stroke Foundation of Ontario, mhalligan@hsf.on.ca
|
| Abstract:
Spark Together for Healthy Kids(Spark) targets childhood obesity using a population approach, and focuses on creating environments to increase physical activity and healthy eating. A developmental evaluation approach has been used during Spark's first five years, to inform Spark strategy and examine markers of progress that are linked to changes in environments and behaviours. Early products of this evaluation include a theory of change, multi-method design, two evaluation reports, and targeted evidence synthesis, all of which are informing Spark strategy and evaluation. Presenters will share evaluation lessons emphasizing the importance of sustained and trusted relationships between evaluators and partners, the relevance of evaluation questions to decision making, and use of the most rigorous methods to answer the most relevant questions. Presenters will also raise conundrums about this approach such as how developmental evaluation serves needs for 'accountability', the education needed regarding evaluation paradigms, and how 'outcomes' need to be reframed.
|
| |