| In a 90 minute Roundtable session, the first
rotation uses the first 45 minutes and the second rotation uses the last 45 minutes.
|
| Roundtable Rotation I:
Building Partnerships: Lessons Learned From Designing and Implementing a Cross-Project Evaluation With K-12, University, and State-Level Mathematics and Science Educators |
|
Roundtable Presentation 892 to be held in the Quartz Room Section B on Saturday, Nov 8, 1:20 PM to 2:50 PM
|
|
Sponsored by the Cluster, Multi-site and Multi-level Evaluation TIG
|
| Presenter(s):
|
| Karen Mutch-Jones,
Technical Education Research Centers,
karen_mutch-jones@terc.edu
|
| Polly Hubbard,
Technical Education Research Centers,
polly_hubbard@terc.edu
|
| Abstract:
Managing a cross-project, multi-site evaluation can be a challenge, especially when there is substantial variability across projects and uneasiness among project coordinators about participation. Creating structures that unify projects and acknowledge individual differences is critical.
Using specific examples from a state-level Mathematics and Science Partnership evaluation, we will describe activities that helped 25 project staff from K-12 schools and universities, key stakeholders, and evaluators to establish collaborative relationships, develop cross-project goals, surface concerns and anxieties, distinguish between formative and summative evaluation responsibilities, and construct and commit to the evaluation process. Strategies for scaffolding consistent and timely data collection and for helping project staff understand and use findings will also be presented.
Following the presentation, we will answer questions and provide further detail about activities, strategies, and outcomes upon request. We will facilitate a discussion so participants can share thoughts, experiences, alternative approaches, and ideas for creating successful cross-project evaluations.
|
| Roundtable Rotation II:
Using Theory of Change Models When Evaluating Complex Initiatives |
|
Roundtable Presentation 892 to be held in the Quartz Room Section B on Saturday, Nov 8, 1:20 PM to 2:50 PM
|
|
Sponsored by the Cluster, Multi-site and Multi-level Evaluation TIG
|
| Presenter(s):
|
| Martha McGuire,
Cathexis Consulting,
martha@cathexisconsulting.ca
|
| Marla Steinberg,
Michael Smith Foundation for Health Research,
marla_steinberg@phac-aspc.gc.ca
|
| Keiko Kuji Shikatani,
Independent Consultant,
kujikeiko@aol.com
|
| Abstract:
Programs are becoming more complicated and long-term results may take decades, making it difficult to determine if the program is going to achieve the desired results. Theory of change models are a tool that can help to determine whether there is movement towards the intended results. We will present an example of a theory of change model that was developed for the Canadian Action Program for Children and the Canadian Prenatal Nutrition Program. Through facilitated small group discussion we will explore the following questions:
- What are some examples where theory of change models have been developed as part of the evaluation of other complex programs?
- How were the theories of change models used in the evaluation?
- What added value did use of theories of change models bring to the evaluation?
- What are some pitfalls to avoid?
|