|
Session Title: Evaluating a Complex Informal Science Education Program Through a Partnership Model
|
|
Panel Session 441 to be held in Redondo on Thursday, Nov 3, 2:50 PM to 4:20 PM
|
|
Sponsored by the Extension Education Evaluation TIG
|
| Chair(s): |
| Suzanne Le Menestrel, United States Department of Agriculture, slemenestrel@nifa.usda.gov
|
| Abstract:
This panel is focused on the creation of a partnership model for an evaluation of the 4-H Science initiative between an external evaluator and the evaluation's stakeholders. The 4-H youth development organization is a complex public-private partnership between the United States Department of Agricultures' National Institute of Food and Agriculture, the nation's Cooperative Extension system operated by the more than 100 land grant universities and colleges, and a private, non-profit partner, National 4-H Council. The traditional model of evaluation for many Cooperative Extension programs has been to rely on internal evaluation expertise through either a full-time evaluation faculty member or other specialist with evaluation expertise. This panel will include perspectives from national and state-level stakeholders as well as the external evaluator and will discuss the advantages of and limitations of using a partnership model to conduct an evaluation of a complex multi-sector youth development initiative.
|
|
A National Perspective on Evaluating a Complex Informal Science Education Program
|
| Suzanne Le Menestrel, United States Department of Agriculture, slemenestrel@nifa.usda.gov
|
|
This paper presents a national perspective on the challenges in creating an evaluation design for a complex informal science education program such as the 4-H Science Initiative. The presenter will describe the creation of several national-level science evaluation design teams that were comprised of both internal and external experts and stakeholders, including the funder of the evaluation. The presenter will also discuss the management structure of the national evaluation and the relationship between the client/stakeholders and the external evaluator. The advantages and limitations of this partnership model will be reviewed and recommendations for others who are interested in forming partnerships between organizations and evaluators will be provided.
|
|
|
A State Perspective on Evaluating a Complex Informal Science Education Program
|
| Jill Walahoski, University of Nebraska,Lincoln, jwalahos@unlnotes.unl.edu
|
|
Participation in a national evaluation presents both challenges and opportunities for land grant university 4-H Programs that are likely relevant to other multi-site youth development programs. While there are shared outcomes among the institutions and their respective local program sites, there is less consistency in how programs are delivered and how data are collected.
There is a need for common measures and data collection strategies. However, there are varying circumstances that impact a location's ability to participate. Integral in overcoming the barriers to participation is the investment of the state and local program sites in the methods and tools utilized. It was crucial in our work to engage program leaders system-wide in the development of the evaluation plan design, methods and tools. They identified the needs and challenges of the program sites and developed strategies that allowed for flexibility and tailoring, especially in the early rounds of data collection.
| |
|
An External Evaluator's Perspective on Evaluating a Complex Informal Science Education Program
|
| Jenny LaFleur, Policy Studies Associates, jlafleur@policystudies.com
|
|
An external evaluation can be a key tool for an organization looking to examine its practices and assess its progress toward stated goals. However, the path to creating a successful partnership often requires that evaluators: (1) navigate steep learning curves in order to become familiar with the contracting organization; (2) regularly (re)calibrate evaluation activities to respond to the realities of a complex, national program; (3) be responsive to all stakeholders, from both the organization and its funders; and (4) present data and findings in a way that allows clients to use the evaluation results to effectively guide their work. This presentation will review lessons learned from Policy Studies Associates' ongoing evaluation of the 4-H Science Initiative from the perspective of the external evaluator.
| |