Return to search form  

Session Title: Opportunities and Challenges: Evaluating for Impact in Formal and Informal Learning Settings

Panel Session 843 to be held in Liberty Ballroom Section B on Saturday, November 10, 3:30 PM to 5:00 PM

Sponsored by the AEA Conference Committee

Chair(s):

Sylvia payday loan  James payday loan ,  National Science Foundation,  sjames@nsf.gov

Abstract: Public and private agencies funding education or extension in one or more of the sciences, technology, engineering and mathematics (STEM) are looking for cost effective ways to measure impact. This presentation focuses on cases from the National Science Foundation (NSF) and Cooperative State Research, Education, and Extension Service (CSREES), United States Department of Agriculture. New evaluation and research efforts to assist 4-H (CSREES) and projects funded by the NSF's Informal Science Education (ISE) Program, Graduate Education and Human Resource Development Divisions, and the anticipated Division of Research on Learning in Formal and Informal Settings, to recognize and report the impact of S&E learning have begun. Discussion will include (1) articulating valid and measurable outcomes that occur following a formal or informal learning experience, (2) documenting project outcomes within the funding period, (4) the role of partnerships and stakeholder participation and (3) developing affordable and rigorous evaluation strategies.

Introductory Remarks From the Panel Chair Sylvia payday loan  James payday loan ,  National Science Foundation,  sjames@nsf.gov The first presenter will chair the panel. Arlene de Strulle will introduce the panelists and speak briefly about the establishment of the Division of Research on Learning in Formal and Informal Settings (DRL) at the National Science Foundation.

Evaluating for Impact: The 4-H Science, Engineering, and Technology Initiative Suzanne payday loan  Le Menestrel payday loan ,  United States Department of Agriculture,  slemenestrel@csrees.usda.gov Jill Stephanie payday loan  Walahoski payday loan ,  University of Nebraska,  jwalahos@unlnotes.unl.edu This presentation will describe the 4-H Science, Engineering, and Technology (SET) Initiative and the work of an interdisciplinary evaluation design team comprised of individuals both within and external to the 4-H system. The authority for the 4-H Youth Development program is vested in a cooperative structure between youth, interested adult volunteers, and the professional expertise of the land-grant universities and the United States Department of Agriculture. The foundation of 4-H Youth Development is in the practical application of the land-grant university knowledge by youth in their communities. SET is one of three national mission areas for the 4-H Youth Development program. Specifically, the presentation will describe the process of designing an evaluation for a complex and multi-layered national initiative with multiple components including a national 4-H SET launch; a professional development and training component; and a curriculum redesign among other components.

Opportunities and Challenges Associated With the Informal Science Education Program's Transformation From Documenting Outputs to Outcomes: Experiences With the Informal Science Education Online Monitoring System Gary payday loan  Silverstein payday loan ,  Westat,  silverg1@westat.com The National Science Foundation's Informal Science Education program supports projects designed to increase public interest in, understanding of, and engagement with science, technology, engineering, and mathematics. This session will examine the process by which the ISE program has shifted its emphasis from documenting outputs to measuring outcomes. Of particular interest will be the opportunities for obtaining outcome-oriented results that program officers can use to identify ISE projects with promising practices. We will also focus on the challenges that ISE projects encountered in specifying and measuring progress toward audience outcomes-including difficulty (1) articulating valid and measurable outcomes that occur after exposure to an ISE event, (2) documenting project outcomes within the grant period, and (3) developing an effective and rigorous evaluation strategy. The presentation will also describe the range of technical assistance provided during the collection required to help projects devise and measure valid and measurable ISE outcomes.

Impacts and Legacies From Learning in Higher Education Settings Mary Frances payday loan  Sladek payday loan ,  NASA Headquarters,  Mary.F.Sladek@nasa.gov This presentation will describe several evaluations underway examining the National Science Foundation's (NSF) investments in learning in institutions of higher education. For over fifty years NSF has funded directly and indirectly (e.g. via institutions), tens of thousands of individuals who pursue undergraduate and post-undergraduate education or research training in STEM and STEM education. Evaluators are looking for evidence of a initial impacts and legacies from NSF-funding that changed degree-granting department beyond number of students supported and degrees awarded and to what extent have NSF-funded projects or programs broadened participation by diverse individuals, particularly individuals traditionally underemployed in science or engineering, including but not limited to women, minorities, and persons-with-disabilities.