|
Session Title: The Cycle of Evidence-based Policy and Practice: Synthesis, Translation, and Evaluation Capacity Building
|
|
Panel Session 312 to be held in Texas E on Thursday, Nov 11, 1:40 PM to 3:10 PM
|
|
Sponsored by the Evaluation Use TIG
, the Organizational Learning and Evaluation Capacity Building TIG, Alcohol, Drug Abuse, and Mental Health TIG, and the Health Evaluation TIG
|
| Chair(s): |
| Susan Labin, Independant Consultant, susan@susanlabin.com
|
| Abstract:
This panel will include presentations on the major components in the cycle of developing evidence-based policy and practice. The need for synthesis for policy will be explored in terms of contributions and roles of evaluation and performance measurement. The synthesis method, the core methodology to aggregate findings for evidence-based practice reviews, will be defined and various types of syntheses will be compared. Using results from synthesis is the impetus for the Centers for Disease Control and Prevention’s system for synthesis and translational research, which will be presented by those involved in developing the system. The translational process is further explored in a presentation of the Service to Science Academies (supported by the Substance Abuse and Mental Health Services Administration and the Center for Substance Abuse Prevention), an example of evaluation capacity building to increase the utilization of evidenced-based findings in the field and to bring practice into the evidence base.
|
|
Importance and Usage of Synthesis in Public Policy: Implications for Evaluation and Performance Measurement
|
| Joseph Wholey, University of Southern California, joewholey@aol.com
|
|
A critically important use of evaluation findings is to improve public policies and programs. By summarizing what is known about the effectiveness of a public policy or program, evaluation synthesis produces evaluation findings and helps focus future programs and evaluations. Future evaluation may be accomplished either through ongoing monitoring of the extent to which outcomes meet policy or program goals or though subsequent evaluation studies that build on and extend the synthesis findings. The presenter will draw on his nationally recognized expertise in developing performance indicators and evaluations. The presentation will explore how evaluators can encourage and support the use of evaluation findings to improve policies and programs by offering recommendations, suggestions, or options for: 1) redesigning management systems to focus on results; 2) creating incentive systems focused on results; 3) developing key indicator systems at national, state, or community-level; or 4) creating performance partnerships.
|
|
|
Research Synthesis: The Core Methodology in Evidence-based Reviews
|
| Susan Labin, Independant Consultant, susan@susanlabin.com
|
|
Evidence-based reviews are an essential step in the cycle of utilizing evaluation research to improve policy and practice. The core methodology of evidence-based reviews derives from research syntheses that aggregate findings from primary research. Given the attention and importance of evidence-based reviews, it is valuable to be aware the principles of the underlying method. Experience from developing and using synthesis methods will inform the presentation beginning with the history and types of broad-based syntheses. Broad-based syntheses are currently being used in the evidence-based review processes in federal agencies and are compatible with AEA’s Roadmap to OMB. Controversies regarding broad-based syntheses as opposed to meta-analysis, which usually restricts inclusion of evidence to randomized control trials, will be discussed. A variety of types of reviews (such as retrospective and prospective) and their potential usages will be compared. Recommendations will be offered for advancing synthesis methods and their application.
| |
|
Developing a Prevention Synthesis and Translation System to Promote Science-based Approaches to Teen Pregnancy, HIV and Sexually-transmitted Infections Prevention
|
| Kelly Lewis, Georgia State University, klewis28@gsu.edu
|
| Catherine A Lesesne, Centers for Disease Control and Prevention, ckl9@cdc.gov
|
| Abraham Wandersman, University of South Carolina, wandersman@sc.edu
|
| S Christine Zahniser, Global Evaluation and Applied Research Solutions Inc, scz1@cdc.gov
|
| Mary Martha Wilson, Healthy Teen Network, marymartha@healthyteennetwork.org
|
| Gina Desiderio, Healthy Teen Network, gina@healthyteennetwork.org
|
| Diane C Green, Centers for Disease Control and Prevention, dcg1@cdc.gov
|
|
Prevention synthesis and translation is seen as vital to bridging science and practice, yet how to develop it and train support system partners to use it is under-researched. By way of a case example by developers and implementers, this presentation highlights the importance of synthesis and describes an effective process for developing a synthesis/translation product called Promoting Science-based Approaches to Teen Pregnancy Prevention Using Getting To Outcomes. We will share our approach and experience in defining evidence-based programs and strategies in the area of teen pregnancy prevention; the implications of divergent definitions of and requirements for "evidence" on the development of clear synthesis/translation products; and the short-term results of our efforts to support the synthesis/translation product. Implications for research and practice will also be discussed.
| |
|
Service to Science: The Role of Evaluation Capacity Building in Evidence-based Practice
|
| Pamela Imm, University of South Carolina, pamimm@windstream.net
|
|
This presentation will focus on how local programs can build their capacity to evaluate their programs and gather data to submit to a federal registry for review. This initiative, referred to as “Service to Science,” is a national initiative supported by the Substance Abuse and Mental Health Services Administration (SAMHSA) and the Center for Substance Abuse Prevention (CSAP). One goal of the Service to Science Initiative is to increase the culturally appropriate and innovative substance abuse and other prevention interventions. States nominate local programs for a Service to Science Academy and to work with expert evaluators. This presentation is informed by direct experience in working with the Academies and will address how evaluators work with local programs for evaluation capacity building (ECB) and how these ECB efforts are important to meet the review criteria for SAMHSA’s National Registry of Evidence-Based Programs and Practices (NREPP).
| |