|
Field Study Evaluation of a Comprehensive Sexual Abstinence Program: Methodology Challenges, Approaches, and Implications
|
| Presenter(s):
|
| Virginia Dick, University of Georgia, vdick@cviog.uga.edu
|
| Ann Peisher, University of Georgia, apeisher@uga.edu
|
| Amy Laura Arnold, University of georgia, alarnold@uga.edu
|
| Robetta McKenzie, Augusta Partnership for Children Inc, rmckenzie@arccp.org
|
| Katrina Davidson, Augusta Partnership for Children Inc, kaaron@arccp.org
|
| Don Bower, University of Georgia, dbower@uga.edu
|
| Abstract:
This paper will examine the field study evaluation of a comprehensive abstinence education effort. A group randomized cluster design was utilized to provide the most rigorous design possible in a real-world environment. This paper will focus on (1) challenges of securing adequate power in a group-randomized design where the pool of potential clusters is limited (Murray, Varnell & Blitstein, 2003), (2) issues raised when randomization yielded significant variation between groups and (3) how to statistically examine results which indicate intervention youth showed greater gains in key outcomes than control group youth. Methodological challenges that are encountered due to baseline variations between groups will also be examined using advanced statistical analysis. Authors will propose hypotheses to explain why the differences may exist and how those differences will be tracked over time.
|
|
From Champions to Change: The Role of Quality Evaluation in Implementing a Child Welfare System Change Initiative
|
| Presenter(s):
|
| Margaret Richardson, Western Michigan University, margaret.m.richardson@wmich.edu
|
| Jim Henry, Western Michigan University, james.henry@wmich.edu
|
| Abstract:
Broad community change often begins with the inspiration of community champions. A Michigan initiative to help communities understand the impact of trauma on children in the child welfare system is underway in six counties and a tribal community. This initiative has taken a grass roots participatory evaluation approach to system change with the aim of building capacity, changing practice, and influencing policy to include the impact of trauma on children in the child welfare system. Evaluation strategies have been developed in response to the resources and capacity of local communities. The role of the champion in each locale as central to implementation is discussed, as are evaluation methods to support and guide implementation. How to find champions and partner with them to implement and later to sustain system change is presented. Strategies learned through this initiative are summarized and presented for applicability to other related areas within children’s services.
|
|
Developing a Shared Understanding of Evaluation Quality: The Case of a Sexual Abuse Prevention Program
|
| Presenter(s):
|
| Beth Johnson, EMJ Associates, bjohnson@emjassociates.com
|
| Abstract:
A small, community-based organization is working to prevent sexual abuse through participatory theatrical performances in elementary schools, along with teacher training and crisis intervention services. From an initial focus on evaluating outcomes, the organization moved to a longer-term discovery process, involving multiple stakeholders in developing a theory of change and valid and reliable data collection instruments. This paper describes the collaborative process between the external evaluator and the organization that supported a shared, and evolving, understanding of the purposes of evaluation. The tension between truth and justice is manifest in the commitment to both a rigorous examination of program impact and to the essential mission of preventing sexual abuse. Examples of tools and the analyses of pilot data will be shared. Obstacles to quality will be discussed, including small budgets and a perceived demand to deliver numbers that prove program effectiveness.
|
| | |