|
Evaluating and Improving Implementation of Environmental Strategies for Substance Abuse Prevention: Discussion of an Initial Process Measure
|
| Presenter(s):
|
| Crystelle Egan, University of Rhode Island, caegan@mail.uri.edu
|
| Paul Florin, University of Rhode Island, pflorin@mail.uri.edu
|
| Cynthia Roberts, University of Rhode Island, cynthia.roberts70@gmail.com
|
| Abstract:
The evaluation of environmental strategies (ES) for substance abuse prevention is challenged by a lack of standardized measures. Moreover, the capacity to implement ES may be limited among some prevention practitioners. To address these challenges simultaneously, we developed a process measure that also serves as an implementation guide and a prompt for technical assistance. The Monthly Environmental Strategies Tracking Interview is comprised of structured quantitative and qualitative questions regarding the implementation of media, policy, and enforcement strategies by municipal coalitions funded through a Center for Substance Abuse Prevention Strategic Prevention Framework State Incentive Grant (SPF SIG). The objectives of this paper are: 1) to describe the rationale for and development of the measure, 2) to discuss how the measure is used to facilitate strategy implementation, and 3) to explore the strengths and challenges of this approach. Sample collected data will be presented and copies of the measure will be available.
|
|
Evaluation of How Mental Health Staff Promotes Recovery: A Rasch Analysis of the PRO Survey
|
| Presenter(s):
|
| Kathryn DeRoche, Mental Health Center of Denver, kathryn.deroche@mhcd.org
|
| Pablo Olmos, Mental Health Center of Denver, antonio.olmos@mhcd.org
|
| Abstract:
Consumer-centered mental health recovery has emerged as a novel philosophy among adult community-base service providers over the last two decades. Distinctive from the abundance of recovery instruments, the Promoting Recovery in mental health Organizations (PRO) survey measures the consumer's perception of how different types of staff members promote recovery. Six sub-scales representing different types of staff members were developed by the Mental Health Center of Denver's Recovery committee and administered to a stratified random sample of 450 consumers. By using Rasch analysis techniques, similarities and differences were discovered in how therapists, case managers, psychiatrists, other medical staff, front-desk staff, and rehabilitation staff promote consumers' recovery. Furthermore, the relationships among PRO sub-scales and other measures of recovery were examined (consumers' self-report, and clinicians opinions). Finally, the implications for quality improvement based on the results of the PRO analysis are discussed, including training, staff evaluation, and hiring.
|
|
The Youth Evaluation Project at the Mental Health Center of Denver
|
| Presenter(s):
|
| Kathryn DeRoche, Mental Health Center of Denver, kathryn.deroche@mhcd.org
|
| Pablo Olmos, Mental Health Center of Denver, antonio.olmos@mhcd.org
|
| Lydia Prado, Mental Health Center of Denver, lydia.prado@mhcd.org
|
| Abstract:
To date, instruments developed to evaluate progress in youth seeking mental health services contain three inherent limitations, including: (1) lacking input from key stakeholders, (2) focusing on symptom reduction, and (3) the psychometric procedures utilized include assumptions that do not match the theories developed. At the Mental Health Center of Denver, we have started the development of a holistic evaluation system to overcome these limitations. The current presentation will discuss the results of the first stage of research, including analysis of a qualitative constructivism grounded theory containing 33 informal interviews with youth receiving mental health service, parents/guardians, clinicians, teachers, and community members. In the presentation, we will focus on the similarities and differences among the categories of stakeholder, in addition to how the results were used to develop quantitative evaluation surveys. Finally, implications for practice and future directions for additional validation will be discussed.
|
|
Midcourse Evaluability Assessment: Redesigning the Strategic Prevention Framework Cross-Site On the Fly
|
| Presenter(s):
|
| Robert Orwin, Westat, robertorwin@westat.com
|
| Robert Flewelling, Pacific Institute for Research and Evaluation, flewelling@pire.org
|
| Abstract:
This paper analyzes the evaluation circumstances of 26 States participating in the U.S. Center for Substance Abuse Prevention's Strategic Prevention Framework State Incentive Grant, a national public health initiative to prevent substance abuse and its consequences. Each State used a data-driven planning model to allocate resources to 445 communities which in turn launched over 1400 intervention strategies to target prevention priorities in their populations. Using a standardized template, the paper assesses what has happened with each State evaluation's design and implementation, yielding a "grade" reflecting the degree to which credible conclusions about program effectiveness are likely. Inputs include the existence and quality of 1) comparison communities, 2) longitudinal population-based outcomes data, 3) community-level fidelity data, 4) pre- and post-intervention intervening variables data, and 5) geographic concordance between program and data catchment areas. Collectively, the grades and associated narratives will in turn be used as needed to revise the national design.
|
| | | |