|
Does Quality Matter Too?: Evaluating A Tool to Assess Quality of Implementation in a Parenting-Based Program to Improve Children’s Postdivorce Mental Health
|
| Presenter(s):
|
| Cady Berkel,
Arizona State University,
cady.berkel@asu.edu
|
| Sarah Jones,
Arizona State University,
sarahjp@asu.edu
|
| Melissa Hagan,
Arizona State University,
melissa.hagan@asu.edu
|
| Irwin Sandler,
Arizona State University,
irwin.sandler@asu.edu
|
| Sharlene Wolchik,
Arizona State University,
wolchik@asu.edu
|
| Tim Ayers,
Arizona State University,
tim.ayers@asu.edu
|
| Erin Schoenfelder,
Arizona State University,
erin.schoenfelder@asu.edu
|
| Anne Mauricio,
Arizona State University,
anne.mauricio@asu.edu
|
| Abstract:
While many contend program quality increases participants’ engagement, we lack standard measures for evaluating implementation, beyond fidelity checklists, which evaluate implementation quantity, but not quality. We present reliability and predictive utility of the QIM, an implementation quality measure rating seven domains of implementation (including fostering group cohesion, personalizing material). Data comes from video recordings of New Beginnings, a parenting program to improve children’s post divorce mental health, lead by two co-facilitators. For each session, we collect:
3 independently-rated QIMs (2 facilitators, 1 overall)
2 QIM self-assessments (1 per facilitator)
Fidelity
Engagement (participant attendance, homework completion)
Using MLM with our nested, repeated measures data, we evaluate the following:
Can adequate interrater reliability be achieved on the QIM?
How do independent QIM ratings relate to fidelity, QIM self-assessments, and participant engagement?
For independent ratings, how does an overall QIM score compare to a combination of the two facilitator QIM scores as predictors of engagement?
|
|
An Assessment of Substance Abuse Training and Technical Assistance Needs in Frontier States: Implications for the Adoption of Evidence-Based Practices
|
| Presenter(s):
|
| Joyce Hartje,
University of Nevada Reno,
jhartje@casat.org
|
| Nancy Roget,
University of Nevada Reno,
nroget@casat.org
|
| Wendy Woods,
University of Nevada Reno,
wwoods@casat.org
|
| Joanne Brosh,
University of Nevada Reno,
jbrosh@casat.org
|
| Abstract:
The purpose of this project was to assess the training and technical assistance needs of substance abuse and allied health professionals in the six-state Mountain West Addiction Technology Transfer Center (MWATTC) region, and to examine their attitudes and level of interest in adopting specific evidence-based practices (EBPs). A web-based survey design and a snowball sampling procedure were used to facilitate collecting data from a representative sample in a short amount of time. Results from the needs assessment were used at the MWATTC Advisory Board meeting to guide state-level discussions regarding the training and technical assistance activities needed by substance abuse treatment professionals in their state. By getting stakeholder participation in this process, the MWATTC is able to more effectively implement stakeholder-driven training and technical assistance activities, thereby increasing the likelihood of events being relevant to participants, as well as enhancing event attendance and attitudes towards implementing EBPs.
|
|
Evaluating Findings from Nebraska's State Incentive Grant (SIG)
|
| Presenter(s):
|
| Phillip Graham,
RTI International,
pgraham@rti.org
|
| Jason Williams,
RTI International,
jawilliams@rti.org
|
| Abstract:
The CSAP State Incentive Grant (SIG) program was the Center’s flagship initiative to reduce substance use among youth age 12-17 through the promotion and adoption of evidence-based prevention strategies. From 2004-2007, the State of Nebraska funded 27community coalitions to implement and evaluate comprehensive prevention strategies to reduce substance use among its youth. However, evaluation of this initiative has been hampered by several methodological challenges (e.g., lack of sound comparison data).
Longitudinal Growth Modeling (LGM) will be applied to three waves of data collected in 2003, 2005, and 2007 to determine the overall impact of the SIG initiative. Results from latent profile analysis (LPA) will also be presented to identify key underlying characteristics of the most effective community coalitions. Findings will provide important insight regarding characteristics associated with program effectiveness in real world settings and will provide a critical test of federal policies requiring implementation of evidence-based strategies via community coalitions.
|
|
Linking Services to Outcomes in the Evaluation of San Francisco's Mental Health Services Act Full Service Partnerships
|
| Presenter(s):
|
| Thomas Bleecker,
Research, Evaluation, and Quality Management,
tom.bleecker@sfdph.org
|
| Deborah Sherwood,
Research, Evaluation, and Quality Management,
deborah.sherwood@sfdph.org
|
| Abstract:
San Francisco’s implementation of Mental Health Services Act Full Service Partnerships (MHSA FSPs) targets underserved mental health and dual diagnosis clients. The treatment approach relies on an intensive case management model along with a commitment to do “whatever it takes” to support clients’ recovery and integration into the community.
Client outcomes are tracked through the Data Collection and Reporting (DCR) system, a web-based application that captures initial assessments in life domains (e.g., residential, employment), changes in those domains (Key Events), and quarterly summaries. FSP mental health services are tracked in the county billing system.
This presentation demonstrates our evaluation approach, which ties together the processes of service provision (from the billing system) to client outcomes (from the DCR). The presentation will demonstrate how differences in FSP client populations, treatment models, and outcomes were visually presented to program managers and staff, and how those results were used in ongoing program operations.
|
| | | |