|
Development of Evaluation Indicators for a Policy Framework for Children and Youth Mental Health Services
|
| Presenter(s):
|
| Evangeline Danseco,
Center of Excellence for Child and Youth Mental Health,
edanseco@cheo.on.ca
|
| Ian Manion,
Center of Excellence for Child and Youth Mental Health,
imanion@cheo.on.ca
|
| Abstract:
The Ontario Ministry of Children and Youth Services in Canada developed a policy framework for the children and youth mental health sector highlighting four broad goals: accessibility, integration, quality and evidence-based care, and accountability. Indicators to assess progress in achieving these goals were identified and selected using a modified Delphi approach. An expert panel of 21 stakeholders (parents, service providers and administrators, policy-makers, researchers, and advocates) reviewed candidate indicators based on relevance, validity, and feasibility. There were two rounds of online surveys and two panel meetings over six months. An initial 225 indicators were identified with seven of these being proposed for piloting and potential system-wide adoption. Through a series of online surveys and panel meetings over six months, the final list of recommended indicators included seven indicators based on validity, feasibility and relevance. This presentation will discuss the modified Delphi approach and the processes used to select the indicators.
|
|
Using Key Component Scaling to Evaluate the Implementation of a Community Crisis Bed Program
|
| Presenter(s):
|
| Purnima Sundar,
Carleton University,
purnimasundar@hotmail.com
|
| John Sylvestre,
University of Ottawa,
jsylvest@uottawa.ca
|
| Parastoo Jamshidi,
University of Ottawa,
pjams070@uottawa.ca
|
| Matthew Manion,
University of Ottawa,
mmani069@uottawa.ca
|
| Abstract:
The Community Crisis Bed (CCB) program in Ottawa, Ontario, provides community-based alternatives to hospitalization for people experiencing a mental health crisis. Based on work by Cousins et al. (2004), a Key Component Scaling tool was developed to evaluate program implementation. From a program logic model, key programmatic activities were identified. For each activity, descriptions of “full” and “low” program implementation were written based on program documentation and feedback from an evaluation steering committee. Staff members from three program stakeholder groups, as well as clients and family members, participated in focus groups or interviews during which they rated and discussed implementation of the various program components. Scale data were used to categorize program components as achieving full implementation, inconsistent/partial implementation, or low level implementation. Qualitative data showed that implementation challenges were attributable to differences in expectation among the partners, as well as difficulties in communication, information sharing, and coordinating partners.
|
|
Theory of Planned Behavior and Propensity Scores: Applications for Longitudinal Evaluation of Underage Alcohol Use Prevention Programs
|
| Presenter(s):
|
| Robert Seufert,
Miami University at Middletown,
seuferrl@muohio.edu
|
| Mark Carrozza,
University of Cincinnati,
mark.carrozza@uc.edu
|
| Abstract:
The research evaluates the utility of applying the Integrated Theory of Planned Behavior for understanding, predicting, and reducing underage alcohol use. The authors also assess the merit of using logistic regression-based propensity scores as a methodology to form statistically equivalent quasi-experimental groups during longitudinal program evaluations. Applications of other statistical procedures to evaluate program impact are assessed. Finally, we discuss and evaluate the policy implications of using media campaign messages to reduce underage drinking and related health and safety problems
|
|
Mental Health Performance Indicators to Measure Disparity: The California External Quality Review Experience
|
| Presenter(s):
|
| Saumitra SenGupta,
APS Healthcare Inc,
ssengupta@apshealthcare.com
|
| Hui Zhang,
APS Healthcare Inc,
hzhang@apshealthcare.com
|
| Sheila Baler,
APS Healthcare Inc,
sbaler@apshealthcare.com
|
| Abstract:
The role played by the External Quality Review Organizations (EQRO) in managed care waiver states in reviewing health and mental health plans are seldom discussed at the American Evaluation Association annual meetings. The proposed session will introduce the work of the California Mental Health EQRO in assessing statewide disparities in public mental health service access, expenditures and implications in policy initiatives and performance improvement at local and state levels.. The CA EQRO has utilized and improvised upon some commonly used performance indicators such as penetration rate, cost per beneficiary, and retention rate to examine racial and gender based disparities in the state. These indicators will be briefly described followed by some current findings and challenges of using this methodology in assessing disparity such as definitional issues, the EQRO role, as well as strengths of this approach including complementary data collection methods employed by the EQRO to enhance the review findings.
|
| | | |