|
Session Title: Moving Towards Improving the Quality of Our Evaluations: Approaches and Lessons Learned From Comprehensive Cancer Control at the Centers for Disease Control and Prevention (CDC)
|
|
Panel Session 717 to be held in TRAVIS D on Saturday, Nov 13, 8:00 AM to 9:30 AM
|
|
Sponsored by the Health Evaluation TIG
|
| Chair(s): |
| Debra Holden, Research Triangle Institute International, debra@rti.org
|
| Discussant(s):
|
| Phyllis Rochester, Centers for Disease Control and Prevention, pfr5@cdc.gov
|
| Abstract:
Comprehensive cancer control (CCC) is an “integrated and coordinated” approach by the Centers for Disease Control and Prevention (CDC) that begun in 1998 with the ultimate goal of reducing cancer incidence, morbidity, and mortality. CDC’s funded programs developed CCC plans and are currently implementing cancer control interventions along the cancer control continuum to realize these goals. CDC has worked closely with these programs since inception to provide ongoing technical assistance. In 2007, an evaluation conceptual framework was developed to inform evaluation efforts. Using the evaluation conceptual framework, CDC has developed and conducted activities that have been instrumental in establishing a system of accountability for public investments in cancer prevention and control. Panelists will describe activities that have enhanced CDC’s evaluations and will build the capacity of our funded partners to develop and implement quality evaluations.
|
|
Performance Measures for the National Comprehensive Cancer Control Program (NCCCP): Current State and Future Directions
|
| Julie Townsend, Centers for Disease Control and Prevention, zmk4@cdc.gov
|
| Chrisandra Stockmyer, Centers for Disease Control and Prevention, cstockmyer@cdc.gov
|
| Angela Moore, Centers for Disease Control and Prevention, armoore@cdc.gov
|
| Phyllis Rochester, Centers for Disease Control and Prevention, pfr5@cdc.gov
|
|
In order to ensure accountability, document outcomes, and facilitate quality improvement, a set of performance measures were developed for Comprehensive Cancer Control (CCC) grantees. In 2008, the performance measures were piloted with CCC grantees. Based on a review of the pilot results, some performance measures were refined to better document CCC implementation and outcomes. Results from 2009 show that 60% of CCC grantees have diverse organizational representation in their partnership, 92% conduct regular assessments of the cancer burden, and a median of 60% of partners are implementing the cancer plans. However, results also indicate that some grantees need assistance with leveraging funds, developing complete evaluation plans, and finding evidence-based interventions. This systematic approach to collecting performance measures presents CDC with a unique opportunity to provide enhanced technical assistance to our grantees, effectively communicate the breadth and depth of CCC, measure environmental and policy changes, and demonstrate progress towards outcome indicators.
|
|
|
Comprehensive Cancer Control Evaluation Toolkit: A Resource to Improve the Quality of Evaluation Plans
|
| Angela Moore, Centers for Disease Control and Prevention, cyq6@cdc.gov
|
| LaShawn Curtis, RTI International, lcurtis@rti.org
|
| Cindy Soloe, RTI International, csoloe@rti.org
|
| Phyllis Rochester, Centers for Disease Control and Prevention, pfr5@cdc.gov
|
|
The CDC is committed to providing training and technical assistance to our funded partners that will aid in the successful development, implementation, and evaluation of comprehensive cancer control (CCC) programs. In 2008, CDC and evaluators from RTI International conducted a preliminary review of information contained within submitted CCC evaluation plans. The purpose of the evaluation plan review was to assess the extent to which these plans addressed the evaluation performance measure requirements. Results from this assessment coupled with the findings of the performance measures pilot, indicated the need for additional guidance from CDC regarding the development and implementation of evaluation plans. A process was identified that included a review of evaluation resources and the development of working groups to develop an evaluation toolkit. The development of this resource is an initial step towards providing tools and products that will improve the quality of CCC evaluation plans.
| |
|
The Development of a Menu of Outcomes Database (MOD): A Practical Evaluation Tool to Assist State, Tribal and Territorial Comprehensive Cancer Control Programs
|
| Brenda Stone-Wiggins, Research Triangle Institute International, bwiggins@rti.org
|
| Phyllis Rochester, Centers for Disease Control and Prevention, pfr5@cdc.gov
|
| Chrisandra Stockmyer, Centers for Disease Control and Prevention, cstockmyer@cdc.gov
|
| Angela Moore, Centers for Disease Control and Prevention, cyq6@cdc.gov
|
| Janice Tzeng, RTI International, jtzeng@rti.org
|
| Nathan Mann, RTI International, nmann@rti.org
|
| Debra Holden, Research Triangle Institute International, debra@rti.org
|
|
To guide and assist the CDC programs in their evaluations, a menu of outcomes that are feasible across the programs was developed. Outcome indicators were identified through cancer and chronic disease experts, national plans and the literature; mapped to the conceptual evaluation framework of the National Comprehensive Cancer Control Program (NCCCP); and categorized by level of impact and other domains (i.e., cancer continuum, risk factors and cancer site). An environmental scan was conducted to identify national data sources and measures for the respective indicators. The lack of national data sources identified gaps and data needs. The result is a Menu of Outcomes Database (MOD), a searchable MS Access database of 143 indicators linked to 441 measures from 42 national data sources. Database design and function was refined based on usability testing and piloting with CCC programs. Future enhancements and expansion to include state data sources are proposed for subsequent phases.
| |