|
Session Title: The Impact of Networked Contexts on Federal-Level Performance Measurement: Results From a Multiple Case Study of Four Centers for Disease Control and Prevention Funded Programs
|
|
Panel Session 239 to be held in Room 110 in the Convention Center on Thursday, Nov 6, 9:15 AM to 10:45 AM
|
|
Sponsored by the Government Evaluation TIG
and the Health Evaluation TIG
|
| Chair(s): |
| Amy DeGroff,
Centers for Disease Control and Prevention,
adegroff@cdc.gov
|
| Abstract:
In 2007-2008, a multiple case study was conducted to explore the challenges of developing national-level performance measurement systems for public health programs implemented through decentralized, networked structures. Four Centers for Disease Control and Prevention-funded programs were included: the National Sexually Transmitted Disease Program, the National Breast and Cervical Cancer Early Detection Program, the National Tobacco Control Program, and the Public Health Emergency Preparedness Program. Case study methods included document review, individual interviews, a focus group, and participant observations. The study examined the relationship between the networked structure and the resulting performance measurement system as well as issues of accountability and use. In-case and cross-case analysis were conducted. For this panel, individuals representing three of the four cases will discuss their case-specific results and their own experiences developing and implementing their program's performance measurement system. The study's key investigator will present cross-case findings and make recommendations for future practice.
|
|
Four National-Level Performance Measurement Systems: Cross-Case Findings
|
| Amy DeGroff,
Centers for Disease Control and Prevention,
adegroff@cdc.gov
|
|
Although a significant literature exists addressing the virtues and challenges of performance measurement in the public sector, little empirical research has been conducted studying national-level, performance measurement systems aimed at monitoring large-scale, decentralized programs. In 2007-2008, a multiple case study was conducted to explore the challenges of developing national-level performance measurement systems for public health programs implemented through decentralized, networked structures. Each of the four programs included in the study are implemented through a vast network of state and local partners across the country. Given extensive variability in program models and implementation, the decentralized structure inherently challenges efforts to identify common measures, collect and report valid data, and ensure data use. In addition, accountability is often fractured as multiple actors at various levels contribute toward the achievement of program goals and outcomes. In this presentation, the study's key investigator will describe the research methodology and present cross-case findings.
|
|
|
Developing and Implementing a National Measurement System for Public Health Emergency Preparedness: Are We Ready Yet?
|
| Anita McLees,
Centers for Disease Control and Prevention,
zdu5@cdc.gov
|
| Craig W Thomas,
Centers for Disease Control and Prevention,
cwthomas@cdc.gov
|
| Karen Mumford,
Centers for Disease Control and Prevention,
kmumford@cdc.gov
|
|
Since 2002, CDC's Division of State and Local Readiness (DSLR) has annually awarded approximately $1 billion to 62 states, territories, and localities through the Public Health Emergency Preparedness (PHEP) Cooperative Agreement. In order to address questions about the extent to which this investment has improved our nation's preparedness for and response to public health emergencies, DSLR is working in collaboration with numerous stakeholders to develop and implement a performance measurement system to address program improvement and accountability. This presentation will highlight the evolution of CDC's approach to measuring PHEP grantees' progress as well as challenges and accomplishments to date, including the unique challenges of developing and implementing a national-level performance measurement system for programs implemented through decentralized, networked structures.
| |
|
Developing and Implementing Performance Measures for 65 Diverse Sexually Transmitted Disease (STD) Programs
|
| Betty Apt,
Centers for Disease Control and Prevention,
bapt@cdc.gov
|
| Dayne Collins,
Centers for Disease Control and Prevention,
dcollins@cdc.gov
|
|
In 2004, CDC's Division of STD Prevention (DSTDP) implemented performance measures in the 65 project areas they fund. This presentation will describe the methods DSTDP used to address the challenges associated with developing and implementing national measures for project areas that have diverse at-risk populations and disease burden. For example, some project areas have high rates of syphilis morbidity in men who have sex with men; while other project areas have little syphilis, but have high prevalence of Chlamydia in young women. Some project areas are rural states and others are urban cities. The presentation will cover methods DSTDP used, such as workgroups with project area representatives and pilot testing, to engage the many stakeholders, develop measures that project areas could accept, introduce the measures as a program requirement, and then help project areas use the measures to improve their STD programs.
| |
|
Core Outcome Indicator Measurement Development for the National Tobacco Control Program
|
| Sheila Porter,
Centers for Disease Control and Prevention,
sporter@cdc.gov
|
| Todd Rogers,
Public Health Institute,
txrogers@pacbell.net
|
| Natasha Jamison,
Centers for Disease Control and Prevention,
njamison@cdc.gov
|
| Martha Engstrom,
Centers for Disease Control and Prevention,
mengstrom@cdc.gov
|
|
The Centers for Disease Control and Prevention's Office on Smoking and Health (OSH) provides funding and leadership for the National Tobacco Control Program (NTCP), involving comprehensive tobacco control and prevention activities in 50 states, tribes, U.S. territories, and the District of Columbia. NTCP's goals are to prevent initiation of tobacco use among young people, eliminate non-smokers exposure to secondhand smoke, promoting quitting among adults and young people, and eliminating tobacco-related disparities. To monitor and evaluate NTCP efforts and outcomes, OSH has developed a set of core outcome indicators. Although data for many indicators can be obtained from existing population-based surveys of adults and youth, several core indicators must be measured through data collection at the community level (e.g., tobacco industry practices) or by accessing archival records (e.g., tobacco control policy tracking). This paper will present a summary of OSH efforts to develop and implement standardized methods to measure core indicators.
| |