|
Session Title: Improving the Design, Methods, and Data Quality of a Public Health Outcome Monitoring Project
|
|
Panel Session 360 to be held in REPUBLIC B on Thursday, Nov 11, 3:35 PM to 4:20 PM
|
|
Sponsored by the Health Evaluation TIG
|
| Chair(s): |
| Gary Uhl, Centers for Disease Control and Prevention, gau4@cdc.gov
|
| Discussant(s):
|
| Gary Uhl, Centers for Disease Control and Prevention, gau4@cdc.gov
|
| Abstract:
The Centers for Disease Control and Prevention (CDC) evaluates the outcomes of HIV prevention behavioral interventions as they are implemented by CDC-funded community-based organizations through the Community-based Organization Behavioral Outcomes Project (CBOP). Multiple client-, agency-, and community- level factors at these organizations impact the CBOP design, methods and data quality. The first speaker will present an overview of CBOP and will describe how evaluation and data quality challenges and lessons learned were identified by agency and CDC staff. The second speaker will present specific lessons learned across CBOP evaluations and describe how these have been used to improve the design, methods, and data quality of subsequent CBOP evaluations. The panel will be moderated by Gary Uhl, Team Leader of the Evaluation Studies Team in the Program Evaluation Branch.
|
|
The Community-based Organizations Behavioral Outcomes Project: Identifying Challenges and Lessons Learned to Improve Evaluation Design, Methods, and Data Quality
|
| Andrea Moore, MANILA Consulting Group Inc, dii7@cdc.gov
|
| Elizabeth Kalayil, MANILA Consulting Group Inc, ehk2@cdc.gov
|
| Tobey Sapiano, Centers for Disease Control and Prevention, gvf8@cdc.gov
|
| Holly Fisher, Centers for Disease Control and Prevention, hkh3@cdc.gov
|
| Alpa Patel-Larson, Centers for Disease Control and Prevention, aop2@cdc.gov
|
| Gary Uhl, Centers for Disease Control and Prevention, gau4@cdc.gov
|
|
The Centers for Disease Control and Prevention (CDC) conducts outcome monitoring evaluations on HIV prevention behavioral interventions through the Community-based Organizations Behavioral Outcomes Project (CBOP). Through CBOP, CDC funds community-based organizations to collect quantitative and contextual data to assess clients’ risk behaviors between baseline and two post-intervention follow-ups, and to describe intervention delivery in real-world settings. In addition, CDC aims to improve the quality of the outcome monitoring project by collecting information on the implementation of the evaluation across agencies. For example, CDC uses semi-structured, open-ended questions from progress reports, and communication such as individual and group calls with agencies, to identify challenges and formulate solutions for data collection, data entry, and quality assurance. These data are combined with site visit observations and other experiences of CDC staff to develop lessons learned.
|
|
|
The Application of Lessons Learned to the Design, Methods and Data Quality of The Community-based Organizations Outcome Monitoring Project
|
| Tobey Sapiano, Centers for Disease Control and Prevention, gvf8@cdc.gov
|
| Gary Uhl, Centers for Disease Control and Prevention, gau4@cdc.gov
|
| Andrea Moore, MANILA Consulting Group Inc, dii7@cdc.gov
|
| Elizabeth Kalayil, MANILA Consulting Group Inc, ehk2@cdc.gov
|
| Adanze Eke, MANILA Consulting Group Inc, hzi4@cdc.gov
|
| Holly Fisher, Centers for Disease Control and Prevention, hkh3@cdc.gov
|
| Tanisha Grimes, Centers for Disease Control and Prevention, imf2@cdc.gov
|
| Tamika Hoyte, MANILA Consulting Group Inc, imb5@cdc.gov
|
| Alpa Patel-Larson, Centers for Disease Control and Prevention, aop2@cdc.gov
|
| Ekaterine Shapatava, Northrop Grumman Corporation, fpk7@cdc.gov
|
|
Since 2006, 22 community-based organizations have been funded to conduct outcome monitoring on five HIV prevention behavioral interventions through the Community-based Organizations Behavioral Outcomes Project (CBOP). To improve CBOP evaluations, CDC modifies the evaluation methods and data quality assurance procedures for each CBOP based on lessons learned from the previous CBOP. Over the course of CBOP, modifications based on lessons learned have been made to training, data collection, data entry, data reporting and quality assurance procedures. For example, during the first two CBOPs, agency staff reported challenges interpreting the data variables- in response, CDC made changes to the data collection instrument and proposed recommendations for additional training for client interviews. In turn, subsequent CBOPs implemented more rigorous training on the data variables and on interviewer techniques. The design of future outcome monitoring projects will continue to evolve and be strengthened by the insight gained through this process.
| |