|
Session Title: Using Multi-site Evaluation Methods to Improve HIV Prevention Programs and Increase Evaluation Capacity
|
|
Panel Session 269 to be held in Mineral Hall Section D on Thursday, Nov 6, 10:55 AM to 12:25 PM
|
|
Sponsored by the Cluster, Multi-site and Multi-level Evaluation TIG
|
| Chair(s): |
| Gary Uhl,
Centers for Disease Control and Prevention,
gau4@cdc.gov
|
| Abstract:
The Program Evaluation Branch (PEB) in the Division of HIV/AIDS Prevention at the Centers for Disease Control conducts many types of evaluations, including multi-site evaluations. This presentation will provide an overview of a few of the methods and approaches that PEB has utilized in three multi-site evaluations: the Social Networking Analysis Project (SNAP), the Young Men of Color who Have Sex with Men Counseling, Testing, Referral Project (YCEP), and the Community-based Organization Behavioral Outcomes Project (CBOP). This presentation will describe the different methodologies and approaches used and how each evaluation affected HIV prevention programs, identified and managed challenges, and increased evaluation capacity at the project sites.
|
|
Using Formative Evaluation in a Multi-site Evaluation to Understand the Provision of HIV Counseling, Testing, and Referral (CTR) Programs to Young Men of Color Who Have Sex with Men (YMCSM)
|
| Andrea Moore,
MANILA Consulting Group Inc,
amoore@cdc.gov
|
| Gene Shelley,
Centers for Disease Control and Prevention,
gshelley@cdc.gov
|
| Kathleen Raleigh,
Centers for Disease Control and Prevention,
kraleigh@cdc.gov
|
|
The Centers for Disease Control and Prevention funded five community based organizations (CBOs) to participate in a multi-site evaluation project to assess their provision of HIV CTR to YMCSM. Formative evaluation methods were used to describe the context in which CTR is provided. We conducted interviews with CBO staff and focus groups with YMCSM peer counselors and advisory group members to understand the strategies and barriers involved in accessing HIV testing services. Among all recruitment strategies, community outreach and the provision of multiple testing technologies were generally viewed as the most successful. Barriers included restrictions on testing locations and providers of tests, false assumptions about testing (cost, identifying a person as gay) and cultural stigma. Findings from this evaluation assisted CBOs in streamlining the process of tracking referrals and can be used to mitigate barriers and enhance strategies for recruiting YMCSM into needed services.
|
|
|
Using Social Network Methods for Multi-site Evaluation
|
| Gene Shelley,
Centers for Disease Control and Prevention,
gshelley@cdc.gov
|
| Tanesha Griffin,
Northrop Grumman Corporation,
tgriffin2@cdc.gov
|
|
Social network analysis was used to examine and describe the coalitions of collaborating agencies in two sites who serve young men who have sex with men. Three waves of data were collected concerning collaboration and referral activities among agencies to determine coalition member satisfaction and the quality of interaction among agencies. Social network analyses were conducted for each type of agency interaction and for each wave of data. This presentation will describe the changes in collaboration and referral activities over time. In general, agencies were satisfied with the coalitions and participated together in community HIV-prevention activities. After the analyses, coalition members better understood their current functioning and how their coalitions could be continued and strengthened. Although not routinely used for evaluation, social network analysis methods can be used to examine changes in structure and function of coalitions (or any group) before, during and after an event (such as an intervention).
| |
|
How a Collaborative Approach in a Multi-site Evaluation Improved Program and Increased Evaluation Capacity of Grantees
|
| Bryce Smith,
Centers for Disease Control and Prevention,
bsmith6@cdc.gov
|
| Kathleen Raleigh,
Centers for Disease Control and Prevention,
kraleigh@cdc.gov
|
| Tanesha Griffin,
Northrop Grumman Corporation,
tgriffin2@cdc.gov
|
| Joanna Wooster,
Centers for Disease Control and Prevention,
jwooster@cdc.gov
|
| Elizabeth J Kalayil,
MANILA Consulting Group Inc,
ekalayil@cdc.gov
|
| Ekaterine Shapatava,
Northrop Grumman Corporation,
eshapatava@cdc.gov
|
| Gary Uhl,
Centers for Disease Control and Prevention,
guhl@cdc.gov
|
|
The Community-based Organization Behavioral Outcome Project (CBOP) is a multi-site outcome monitoring evaluation designed to assess the performance of CDC directly-funded agencies by monitoring changes in clients' HIV risk behaviors before and after participating in evidence-based interventions (EBIs). Throughout this evaluation project, high levels of collaboration between CDC and CBOP grantees have been utilized in the development of detailed timelines, protocols, data collection instruments, quality assurance plans, record-keeping, and data management policies and procedures. This collaboration has resulted in refocused recruitment efforts on appropriate target populations, greater consistency in intervention delivery, and increased evaluation capacity. Grantees have demonstrated this increased evaluation capacity by applying newly developed knowledge and skills (e.g., quality assurance practices) to the other programs that they provide and conducting internal process and outcome monitoring of these programs.
| |