| Session Title: Retention in a Longitudinal Outcomes Study: Exploring Two Sides of the Same Coin, Who Asks and Who Answers |
| Multipaper Session 710 to be held in Pratt Room, Section B on Saturday, November 10, 9:35 AM to 10:20 AM |
| Sponsored by the Human Services Evaluation TIG |
| Chair(s): |
| Stacy Johnson, Macro International Inc, stacy.f.johnson@orcmacro.com |
| Discussant(s): |
| Christine Walrath, Macro International Inc, christine.m.walrath-greene@orcmacro.com |
| Abstract: This session examines two factors that impact retention in longitudinal research targeting marginalized or distressed populations: the internal and the external variables around the interviewer and the interviewee. The two papers draw on analysis of data from a large sample youth and caregivers from multiple communities who have participated in the National Evaluation of the Comprehensive Community Mental Health Services for Children and Their Families Program from 2002 to 2007. Youth with serious emotional disturbance and their caregivers provided quantitative data at 6-month intervals for up to 3 years. Local evaluation teams collecting the data provided qualitative and quantitative information on their staffing models, incentives, training, support, and life experiences of data collectors. This session will provide an analysis of conditions versus retention rates across a wide range of program and client characteristics. Lessons learned for informing future evaluation practice will be shared. |
| Retention in a Longitudinal Outcomes Study: Impact of Staffing Structure, Agency Policies and Staff Characteristics on Participants |
| Stacy Johnson, Macro International Inc, stacy.f.johnson@orcmacro.com |
| Connie Maples, Macro International Inc, connie.j.maples@orcmacro.com |
| The most critical aspect of longitudinal research is the ability to maintain long-term contact with participants and to track their outcomes over extended periods of time (van Wheel, et al., 2006). Attrition in longitudinal studies impacts their statistical power, introduces bias and threatens internal and external validity (Crom, D., et al., 2006). This paper focuses on data collection staffing models and their impact on participant retention in a 3-year longitudinal outcomes study of the Comprehensive Community Mental Health Services for Children and Their Families Program. Qualitative and quantitative analytical methods are used to explore how staffing variables such as the demographic characteristics and the role of data collectors in the community of study impact participant retention. Policies, procedures and staff structures that support data collection activities are also analyzed. Finally, we will share lessons learned related to overcoming obstacles to retaining participants longitudinally for informing future evaluation practice. |
| Retention in a Longitudinal Outcomes Study: An Exploration of the Effects of Respondent Characteristics, Roles and Consistency |
| Tisha Tucker, Macro International Inc, alyce.l.tucker@orcmacro.com |
| Laura Whalen, Macro International Inc, laura.g.whalen@orcmacro.com |
| Longitudinal studies are often challenged by participant reluctance to take part in the study, family changes and crises, competing priorities, and situational stressors (Ryan & Hayman, 1996). Hunt and White (1998) have identified that along with study design, the study population of interest may impact retention. Though there is extensive research on the respondent characteristics that affect retention, the field is lacking a consensus around which characteristics have the greatest impact. This paper explores how characteristics and roles of research respondents who have participated in the national evaluation of the Comprehensive Community Mental Health Services for Children and Their Families Program impact retention. By exploring respondent characteristics by gender and race/ethnicity, respondent role by caregiver types, and respondent consistency by change in respondents, we identify which variables are most strongly correlated with high retention. Findings identify needs for strategic development to maximize retention rates among certain respondent types and structures. |