Return to search form  

Session Title: Of Mice and Men: How to Conduct a Random Assignment Study

Panel Session 822 to be held in Calhoun Room on Saturday, November 10, 1:50 PM to 3:20 PM

Sponsored by the Quantitative Methods: Theory and Design TIG

Chair(s):

Carrie payday loan  Markovitz payday loan ,  Abt Associates Inc,  carrie_markovitz@abtassoc.com

Abstract: Random assignment, known as the gold standard in research, is more commonly being implemented in evaluations of social programs and initiatives. However, these types of studies present unique challenges in study design, implementation, and the recruitment of subjects. In this session we will review some of the topics around designing and implementing a successful random assignment study. We will present examples of current random assignment studies, discuss the unique challenges involved in each type of evaluation, and offer best practices and recommendations for conducting random assignment studies in different settings.

The Benefit Offset National Demonstration (BOND) Larry payday loan  Orr payday loan ,  Abt Associates Inc,  larry_orr@abtassoc.com Dr. Larry L. Orr will discuss the design of the Benefit Offset National Demonstration (BOND), a test of new approaches to helping Social Security Disability Insurance (SSDI) beneficiaries and applicants return to work. BOND will use random assignment to measure the impacts of alternative combinations of financial incentives, health insurance and health supports, and consumer-directed employment supports on employment and earnings. Dr. Orr is Chief Economist at Abt Associates and specializes in the design and implementation of randomized field trials of public programs.

The National Random Assignment Study of Youth Corps Carrie payday loan  Markovitz payday loan ,  Abt Associates Inc,  carrie_markovitz@abtassoc.com Dr. Carrie E Markovitz will present on the design and implementation of a random assignment evaluation of Youth Corps being conducted for the Corporation for National and Community Service. This study is a 30-month impact evaluation of youth corps, which are programs that combine intensive community service with job training and education. Because there is no one model for youth corps, the study sample includes a variety of organization types presenting a unique challenge for designing and implementing random assignment. Dr. Markovitz is the Project Director for this study and has been involved in numerous random assignment studies. She is a statistician with 11 years of experience designing and conducting quantitative and qualitative evaluations of youth and workforce development programs.

Impact Evaluation of Upward Bound's Increased Emphasis on Higher-Risk Students Ryoko payday loan  Yamaguchi payday loan ,  Abt Associates Inc,  ryoko_yamaguchi@abtassoc.com Ryoko Yamaguchi will discuss the design of the Upward Bound evaluation, which randomizes 3,600 high school students within 90 Upward Bound programs, to investigate whether the program has an impact on student outcomes. When conducting random assignment in a school-based setting, there are multiple constituents to train, inform, and gain approval, starting with students, parents, teachers, administrators, the school board, and program directors. In addition, school-based settings provide unique challenges such as possible differential attrition, shared variance and nestedness of the data, and contamination that is critical for researchers to examine. Dr. Yamaguchi has 15 years experience in education, both as a researcher/evaluator and as a special education teacher. She has conducted numerous school-based experimental and quasi-experimental studies, and has expertise in at-risk youth issues.