Evaluation 2009 Banner

Return to search form  

Contact emails are provided for one-to-one contact only and may not be used for mass emailing or group solicitations.

Session Title: Building Evaluation Capacity With Technology: Using Web Analytics, Web Integrated Database, and Computer Aided Web Interviewing
Multipaper Session 207 to be held in Panzacola Section G2 on Thursday, Nov 12, 9:15 AM to 10:45 AM
Sponsored by the Integrating Technology Into Evaluation
Chair(s):
Sheetal Malhotra,  Medical Institute for Sexual Health, sheetal.malhotra@gmail.com
Discussant(s):
Marcie J Bober-Michel,  San Diego State University, bober@mail.sdsu.edu
A National Evaluation of Community Outreach and Training Efforts: The Application of a Web-Integrated Database
Presenter(s):
Kimberly Pukstas, University of Southern Maine, kpukstas@usm.maine.edu
Brenda Joly, University of Southern Maine, bjoly@usm.maine.edu
Prashant Mittal, University of Southern Maine, pmittal@usm.maine.edu
Martha Elbaum Williamson, University of Southern Maine, mwilliamson@usm.maine.edu
Abstract: This paper will examine the successes and challenges of using a web-integrated database as part of a multi-site evaluation project funded by the Robert Wood Johnson Foundation. The purpose of the evaluation was to assess the outreach and training efforts of a national replication study on the Early Detection and Intervention for the Prevention of Psychosis Program (EDIPPP). These efforts were coordinated by five agencies and targeted over 400 communities across the country. The extent and variation of activities supported by the EDIPPP outreach model required the evaluation to track an extensive list of measures. The evaluation team contracted with an outside vendor to develop an online system that could help manage, track and store site-specific information. Benefits included real-time reporting, improved communication with partners, and streamlined data collection efforts. Challenges included difficulties with data imports, data exchange across different platforms, managing system modifications and working with unique identifiers.
Experiences and Lessons Learned Using Computer Assisted Web-interviewing Within Educational Program Evaluation
Presenter(s):
Josh De La Rosa, Research Works Inc, jdelarosa@researchworks.org
Jeffrey Wasbes, Research Works Inc, jwasbes@researchworks.org
Abstract: Factors such as the rise in affordable hardware, advances in software and the proliferation of broadband internet have contributed to the increased use of Computer Assisted Web-Interviewing (CAWI) in social research. This paper addresses obstacles such as reduced response rates, reduced completion rates and response quality in implementing this relatively new methodology within the context of evaluation. Using the empirical evidence gathered during a variety of evaluation context such as professional development grants, out-of-school time programs and supplemented by germane research, this paper will discuss the advantages and disadvantages along with best practices of using CAWI in evaluation and will propose a checklist to guide process in an effort to reduce total survey error.

 Return to Evaluation 2009

Add to Custom Program