|
Session Title: An Inspired Design for Collecting Useful Data From Diverse Stakeholder Groups
|
|
Panel Session 728 to be held in Laguna B on Friday, Nov 4, 2:50 PM to 4:20 PM
|
|
Sponsored by the Disabilities and Other Vulnerable Populations
and the Government Evaluation TIG
|
| Chair(s): |
| Norma Fleischman, United States Department of Education, norma.fleischman@ed.gov
|
| Discussant(s):
|
| Norma Fleischman, United States Department of Education, norma.fleischman@ed.gov
|
| Abstract:
This panel will focus on how an external contractor (Westat) worked in close partnership with the funding agency (Rehabilitation Services Administration-RSA, U.S. Department of Education) and a federal grantee, the Helen Keller National Center for Deaf-Blind Youths and Adults (HKNC), to ensure that appropriate communications and other accessibility supports were in place to effectively facilitate a robust and valid study of HKNC, including interviews with critical stakeholder groups, including individuals with multiple disabilities, their families, service providers, and government agencies responsible for serving the needs of deaf-blind individuals. The evaluators were responsive to the needs of Federal stakeholders (RSA and OMB) for specific performance information. The resulting study design and implementation strategies were complex and required a true partnership with both the funders and HKNC to develop the necessary capacity to obtain study-specific information from former HKNC participants who were deaf-blind and other stakeholders.
|
|
An Evaluation of the Helen Keller National Center for Deaf-Blind Youths and Adults: Background, Scope, and Stakeholders
|
| Norma Fleischman, United States Department of Education, norma.fleischman@ed.gov
|
|
The Helen Keller National Center for Deaf-Blind Youths and Adults (HKNC) provides services designed to equip consumers to live independently in their communities and/or enhance their ability to secure meaningful employment. In addition to Headquarter services, which include field services and training programs, 10 regional field offices located around the United States provide referrals, counseling, and transition assistance to deaf-blind consumers and their families and technical assistance and training to service providers. In 2008, Westat was contracted by the U.S. Department of Education's Rehabilitation Services Administration (RSA) to conduct an evaluation of HKNC. The study includes complex research questions and diverse participants and stakeholders, and involves challenges in communicating effectively and respectfully with individuals who are deaf-blind. Building communications capacities involved intensive on-site meetings at HKNC where the evaluators actively engaged with HKNC staff and consumers to observe the myriad of communication methods utilized by individuals who are deaf-blind.
|
|
|
Collecting Useful Data from Diverse Stakeholder Groups: Design Considerations and Challenges
|
| David Bernstein, Westat, davidbernstein@westat.com
|
|
This presentation will summarize the design approach developed for an evaluation of the Helen Keller National Center (HKNC) for Deaf-Blind Youths and Adults. The study is evaluating HKNC by gathering data on program implementation to help deaf-blind individuals achieve independent living and vocational goals. The study included residential adult educational programs offered in Sands Point, NY at HKNC Headquarters as well as services offered by HKNC regional representatives and field staff across the United States. HKNC provides services to a wide variety of stakeholder groups including deaf-blind individuals, their families, service providers who support deaf-blind individuals, vocational rehabilitation agencies and staff, and other interest groups. The Rehabilitation Services Administration (RSA) in the U.S. Department of Education identified 14 evaluation questions to be addressed. Westat developed instruments to collect data through interviews, site visits, an email survey, and archival data analysis with 10 different stakeholder groups.
| |
|
Design Considerations for Collecting Data from Deaf-Blind Individuals
|
| Carol Cober, Westat, carolcober@westat.com
|
|
This presentation reviews the communication concerns and data collection approach for an evaluation of the Helen Keller National Center (HKNC). The study included interviews with deaf-blind former participants in HKNC's residential program in Sands Point, NY. A range of appropriate methods for communicating through interpreters were used. Pertinent background information was critical and included factors such as age of onset of hearing and vision loss, vision stability, level of language competencies, educational backgrounds and any physical, cognitive or other disabilities that might affect communication. Screening and matching of qualified interpreters and interview subjects was critical so that individualized interpreting needs could be met. A training video was developed to capture specific signs unique to the HKNC program and to orient the interpreters to the interview protocol. This presentation reviews what evaluators should consider for understanding communication concerns of people who are deaf-blind to ensure their full participation in an evaluation.
| |