Return to search form  

Session Title: Practicing Culturally-Based Evaluation: Learnings From the Field

Panel Session 125 to be held in Royale Conference Foyer on Wednesday, November 7, 4:30 PM to 6:00 PM

Sponsored by the Multiethnic Issues in Evaluation TIG

Chair(s):

Cheryl payday loan  Blanchette payday loan ,  Harder & Company Community Research,  cblanchette@harderco.com

Abstract: While evaluators agree on the importance of culturally relevant evaluation, there is still a great need to share knowledge and to identify promising practices within the field. In this session, four practicing evaluators will describe specific strategies and lessons learned in this regard based on their experiences conducting evaluations in diverse communities throughout California. Specifically, the panel will: (1) describe their engagement in an intentional and collaborative learning process around culturally-based evaluation; (2) present a checklist approach for systematically thinking through opportunities to increase the cultural relevance of an evaluative undertaking; (3) discuss challenges in using Likert scales with diverse populations and alternative measurement approaches; and (4) present recommendations for improving the quality of translated data collection instruments. The aim of this presentation is to share promising practices and invite discussion with other practitioners in the field.

Check It Out: The Development and Use of a Culturally Based Consulting Checklist Kym payday loan  Dorman payday loan ,  Harder & Company Community Research,  kdorman@harderco.com Evaluation checklists have been found to be an effective tool for thinking through various steps or factors to be considered in the conduct of an evaluation. The first panelist will present the application of this approach to evaluation consulting in diverse communities. Specifically, she will present a sequential checklist that identifies opportunities to consider and integrate culturally-based evaluation approaches and practices throughout all stages of an evaluation, including: 1) planning, 2) implementation, 3) analysis, and 4) dissemination of findings. While the use of a checklist approach does not guarantee the cultural relevance of an evaluation, it does provide an opportunity for evaluators to systematically think through elements of their practice and how they intersect with issues of culture and power. The bilingual panelist has worked in evaluation for over 7 years and has taken a lead role in the development of the checklist and other culturally-based consulting activities.

On a Scale of 1 to 5, How Well do you Understand the Question? Maricela payday loan  Piņa payday loan ,  Harder & Company Community Research,  mpina@harderco.com The increasing importance of evaluation in determining the merit of various social programs coupled with the growing diversity of the United States results in a pressing need to assess the reliability and validity of various measurement techniques with culturally diverse populations. One topic seldom addressed in the literature is the use of instruments that primarily rely on Likert scales to solicit information from culturally diverse populations. This presentation will address methodological challenges associated with using Likert scales. It will include discussion of the following items: (1) cultural differences in response to Likert scales; (2) illiteracy and innumeracy issues; (3) social desirability; (4) construct validity; and (5) general difficulties encountered by respondents. Recommendations from direct field experience and the literature will also be presented. The bilingual/bicultural panelist has extensive experience conducting evaluations with diverse populations throughout California.

No Entiendo: Improving the Quality of Translation in Evaluation Practice Nayeli payday loan  Cerpas payday loan ,  Harder & Company Community Research,  ncerpas@harderco.com Through the use of culturally-based research methods, evaluators are increasingly responsive to the diverse cultures and communities in which they operate. This presentation will discuss language translation in evaluation practice as a critical component of culturally-based consulting, primarily when translating written materials and when collecting data. Items discussed will include approaches for ensuring that translated tools are culturally relevant and accessible, key decisions in planning for translation, use of different translation resources, and recommendations identified through the academic literature and in practice. The panelist has extensive experience in the development, implementation, and evaluation of culturally appropriate tools, and takes a special interest in issues concerning communities disproportionately affected by health and social inequities.