Return to search form  

Session Title: Evaluating Educational Programs in the Department of State's Bureau of Educational and Cultural Affairs: Multiple Goal Sets and Multi-dimensional Changes

Panel Session 851 to be held in Peale Room on Saturday, November 10, 3:30 PM to 5:00 PM

Sponsored by the International and Cross-cultural Evaluation TIG

Chair(s):

Melinda payday loan  Crowley payday loan ,  United States Department of State,  crowleyml@state.gov

Abstract: The Bureau of Education and Cultural Affairs (ECA), in the Department of State, has developed innovative, rigorous research designs and strategies to evaluate its international educational programs, which have multiple goals and seek multidimensional changes. The panel presentations are structured sequentially. They provide, first, an overview of the ECA's educational programs and their multiple goal sets (in the areas of education, civic education, and public diplomacy). The subsequent presentations discuss evaluation methodology development, evolution, and application globally, in the Middle East, North Africa, South Asia, and Eurasia. The panel ends with presentations of two evaluations: The School Connectivity Program and the English Access Microscholarship Program. Each of these case studies offers insight into the challenges of methodology development, and the implementation of these methodologies in these diverse environments. In each case, evaluation findings have been integral to learning, including on-going program development, adjustment, and effectiveness, globally.

Department of State International Educational Programs and Multiple Goal Sets Robin payday loan  Silver payday loan ,  United States Department of State,  silverrs@state.gov The first panel presentation provides an overview of the educational programs managed by the Bureau of Educational and Cultural Affairs (ECA) within the Department of State. It details the multiple goals sets common to these educational programs: Educational goals: 1. Educational reforms (curricular, pedagogical, institutional) 2. Transfer of knowledge, skills, or aptitude 3. Integrating access to the Internet with training in new approaches to teaching Civic education: 1. Civics 2. Community service Public Diplomacy 1. Mutual understanding and cross-cultural learning 2. Creating linkages between citizen and institutions in the United States and abroad. Within the context of these goal areas, each program seeks to effect complex, -multi-dimensional- changes in: - Individual knowledge, attitudes, behaviors, and skills - Societal/community knowledge and behavior - Organizations/institutions Dr. Robin Silver, a Senior Evaluation Officer in the Department of State, has managed evaluations of multiple international educational programs, including the School Connectivity Program evaluation.

Approaches to Learning: Department of State Educational Program Evaluation Methodologies Norma payday loan  Fleischman payday loan ,  United States Department of State,  fleischmanns@state.gov This presentation discusses the sophisticated evaluation designs and strategies designed by State Department evaluators in the Bureau of Educational Affairs (ECA). Evaluations of international educational programs, with multiple goal sets, rely on mixed methodologies and data sources, for example: 1. Surveys of program participants, staff, administrators, educators, etc. 2. Country case studies 3. Focus groups with all program participants 4. Focus groups with teachers, staff, administrators, educators 5. Key informant interviews with program grantees, program staff, administrators, etc. 6. Comparison Groups- surveys of non-participants 7. Focus groups or surveys of possible beneficiaries 8. Informal discussions 9. Program review 10. Review and analysis of program literature 11. Review of professional literature Dr. Norma Fleischman is a Senior Evaluation Officer in the Department of State and has managed a portfolio of varied public diplomacy program evaluations.

School Connectivity Program Evaluation: Methodology and Findings Jill payday loan  Tirnauer payday loan ,  United States Department of State,  tirnauerjx@state.gov This presentation presents an overview of the School Connectivity Program, which provides Internet access and computer skills training to schools in 22 countries and supports teacher training in pedagogies that rely on new technologies. It reviews evaluation design, findings in multiple goal areas, and use in program learning. The evaluation relied on these primary data sources: -Open-ended interviews with U.S. based and in-country grantee staff -Online surveys for students, teachers, and Master Trainers in 12 countries. -Country case studies in Armenia, Bosnia-Herzegovina, Tajikistan and Lebanon. -Open-ended interviews with school principals and school program staff. -Focus groups and informal discussions with program participants (students, teachers, Master Trainers and community members). -Community members in Tajikistan. -Comparison schools in Armenia Ms. Jill Tirnauer is a Senior Evaluation Officer in the Department of State. She is responsible for managing numerous evaluations of its international educational programs.

English Access Microscholarship Program: Methodology and Findings Leslie payday loan  Esterrich payday loan ,  United States Department of State,  esterrichlk@state.gov This presentation presents an overview of the English Access Microscholarship Program which provides English language instruction to non-elite, Muslim high school students in approximately 44 countries. It then reviews evaluation design, findings in multiple goal areas, and use in program learning. The primary data sources were: -Open-ended Interviews with State Department, Office of English Language Programs Staff -Site Visits to Schools and Centers in Lebanon, Morocco, Oman, Bangladesh, India, and Pakistan -Structured Interviews with: -Public Diplomacy staff -Regional English Language Officers (RELOs) -Administrators -Teachers -Students -Alumni -Peers of Students -Parents of Students -Focus Groups Students -Classroom Observations of Classes Ms. Leslie Esterrich is a Senior Evaluator in the Department of State. She co-managed the English Access Micro-scholarship Program evaluation, among others.