Evaluation 2008 Banner

Return to search form  

Contact emails are provided for one-to-one contact only and may not be used for mass emailing or group solicitations.

Session Title: Methods for Assessing Program Impacts on Student Performance
Multipaper Session 109 to be held in Mineral Hall Section F on Wednesday, Nov 5, 4:30 PM to 6:00 PM
Sponsored by the Pre-K - 12 Educational Evaluation TIG
Chair(s):
Liliana Rodriguez Campos,  University of South Florida,  lrodriguez@coedu.usf.edu
The Impacts of a Teacher Training Program on Elementary Students’ Performance in Reading and Mathematics
Presenter(s):
Shahpar Modarresi,  Montgomery County Public Schools,  shahpar_modarresi@mcpsmd.org
Faith Connolly,  Naviance,  faith.connolly@naviance.com
Abstract: This paper examines the effectiveness of a teacher training program in improving reading and mathematics performance of elementary students. Due to the lack of random assignment of students to teachers, this evaluation used a quasi-experimental design. Both statistical significance tests and effect sizes were used to analyze the evaluation data. The analysis of covariance (ANCOVA) was utilized to test significant differences between the two groups of students (students of trained teachers and students of teachers who had not had the training). Propensity scores (based on students’ pretests, teachers’ qualification status and several other background measures) were computed using logistic regression models. To balance the two groups of students, the propensity scores were divided into five categories and used as covariates in statistical models. On average, no statistical or practical significant differences were found for performances on the reading or mathematics measures between the two groups of elementary students.
Potential Use of the Sheltered Instructional Observation Protocol (SIOP) Model for Program Evaluation
Presenter(s):
Victoria Stewart,  Northwest Regional Educational Laboratory,  stewartv@nwrel.org
Elizabeth Autio,  Northwest Regional Educational Laboratory,  autioe@nwrel.org
Abstract: Northwest Regional Educational Laboratory (NWREL) will investigate interrater reliability of the Sheltered Instructional Observation Protocol (SIOP) Model as part of the Washington state legislature’s English Language Learner Demonstration Project. Specifically NWREL field researchers will visit 37 schools across 11 districts in an effort to capture a snapshot of instructional practices in the elementary, middle, and high schools for students who are not proficient in English. Two researchers will observe a class and rate the teacher’s skills with presenting curricula in the core subjects of English, Mathematics, Science, and Social Studies using the well established SIOP rubric. The rubric is comprised of 8 components with 30 items. Each item will be scored using a five-point Likert scale ranging from 0 to 4 and later used to gauge where teachers are with administering appropriate lessons for ELL. Each of the rater's scores will be re-assessed to take stock on the similar and divergent ratings.

 Return to Evaluation 2008

Add to Custom Program