Evaluation 2009 Banner

Return to search form  

Contact emails are provided for one-to-one contact only and may not be used for mass emailing or group solicitations.

Session Title: Evaluative Directions in Developing Practices in Higher Education Assessment
Multipaper Session 271 to be held in Suwannee 17 on Thursday, Nov 12, 10:55 AM to 12:25 PM
Sponsored by the Assessment in Higher Education TIG
Chair(s):
Syd King,  New Zealand Qualifications Authority, syd.king@nzqa.govt.nz
Discussant(s):
Rochelle Michel,  Educational Testing Service, rmichel@ets.org
Assessment of Higher Educational Variables That Lead to Academic Success
Presenter(s):
Steven Middleton, Southern Illinois University at Carbondale, scmidd@siu.edu
MH Clark, Southern Illinois University at Carbondale, mhclark@siu.edu
Abstract: Institutions of higher education have place an emphasis on student learning for a variety of reasons, including the improvement of education and future marketability of students in order to enhance the schools' reputation and attract potential students. Grade point average (GPA) is one way to evaluate student progress. This study used 64 first-year students to examine how academic integration mediates the relationship between academic motivation and college GPA. Of the seven different types of academic mediation examined, academic integration fully mediated the relationships between two subscales of intrinsic academic motivation (knowledge and accomplishment) and GPA. Thus, higher intrinsic motivation for knowledge and accomplishment leads to better academic integration, which leads to higher GPAs. Therefore, institutions of higher education can augment student achievement by emphasizing social and academic programs that promote academic integration.
A Collaborative Approach to the Development of a University-wide Alumni Outcomes Assessment: Theory to Practice
Presenter(s):
Jennifer Reeves, Nova Southeastern University, jennreev@nova.edu
Candace Lacey, Nova Southeastern University, lacey@nova.edu
Barbara Packer-Muti, Nova Southeastern University, bpacker@nova.edu
Abstract: This session will provide the opportunity to discuss the development of a university-wide alumni outcomes assessment. Internal academic review at Nova Southeastern University (NSU) requires that all programs provide data on student learning outcomes from current students and alumni. With 14 different academic colleges awarding undergraduate, graduate, and professional degrees, collaboration is essential to develop a single, university-wide assessment instrument. A team of university representatives, including faculty members, researchers, administrators, and an alumni development officer worked with an external consultant to design a uniform, annual assessment grounded in the university's core values. The assessment provides a mixed methods approach to evaluating alumni feedback with both closed and open-ended questions.
Promoting School Accountability Through the Formative Use of Summative Test Results
Presenter(s):
Rachael Tan, Schroeder Measurement Technologies Inc, rtan@smttest.com
Abstract: Within the licensure industry, examination results are generally used only to decide whether to grant a license allowing a candidate to practice in their field. However, Multidimensional Item Response Theory (MIRT) analyses of candidate test results allow formative information to be gathered regarding how well schools are training students for practice within their profession. This study uses the results from a 100-item Computerized Adaptive Test (CAT) to provide prescriptive information to 42 schools in regards to how well their candidates performed in 14 content areas. Such information allows schools to determine in which content areas their candidates are deficient, and in which areas they are successfully preparing candidates for professional practice. By employing MIRT to identify curricular shortcomings, evaluation efforts can be focused on improving instruction in the most critical areas.
Assessing Undergraduate Student Learning Outcomes on Higher Order Skills under Open and Closed-Book Exam Conditions in Online Learning
Presenter(s):
Tary Wallace, University of South Florida, tlwallace@sar.usf.edu
Haiyan Bai, University of Central Florida, hbai@mail.ucf.edu
Abstract: The uniqueness of web-based courses causes faculty to question well-established and prudent assessment procedures on obtaining valid scores of higher-order skills tests if students take open-book exams on the Internet in the evaluation of the achievement of undergraduate students. The attitude and achievement scores of students who took open- and closed-book exams in an undergraduate measurement class are examined. Multivariate repeated measures are used to study the differences of overtime changes on attitudes and achievement scores between the closed-book condition and the open-book conditions using 167 undergraduate students participating in a large University in the south-east area of the United States. The study results would provide useful information to faculty members for informed decision-making with regards to open-book testing of higher-order measurement skills in a web-based and web-enhanced course.

 Return to Evaluation 2009

Add to Custom Program