Search

In most U.S. schools, teachers are evaluated using observation of teaching practice (OTP). This study investigates rater effects on OTP ratings among 421 principals in an authentic teacher evaluation system. Many-facet Rasch analysis (MFR) using a block of shared ratings revealed that principals generally (a) differentiated between more and less effective teachers, (b) rated their teachers with leniency (i.e., overused higher rating categories), and (c) differentiated between teaching practices (e.g., "Cognitive Engagement" vs. "Classroom Management") with minimal halo effect. Individual principals varied significantly in degree of leniency, and approximately 12% of principals exhibited severe rater bias. Implications for use of OTP ratings for evaluating teachers' effectiveness are discussed. Strengths and limitations of MFR to analyze rater effects in OTP are also discussed.

The purpose of this study was to address the effectiveness of autonomy support and a lottery-based reward in enhancing test performance and test-taking motivation on a low-stakes test. Two hundred and forty-six university students were randomly assigned to three groups -- lottery, autonomy support and control -- and took a mathematics test. Students in the autonomy support and lottery group reported putting forth more test-taking effort than students in the control group. Males who were offered a chance at winning the financial reward scored almost 10 points higher on the exam compared to females. Results showed no significant difference in test scores for female students among groups, suggesting that neither intervention had an impact on females.

Teacher evaluation systems commonly rely on observation of teaching practice (OTP) by school principals. However, the value of OTP as evidence of teacher effectiveness depends on its psychometric quality. In this study, we address a key aspect of the psychometric quality of principals' OTP ratings. Specifically, we investigate the degree to which rating scale categories have a consistent interpretation across teaching episodes and practices. Results suggest that the 1,324 principals' use of the rating scale categories functioned as intended overall. However, we also found that the midpoint category is underutilized and that rating categories do not always reflect similar levels of teaching effectiveness across teaching episodes and practices. When such discrepancies occur, we cannot assume principals' ratings reflect a consistent level of teacher effectiveness within and across classrooms. This is a critical component of validity evidence that can inform the interpretation of OTP ratings and point to areas for improvement in both the rubrics and in principals' training for classroom observations.

The authors argue that the prospect of performance can motivate students to learn. He uses a study of the Above and Beyond program at a K-5 school, where students appeared to be more interested in their subjects and learn more effectively when given the opportunity to display or perform in front of an audience.