Search

This paper describes how a state education system in Australia introduced standards-referenced assessments into its large-scale, high-stakes, curriculum-based examinations in a way that enables comparison of performance across time even though the examinations are different each year. It describes the multi-stage modified Angoff standard-setting procedure used to establish cut-off scores on subject examinations, and how the results from this exercise were then used to develop standards packages. These packages illustrate the performances of students at the borders between the various bands. The paper also shows how originally it was intended to use a Rasch measurement model to create the statistical feedback used in the standard-setting procedure. It also describes the modifications to the feedback that were necessary to meet the real-time constraints of this large-scale examination programme. It argues that consideration should now be given to using the Rasch model to provide this feedback instead of the current approach. [ABSTRACT FROM PUBLISHER]

In recent years, significant numbers of academics from the science and health disciplines at our institution have found that their students lack the appropriate 'mathematical' background to cope with first-year science subjects. Consequently, failure rates are on the increase in these subjects. The mathematical background of students entering university has been found to be a problem in other universities in Australia, as well as in the UK, Ireland and the US. In this report, the authors analyse data on current students' performance and present suggestions for addressing the problems found. The performance of first-year students in four different mathematics and mathematically related subjects is compared to the level of their secondary school mathematics and performance, and to their tertiary entrance score. We conclude that a student's secondary school mathematics background, not their tertiary entrance score, has a dramatic effect on pass rates. On the basis of our findings, a way forward is suggested. [ABSTRACT FROM AUTHOR]