1. Using Diagnostic Profiles to Describe Borderline Performance in Standard Setting.
- Author
-
Skaggs, Gary, Hein, Serge F., and Wilkins, Jesse L. M.
- Subjects
- *
PERFORMANCE standards , *TEST scoring - Abstract
In test‐centered standard‐setting methods, borderline performance can be represented by many different profiles of strengths and weaknesses. As a result, asking panelists to estimate item or test performance for a hypothetical group study of borderline examinees, or a typical borderline examinee, may be an extremely difficult task and one that can lead to questionable results in setting cut scores. In this study, data collected from a previous standard‐setting study are used to deduce panelists' conceptions of profiles of borderline performance. These profiles are then used to predict cut scores on a test of algebra readiness. The results indicate that these profiles can predict a very wide range of cut scores both within and between panelists. Modifications are proposed to existing training procedures for test‐centered methods that can account for the variation in borderline profiles. [ABSTRACT FROM AUTHOR]
- Published
- 2020
- Full Text
- View/download PDF