Back to Search Start Over

Problems in estimating composite reliability of ‘unitised’ assessments

Authors :
Tom Bramley
Vikas Dhawan
Source :
Research Papers in Education. 28:43-56
Publication Year :
2013
Publisher :
Informa UK Limited, 2013.

Abstract

This paper discusses the issues involved in calculating indices of composite reliability for ‘modular’ or ‘unitised’ assessments of the kind used in GCSEs, AS and A level examinations in England. The increasingly widespread use of on-screen marking has meant that the item-level data required for calculating indices of reliability is now routinely available for most (but not all) units of unitised assessments. Whilst it is relatively straightforward to obtain indices of reliability at unit level, it is far more complex to obtain indices at overall assessment level because of problems created by: (i) the number of different possible ‘routes’ to the final assessment; (ii) the different knowledge, skills and understanding assessed in different units; (iii) the wide variety in item type and size within and across units; (iv) the fact that the item-level data required for calculating reliability indices is not available (or does not exist) for certain units and (v) the different intended weighting of different ...

Details

ISSN :
14701146 and 02671522
Volume :
28
Database :
OpenAIRE
Journal :
Research Papers in Education
Accession number :
edsair.doi...........9273c8ad393274fa0b35fee556c90656
Full Text :
https://doi.org/10.1080/02671522.2012.754226