Development of a three-centre simultaneous objective structured clinical examination

Objective To describe the development, organization, implementation and evaluation of a yearly multicentre, identical and simultaneous objective structured clinical examination (OSCE). Subjects All fifth-year medical students in a 6-year undergraduate medical programme. Setting The Christchurch, Dunedin and Wellington Schools of Medicine of the University of Otago, New Zealand. Method One practice and two full 18-station OSCEs have been completed over 2 years, for up to 72 students per centre, in three centres. The process of development and logistics is described. Data are presented on validity, reliability and fairness. Results Face and content validity were established. Internal consistency was 0·83–0·86 and interexaminer reliability, as assessed by the coefficient of correlation, averaged 0·78. Students rated the OSCE highly on relevance. Of the total variance in total OSCE marks, the schools contributed 6·9%, and the students 93·1%, in the first year. In the second year the schools contributed 6·2% and the students 93·8%. Conclusion Implementation of a psychometrically sound, multicentre, simultaneous and identical OSCE is possible with a low level of interschool variation.