1. Increasing Authenticity of Simulation-Based Assessment in Diagnostic Radiology
- Author
-
Christian P. Mol, Mario Maas, Jan P. J. van Schaik, Corinne A. Tipker, Olle ten Cate, Kim de Crom, Anouk van der Gijp, Koen L. Vincken, Cécile J. Ravesloot, Dik R. Rutgers, Marieke van der Schaaf, Irene C. van der Schaaf, Amsterdam Gastroenterology Endocrinology Metabolism, Amsterdam Movement Sciences, and Radiology and Nuclear Medicine
- Subjects
Program evaluation ,medicine.medical_specialty ,020205 medical informatics ,Epidemiology ,Process (engineering) ,Image quality ,Computer science ,media_common.quotation_subject ,Clinical Decision-Making ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Medicine (miscellaneous) ,Fidelity ,Pilot Projects ,02 engineering and technology ,030218 nuclear medicine & medical imaging ,Education ,03 medical and health sciences ,Digital image ,0302 clinical medicine ,Simulation-based assessments ,0202 electrical engineering, electronic engineering, information engineering ,Medical imaging ,medicine ,Humans ,Program Development ,Simulation Training ,media_common ,Internship and Residency ,medical images ,Test method ,radiology ,Test (assessment) ,Modeling and Simulation ,clinical reasoning ,Educational Measurement ,Radiology ,Program Evaluation - Abstract
INTRODUCTION: Clinical reasoning in diagnostic imaging professions is a complex skill that requires processing of visual information and image manipulation skills. We developed a digital simulation-based test method to increase authenticity of image interpretation skill assessment. METHODS: A digital application, allowing volumetric image viewing and manipulation, was used for three test administrations of the national Dutch Radiology Progress Test for residents. This study describes the development and implementation process in three phases. To assess authenticity of the digital tests, perceived image quality and correspondence to clinical practice were evaluated and compared with previous paper-based tests (PTs). Quantitative and qualitative evaluation results were used to improve subsequent tests. RESULTS: Authenticity of the first digital test was not rated higher than the PTs. Test characteristics and environmental conditions, such as image manipulation options and ambient lighting, were optimized based on participants' comments. After adjustments in the third digital test, participants favored the image quality and clinical correspondence of the digital image questions over paper-based image questions. CONCLUSIONS: Digital simulations can increase authenticity of diagnostic radiology assessments compared with paper-based testing. However, authenticity does not necessarily increase with higher fidelity. It can be challenging to simulate the image interpretation task of clinical practice in a large-scale assessment setting, because of technological limitations. Optimizing image manipulation options, the level of ambient light, time limits, and question types can help improve authenticity of simulation-based radiology assessments.
- Published
- 2017
- Full Text
- View/download PDF