Search

Background: Simtics Integrated Cognitive Simulator (ICS) is a software learning environment, previously demonstrated to be of use to surgical trainees in learning the cognitive aspects of procedural skills. It also includes a Test-Mode, which has not previously been assessed for its ability to discriminate between experienced and non-experienced operators. Methods: 10 experienced and 10 non-experienced participants performed a laparoscopic appendicectomy using the ICS laparoscopic appendicectomy (LA) module. Total score, total time, and four further metrics (incorrect hand, incorrect instrument, incorrect location, time > 15s per step) were recorded for each individual, across the four sections and nine steps of the simulation. Results: Median total score was greater amongst surgically experienced participants than surgically inexperienced participants (26.5 %, p = 0.023). Instrument use was a significant discriminator between these groups in 2 of 4 of the ICS LA sections. PeerJ Preprints | https://doi.org/10.7287/peerj.preprints.1893v1 | CC-BY 4.0 Open Access | rec: 23 Mar 2016, publ: 23 Mar 2016 Conclusions: ICS LA metrics are able to discriminate between experienced and inexperienced operators. Differences in the discriminant ability of these metrics could be used to optimise the assessment metrics for assessment metrics of procedural simulations. PeerJ Preprints | https://doi.org/10.7287/peerj.preprints.1893v1 | CC-BY 4.0 Open Access | rec: 23 Mar 2016, publ: 23 Mar 2016 Introduction Simulation technologies are garnering increased attention as a tool for medical and surgical education. These simulators focus on skills in different learning domains, including psychomotor, visuospatial perception, and cognitive skills (1). Simulators are used for both learning and assessing skills in these domains, though little attention has been given to the metrics used in simulation-based assessments. Simtics Integrated Cognitive Simulator module Test-Mode provides an assessment environment designed to assess the executive routine involved in performing the laparoscopic appendicectomy procedure. This study aimed to determine which of the module’s testing metrics are able to distinguish between individuals with different levels of procedural knowledge and experience.