Search

Background: Computer-based applications are increasingly used to support the training of medical professionals. Augmented reality applications (ARAs) render an interactive virtual layer on top of reality. The use of ARAs is of real interest to medical education because they blend digital elements with the physical learning environment. This will result in new educational opportunities. The aim of this systematic review is to investigate to which extent augmented reality applications are currently used to validly support medical professionals training., Methods: PubMed, Embase, INSPEC and PsychInfo were searched using predefined inclusion criteria for relevant articles up to August 2015. All study types were considered eligible. Articles concerning AR applications used to train or educate medical professionals were evaluated., Results: Twenty-seven studies were found relevant, describing a total of seven augmented reality applications. Applications were assigned to three different categories. The first category is directed toward laparoscopic surgical training, the second category toward mixed reality training of neurosurgical procedures and the third category toward training echocardiography. Statistical pooling of data could not be performed due to heterogeneity of study designs. Face-, construct- and concurrent validity was proven for two applications directed at laparoscopic training, face- and construct validity for neurosurgical procedures and face-, content- and construct validity in echocardiography training. In the literature, none of the ARAs completed a full validation process for the purpose of use., Conclusion: Augmented reality applications that support blended learning in medical training have gained public and scientific interest. In order to be of value, applications must be able to transfer information to the user. Although promising, the literature to date is lacking to support such evidence., Competing Interests: Compliance with ethical standards Disclosures Authors E.Z. Barsom, M. Graafland and M.P. Schijven have no conflicts of interest or financial ties to disclose.

Objective: With the increase in robotic-assisted laparoscopic surgery there is a concomitant rising demand for training methods. The objective was to establish face and construct validity of a novel virtual reality simulator (dV-Trainer, Mimic Technologies, Seattle, WA) for the use in training of robot-assisted surgery., Methods: A comparative cohort study was performed. Participants (n = 42) were divided into three groups according to their robotic experience. To determine construct validity, participants performed three different exercises twice. Performance parameters were measured. To determine face validity, participants filled in a questionnaire after completion of the exercises., Results: Experts outperformed novices in most of the measured parameters. The most discriminative parameters were "time to complete" and "economy of motion" (P < 0.001). The training capacity of the simulator was rated 4.6 ± 0.5 SD on a 5-point Likert scale. The realism of the simulator in general, visual graphics, movements of instruments, interaction with objects, and the depth perception were all rated as being realistic. The simulator is considered to be a very useful training tool for residents and medical specialist starting with robotic surgery., Conclusions: Face and construct validity for the dV-Trainer could be established. The virtual reality simulator is a useful tool for training robotic surgery.

Background: Although task training on virtual reality (VR) simulators has been shown to transfer to the operating room, to date no VR curricula have been described for advanced laparoscopic procedures. The purpose of this study was to develop a proficiency-based VR technical skills curriculum for laparoscopic colorectal surgery., Methods: The Delphi method was used to determine expert consensus on which VR tasks (on the LapSim simulator) are relevant to teaching laparoscopic colorectal surgery. To accomplish this task, 19 international experts rated all the LapSim tasks on a Likert scale (1-5) with respect to the degree to which they thought that a particular task should be included in a final technical skills curriculum. Results of the survey were sent back to participants until consensus (Cronbach's α >0.8) was reached. A cross-sectional design was utilized to define the benchmark scores for the identified tasks. Nine expert surgeons completed all identified tasks on the "easy," "medium," and "hard" settings of the simulator., Results: In the first round of the survey, Cronbach's α was 0.715; after the second round, consensus was reached at 0.865. Consensus was reached for 7 basic tasks and 1 advanced suturing task. Median expert time and economy of movement scores were defined as benchmarks for all curricular tasks., Conclusion: This study used Delphi consensus methodology to create a curriculum for an advanced laparoscopic procedure that is reflective of current clinical practice on an international level and conforms to current educational standards of proficiency-based training., (Copyright © 2012 Mosby, Inc. All rights reserved.)

Minimal invasive techniques are rapidly becoming standard surgical techniques for many surgical procedures. To develop the skills necessary to apply these techniques, box trainers and/or inanimate models may be used, but these trainers lack the possibility of inherent objective classification of results. In the past decade, virtual reality (VR) trainers were introduced for training minimal invasive techniques. Minimally invasive surgery (MIS) is, by nature, very suitable for this type of training. The specific psychomotor skills and eye-hand coordination needed for MIS can be mastered largely using VR simulation techniques. It is also possible to transfer skills learned on a simulator to real operations, resulting in error reduction and shortening of procedural operating time. The authors aim to enlighten the process of gaining acceptance in the Netherlands for novel training techniques. The Dutch Societies of Surgery, Obstetrics and Gynecology, and Urology each developed individual training curricula for MIS using simulation techniques, to be implemented in daily practice. The ultimate goal is to improve patient safety. The authors outline the opinions of actors involved, such as different simulators, surgical trainees, surgeons, surgical societies, hospital boards, government, and the public. The actual implementation of nationwide training curricula for MIS is, however, a challenging step.

Background: Virtual reality (VR) simulators have been demonstrated to improve basic psychomotor skills in endoscopic surgery. The exercise configuration settings used for validation in studies published so far are default settings or are based on the personal choice of the tutors. The purpose of this study was to establish consensus on exercise configurations and on a validated training program for a virtual reality simulator, based on the experience of international experts to set criterion levels to construct a proficiency-based training program., Methods: A consensus meeting was held with eight European teams, all extensively experienced in using the VR simulator. Construct validity of the training program was tested by 20 experts and 60 novices. The data were analyzed by using the t test for equality of means., Results: Consensus was achieved on training designs, exercise configuration, and examination. Almost all exercises (7/8) showed construct validity. In total, 50 of 94 parameters (53%) showed significant difference., Conclusions: A European, multicenter, validated, training program was constructed according to the general consensus of a large international team with extended experience in virtual reality simulation. Therefore, a proficiency-based training program can be offered to training centers that use this simulator for training in basic psychomotor skills in endoscopic surgery.

Background: A demand for safe, efficient laparoscopic training tools has prompted the introduction of virtual reality (VR) laparoscopic simulators, which might be used for performance assessment. The purpose of this review is to determine the value of VR metrics in laparoscopic skills assessment., Data Sources: An exhaustive search of the MEDLINE and EMBASE databases was performed to identify publications concerning construct, concurrent and predictive validation of VR simulators. Of 643 publications found, 42 were included in this review. Studies into all 3 types of validation showed a large heterogeneity in study design. Although concurrence of VR metrics with box trainer metrics, mental aptitude tests, and in vivo surgical performance was generally weak, several metrics demonstrated construct validity in selected simulators., Conclusions: Using the right simulator, tasks, and metrics, trainees' and experts' laparoscopic skills can reliably be compared. However, VR simulators cannot yet predict levels of real life surgical skills., (Copyright 2010 Elsevier Inc. All rights reserved.)

The aim of the study was to determine if the concept of face and construct validity may apply to the SurgicalSim Educational Platform (SEP) "robot" simulator. The SEP robot simulator is a virtual reality (VR) simulator aiming to train users on the Da Vinci Surgical System. To determine the SEP's face validity, two questionnaires were constructed. First, a questionnaire was sent to users of the Da Vinci system (reference group) to determine a focused user-group opinion and their recommendations concerning VR-based training applications for robotic surgery. Next, clinical specialists were requested to complete a pre-tested face validity questionnaire after performing a suturing task on the SEP robot simulator. To determine the SEP's construct validity, outcome parameters of the suturing task were compared, for example, relative to participants' endoscopic experience. Correlations between endoscopic experience and outcome parameters of the performed suturing task were tested for significance. On an ordinal five-point, scale the average score for the quality of the simulator software was 3.4; for its hardware, 3.0. Over 80% agreed that it is important to train surgeons and surgical trainees to use the Da Vinci. There was a significant but marginal difference in tool tip trajectory (p = 0.050) and a nonsignificant difference in total procedure time (p = 0.138) in favor of the experienced group. In conclusion, the results of this study reflect a uniform positive opinion using VR training in robotic surgery. Concepts of face and construct validity of the SEP robotic simulator are present; however, these are not strong and need to be improved before implementation of the SEP robotic simulator in its present state for a validated training curriculum to be successful .

Background: Virtual reality (VR) as surgical training tool has become a state-of-the-art technique in training and teaching skills for minimally invasive surgery (MIS). Although intuitively appealing, the true benefits of haptic (VR training) platforms are unknown. Many questions about haptic feedback in the different areas of surgical skills (training) need to be answered before adding costly haptic feedback in VR simulation for MIS training. This study was designed to review the current status and value of haptic feedback in conventional and robot-assisted MIS and training by using virtual reality simulation., Methods: A systematic review of the literature was undertaken using PubMed and MEDLINE. The following search terms were used: Haptic feedback OR Haptics OR Force feedback AND/OR Minimal Invasive Surgery AND/OR Minimal Access Surgery AND/OR Robotics AND/OR Robotic Surgery AND/OR Endoscopic Surgery AND/OR Virtual Reality AND/OR Simulation OR Surgical Training/Education., Results: The results were assessed according to level of evidence as reflected by the Oxford Centre of Evidence-based Medicine Levels of Evidence., Conclusions: In the current literature, no firm consensus exists on the importance of haptic feedback in performing minimally invasive surgery. Although the majority of the results show positive assessment of the benefits of force feedback, results are ambivalent and not unanimous on the subject. Benefits are least disputed when related to surgery using robotics, because there is no haptic feedback in currently used robotics. The addition of haptics is believed to reduce surgical errors resulting from a lack of it, especially in knot tying. Little research has been performed in the area of robot-assisted endoscopic surgical training, but results seem promising. Concerning VR training, results indicate that haptic feedback is important during the early phase of psychomotor skill acquisition.

Objective: The objective of the study was to validate virtual reality simulation in assessing laparoscopic skills in gynecology by establishing the extent of realism of the simulation to the actual task (face validity) and the degree to which the results of the test one uses reflects the subject tested (construct validity)., Study Design: Subjects (n = 56) were divided into 3 groups: novices (n = 15), intermediates (n = 20), and experts (n = 21). Participants completed 3 repetitions of a training program consisting of 4 basic skills and 3 gynecologic procedural simulations. The performance was compared between groups using a post hoc Student t test with the Bonferroni technique. Face validity was determined by using a questionnaire of 27 statements., Results: Resulting from the questionnaire, the opinion about the realism and training capacities of the tasks was favorable among all groups. The degree of prior laparoscopic experience was reflected in the outcome performance parameters of the tasks. Experts achieved significant better scores on specific parameters., Conclusion: The results of this study indicate acceptance and thus face validity of the system among both reference (novice, intermediate) and expert group. There is a significant difference between subjects with different laparoscopic experience and thereby construct validity for the laparoscopic simulator could be established.

Introduction: Virtual reality (VR) simulators have been developed to train basic endoscopic surgical skills outside of the operating room. An important issue is how to create optimal conditions for integration of these types of simulators into the surgical training curriculum. The willingness of surgical residents to train these skills on a voluntary basis was surveyed., Methods: Twenty-one surgical residents were given unrestricted access to a VR simulator for a period of four months. After this period, a competitive element was introduced to enhance individual training time spent on the simulator. The overall end-scores for individual residents were announced periodically to the full surgical department, and the winner was awarded a prize., Results: In the first four months of study, only two of the 21 residents (10%) trained on the simulator, for a total time span of 163 minutes. After introducing the competitive element the number of trainees increased to seven residents (33%). The amount of training time spent on the simulator increased to 738 minutes., Conclusions: Free unlimited access to a VR simulator for training basic endoscopic skills, without any form of obligation or assessment, did not motivate surgical residents to use the simulator. Introducing a competitive element for enhancing training time had only a marginal effect. The acquisition of expensive devices to train basic psychomotor skills for endoscopic surgery is probably only effective when it is an integrated and mandatory part of the surgical curriculum.

To prevent unnecessary mistakes and avoidable complications in laparoscopic surgery, there has to be proper training. A safe way to train surgeons for laparoscopy is simulation. This study addresses the face validity of ProMIS, an Augmented Reality laparoscopic simulator, as a tool for training suturing skills in laparoscopic surgery. A two-paged, 12-item structured questionnaire, using a five-point-Likert scale, was presented to 50 surgeons/surgical interns. The participants were allotted to two groups: an "expert" (>50 procedures; N=23) and a referent group (<50 procedures; N=27). Non-parametric statistics were used to determine statistical differences. General consensus existed in both expert and referent groups, delineating ProMIS as a useful tool in teaching suturing skills surgeons/surgical interns (mean + or - st dev, resp, score 4.91 + or - 0.42 and 4.93 + or - 0.38) with regard to realism, tactile feedback, and suturing techniques. Significant differences in opinion regarding the ergonomics and design of ProMIS between the expert and referent groups existed. The ProMIS Augmented Reality laparoscopic simulator is regarded as a useful tool in laparoscopic training in both expert and referent groups. Although significant differences in opinion existed with regards to ergonomics and design of ProMIS, they were present between experts and novices.

Background: Virtual reality simulators may be invaluable in training and assessing future endoscopic surgeons. The purpose of this study was to investigate if the results of a training session reflect the actual skill of the trainee who is being assessed and thereby establish construct validity for the LapSim virtual reality simulator (Surgical Science Ltd., Gothenburg, Sweden)., Methods: Forty-eight subjects were assigned to one of three groups: 16 novices (0 endoscopic procedures), 16 surgical residents in training (>10 but <100 endoscopic procedures), and 16 experienced endoscopic surgeons (>100 endoscopic procedures). Performance was measured by a relative scoring system that combines single parameters measured by the computer., Results: The higher the level of endoscopic experience of a participant, the higher the score. Experienced surgeons and surgical residents in training showed statistically significant higher scores than novices for both overall score and efficiency, speed, and precision parameters., Conclusions: Our results show that performance of the various tasks on the simulator corresponds to the respective level of endoscopic experience in our research population. This study demonstrates construct validity for the LapSim virtual reality simulator. It thus measures relevant skills and can be integrated in an endoscopic training and assessment program.

Background: The SIMENDO is an affordable virtual reality simulator designed to train basic psychomotor skills for endoscopic surgery. This study aimed first to establish construct validity by determining which parameters can discriminate groups with different experience levels, and second to establish the extent to which training is useful by determining when inexperienced groups reach expert level., Methods: The study participants were divided into four groups according to their experience with endoscopic procedures: experienced group (group A, >50 procedures performed, n = 15), intermediate group (group B, 1-50 procedures performed, n = 18), endoscope navigation group (group C, endoscope navigation experience, n = 14), and novice group (group D, no endoscopic experience, n = 14). Each participant performed three repetitions of six consecutive exercises. The parameters studied were task time, path length of the instruments, and number of errors (collisions). Some participants continued training up to 10 repetitions to get insight in the learning curve., Results: Group A (expert) outperformed all the other groups (B, C, and D) in terms of total median task time (p < 0.05), groups C and D in terms of path length, and group D in terms of collision frequency in the first two repetitions. Group B (intermediate) outperformed group D (novice) in total time and endoscope path length for all repetitions, and group C (camera navigation) outperformed group D (novice) in the first repetition. Less experienced groups D and C did not reach expert level for the task time within 10 repetitions, and group B reached it after the eighth repetition (p < 0.05)., Conclusion: The study was able to establish construct validity for the training program with the simulator under study. The learning curve showed that training with this simulator is useful for subjects with or without limited endoscopic experience. Furthermore, previous endoscopic camera navigation already improves motor skills to more than the basic level.

Background: Virtual reality (VR) is an emerging new modality for laparoscopic skills training; however, most simulators lack realistic haptic feedback. Augmented reality (AR) is a new laparoscopic simulation system offering a combination of physical objects and VR simulation. Laparoscopic instruments are used within an hybrid mannequin on tissue or objects while using video tracking. This study was designed to assess the difference in realism, haptic feedback, and didactic value between AR and VR laparoscopic simulation., Methods: The ProMIS AR and LapSim VR simulators were used in this study. The participants performed a basic skills task and a suturing task on both simulators, after which they filled out a questionnaire about their demographics and their opinion of both simulators scored on a 5-point Likert scale. The participants were allotted to 3 groups depending on their experience: experts, intermediates and novices. Significant differences were calculated with the paired t-test., Results: There was general consensus in all groups that the ProMIS AR laparoscopic simulator is more realistic than the LapSim VR laparoscopic simulator in both the basic skills task (mean 4.22 resp. 2.18, P < 0.000) as well as the suturing task (mean 4.15 resp. 1.85, P < 0.000). The ProMIS is regarded as having better haptic feedback (mean 3.92 resp. 1.92, P < 0.000) and as being more useful for training surgical residents (mean 4.51 resp. 2.94, P < 0.000)., Conclusions: In comparison with the VR simulator, the AR laparoscopic simulator was regarded by all participants as a better simulator for laparoscopic skills training on all tested features.

The Work Group for Evaluation and Implementation of Simulators and Skills Training Programmes is a newly formed subgroup of the European Association of Endoscopic Surgeons (EAES). This work group undertook a review of validation evidence for surgical simulators and the resulting consensus is presented in this article. Using clinical guidelines criteria, the evidence for validation for 6 different simulators was rated and subsequently translated to a level of recommendation for each system. The simulators could be divided into 2 basic types; systems for laparoscopic general surgery and flexible gastrointestinal endoscopy. Selection of simulators for inclusion in this consensus was based on their availability and relatively widespread usage as of July 2004. While level 2 recommendations were achieved for a few systems, it was clear that there was an overall lack of published validation studies with rigorous experimental methodology. Since the consensus meeting, there have been a number of new articles, system upgrades and new devices available. The work group intends to update these consensus guidelines on a regular basis, with the resulting article available on the EAES website (http://www.eaes-eur.org).

Background: This study assesses the acquisition of skill and the learning curve associated with the performance of the clip-and-cut task on the Xitact LS 500 virtual reality (VR) simulator in laparoscopic cholecystectomy., Methods: A group of 33 residents and interns with no previous laparoscopic experience participated in the study. All participants received a 1-h familiarization tour on the simulator. Thirty participants completed a full course of 30 simulation runs over 3 days (10 runs per day). The outcome parameters were a previously validated sum-score and time to complete performance., Results: Group demographics were similar. Of the participants who completed the full study, 16.7% appeared to have such a high level of innate psychomotor abilities that they were considered proficient in the task immediately after the initial familiarization tour. Most participants (63.3%) had a moderate level of innate abilities, and their performance improved through repetitive VR training. In our study, 20% of the participants had such a low level of innate abilities that they were unable to achieve an acceptable performance in our minimal-access surgery (MAS) simulation., Conclusions: Learning curves cannot be assessed by examining the repetitive training of only one person. There seem to be four different performance profiles, reflecting the fact that some people are more adept than others to be trained by MAS procedural VR simulation. For participants receptive to training--63.3% in this study--proficiency in the task occurs after approximately 25 simulative runs.