Search

Objective: The objective of this study was to explore the educational utility of virtually augmented surgical navigation (VASN) in simulation training for endoscopic sinus surgery., Study Design: Prospective trial using within-subjects design., Setting: Single academic institution., Methods: Otolaryngology trainees (n = 15) were enrolled in a prospective trial of repeated measures. Participants performed unilateral functional endoscopic sinus surgery (FESS) on a 3-dimensional-printed sinus model without instruction. Participants then underwent educational intervention incorporating VASN tools-featuring anatomic overlay delineations, virtual planning points, proximity alerts, digital measurements, as well as artificial intelligence-generated endoscopic viewpoints. With the VASN tools activated, participants then performed FESS on the contralateral side of the model. Primary outcomes of interest included number of major complications, time to complete anterior fess, steps completed, and technical skills score. Descriptive statistics were performed to describe participant characteristics and bivariate analysis were used to evaluate differences in subjective and objective outcome measures., Results: A majority (93%) of residents strongly agreed that simulation intervention improved their confidence in surgical skills related to FESS. Complications decreased from 13 instances to 3 following interventions. Initial technical skills score of 45.2 increased to 54.4 postintervention (P < .0001) and global score also improved by 4.6 points on average (P < .001). Time to anterior FESS decreased from 1356 to 915 seconds (P = .006) and average number of completed surgical steps increased from 3.3 to 4.6 (P < .001)., Conclusion: This simulation study contributes to growing evidence supporting utility of advanced technology in surgical education. Results suggest that VASN serves as a beneficial adjunct in FESS simulation training., (© 2024 American Academy of Otolaryngology–Head and Neck Surgery Foundation.)

Purpose: To develop and investigate an evidence-based performance test for assessment of vitreoretinal surgical skills on the EyeSi Surgical Simulator., Methods: Ten junior residents without any surgical experience, eight senior residents with prior experience in cataract surgery and five vitreoretinal surgeons were included in the study. The test consisted of seven modules and was completed twice by all groups during a single session. Validity evidence was evaluated using Messick's validity framework. Senior residents completed four additional test sessions and were retested 3 months after to assess skill acquisition and retention., Results: Content was aligned with vitreoretinal surgical skills as evaluated by expert surgeons. Response process was ensured through standardized instruction and data collection. The test showed satisfactory internal consistency with Cronbach's α = 0.76 (internal structure) and significant discriminative ability between the residents and the experienced surgeons (relation to other variables). A pass/fail level was determined at 596 using the contrasting groups' method. Consequences of applying this standard resulted in no false positive and no false negative. Senior residents significantly improved their simulator skills over time, reaching a plateau at the fifth iteration and equalling expert performance (p = 0.420). This level of competency was retained during the post-3-month retention testing (p = 0.062)., Conclusion: We established a performance test with solid evidence for assessment of vitreoretinal surgical skills on the EyeSi Simulator and determined a benchmark criterion that may be used for future implementation of proficiency-based training for novices., (© 2020 Acta Ophthalmologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.)

Purpose: To develop and investigate an Eyesi simulator-based test for the more experienced cataract surgeon for evidence of validity., Methods: The study was a prospective interventional cohort study and carried out at the Copenhagen Academy for Medical Education and Simulation. The Eyesi Simulator was used for the test which was developed by three expert cataract surgeons. Ten cataract surgeons (>250 surgeries performed) and ten ophthalmic residents performed two repetitions of the test. The test consisted of four modules: Iris Expansion Ring insertion - level 1, Iris Expansion Ring extraction - level 2, Capsulorhexis - level 3 and Anterior Vitrectomy - level 6., Results: Internal consistency reliability showed Cronbach's alpha of 0.63. Test-retest reliabilities were significant for Iris Expansion Ring extraction - level 2 (p = 0.012) and Capsulorhexis - level 3 (p = 0.018). Differences between the two groups were only significant in both repetitions for the Iris Expansion Ring extraction - level 2 (p < 0.001 and p = 0.041, respectively). Furthermore, we found a statistically significant difference between the mean module scores for novices and the more experienced surgeons for Iris Expansion Ring insertion - level 1 (p = 0.021) and Capsulorhexis - level 3 (p = 0.019) in the first repetition., Conclusion: The investigated modules show evidence of validity within several aspects of Messick's framework. However, the evidence is not strong enough to apply the test for certification purposes of cataract surgeons, but the modules may still be relevant in the training of advanced cataract surgical procedures., (© 2020 The Authors. Acta Ophthalmologica published by John Wiley & Sons Ltd on behalf of Acta Ophthalmologica Scandinavica Foundation.)

Study Design: Prospective experimental study with on-site simulation., Objective: To compare the accuracy and efficiency of different techniques for pedicle screw instrumentation (PSI)., Summary of Background Data: Improving the safety and efficiency of PSI is a critical step to reduce the complication rates and the cost of scoliosis surgery. Innovative operative techniques for PSI have shown to safely improve efficiency, thereby reducing cost. Surgical simulation is a valuable tool to study different operative techniques., Methods: Five spine fellows instrumented 20 simulation models of a scoliotic spine with 10 pedicle screws per model. Four techniques were studied, including the conventional pedicle probe and the innovative sequential drilling technique, with or without computed tomography (CT)-based navigation. Our primary outcome measures were efficiency and accuracy of PSI. We analyzed the data with bivariate analyses using the Chi-square test for categorical variables and the Student t test or ANalysis Of VAriance with Bonferroni post-hoc tests for continuous variables., Results: The drilling techniques (free hand and navigated) were more efficient as compared with the pedicle probe techniques (P < 0.01). The navigated techniques resulted in better accuracy as compared with the free hand techniques (P = 0.036). Most pedicle breaches were medial (n = 32/52). The concave apical pedicle (T4 right side) had the highest incidence of breaches. There was no significant difference in efficiency comparing the free hand and the navigated pedicle probe techniques (P = 0.261) or comparing the free hand drilling and the navigated drilling techniques (P = 1.00)., Conclusion: On site surgical simulation is a promising concept for teaching advanced procedural skills. Our findings suggest that navigation improves the accuracy of PSI while sequential drilling safely improves efficiency. Combining navigation with sequential drilling can significantly improve the accuracy and the efficiency of PSI in scoliosis surgery, as previously suggested with our published clinical data., Level of Evidence: 4.

Background and Objective: Surgical skill assessment aims to objectively evaluate and provide constructive feedback for trainee surgeons. Conventional methods require direct observation with assessment from surgical experts which are both unscalable and subjective. The recent involvement of surgical robotic systems in the operating room has facilitated the ability of automated evaluation of the expertise level of trainees for certain representative maneuvers by using machine learning for motion analysis. The features extraction technique plays a critical role in such an automated surgical skill assessment system., Methods: We present a direct comparison of nine well-known feature extraction techniques which are statistical features, principal component analysis, discrete Fourier/Cosine transform, codebook, deep learning models and auto-encoder for automated surgical skills evaluation. Towards near real-time evaluation, we also investigate the effect of time interval on the classification accuracy and efficiency., Results: We validate the study on the benchmark robotic surgical training JIGSAWS dataset. An accuracy of 95.63, 90.17 and 90.26% by the Principal Component Analysis and 96.84, 92.75 and 95.36% by the deep Convolutional Neural Network for suturing, knot tying and needle passing, respectively, highlighted the effectiveness of these two techniques in extracting the most discriminative features among different surgical skill levels., Conclusions: This study contributes toward the development of an online automated and efficient surgical skills assessment technique., Competing Interests: Declaration of Competing Interest None., (Copyright © 2019. Published by Elsevier B.V.)

Focused thoracic ultrasound has become essential in the guidance and direction of pleural interventions to reduce unwanted complications and as a result now forms a crucial component of physician training. Current training standards along with assessment methods vary widely, and are often not robust enough to ensure adequate competence.This review assesses the current state of training and assessment of thoracic ultrasound competence in various settings, allowing comparison with alternative competency based programmes. Future directions for training and assessment of thoracic ultrasound competence are discussed., Competing Interests: Conflict of interest: D.J. McCracken has nothing to disclose. Conflict of interest: C.B. Laursen has nothing to disclose. Conflict of interest: G. Barker has nothing to disclose. Conflict of interest: F.V. Gleeson has nothing to disclose. Conflict of interest: K.M. Cullen has nothing to disclose. Conflict of interest: N.M. Rahman has nothing to disclose., (Copyright ©ERS 2019.)

Objective: Currently, there is a worldwide shift toward competency-based medical education. This necessitates the use of automated skills assessment methods during self-guided interventions training. Making assessment methods that are transparent and configurable will allow assessment to be interpreted into instructional feedback. The purpose of this work is to develop and validate skills assessment methods in ultrasound-guided interventions that are transparent and configurable., Methods: We implemented a method based upon decision trees and a method based upon fuzzy inference systems for technical skills assessment. Subsequently, we validated these methods for their ability to predict scores of operators on a 25-point global rating scale in ultrasound-guided needle insertions and their ability to provide useful feedback for training., Results: Decision tree and fuzzy rule-based assessment performed comparably to state-of-the-art assessment methods. They produced median errors (on a 25-point scale) of 1.7 and 1.8 for in-plane insertions and 1.5 and 3.0 for out-of-plane insertions, respectively. In addition, these methods provided feedback that was useful for trainee learning. Decision tree assessment produced feedback with median usefulness 7 out of 7; fuzzy rule-based assessment produced feedback with median usefulness 6 out of 7., Conclusion: Transparent and configurable assessment methods are comparable to the state of the art and, in addition, can provide useful feedback. This demonstrates their value in self-guided interventions training curricula.

Mandibular all-on-4 implant reconstruction techniques are less complex than maxillary but more complex than routine dental implant surgery, requiring advanced technical skills, deeper understanding of prosthodontic principles, and more complex surgical planning. Surgical simulation may assist experienced surgeons seeking to acquire new skills through increased planning ability, improved intraspecialty communication, and enhanced technical competence. Achieving competence is different for the trainee devoted to the learning process and the practicing surgeon with limited time and balancing other roles and responsibilities. Well-constructed continuing education incorporating simulation, 3-dimensional printed models, and computer-assisted planning may offer the most efficient path to competence., (Copyright © 2019 Elsevier Inc. All rights reserved.)

Maxillary all-on-four implant reconstruction requires training beyond normal dental implant training. It conjoins technical surgical acumen, anatomic and complex spatial relationship understanding, thorough awareness of dental prosthodontic principles, and excellent patient management skills. Acquisition of appropriate training to the level of competence in an era of greater patient expectations and increased vigilance for patient safety and overall quality of care is limited. Repeated purposeful practice in performing complex psychomotor tasks is of paramount importance in achieving competence. Surgical simulation may assist surgical learners to acquire familiarity with relevant anatomic variations, instrumentation, surgical techniques, and management of intraoperative and postoperative complications., (Copyright © 2019 Elsevier Inc. All rights reserved.)

This paper describes transfer of skills obtained from training with the EyeSI virtual reality simulator of ophthalmic surgery to real-life surgical performance. Skills in real-life phacoemulsification surgery were assessed by systematic blinded evaluation of surgical videos based on the OSACCS system. Nineteen Danish cataract surgeons with varying clinical experience levels had their cataract surgery skills evaluated before and after completing a standardized mastery learning program on the EyeSI. It was found that transfer of skills could be demonstrated only for surgeons with a real-life experience of less than 75 completed, independent cases. We could not demonstrate transfer of skills from the EyeSI cataract module to the EyeSI vitreoretinal module, so each subspecialty seems to require specific training. Finally, the discriminative power of EyeSI simulation between emerging surgeons and experts was found to reside only in the first training sessions. The EyeSI simulator in its current state of development, and our implementation of it, seems to require further development before it can be used as a tool to select residents for surgical training and to re-certify more senior surgeons.

Purpose: It was hypothesized that surgeon's experience as well as bone density play a significant role in achieving accurate cuts with patient-specific instrumentation (PSI). The aim of this study was to compare the accuracy of the tibial cuts in different bone densities made by a highly experienced orthopedic surgeon on one hand and a less experienced orthopedic surgeon on the other., Methods: Tibial models from three different sawbone densities were developed for this study. Each surgeon performed 21 cuts. A coordinate measuring machine was used to analyse the cuts. The K-Cohen test was performed to evaluate the results. The analyzed parameters were guide positioning and deviation from the guide cut to the tibial cut, including varus/valgus angle, the tibial slope, cut height, planarity (mm 2 ), and rugosity (mm)., Results: There was a significant difference in the positioning of the tibial cut guide between the two surgeons for the tibial slope (p < 0.05), while no difference was observed for the varus/valgus angle (n.s.) and the cut height (n.s.). No significant difference in the tibial cut was observed between the surgeons for the tibial slope angle (n.s.), varus/valgus angle (n.s.), planarity (n.s.), and rugosity (n.s.). In the different bone types, no significant difference was observed for the tibial slope (n.s.) and varus/valgus angle (n.s.), while planarity and rugosity showed significant differences (p < 0.05). Our study showed no significant difference in the tibial cuts for the tibial slope, varus/valgus angle, planarity, and rugosity between the two surgeons., Conclusions: In the present study, it could be demonstrated that accuracy of the cuts is ensured by PSI not depending on the surgeon's experience and the bone mineral density. This speaks to its clinical significance: PSI might be suited for less experienced surgeons to reduce outliers in total knee arthroplasty (TKA).

Purpose: To assess the accuracy of cup orientation and learning curve of the disposable accelerometer-based portable navigation system for total hip arthroplasty (THA) in the supine position., Methods: A total of 75 patients who underwent THA through the anterolateral supine approach (ALS) with an accelerometer-based portable navigation system for the supine position (HipAlign ® ) between July 2017 and October 2018 were analyzed in this study. We compared the intraoperative cup angles using navigation records with the postoperative angles using postoperative computed tomography (CT) data. All patients were categorized into the following groups according to the course of three discrete, sequential operative time periods: 1-25 (initial group), 26-50 (intermediate group), and 51-75 (recent group). We compared the accuracy of cup inclination and anteversion among the three groups. The time required for navigation and the operative time of all patients were measured., Results: The average absolute error in measurement (postoperative CT-navigation record) was 2.6° ± 2.7° (inclination) and 2.8° ± 2.7° (anteversion). There were no significant differences among the three groups. The average time required for navigation and the operative time were 365.1 ± 90.3 s and 76.1 ± 1.6 min, respectively. The required time for HipAlign ® navigation and operative time were constant in most patients, except for those of the initial five cases., Conclusion: The accelerometer-based portable navigation system provides good accuracy of cup orientation, has a short learning curve, and requires a minimal surgical time for THA in supine position.

Purpose: To investigate the validity of six vitreoretinal modules on the Eyesi Surgical Simulator., Methods: Fifteen residents with no vitreoretinal experience and six trained vitreoretinal surgeons (>100 procedures per year) were included in the study. Four modules were selected in agreement with an experienced surgeon: the navigation (Nav), forceps (For), vitrector (Vit) and epiretinal membrane (ERM) peeling modules. The first level of the basic training modules (Nav1 and For1) and the first two levels of the more procedural modules (Vit1, Vit2, ERM1 and ERM2) were completed twice by both groups in the above order. The performance parameters for each task were calculated by the simulator software. The results from both iterations were recorded for analysis., Results: Experienced vitreoretinal surgeons outperformed residents with regard to the overall score on the Nav1 (p = 0.01), For1 (p < 0.01), ERM1 (p = 0.02) and ERM2 (p = 0.04) modules. No differences in overall score were found between the two groups on the Vit1 (p = 0.17) and Vit2 modules (p = 0.26)., Conclusion: Validity for the simulator metrics was found on four vitreoretinal modules not previously investigated, with regard to construct validity, content and the response process. These exercises could be included in a future competency-based training programme that could potentially be applied in the standard ophthalmological curriculum., (© 2018 Acta Ophthalmologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.)

Purpose: Laparoscopic surgery requires complex surgical skills; hence, surgeons require regular training to improve their surgical techniques. The quantitative assessment of a surgeon's skills and the provision of feedback are important processes for conducting effective training. The aim of this study was to develop an inexpensive training system that provides automatic technique evaluation and feedback., Methods: We detected the instrument using image processing of commercial web camera images and calculated the motion analysis parameters (MAPs) of the instrument to quantify performance features. Upon receiving the results, we developed a method of evaluating the surgeon's skill level. The feedback system was developed using MAPs-based radar charts and scores for determining the skill level. These methods were evaluated using the videos of 38 surgeons performing a suturing task., Results: There were significant differences in MAPs among surgeons; therefore, MAPs can be effectively used to quantify a surgeon's performance features. The results of skill evaluation and feedback differed greatly between skilled and unskilled surgeons, and it was possible to indicate points of improvement for the procedure performed in this study. Furthermore, the results obtained for certain novice surgeons were similar to those obtained for skilled surgeons., Conclusion: This system can be used to assess the skill level of surgeons, independent of the years of experience, and provide an understanding of the individual's current surgical skill level effectively. We conclude that our system is useful as an inexpensive laparoscopic training system that might aid in skill improvement.

Objective: Our aim was to develop an ultrasound-guided training curriculum for continuous infusion catheter placement in the paravertebral space and to create a gelatin thoracic spine-rib model for use in this training. We sought to create a model that was inexpensive and reusable such that multiple participants could use one model during training., Design: The model was prepared by embedding a firm foam thoracic spine replica with bilateral attached ribs into an opaque gelatin mixture. Once solidified, a preselected area was excised on each side, such that the model could be easily refilled with new gelatin blocks for use by each participant. This allowed for multiple participants to use the same model while eliminating confusion with prior tract marks., Setting: The Marcia and Eugene Applebaum Simulation Learning Institute, Beaumont Hospital, Royal Oak, MI; a private nonprofit tertiary care hospital associated with the OUWB School of Medicine, Rochester, MI., Participants: Fifty-two medical students and general surgery residents underwent a 30-minute didactic session on ultrasound technique for catheter placement followed by practice on the gelatin model., Results: The texture and echogenicity of the model were subjectively comparable to those of tissue in vivo and the osseous elements of the spine in the model were clearly identified using ultrasound. The exchangeable catheter placement area provided an efficient and effective method to test accurate performance in catheter placement by multiple users. Participants increased their confidence in the use of ultrasound for this procedure., Conclusions: To date, this is the first gelatin thoracic spine-rib model that has been used to teach ultrasound-guided catheter insertion into the paravertebral space, with removable testing areas that can be used by multiple users. This model can provide an inexpensive training tool that can be used in a surgical simulation setting., (Copyright © 2018 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.)

Aims: Our aims were to develop a training system for camera assistants (CA), and evaluate participants' performance as CA., Methods: A questionnaire on essential requirements to be a good CA was administered to experts in pediatric endoscopic surgery. An infant-sized box trainer with several markers and lines inside was developed. Participants performed marker capturing and line-tracing tasks using a 5-mm 30° scope. A postexperimental questionnaire on the developed system was administered. The task completion time was measured., Results: The 5-point evaluation scale was used for each item in the questionnaire survey of experts. The abilities to maintain a horizontal line (mean score: 4.5) and to center the target in a specified rectangle on the monitor (4.5) as well as having a full understanding of the operative procedure (4.3) were ranked as highly important. Fifty-two participants, including 5 surgical residents, were enrolled in the evaluation experiment. The completion time of capturing the markers was significantly longer in the resident group than in the nonresident group (244 versus 124 seconds, P = .04), but that of tracing the lines was not significantly different between the groups. The postexperimental questionnaire showed that the participants felt that the line-tracing tasks (3.7) were more difficult than marker-capturing tasks (2.9)., Conclusions: Being proficient in manipulating a camera and having adequate knowledge of operative procedures are essential requirements to be a good CA. The ability was different between the resident and nonresident groups even in a simple task such as marker capturing.

Objective: A fundamental aspect of surgical planning in liver resections is the identification of key vessel tributaries to preserve healthy liver tissue while fully resecting the tumor(s). Current surgical planning relies primarily on the surgeon's ability to mentally reconstruct 2D computed tomography/magnetic resonance (CT/MR) images into 3D and plan resection margins. This creates significant cognitive load, especially for trainees, as it relies on image interpretation, anatomical and surgical knowledge, experience, and spatial sense. The purpose of this study is to determine if 3D reconstruction of preoperative CT/MR images will assist resident-level trainees in making appropriate operative plans for liver resection surgery., Design: Ten preoperative patient CT/MR images were selected. Images were case-matched, 5 to 2D planning and 5 to 3D planning. Images from the 3D group were segmented to create interactive digital models that the resident can manipulate to view the tumor(s) in relation to landmark hepatic structures. Residents were asked to evaluate the images and devise a surgical resection plan for each image. The resident alternated between 2D and 3D planning, in a randomly generated order. The primary outcome was the accuracy of resident's plan compared to expert opinion. Time to devise each surgical plan was the secondary outcome. Residents completed a prestudy and poststudy questionnaire regarding their experience with liver surgery and the 3D planning software., Setting and Participants: Senior level surgical residents from the Queen's University General Surgery residency program were recruited to participate., Results: A total of 14 residents participated in the study. The median correct response rate was 2 of 5 (40%; range: 0-4) for the 2D group, and 3 of 5 (60%; range: 1-5) for the 3D group (p < 0.01). The average time to complete each plan was 156 ± 107 seconds for the 2D group, and 84 ± 73 seconds for the 3D group (p < 0.01). A total 13 of 14 residents found the 3D model easier to use than the 2D. Most residents noticed a difference between the 2 modalities and found that the 3D model improved their confidence with the surgical plan proposed., Conclusions: The results of this study show that 3D reconstruction for liver surgery planning increases accuracy of resident surgical planning and decreases amount of time required. 3D reconstruction would be a useful model for improving trainee understanding of liver anatomy and surgical resection, and would serve as an adjunct to current 2D planning methods. This has the potential to be developed into a module for teaching liver surgery in a competency-based medical curriculum., (Copyright © 2017 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.)

Background: Technical limitations of minimally invasive surgery challenge both surgeons and camera assistants. Current research indicates that visual-spatial ability (VSA) has impact on learning of laparoscopic camera navigation (LCN). However, it remains unclear if complexity of LCN tasks influences the impact of VSA. The aim of this study was to examine the influence of VSA on LCN training within tasks of different complexity levels., Methods: The present study was conducted as a monocentric prospective trial. VSA was assessed with a cube comparison test before participants underwent LCN training. LCN training consisted of three tasks with increasing complexity. Each task was performed four times and performance was assessed each time. Correlations and multivariate regression analysis were used to assess the influence of VSA on LCN skills., Results: Seventy-one participants were included (35 males). Significant performance improvement and faster completion times were observed from the first to fourth trial of all three LCN training tasks. Significant positive correlations between VSA and performance on LCN task 3 were found (performance: r s  = 0.47; p < 0.001, time: r s  = -0.43; p < 0.001). Multivariate regression revealed that higher VSA resulted in greater reduction of time between the first trials of LCN training task 3 (B = -1.67, p = 0.031)., Conclusion: In the present study, all trainees improved LCN performance during the training. VSA seems to have impact on LCN performance and training progress particularly for complex LCN tasks. The relation of VSA and LCN performance was stronger for less experienced participants and in the beginning of the learning phase.

Purpose: To investigate how experience in simulated cataract surgery impacts and transfers to the learning curves for novices in vitreoretinal surgery., Methods: Twelve ophthalmology residents without previous experience in intraocular surgery were randomized to (1) intensive training in cataract surgery on a virtual-reality simulator until passing a test with predefined validity evidence (cataract trainees) or to (2) no cataract surgery training (novices). Possible skill transfer was assessed using a test consisting of all 11 vitreoretinal modules on the EyeSi virtual-reality simulator. All participants repeated the test of vitreoretinal surgical skills until their performance curve plateaued. Three experienced vitreoretinal surgeons also performed the test to establish validity evidence. Analysis with independent samples t-tests was performed., Results: The vitreoretinal test on the EyeSi simulator demonstrated evidence of validity, given statistically significant differences in mean test scores for the first repetition; experienced surgeons scored higher than novices (p = 0.023) and cataract trainees (p = 0.003). Internal consistency for the 11 modules of the test was acceptable (Cronbach's α = 0.73). Our findings did not indicate a transfer effect with no significant differences found between cataract trainees and novices in their starting scores (mean ± SD 381 ± 129 points versus 455 ± 82 points, p = 0.262), time to reach maximum performance level (10.7 ± 3.0 hr versus 8.7 ± 2.8 hr, p = 0.265), or maximum scores (785 ± 162 points versus 805 ± 73 points, p = 0.791)., Conclusion: Pretraining in cataract surgery did not demonstrate any measurable effect on vitreoretinal procedural performance. The results of this study indicate that we should not anticipate extensive transfer of surgical skills when planning training programmes in intraocular surgery., (© 2017 Acta Ophthalmologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.)

Background: The societies of thoracic surgery are working to incorporate simulation and competency-based assessment into specialty training. One challenge is the development of a simulation-based test, which can be used as an assessment tool. The study objective was to establish validity evidence for a virtual reality simulator test of a video-assisted thoracoscopic surgery (VATS) lobectomy of a right upper lobe., Methods: Participants with varying experience in VATS lobectomy were included. They were familiarized with a virtual reality simulator (LapSim ® ) and introduced to the steps of the procedure for a VATS right upper lobe lobectomy. The participants performed two VATS lobectomies on the simulator with a 5-min break between attempts. Nineteen pre-defined simulator metrics were recorded., Results: Fifty-three participants from nine different countries were included. High internal consistency was found for the metrics with Cronbach's alpha coefficient for standardized items of 0.91. Significant test-retest reliability was found for 15 of the metrics (p-values <0.05). Significant correlations between the metrics and the participants VATS lobectomy experience were identified for seven metrics (p-values <0.001), and 10 metrics showed significant differences between novices (0 VATS lobectomies performed) and experienced surgeons (>50 VATS lobectomies performed). A pass/fail level defined as approximately one standard deviation from the mean metric scores for experienced surgeons passed none of the novices (0 % false positives) and failed four of the experienced surgeons (29 % false negatives)., Conclusion: This study is the first to establish validity evidence for a VATS right upper lobe lobectomy virtual reality simulator test. Several simulator metrics demonstrated significant differences between novices and experienced surgeons and pass/fail criteria for the test were set with acceptable consequences. This test can be used as a first step in assessing thoracic surgery trainees' VATS lobectomy competency.

Purpose: To test the validity of the eyesi surgical simulator as an assessment tool in a virtual reality vitreoretinal training programme., Methods: In collaboration with an experienced vitreoretinal surgeon, a virtual vitreoretinal training programme was composed on the eyesi surgical simulator, software version 2.9.2 (VRmagic GmbH, Manheim, Germany). It was completed twice by three groups: 20 medical students, ten residents of ophthalmology and five trained vitreoretinal surgeons. The programme contained six training modules: navigation level 2 (Nav2), forceps training level 5 (ForT5), bimanual training level 3 (BimT3), laser coagulation level 3 (LasC3), posterior hyaloid level 3 (PostH3) and internal limiting membrane peeling level 3 (ILMP3). The scores in each module were assessed from two to five different factors (tissue treatment, efficiency, target achievement, instrument handling and microscope handling), and it was possible to achieve 100 points in each module., Results: At the final training session, the highest overall median score was found for the vitreoretinal surgeons (vitreoretinal surgeons: 434 points, residents: 394.5 points, medical students: 272.5 points, p < 0.01). This was also found in four of the six modules. These were Nav2 (p = 0.03), BimT3 (p < 0.01), PostH3 (p < 0.01) and ILMP3 (p < 0.01). On the other hand, the three groups did not differ regarding ForT5 (p = 0.16) or LasC3 (p = 0.75)., Conclusions: We developed a training programme with validity for the eyesi surgical simulator as an assessment tool for overall score and for four of six vitreoretinal modules. These findings could potentially make the programme a useful tool in the training of future vitreoretinal surgeons., (© 2016 Acta Ophthalmologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.)

Introduction: The development augmented reality devices allow physicians to incorporate data visualization into diagnostic and treatment procedures to improve work efficiency, safety, and cost and to enhance surgical training. However, the awareness of possibilities of augmented reality is generally low. This review evaluates whether augmented reality can presently improve the results of surgical procedures., Methods: We performed a review of available literature dating from 2010 to November 2016 by searching PubMed and Scopus using the terms "augmented reality" and "surgery." Results . The initial search yielded 808 studies. After removing duplicates and including only journal articles, a total of 417 studies were identified. By reading of abstracts, 91 relevant studies were chosen to be included. 11 references were gathered by cross-referencing. A total of 102 studies were included in this review., Conclusions: The present literature suggest an increasing interest of surgeons regarding employing augmented reality into surgery leading to improved safety and efficacy of surgical procedures. Many studies showed that the performance of newly devised augmented reality systems is comparable to traditional techniques. However, several problems need to be addressed before augmented reality is implemented into the routine practice.

Purpose: The integration of swept-source optical coherence tomography (SS-OCT) into the operating microscope enables real-time, tissue-level three-dimensional (3D) imaging to aid in ophthalmic microsurgery. In this prospective randomized controlled study, we evaluated the impact of SS microscope-integrated OCT (MI-OCT) on ophthalmology residents' performance of ophthalmic microsurgical maneuvers., Methods: Fourteen ophthalmology residents from a single institution were stratified by year of training and randomized to perform four anterior segment surgical maneuvers on porcine eyes with (MI-OCT+) or without (MI-OCT-) direct intraoperative OCT guidance. Subsequently, both groups repeated the same maneuvers without MI-OCT feedback to test whether initial MI-OCT experience affected subsequent surgical performance. Finally, the MI-OCT- group was crossed over and allowed to repeat the same maneuvers with direct MI-OCT guidance. Each resident completed a survey at the completion of the study., Results: With direct MI-OCT feedback, residents demonstrated enhanced performance in depth-based anterior segment maneuvers (corneal suture passes at 50% and 90% depth and corneal laceration repair) compared with the residents operating without MI-OCT. Microscope-integrated OCT+ residents continued to outperform the controls when both groups subsequently operated without MI-OCT. For clear corneal wound geometry, there was no statistically significant effect of MI-OCT as applied in this study. Overall, the resident surgeons rated their subjective experience of using MI-OCT very favorably., Conclusions: Microscope-integrated OCT feedback enhances performance of ophthalmology residents in select anterior segment surgical maneuvers. Microscope-integrated OCT represents a valuable tool in the surgical education of ophthalmology residents.

Background: This study was undertaken to introduce and establish the value of the Dundee Endoscopic Psychomotor Otolaryngology Surgery Trainer (DEPOST) as a customisable, objective real-time scoring system for trainee assessment. The construct validity of the system was assessed by comparing the performance of experienced otolaryngologists with that of otolaryngology trainees, junior doctors and medical students., Methods: Forty two subjects (13 Consultants, 8 senior trainees, 13 junior trainees and 8 junior doctors/medical students) completed a single test on DEPOST. The test involved using a 30° rigid endoscope and a probe with position sensor, to identify a series of lights in a complex 3-dimensional model. The system scored subjects for time, success rate, and economy of movement (distance travelled). An analysis of variance and correlation analysis were used for the data analysis, with statistical significance set at 0.05., Results: Increasing experience led to significantly improved performance with the DEPOST (p < 0.01). Senior trainees' results were significantly better than those of consultant otolaryngologists in success rate and time (p < 0.05 & p < 0.05). Consultants were the most efficient in their movement (p = 0.051) CONCLUSIONS: The system provides an accurate and customisable assessment of endoscopic skill in otolaryngologists. The DEPOST system has construct validity, with master surgeons and senior trainees completing the tasks more accurately without sacrificing execution time, success rate or efficiency of movement.

Objective: Endovascular robotics systems, now approved for clinical use in the United States and Europe, are seeing rapid growth in interest. Determining who has sufficient expertise for safe and effective clinical use remains elusive. Our aim was to analyze performance on a robotic platform to determine what defines an expert user., Methods: During three sessions, 21 subjects with a range of endovascular expertise and endovascular robotic experience (novices <2 hours to moderate-extensive experience with >20 hours) performed four tasks on a training model. All participants completed a 2-hour training session on the robot by a certified instructor. Completion times, global rating scores, and motion metrics were collected to assess performance. Electromagnetic tracking was used to capture and to analyze catheter tip motion. Motion analysis was based on derivations of speed and position including spectral arc length and total number of submovements (inversely proportional to proficiency of motion) and duration of submovements (directly proportional to proficiency)., Results: Ninety-eight percent of competent subjects successfully completed the tasks within the given time, whereas 91% of noncompetent subjects were successful. There was no significant difference in completion times between competent and noncompetent users except for the posterior branch (151 s:105 s; P = .01). The competent users had more efficient motion as evidenced by statistically significant differences in the metrics of motion analysis. Users with >20 hours of experience performed significantly better than those newer to the system, independent of prior endovascular experience., Conclusions: This study demonstrates that motion-based metrics can differentiate novice from trained users of flexible robotics systems for basic endovascular tasks. Efficiency of catheter movement, consistency of performance, and learning curves may help identify users who are sufficiently trained for safe clinical use of the system. This work will help identify the learning curve and specific movements that translate to expert robotic navigation., (Copyright © 2015 Society for Vascular Surgery. Published by Elsevier Inc. All rights reserved.)

To evaluate the fidelity of the iDental system and investigate its utility and performance on simulated drilling operations, user studies consisting of objective and subjective evaluations were performed. A voxel-based drilling simulation sub-system in the iDental system was employed for evaluation. Twenty participants were enrolled to take part in the experiments and were divided into two groups: novice and resident. A combined evaluation method including objective and subjective methods was employed. The objective evaluation included two dental drilling tasks: caries removal operation and pulp chamber opening operation. In the subjective method, participants were required to complete a questionnaire to evaluate the fidelity of the system after the operation task. Based on the structured global assessment scales in the questionnaire, the average subjective evaluation scores of the proposed metrics were greater than 4.5, demonstrating that the system operated above medium fidelity. Dentists expressed great interest and positive attitudes toward the potential of the iDental system. The objective evaluation data including time spent and the volume of removed healthy and carious tissue were obtained. Although no significant differences could be found between the two groups, the volume of removed caries and the depth of pulp chamber insertion manifested small standard deviations. Evaluation results illustrated that dentists were willing to use the virtual reality training system. Several future research topics were identified, including increasing the task difficulty, improving the system fidelity and introducing appropriate finger rest points.

Purpose: To establish and evaluate a systematic training programme to be included into the ophthalmologic resident curriculum., Methods: Medical students (n = 20) within a year from graduation and with no previous ophthalmic experience were included in this prospective study and randomized into two groups. Group A (n = 10) completed the Eyesi cataract simulator training programme once a week for 4 weeks, while Group B (n = 10) completed it once a week at the first and the last week. Two cataract surgeons were used to determine two different levels of reference scores. Score per analysed module [two different levels of Capsulorhexis (A and B), Hydromaneuver, Phaco divide and conquer], Overall score, Total time, Cornea injury, Capsule rupture and Capsule damage by ultrasound were recorded., Results: Group A outperformed Group B in several modules, reached a significant higher number of reference scores (p < 0.01) and caused fewer complications with regard to Capsule rupture (p = 0.01) and Capsule damage by ultrasound (p < 0.05). Both Groups A and B improved their performance and also became more time efficient (p < 0.01 for both groups). Group A showed positive learning curves for Overall score (p < 0.01), Capsulorhexis A (p < 0.01), Capsulorhexis B (p < 0.01) and Hydromaneuver (p = 0.01). Group B showed a significant improvement for Overall score (p < 0.01), Hydromaneuver (p = 0.02) and Phaco divide and conquer (p < 0.01)., Conclusion: Repetitive training with a systematic training programme, based on validated modules in the Eyesi simulator, was shown to improve simulated cataract surgery skills. Higher level of skills and more reference scores were reached with more training. Furthermore, the programme was optimized to be applied into the standard ophthalmological curriculum for cataract surgery training., (© 2014 Acta Ophthalmologica Scandinavica Foundation. Published by John Wiley & Sons Ltd.)

Purpose:    Advanced surgical procedures, which have become complex and difficult, increase the burden of surgeons. Quantitative analysis of surgical procedures can improve training, reduce variability, and enable optimization of surgical procedures. To this end, a surgical task analysis system was developed that uses only surgical navigation information., Methods:    Division of the surgical procedure, task progress analysis, and task efficiency analysis were done. First, the procedure was divided into five stages. Second, the operating time and progress rate were recorded to document task progress during specific stages, including the dissecting task. Third, the speed of the surgical instrument motion (mean velocity and acceleration), as well as the size and overlap ratio of the approximate ellipse of the location log data distribution, was computed to estimate the task efficiency during each stage. These analysis methods were evaluated based on experimental validation with two groups of surgeons, i.e., skilled and "other" surgeons. The performance metrics and analytical parameters included incidents during the operation, the surgical environment, and the surgeon's skills or habits., Results:    Comparison of groups revealed that skilled surgeons tended to perform the procedure in less time and involved smaller regions; they also manipulated the surgical instruments more gently., Conclusion:    Surgical task analysis developed for quantitative assessment of surgical procedures and surgical performance may provide practical methods and metrics for objective evaluation of surgical expertise.

Purpose: Training within a proficiency-based virtual reality (VR) curriculum may reduce errors during real surgical procedures. This study used a scientific methodology to develop a VR training curriculum for phacoemulsification surgery (PS)., Patients and Methods: Ten novice-(n) (performed <10 cataract operations), 10 intermediate-(i) (50-200), and 10 experienced-(e) (>500) surgeons were recruited. Construct validity was defined as the ability to differentiate between the three levels of experience, based on the simulator-derived metrics for two abstract modules (four tasks) and three procedural modules (five tasks) on a high-fidelity VR simulator. Proficiency measures were based on the performance of experienced surgeons., Results: Abstract modules demonstrated a 'ceiling effect' with construct validity established between groups (n) and (i) but not between groups (i) and (e)-Forceps 1 (46, 87, and 95; P<0.001). Increasing difficulty of task showed significantly reduced performance in (n) but minimal difference for (i) and (e)-Anti-tremor 4 (0, 51, and 59; P<0.001), Forceps 4 (11, 73, and 94; P<0.001). Procedural modules were found to be construct valid between groups (n) and (i) and between groups (i) and (e)-Lens-cracking (0, 22, and 51; P<0.05) and Phaco-quadrants (16, 53, and 87; P<0.05). This was also the case with Capsulorhexis (0, 19, and 63; P<0.05) with the performance decreasing in the (n) and (i) group but improving in the (e) group (0, 55, and 73; P<0.05) and (0, 48, and 76; P<0.05) as task difficulty increased., Conclusion: Experienced/intermediate benchmark skill levels are defined allowing the development of a proficiency-based VR training curriculum for PS for novices using a structured scientific methodology.

Purpose: To investigate construct validity for modules hydromaneuvers and phaco on the Eyesi surgical simulator., Methods: Seven cataract surgeons and 17 medical students performed capsulorhexis, hydromaneuvers, phaco, navigation, forceps, cracking and chopping modules in a standardized manner. Three trials were performed on each module (two on phaco) in the above order. Performance parameters as calculated by the simulator for each trial were saved. Video recordings of the second trial of the modules capsulorhexis, hydromaneuvers and phaco were evaluated with the modified Objective Structured Assessment of Surgical Skill (OSATS) and Objective Structured Assessment of Cataract Surgical Skill (OSACSS) tools., Results: Cataract surgeons outperformed medical students with regard to overall score on capsulorhexis (p < 0.001, p = 0.035, p = 0.010 for the tree iterations, respectively), navigation (p = 0.024, p = 0.307, p = 0.007), forceps (p = 0.017, p = 0.03, p = 0.028). Less obvious differences in overall score were found for modules cracking and chopping (p = 0.266, p = 0.022, p = 0.324) and phaco (p = 0.011, p = 0.081 for the two iterations, respectively). No differences in overall score were found on hydromaneuvers (p = 0.588, p = 0.503, p = 0.773), but surgeons received better scores from the evaluations of the modified OSATS (p = 0.001) and OSACSS (capsulorhexis, p = 0.003; hydromaneuvers, p = 0.017; phaco, p = 0.001)., Conclusions: Construct validity was found on several modules previously not investigated (phaco, hydromaneuvers, cracking and chopping, navigation), and our results confirm previously demonstrated construct validity for capsulorhexis and forceps modules. Interestingly, validation of the hydromaneuvers module required OSACSS video evaluation tool. A further development of the scoring system in the simulator for the hydromaneuvers module would be advantageous and make training and evaluation of progress more accessible and immediate., (© 2012 The Authors. Acta Ophthalmologica © 2012 Acta Ophthalmologica Scandinavica Foundation.)

Introduction: The hypothesis of this study is that computer-aided navigation experience could improve the ability to better place components in the coronal plane and to improve visual/spatial awareness based on the ability of navigation to provide instant feedback. The purpose of this study is to demonstrate the educational role of the navigation system to obtain a better alignment of the prosthetic components with standard instrumentation after a computer-aided navigation experience., Materials and Methods: One hundred fifty patients were operated by the same surgeon, with more than 5 years experience with TKA. They were equally divided in three groups: group A (operated with non-navigated technique by surgeon without computer-assisted experience); group B (operated with computer-assisted surgery by the same surgeon); group C (operated with non-navigated technique by the same surgeon after the computer-navigated experience). We evaluated by full-length weight-bearing radiographs the overall alignment of the lower limb in the coronal plane. The optimum placement of the components was considered when the angle was within the limits of ±3° varus/valgus on the coronal x-rays. Comparison between groups was done using one-way ANOVA followed by post hoc Bonferroni test and Pearson chi-square statistics for proportions of optimum placement (P<0.05)., Results: In the group A 34 patients (68%) had the optimum placement on the coronal x-rays; in the group B they were 46 (92%) and in the group 41 (82%). The difference is statistically significant in comparing group A and Group B (<0.001), group A and group C (P=0.04), but not for group B and C (P=0.2)., Conclusion: We believe that the navigation system has an educational role to improve the ability of surgeon of positioning prosthetic components precisely in the coronal plane., (Copyright © 2012 Elsevier B.V. All rights reserved.)

Objective: This study aimed to examine the correlation between visuospatial ability, measured with the Perceptual Ability Test (PAT), and da Vinci robot simulator performance on the da Vinci Skills Simulator., Methods: Twenty-five consenting medical students naive to both the PAT and the da Vinci robot completed the PAT and then performed a single simulation (Ring-walk 2) 10 consecutive times. Raw PAT scores were compared with composite simulator scores for all subjects. Participants were divided into those with high and low visuospatial ability based on whether they scored above or below (or equal) to the median on the PAT. We compared the mean composite simulator scores and the time to complete each exercise between the high and the low PAT performers., Results: The mean (SD) raw PAT score (out of 90) was 45.5 (18.3) (median, 43.0). The mean composite simulator score was 65.5 (24.1) (median, 72.2). The high (n = 12) and low (n = 13) PAT performers had a mean (SD) (median) simulator score of 79.1 (9.8) (80.3) and 53.0 (26.7) (65.9), respectively. On average, the high PAT performers scored 26.1 points (95% confidence interval, 9.2-43.0, P = 0.005), or 49.2%, higher on the simulation than the low PAT performers. The high PAT performers completed the exercise in 96.5 seconds (95% confidence interval, 26.0-167.0; P = 0.009), or 36.2%, faster than the low PAT performers., Conclusions: Better visuospatial ability relates to improved performance on a robotic surgery simulator.

Purpose: Development of a visualization system that provides surgical instructors with a method to compare the results of many virtual surgeries (n > 100)., Methods: A masked distance field models the overlap between expert and resident results. Multiple volume displays are used side-by-side with a 2D point display., Results: Performance characteristics were examined by comparing the results of specific residents with those of experts and the entire class., Conclusions: The software provides a promising approach for comparing performance between large groups of residents learning mastoidectomy techniques.

Background: While radical prostatectomy surgeon learning curves have characterized less blood loss, shorter operative times, and fewer positive margins, there is a dearth of studies characterizing learning curves for improving sexual function. Additionally, while learning curve studies often define volume thresholds for improvement, few of these studies demonstrate specific technical modifications that allow reproducibility of improved outcomes., Objective: Demonstrate and quantify the learning curve for improving sexual function outcomes based on technical refinements that reduce neurovascular bundle displacement during nerve-sparing robot-assisted radical prostatectomy (RARP)., Design, Setting, and Participants: We performed a retrospective study of 400 consecutive RARPs, categorized into groups of 50, performed after elimination of continuous surgeon/assistant neurovascular bundle countertraction., Surgical Procedure: Our approach to RARP has been described previously. A single-console robotic system was used for all cases., Outcome Measurements and Statistical Analysis: Expanded Prostate Cancer Index Composite sexual function was measured within 1 yr of RARP. Linear regression was performed to determine factors influencing the recovery of sexual function., Results and Limitations: Greater surgeon experience was associated with better 5-mo sexual function (p = 0.007) and a trend for better 12-mo sexual function (p = 0.061), with improvement plateauing after 250-300 cases. Additionally, younger patient age (both p<0.02) and better preoperative sexual function (<0.001) were associated with better 5- and 12-mo sexual function. Moreover, trainee robotic console time during nerve sparing was associated with worse 12-mo sexual function (p=0.021), while unilateral nerve sparing/non-nerve sparing was associated with worse 5-mo sexual function (p = 0.009). Limitations include the retrospective single-surgeon design., Conclusions: With greater surgeon experience, attenuating lateral displacement of the neurovascular bundle and resultant neurapraxia improve postoperative sexual function. However, to maximize outcomes, appropriate patient selection must be exercised when allowing trainee nerve-sparing involvement., (Copyright © 2012 European Association of Urology. Published by Elsevier B.V. All rights reserved.)

Surgical techniques are becoming more complex and require substantial training to master. The development of automated, objective methods to analyze and evaluate surgical skill is necessary to provide trainees with reliable and accurate feedback during their training programs. We present a system to capture, visualize, and analyze the movements of a laparoscopic surgeon for the purposes of skill evaluation. The system records the upper body movement of the surgeon, the position, and orientation of the instruments, and the force and torque applied to the instruments. An empirical study was conducted using the system to record the performances of a number of surgeons with a wide range of skill. The study validated the usefulness of the system, and demonstrated the accuracy of the measurements.

Objectives/hypothesis: Our group has developed an augmented image guidance system that incorporates intraoperative cone-beam computed tomography (CBCT), virtual or augmented displays, and image registration. We assessed the potential benefits of augmented endoscopy derived from this system for use during skull base navigation. Specifically, we wished to evaluate target localization accuracy and the effect on task workload and confidence., Study Design: Prospective, sequential, paired preclinical trial., Methods: A single cadaver head underwent computed tomography, and critical structures were contoured. The specimen was reimaged after endoscopic dissection and deformable registration allowed contours to be displayed on postablation CBCT imaging. A real-time virtual view including anatomical contours was provided parallel to the real endoscopic image. Twelve subjects were asked to endoscopically localize seven skull base landmarks in a conventional manner. The same exercise was then performed with augmented endoscopy. Precise three-dimensional (3D) localization was recorded with a tracked probe. The NASA task load index was completed after each exercise. A short questionnaire was also administered., Results: The real-time augmented image guidance system aided localization in 85% of responses and increased confidence in 97%. There was a significant reduction in mental demand, effort, and frustration when the technology was employed, with an increase in perceived performance (P < .05). Three dimensional navigational precision was improved for all landmarks., Conclusions: Real-time augmented image-guided surgery increases accuracy and confidence in trainee surgeons and decreases task workload during skull base navigation. This technology shows great promise in assisting in skull base surgery even for experienced surgeons., (Copyright © 2011 The American Laryngological, Rhinological, and Otological Society, Inc.)

Background: The number of robotic-assisted procedures offered in Spain is rapidly increasing despite a lack of consensus criteria for training and credentialling., Objective: This national multicentre study was designed to analyze the different areas of the robotic urological surgery learning curve., Material and Methods: A questionnaire was sent to all 13 urology units in Spain with an active robotics programme requesting information on training and problems encountered., Results: In most centres (n = 11, 84.6%), training programmes were animal-based; cadavers were used at only 2 (15.4%). Proctoring in initial procedures was practiced by 12 groups (92.3%). When initiating the robotics programme, the console was shared at 8 units (61.5%). Prior experience in open and/or laparoscopic surgery was reported by 10 of the groups (76.9%), and experience in open surgery only by 2 (15.4%) or robotic surgery alone by 1 (7.7%). The procedure with which the robotics programme was started in all 13 participating units was radical prostatectomy. The number of cases needed to complete the learning curve for this procedure was 20-25 cases according to 8 (61.5%) surgery teams., Conclusions: Up until March 26, 2010, 1,692 operations, mostly radical prostatectomies, were conducted using the da Vinci robot in our country., (Copyright © 2011 S. Karger AG, Basel.)

Background: Robotic laparoscopic surgery has revolutionized minimally invasive surgery for the treatment of abdominal pathologies. However, current training techniques rely on subjective evaluation. The authors sought to identify objective measures of robotic surgical performance by comparing novices and experts during three training tasks., Methods: Five novices (medical students) were trained in three tasks with the da Vinci Surgical System. Five experts trained in advanced laparoscopy also performed the three tasks. Time to task completion (TTC), total distance traveled (D), speed (S), curvature (kappa), and relative phase (Phi) were measured., Results: Before training, TTC, D, and kappa were significantly smaller for experts than for novices (p < 0.05), whereas S was significantly larger for experts than for novices before training (p < 0.05). Novices performed significantly better after training, as shown by smaller TTC, D, and kappa, and larger S. Novice performance after training approached expert performance., Conclusion: This study clearly demonstrated the ability of objective kinematic measures to distinguish between novice and expert performance and training effects in the performance of robotic surgical training tasks.

One of the most important advantages of computer simulators for surgical training is the opportunity they afford for independent learning. However, if the simulator does not provide useful instructional feedback to the user, this advantage is significantly blunted by the need for an instructor to supervise and tutor the trainee while using the simulator. Thus, the incorporation of relevant, intuitive metrics is essential to the development of efficient simulators. Equally as important is the presentation of such metrics to the user in such a way so as to provide constructive feedback that facilitates independent learning and improvement. This paper presents a number of novel metrics for the automated evaluation of surgical technique. The general approach was to take criteria that are intuitive to surgeons and develop ways to quantify them in a simulator. Although many of the concepts behind these metrics have wide application throughout surgery, they have been implemented specifically in the context of a simulation of mastoidectomy. First, the visuohaptic simulator itself is described, followed by the details of a wide variety of metrics designed to assess the user's performance. We present mechanisms for presenting visualizations and other feedback based on these metrics during a virtual procedure. We further describe a novel performance evaluation console that displays metric-based information during an automated debriefing session. Finally, the results of several user studies are reported, providing some preliminary validation of the simulator, the metrics, and the feedback mechanisms. Several machine learning algorithms, including Hidden Markov Models and a Naïve Bayes Classifier, are applied to our simulator data to automatically differentiate users' expertise levels.

Background: While computer-assisted orthopaedic surgery technology may facilitate performance and learning in the expert, its effects on the trainee are unclear. Motor learning theory suggests that, while the real-time feedback provided by computer-assisted orthopaedic surgery should improve performance, it may be detrimental to learning. The purpose of this study was to assess the effects of computer-assisted orthopaedic surgery on the learning of surgical skills by trainees., Methods: Forty-five participants were randomized to one of three training groups-conventional training, computer navigation, or knowledge of results-in which they learned technical skills related to total hip replacement. Outcomes were assessed in a pretest session and in ten-minute and six-week retention and transfer tests., Results: All groups demonstrated improved accuracy and precision in the determination of the abduction angle and the version angle of the acetabular cups during training (p < 0.001). The computer navigation group demonstrated significantly better accuracy and precision in early training (p < 0.05) and better precision throughout training (p < 0.05). No significant degradation in performance was observed between the immediate and the delayed testing for any group, suggesting that there was task learning in all groups with no negative effects of the tested training modalities on learning., Conclusions: In this study, the concurrent augmented feedback provided by computer-assisted orthopaedic surgery resulted in improved early performance and equivalent learning. While we did not observe a compromise in learning, further investigation is required to ensure that computer-assisted orthopaedic surgery does not compromise trainee learning in more complex tasks.

Background: Surgical skills are required by a wide range of health care professionals. Tasks range from simple wound closure to highly complex diagnostic and therapeutic procedures. Technical expertise, although essential, is only one component of a complex picture. By emphasising the importance of knowledge and attitudes, this article aims to locate the acquisition of surgical skills within a wider educational framework., Simulators: Simulators can provide safe, realistic learning environments for repeated practice, underpinned by feedback and objective metrics of performance. Using a simple classification of simulators into model-based, computer-based or hybrid, this paper summarises the current state of the art and describes recent technological developments. Advances in computing have led to the establishment of precision placement and simple manipulation simulators within health care education, while complex manipulation and integrated procedure simulators are still in the development phase., Evaluation: Tension often exists between the design and evaluation of surgical simulations. A lack of high quality published data is compounded by the difficulties of conducting longitudinal studies in such a fast-moving field. The implications of this tension are discussed., The Wider Context: The emphasis is now shifting from the technology of simulation towards partnership with education and clinical practice. This highlights the need for an integrated learning framework, where knowledge can be acquired alongside technical skills and not in isolation from them. Recent work on situated learning underlines the potential for simulation to feed into and enrich everyday clinical practice.