Search

Background: The aim of this study was to analyze learning curves and competency gains of novice vascular trainees when performing open aortic repair in a simulation-based environment., Methods: This was a prospective study of 16 vascular trainees performing infrarenal open aortic repair on an inanimate abdominal aortic aneurysm simulator with pulsatile pressure and flow. Each participant performed 4 procedures as a primary surgeon while getting structured feedback by a supervising experienced vascular surgeon. All sessions were video recorded and were anonymously and independently assessed by 3 rater-trained experts on an online platform using the newly validated open abdominal aortic aneurysm repair of technical expertise assessment tool. All supervisor interferences and procedure time was noted., Results: Reliability between raters was excellent (intraclass correlation coefficient = 0.92). Participants' mean scores almost doubled during the course between the first (13.4, 95% confidence interval [CI], 6.8-20) and fourth session (29.8, 95% CI, 26.3-33.3) with a mean difference of 14.6 (P < 0.001). Supervisor interference also decreased significantly from mean 3.0 (95% CI, 1.5-3.6) in the first to 0.7 (95% CI, 0.4-1.0) in the fourth session (P = 0.004). Procedure time decreased with a mean of 24 minutes: from 81 min (95% CI, 71.8-90.3) to 57 min (95% CI, 51.1-63.2, P < 0.001). There was a significant negative correlation between procedure time and the Open Abdominal Aortic Aneurysm Repair of Technical Expertise score (Pearson's r = -0.72, P < 0.01). Only half of the participants passed the pass/fail score of 27.7 points during the course., Conclusions: Novice vascular trainees achieve skills and competencies in open aortic repair in a simulated setting with dedicated supervision and feedback and can become ready for supervised surgery on real patients. Learning rates are individual, and it is important to construct training programs with emphasis on proficiency and not merely attending a course., (Copyright © 2020. Published by Elsevier Inc.)

Objective: The aims of this study were to develop a procedure specific assessment tool for open abdominal aortic aneurysm (AAA) repair, gather validity evidence for the tool and establish a pass/fail standard., Methods: Validity was studied based on the contemporary framework by Messick. Three vascular surgeons experienced in open AAA repair and an expert in assessment and validation within medical education developed the OPEn aortic aneurysm Repair Assessment of Technical Expertise (OPERATE) tool. Vascular surgeons with varying experiences performed open AAA repair in a standardised simulation based setting. All procedures were video recorded with the faces anonymised and scored independently by three experts in a mutual blinded setup. The Angoff standard setting method was used to establish a credible pass/fail score., Results: Sixteen novices and nine experienced open vascular surgeons were enrolled. The OPERATE tool achieved high internal consistency (Cronbach's alpha .92) and inter-rater reliability (Cronbach's alpha .95) and was able to differentiate novices and experienced surgeons with mean scores (higher score is better) of 13.4 ± 12 and 25.6 ± 6, respectively (p = .01). The pass/fail score was set high (27.7). One novice passed the test while six experienced surgeons failed., Conclusion: Validity evidence was established for the newly developed OPERATE tool and was able to differentiate between novices and experienced surgeons providing a good argument that this tool can be used for both formative and summative assessment in a simulation based environment. The high pass/fail score emphasises the need for novices to train in a simulation based environment up to a certain level of competency before apprenticeship training in the clinical environment under the tutelage of a supervisor. Familiarisation with the simulation equipment must be ensured before performance is assessed as reflected by the low scores in the experienced group's first attempt., (Copyright © 2020 European Society for Vascular Surgery. Published by Elsevier B.V. All rights reserved.)

Objectives: The aims of this study were to investigate the validity evidence for a novel procedure specific assessment tool of competence in endovascular aortic repair (EVAR) and to establish a pass/fail level for the assessment., Methods: Computed tomography angiography data of a 55 mm in diameter infrarenal aortic aneurysm was implemented into an endovascular simulator. Twenty-three physicians with varying EVAR experiences were video-recorded when performing a standard EVAR procedure on the simulator. Two experienced EVAR operators assessed the participants using the novel rating scale, "EndoVascular Aortic Repair Assessment of Technical Expertise" (EVARATE). Validity was studied according to the framework endorsed by the American Educational Research Association., Results: The EVARATE scale had a high internal consistency (Cronbach's alpha = .90). The inter-rater reliability was acceptable (Intraclass Correlation Coefficient = .68, p = .005). Specific EVAR experience correlated significantly with the EVARATE score (Spearman's rho = .62, p = .002), but general endovascular experience did not. Consequence analysis showed that the EVARATE assessment could distinguish novices from intermediates (p < .01) and from experts (p < .001). A pass/fail score was determined using the contrasting groups' method., Conclusion: This paper presents the initial validity evidence for a novel procedure specific assessment tool, EVARATE, for operator competence in endovascular aortic repair investigated in a simulated setting. The assessment tool can be used to provide structured formative feedback to trainees., (Copyright © 2018 European Society for Vascular Surgery. Published by Elsevier B.V. All rights reserved.)