Search

IMPORTANCE: Minimally invasive esophagectomy (MIE) is a complex procedure with substantial learning curves. In other complex minimally invasive procedures, suboptimal surgical performance has convincingly been associated with less favorable patient outcomes as assessed by peer review of the surgical procedure. OBJECTIVE: To develop and validate a procedure-specific competency assessment tool (CAT) for MIE. DESIGN, SETTING, AND PARTICIPANTS: In this international quality improvement study, a procedure-specific MIE-CAT was developed and validated. The MIE-CAT contains 8 procedural phases, and 4 quality components per phase are scored with a Likert scale ranging from 1 to 4. For evaluation of the MIE-CAT, intraoperative MIE videos performed by a single surgical team in the Esophageal Center East Netherlands were peer reviewed by 18 independent international MIE experts (with more than 120 MIEs performed). Each video was assessed by 2 or 3 blinded experts to evaluate feasibility, content validity, reliability, and construct validity. MIE-CAT version 2 was composed with refined content aimed at improving interrater reliability. A total of 32 full-length MIE videos from patients who underwent MIE between 2011 and 2020 were analyzed. Data were analyzed from January 2021 to January 2023. EXPOSURE: Performance assessment of transthoracic MIE with an intrathoracic anastomosis. MAIN OUTCOMES AND MEASURES: Feasibility, content validity, interrater and intrarater reliability, and construct validity, including correlations with both experience of the surgical team and clinical parameters, of the developed MIE-CAT. RESULTS: Experts found the MIE-CAT easy to understand and easy to use to grade surgical performance. The MIE-CAT demonstrated good intrarater reliability (range of intraclass correlation coefficients [ICCs], 0.807 [95% CI, 0.656 to 0.892] for quality component score to 0.898 [95% CI, 0.846 to 0.932] for phase score). Interrater reliability was moderate (range of ICCs, 0.536 [95% CI, −0.220 to 0.994] for total MIE-CAT score to 0.705 [95% CI, 0.473 to 0.846] for quality component score), and most discrepancies originated in the lymphadenectomy phases. Hypothesis testing for construct validity showed more than 75% of hypotheses correct: MIE-CAT performance scores correlated with experience of the surgical team (r = 0.288 to 0.622), blood loss (r = −0.034 to −0.545), operative time (r = −0.309 to −0.611), intraoperative complications (r = −0.052 to −0.319), and severe postoperative complications (r = −0.207 to −0.395). MIE-CAT version 2 increased usability. Interrater reliability improved but remained moderate (range of ICCs, 0.666 to 0.743), and most discrepancies between raters remained in the lymphadenectomy phases. CONCLUSIONS AND RELEVANCE: The MIE-CAT was developed and its feasibility, content validity, reliability, and construct validity were demonstrated. By providing insight into surgical performance of MIE, the MIE-CAT might be used for clinical, training, and research purposes.

IMPORTANCE: Understanding the learning curve of a new complex surgical technique helps to reduce potential patient harm. Current series on the learning curve of minimally invasive distal pancreatectomy (MIDP) are mostly small, single-center series, thus providing limited data. OBJECTIVE: To evaluate the length of pooled learning curves of MIDP in experienced centers. DESIGN, SETTING, AND PARTICIPANTS: This international, multicenter, retrospective cohort study included MIDP procedures performed from January 1, 2006, through June 30, 2019, in 26 European centers from 8 countries that each performed more than 15 distal pancreatectomies annually, with an overall experience exceeding 50 MIDP procedures. Consecutive patients who underwent elective laparoscopic or robotic distal pancreatectomy for all indications were included. Data were analyzed between September 1, 2021, and May 1, 2022. EXPOSURES: The learning curve for MIDP was estimated by pooling data from all centers. MAIN OUTCOMES AND MEASURES: The learning curve was assessed for the primary textbook outcome (TBO), which is a composite measure that reflects optimal outcome, and for surgical mastery. Generalized additive models and a 2-piece linear model with a break point were used to estimate the learning curve length of MIDP. Case mix–expected probabilities were plotted and compared with observed outcomes to assess the association of changing case mix with outcomes. The learning curve also was assessed for the secondary outcomes of operation time, intraoperative blood loss, conversion to open rate, and postoperative pancreatic fistula grade B/C. RESULTS: From a total of 2610 MIDP procedures, the learning curve analysis was conducted on 2041 procedures (mean [SD] patient age, 58 [15.3] years; among 2040 with reported sex, 1249 were female [61.2%] and 791 male [38.8%]). The 2-piece model showed an increase and eventually a break point for TBO at 85 procedures (95% CI, 13-157 procedures), with a plateau TBO rate at 70%. The learning-associated loss of TBO rate was estimated at 3.3%. For conversion, a break point was estimated at 40 procedures (95% CI, 11-68 procedures); for operation time, at 56 procedures (95% CI, 35-77 procedures); and for intraoperative blood loss, at 71 procedures (95% CI, 28-114 procedures). For postoperative pancreatic fistula, no break point could be estimated. CONCLUSION AND RELEVANCE: In experienced international centers, the learning curve length of MIDP for TBO was considerable with 85 procedures. These findings suggest that although learning curves for conversion, operation time, and intraoperative blood loss are completed earlier, extensive experience may be needed to master the learning curve of MIDP.