Search

Effective self-assessment is a cornerstone of lifelong professional development; however, evidence suggests physicians have a limited ability to self-assess. Novel strategies to improve the accuracy of learner self-assessment are needed. Our institution's surgical entrustable professional activity (EPA) implementation strategy incorporates resident self-assessment to address this issue. This study evaluates the accuracy of resident self-assessment versus faculty assessment across 5 EPAs in general surgery.Within a single academic general surgery residency program, assessment data for 5 surgery EPAs was prospectively collected using a mobile application. Matched assessments (resident and faculty assessments for the same clinical encounter) were identified and the remainder excluded. Assessment scores were compared using Welch's t test. Agreement was analyzed using Cohen's kappa with squared weights.One thousand eight hundred and fifty-seven EPA assessments were collected in 17 months following implementation. One thousand one hundred and fifty-five (62.2%) were matched pairs. Residents under-rated their own performance relative to faculty assessments (2.36 vs 2.65, p0.01). This pattern held true for all subsets except for Postgraduate Year (PGY)2 residents and Inguinal Hernia EPAs. There was at least moderate agreement between matched resident and faculty EPA assessment scores (κ = 0.57). This was consistent for all EPAs except Trauma evaluations, which were completed by faculty from 2 different departments. Surgery resident self-assessments more strongly agreed with Surgery faculty assessments than Emergency Medicine faculty assessments (κ = 0.58 vs 0.36).Resident EPA self-assessments are equivalent or slightly lower than faculty assessments across a wide breadth of clinical scenarios. Resident and faculty matched assessments demonstrate moderate agreement.

OBJECTIVE To obtain a legal understanding of the “key” or “critical” portions of an operation, pertaining to attending supervision, resident autonomy, and patient safety. DESIGN Snowball sampling, a subset of purposive sampling, was used to develop a population of 47 risk managers and legal counsel, who were given an online, qualitative questionnaire. Interpretive description was used to analyze qualitative data. Individual responses were coded with simultaneous categorization and assessment of underlying relationships. SETTING Online, qualitative questionnaire. PARTICIPANTS Hospital risk managers and legal counsel from across the United States. RESULTS Overall, 25 of 47 (53%) risk managers completed the survey. Qualitative responses could be organized into 3 major themes (1) variation in the definition of “key” or “critical” portions of an operation, (2) differing expectations of attending supervision and resident autonomy, and (3) the need for clear communication and trust among attendings, residents, and patients. CONCLUSIONS Among risk managers, the primary liaisons between surgeons and patients in malpractice litigation, there is widespread variation in understanding the “key” and “critical” portions of an operation and the dynamic between appropriate attending supervision and resident autonomy. Better collaboration and transparency between surgeons and legal experts are required to facilitate a shared mental model regarding attending supervision and resident autonomy.

Toolkits to assess progressive resident autonomy are integral to the movement toward competency-based surgical education. OpTrust is one such tool validated for intraoperative assessment of both faculty and resident entrustment behaviors. We developed a supplementary tool to OpTrust that would aid faculty and residents in making meaningful improvements in entrustment behavior by providing talking points and reflection items tailored to different motivational styles as defined by Regulatory Focus Theory (RFT).Existing literature about surgical entrustment was used to build a list of sample dialogue and self-reflection items to use in the operating room. This list was distributed as a survey to individuals familiar with OpTrust and RFT, asking them to categorize each item as Promotion-oriented, Prevention-oriented, or Either. The respondents then met to discuss survey items that did not reach a consensus until the group agreed on their categorization.University of Wisconsin, School of Medicine and Public Health, Madison, Wisconsin Michigan Medicine, Ann Arbor, Michigan PARTICIPANTS: Clinician and education researchers familiar with intraoperative entrustment and RFT RESULTS: Eight respondents completed the survey categorizing the talking points and reflection items by RFT (100% response rate). Six of these respondents attended the additional meeting to discuss discordant items. The input from this panel was used to develop "TrustEd," the supplementary tool that faculty and residents can quickly reference before beginning a case.Although tools such as OpTrust allow intraoperative entrustment behaviors to be quantified, TrustEd offers concrete strategies for faculty and residents who are interested in improving those behaviors over time. Further study is needed to assess whether the use of TrustEd does in fact lead to durable behavior change and improvement in OpTrust scores.

Entrustable Professional Activities are a holistic assessment framework developed in the Netherlands in 2005, which have recently been adopted in undergraduate medical education in the United States. As part of an increased focus on competency-based assessment, the specialty of pediatrics has led the way in incorporating them into graduate medical education. We describe the development and initial pilot process of implementation of EPAs into the assessment of General Surgery trainees.

Objective The Public Service Loan Forgiveness (PSLF) program is an option to trainees to help alleviate federal education debt. The prevalence of PSLF utilization and how this may impact career decisions of trainees is unknown. The purpose of this study was to understand the prevalence, impact, and understanding of PSLF participation on trainees. Design IRB-approved anonymous survey asking study subjects to report demographics, financial status, and reliance on PSLF. In addition, study subjects were asked to report their participation in PSLF, the possible impact of PSLF participation on career decisions, and to identify the qualifications needed to complete PSLF. Setting Online anonymous survey. Participants The survey was offered to all physician trainees in all specialties at the University of Texas, Southwestern, University of Wisconsin, Madison, and University of Michigan, Ann Arbor. Results There were 934 respondents, yielding a 37.6% response rate. A total of 416/934 (44.5%) respondents were actively or planning on participating in the PSLF program with 175/934 (18.7%) belonging to a surgical specialty. Those belonging to a surgical specialty were more likely to be PSLF participants compared to medical specialties (53.1% versus 42.6%, p = 0.01). For those participating in PSLF, 82/416 (19.7%) stated this participation impacted career decisions. A total of 275/934 (29.4%) respondents obtained and 437/934 (46.8%) wanted to receive formal training/lectures in regards to the PSLF program. Of those actively or planning on participating in the PSLF program, only 58/416 (13.9%) were able to correctly identify all of the qualifications/criteria to complete the program. Conclusions A large proportion of trainees rely on the PSLF program for education loan forgiveness with approximately 20% reporting participation impacted career decisions. Additionally, the majority may not fully understand PSLF criteria. Programs should strongly consider providing a formal education regarding PSLF to their trainees.

The reported influence of Accreditation Council for Graduate Medical Education resident duty hour limitations on operative case volume has been mixed. Additional restrictions instituted in July 2011 further limited the work hours of postgraduate year 1 (PGY-1) residents, threatening to reduce availability for educational and operative activities. In this study, we evaluate our novel intern call schedule, which we hypothesized would preserve operative experience despite these increased restrictions.A retrospective analysis of PGY-1 operative reports was conducted. Operations outside of major case categories were excluded. Operative case volumes in the Section of General Surgery for the same period were analyzed, as were average duty hours for each resident. Comparative statistics were generated using Wilcoxon rank sum tests.Single-institution study conducted at the University of Michigan, a tertiary-care academic hospital.Overall, 50 categorical general surgery residents from 2005 to present were included. Three residents were subsequently excluded as they were preliminary interns rather than categorical; 2 residents were excluded having completed their intern years at other institutions.The median number of major cases done during the PGY-1 for all evaluated residents was 89 (interquartile range [IQR]: 72-101). For interns between the years 2005 and 2011, the median number of major cases was 87 (IQR: 73-101), whereas interns in the 2011 to 2013 academic years performed 91.5 (IQR: 69.5-101.5, p = 0.91). Although case volume varied between intern classes, no significant differences were observed between any 2 individual classes in the study. Analysis of annual case volumes among each PGY revealed a relative increase of 29% (p0.001) among PGY-2 residents, and 20% (p = 0.02) by PGY-3 residents. Relative increases among senior residents (8% for both PGY-4 and PGY-5) did not reach statistical significance.Our novel call schedule attempts to minimize prolonged night-float coverage responsibilities for interns in hopes of preserving their operative experience. In spite of increased duty hour restrictions, PGY-1 operative volume has not decreased significantly at our institution. However, in the same time period, PGY-2 and PGY-3 case volume has increased. Our findings highlight the challenges faced by surgical residencies in light of these new restrictions, particularly the 16-hour limit. Additional rigorously designed prospective studies should be conducted to better understand the influence of the most recent Accreditation Council for Graduate Medical Education work hour limitations on the subjective and objective experiences of surgical residents.

Objectives To meet the Accreditation Council for Graduate Medical Education core competency in Practice-Based Learning and Improvement, educational curricula need to address training in quality improvement (QI). We sought to establish a program to train residents in the principles of QI and to provide practical experiences in developing and implementing improvement projects. Design We present a novel approach for engaging students, residents, and faculty in QI efforts—Team Action Projects in Surgery (TAPS). Setting Large academic medical center and health system. Participants Multiple teams consisting of undergraduate students, medical students, surgery residents, and surgery faculty were assembled and QI projects developed. Using “managing to learn” Lean principles, these multilevel groups approached each project with robust data collection, development of an A3, and implementation of QI activities. Results A total of 5 resident led QI projects were developed during the TAPS pilot phase. These included a living kidney donor enhanced recovery protocol, consult improvement process, venous thromboembolism prophylaxis optimization, Clostridium difficile treatment standardization, and understanding variation in operative duration of laparoscopic cholecystectomy. Qualitative and quantitative assessment showed significant value for both the learner and stakeholders of QI related projects. Conclusion Through the development of TAPS, we demonstrate a novel approach to addressing the increasing focus on QI within graduate medical education. Efforts to expand this multilevel team based approach would have value for teachers and learners alike.