Search

Background: It is unknown whether traditional medical education ensures competence among fellows in the key skill of breaking bad news (BBN). While simulation-based mastery learning (SBML) has been used to train fourth-year medical students (M4s) in BBN, it is unclear if it adds similar value for fellows. Objective: We examined the effect of traditional medical training on BBN skills by comparing baseline fellow and M4 skills and confidence and assessed the impact of a BBN SBML curriculum for fellows. Methods: Fellows training in six programs at Northwestern University from November 2018 to May 2019 were eligible for inclusion. Fellows completed a BBN SBML curriculum including a pretest, individualized feedback using a previously published assessment tool, and ongoing deliberate practice until all achieved a minimum passing standard (MPS). The primary outcomes were checklist and scaled item scores on the assessment tool. Fellow performance was compared to a historical M4 cohort. Results: Twenty-eight of 38 eligible fellows completed the curriculum and were included for analysis. Fellows reported significantly more experience and confidence in BBN compared to M4s, yet their pre-training performance was significantly worse on checklist (57.1% vs 65.0%, P = .02) and scaled items; only 4% reached the MPS. After training, fellow performance significantly improved on checklist (57.1% to 92.6%, SD = 5.2%, P < .001) and scaled items; all reached the MPS. Conclusions: Despite higher confidence and BBN clinical experience, fellows performed worse than untrained M4s, confirming that experience is not a proxy for skill. Programs must develop competency-based assessments to ensure entrustment of communication skills.

OBJECTIVES Difficult intravenous (IV) access (DIVA) is a prevalent condition in the hospital setting and increases utilization of midline catheters (MCs) and peripherally inserted central catheters (PICCs). Ultrasound-guided peripheral intravenous (USGPIV) insertion is effective at establishing intravenous access in DIVA but remains understudied in the inpatient setting. We evaluated the effect of an USGPIV simulation-based mastery learning (SBML) curriculum for nurses on MC and PICC utilization for hospitalized patients. METHODS We performed a quasi-experimental observational study. We trained nurses across all inpatient units at a large tertiary care hospital. We queried the electronic medical record to compare PICC and MC utilization for patients with DIVA during 3 periods: before USGPIV SBML training (control), during pilot testing of the intervention, and during the SBML intervention. To account for variations in insertion practices over time, we performed an interrupted time series (ITS) analysis between 2 periods, the combined control and pilot periods and the intervention period. RESULTS One hundred forty-eight nurses completed USGPIV SBML training. Midline catheters inserted monthly per 1000 patient-days for DIVA decreased significantly from 1.86 ± 0.51 (control) to 2.31 ± 0.28 (pilot) to 1.33 ± 0.51 (intervention; P = 0.001). The ITS analysis indicated a significant intervention effect (P < 0.001). Peripherally inserted central catheters inserted monthly per 1000 patient-days for DIVA also significantly decreased over the study periods; however, the ITS failed to show an intervention effect as PICC insertions were already decreasing during the control period. CONCLUSIONS A hospital-wide USGPIV SBML curriculum for inpatient nurses was associated with a significant reduction in MCs inserted for DIVA.

Background Ventricular assist device simulation-based mastery learning (SBML) results in better patient and caregiver self-care skills compared with usual training. Objective The aim of this study was to evaluate the effect of SBML on driveline exit site infections. Methods We compared the probability of remaining infection free at 3 and 12 months between patients randomized to SBML or usual training. Results The SBML-training group had no infections at 3 months and 2 infections at 12 months, yielding a Kaplan-Meier estimate of the probability of remaining infection free of 0.857 (95% confidence interval [CI], 0.692-1.00) at 12 months. The usual-training group had 6 infections at 3 months with no additional infections by 12 months. Kaplan-Meier estimates of remaining infection free at 3 and 12 months were 0.878 (95% CI, 0.758-1.00) and 0.748 (95% CI, 0.591-0.946), respectively. Time-to-infection distributions for SBML versus usual training showed a difference in 12-month infection rates of 0.109 (P = .07). Conclusions Ventricular assist device self-care SBML resulted in fewer 12-month infections.

Background The American Board of Psychiatry and Neurology and the Accreditation Council for Graduate Medical Education (ACGME) developed Milestones that provide a framework for residents' assessment. However, Milestones do not provide a description for how programs should perform assessments. Objectives We evaluated graduating residents' status epilepticus (SE) identification and management skills and how they correlate with ACGME Milestones reported for epilepsy and management/treatment by their program's clinical competency committee (CCC). Methods We performed a cohort study of graduating neurology residents from 3 academic medical centers in Chicago in 2018. We evaluated residents' skills identifying and managing SE using a simulation-based assessment (26-item checklist). Simulation-based assessment scores were compared to experience (number of SE cases each resident reported identifying and managing during residency), self-confidence in identifying and managing these cases, and their end of residency Milestones assigned by a CCC based on end-of-rotation evaluations. Results Sixteen of 21 (76%) eligible residents participated in the study. Average SE checklist score was 15.6 of 26 checklist items correct (60%, SD 12.2%). There were no significant correlations between resident checklist performance and experience or self-confidence. The average participant's level of Milestone for epilepsy and management/treatment was high at 4.3 of 5 (SD 0.4) and 4.4 of 5 (SD 0.4), respectively. There were no significant associations between checklist skills performance and level of Milestone assigned. Conclusions Simulated SE skills performance of graduating neurology residents was poor. Our study suggests that end-of-rotation evaluations alone are inadequate for assigning Milestones for high-stakes clinical skills such as identification and management of SE.

Background The US Medical Licensing Examination (USMLE) Step 1 and Step 2 scores are often used to inform a variety of secondary medical career decisions, such as residency selection, despite the lack of validity evidence supporting their use in these contexts. Objective We compared USMLE scores between non–chief residents (non-CRs) and chief residents (CRs), selected based on performance during training, at a US academic medical center that sponsors a variety of graduate medical education programs. Methods This was a retrospective cohort study of residents' USMLE Step 1 and Step 2 Clinical Knowledge (CK) scores from 2015 to 2020. The authors used archived data to compare USMLE Step 1 and Step 2 CK scores between non-CR residents in each of the eligible programs and their CRs during the 6-year study period. Results Thirteen programs enrolled a total of 1334 non-CRs and 211 CRs over the study period. There were no significant differences overall between non-CRs and CRs average USMLE Step 1 (239.81 ± 14.35 versus 240.86 ± 14.31; P = .32) or Step 2 scores (251.06 ± 13.80 versus 252.51 ± 14.21; P = .16). Conclusions There was no link between USMLE Step 1 and Step 2 CK scores and CR selection across multiple clinical specialties over a 6-year period. Reliance on USMLE Step 1 and 2 scores to predict success in residency as measured by CR selection is not recommended.

Background Medical procedures are traditionally taught informally at patients' bedside through observation and practice using the adage "see one, do one, teach one." This lack of formalized training can cause trainees to be unprepared to perform procedures independently. Simulation based education (SBE) increases competence, reduces complications, and decreases costs. We developed, implemented, and evaluated the efficacy of a right heart catheterization (RHC) SBE curriculum. Methods The RHC curriculum consisted of a pretest, video didactics, deliberate practice, and a posttest. Pre-and posttest skills examinations consisted of a dichotomous 43-item checklist on RHC skills and a 14-item hemodynamic waveform quiz. We enrolled two groups of fellows: 6 first-year, novice cardiology fellows at Northwestern University in their first month of training, and 11 second- and third-year fellows who had completed traditional required, level I training in RHC. We trained the first-year fellows at the beginning of the 2018-2019 year using the SBE curriculum and compared them to the traditionally-trained cardiology fellows who did not complete SBE. Results The SBE-trained fellows significantly improved RHC skills, hemodynamic knowledge, and confidence from pre- to posttesting. SBE-trained fellows performed similarly to traditionally-trained fellows on simulated RHC skills checklists (88.4% correct vs. 89.2%, p = .84), hemodynamic quizzes (94.0% correct vs. 86.4%, p = .12), and confidence (79.4 vs. 85.9 out of 100, p = .15) despite less clinical experience. Conclusions A SBE curriculum for RHC allowed novice cardiology fellows to achieve level I skills and knowledge at the beginning of fellowship and can train cardiology fellows before patient contact.

PURPOSE Infusing continuity of care into medical student clerkships may accelerate professional development, preserve patient-centered attitudes, and improve primary care training. However, prospective, randomized studies of longitudinal curricula are lacking. METHOD All entering Northwestern University Feinberg School of Medicine students in 2015 and 2016 were randomized to the Education Centered Medical Home (ECMH), a 4-year, team-based primary care clerkship; or a mentored individual preceptorship (IP) for 2 years followed by a traditional 4-week primary care clerkship. Students were surveyed 4 times (baseline, M1, M2, and M3 year [through 2018]); surveys included the Maslach Burnout Inventory (MBI); the Communication, Curriculum, and Culture (C3) survey assessing the hidden curriculum; and the Attitudes Toward Health Care Teams (ATHCT) scale. The authors analyzed results using an intent-to-treat approach. RESULTS Three hundred twenty-nine students were randomized; 316 (96%) participated in surveys. Seventy percent of all respondents would recommend the ECMH to incoming first-year students. ECMH students reported a more positive learning environment (overall quality, 4.4 ECMH vs 4.0 IP, P < .001), greater team-centered attitudes (ATHCT scale, 3.2 vs 3.0, P = .007), less exposure to negative aspects of the hidden curriculum (C3 scale, 4.6 vs 4.3, P < .001), and comparable medical knowledge acquisition. ECMH students established more continuity relationships with patients (2.2 vs 0.3, P < .001) and reported significantly higher professional efficacy (MBI-PE, 4.1 vs 3.9, P = .02). CONCLUSIONS In this randomized medical education trial, the ECMH provided superior primary care training across multiple outcomes compared with a traditional clerkship-based model, including improved professional efficacy.

PURPOSE It is challenging to add rigorous, competency-based communication skills training to existing clerkship structures. The authors embedded a simulation-based mastery learning (SBML) curriculum into a medicine subinternship to demonstrate feasibility and determine the impact on the foundational skill of breaking bad news (BBN). METHOD All fourth-year students enrolled in a medicine subinternship at Northwestern University Feinberg School of Medicine from September 2017 through August 2018 were expected to complete a BBN SBML curriculum. First, students completed a pretest with a standardized patient using a previously developed BBN assessment tool. Learners then participated in a 4-hour BBN skills workshop with didactic instruction, focused feedback, and deliberate practice with simulated patients. Students were required to meet or exceed a predetermined minimum passing standard (MPS) at posttest. The authors compared pretest and posttest scores to evaluate the effect of the intervention. Participant demographic characteristics and course evaluations were also collected. RESULTS Eighty-five students were eligible for the study, and 79 (93%) completed all components. Although 55/79 (70%) reported having personally delivered serious news to actual patients, baseline performance was poor. Students' overall checklist performance significantly improved from a mean of 65.0% (SD = 16.2%) items correct to 94.2% (SD = 5.9%; P < .001) correct. There was also statistically significant improvement in scaled items assessing quality of communication, and all students achieved the MPS at mastery posttest. All students stated they would recommend the workshop to colleagues. CONCLUSIONS It is feasible to embed SBML into a required clerkship. In the context of this study, rigorous SBML resulted in uniformly high levels of skill acquisition, documented competency, and was positively received by learners.

Difficult intravenous (IV) access (DIVA) is a prevalent condition in the hospital setting and increases utilization of midline catheters (MCs) and peripherally inserted central catheters (PICCs). Ultrasound-guided peripheral intravenous (USGPIV) insertion is effective at establishing intravenous access in DIVA but remains understudied in the inpatient setting. We evaluated the effect of an USGPIV simulation-based mastery learning (SBML) curriculum for nurses on MC and PICC utilization for hospitalized patients.We performed a quasi-experimental observational study. We trained nurses across all inpatient units at a large tertiary care hospital. We queried the electronic medical record to compare PICC and MC utilization for patients with DIVA during 3 periods: before USGPIV SBML training (control), during pilot testing of the intervention, and during the SBML intervention. To account for variations in insertion practices over time, we performed an interrupted time series (ITS) analysis between 2 periods, the combined control and pilot periods and the intervention period.One hundred forty-eight nurses completed USGPIV SBML training. Midline catheters inserted monthly per 1000 patient-days for DIVA decreased significantly from 1.86 ± 0.51 (control) to 2.31 ± 0.28 (pilot) to 1.33 ± 0.51 (intervention; P = 0.001). The ITS analysis indicated a significant intervention effect (P0.001). Peripherally inserted central catheters inserted monthly per 1000 patient-days for DIVA also significantly decreased over the study periods; however, the ITS failed to show an intervention effect as PICC insertions were already decreasing during the control period.A hospital-wide USGPIV SBML curriculum for inpatient nurses was associated with a significant reduction in MCs inserted for DIVA.

Background Patients who undergo ventricular assist device (VAD) implantation and their caregivers must rapidly learn a significant amount of self-care skills and knowledge. Objective The aim of this study was to explore patient, caregiver, VAD coordinator, and physician perspectives and perceptions of existing VAD self-care training to inform development of a simulation-based mastery learning (SBML) curriculum to teach patients and caregivers VAD self-care skills and knowledge. Methods We conducted semistructured, in-person interviews with patients with a VAD, their caregivers, VAD coordinators, and physicians (cardiac surgeons, an infectious disease physician, and advanced heart failure cardiologists). We used a 2-cycle team-based iterative inductive approach to coding and analysis. Results We interviewed 16 patients, 12 caregivers, 7 VAD coordinators, and 11 physicians. Seven major themes were derived from the interviews including (1) identification of critical curricular content, (2) need for standardization and assessment, (3) training modalities, (4) benefits of repetition, (5) piercing it all together, (6) need for refresher training, and (7) provision of training before implant. Conclusions Findings from this study suggest that SBML is a natural fit for the high-risk tasks needed to save VAD self-care. The 7 unique training-related themes derived from the qualitative data informed the design and development of a VAD SBML self-care curriculum.

Mastery learning is a form of competency-based education in which learning time varies but outcomes are uniform. Trainees must meet a minimum passing standard (MPS) before completing a mastery learning curriculum. The objective of this study was to establish a curriculum for fall risk and gait assessment for medical students, determine an MPS for a fall risk and gait assessment clinical skills examination (CSE), and apply the MPS to a sample of medical students completing a fall risk and gait assessment CSE. Medical students completed an interactive session about fall risk and gait assessment including the Timed Up and Go (TUG) test and completed deliberate practice with 3 patients. Skills were evaluated using an 18-item skills checklist. A panel of clinical experts set the MPS at 82%. Eighty-seven medical students participated. The average score on the checklist was 14.7 of 18 (81.4%.) Although almost all performed the TUG correctly, only 61% met the MPS for the checklist. Our results suggest that a mastery learning approach may better prepare the 39% of students that did not meet MPS to complete a fall risk and gait assessment.

Background We developed a simulation-based mastery learning (SBML) curriculum that boosted self-care skills for patients with a ventricular assist device (VAD). In this study, we evaluated short-term skills retention. Method We assessed skill retention among patients and caregivers who participated in VAD self-care SBML at a tertiary care center. We compared discharge skills tests (immediately after completing SBML) with 1- and 3-month follow-up tests to assess skill retention. Results Fifteen patients and 15 caregivers completed discharge and follow-up testing. Skills were largely retained at 1 and 3 months. Conclusions SBML results in short-term retention of VAD self-care skills.

To develop and evaluate a post-acute care simulation-based mastery learning (SBML) continuing medical education (CME)/maintenance of certification (MOC) procedure course.Pretest-posttest study of the SBML intervention.A 2-day post-acute care procedures course.Sixteen practicing clinicians (5 physicians,11 advanced practice providers). Participants engaged in a skills pretest on knee aspiration/injection, gastrostomy tube removal/replacement, tracheostomy tube exchange, and basic suturing using a checklist created for each procedure. Participants received a didactic on each procedure followed by deliberate practice with feedback. Using the same checklists, participants completed a skills posttest and were required to meet a minimum passing standard (MPS) to obtain CME/MOC credit.The MPS for each skills checklist was determined by a multidisciplinary panel of 11 experts. Participants completed surveys on procedure self-confidence and a course evaluation.There was statistically significant improvement between pre- and posttests for all four procedures (An SBML training course granting CME/MOC credit for post-acute care providers significantly improves performance of knee aspiration/injection, gastrostomy tube removal/replacement, tracheostomy tube exchange, and basic suturing.

BACKGROUND: Longitudinal clerkships provide students with meaningful clinical care roles that promote learning and professional development. It remains unclear how longitudinal primary care clerkships inform students’ perceptions of primary care. OBJECTIVE: To explore perceptions of primary care among medical students enrolled in longitudinal primary care clerkships. DESIGN: Qualitative, semi-structured interviews with medical students over 4 years. PARTICIPANTS: Thirty-eight medical students participated at baseline; 35 participated in a 2-year follow-up interview; 24 participated at 4 years. Each student was enrolled in one of two longitudinal primary care clerkships: a team-based Education-Centered Medical Home (ECMH) or a one-on-one individual preceptorship (IP). APPROACH: De-identified interview transcripts were analyzed using a process of open and axial coding, followed by elaborative coding for longitudinal analysis. Codes were compiled into a set of themes and compared across time periods and between clerkships. KEY RESULTS: Students reported that primary care serves as a first point of contact, emphasizing longitudinal care with a wide scope of practice and approaching patient care with a biopsychosocial perspective. Student perceptions of primary care greatly expanded over the course of 4 years: for instance, initial perceptions of primary care physicians evolved from “passive gatekeeper” to a more nuanced “quarterback.” Students in ECMH, whose clerkship provided more opportunity for patient continuity, further reflected on the relationships they themselves developed with patients. CONCLUSIONS: Regardless of their eventual specialty choice, longitudinal experiences may aid all students in fostering a sense of the broad scope and importance of primary care. However, without numerous opportunities to witness continuity of care, students may perceive primary care as having limited scope and importance. Longitudinal clerkships, emphasizing continuity with patients and preceptors, may foster in students a broad and nuanced perspective of the scope of primary care as a field. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s11606-021-06914-2.

Introduction Resident physicians are expected to acquire competence at central venous catheter (CVC) insertion to a mastery standard. Valid competence decisions about resident physicians' CVC performance rely on reliable data and rigorous achievement standards. This study used data from 3 CVC simulation-based mastery learning studies involving internal medicine (IM) and emergency medicine (EM) residents to address 2 questions: What is the effectiveness of a CVC mastery learning education intervention? Are minimum passing standards (MPSs) set by faculty supported by item response theory (IRT) analyses? Methods Pretraining and posttraining skills checklist data were drawn from 3 simulation-based mastery learning research reports about CVC internal jugular (IJ) and subclavian (SC) insertion skill acquisition. Residents were required to meet or exceed a posttest skills MPS. Generalized linear mixed effect models compared checklist performance from pre to postintervention. Minimum passing standards were determined by Angoff and Hofstee standard setting methods. Item response theory models were used for cut-score evaluation. Results Internal medicine and EM residents improved significantly on every IJ and SC checklist item after mastery learning. Item response theory analyses support the IJ and SC MPSs. Conclusions Mastery learning is an effective education intervention to achieve clinical skill acquisition among IM and EM residents. Item response theory analyses reveal desirable measurement properties for the MPSs previously set by expert faculty panels. Item response theory analysis is useful for evaluating standards for mastery learning interventions. The CVC mastery learning curriculum, reliable outcome data, and high achievement standards together contribute to reaching valid decisions about the competence of resident physicians to perform the clinical procedure.

In current circumstances one rightfully wonders if persistence of SARS-Cov-2 will fundamentally alter the landscape of medical education and hospital training. Absent a vaccine, the prevalence of this virus adds to annual respiratory illnesses caused by seasonal influenza, respiratory syncytial virus, rhinoviruses, and other coronaviruses. Faced with a looming new-normal, many educators are ruminating on how best to ensure rigorous medical training that produces a steady stream of competent physicians. By way of background, the umbrella of medical education covers a highly structured curriculum in a variety of pre-clinical and clinical environments whose architecture and requirements are set by the Liaison Committee for Medical Education (LCME) ( 1 ) and the Accreditation Council for Graduate Medical Education (ACGME) ( 2 ). These requirements reflect established habits for producing quality outcomes. Capricious changes to these requirements can alter the carat of each uncut gem matriculating to medical school. And for this reason, students follow inviolate course work to their doctorate. Graduates can apply for state licensure to become physicians after receiving accredited training as interns and residents. Only later when seen serving a public good are physicians fully vested professionals. Such training can last 7-10 years. Modern training encompasses a well-thought-out system of educational milestones …

Background Underrepresented minority (URM) trainees face unique challenges in academic medicine. Near-peer mentorship is an under-described method to support URM trainees. Objective We created and evaluated the Student to Resident Institutional Vehicle for Excellence (STRIVE) program in a large urban medical school and associated residency programs. Methods All URM residents were invited to participate in the STRIVE mentorship program consisting of 3 pillars of programming: medical school curriculum review sessions, panel discussions, and social events for medical students. The program was evaluated through participation rates and a 7-item survey delivered in May 2019 after 3 years of implementation. Results The STRIVE initiative conducted 25 events. Thirty-five of 151 eligible (23%) URM residents participated as mentors for an average of 50 of 110 eligible (45%) URM medical students annually. Resident mentors participated for an average of 3 to 4 hours each year. Twenty of 32 eligible resident mentors (63%) completed the survey. Ninety-five percent (19 of 20) of survey respondents agreed that STRIVE made them a better mentor; 90% (18 of 20) reported that they would have appreciated an equivalent program during their medical school training; and 75% (15 of 20) agreed that the program helped them address the challenges of underrepresentation in medicine. Conclusions Over a 3-year period, STRIVE required a modest amount of resident time and was valued by the URM residents and medical students who participated in the program.

Defensible minimum passing standards (MPSs) must be used to evaluate learner performance outcomes in health professions education. In this study, the authors compared the results of traditional Angoff and Hofstee standard-setting exercises with the Mastery Angoff and Patient-Safety approaches for central venous catheter (CVC) insertion skills examinations. The authors also evaluated how these standards affected the historical performance of residents who participated in a simulation-based mastery learning (SBML) curriculum for CVC insertion skills.In April and May 2015, 12 physicians with expertise in CVC insertion set MPSs for previously published internal jugular (IJ) and subclavian (SC) CVC insertion checklists using Angoff, Hofstee, Mastery Angoff, and Patient-Safety approaches. The resulting MPSs were compared using historical performance of internal medicine and emergency medicine residents who participated in CVC insertion SBML.The MPSs were set as follows: Angoff: IJ 91% checklist items correct, SC 90%. Hofstee: IJ 88%, SC 90%. Mastery Angoff: IJ 98%, SC 98%. Patient-Safety: IJ 98%, SC 98%. Based on the historical performance of 143 residents assessed on IJ and SC insertion, applying the 98% MPS would result in additional practice and retesting of 55/123 residents (45%) who had previously passed the IJ examination and 36/130 residents (28%) who had passed the SC examination using the Angoff and Hofstee MPSs.The Mastery Angoff and Patient-Safety standard-setting approaches resulted in higher CVC insertion SBML MPSs compared with traditional standard-setting methods. Further study should assess the impact of these more rigorous standards on patient outcomes.

Phenomenon: Teaching patient-centered care (PCC) is a key component of undergraduate medical curricula. Prior frameworks of PCC describe multiple domains of patient-centeredness, ranging from interpersonal encounters to systems-level issues. Medical students' perceptions of PCC are thought to erode as they progress through school, but little is known about how students view PCC toward the beginning of training. This study explores the perceptions of PCC among 1st-year medical students to inform curricular development and evaluation. Approach: Medical students participated in semistructured, in-person interviews within 4 months of starting medical school as part of a longitudinal study. Transcripts were analyzed using a grounded theory approach and the constant comparative method to describe responses and characterize emergent themes. Transcripts were reviewed to compare codes and compile a final codebook. Findings: Thirty-eight students completed interviews. Students provided heterogeneous definitions of PCC, including perceptions that PCC is implicit and obvious. Many students were unable to provide a concrete definition of PCC, juxtaposing PCC with other priorities such as profit- or physician-centered care, whereas others thought the term was jargon. Some participants defined PCC as upholding patient values using hypothetical examples centered around physician behavior. Insights: Although students appeared to enter medical school with a range of perceptions about PCC, many of their descriptions were limited and only scratch the surface of existing frameworks. Rather than their perceptions of PCC eroding during medical school, students may never fully develop a foundational understanding of PCC. Our findings reinforce the need for authentic, clinically experiential learning opportunities that promote PCC from the earliest stages of medical education.

Physicians-in-training often perform bedside thoracenteses in academic medical centers, and complications are more common among less experienced clinicians. Simulation-based mastery learning (SBML) is one potential solution to this problem. This study evaluated the effects of a randomized trial of thoracentesis SBML on patient complications: iatrogenic pneumothorax (IP), hemothorax, and reexpansion pulmonary edema (REPE).The authors randomized internal medicine residents to undergo thoracentesis SBML at a tertiary care academic center from December 2012 to May 2016. They subsequently compared thoracentesis complications from procedures performed by SBML-trained residents, traditionally trained residents (no simulation training), and those referred to pulmonary medicine or interventional radiology (IR).During the study period, 917 thoracenteses were performed on 709 patients. IP occurred in 60 (6.5%) procedures, of which 7 (11.6%) were clinically meaningful. SBML-trained residents performed procedures with a trend toward lower combined clinically meaningful complications (IP, hemothorax, REPE) compared with traditionally trained residents (7.9% vs. 0%; P = .06). SBML-trained residents caused fewer clinically meaningful IPs compared with traditionally trained residents, pulmonary, and IR referrals (P = .02). Hemothorax occurred after 4 (0.4%) thoracenteses, and SBML-trained residents had a trend toward lower hemothorax (0) compared with other groups (P = .07). REPE occurred after 3 (0.3%) procedures, with no differences between groups. SBML-trained residents performed procedures with lower combined clinically meaningful complications compared with other groups (P = .008).Residents randomized to an SBML intervention performed thoracenteses with low rates of clinically meaningful complications. Rigorous education represents a successful quality improvement strategy.

Problem:Ultrasound-guided peripheral intravenous catheter (USGPIV) insertion is an effective method to gain vascular access in patients with difficult intravenous access (DIVA). While USGPIV success rates are reported to be high, some studies have reported a concerning incidence of USGPIV premature failures.Aims:The purpose of this study was to compare differences in USGPIV and landmark peripheral intravenous catheter (PIV) utilization and failure following a hospital-wide USGPIV training program for nurses.Methods:The authors performed a retrospective, electronic medical record review of all USGPIVs and PIVs inserted at a tertiary, urban, academic medical center from September 1, 2018, through September 30, 2019. The primary outcome was differences between USGPIV and PIV time to failure.Results:A total of 43,470 short peripheral intravenous catheters (PIVCs) were inserted in 23,713 patients. Of these, 7972 (16.8%) were USGPIV. At 30 days of follow-up, for PIVCs with an indication for removal documented, USGPIVs had higher Kaplan–Meier survival probabilities than PIVs ( p Conclusions:The use of simulation-based mastery associated with USGPIVs, demonstrated lower failure rates than standard PIVs after 2 days and USGPIVs exhibited improved survival rates in patients with DIVA. These findings suggest that rigorous simulation-based insertion training demonstrates improved USGPIV survival when compared to traditional PIVCs. SBML is an extremely useful tool to ensure appropriately trained clinicians acquire the necessary knowledge and skillset to improve USGPIV outcomes.

Objectives The aim of this study is to determine whether simulation-based education (SBE) translates into reduced procedure time, radiation, and contrast use in actual clinical care. Background As a high volume procedure often performed by novice cardiology fellows, diagnostic coronary angiography represents an excellent target for SBE. Reports of SBE in interventional cardiology are limited and there is little understanding of the potential downstream clinical impact of these interventions. Methods All diagnostic coronary angiograms performed at a single center between January 1, 2011 and June 30, 2015 were analyzed. Random effects linear regression models were used to compare outcomes between procedures performed by 12 cardiology fellows who underwent simulation-based training and those performed by 20 traditionally trained fellows. Results Thirty-two cardiology fellows performed 2,783 diagnostic coronary angiograms. Procedures performed by fellows trained with SBE were shorter (mean of 23.98 min vs. 24.94 min, P = 0.034) and were performed with decreased radiation (mean of 56,348 mGycm2 vs. 66,120 mGycm2, P

Chief residents (CRs) are selected based on interpersonal skills, medical knowledge, and clinical performance; however, they must adapt to their leadership role by taking on administrative tasks, resolving conflicts, and assisting underperforming residents. The Northwestern University McGaw Medical Center identified training area deficiencies and created a one-day curriculum that addressed the role of the CR, conflict resolution and negotiation, managing trainees with clinical/professional deficiencies, supporting trainees in distress, improving program morale, and navigating the Accreditation Council for Graduate Medical Education requirements. A total of 43 CRs participated in the 2016 Leadership Skills Retreat; surveys identified an improvement in reported self-confidence across all content areas.

Purpose Patients implanted with a ventricular assist device (VAD) and their caregivers must learn self-care skills to help prevent complications. We created a VAD self-care simulation-based mastery learning (SBML) curriculum and evaluated the retention of VAD self-care skills between SBML and traditionally-trained patients and caregivers. Methods From June 2017 to February 2019, patients and their caregivers at a tertiary care VAD center were randomized to SBML or traditional-training during their implant hospitalization. SBML consisted of participants taking a pretest on 3 VAD self-care skills (controller, power source, and driveline dressing changes), watching videos, and performing deliberate practice on a VAD simulator. SBML participants took the 3 skills tests again before discharge and were required to meet or exceed a minimum passing score for each skill. The traditionally-trained group received the existing institutional VAD self-care teaching and took the 3 VAD self-care skills tests before discharge. Subsequently, the SBML group was retested at 1 and 3 months after discharge and the traditionally-trained group was retested 3 months after discharge. Results 15 patients and 15 caregivers in the SBML group and 16 patients and 16 caregivers in the traditionally-trained group completed the study (Table). There were no differences in demographic and clinical information between groups. There were no significant differences between discharge test performance and 1 and 3 month follow-up performance within the SBML group. The SBML group significantly outperformed the traditionally-trained group at 3 months on all 3 skills tests (all p Conclusion VAD self-care SBML resulted in skills retention up to 3 months after discharge. Traditional VAD training resulted in sustained low levels of VAD self-care skills that did not improve after living with a VAD for 3 months. SBML is an effective method to train patients and caregivers on VAD self-care skills.

A rigorous education intervention cannot succeed without well-planned implementation and careful ongoing management. Specific steps needed to achieve education and translational science goals include (a) planning for mastery learning, (b) pilot testing, (c) implementation, and (d) continuous management. Successful mastery learning programs rely on numerous resources. Planning for implementation includes obtaining resources such as space, time, supplies, equipment, and faculty. Pilot testing ensures that scenarios and assessment tools are refined and accurate. Implementation requires highly engaged faculty and learners who complete rigorous deliberate practice with individualized performance feedback. During outcome assessment, predetermined outcome measures are evaluated. Finally, ongoing management is necessary for mastery learning programs that may undergo periodic revision based on feedback and reaching education and clinical outcomes. When planning for dissemination, understanding culture, setting, and the downstream collateral impact of a mastery learning program is critical.

Healthcare providers demonstrate wide variability in their skill at performing medical procedures safely. Objective measures of clinical skills are rarely used in making high-stakes personnel decisions. Hospitals and other privileging, licensing, and credentialing bodies use aggregate number systems to determine if individual healthcare providers are safe and ready to perform clinical procedures. However, many studies show that neither clinical experience (number of procedures performed) nor provider self-confidence correlate with actual procedural skill. Simulation-based mastery learning (SBML) can be used to ensure that individual healthcare providers are competent to perform invasive procedures. In this chapter, we discuss how SBML has been used to boost bedside procedural skills. Specifically, we describe how SBML curricula were developed using the Thomas and Kern framework for bedside procedural skills including thoracentesis, paracentesis, central venous catheter (CVC) insertion, and CVC maintenance. We also review how translational science outcomes are used to provide validity evidence about the effectiveness of these curricula.

This opening chapter is an indictment of traditional clinical education in the health professions. Traditional clinical education in the health professions is not effective to achieve goals of skill acquisition, use, and maintenance by individuals or teams. The chapter argues from evidence that the time honored “see one, do one, teach one” approach to clinical education—the so-called apprenticeship model—for doctors, nurses, and other health professionals is obsolete. Introductory framing remarks and an example of medical education featuring mastery learning compared to traditional medical education are followed by three chapter sections: (a) historical origins of clinical education; (b) current state-of-affairs in clinical education including uneven educational opportunities, learner evaluation and feedback, and clinical practice outcomes; and (c) new directions for clinical education, namely, the learning sciences, active learning, deliberate practice, reliable measurement with feedback, and mastery learning.

This chapter addresses the key education policy consequences that derive from implementation and management of mastery learning programs in the health professions. The chapter begins with framing statements about mastery learning policy consequences taken from two scholarly reports. It proceeds to discuss the benefits and challenges of mastery learning education policies regarding four stakeholder entities: learners, education programs, sponsoring organizations, and governing bodies and the healthcare system. A brief coda provides a chapter summary.

This concluding chapter of Mastery Learning in Health Professions Education addresses two mastery learning centers of interest—opportunities and challenges. Six opportunities are discussed: (a) expand mastery learning curricula to include a broader range of skills training in medicine, nursing, and other health professions; (b) spread mastery learning curricula into patient education and education for family members and patient caregivers; (c) develop and test mastery learning curricula to better address training of clinical team skills; (d) widen education models where one’s peers and other professionals serve as teachers and assessors; (e) enlarge mastery learning domains to cover a much wider range of non-technical clinical skills; and (f) improve the quality, impact, and reporting of mastery learning research. Seven challenges are then presented: (a) assessment of complex clinical problems; (b) achievement of adaptive competencies in patient care; (c) the limits of mastery learning; (d) evaluation apprehension; (e) cultural and organizational questions; (f) mastery learning in the context of new and emerging technologies; and (g) in the USA, a lack of federal funding for mastery learning health professions education research. We hope this chapter will inspire other health professions educators to adopt and improve the mastery learning model in service of their learners and patients.

This chapter presents a business case for simulation-based mastery learning (SBML). SBML projects in medical education often yield downstream return on investment (ROI) which can be calculated using the Phillips ROI model. The Phillips ROI model first involves performing a business alignment needs assessment, determining the cost of an identified problem, and assessing how SBML can be a solution. Subsequently, the ROI model evaluates both inputs (cost) and outputs (outcomes) to ensure that institutions receive maximum effect from improvement initiatives. The chapter has four sections: (a) description of the Phillips ROI methodology, (b) an example of use of the ROI model with SBML, (c) additional examples of ROI, and (d) stakeholder engagement: convincing the C-suite. The chapter concludes with a brief coda.

Medical education has gradually shifted toward a competency-based approach over the past decade. To comply with expectations of accrediting bodies, medical educators have been asked to demonstrate that graduating students and residents are competent to advance to the next phase of training. However, traditional clinical skills evaluations are subjective and often based on one-on-one interactions with supervising faculty members. Additional concerns have been raised about uneven clinical experiences leading to variable clinical skill acquisition among graduates. Mastery learning curricula allow medical schools and GME programs to document clinical skill acquisition with high reliability and make valid decisions about trainee competency. In this chapter, we discuss historical standard setting methods used in health professions education and set a path forward for fair, reasonable, and evidence-based standard setting in mastery learning environments.

Background: No recognized standards exist for teaching patients and their caregivers ventricular assist device (VAD) self-care skills. We compared the effectiveness of a VAD simulation-based mastery learning (SBML) self-care training curriculum with usual VAD self-care training. Methods and Results: VAD patients and their caregivers were randomized to SBML or usual training during their implant hospitalization. The SBML group completed a pretest on 3 VAD self-care skills (controller, power source, and dressing change), then viewed videos and participated in deliberate practice on a simulator. SBML participants took a posttest and were required to meet or exceed a minimum passing standard for each of the skills. The usual training group completed the existing institutional VAD self-care teaching protocol. Before hospital discharge, the SBML and usual training groups took the same 3 VAD self-care skills tests. We compared demographic and clinical information, self-confidence, total participant training time, and skills performance between groups. Forty participants completed the study in each group. There were no differences in demographic and clinical information, self-confidence, or training time between groups. More participants in the SBML group met the minimum passing standard compared with the usual training group for controller (37/40 [93%] versus 25/40 [63%]; P =0.001), power source (36/40 [90%] versus 9/40 [23%]; P P Conclusions: SBML provided superior VAD self-care skills learning outcomes compared with usual training. This study has important implications for patients due to the morbidity and mortality associated with improper VAD self-care. Clinical Trial Registration: URL: http://www.clinicaltrials.gov . Unique identifier: NCT03073005.

Central venous catheter insertions may lead to preventable adverse events. Attending physicians' central venous catheter insertion skills are not assessed routinely. We aimed to compare attending physicians' simulated central venous catheterinsertion performance to published competency standards.Prospective cohort study of attending physicians' simulated internal jugular and subclavian central venous catheter insertion skills versus a historical comparison group of residents who participated in simulation training.Fifty-eight Veterans Affairs Medical Centers from February 2014 to December 2014 during a 2-day simulation-based education curriculum and two academic medical centers in Chicago.A total of 108 experienced attending physicians and 143 internal medicine and emergency medicine residents.None.Using a previously published central venous catheter insertion skills checklist, we compared Veterans Affairs Medical Centers attending physicians' simulated central venous catheter insertion performance to the same simulated performance by internal medicine and emergency medicine residents from two academic centers. Attending physician performance was compared to residents' baseline and posttest (after simulation training) performance. Minimum passing scores were set previously by an expert panel. Attending physicians performed higher on the internal jugular (median, 75.86% items correct; interquartile range, 68.97-86.21) and subclavian (median, 83.00%; interquartile range, 59.00-86.21) assessments compared to residents' internal jugular (median, 37.04% items correct; interquartile range, 22.22-68.97) and subclavian (median, 33.33%; interquartile range, 0.00-70.37; both p0.001) baseline assessments. Overall simulated performance was poor because only 12 of 67 attending physicians (17.9%) met or exceeded the minimum passing score for internal jugular central venous catheter insertion and only 11 of 47 (23.4%) met or exceeded the minimum passing score for subclavian central venous catheter insertion. Resident posttest performance after simulation training was significantly higher than attending physician performance (internal jugular: median, 96%; interquartile range, 93.10-100.00; subclavian: median, 100%; interquartile range, 96.00-100.00; both p0.001).This study demonstrates highly variable simulated central venous catheter insertion performance among a national cohort of experienced attending physicians. Hospitals, healthcare systems, and governing bodies should recognize that even experienced physicians require periodic clinical skill assessment and retraining.

OBJECTIVE:To evaluate the association of a forceps simulation training curriculum for obstetrics residents on rates of severe perineal lacerations after forceps deliveries.METHODS:This was a retrospective cohort study. We created a novel simulation curriculum for forceps-assisted vaginal delivery ba

Internal medicine (IM) residents and hospitalist physicians commonly perform thoracenteses. National data show that thoracenteses are also frequently referred to other services such as interventional radiology (IR), increasing healthcare costs. Simulation-based mastery learning (SBML) is an effective method to boost physicians' procedural skills and self-confidence. This study aimed to (1) assess the effect of SBML on IM residents' simulated thoracentesis skills and (2) compare thoracentesis referral patterns, self-confidence, and reasons for referral between traditionally trained residents (non-SBML-trained), SBML-trained residents, and hospitalist physicians. A random sample of 112 IM residents at an academic medical center completed thoracentesis SBML from December 2012 to May 2015. We surveyed physicians caring for hospitalized patients with thoracenteses during the same time period and compared referral patterns, self-confidence, and reasons for referral. SBML-trained resident thoracentesis skills improved from a median of 57.6% (interquartile range [IQR] 43.3-76.9) at pretest to 96.2% (IQR 96.2-100.0) at post-test (P < 0.001). Surveys demonstrated that traditionally trained residents were more likely to refer to IR and cited lower confidence as reasons. SBML-trained residents were more likely to perform bedside thoracenteses. Hospitalist physicians were most likely to refer to pulmonary medicine and cited lack of time to perform the procedure as the main reason. SBML-trained residents were most confident about their thoracentesis skills, despite hospitalist physicians having more experience. This study identifies confidence and time as reasons physicians refer thoracenteses rather than perform them at the bedside. Thoracentesis SBML boosts skills and promotes bedside procedures that are safe and less expensive than referrals. Journal of Hospital Medicine 2016;11:792-795. © 2016 Society of Hospital Medicine.

A 3-day simulation-based capstone course was developed and pilot tested for a cohort of graduating medical students to assess their readiness for residency. The intervention taught and assessed individual performance on specific components of the 13 core entrustable professional activities (EPAs) that all medical school graduates should perform independently. Two 6-station clinical skills examinations (CSE) were developed to assess performance before and after a simulation-based educational intervention. Graduating medical students could not reliably perform selected EPAs at baseline. However, a focused 3-day simulation-based capstone experience produced significant improvement in core clinical skills.

Curriculum development in medical education should follow a planned, systematic approach fitted to the needs and conditions of a local institutional environment and its learners. This article describes the development and maintenance of a simulation-based medical education curriculum on advanced cardiac life support skills and its transformation to a mastery learning program. Curriculum development used the Kern 6-step model involving problem identification and general needs assessment, targeted needs assessment, goals and objectives, educational strategies, implementation, and evaluation and feedback. Curriculum maintenance and enhancement and dissemination are also addressed. Transformation of the simulation-based medical education curriculum to a mastery learning program was accomplished after a 2-year phase-in trial. A series of studies spanning 11 years was performed to adjust the curriculum, improve checklist outcome measures, and evaluate curriculum effects as learning outcomes among internal medicine residents and improved patient care practices. We anticipate wide adoption of the mastery learning model for skill and knowledge acquisition and maintenance in medical education settings.