Search

Purpose: The objective structured clinical examination (OSCE) assesses clinical competence in health sciences education. There is little research regarding the reliability and validity of using an OSCE during the transition from undergraduate to graduate medical education. The goal of this study was to measure the reliability of a unique 2-rater Entrustable Professional Activity (EPA)-based OSCE format for transition to internship using generalizability theory for estimating reliability., Method: During the 2018 to 2022 academic years, 5 cohorts of interns (n = 230) at the University of Iowa Hospital and Clinics participated in a 6-station OSCE assessment delivered during orientation. A univariate and multivariate generalizability study (G study) was conducted on the scores generated by the 3 cases in the orientation OSCE that shared the 2-rater format. This analysis was supplemented with an associated decision study (D study)., Results: The univariate G study for the cases that used a simulated patient and a faculty rater demonstrated that this OSCE generated a moderately reliable score with 3 cases. The D study showed that increasing the OCSE to 12 cases yielded a mean score reliable enough ( G = 0.76) for making high-stakes normative decisions regarding remediation and readiness to practice. The universe score correlation between 2 types of raters was 0.398. The faculty ratings displayed a larger proportion of universe (true) score variance and yielded a more reliable ( G = 0.433) score compared with the standardized patient ratings ( G = 0.337)., Conclusions: This study provides insight into the development of an EPA-based OSCE. The univariate G study demonstrated that when using the 2 rater types, this assessment could generate a moderately reliable score with 3 cases. The multivariate G study showed that the 2 types of raters assessed different aspects of clinical skills, and faculty raters were more reliable., (Copyright © 2024 the Association of American Medical Colleges.)

Abstract: Although most students complete Step 1 before clerkships, some institutions delay the exam until after clerkships. The change to pass/fail grading adds additional complexity that should be considered when deciding about exam timing. Both early and late administration may affect learning outcomes, learner behavior, student well-being, and residency match success. Step 1 completion before clerkships promotes learning outcomes (e.g., integration and mastery of foundational material), may encourage students to focus on the curriculum, and may better prepare students for clinical science exams (CSEs). However, delaying the exam ensures that students maintain foundational knowledge and may encourage clinical educators to demonstrate basic science illustrations. An early Step 1 may affect learner behavior by allowing clerkship students to focus on clinical learning. The associated National Board of Medical Examiners performance report may also be used for Step 2 and CSE preparation. However, delaying Step 1 allows greater scheduling flexibility based on developmental milestones. Administration of Step 1 before clerkships removes a significant stressor from the clinical year and decompresses the residency application period. However, a delayed Step 1 reduces the pressure on students to engage in numerous extracurricular and research activities to distinguish themselves due to the pass/fail change. An early Step 1 exam may also lead to improved CSE performance, which is often linked to clerkship honors criteria, an increasingly valuable distinction for residency match success after the change to pass/fail. In contrast, delaying Step 1 is associated with higher first-time pass rates, which may be especially important for students at risk for failure. Medical educators and students should collaboratively approach the question of Step 1 timing, considering these factors within the context of the medical school program, curricular constraints and priorities, and students' individual needs and goals., (Copyright © 2024 Written work prepared by employees of the Federal Government as part of their official duties is, under the U.S. Copyright Act, a “work of the United States Government” for which copyright protection under Title 17 of the United States Code is not available. As such, copyright does not extend to the contributions of employees of the Federal Government.)

Purpose: For accelerated 3-year MD (3YMD) pathways to be fully adopted in medical education, a comprehensive analysis of outcome data is needed. This study includes 7 accelerated 3YMD graduating classes at NYU Grossman School of Medicine (NYUGSOM) and reports on outcomes from both medical school and internship compared with their 4-year MD (4YMD) counterparts., Method: Outcomes across the undergraduate-graduate medical education continuum for the first 7 classes of NYUGSOM graduates (matriculated from 2013-2019) from the accelerated 3YMD (n = 136) and 4YMD pathways (n = 681) were compared. For the internship outcomes, 3YMD interns were compared with 4YMD interns who graduated from NYUGSOM and all 4YMD interns (4YMD graduates from NYUGSOM and any other medical school) at NYUGSOM residencies., Results: Accelerated 3YMD students were approximately 5 months older at admission and had higher multiple mini-interview scores than 4YMD students. Overall, accelerated 3YMD students performed similarly to 4YMD students during medical school and internship. Significant differences included higher performance by 3YMD students on preclerkship exams and lower performance on Steps 1 and 2 (average: 5.6 and 5.4 fewer points, respectively) and the physical examination portion of the NYUGSOM Comprehensive Clinical Skills Exam. Internship data indicated comparable team assessments across all residencies, statistically significant higher performance on Step 3 when compared with all 4YMD interns, and, in internal medicine, comparable clinical reasoning between 3YMD and all 4YMD interns. When comparing 3YMD interns to all 4YMD interns in the internal medicine residency program, 3YMD interns had a statistically significantly higher performance on milestones., Conclusions: The outcomes from 7 years of graduating accelerated 3YMD students at NYUGSOM show similar performance in medical school and early residency to 4YMD graduates. Long-term study of accelerated 3YMD students from NYUGSOM and other medical schools is needed to further validate the success of this innovative medical education pathway., (Copyright © 2024 the Association of American Medical Colleges.)

Problem: A shortage of curriculum-aligned formative multiple-choice questions (FMCQs) remains despite their known learning benefits in preclinical medical education due to limitations on teaching faculty time and other reasons. In response, students often use extramural resources such as commercial or collaborative question banks; however, these options are often expensive and cannot be aligned with the content of each school's unique curriculum. In addition, students need feedback on their learning in a manner that parallels the format of summative assessments. In this pilot, the authors aimed to enhance student learning by creating an intramural formative practice resource that was developed as the curriculum unfolded under the direction of the faculty leading the concurrently running curricular units., Approach: The authors developed a workflow known as Professor-Reviewed Exam Practice (PREP) in 2023. PREP partnered with preclinical medical students and faculty to create vignette-style, single-best-response FMCQs with feedback for every lecture and self-guided learning module in multiple preclinical blocks of The Ohio State University College of Medicine undergraduate medical curriculum., Outcomes: PREP established a sustainable, student-led, faculty-guided workflow that created high-quality, curriculum-aligned FMCQs for student use in the preclinical medical curriculum over a 14-month period. Usage rates were high across multiple preclinical blocks, reflecting high student demand for FMCQs of this nature and their value as a study aid. Survey data showed faculty agreed that their time commitment and role in the PREP workflow was appropriate., Next Steps: Future work will evaluate the benefits of PREP to students by exploring the potential impact of PREP FMCQs on summative assessment performance and if writing FMCQs confers benefits to PREP team members. Faculty survey indicated that performance data from PREP FMCQs could be used to tailor upcoming teaching and learning methods, which is an area for future inquiry., (Copyright © 2024 The Author(s). Published by Wolters Kluwer Health, Inc. on behalf of the Association of American Medical Colleges.)

Problem: In the United States, physician bias is exhibited early in medical training and contributes to systemic inequities within the field of medicine. A lack of diversity, equity, inclusion, and antiracism (DEI-AR) content within medical curricula drives critical gaps in knowledge and deficiencies when preparing medical students to serve patients of diverse backgrounds. At the Mayo Clinic Alix School of Medicine (MCASOM), student-led curricular reviews between 2017 to 2018 and 2020 to 2021 revealed opportunities to improve DEI-AR content within preclinical courses. Course directors expressed concern of limited expertise and time to enact effective changes., Approach: The MCASOM DEI-AR teaching assistant (TA) program aims to curate a collaborative partnership between course directors and compensated student TAs to facilitate course enhancements responsive to the prior preclinical course review while centering standardized DEI-AR best practices., Outcomes: As of January 2024, the program has engaged 14 TAs and partnered with 24 preclinical courses. Postcourse student evaluation responses were collected from 8 courses for 2021 to 2022 (before enhancements) and 2022 to 2023 (after enhancements). Student satisfaction with DEI-AR content is tracked through postcourse evaluations, with preliminary data demonstrating improvement after DEI-AR curricular integration (improvement of mean preenhancement and postenhancement scores of 3.81 to 4.05; t12 = 1.79, P = .21). Qualitative student comments were sorted into general categories of positive, negative, or neutral, showing a 6.25% median increase in positive perception of DEI., Next Steps: Plans for the MCASOM DEI-AR TA program include application of quality improvement strategies to improve program processes and outcomes. Development of a centralized dashboard that integrates course enhancement progress and ongoing feedback from evaluations is anticipated to facilitate this effort. The program additionally aims to develop partnerships with clinical clerkships, which would allow for a more comprehensive enhancement of the overall medical education experience related to DEI-AR., (Copyright © 2024 the Association of American Medical Colleges.)

Purpose: A physician's specialty is an integral part of their professional identity formation (PIF), not only determining the role they play in patient care but also shaping group interactions in the workplace. Prior work on PIF in medical students has focused on the development of a physician identity. However, little is known about how medical students might begin to develop divergent specialty-specific identities during medical school. Consequently, the authors aimed to explore how the process of specialty selection shapes PIF during undergraduate medical training and to develop a construct of specialty identity formation (SIF) as an important aspect of PIF., Method: The authors used a constructivist grounded theory approach to explore SIF in senior medical students at the University of Washington between August 2022 and January 2023. The author team consisted of 6 attending physicians. Two investigators conducted hour-long, semistructured interviews, which were audio recorded, transcribed, and deidentified. After analysis, member checking was completed with 2 participants., Results: The authors interviewed 14 students and categorized the data into 3 phases: nascent understanding, experiential grounding, and projecting forward. Participants reflected on considering their personal values, while simultaneously exploring the values and defining features of various specialty groups. Early impressions were formed based on ideas influenced by peers and mentors and later integrated with experiences on clinical rotations. Finally, participants noted engaging in a process projecting forward as they attempted to envision their potential futures as both physicians and members of a specialty group., Conclusions: As students explore their specialty identity, they use self-anchoring and self-stereotyping to integrate components of their evolving specialty identity into their professional identity. However, uncertainty regarding their fit with a specialty persists for many. Many sociocultural aspects of the learning environment affect SIF, including threats to psychological and identity safety., (Copyright © 2024 the Association of American Medical Colleges.)

Purpose: Educational impact is dependent on student engagement. Assessment design can provide a scaffold for student engagement to determine the focus of student efforts. Little is known about how medical students engage with assessment. Therefore, we asked the following research question: How do medical students engage with the process of assessment and their assessment data in 2 clinical assessment systems?, Method: This multi-institutional, cross-sectional constructivist grounded theory study of fourth-year undergraduate medical students at the University of Washington and Cleveland Clinic Lerner College of Medicine assessed 2 different assessment systems: traditional tiered grading, in which clerkship grades were summative, and programmatic assessment, in which students received low-stake, narrative feedback across clerkships with progress based on aggregated performance data in student portfolios. All fourth-year students were invited to participate in one-on-one semistructured interviews guided by student engagement theory between September 2022 and January 2023. Verbatim transcripts underwent iterative, qualitative analysis., Results: Twenty-two medical students were interviewed, 13 from a traditional grading assessment system and 9 from a programmatic assessment system. Three major ways in which assessment systems affected how students engaged with their assessments were categorized into the affective, cognitive, and behavioral domains of engagement: as a sociocultural statement of value, as the cognitive load associated with the assessment system and practices themselves, and as the locus of power and control in learning and authentic practice., Conclusions: Medical students' beliefs about assessment goals, cognitive burden of assessment, and relationships with others significantly affected their engagement with their assessments. In assessment systems that reward grading and an archetypal way of being, students report engaging by prioritizing image over learning. In programmatic assessment systems, students describe more fully and authentically engaging in their assessment for and as learning. Systems of assessment communicate what is rewarded, and you get what you reward., (Copyright © 2024 the Association of American Medical Colleges.)

Abstract: Most medical schools have instituted undergraduate medical education (UME) well-being programs in recent years in response to high rates of medical student distress, but there is currently significant variability in the structure of UME well-being programs and limited guidance on how to best structure such programs to achieve success. In this article, the authors, all leaders of medical student well-being programs at their home institutions and members of the Association of American Medical Colleges Group on Student Affairs Committee on Student Affairs Working Group on Medical Student Well-Being between 2019 and 2023 offer guidance to the national community on how best to structure a UME well-being program. They use the current literature and their professional experiences leading well-being efforts at 7 different institutions to review the case for addressing medical student well-being, propose a guiding model, and make recommendations for strategies to implement this model.The proposed guiding model emphasizes the importance of the learning environment and efficiency of learning to medical student well-being, as well as personal resilience. Based on this model, the authors recommend specific and tangible well-being strategies to implement systemic interventions to improve the learning environment, efficiency of learning, and personal resilience, including formalizing the well-being program; hiring qualified, dedicated, and empowered well-being leadership with clear responsibilities; acting as a central hub for resources and as a liaison with mental health care; and establishing robust program evaluation methods., (Copyright © 2024 the Association of American Medical Colleges.)

Purpose: How to best support self-regulated learning (SRL) skills development and track trainees' progress along their competency-based medical education learning trajectory is unclear. Learning plans (LPs) may be the answer; however, information on their use in undergraduate medical education (UME) is limited. This study summarizes the literature regarding LP use in UME, explores the student's role in LP development and implementation, and identifies additional research areas., Method: MEDLINE, Embase, PsycInfo, Education Source, and Web of Science databases were searched for articles published from database inception to March 6, 2024, and relevant reference lists were manually searched. The review included studies of undergraduate medical students, studies of LP use, and studies of the UME stage in any geographic setting. Data were analyzed using quantitative and qualitative content analyses., Results: The database search found 7,871 titles and abstracts with an additional 25 found from the manual search for a total of 7,896 articles, of which 39 met inclusion criteria. Many LPs lacked a guiding framework. LPs were associated with self-reported improved SRL skill development, learning structure, and learning outcomes. Barriers to their use for students and faculty were time to create and implement LPs, lack of training on LP development and implementation, and lack of engagement. Facilitators included SRL skill development, LP cocreation, and guidance by a trained mentor. Identified research gaps include objective outcome measures, longitudinal impact beyond UME, standardized framework for LP development and quality assessment, and training on SRL skills and LPs., Conclusions: This review demonstrates variability of LP use in UME. LPs appear to have potential to support medical student education and facilitate translation of SRL skills into residency training. Successful use requires training and an experienced mentor. However, more research is required to determine whether benefits of LPs outweigh the resources required for their use., (Copyright © 2024 the Association of American Medical Colleges.)

Problem: Many non-workplace-based assessments do not provide good evidence of a learner's problem representation or ability to provide a rationale for a clinical decision they have made. Exceptions include assessment formats that require resource-intensive administration and scoring. This article reports on research efforts toward building a scalable non-workplace-based assessment format that was specifically developed to capture evidence of a learner's ability to justify a clinical decision., Approach: The authors developed a 2-step item format called SHARP (SHort Answer, Rationale Provision), referring to the 2 tasks that comprise the item. In collaboration with physician-educators, the authors integrated short-answer questions into a patient medical record-based item starting in October 2021 and arrived at an innovative item format in December 2021. In this format, a test-taker interprets patient medical record data to make a clinical decision, types in their response, and pinpoints medical record details that justify their answers. In January 2022, a total of 177 fourth-year medical students, representing 20 U.S. medical schools, completed 35 SHARP items in a proof-of-concept study., Outcomes: Primary outcomes were item timing, difficulty, reliability, and scoring ease. There was substantial variability in item difficulty, with the average item answered correctly by 44% of students (range, 4%-76%). The estimated reliability (Cronbach α ) of the set of SHARP items was 0.76 (95% confidence interval, 0.70-0.80). Item scoring is fully automated, minimizing resource requirements., Next Steps: A larger study is planned to gather additional validity evidence about the item format. This study will allow comparisons between performance on SHARP items and other examinations, examination of group differences in performance, and possible use cases for formative assessment. Cognitive interviews are also planned to better understand the thought processes of medical students as they work through the SHARP items., (Copyright © 2024 The Author(s). Published by Wolters Kluwer Health, Inc. on behalf of the Association of American Medical Colleges.)

Problem: Medical school graduates enter a complex health care delivery system involving interprofessional teamwork and multifaceted value-based patient care decisions. However, current curricula on health systems science (HSS) are piecemeal, lecture based, and confined to preclinical training., Approach: The VISTA program is a longitudinal, immersive learning curriculum integrated into the University of Chicago Pritzker School of Medicine curriculum between 2016 and 2018. Key components include a unit-based nursing interprofessional team experience, a discharge objective structured clinical examination (OSCE), a patient safety simulation, and the implementation of a Choosing Wisely SmartPhrase. Graduates before 2016-2017 and after 2018-2020 VISTA implementation completed a Likert-style survey assessing attitudes, knowledge, and behaviors on HSS topics. A free response question solicited improvement areas. The Association of American Medical Colleges (AAMC) Graduation Questionnaire (GQ) was also examined., Outcomes: The overall VISTA survey response rate was 59%, with 126 fourth-year medical student respondents before VISTA and 120 after VISTA. Compared with pre-VISTA graduates, post-VISTA graduates reported a significantly higher rate of competence on the HSS questions, with the greatest increases seen in effective communication at discharge (n = 73/126 [57.9%] to 116/120 [96.7%], P < .001), knowledge on safety event reporting (n = 53/126 [42.1%] to 96/120 [79.8%], P < .001), and considering costs in making health care decisions (n = 76/126 [60.3%] to 117/120 [97.5%], P < .001). All were directly addressed through experiential learning interventions, and 2 were intended practice behaviors. VISTA graduate responses to free-text questions demonstrated a more nuanced understanding of HSS compared with pre-VISTA responses. The AAMC GQ data showed increased agreement with an item that mapped to HSS understanding., Next Steps: The VISTA program provides a model for institutions to enhance HSS education between curricular overhauls. Next steps include implementing value-added roles and additional immersive learning exercises., (Copyright © 2024 the Association of American Medical Colleges.)

Purpose: Surgical subinternships are important rotations for students preparing for a career in general surgery; however, these rotations often vary by institution and service. This modified Delphi study was conducted to reach a consensus set of roles, responsibilities, and expectations of fourth-year medical students on their surgical subinternships., Method: Candidate statements on roles, responsibilities, and expectations of subinterns were categorized into 7 domains: rotation structure, rounding and patient care, operating room conduct, technical skills, knowledge base, clinic, and professionalism. Expert panels were assembled of key stakeholders: program directors, clerkship directors, other education faculty, trainees, and recent subinterns. Three Delphi rounds were conducted from January to April 2023 to reach consensus defined a priori as a Cronbach α ≥ 0.8 and 80% or greater panel agreement., Results: Forty-six expert panelists were recruited to participate in Delphi rounds, with 100%, 95.7%, and 97.8% response rates in the first, second, and third rounds, respectively. By the third round, 67 statements reached consensus as essential roles, responsibilities, and expectations of surgical subinterns. Key themes from these 67 statements included subinterns approximating the role of an intern with respect to work hours, patient care responsibilities, basic technical skills, and knowledge base. Panelists rated rounding and patient care as the most important domain, followed closely by professionalism. Additional key domains for evaluation in descending order were knowledge base, operating room conduct, clinic, and technical skills. By the third round, notable disagreements in the Delphi process included technical skills and rounding and patient care (93.3% and 88.9% agreement, respectively)., Conclusions: This study provides a national consensus on core roles, responsibilities, and expectations for medical students completing surgical subinternships. Students can use these recommendations to prepare for subinternships, whereas faculty as well as residents and fellows can use them to evaluate applicants for general surgery residency positions., (Copyright © 2024 the Association of American Medical Colleges.)

Problem: Structural competency is increasingly valued as a framework to address health equity within undergraduate medical education. As of academic year 2023-2024, the Liaison Committee on Medical Education (LCME) requires that medical schools have content regarding basic principles of structurally competent health care. Despite encouraging data about the effectiveness of structural competency curricula, most occur within the walls of a classroom and do not enter the authentic or simulated clinical space., Approach: From 2022 to 2023, an objective structured clinical exam (OSCE) focused on premature discharge, previously known as discharge against medical advice, was integrated into the required fourth-year Health Policy course at Weill Cornell Medical College, which uses the framework of structural competency. After a simulated clinical encounter, students completed a reflection assignment and participated in group debriefing to reflect on how policy coursework affected their simulated clinical experience. Students completed an evaluation about their OSCE experience, and OSCE checklist performance was analyzed., Outcomes: Of 82 students who participated in the curriculum, 68 completed a curricular evaluation, and 62 consented to have their OSCE performance evaluated for research. Mean overall OSCE checklist performance evaluating students' patient-centered communication skills, harm reduction skills, and discharge planning and counseling was 14.3/16 (89.6%; standard deviation, 9.8%). Students reported it was valuable to focus on structural factors affecting care within the simulated clinical encounter by using the structural competency framework., Next Steps: To the authors' knowledge, this is the first OSCE for medical students designed to deepen their understanding of structural competency by embedding the experience into an existing course using the framework. Future work should explore how this curriculum affects students' attitudes toward structurally vulnerable patients. With structural competency as an LCME requirement, the use of OSCEs may give educators a means to teach and assess fundamental concepts., (Copyright © 2024 the Association of American Medical Colleges.)

Purpose: Left-handed medical students contend with unique educational barriers within surgery, such as lack of educational resources, lack of left-handed-specific training, and widespread stigmatization of surgical left-handedness. This study aimed to highlight the surgical experiences of left-handed medical students so educators may be empowered to act with greater care and appreciation of these students' circumstances., Method: In this qualitative study, the authors conducted semistructured interviews on surgical experiences during medical school between January 31, 2021, and June 20, 2021, on 31 current surgical residents and fellows from 15 U.S. institutions and 6 surgical specialties. Left-handed trainees were included regardless of their surgical hand dominance., Results: The authors identified 3 themes related to left-handed medical students' surgical experience: (1) disorienting advice from faculty or residents, (2) discouraging right-handed pressures and left-handed stigmatization, and (3) educational wishes of left-handed medical students. Trainees describe dialogues during medical school in which their handedness was directly addressed by residents and faculty with disorienting and nonbeneficial advice. Often trainees were explicitly told which hand to use, neglecting any preferences of the left-handed student. Participants also described possible changes in future surgical clerkships, including normalization of left-handedness, tangible mentorship, or granular and meaningful instruction., Conclusions: Left-handed medical students encounter unique challenges during their surgical education. These students report being disoriented by the variability of advice provided by mentors, discouraged by how pressured they feel to operate right-handed, and burdened by the need to figure things out by themselves in the absence of adequate left-handed educational resources. Surgical education leadership should detail the unique problems left-handed learners face, impartially elicit the learner's current operative hand preference, take responsibility for their left-handed students, promote acceptance and accommodation strategies of left-handed surgical trainees, and endeavor to improve the breadth of left-handed surgical resources., (Copyright © 2023 the Association of American Medical Colleges.)

Purpose: Clinical reasoning, a complex construct integral to the practice of medicine, has been challenging to define, teach, and assess. Programmatic assessment purports to overcome validity limitations of judgments made from individual assessments through proportionality and triangulation processes. This study explored a pragmatic approach to the programmatic assessment of clinical reasoning., Method: The study analyzed data from 2 student cohorts from the University of Utah School of Medicine (UUSOM) (n = 113 in cohort 1 and 119 in cohort 2) and 1 cohort from the University of Colorado School of Medicine (CUSOM) using assessment data that spanned from 2017 to 2021 (n = 199). The study methods included the following: (1) asking faculty judges to categorize student clinical reasoning skills, (2) selecting institution-specific assessment data conceptually aligned with clinical reasoning, (3) calculating correlations between assessment data and faculty judgments, and (4) developing regression models between assessment data and faculty judgments., Results: Faculty judgments of student clinical reasoning skills were converted to a continuous variable of clinical reasoning struggles, with mean (SD) ratings of 2.93 (0.27) for the 232 UUSOM students and 2.96 (0.17) for the 199 CUSOM students. A total of 67 and 32 discrete assessment variables were included from the UUSOM and CUSOM, respectively. Pearson r correlations were moderate to strong between many individual and composite assessment variables and faculty judgments. Regression models demonstrated an overall adjusted R2 (standard error of the estimate) of 0.50 (0.19) for UUSOM cohort 1, 0.28 (0.15) for UUSOM cohort 2, and 0.30 (0.14) for CUSOM., Conclusions: This study represents an early pragmatic exploration of regression analysis as a potential tool for operationalizing the proportionality and triangulation principles of programmatic assessment. The study found that programmatic assessment may be a useful framework for longitudinal assessment of complicated constructs, such as clinical reasoning., (Copyright © 2024 the Association of American Medical Colleges.)

Problem: Although the practice of medicine is often emotionally challenging, medical curricula seldom systematically address the emotional development of medical students. To fill this gap, the authors developed and evaluated an innovative pedagogical activity based on music to nurture medical students' emotional development. The authors believe that the metaphoric nature of music offers an efficient venue for exploring emotion perception, expression, and regulation., Approach: The pedagogical activity Emotions in Medicine was carried out throughout 2020 and 2021 and consisted of 4 encounters to explore: (1) emotion perception, (2) emotion expression, (3) emotion regulation, and (4) the role of emotions in medical practice. During all encounters, the authors used music to evoke students' emotions and focused the discussions on the relevance of emotions for meaningful medical practice. Emotional intelligence before and after the workshop was tested using the Schutte Self-Report Emotional Intelligence Test (SSEIT), a validated psychometric scale., Outcomes: The workshop facilitated emotional connection among students and created a safe space to explore the role of emotions in medical practice. The mean total pretest SSEIT score was 110 (SD = 14.2); it increased to 116.8 (SD = 16.1) in the posttest ( P < .001). This increase was true across its 4 dimensions: (1) perception of emotions, (2) management of own emotions (3) management of others' emotions, and (4) use of emotions., Next Steps: Music can be an active tool to explore the role of emotions in medical practice. It fosters students' capacity to identify and reflect on emotions while exploring their role in patient care. Further (qualitative) research is needed to explore the mechanisms by which music facilitates learning emotion perception, expression, and regulation., (Copyright © 2024 the Association of American Medical Colleges.)

Purpose: Periodic revision of undergraduate medical education (UGME) curricula is an essential part of evidence-based educational practices. Pakistan's national UGME curriculum, last updated in 2005, was reviewed, and recommended updates were made in 2022. The authors explore academic medical school leaders' perspectives about the proposed reforms, gaps within the existing curriculum, and how to ensure the reform implementation is effective, collaborative, and feedback-driven., Method: Using a mixed methods approach, data were collected from April to July 2022. Academic leadership (principals, who could designate vice principals or medical educators) at all medical schools across Pakistan (n = 117) were invited. Agreement with each of 20 proposed reforms was measured via a survey employing a Likert scale. A semistructured interview guide expanded on the survey questions with probes., Results: Eighty-eight survey responses, from private (59; 67.0%) and public (29; 33.0%) institutions, were obtained (75.2% response rate). Participants recommended most of the proposed reforms. The 3 reforms that received the highest agreement were teaching professionalism as an integral part of the curriculum (83; 94.3%), mandating bedside procedural skills training (80; 90.9%), and including patient safety in the UGME curriculum (79; 89.8%). Including multidisciplinary tumor boards and surgical oncology had the lowest agreement (26; 29.5%). Fifteen interviews were conducted, which revealed 3 major themes: perceptions about changes to the curricular content, limitation of human and financial resources as barriers to reform implementation, and recommendations for effective implementation of an updated curriculum., Conclusions: The findings reflect an overall positive attitude of academic medical school leadership toward the 20 proposed UGME curriculum reforms, which could aid with on-the-ground implementation. However, major limitations, such as a lack of trained faculty and financial resources, must be addressed. The authors propose future research on the resources required for implementing UGME reforms and the reforms' impact after national implementation., (Copyright © 2024 the Association of American Medical Colleges.)

Purpose: Many medical schools incorporate longitudinal clerkships, which promote continuity and may offer early clinical exposure during the preclinical curriculum. However, the mechanisms of near-peer learning and how it contributes to the development of clinical skills in longitudinal clinical experiences are less clear. The authors explored how peer-to-peer interactions among medical students influenced their developmental trajectories from nascent clinicians to more seasoned practitioners capable of juggling dual roles of clinical care and clinical supervision within longitudinal clerkships., Method: The Education-Centered Medical Home (ECMH) at Northwestern University Feinberg School of Medicine is a longitudinal clerkship that represents an ideal setting to explore peer learning. At ECMH, continuity is established across all 4 years of medical school among small groups of students from each year, a preceptor, and a panel of outpatients. The authors conducted 6 focus groups and 9 individual interviews between March 2021 and February 2023 with medical students from all years. Using constructivist grounded theory, the authors collected and analyzed data iteratively using constant comparison to identify themes and explore their relationships., Results: Within ECMH, peer relationships fostered an informal learning culture that enabled meaningful peer interactions while reinforcing the established culture. The authors identified 3 essential learning practices between senior and junior medical students: preparing for patient encounters, shifting roles dynamically during the joint encounter, and debriefing encounters afterward. These practices strengthened learning relationships and supported students' developmental trajectories., Conclusions: Longitudinal peer learning relationships enabled meaningful peer interaction that influenced medical students' clinical development and capability for clinical supervision. Mutual trust, familiarity, and continuity facilitate targeted feedback practices and growth at the edge of junior students' capabilities. Optimizing this peer learning environment and seeking new opportunities to use longitudinal peer learning in clinical environments could promote psychological safety and professional identity formation for medical students., (Copyright © 2024 the Association of American Medical Colleges.)

Purpose: Clinical reasoning is vitally important for practitioners across the health professions. However, the assessment of clinical reasoning remains a significant challenge. Combined with other assessment methods, non-workplace-based assessment can increase opportunities to address multiple components of clinical reasoning, evaluate growth, and foster learning, but tools with validity evidence to assess clinical reasoning outside the workplace are scare. This study examined validity evidence for a novel clinical reasoning mapping exercise (CResME)., Method: Data include CResME performance scores from 120 third-year medical students at the University of Central Florida for 3 topics in May 2022. Each CResME was scored by 2 physician raters based on a scoring rubric that included a combined diagnosis and sequence score. Descriptive statistics were used to examine trends in scores. The authors gathered validity evidence for response process, internal structure, and relations to other variables., Results: The overall mean (SD) score across cases was 66 (29). Internal consistency reliability of cases (Cronbach α) ranged from 0.75 to 0.91. The Phi and G coefficients were 0.45 and 0.56, respectively. Students accounted for 10% of the total variance, indicating the ability to differentiate high and low clinical reasoning skills; the interaction between learner and case accounted for 8.1% of the variance, demonstrating case specificity. There was a moderate correlation between the overall CResME scores and the mean overall score of patient encounter notes from an objective structured clinical examination performed at the end of the third year (0.46; P = .001). Significant associations were also found between the CResME scores and subject exam scores., Conclusions: The CResME can be used to facilitate the assessment of clinical reasoning, supporting the developmental progress of learners throughout the curriculum. Future research is needed to gather validity evidence for CResMEs with different learners across different settings and formats., (Copyright © 2024 the Association of American Medical Colleges.)

Problem: Stigma in health care toward people who inject drugs (PWID) is a well-described, significant barrier to quality care, resulting in poor health outcomes. Harm reduction offers a person-centered counter-framework for minimizing harm for people who use drugs. Despite the evidence in support of harm reduction, medical students typically receive minimal training on harm reduction and the care of PWID., Approach: To fill this gap, medical students at the University of California, Los Angeles organized around the principles of harm reduction to improve the medical school curriculum related to PWID. Students screened lectures for stigmatizing language and collaborated with faculty to improve lecture materials. They partnered with a community organizer and hosted a mandatory 1-hour lecture and 30-minute discussion introducing the principles of harm reduction within an overdose prevention, recognition, and response training for first-year medical students during medical school orientation in August 2022. An anonymous online pretest and posttest survey, assessing student attitudes toward PWID, was used to evaluate the effects of the training., Outcomes: A total of 156 students completed the pretest survey, and 107 students completed the pretest and posttest survey (68.5% response rate). The overall posttest mean stigma score was 1.8 (standard deviation [SD] = 0.5) and was significantly lower than the pretest mean of 2.1 (SD = 0.7; P < .0001), indicating a reduction in stigma among medical student attitudes after the course. There was statistically significant improvement in attitudes for 7 of 13 component measures., Next Steps: This analysis demonstrated that the mandatory class has the capacity to improve medical student attitudes toward PWID. The authors plan to further evaluate the program's effectiveness through measuring and reporting outcomes for future student cohorts. The authors are working with curriculum directors to further incorporate harm reduction principles into other lectures and problem-based learning exercises., (Copyright © 2024 the Association of American Medical Colleges.)

Purpose: Public health is a necessary focus of modern medical education. However, while numerous studies demonstrate benefits of public health education during medical school among self-selected students (i.e., those interested in public health), there are few educational models shown to be effective across the general medical student population. This study examined the effect of a multiyear, case-based, longitudinal online public health curriculum required for all medical students at an urban, research-focused U.S. medical school., Method: The authors created 11 short public health modules to supplement a year-long, organ-based preclerkship course at Columbia University Vagelos College of Physicians and Surgeons. Beginning in 2020, all students were required to complete these modules, with repeated surveys to assess changes in attitudes and knowledge of public health over time. The authors compared responses for these domains before and after each module, across multiple time points throughout the year, and cross-sectionally to a 2019 cohort of students who were not provided the modules., Results: Across 3 cohorts, 405 of 420 (96.4%) students provided responses and were included in subsequent analyses. After completing the modules, students reported perceiving a greater importance of public health to nearly every medical specialty ( P < .001), more positive attitudes toward public health broadly ( P < .001), and increased knowledge of public health content ( P < .001). These findings were consistent across longitudinal analysis of students throughout the year-long course and when compared to the cohort who did not complete the modules., Conclusions: Case-based, interactive, and longitudinal public health content can be effectively integrated into the required undergraduate medical education curriculum to improve all medical students' knowledge and perceptions of public health. Incorporating evidence-based public health education into medical training may help future physicians to better address the needs of the communities and populations in which they practice., (Copyright © 2024 the Association of American Medical Colleges.)

Problem: Creating medical exam questions is time consuming, but well-written questions can be used for test-enhanced learning, which has been shown to have a positive effect on student learning. The automated generation of high-quality questions using large language models (LLMs), such as ChatGPT, would therefore be desirable. However, there are no current studies that compare students' performance on LLM-generated questions to questions developed by humans., Approach: The authors compared student performance on questions generated by ChatGPT (LLM questions) with questions created by medical educators (human questions). Two sets of 25 multiple-choice questions (MCQs) were created, each with 5 answer options, 1 of which was correct. The first set of questions was written by an experienced medical educator, and the second set was created by ChatGPT 3.5 after the authors identified learning objectives and extracted some specifications from the human questions. Students answered all questions in random order in a formative paper-and-pencil test that was offered leading up to the final summative neurophysiology exam (summer 2023). For each question, students also indicated whether they thought it had been written by a human or ChatGPT., Outcomes: The final data set consisted of 161 participants and 46 MCQs (25 human and 21 LLM questions). There was no statistically significant difference in item difficulty between the 2 question sets, but discriminatory power was statistically significantly higher in human than LLM questions (mean = .36, standard deviation [SD] = .09 vs mean = .24, SD = .14; P = .001). On average, students identified 57% of question sources (human or LLM) correctly., Next Steps: Future research should replicate the study procedure in other contexts (e.g., other medical subjects, semesters, countries, and languages). In addition, the question of whether LLMs are suitable for generating different question types, such as key feature questions, should be investigated., (Copyright © 2023 the Association of American Medical Colleges.)

Purpose: To gather and leverage the voices of students to drive creation of required, integrated palliative care curricula within undergraduate medical education in Massachusetts, which is lacking in a majority of U.S. medical schools., Method: The study was conducted by the Massachusetts Medical Schools' Collaborative, a working group committed to ensuring all medical students in Massachusetts receive foundational training in serious illness communication (SIC) and palliative care. Eight focus groups (2 per participating medical school) were conducted during January-May 2021 and included a total of 50 students from Boston University Chobanian & Avedisian School of Medicine, Harvard Medical School, Tufts University School of Medicine, and the UMass Chan Medical School. Data collected from focus groups were discussed and coded. Themes were identified using the immersion/crystallization qualitative data analysis approach., Results: Six key themes emerged. Students viewed SIC as essential to high-quality medical practice regardless of specialty, and believed training in SIC skills and palliative care should be required in medical school curricula. Students preferred to learn and practice these skills using frameworks, particularly in real-world situations. Students recognized the expertise of palliative care specialists and described them as a scarce, often misunderstood resource in health care. Students reported it was mostly "luck" if they were included in family meetings and observed good role models. Finally, students desired practice in debriefing after difficult and emotional situations., Conclusions: This study confirms long-standing themes on students' experiences with SIC and palliative care topics, including feeling inadequately prepared to care for seriously ill patients as future physicians. Our study collected students' perspectives as actionable data to develop recommendations for curricular change. Collaborative faculty also created recommendations based on the focus group data for immediate and ongoing SIC and palliative care curricular change in Massachusetts, which can apply to medical schools nationwide., (Copyright © 2024 the Association of American Medical Colleges.)

Abstract: Philosophers and scientists alike argue that wonder-that emotion or state of consciousness in which one's attention is fixed on phenomena beyond one's comprehension-is the central virtue and driving force of all education. As in general education, wonder is central to all aspects of academic medicine's tripartite mission; a sense of wonder fuels the delivery of humanized patient care, sparks scientific discoveries, and supports engagement in lifelong learning. Despite its importance throughout medicine, developing a capacity for wonder among physicians has not been a stated goal of medical education, and innovative methods to foster a capacity for wonder have not been explored. There is a growing interest in the arts and humanities in medical education, and evidence suggests that these can support the development of a diverse array of clinically relevant skills and attitudes (including close observation, critical thinking, empathy, and tolerance for ambiguity) in medical learners across the learning continuum. However, even the potential of these methods to support a capacity for wonder has not yet been fully explored. In this article, the authors explore how one of the most widely used and studied arts-based learning activities in medical education, Visual Thinking Strategies, can help develop a capacity for wonder among physicians. They illustrate how Visual Thinking Strategies support the central elements of wonder-based pedagogy (i.e., exploration, improvisation, imagination, personal interest, and the ethos of educators) previously developed in education theory., (Copyright © 2023 the Association of American Medical Colleges.)

Purpose: Competency-based medical education (CBME) represents a shift to a paradigm with shared definitions, explicit outcomes, and assessments of competence. The groundwork has been laid to ensure all learners achieve the desired outcomes along the medical education continuum using the principles of CBME. However, this continuum spans the major transition from undergraduate medical education (UME) to graduate medical education (GME) that is also evolving. This study explores the experiences of medical educators working to use CBME assessments in the context of the UME-GME transition and their perspectives on the existing challenges., Method: This study used a constructivist-oriented qualitative methodology. In-depth, semistructured interviews of UME and GME leaders in CBME were performed between February 2019 and January 2020 via Zoom. When possible, each interviewee was interviewed by 2 team members, one with UME and one with GME experience, which allowed follow-up questions to be pursued that reflected the perspectives of both UME and GME educators more fully. A multistep iterative process of thematic analysis was used to analyze the transcripts and identify patterns across interviews., Results: The 9 interviewees represented a broad swath of UME and GME leadership positions, though most had an internal medicine training background. Analysis identified 4 overarching themes: mistrust (a trust chasm exists between UME and GME); misaligned goals (the residency selection process is antithetical to CBME); inadequate communication (communication regarding competence is infrequent, often unidirectional, and lacks a shared language); and inflexible timeframes (current training timeframes do not account for individual learners' competency trajectories)., Conclusions: Despite the mutual desire and commitment to move to CBME across the continuum, mistrust, misaligned goals, inadequate communication, and inflexible timeframes confound such efforts of individual schools and programs. If current efforts to improve the UME-GME transition address the themes identified, educators may be more successful implementing CBME along the continuum., (Copyright © 2023 The Author(s). Published by Wolters Kluwer Health, Inc. on behalf of the Association of American Medical Colleges.)

Purpose: The authors examined whether students participating in an urban longitudinal integrated clerkship (LIC) with a curriculum focused on care for underserved populations have a sustained commitment to urban underserved care through residency training and into practice., Method: This mixed-methods study collected data from medical student application essays to the Denver Health LIC (DH-LIC), end-of-course surveys, residency match outcomes, and postgraduation surveys annually for academic years 2014 to 2022. The authors analyzed students' responses to the surveys on interest in working with underserved patients, understanding the rewards and challenges of working in safety net institutions, working in the community to improve health, and working at DH. The authors qualitatively coded the 70 application essays of all selected students using summative content analysis., Results: Seventy DH-LIC students were compared with 1,450 medical students between 2014 and 2022. Qualitative analysis of LIC application essays revealed 3 themes: interest in working with underserved populations, work experience with underserved populations, and personal experience with medical vulnerability. Fifty-seven DH-LIC participants (81.4%) expressed high levels of career interest in working with underserved populations, 45 (64.3%) had high levels of work experience with underserved populations, and 18 (25.7%) expressed high levels of personal experience. Graduates of the DH-LIC program demonstrated a high degree of continuing interest in practicing in urban underserved settings throughout medical school and postgraduate training. Ten graduates (71.4%) in practice work in urban underserved settings. Participants reported a high or very high level of interest and commitment to working with underserved populations (96.7%-100%), understanding the safety net health care system (91.7%-98.6%), and working in communities (95.0%-100%) at all time points studied., Conclusions: Early data indicate high rates of graduates working in urban underserved settings. These preliminary outcomes suggest the LIC may support the development of a committed workforce for urban underserved communities., (Copyright © 2023 the Association of American Medical Colleges.)

Abstract: Commitment to clinical education often requires significant forethought and attention to provide a comprehensive learning experience for trainees. In these settings, teaching is typically time-limited, prompted by a clinical scenario, and requires preparation. However, it is not uncommon for teachers to have insufficient time to prepare or to encounter a clinical scenario in which they have not yet developed a teaching script.In this article, the authors share 5 categories of teaching techniques that instructors can pull from regardless of the prompt or busyness of the clinical setting and that are ideal for using when the teaching script is "blank." They call this approach of having scenario-independent teaching techniques ready to be applied with minimal preparation, "pseudo-improvised teaching."Drawing from the literature, their own experience, and borrowing from improvisational theater, the authors share a toolkit of pseudo-improvised teaching techniques spanning from pathophysiology to clinical skills to work-life integration. In addition to highlighting several techniques, they describe models of meta-structure for teaching in which the use of themes for the day (i.e., longitudinal themes) and routines can ease some of the cognitive load felt by both learners and educators., (Copyright © 2023 the Association of American Medical Colleges.)

Purpose: Mistreatment of medical students by patients has not been qualitatively explored in the literature. The authors sought to develop a rich understanding of the impact and consequences of medical students' experiences of mistreatment by patients., Method: This exploratory descriptive qualitative study was conducted at a large Canadian medical school from April-November 2020. Fourteen medical students were recruited for semistructured interviews. Students were asked about their experiences of mistreatment by patients and how they responded to these experiences. Transcripts were thematically analyzed using an inductive approach, and the authors interwove critical theory into their conceptual interpretation of the data., Results: Fourteen medical students (median age = 25.5; 10, 71.4% self-reported male; 12, 85.7% self-identified visible minority) participated in this study. Twelve (85.7%) participants had personally experienced patient mistreatment and 2 (14.3%) had witnessed mistreatment of another learner. Medical students described being mistreated by patients based on their gender and race/ethnicity. Although all participants were aware of the institution's official mechanism for reporting mistreatment, none filed an official report. Some participants described turning to their formal (faculty members and residents) and informal (family and friends) social supports to cope with mistreatment by patients. Participants described resenting and avoiding patients who mistreated them and struggling to maintain empathy for, openness to, and overall ethical engagement with discriminatory patients. Students often described a need to be stoic toward their experiences of mistreatment by patients, often seeing it as their "professional duty" to overcome and thus suppress the negative emotions associated with mistreatment., Conclusions: Medical schools must proactively develop multifaceted mechanisms to support medical students who experience mistreatment by patients. Future research can further uncover this neglected dimension of the hidden curriculum to better develop responses to incidents of mistreatment that commit to antiracism, antisexism, patient care, and learner care., (Copyright © 2023 by the Association of American Medical Colleges.)

Problem: Despite numerous pedagogical approaches and technologies now available for medical gross anatomy, students can find it difficult to translate what occurs in a dissection laboratory into the context of clinical practice., Approach: Using complementary and collaborative approaches at 2 different medical schools, Virginia Commonwealth University (VCU) and University of Maryland (UM), we designed and implemented a series of clinical activities in the preclerkship medical gross anatomy laboratory that directly link dissected structures to clinical procedures. These activities specifically direct students to perform simulated clinically related procedures on anatomic donors during laboratory dissection sessions. The activities are called OpNotes at VCU and Clinical Exercises at UM. Each activity in the VCU OpNotes requires about 15 minutes of group activity at the end of a scheduled laboratory and involves faculty to grade the student responses submitted via a web-based-assessment form. Each exercise in UM Clinical Exercises also requires about 15 minutes of group activity during the schedule laboratory but does not involve faculty to complete grading., Outcomes: Cumulatively, the activities in OpNotes and Clinical Exercises both brought clinical context directly to anatomical dissections. These activities began in 2012 at UM and 2020 at VCU, allowing a multiyear and multi-institute development and testing of this innovative approach. Student participation was high, and perception of its effectiveness was almost uniformly positive., Next Steps: Future iterations of the program will work to assess the efficacy of the program as well as to streamline the scoring and delivery of the formative components. Collectively, we propose that the concept of executing clinic-like procedures on donors in anatomy courses is an effective means of enhancing learning in the anatomy laboratory while concurrently underscoring the relevance of basic anatomy to future clinical practice., Competing Interests: Other disclosures: The authors report that there are no potential conflicts of interest in any form., (Copyright © 2023 by the Association of American Medical Colleges.)

While the traditional medical school curriculum specializes in teaching doctor-patient communication at the individual patient level, the need to train physicians to communicate science and medicine effectively to the public at large is, for the most part, ignored. With the unchecked proliferation of misinformation and disinformation during the COVID-19 pandemic, it is critical that current and future medical professionals learn to engage in the public arena using multiple methods (written, oral, social media) across multimedia platforms to dispel misinformation and accurately educate the public. This article describes the authors' interdisciplinary approach at the University of Chicago Pritzker School of Medicine to teaching science communication to medical students, early experiences, and future directions in this vein. The authors' experiences show that medical students are viewed as trusted sources of health-related information, and thus, need the skills and training to tackle misinformation and that students across these learning experiences appreciated the opportunity to choose a topic of their interest according to what matters to them and their communities most. The feasibility of successfully teaching scientific communication in an undergraduate and medical education curriculum is confirmed. These early experiences support the feasibility and impact of training medical students to improve communication about science with the general public., (Copyright © 2023 by the Association of American Medical Colleges.)

Purpose: Learner-centered feedback models encourage educators to ask learners to self-assess at the start of feedback conversations. This study examines how learners perceive and respond to self-assessment prompts during feedback conversations and assesses medical students' perceptions of and approach to self-assessment used as the basis for these conversations., Method: All rising second-, third-, and fourth-year medical students at a midwestern U.S. medical school were invited to participate in this study. Students participated in 1-on-1 interviews between June and August 2019 during which they were asked open-ended questions about their experiences with self-assessment and feedback during medical school. The interviews were audio recorded and transcribed, and comments related to self-assessment in feedback conversations were extracted. Thematic analysis was used to identify recurrent ideas and patterns within the transcripts, and all excerpts were reviewed and coded to ensure that the identified themes adequately captured the range of student responses., Results: A total of 25 students participated in the study. Although some students noted improvement in their self-assessment abilities with increasing experience, no consistent gender, race, or training-level differences were found in reported attitudes or preferences. Students identified many benefits of self-assessment and generally appreciated being asked to self-assess before receiving feedback. Students had varied responses to specific self-assessment prompts, with no clear preferences for any particular self-assessment questions. Students described weighing multiple factors, such as image concerns and worries about impact on subsequent evaluations, when deciding how to respond to self-assessment prompts., Conclusions: The process by which learners formulate and share self-assessments in feedback conversations is not straightforward. Although educators should continue to elicit self-assessments in feedback discussions, they should recognize the limitations of these self-assessments and strive to create a safe environment in which learners feel empowered to share their true impressions., (Copyright © 2022 by the Association of American Medical Colleges.)

Problem: Despite the prevalence and detrimental effects of racial discrimination in American society and its health care systems, few medical schools have designed and implemented curricula to prepare medical students to respond to patient bias and racism., Approach: During the summer of 2020, a virtual communication class was designed that focused on training medical students in how to respond to patient bias and racism. Following brief didactics at the start of the session, students practiced scenarios with actors in small groups and received direct feedback from faculty. For each scenario, students were instructed to briefly gather a patient's history and schedule an appointment with the attending whose name triggered the patient to request an "American" provider. In one scenario, the patient's request was motivated by untreated hearing loss and difficulty understanding accents. In another, it was motivated by racist views toward foreign physicians. Students were to use motivational interviewing (MI) to uncover the reasoning behind the request and respond appropriately. Students assessed their presession and postsession confidence on 5 learning objectives that reflect successful communication modeled after MI techniques., Outcomes: Following the session, student skills confidence increased in exploring intentions and beliefs ( P = .026), navigating a conversation with a patient exhibiting bias ( P = .019) and using nonverbal skills to demonstrate empathy ( P = .031). Several students noted that this was their first exposure to the topic in a medical school course and first opportunity to practice these skills under supervision., Next Steps: The experience designing and implementing this module preparing students in responding to patient bias and racism suggests that such an effort is feasible, affordable, and effective. With the clear need for such a program and positive impact on student confidence navigating these discussions, including such training in medical school programs appears feasible and is strongly encouraged., (Copyright © 2022 by the Association of American Medical Colleges.)

Purpose: Racial/ethnic disparities exist in clinical clerkship grading, yet little is known about medical student and faculty perspectives on why these disparities occur. This study explored what happens during clerkships that might explain grading disparities., Method: Medical students and clerkship teachers at 3 U.S. medical schools completed a demographic survey and semistructured interview. The constant comparative method was used to analyze transcripts by inductively developing codes; grouping codes in categories; and refining codes, descriptions, and group assignments to identify themes. Interpretations of and relationships among themes were iteratively discussed to develop a grounded theory., Results: Fifty-nine participants (29 medical students, 30 teachers [28 clinical faculty, 2 residents]) were interviewed in 2020. The Social Milieu of Medical Education (relationships, fit, opportunities, and judgments in the clinical-learning setting) was the organizing theme, influenced by 5 additional themes: Societal Influence (experiences in society), Students' Characteristics and Background (personal characteristics and experiences outside medical school), Assessment Processes (collection of student performance data and how data inform grades), Learning Environment (resources available and messaging within the clinical setting), and Students' Interactions and Reactions (interactions with and reactions to peers and teachers). The grounded theory highlights complex, multilayered aspects of how the social milieu of medical education is shaped by and shapes students' experiences, relationships, and clerkship assessments and promotes clerkship-grading disparities., Conclusions: Mitigating clerkship-grading disparities will require intervening on interrelated, contextual factors to provide equitable opportunities for students from diverse backgrounds and with varying styles of engagement in clinical-learning settings, along with attending to modifying assessment processes., (Copyright © 2022 by the Association of American Medical Colleges.)

Purpose: To inform research on developing or adopting leadership competency frameworks for use in U.S. undergraduate medical education (UME), this scoping review describes the content of U.S. UME leadership curricula, associated competency frameworks, and content delivery., Method: The authors searched PubMed, Embase, and ERIC databases on June 22, 2020. They included English-language studies that described U.S. UME curricula in which the primary end goal was leadership development. They excluded studies published before January 1, 2000. Data were extracted on leadership competency frameworks and curricular content, audience, duration, electivity, selectivity, learning pedagogies, and outcome measures. The curricular content was coded and categorized within the Medical Leadership Competency Framework (MLCF) using the constant comparative method. A repeated search of the literature on May 14, 2021, did not yield any additional studies., Results: Of 1,094 unique studies, 25 studies reporting on 25 curricula met inclusion criteria. The course content of the curricula was organized into 91 distinct themes, most of which could be organized into the first 2 competencies of the MLCF: Demonstrating Personal Qualities and Working With Others. Thirteen curricula (52%) aligned with leadership competency frameworks, and 12 (48%) did not appear to use a framework. Number of participants and target learner level varied widely, as did curricula duration, with fewer than half (n = 12, 48%) spanning more than 1 semester. Most curricula (n = 14, 56%) were elective, and many (n = 16, 64%) offered experiential learning. Most studies (n = 16, 64%) reported outcomes as student perception data., Conclusions: The authors found wide variation in content of U.S. UME leadership development curricula, and few curricula aligned with an established leadership competency framework. The lack of professional consensus on the scope of medical leadership and how it should be taught thwarts effective incorporation of medical leadership training within UME., (Copyright © 2022 by the Association of American Medical Colleges.)

The COVID-19 pandemic caused substantial disruptions in medical education. The University of British Columbia (UBC) MD Undergraduate Program (MDUP) is the sixth-largest medical school in North America. MDUP students and faculty developed a joint response to these disruptions to address the curriculum and public health challenges that the pandemic posed. After clinical activities were suspended in March 2020, third- and fourth-year MDUP students formed a COVID-19 Medical Student Response Team (MSRT) to support frontline physicians, public health agencies, and community members affected by the pandemic. A nimble organizational structure was developed across 4 UBC campuses to ensure a rapid response to meet physician and community needs. Support from the faculty ensured the activities were safe for the public, patients, and students and facilitated the provision of curricular credit for volunteer activities meeting academic criteria. As of June 19, 2020, more than 700 medical students had signed up to participate in 68 projects. The majority of students participated in projects supporting the health care system, including performing contact tracing, staffing public COVID-19 call centers, distributing personal protective equipment, and creating educational multimedia products. Many initiatives have been integrated into the MDUP curriculum as scholarly activities or paraclinical electives for which academic credit is awarded. This was made possible by the inherent flexibility of the MDUP curriculum and a strong existing partnership between students and faculty. Through this process, medical students were able to develop fundamental leadership, advocacy, communication, and collaboration skills, essential competencies for graduating physicians. In developing a transparent, accountable, and inclusive organization, students were able to effectively meet community needs during a crisis and create a sustainable and democratic structure capable of responding to future emergencies. Open dialogue between the MSRT and the faculty allowed for collaborative problem solving and the opportunity to transform disruption into academic innovation., (Copyright © 2021 by the Association of American Medical Colleges.)

Problem: There is a paucity of guidance regarding implementation of telemedicine curricula at the clerkship level, particularly with students actively engaged in video and telephone encounters. The COVID-19 pandemic caused rapid shifts in the delivery of medical education to clerkship-level students. This article describes the successful pilot of a direct patient care, virtual health curriculum at the clerkship level and discusses lessons learned., Approach: All 18 preceptors and 5 students at Stanford University School of Medicine, California, enrolled in the required 4-week family medicine clerkship in April 2020 were connected as virtual partners via a commercial video platform. The combined use of both this video program and Epic electronic health record (EHR) software as modes for teaching and patient care led to technical challenges and logistical hurdles. As part of an iterative process, clerkship leadership identified problems via preceptor and student interviews and integrated that feedback to create a model for delivering high-quality, clerkship-level clinical instruction during the COVID-19 shelter in place order., Outcomes: Of those who completed an evaluation, the majority of preceptors (n = 16; 89%) and students (n = 4; 100%, 1 student did not respond) expressed satisfaction with the virtual, remote teaching model conducted over 37 clinic visits. A detailed 14-step process list resulted from identifying and addressing both audio and video technical challenges and is provided for use by other institutions that wish to implement this workflow., Next Steps: Future directions include assessing patient perspectives on the involvement of students in virtual visits, soliciting patient input for a more robust patient-physician-student virtual experience, and integrating a multiparty platform, when available, via the EHR to afford greater student autonomy., (Copyright © 2021 by the Association of American Medical Colleges.)

Purpose: With the growing importance of professionalism in medical education, it is imperative to develop professionalism assessments that demonstrate robust validity evidence. The Professionalism Mini-Evaluation Exercise (P-MEX) is an assessment that has demonstrated validity evidence in the authentic clinical setting. Identifying the factorial structure of professionalism assessments determines professionalism constructs that can be used to provide diagnostic and actionable feedback. This study examines validity evidence for the P-MEX, a focused and standardized assessment of professionalism, in a simulated patient setting., Method: The P-MEX was administered to 275 pediatric residency applicants as part of a 3-station standardized patient encounter, pooling data over an 8-year period (2012 to 2019 residency admission years). Reliability and construct validity for the P-MEX were evaluated using Cronbach's alpha, exploratory factor analysis (EFA), and confirmatory factor analysis (CFA)., Results: Cronbach's alpha for the P-MEX was 0.91. The EFA yielded 4 factors: doctor-patient relationship skills, interprofessional skills, professional demeanor, and reflective skills. The CFA demonstrated good model fit with a root-mean-square error of approximation of .058 and a comparative fit index of .92, confirming the reproducibility of the 4-factor structure of professionalism., Conclusions: The P-MEX demonstrates construct validity as an assessment of professionalism, with 4 underlying subdomains in doctor-patient relationship skills, interprofessional skills, professional demeanor, and reflective skills. These results yield new confidence in providing diagnostic and actionable subscores within the P-MEX assessment. Educators may wish to integrate the P-MEX assessment into their professionalism curricula., (Copyright © 2021 by the Association of American Medical Colleges.)

Problem: The COVID-19 pandemic has presented a unique set of challenges to medical education globally. Low- and middle-income countries (LMICs) have faced unique barriers in transitioning to virtual modalities, and many medical students in LMICs experienced dramatically reduced educational time. The authors created the Global Medical Education Collaborative (GMEC) to address this problem by providing free, online, case-based tutorials to medical students in LMICs during the pandemic., Approach: The authors developed a needs assessment to gauge students' educational requirements, which informed GMEC's 2 primary goals: to provide free access to interactive online tutorials for students in LMICs and to bridge the physical distance between educators and learners via an online platform. A pilot program in Nigeria (April 26-May 26, 2020) helped inform the current strategy and logistics. Tutors and students were recruited via social media and medical education networks at the authors' home institutions., Outcomes: Within the first 2 months (April 26-June 26, 2020), 324 students representing 12 countries and 20+ medical schools joined GMEC. Additionally, 95 physicians and trainees joined as tutors and, collectively, delivered 52 tutorials. Students responded to a needs assessment querying confidence in various clinical domains, interest in covering clinical topics, barriers to virtual learning, and the effect of the pandemic on their education. Tutors held 1-hour, interactive tutorials over Zoom covering a variety of clinical topics. According to surveys, 91% of students (71 of 78) felt more confident in the material related to the tutorial's topic after participating., Next Steps: GMEC will continue to engage students, tutors, and collaborators to facilitate the delivery of innovative, high-quality tutorials to students affected by COVID-19 in LMICs. To ensure that the platform is sustainable and aligned with GMEC's mission to promote equity in global medical education, the collaborative will need to be agile and responsive., (Copyright © 2021 by the Association of American Medical Colleges.)

Purpose: Disciplinary action imposed on physicians indicates their fitness to practice medicine is impaired and patient safety is potentially at risk. This national retrospective cohort study sought to examine whether there was an association between academic attainment or performance on a situational judgment test (SJT) in medical school and the risk of receiving disciplinary action within the first 5 years of professional practice in the United Kingdom., Method: The authors included data from the UK Medical Education Database for 34,865 physicians from 33 U.K. medical schools that started the UK Foundation Programme (similar to internship) between 2014 and 2018. They analyzed data from 2 undergraduate medical assessments used in the United Kingdom: the Educational Performance Measure (EPM), which is based on academic attainment, and SJT, which is an assessment of professional attributes. The authors calculated hazard ratios (HRs) for EPM and SJT scores., Results: The overall rate of disciplinary action was low (65/34,865, 0.19%) and the mean time to discipline was 810 days (standard deviation [SD] = 440). None of the physicians with fitness to practice concerns identified as students went on to receive disciplinary action after they qualified as physicians. The multivariate survival analysis demonstrated that a score increase of 1 SD (approximately 7.6 percentage points) on the EPM reduced the hazard of disciplinary action by approximately 50% (HR = 0.51; 95% confidence interval [CI]: 0.38, 0.69; P < .001). There was not a statistically significant association between the SJT score and the hazard of disciplinary action (HR = 0.84; 95% CI: 0.62, 1.13; P = .24)., Conclusions: An increase in EPM score was significantly associated with a reduced hazard of disciplinary action, whereas performance on the SJT was not. Early identification of increased risk of disciplinary action may provide an opportunity for remediation and avoidance of patient harm., (Copyright © 2021 by the Association of American Medical Colleges.)

Problem: In March 2020, the novel coronavirus 2019 (COVID-19) became a global pandemic. Medical schools around the United States faced difficult decisions, temporarily suspending hospital-based clerkship rotations for medical students due to potential shortages of personal protective equipment and a need to social distance. This decision created a need for innovative, virtual learning opportunities to support undergraduate medical education., Approach: Educators at Yale School of Medicine developed a novel medical student curriculum converting high-fidelity, mannequin-based simulation into a fully online virtual telesimulation format. By using a virtual videoconferencing platform to deliver remote telesimulation as an immersive educational experience for widely dispersed students, this novel technology retains the experiential strengths of simulation-based learning while complying with needs for social distancing during the pandemic. The curriculum comprises simulated clinical scenarios that include live patient actors; facilitator interactions; and real-time assessment of vital signs, labs, and imaging. Each 90-minute session includes 2 sets of simulation scenarios and faculty-led teledebriefs. A team of 3 students performs the first scenario, while an additional team of 3 students observes. Teams reverse roles for the second scenario., Outcomes: The 6-week virtual telesimulation elective enrolled the maximum 48 medical students and covered core clinical clerkship content areas. Communication patterns within the virtual telesimulation format required more deliberate turn-taking than normal conversation. Using the chat function within the videoconferencing platform allowed teams to complete simultaneous tasks. A nurse confederate provided cues not available in the virtual telesimulation format., Next Steps: Rapid dissemination of this program, including online webinars and live demonstration sessions with student volunteers, supports the development of similar programs at other universities. Evaluation and process improvement efforts include planned qualitative evaluation of this new format to further understand and refine the learning experience. Future work is needed to evaluate clinical skill development in this educational modality., (Copyright © 2021 by the Association of American Medical Colleges.)