Search

Introduction: Program signaling (PS), which enables residency applicants to signal their preference for a specific program, was introduced in emergency medicine (EM) in the 2022-2023 residency application cycle. In this study we evaluated EM program directors' (PD) utilization of PS in application review and ranking. This study also explores the relationship between program characteristics and number of signals received as well as the relative importance and utilization of signals related to the number of signals received., Methods: This is an institutional review board-approved, cross-sectional study of PDs at Accreditation Council for Graduate Medical Education-accredited EM residency programs. We used descriptive statistics to describe the characteristics of residency programs and practices around PS. Measures of central tendency and dispersion summarized continuous variables. We used chi-square analysis or the Fisher exact test for comparisons between groups for categorical variables. Comparisons for continuous variables were made using the t -test for independent samples or analysis of variance., Results: The response rate was 41% (n = 113/277 EM programs). Most programs participated in PS (n = 261/277 EM programs, 94.2%). Mean number of signals received was 60 (range 2-203). Signals received varied based on program characteristics including geographic location and program type, duration, environment, and longevity. Most used PS in holistic review (52.2%), but other uses varied by proportion of applications that were signaled. The importance of PS in application review (mean 2.9; 1-5 scale, 1 = not important, 5 = extremely important) and rank list preparation (2.1) was relatively low compared to other application elements such as standardized letters of evaluation (4.97 for review, 4.90 for ranking)., Conclusion: The study provides insights into PS utilization in EM's inaugural year. We have identified patterns of signal use based on program characteristics and number of signals received that can inform signal allocation and utilization on an individual applicant and program level. A more nuanced understanding of signal use can provide valuable insight as the specialty of EM grapples with fluctuations in its applicant numbers and shifting demographics of its applicant pool., Competing Interests: Conflicts of Interest: By the WestJEM article submission agreement, all authors are required to disclose all affiliations, funding sources and financial or management relationships that could be perceived as potential sources of bias. No author has professional or financial relationships with any companies that are relevant to this study. There are no conflicts of interest or sources of funding to declare.

Background: Academic emergency medicine (EM) communities have viewed anonymous online communities (AOC) such as Reddit or specialty-specific "applicant spreadsheets" as poor advising resources. Despite this, robust EM AOCs exist, with large user bases and heavy readership. Insights about applicants' authentic experiences can be critical for applicants and program leadership decision-making. To date, there are no EM studies to qualitatively assess EM AOC narratives during the application cycle. Our goal was to perform a qualitative analysis of students' EM program experiences through a publicly available AOC., Methods: This was a qualitative analysis of a publicly available, time-stamped, user-locked AOC dataset: "Official 2020-2021 Emergency Medicine Applicant Spreadsheet." We extracted and then de-identified all data from selected sub-sheets entitled "Virtual Interview Impressions" and "Rotation Impressions." Four investigators used constant comparative method to analyze the data inductively, and they subsequently met to generate common themes discussed by students. Preliminary thematic analysis was conducted on a random sample of 37/183 (20%) independent narratives to create the initial codebook. This was used and updated iteratively to analyze the entire narrative set consisting of 841 discrete statements. Finally, two unique codes were created to distinguish whether the identified sub-themes, or program attributes, were likely "modifiable" or "non-modifiable.", Results: We identified six major themes: living and working conditions; interpersonal relationships; learning experiences, postgraduate readiness, and online/virtual supplements. Common sub-themes included patient population (13%); resident personality (7%); program leadership personality (7%); relationship with faculty/leadership (6%); geography (4%); practice setting (4%); program reputation (4%), and postgraduate year-3 experiences (4%). Modifiable sub-themes outnumbered non-modifiable sub-themes, 60.7% to 39.3%., Conclusion: In this analysis of selected medical students' narratives in an AOC, the majority of identified themes represented topics that may serve as external feedback for EM residency programs and their clerkships. Selective use of AOCs may set a precedent for future program assessments by applicants and inform program leadership of important programmatic elements in the eyes of applicants. It elucidates important themes in their interactions or learning experiences with programs and creates opportunities for learner-centric program improvement., Competing Interests: Conflicts of Interest: By the WestJEM article submission agreement, all authors are required to disclose all affiliations, funding sources and financial or management relationships that could be perceived as potential sources of bias. No author has professional or financial relationships with any companies that are relevant to this study. This research was funded in part by an EMRA Be the Change Grant awarded in 2021.