Search

Background The pass rate on the American Board of Internal Medicine (ABIM) nephrology certifying exam has declined and is among the lowest of all internal medicine (IM) subspecialties. In recent years, there have also been fewer applicants for the nephrology fellowship match. Methods This retrospective observational study assessed how changes between 2010 and 2019 in characteristics of 4094 graduates of US ACGME-accredited nephrology fellowship programs taking the ABIM nephrology certifying exam for the first time, and how characteristics of their fellowship programs were associated with exam performance. The primary outcome measure was performance on the nephrology certifying exam. Fellowship program pass rates over the decade were also studied. Results Lower IM certifying exam score, older age, female sex, international medical graduate (IMG) status, and having trained at a smaller nephrology fellowship program were associated with poorer nephrology certifying exam performance. The mean IM certifying exam percentile score among those who subsequently took the nephrology certifying exam decreased from 56.7 (SD, 27.9) to 46.1 (SD, 28.7) from 2010 to 2019. When examining individuals with comparable IM certifying exam performance, IMGs performed less well than United States medical graduates (USMGs) on the nephrology certifying exam. In 2019, only 57% of nephrology fellowship programs had aggregate 3-year certifying exam pass rates ≥80% among their graduates. Conclusions Changes in IM certifying exam performance, certain trainee demographics, and poorer performance among those from smaller fellowship programs explain much of the decline in nephrology certifying exam performance. IM certifying exam performance was the dominant determinant.

PURPOSE To examine whether there are group differences in milestone ratings submitted by program directors working with clinical competency committees (CCCs) based on gender for internal medicine (IM) residents and whether women and men rated similarly on milestones perform comparably on subsequent in-training and certification examinations. METHOD This national retrospective study examined end-of-year medical knowledge (MK) and patient care (PC) milestone ratings and IM In-Training Examination (IM-ITE) and IM Certification Examination (IM-CE) scores for 2 cohorts (2014-2017, 2015-2018) of U.S. IM residents at ACGME-accredited programs. It included 20,098/21,440 (94%) residents, with 9,424 women (47%) and 10,674 men (53%). Descriptive statistics and differential prediction techniques using hierarchical linear models were performed. RESULTS For MK milestone ratings in PGY-1, men and women showed no statistical difference at a significance level of .01 (P = .02). In PGY-2 and PGY-3, men received statistically higher average MK ratings than women (P = .002 and P < .001, respectively). In contrast, men and women received equivalent average PC ratings in each PGY (P = .47, P = .72, and P = .80, for PGY-1, PGY-2, and PGY-3, respectively). Men slightly outperformed women with similar MK or PC ratings in PGY-1 and PGY-2 on the IM-ITE by about 1.7 and 1.5 percentage points, respectively, after adjusting for covariates. For PGY-3 ratings, women and men with similar milestone ratings performed equivalently on the IM-CE. CONCLUSIONS Milestone ratings were largely similar for women and men. Generally, women and men with similar MK or PC milestone ratings performed similarly on future examinations. Although there were small differences favoring men on earlier examinations, these differences disappeared by the final training year. It is questionable whether these small differences are educationally or clinically meaningful. The findings suggest fair, unbiased milestone ratings generated by program directors and CCCs assessing residents.

Purpose: To assess the correlations between United States Medical Licensing Examination (USMLE) performance, American College of Physicians (ACP) Internal Medicine In-Training Examination (IM-ITE) performance, American Board of Internal Medicine (ABIM) Internal Medicine Certification Exam (IM-CE) performance, and other medical knowledge and demographic variables. Method: The study included 9,676 postgraduate year (PGY) 1, 11,424 PGY2, and 10,239 PGY3 internal medicine (IM) residents from any Accreditation Council for Graduate Medical Education-accredited IM residency program who took the IM-ITE (2014 or 2015) and the IM-CE (2015-2018). USMLE scores, IM-ITE percent correct scores, and IM-CE scores were analyzed using multiple linear regression and IM-CE pass/fail status was analyzed using multiple logistic regression, controlling for USMLE Step 1, Step 2 Clinical Knowledge, and Step 3 scores; averaged medical knowledge milestones; age at IM-ITE; gender; and medical school location (United States or Canada vs international). Results: All variables were significant predictors of passing the IM-CE with IM-ITE scores having the strongest association and USMLE Step scores being the next strongest predictors. Prediction curves for the probability of passing the IM-CE based solely on IM-ITE score for each PGY show that residents must score higher on the IM-ITE with each subsequent administration to maintain the same estimated probability of passing the IM-CE. Conclusions: The findings from this study should support residents and program directors in their efforts to more precisely identify and evaluate knowledge gaps for both personal learning and program improvement. While no individual USMLE Step score was as strongly predictive of IM-CE score as IM-ITE score, the combined relative contribution of all 3 USMLE Step scores was of a magnitude similar to that of IM-ITE score.

To evaluate validity evidence for internal medicine milestone ratings across programs for three resident cohorts by quantifying "not assessable" ratings; reporting mean longitudinal milestone ratings for individual residents; and correlating medical knowledge ratings across training years with certification examination scores to determine predictive validity of milestone ratings for certification outcomes.This retrospective study examined milestone ratings for postgraduate year (PGY) 1-3 residents in U.S. internal medicine residency programs. Data sources included milestone ratings, program characteristics, and certification examination scores.Among 35,217 participants, there was a decreased percentage with "not assessable" ratings across years: 1,566 (22.5%) PGY1s in 2013-2014 versus 1,219 (16.6%) in 2015-2016 (P = .01), and 342 (5.1%) PGY3s in 2013-2014 versus 177 (2.6%) in 2015-2016 (P = .04). For individual residents with three years of ratings, mean milestone ratings increased from around 3 (behaviors of an early learner or advancing resident) in PGY1 (ranging from a mean of 2.73 to 3.19 across subcompetencies) to around 4 (ready for unsupervised practice) in PGY3 (mean of 4.00 to 4.22 across subcompetencies, P.001 for all subcompetencies). For each increase of 0.5 units in two medical knowledge (MK1, MK2) subcompetency ratings, the difference in examination scores for PGY3s was 19.5 points for MK1 (P.001) and 19.0 for MK2 (P.001).These findings provide evidence of validity of the milestones by showing how training programs have applied them over time and how milestones predict other training outcomes.

The American board of internal medicine (ABIM) establishes standards for physicians. The American geriatrics society (AGS) is a not-for-profit membership organization of nearly 6,000 health professionals devoted to improving the health, independence, and quality of life of all older people. Beginning in 2013, ABIM redesigned its governance structure, including the role of the specialty boards. Specialty boards are charged with responsibilities for oversight in four main areas: (1) the assessments used in initial certification and maintenance of certification (MOC); (2) medical knowledge self-assessment and practice assessment in the specialty; (3) building relationships with relevant professional societies and other organizational stakeholders; and (4) issues related to training requirements for initial certification eligibility within the specialty. The aim of this paper is to inform the geriatrics community regarding the function of geriatric medicine board (GMB) of the ABIM, and to invite the geriatrics community to fully engage with and leverage the GMB as a partner to: (1) develop better certification examinations and processes, identifying better knowledge and practice assessments, and in establishing appropriate training and MOC requirements for geriatric medicine; (2) leverage ABIM assets to conduct applied research to guide the field in the areas of training and certification and workforce development in geriatric medicine; (3) make MOC relevant for practicing geriatricians. Active engagement of the geriatrics community with ABIM and the GMB will ensure that certification in geriatric medicine provides the greatest possible value and meaning to physicians, patients, and the public.

The American College of Cardiology In-Training Exam (ACC-ITE) is incorporated into most U.S. training programs, but its relationship to performance on the American Board of Internal Medicine Cardiovascular Disease (ABIM CVD) Certification Examination is unknown. ACC-ITE scores from third-year fellows from 2011 to 2014 (n = 1,918) were examined. Covariates for regression analyses included sex, age, medical school country, U.S. Medical Licensing Examination Step, and ABIM Internal Medicine Certification Examination scores. A secondary analysis examined fellows (n = 511) who took the ACC-ITE in the first and third years. ACC-ITE scores were the strongest predictor of ABIM CVD scores (p < 0.0001), and the most significant predictor of passing (p < 0.0001). The change in ACC-ITE scores from first to third year was a strong predictor of the ABIM CVD score (p < 0.001). The ACC-ITE is strongly associated with performance on the ABIM CVD Certification Examination.

Pregnancy and its impact on graduate medical training are not well understood. To examine the effect of gender and pregnancy for Internal Medicine (IM) residents on evaluations by peers and faculty. This was a retrospective cohort study. All IM residents in training from July 1, 2004–June 30, 2014, were included. Female residents who experienced pregnancy and male residents whose partners experienced pregnancy during training were identified using an existing administrative database. Mean evaluation scores by faculty and peers were compared relative to pregnancy (before, during, and after), accounting for the gender of both the evaluator and resident in addition to other available demographic covariates. Potential associations were assessed using mixed linear models. Of 566 residents, 117 (20.7%) experienced pregnancy during IM residency training. Pregnancy was more common in partners of male residents (24.7%) than female residents (13.2%) (p = 0.002). In the post-partum period, female residents had lower peer evaluation scores on average than their male counterparts (p = 0.0099). A large number of residents experience pregnancy during residency. Mean peer evaluation scores were lower after pregnancy for female residents. Further study is needed to fully understand the mechanisms behind these findings, develop ways to optimize training throughout pregnancy, and explore any unconscious biases that may exist.

To summarize characteristics and validity evidence of tools that assess teamwork in undergraduate medical education (UME), and provide recommendations for addressing the interprofessional collaboration competencies of the Association of American Medical Colleges (AAMC).The authors conducted a systematic review, searching MEDLINE, MEDLINE In-process, CINAHL, and PsycINFO from January 1, 1979, through April 1, 2014; they searched reference lists and national meeting abstracts. They included original research reports that described a quantitative tool used to assess teamwork in UME. They abstracted characteristics and validity evidence for the tools, plus study quality, according to established frameworks. Two authors independently abstracted 25% of articles and calculated agreement. Authors then applied predefined criteria to identify tools best suited to address the AAMC's teamwork competencies.Of 13,549 citations, 70 articles describing 64 teamwork assessment tools were included. Of these 64 tools, 27 (42%) assessed teamwork in classroom, 31 (48%) in simulation, and only 7 (11%) in actual clinical settings. The majority (47; 73%) of tools assessed medical students' teamwork in interprofessional teams. On the basis of content concordance, strength of validity evidence, generalizability of scores, and level of outcomes, four published tools were recommended to assess the AAMC's teamwork competencies: the Collaborative Healthcare Interdisciplinary Relationship Planning Scale, Readiness for Interprofessional Learning Scale, Communication and Teamwork Skills assessment, and Teamwork Mini-Clinical Evaluation Exercise.Substantial validity evidence supports the use of several UME teamwork assessments. Four tools have been appropriately designed and sufficiently studied to constitute appropriate assessments of the AAMC's teamwork competencies.

Purpose To accelerate change in primary care training by undertaking a national effort to build interprofessional (IP) faculty teams. Methods This quasi-experimental mixed method study, conducted between 2015 and 2018, included >100 faculty and staff from medicine, nursing, pharmacy, physician assistant, and behavioral health from 9 institutions. Participants completed surveys at baseline, one year after training, and at program's completion to measure perceived changes in skills, clinics and training programs. Qualitative methods involved analyses of training and site visit observations and telephone interviews with team members. Results Self-assessment of competency in IP care and education, patient centered care, and leadership improved significantly for 15/15 (100%) skills assessed before and after program completion (p Conclusion Creating and supporting IP primary care teams of faculty and staff within institutions appears to accelerate clinical learning environment transformation. Further study should determine if this model can sustain IP collaborative practice and education in other settings.

The Accreditation Council for Graduate Medical Education (ACGME) has surveyed residents since 2003, and faculty since 2012. Surveys are designed to assess program functioning and specify areas for improvement. The purpose of this study was to assess the association of the ACGME's resident and faculty surveys with residency-program-specific performance on the American Board of Internal Medicine (ABIM) certification exam.Data were available from residents and faculty in 375 U.S. ACGME-accredited internal medicine programs from the 2012-2013, 2013-2014, and 2014-2015 academic years. Analysis of variance and correlations were used to examine the relationship between noncompliance with ACGME program requirements as assessed by the resident and faculty surveys, and ABIM program pass rates.Noncompliance reported on the resident and faculty surveys was highest for programs not meeting the ACGME program requirement of an 80% pass rate on the ABIM certification examination. This relationship was significant for overall noncompliance, both within the resident (P.001) and faculty (P.05) surveys, for many areas within the two surveys (correlations ranged between -.07 and -.25, and P values ranged between .20 and.001), and for the highest levels of noncompliance across areas of the resident (P.001) and faculty (P.04) surveys.ACGME resident and faculty surveys were significantly associated with ABIM program pass rates, supporting the importance of these surveys within the ACGME's Next Accreditation System.

Theory: Networking has positive effects on career development; however, personal characteristics of group members such as gender or diversity may foster or hinder member connectedness. Social network analysis explores interrelationships between people in groups by measuring the strength of connection between all possible pairs in a given network. Social network analysis has rarely been used to examine network connections among members in an academic medical society. This study seeks to ascertain the strength of connection between program directors in the Association of Program Directors in Internal Medicine (APDIM) and its Education Innovations Project subgroup and to examine possible associations between connectedness and characteristics of program directors and programs. Hypotheses: We hypothesize that connectedness will be measurable within a large academic medical society and will vary significantly for program directors with certain measurable characteristics (e.g., age, gender, rank, location, burnout levels, desire to resign). Method: APDIM program directors described levels of connectedness to one another on the 2012 APDIM survey. Using social network analysis, we ascertained program director connectedness by measuring out-degree centrality, in-degree centrality, and eigenvector centrality, all common measures of connectedness. Results: Higher centrality was associated with completion of the APDIM survey, being in a university-based program, Educational Innovations Project participation, and higher academic rank. Centrality did not vary by gender; international medical graduate status; previous chief resident status; program region; or levels of reported program director burnout, callousness, or desire to resign. Conclusions: In this social network analysis of program directors within a large academic medical society, we found that connectedness was related to higher academic rank and certain program characteristics but not to other program director characteristics like gender or international medical graduate status. Further research is needed to optimize our understanding of connection in organizations such as these and to determine which strategies promote valuable connections.

Electrophysiology (EP) is an increasingly complicated field. Recognition of the complexity and scope of EP training has resulted in a consensus that it requires more than 12 months to become competent in the vast array of required decision-making and procedural skills. We aim to provide an update on

Resident physicians routinely perform bedside procedures that pose substantial risk to patients. However, no standard programmatic approach to supervision and procedural competency assessment among residents currently exists. The authors performed a national survey of internal medicine (IM) program directors to examine procedural assessment and supervision practices of IM residency programs. Procedures chosen were those commonly performed by medicine residents at the bedside. Of the 368 IM programs, 226 (61%) completed the survey. Programs reported the predominant method of training as 171 (74%) apprenticeship and 106 (46%) as module based. The majority of programs used direct observation to attest to competence, with 55% to 62% relying on credentialed residents. Most programs also relied on a minimum number of procedures to determine competence (64%-88%), 72% of which reported 5 procedures (a lapsed historical standard). This national survey demonstrates that procedural assessment practices for IM residents are insufficiently robust and may put patients at undue risk.

Objectives With the advent of compact ultrasound (US) devices, it is easier for physicians to enhance their physical examinations through the use of US. However, although this new tool is widely available, few internal medicine physicians have US training. This study sought to understand physicians’ baseline knowledge and skill, provide education in US principles, and demonstrate that proper use of compact US devices is a skill that can be quickly learned. Methods Training was performed at the Mayo Clinic in June 2010 and June 2011. The participants consisted of internal medicine residents. The workshop included didactics and hands-on US experiences with human and cadaver models in a simulation center. Pretests and posttests of residents’ knowledge, attitudes, and skills with US were completed. We reassessed the 2010 group in the spring of 2012 with a long-term retention survey for knowledge and confidence in viewing images. Results A total of 136 interns completed the workshop. Thirty-nine residents completed the long-term retention survey. Posttest assessments showed a statistically significant improvement in the knowledge of US imaging, confidence in identifying structures, image identification, and image acquisition (P < .0001). In the long-term retention study, knowledge of US imaging and confidence in identifying structures did decline. Conclusions This educational intervention resulted in improvement in US knowledge and image acquisition. However, the knowledge diminished over time, suggesting that further education is needed if US is to become an important component of internal medicine training and practice.

Background Point-of-care (POC) ultrasound has been shown to improve procedural outcomes and physical examination accuracy in multiple settings. There are limited data regarding the optimal way to train nonradiologists in POC ultrasound. This is a primary barrier to more widespread use of ultrasound in the physical examination. Objective We created a workshop to instruct postgraduate year (PGY)-2 and PGY-3 internal medicine residents in POC ultrasound imaging of the abdominal aorta and kidneys. Methods A half-day simulation center workshop was created to review ultrasound operations and teach residents to independently obtain ultrasound images of the abdominal aorta and kidneys on standardized patients with normal anatomy. The workshop incorporated didactic instruction and hands-on ultrasound practice in small groups. Each resident's ability to independently obtain ultrasound images was assessed using a preworkshop and postworkshop skills examination with a standardized patient. Resident knowledge and attitudes toward POC ultrasound were also assessed using a preworkshop and postworkshop test and survey. Results A total of 58 residents completed the workshop, and 84% were able to independently obtain high-quality images of the abdominal aorta and kidney after workshop completion, compared with 16% on the preworkshop test. Residents demonstrated a statistically significant increase in their self-reported confidence with ultrasound operation and image acquisition. Conclusions Training using standardized patients can prepare residents to independently obtain POC ultrasound images of the aorta and kidneys. Training resulted in increased resident confidence with POC ultrasound and self-reported likelihood of future use.

Background Evidence-based practice in education requires high-quality evidence, and many in the medical education community have called for an improvement in the methodological quality of education research. Objective Our aim was to use a valid measure of medical education research quality to highlight the methodological quality of research publications and provide an overview of the recent internal medicine (IM) residency literature. Methods We searched MEDLINE and PreMEDLINE to identify English-language articles published in the United States and Canada between January 1, 2010, and December 31, 2011, focusing on IM residency education. Study quality was assessed using the Medical Education Research Study Quality Instrument (MERSQI), which has demonstrated reliability and validity. Qualitative articles were excluded. Articles were ranked by quality score, and the top 25% were examined for common themes, and 2 articles within each theme were selected for in-depth presentation. Results The search identified 731 abstracts of which 223 articles met our inclusion criteria. The mean (±SD) MERSQI score of the 223 studies included in the review was 11.07 (±2.48). Quality scores were highest for data analysis (2.70) and lowest for study design (1.41) and validity (1.29). The themes identified included resident well-being, duty hours and resident workload, career decisions and gender, simulation medicine, and patient-centered outcomes. Conclusions Our review provides an overview of the IM medical education literature for 2010–2011, highlighting 5 themes of interest to the medical education community. Study design and validity are 2 areas where improvements in methodological quality are needed, and authors should consider these when designing research protocols.

Physician burnout and distress has been described in national studies of practicing physicians, internal medicine (IM) residents, IM clerkship directors, and medical school deans. However, no comparable national data exist for IM residency program directors.To assess burnout and distress among IM residency program directors, and to evaluate relationships of distress with personal and program characteristics and perceptions regarding implementation and consequences of Accreditation Council for Graduate Medical Education (ACGME) regulations.The 2010 Association of Program Directors in Internal Medicine (APDIM) Annual Survey, developed by the APDIM Survey Committee, was sent in August 2010 to the 377 program directors with APDIM membership, representing 99.0 % of the 381 United States categorical IM residency programs.The 2010 APDIM Annual Survey included validated items on well-being and distress, including questions addressing quality of life, satisfaction with work-life balance, and burnout. Questions addressing personal and program characteristics and perceptions regarding implementation and consequences of ACGME regulations were also included.Of 377 eligible program directors, 282 (74.8 %) completed surveys. Among respondents, 12.4 % and 28.8 % rated their quality of life and satisfaction with work-life balance negatively, respectively. Also, 27.0 % reported emotional exhaustion, 10.4 % reported depersonalization, and 28.7 % reported overall burnout. These rates were lower than those reported previously in national studies of medical students, IM residents, practicing physicians, IM clerkship directors, and medical school deans. Aspects of distress were more common among younger program directors, women, and those reporting greater weekly work hours. Work-home conflicts were common and associated with all domains of distress, especially if not resolved in a manner effectively balancing work and home responsibilities. Associations with program characteristics such as program size and American Board of Internal Medicine (ABIM) pass rates were not found apart from higher rates of depersonalization among directors of community-based programs (23.5 % vs. 8.6 %, p = 0.01). We did not observe any consistent associations between distress and perceptions of implementation and consequences of program regulations.The well-being of IM program directors across domains, including quality of life, satisfaction with work-life balance, and burnout, appears generally superior to that of medical trainees, practicing physicians, and other medical educators nationally. Additionally, it is reassuring that program directors' perceptions of their ability to respond to current regulatory requirements are not adversely associated with distress. However, the increased distress levels among younger program directors, women, and those at community-based training programs reported in this study are important concerns worthy of further study.

BACKGROUND There have been recent calls for improved internal medicine outpatient training, yet assessment of clinical and educational variables within existing models is lacking.

Patient care and medical knowledge are Accreditation Council for Graduate Medical Education (ACGME) core competencies. The correlation between amount of patient contact and knowledge acquisition is not known.To determine if a correlation exists between the number of patient encounters and in-training exam (ITE) scores in internal medicine (IM) and pediatric residents at a large academic medical center.Retrospective cohort studyResident physicians at Mayo Clinic from July 2006 to June 2010 in IM (318 resident-years) and pediatrics (66 resident-years).We tabulated patient encounters through review of clinical notes in an electronic medical record during post graduate year (PGY)-1 and PGY-2. Using linear regression models, we investigated associations between ITE score and number of notes during the previous PGY, adjusted for previous ITE score, gender, medical school origin, and conference attendance.For IM, PGY-2 admission and consult encounters in the hospital and specialty clinics had a positive linear association with ITE-3 % score (β = 0.02; p = 0.004). For IM, PGY-1 conference attendance is positively associated with PGY-2 ITE performance. We did not detect a correlation between PGY-1 patient encounters and subsequent ITE scores for IM or pediatric residents. No association was found between IM PGY-2 ITE score and inpatient, outpatient, or total encounters in the first year of training. Resident continuity clinic and total encounters were not associated with change in PGY-3 ITE score.We identified a positive association between hospital and subspecialty encounters during the second year of IM training and subsequent ITE score, such that each additional 50 encounters were associated with an increase of 1 % correct in PGY-3 ITE score after controlling for previous ITE performance and continuity clinic encounters. We did not find a correlation for volume of encounters and medical knowledge for IM PGY-1 residents or the pediatric cohort.

High-quality assessment of resident performance is needed to guide individual residents' development and ensure their preparedness to provide patient care. To facilitate this aim, reporting milestones are now required across all internal medicine (IM) residency programs.To describe initial milestone ratings for the population of IM residents by IM residency programs.Cross-sectional study.IM residency programs.All IM residents whose residency program directors submitted milestone data at the end of the 2013-2014 academic year.Ratings addressed 6 competencies and 22 subcompetencies. A rating of "not assessable" indicated insufficient information to evaluate the given subcompetency. Descriptive statistics were calculated to describe ratings across competencies and training years.Data were available for all 21 774 U.S. IM residents from all 383 programs. Overall, 2889 residents (1621 in postgraduate year 1 [PGY-1], 902 in PGY-2, and 366 in PGY-3) had at least 1 subcompetency rated as not assessable. Summaries of average ratings by competency and training year showed higher ratings for PGY-3 residents in all competencies. Overall ratings for each of the 6 individual competencies showed that fewer than 1% of third-year residents were rated as "unsatisfactory" or "conditional on improvement." However, when subcompetency milestone ratings were used, 861 residents (12.8%) who successfully completed training had at least 1 competency with all corresponding subcompetencies graded below the threshold of "readiness for unsupervised practice."Data were derived from a point in time in the first reporting period in which milestones were used.The initial milestone-based evaluations of IM residents nationally suggest that documenting developmental progression of competency is possible over training years. Subcompetencies may identify areas in which residents might benefit from additional feedback and experience. Future work is needed to explore how milestones are used to support residents' development and enhance residency curricula.None.

To report findings from a national effort initiated by three primary care certifying boards to catalyze change in primary care training.In this mixed-method pilot study (2012-2014), 36 faculty in 12 primary care residencies (family medicine, internal medicine, pediatrics) from four institutions participated in a professional development program designed to prepare faculty to accelerate change in primary care residency training by uniting them in a common mission to create effective ambulatory clinical learning environments. Surveys administered at baseline and 12 months after initial training measured changes in faculty members' confidence and skills, continuity clinics, and residency training programs. Feasibility evaluation involved assessing participation. The authors compared quantitative data using Wilcoxon signed-rank and Bhapkar tests. Observational field notes underwent narrative analysis.Most participants attended two in-person training sessions (92% and 72%, respectively). Between baseline and 12 months, faculty members' confidence in leadership improved significantly for 15/19 (79%) variables assessed; their self-assessed skills improved significantly for 21/22 (95%) competencies. Two medical home domains ("Continuity of Care," "Support/Care Coordination") improved significantly (P.05) between the two time periods. Analyses of qualitative data revealed that interdisciplinary learning communities formed during the program and served to catalyze transformational change.Results suggest that improvements in faculty perceptions of confidence and skills occurred and that the creation of interdisciplinary learning communities catalyzed transformation. Lengthening the intervention period, engaging other professions involved in training the primary care workforce, and a more discriminating evaluation design are needed to scale this model nationally.

Background Studies have suggested that patient contact time for internal medicine residents is decreasing and being replaced with computer-related activities, yet objective data regarding computer use by residents are lacking. Objective The aim of this study was to objectively measure time use by internal medicine residents while on duty in the hospital setting using real-time, voice-capture technology. Methods First- and third-year categoric internal medicine residents participated (n = 25) during a 3-month period in 2010 while rotating on general internal medicine rotations. Portable speech-recognition technology was used to record residents' activities. The residents were prompted every 15 minutes from an earpiece and asked to categorize the activity they had been doing since the last prompt, choosing from a predetermined list of 15 activities. Results Of the 1008 duty-time responses, 493 (49%) were classified as computer-related activities, whereas 341 (34%) were classified as direct patient care, 110 (11%) were classified as noncomputer-related education, and 64 (6%) were classified as other activities. Of resident reported computer-use time, 70% was spent on patient notes and order entry. Conclusions The results of our study suggest that computer use is the predominant activity for internal medicine residents while in the inpatient setting. Work redesign because of duty hour regulations should consider how to free up residents' time from computer-based activities to allow residents to engage in more direct patient care and noncomputer-based learning.

To assess internal medicine (IM) and surgery program directors' views of the likely effects of the 2011 Accreditation Council for Graduate Medical Education duty hours regulations.In fall 2010, investigators surveyed IM and surgery program directors, assessing their views of the likely impact of the 2011 duty hours standards on learning environment, workload, education opportunities, program administration, and patient outcomes.Of 381 IM program directors, 287 (75.3%) responded; of 225 surgery program directors, 118 (52.4%) responded. Significantly more surgeons than internists indicated that the new regulations would likely negatively impact learning climate, including faculty morale and residents' relationships (P.001). Most leaders in both specialties (80.8% IM, 80.2% surgery) felt that the regulations would likely increase faculty workload (P = .73). Both IM (82.2%) and surgery (96.6%) leaders most often rated, of all education opportunities, first-year resident clinical experience to be adversely affected (P.001). Respondents from both specialties indicated that they will hire more nonphysician/midlevel providers (59.5% IM, 89.0% surgery, P.001) and use more nonteaching services (66.8% IM, 70.1% surgery, P = .81). Respondents expect patient safety (45.1% IM, 76.9% surgery, P.001) and continuity of care (83.6% IM across all training levels, 97.5% surgery regarding first-year residents) to decrease.IM and surgery program directors agree that the 2011 duty hours regulations will likely negatively affect the quality of the learning environment, workload, education opportunities, program administration, and patient outcomes. Careful evaluation of actual impact is important.

Michael Adams, MD, FACP, is Program Director of Medicine at Georgetown University; Thomas B. Morrison, MD, is Fellow in Cardiovascular Medicine at Vanderbilt University; Stephanie Call, MD, is Program Director of Medicine at Virginia Commonwealth University; Andrew J. Halvorsen, MS, is Biostatistician and Project and Data Manager in the Internal Medicine Residency Office of Educational Innovations at Mayo Clinic; Jared Moore, MD, is Chief Medical Resident in Internal Medicine at Ohio State University; Maria Lucarelli, MD, is Associate Program Director in Internal Medicine at Ohio State University; Steven Angus, MD, is Program Director of Medicine at the University of Connecticut Health Center; and Furman S. McDonald, MD, MPH, is Program Director of Internal Medicine Residency Office of Educational Innovations at the Mayo Clinic. Funding: This study was supported in part by the Mayo Clinic Internal Medicine Residency Office of Educational Innovations as part of the ACGME Educational Innovations Project. The Mayo Clinic Survey Research Center provided assistance with the survey design and data collection. We are grateful for the support of the Association of Program Directors of Internal Medicine and the members of the Survey Committee and to the residency program directors who completed the Association of Program Directors in Internal Medicine (APDIM) survey. While we are reporting the results of the APDIM Survey Committee, we are not presuming to speak for the organization and our paper does not constitute an official policy statement of APDIM, the APDIM Council, or any other organzation with which any of the authors may be affiliated.

Maintenance of certification examination performance is associated with quality of care. We aimed to examine relationships between electronic medical knowledge resource use, practice characteristics and examination scores among physicians recertifying in internal medicine.We conducted a cross-sectional study of 3,958 United States physicians who took the Internal Medicine Maintenance of Certification Examination (IM-MOCE) between January 1, 2006 and December 31, 2008, and who held individual licenses to one or both of two large electronic knowledge resource programs. We examined associations between physicians' IM-MOCE scores and their days of electronic resource use, practice type (private practice, residency teaching clinic, inpatient, nursing home), practice model (single or multi-specialty), sex, age, and medical school location.In the 365 days prior to the IM-MOCE, physicians used electronic resources on a mean (SD, range) of 20.3 (36.5, 0-265) days. In multivariate analyses, the number of days of resource use was independently associated with increased IM-MOCE scores (0.07-point increase per day of use, p = 0.02). Increased age was associated with decreased IM-MOCE scores (1.8-point decrease per year of age, p 0.001). Relative to physicians working in private practice settings, physicians working in residency teaching clinics and hospital inpatient practices had higher IM-MOCE scores by 29.1 and 20.0 points, respectively (both p 0.001).Frequent use of electronic resources was associated with modestly enhanced IM-MOCE performance. Physicians involved in residency education clinics and hospital inpatient practices had higher IM-MOCE scores than physicians working in private practice settings.

Impact of Resident Workload and Handoff Training on Patient Outcomes Stephanie K. Mueller, MD, Stephanie A. Call, MD, MSPH, Furman S. McDonald, MD, MPH, Andrew J. Halvorsen, MS, Jeffrey L. Schnipper, MD, MPH, LeRoi S. Hicks, MD, MPH Brigham and Women’s-Faulkner Hospital Academic Hospitalist Service, Boston, Mass; Division of General Internal edicine, Brigham and Women’s Hospital, Boston, Mass; Division of General Internal Medicine, Virginia Commonwealth University, Richmond; Divisions of General and Hospital Internal Medicine and Office of Educational Innovations, Internal Medicine Residency, Mayo Clinic, Rochester, Minn; Division of Hospital Medicine, UMass Memorial Healthcare, Worcester; Department of Quantitative Sciences, University of Massachusetts Medical School, Worcester.

Medical Education 2011: 45: 149–154 Objectives Transformative learning theory supports the idea that reflection on quality improvement (QI) opportunities and the ability to develop successful QI projects may be fundamentally linked. We used validated methods to explore associations between resident doctors’ reflections on QI opportunities and the quality of their QI project proposals. Methods Eighty-six residents completed written reflections on practice improvement opportunities and developed QI proposals. Two faculty members assessed residents’ reflections using the 18-item Mayo Evaluation of Reflection on Improvement Tool (MERIT), and assessed residents’ QI proposals using the seven-item Quality Improvement Project Assessment Tool (QIPAT-7). Both instruments have been validated in previous work. Associations between MERIT and QIPAT-7 scores were determined. Internal consistency reliabilities of QIPAT-7 and MERIT scores were calculated. Results There were no significant associations between MERIT overall and domain scores, and QIPAT-7 overall and item scores. The internal consistency of MERIT and QIPAT-7 item groups were acceptable (Cronbach’s α 0.76–0.94). Conclusions The lack of association between MERIT and QIPAT-7 scores indicates a distinction between resident doctors’ skills at reflection on QI opportunities and their abilities to develop QI projects. These findings suggest that practice-based reflection and QI project development are separate constructs, and that skilful reflection may not predict the ability to design meaningful QI initiatives. Future QI curricula should consider teaching and assessing QI reflection and project development as distinct components.

Quality improvement (QI) in health care involves activities ranging from enhancing personal practice to reforming the larger health care system. The Accreditation Council for Graduate Medical Education recognizes this broad definition of QI in its requirement that physicians-in-training demonstrate competence in practice-based learning and improvement (PBLI) and systems-based practice (SBP). Creative metaphors have been used to teach the PBLI and SBP competencies, but conceptual frameworks describing the relationship between these competencies are needed. Transformative learning is an adult education theory that states individuals must critically reflect on life events in order to change their beliefs or behaviors. The authors propose that critical reflection during transformative learning can conceptually link PBLI and SBP. Reflection on personal experience with suboptimal patient care leads to recognizing personal or system limitations. Addressing personal limitations improves individual practice (PBLI), whereas applying QI methodologies leads to large-scale improvements (SBP). Educators who adopt the transformative learning framework should be able to design meaningful QI curricula that encourage residents to be reflective and empower them with QI skills.

A Systems Approach to Morbidity and Mortality Conference Jason H. Szostek, MD, Mark L. Wieland, MD, MPH, Laura L. Loertscher, MD, MPH, Darlene R. Nelson, MD, Christopher M. Wittich, MD, PharmD, Furman S. McDonald, MD, MPH, Joseph C. Kolars, MD, Darcy A. Reed, MD, MPH From the Department of Medicine, Mayo Clinic, Rochester, Minn; Department of Medicine, Providence St Vincent Medical Center, Portland, Ore; Internal Medicine Residency Program, Mayo Clinic, Rochester, Minn; Department of Medicine, University of Michigan, Ann Arbor, Mich.

© 2010 Mayo Foundation for Medical Education and Research A 68-year-old man presented to the pulmonary clinic at Mayo Clinic for evaluation of chronic cough and weight loss. He had a medical history of stroke, insomnia, chronic mucocutaneous candidiasis, spontaneous left-sided pneumothorax, and pneumonia. He had been in good health until experiencing a left pontine stroke in 2006, which caused transient right-sided weakness and dysphagia. Although these symptoms resolved, a cough continued for 18 months before evaluation. Findings on chest radiography and a pulmonary function test were normal 5 months before evaluation. The cough had recently become productive, and the sputum was occasionally red. The patient thought the cough was worse when he was in certain positions. His cough was not triggered by exertion or fumes. He denied sinus disease, postnasal drip, gastroesophageal reflux, and asthma. He had never been a smoker. He had no relevant chemical, occupational, or animal exposures. He reported fever, chills, and a weight loss of 13.6 kg (30 lbs) during the previous 2 months. One month before evaluation, he developed hemoptysis. He was found to have a pleural effusion and was treated for pneumonia at another hospital. Cultures from a bronchoscopy and thoracentesis were reportedly negative. He did not complete the antibiotic course because of mucocutaneous candidiasis.

Chief residents play a crucial role in internal medicine residency programs in administration, academics, team building, and coordination between residents and faculty. The work-life and demographic characteristics of chief residents has not been documented.To delineate the demographics and day-to-day activities of chief residents.The Survey Committee of the Association of Program Directors in Internal Medicine (APDIM) developed a Web-based questionnaire. A link was sent in November 2006 by e-mail to 381 member programs (98%). Data collection ended in April 2007.Data collected include the number of chief residents per residency, the ratio of chief residents per resident, demographics, and information on salary/benefits, training and mentoring, and work life.The response rate was 62% (N = 236). There was a mean of 2.5 chief residents per program, and on average there was 1 chief resident for 17.3 residents. Of the chief residents, 40% were women, 38% international medical graduates, and 11% minorities. Community-based programs had a higher percentage of postgraduate year 3 (PGY-3)-level chief residents compared to university-based programs (22% versus 8%; P = .02). Mean annual salary was $60 000, and the added value of benefits was $21 000. Chief residents frequently supplement their salaries through moonlighting. The majority of formal training occurs by attending APDIM meetings. Forty-one percent of programs assign academic rank to chief residents.Most programs have at least 2 chief residents and expect them to perform administrative functions, such as organizing conferences. Most programs evaluate chief residents regularly in administration, teaching, and clinical skills.

© 2009 Mayo Foundation for Medical Education and Research A 25-year-old woman presented to her local emergency department with symptoms of increasing abdominal girth and shortness of breath during the previous week. Her clothes no longer fit at her waist and she had gained 4.5 kg within the past week. In addition to feeling bloated, the patient had abdominal pain, nausea, and subjective fevers. The pain in her abdomen and back, which she rated as an 8 on a 10-point scale, became worse with movement. She had a complicated medical history, having been diagnosed as having neuroblastoma at the age of 6 months. She had been treated with a laminectomy of several thoracic vertebrae, chemotherapy, and radiation. She had resultant kyphoscoliosis, T4 paraplegia, and asymptomatic chronic hypoxia with a baseline hemoglobin saturation of around 80%. Alcohol use consisted of 12 to 16 drinks per week up until 1 year previously, with only minimal alcohol use since that time. She did not use tobacco or recreational drugs. On physical examination, the patient had severe kyphoscoliosis with a scoliotic angle of 116° and T4 paraplegia. Cardiac examination revealed a grade 2/6 systolic murmur at the base with a faint diastolic component and a prominent pulmonic valve component (P2). Lung examination was difficult secondary to her anatomy, but no wheezes or rhonchi were auscultated bilaterally. Her abdomen was distended with shifting dullness and was nontender. She had pitting edema of both legs to the level of her knees. Her vital signs were as follows: respiratory rate, 20 breaths/min; hemoglobin saturation, 80% on blow by face mask supplemental oxygenation; heart rate, 86 beats/min; blood pressure, 99/58 mm Hg; and no fever. Laboratory studies yielded the following results (reference ranges shown parenthetically): B-type natriuretic peptide level, 606 pg/mL (

Q T D m m c t s j C c n the past decade, the short half-life of leaders in cademic medicine has been an important issue, but esidency program directors have been of particular nterest because of their roles in developing and mainaining a high-quality academic environment, ensuring ontinuous cycles of program and process improveent, and monitoring the development and well-being f physicians-in-training from the time of recruitment o graduation. Program directors have short job duraions and high burnout associated with administrative hassles,” long work hours, dissatisfaction with promoion opportunities, and concerns about resources. In 1996, 34% of internal medicine program directors eported some degree of “burnout,” defined as “the loss f enjoyment or enthusiasm for a job, so that an indiidual is no longer able to devote emotional energy to ts accomplishment.” Among this group of 262 proram directors, a 3-year cohort study demonstrated a 9% turnover and mean job duration of 2.4 years. urnover was highly associated with overall job satisaction. Program director characteristics that were inependently predictive of job turnover included low atisfaction with colleague relationships, high percentges of administrative work time, perceptions of the job

To examine the association of medical knowledge acquisition with attendance at specific conference types during internal medicine residency.Attendance at residency core curriculum, morbidity and mortality, and medical grand rounds conferences was tracked for 195 residents who took the Internal Medicine In-Training Examination (IM-ITE) 421 times while attending the Internal Medicine Residency Program at Mayo Clinic's site in Rochester, MN, between October 1, 1999, and October 1, 2003. Random effects modeling was used to adjust for variables known or hypothesized to be associated with IM-ITE scores and allowed discrimination of effects of individual conferences on IM-ITE scores.Total conference attendance was significantly associated with increased IM-ITE scores, with cohort mean increase of 2.30% (95% confidence interval [CI], 1.24% to 3.36%; P.001). Core curriculum conferences accounted for much more of this association than either medical grand rounds or morbidity and mortality, with cohort mean increases of 2.05% (95% CI, 0.13% to 3.90%; P=.04), 0.24% (95% CI, -0.56% to 1.03%; P=.61), and 0.03% (95% CI, -1.69% to 1.69%; P=.97), respectively.Conference attendance is associated with improved knowledge acquisition as measured by improved performance on IM-ITE. This finding does not appear to apply to all conferences at our institution but rather is specifically attributable to attendance at the core curriculum series.

Disease registries, audit and feedback, and clinical reminders have been reported to improve care processes.To assess the effects of a registry-generated audit, feedback, and patient reminder intervention on diabetes care.Randomized controlled trial conducted in a resident continuity clinic during the 2003-2004 academic year.Seventy-eight categorical Internal Medicine residents caring for 483 diabetic patients participated. Residents randomized to the intervention (n = 39) received instruction on diabetes registry use; quarterly performance audit, feedback, and written reports identifying patients needing care; and had letters sent quarterly to patients needing hemoglobin A1c or cholesterol testing. Residents randomized to the control group (n = 39) received usual clinic education.Hemoglobin A1c and lipid monitoring, and the achievement of intermediate clinical outcomes (hemoglobin A1c7.0%, LDL cholesterol100 mg/dL, and blood pressure130/85 mmHg) were assessed.Patients cared for by residents in the intervention group had higher adherence to guideline recommendations for hemoglobin A1c testing (61.5% vs 48.1%, p = .01) and LDL testing (75.8% vs 64.1%, p = .02). Intermediate clinical outcomes were not different between groups.Use of a registry-generated audit, feedback, and patient reminder intervention in a resident continuity clinic modestly improved diabetes care processes, but did not influence intermediate clinical outcomes.

Residency programs involve trainees in quality improvement (QI) projects to evaluate competency in systems-based practice and practice-based learning and improvement. Valid approaches to assess QI proposals are lacking.We developed an instrument for assessing resident QI proposals--the Quality Improvement Proposal Assessment Tool (QIPAT-7)-and determined its validity and reliability.QIPAT-7 content was initially obtained from a national panel of QI experts. Through an iterative process, the instrument was refined, pilot-tested, and revised.Seven raters used the instrument to assess 45 resident QI proposals.Principal factor analysis was used to explore the dimensionality of instrument scores. Cronbach's alpha and intraclass correlations were calculated to determine internal consistency and interrater reliability, respectively.QIPAT-7 items comprised a single factor (eigenvalue = 3.4) suggesting a single assessment dimension. Interrater reliability for each item (range 0.79 to 0.93) and internal consistency reliability among the items (Cronbach's alpha = 0.87) were high.This method for assessing resident physician QI proposals is supported by content and internal structure validity evidence. QIPAT-7 is a useful tool for assessing resident QI proposals. Future research should determine the reliability of QIPAT-7 scores in other residency and fellowship training programs. Correlations should also be made between assessment scores and criteria for QI proposal success such as implementation of QI proposals, resident scholarly productivity, and improved patient outcomes.

E-learning has been widely utilized in medical education and suggested by some proponents to represent a fundamental advance in educational methodology. We challenge this conclusion by examining e-learning in the context of broader learning theories, specifically as they relate to instructional design and methods. Core tenets of educational design are applied to e-learning in a unified model for instructional design, and examples of e-learning technologies are examined in the context of medical education, with reflections on research questions generated by these new modalities. Throughout, we argue that e-learning is a tool that, when designed appropriately, can be used to meet worthy educational goals.