57 results on '"Rebecca S. Lipner"'
Search Results
2. Association between primary care physician diagnostic knowledge and death, hospitalisation and emergency department visits following an outpatient visit at risk for diagnostic error: a retrospective cohort study using medicare claims
- Author
-
Bradley M Gray, Jonathan L Vandergrift, and Rebecca S Lipner
- Subjects
Medicine - Abstract
Objective Diagnostic error is a key healthcare concern and can result in substantial morbidity and mortality. Yet no study has investigated the relationship between adverse outcomes resulting from diagnostic errors and one potentially large contributor to these errors: deficiencies in diagnostic knowledge. Our objective was to measure that associations between diagnostic knowledge and adverse outcomes after visits to primary care physicians that were at risk for diagnostic errors.Setting/participants 1410 US general internists who recently took their American Board of Internal Medicine Maintenance of Certification (ABIM-IM-MOC) exam treating 42 407 Medicare beneficiaries who experienced 48 632 ‘index’ outpatient visits for new problems at risk for diagnostic error because the presenting problem (eg, dizziness) was related to prespecified diagnostic error sensitive conditions (eg, stroke).Outcome measures 90-day risk of all-cause death, and, for outcome conditions related to the index visits diagnosis, emergency department (ED) visits and hospitalisations.Design Using retrospective cohort study design, we related physician performance on ABIM-IM-MOC diagnostic exam questions to patient outcomes during the 90-day period following an index visit at risk for diagnostic error after controlling for practice characteristics, patient sociodemographic and baseline clinical characteristics.Results Rates of 90-day adverse outcomes per 1000 index visits were 7 for death, 11 for hospitalisations and 14 for ED visits. Being seen by a physician in the top versus bottom third of diagnostic knowledge during an index visit for a new problem at risk for diagnostic error was associated with 2.9 fewer all-cause deaths (95% CI −5.0 to −0.7, p=0.008), 4.1 fewer hospitalisations (95% CI −6.9 to −1.2, p=0.006) and 4.9 fewer ED visits (95% CI −8.1% to −1.6%, p=0.003) per 1000 visits.Conclusion Higher diagnostic knowledge was associated with lower risk of adverse outcomes after visits for problems at heightened risk for diagnostic error.
- Published
- 2021
- Full Text
- View/download PDF
3. Analysis of Performance Trends from 2010–2019 on the American Board of Internal Medicine Nephrology Certifying Exam
- Author
-
Jeffrey S. Berns, Bernard G. Jaar, Furman S McDonald, Rebecca S. Lipner, Bradley G. Brossman, and Weifeng Weng
- Subjects
Adult ,Male ,Nephrology ,medicine.medical_specialty ,Certification ,Demographics ,IMG ,Sex Factors ,Primary outcome ,Percentile rank ,Up Front Matters ,Internal medicine ,Internal Medicine ,Humans ,Medicine ,Fellowships and Scholarships ,Foreign Medical Graduates ,business.industry ,Age Factors ,Female sex ,Pass rate ,General Medicine ,computer.file_format ,Exam score ,United States ,Education, Medical, Graduate ,Osteopathic Physicians ,Female ,Educational Measurement ,business ,computer - Abstract
Background The pass rate on the American Board of Internal Medicine (ABIM) nephrology certifying exam has declined and is among the lowest of all internal medicine (IM) subspecialties. In recent years, there have also been fewer applicants for the nephrology fellowship match. Methods This retrospective observational study assessed how changes between 2010 and 2019 in characteristics of 4094 graduates of US ACGME-accredited nephrology fellowship programs taking the ABIM nephrology certifying exam for the first time, and how characteristics of their fellowship programs were associated with exam performance. The primary outcome measure was performance on the nephrology certifying exam. Fellowship program pass rates over the decade were also studied. Results Lower IM certifying exam score, older age, female sex, international medical graduate (IMG) status, and having trained at a smaller nephrology fellowship program were associated with poorer nephrology certifying exam performance. The mean IM certifying exam percentile score among those who subsequently took the nephrology certifying exam decreased from 56.7 (SD, 27.9) to 46.1 (SD, 28.7) from 2010 to 2019. When examining individuals with comparable IM certifying exam performance, IMGs performed less well than United States medical graduates (USMGs) on the nephrology certifying exam. In 2019, only 57% of nephrology fellowship programs had aggregate 3-year certifying exam pass rates ≥80% among their graduates. Conclusions Changes in IM certifying exam performance, certain trainee demographics, and poorer performance among those from smaller fellowship programs explain much of the decline in nephrology certifying exam performance. IM certifying exam performance was the dominant determinant.
- Published
- 2021
4. Associations between initial American Board of Internal Medicine certification and maintenance of certification status of attending physicians and in-hospital mortality of patients with acute myocardial infarction or congestive heart failure: a retrospective cohort study of hospitalisations in Pennsylvania, USA
- Author
-
John J Norcini, Weifeng Weng, John Boulet, Furman McDonald, and Rebecca S Lipner
- Subjects
Heart Failure ,Hospitalization ,Certification ,Physicians ,Internal Medicine ,Myocardial Infarction ,Humans ,General Medicine ,Hospital Mortality ,Pennsylvania ,United States ,Retrospective Studies - Abstract
ObjectiveTo determine whether internists’ initial specialty certification and the maintenance of that certification (MOC) is associated with lower in-hospital mortality for their patients with acute myocardial infarction (AMI) or congestive heart failure (CHF).DesignRetrospective cohort study of hospitalisations in Pennsylvania, USA, from 2012 to 2017.SettingAll hospitals in Pennsylvania.ParticipantsAll 184 115 hospitalisations for primary diagnoses of AMI or CHF where the attending physician was a self-designated internist.Primary outcome measureIn-hospital mortality.ResultsOf the 2575 physicians, 2238 had initial certification and 820 were eligible for MOC. After controlling for patient demographics and clinical characteristics, hospital-level factors and physicians’ demographic and medical school characteristics, both initial certification and MOC were associated with lower mortality. The adjusted OR for initial certification was 0.835 (95% CI 0.756 to 0.922; pConclusionsInitial certification was associated with lower mortality for AMI or CHF. Moreover, for patients whose physicians had initial certification, an additional advantage was associated with its maintenance.
- Published
- 2022
5. Opportunities for Maintenance of Certification to Better Reflect Scope of Practice Among Medical Oncologists
- Author
-
Jonathan L. Vandergrift, Bradley M. Gray, Brendan J. Barnhart, Rebecca S. Lipner, and Lorna A. Lynn
- Subjects
Oncologists ,Medical education ,Certification ,Scope of practice ,Oncology (nursing) ,Scope of Practice ,Health Policy ,MEDLINE ,Medical Oncology ,Medicare ,United States ,Maintenance of Certification ,03 medical and health sciences ,0302 clinical medicine ,Oncology ,030220 oncology & carcinogenesis ,Humans ,030212 general & internal medicine ,Business ,Aged - Abstract
PURPOSE: Critics argue that the American Board of Internal Medicine’s medical oncology Maintenance of Certification examination requires medical oncologists with a narrow scope of practice to spend time studying material that is no longer relevant to their practice. However, no data are available describing the scope of practice for medical oncologists. METHODS: Using Medicare claims, we examined the scope of practice for 9,985 medical oncologists who saw 8.6 million oncology conditions in 2016, each of which was assigned to 1 of 23 different condition groups. Scope of practice was then measured as the percentage of oncology conditions within each of the 23 groups. We grouped physicians with similar scopes of practice by applying K-means clustering to the percentage of conditions seen. The scope of practice for each physician cluster was determined from the cancers that encompassed the majority of average oncology conditions seen among physicians composing the cluster. RESULTS: We found 20 distinct scope-of-practice clusters. The largest (n = 6,479 [65.5%]) had a general oncology scope of practice. The remaining physicians focused on a narrow scope of cancers, including 22.6% focused on ≥ 1 solid tumors and 11.9% focused on hematologic malignancies. The largest focused cluster accounted for 7.7% of physicians focused on breast cancer. CONCLUSION: A single American Board of Internal Medicine Maintenance of Certification assessment in medical oncology is most appropriate for approximately 65% of certified medical oncologists’ practices. However, the addition of assessments focused on breast cancer and hematologic malignancies could increase this figure to upwards of 85% of certified medical oncologists.
- Published
- 2020
6. Association between primary care physician diagnostic knowledge and death, hospitalisation and emergency department visits following an outpatient visit at risk for diagnostic error: a retrospective cohort study using medicare claims
- Author
-
Bruce E. Landon, Rozalina G. McCoy, Bradley M. Gray, Jonathan L. Vandergrift, and Rebecca S. Lipner
- Subjects
medicine.medical_specialty ,Lower risk ,Medicare ,01 natural sciences ,Physicians, Primary Care ,Presenting problem ,Maintenance of Certification ,03 medical and health sciences ,0302 clinical medicine ,general medicine (see internal medicine) ,Health care ,Outpatients ,medicine ,Humans ,030212 general & internal medicine ,0101 mathematics ,Diagnostic Errors ,Stroke ,Retrospective Studies ,business.industry ,010102 general mathematics ,Primary care physician ,Retrospective cohort study ,General Medicine ,Emergency department ,medicine.disease ,United States ,Hospitalization ,internal medicine ,Emergency medicine ,Medicine ,business ,Emergency Service, Hospital ,General practice / Family practice ,medical education & training - Abstract
ObjectiveDiagnostic error is a key healthcare concern and can result in substantial morbidity and mortality. Yet no study has investigated the relationship between adverse outcomes resulting from diagnostic errors and one potentially large contributor to these errors: deficiencies in diagnostic knowledge. Our objective was to measure that associations between diagnostic knowledge and adverse outcomes after visits to primary care physicians that were at risk for diagnostic errors.Setting/participants1410 US general internists who recently took their American Board of Internal Medicine Maintenance of Certification (ABIM-IM-MOC) exam treating 42 407 Medicare beneficiaries who experienced 48 632 ‘index’ outpatient visits for new problems at risk for diagnostic error because the presenting problem (eg, dizziness) was related to prespecified diagnostic error sensitive conditions (eg, stroke).Outcome measures90-day risk of all-cause death, and, for outcome conditions related to the index visits diagnosis, emergency department (ED) visits and hospitalisations.DesignUsing retrospective cohort study design, we related physician performance on ABIM-IM-MOC diagnostic exam questions to patient outcomes during the 90-day period following an index visit at risk for diagnostic error after controlling for practice characteristics, patient sociodemographic and baseline clinical characteristics.ResultsRates of 90-day adverse outcomes per 1000 index visits were 7 for death, 11 for hospitalisations and 14 for ED visits. Being seen by a physician in the top versus bottom third of diagnostic knowledge during an index visit for a new problem at risk for diagnostic error was associated with 2.9 fewer all-cause deaths (95% CI −5.0 to −0.7, p=0.008), 4.1 fewer hospitalisations (95% CI −6.9 to −1.2, p=0.006) and 4.9 fewer ED visits (95% CI −8.1% to −1.6%, p=0.003) per 1000 visits.ConclusionHigher diagnostic knowledge was associated with lower risk of adverse outcomes after visits for problems at heightened risk for diagnostic error.
- Published
- 2021
7. Changes in Stress and Workplace Shortages Reported by U.S. Critical Care Physicians Treating Coronavirus Disease 2019 Patients
- Author
-
Bruce E. Landon, Bradley M. Gray, Siddharta G. Reddy, Rebecca S. Lipner, Brendan J. Barnhart, Michael L. Barnett, Jonathan L. Vandergrift, Benjamin Chesluk, Lorna A. Lynn, and Jennifer S Stevens
- Subjects
Response rate (survey) ,medicine.medical_specialty ,business.industry ,MEDLINE ,Staffing ,030208 emergency & critical care medicine ,Critical Care and Intensive Care Medicine ,03 medical and health sciences ,0302 clinical medicine ,030228 respiratory system ,Intervention (counseling) ,Emergency medicine ,Workforce ,Pandemic ,medicine ,Occupational stress ,business ,Personal protective equipment - Abstract
OBJECTIVES: Eleven months into the coronavirus disease 2019 pandemic, the country faces accelerating rates of infections, hospitalizations, and deaths. Little is known about the experiences of critical care physicians caring for the sickest coronavirus disease 2019 patients. Our goal is to understand how high stress levels and shortages faced by these physicians during Spring 2020 have evolved. DESIGN: We surveyed (October 23, 2020 to November 16, 2020) U.S. critical care physicians treating coronavirus disease 2019 patients who participated in a National survey earlier in the pandemic (April 23, 2020 to May 3, 2020) regarding their stress and shortages they faced. SETTING: ICU. PATIENTS: Coronavirus disease 2019 patients. INTERVENTION: Irrelevant. MEASUREMENT: Physician emotional distress/physical exhaustion: low (not at all/not much), moderate, or high (a lot/extreme). Shortage indicators: insufficient ICU-trained staff and shortages in medication, equipment, or personal protective equipment requiring protocol changes. MAIN RESULTS: Of 2,375 U.S. critical care attending physicians who responded to the initial survey, we received responses from 1,356 (57.1% response rate), 97% of whom (1,278) recently treated coronavirus disease 2019 patients. Two thirds of physicians (67.6% [864]) reported moderate or high levels of emotional distress in the Spring versus 50.7% (763) in the Fall. Reports of staffing shortages persisted with 46.5% of Fall respondents (594) reporting a staff shortage versus 48.3% (617) in the Spring. Meaningful shortages of medication and equipment reported in the Spring were largely alleviated. Although personal protective equipment shortages declined by half, they remained substantial. CONCLUSIONS: Stress, staffing, and, to a lesser degree, personal protective equipment shortages faced by U.S. critical care physicians remain high. Stress levels were higher among women. Considering the persistence of these findings, rising levels of infection nationally raise concerns about the capacity of the U.S. critical care system to meet ongoing and future demands.
- Published
- 2021
8. Functional Neuroimaging Correlates of Burnout among Internal Medicine Residents and Faculty Members
- Author
-
Steven J Durning, Michelle eCostanzo, Anthony R Artino, Liselotte N Dyrbye, Thomas J Beckman, Lambert eSchuwirth, Eric eHolmboe, Michael J Roy, Christopher M Wittich, Rebecca S Lipner, and Cees evan der Vleuten
- Subjects
fMRI ,Expertise ,burnout ,Cognitive Load ,clinical reasoning ,Psychiatry ,RC435-571 - Abstract
Burnout is prevalent in residency training and practice and is linked to medical error and suboptimal patient care. However, little is known about how burnout affects clinical reasoning, which is essential to safe and effective care. The aim of this study was to examine how burnout modulates brain activity during clinical reasoning in physicians. Using functional Magnetic Resonance Imaging (fMRI), brain activity was assessed in internal medicine residents (n=10) and board-certified internists (faculty, n=17) from the Uniformed Services University (USU) while they answered and reflected upon United States Medical Licensing Examination and American Board of Internal Medicine multiple-choice questions. Participants also completed a validated two-item burnout scale, which includes an item assessing emotional exhaustion and an item assessing depersonalization. Whole brain covariate analysis was used to examine blood-oxygen-level-dependent (BOLD) signal during answering and reflecting upon clinical problems with respect to burnout scores. Higher depersonalization scores were associated with less BOLD signal in the right dorsolateral prefrontal cortex and middle frontal gyrus during reflecting on clinical problems and less BOLD signal in the bilateral precuneus while answering clinical problems in residents. Higher emotional exhaustion scores were associated with more right posterior cingulate cortex and middle frontal gyrus BOLD signal in residents. Examination of faculty revealed no significant influence of burnout on brain activity. Residents appear to be more susceptible to burnout effects on clinical reasoning, which may indicate that residents may need both cognitive and emotional support to improve quality of life and to optimize performance and learning. These results inform our understanding of mental stress, cognitive control as well as cognitive load theory.
- Published
- 2013
- Full Text
- View/download PDF
9. Association of Regional Practice Environment Intensity and the Ability of Internists to Practice High-Value Care After Residency
- Author
-
Jonathan Skinner, Brenda E. Sirovich, Rebecca S. Lipner, Weifeng Weng, and Jessica Van Parys
- Subjects
Adult ,Male ,medicine.medical_specialty ,Referral ,MEDLINE ,Certification ,Maintenance of Certification ,Physicians ,Health care ,medicine ,Internal Medicine ,Humans ,Workplace ,Original Investigation ,Retrospective Studies ,business.industry ,Research ,Health Policy ,Internship and Residency ,Retrospective cohort study ,General Medicine ,Middle Aged ,Online Only ,Family medicine ,Female ,Clinical Competence ,business ,Relocation ,Cohort study - Abstract
This cohort study examines the association between health care intensity in the region where physicians practice and their ability to practice high-value care, specifically for physicians who relocated after residency., Key Points Question How does the health care environment in a region influence internists’ clinical capabilities, particularly the ability to practice high-value care? Findings This cohort study of 2714 newly certified internists (in 2002) who relocated to a new region after completing residency found that higher intensity of use of health care services in a physician’s destination region was associated with reduced ability to practice appropriately conservative care 1 decade later compared with that ability measured at the end of residency. Meaning The demands of practicing in high-intensity service regions may erode internists’ ability to practice high-value, conservative care., Importance Use of health care services and physician practice patterns have been shown to vary widely across the United States. Although practice patterns—in particular, physicians’ ability to provide high-quality, high-value care—develop during training, the association of a physician’s regional practice environment with that ability is less well understood. Objective To examine the association between health care intensity in the region where physicians practice and their ability to practice high-value care, specifically for physicians whose practice environment changed due to relocation after residency. Design, Setting, and Participants This cohort study included a national sample of 3896 internal medicine physicians who took the 2002 American Board of Internal Medicine initial certification examination followed approximately 1 decade (April 21, 2011, to May 7, 2015) later by the Maintenance of Certification (MOC) examination. At the time of the MOC examination, 2714 of these internists were practicing in a new region. Data were analyzed from March 6, 2016, to May 21, 2018. Exposures Intensity of care in the Dartmouth Atlas hospital referral region (HRR), measured by per-enrollee end-of-life physician visits (primary) and current practice type (secondary). Main Outcomes and Measures The outcome, a physician’s ability to practice high-value care, was assessed using the Appropriately Conservative Management (ACM) score on the MOC examination, measuring performance across all questions for which the correct answer was the most conservative option. The exposure, regional health care intensity, was measured as per-enrollee end-of-life physician visits in the Dartmouth Atlas HRR of the physician’s practice. Results Among the 3860 participating internists included in the analysis (2030 men [52.6%]; mean [SD] age, 45.6 [4.5] years), those who moved to regions in the quintile of highest health care intensity had an ACM score 0.22 SD lower (95% CI, −0.32 to −0.12) than internists who moved to regions in the quintile of lowest intensity, controlling for postresidency ACM scores. This difference reflected scoring in the 44th compared with the 53rd percentile of all examinees. This association was mildly attenuated (0.18 SD less; 95% CI, −0.28 to −0.09) after adjustment for physician and practice characteristics. Conclusions and Relevance This study found that practice patterns of internists who relocate after residency training appear to migrate toward norms of the new region. The demands of practicing in high-intensity regions may erode the ability to practice high-value conservative care.
- Published
- 2020
10. National Internal Medicine Milestone Ratings
- Author
-
Sarah Hood, Rebecca S. Lipner, Furman S. McDonald, Karen E. Hauer, Jonathan L. Vandergrift, and Eric S. Holmboe
- Subjects
Medical knowledge ,Educational measurement ,medicine.medical_specialty ,020205 medical informatics ,education ,MEDLINE ,02 engineering and technology ,Education ,Cohort Studies ,03 medical and health sciences ,0302 clinical medicine ,Internal medicine ,Internal Medicine ,0202 electrical engineering, electronic engineering, information engineering ,Milestone (project management) ,Humans ,Medicine ,Longitudinal Studies ,030212 general & internal medicine ,Retrospective Studies ,business.industry ,Follow up studies ,Retrospective cohort study ,General Medicine ,Education, Medical, Graduate ,Educational Status ,Educational Measurement ,business ,Follow-Up Studies ,Cohort study - Abstract
To evaluate validity evidence for internal medicine milestone ratings across programs for three resident cohorts by quantifying "not assessable" ratings; reporting mean longitudinal milestone ratings for individual residents; and correlating medical knowledge ratings across training years with certification examination scores to determine predictive validity of milestone ratings for certification outcomes.This retrospective study examined milestone ratings for postgraduate year (PGY) 1-3 residents in U.S. internal medicine residency programs. Data sources included milestone ratings, program characteristics, and certification examination scores.Among 35,217 participants, there was a decreased percentage with "not assessable" ratings across years: 1,566 (22.5%) PGY1s in 2013-2014 versus 1,219 (16.6%) in 2015-2016 (P = .01), and 342 (5.1%) PGY3s in 2013-2014 versus 177 (2.6%) in 2015-2016 (P = .04). For individual residents with three years of ratings, mean milestone ratings increased from around 3 (behaviors of an early learner or advancing resident) in PGY1 (ranging from a mean of 2.73 to 3.19 across subcompetencies) to around 4 (ready for unsupervised practice) in PGY3 (mean of 4.00 to 4.22 across subcompetencies, P.001 for all subcompetencies). For each increase of 0.5 units in two medical knowledge (MK1, MK2) subcompetency ratings, the difference in examination scores for PGY3s was 19.5 points for MK1 (P.001) and 19.0 for MK2 (P.001).These findings provide evidence of validity of the milestones by showing how training programs have applied them over time and how milestones predict other training outcomes.
- Published
- 2018
11. The Association of Changing Practice Settings on Maintenance of Certification Exam Outcomes
- Author
-
Steven J. Durning, Brendan J. Barnhart, Andrew T. Jones, and Rebecca S. Lipner
- Subjects
Adult ,Male ,medicine.medical_specialty ,Certification ,MEDLINE ,Private Practice ,Context (language use) ,01 natural sciences ,Education ,Maintenance of Certification ,03 medical and health sciences ,0302 clinical medicine ,Internal Medicine ,Odds Ratio ,medicine ,Humans ,Attrition ,030212 general & internal medicine ,0101 mathematics ,Association (psychology) ,Retrospective Studies ,business.industry ,010102 general mathematics ,Retrospective cohort study ,General Medicine ,Odds ratio ,Middle Aged ,medicine.disease ,Confidence interval ,Family medicine ,Group Practice ,Education, Medical, Continuing ,Female ,Clinical Competence ,business - Abstract
Purpose To investigate how changing to or from solo practice settings relates to maintenance of certification (MOC) exam performance. Method The authors conducted a retrospective analysis of exam pass/fail outcomes for 7,112 physicians who successfully completed their initial MOC cycle from 2000 to 2004. Initial physician MOC practice characteristics records, demographic information, and exam performance were linked with exam pass/fail outcomes from their second MOC cycle from 2006 to 2014 (5,215 physicians after attrition). Exam pass/fail outcomes for physicians' second MOC cycle were compared among four groups: those who remained in group practice across both MOC cycles, those who changed from group to solo practice, those who changed from solo to group practice, and those who remained in solo practice across both MOC cycles. Results Physicians who changed from solo to group practice performed significantly better than those who remained in solo practice (odds ratio [OR] = 1.67; 95% confidence interval [CI] = 1.11, 2.51; P = .027). Conversely, physicians changing from group to solo practice performed significantly worse than physicians staying in group practice (OR = 0.60; 95% CI = 0.45, 0.80; P = .002). Meanwhile, physicians who changed from solo to group practice performed similarly to physicians remaining in group practice (OR = 0.95; 95% CI = 0.67, 1.35; P = 0.76). Conclusions Changes in solo/group practice status were associated with second-cycle MOC exam performance. This study provides evidence that the context in which a physician practices may have an impact on their MOC exam performance.
- Published
- 2018
12. Performance on the Nephrology In-Training Examination and ABIM Nephrology Certification Examination Outcomes
- Author
-
Laurel Smith, Janine L. Hawley, Troy J. Plumb, Suzanne M. Norby, Rebecca S. Lipner, Steven A. Haist, Lauren M Duhigg, and Daniel Jurich
- Subjects
Adult ,Male ,Nephrology ,medicine.medical_specialty ,Certification ,Epidemiology ,education ,Specialty ,030204 cardiovascular system & hematology ,Critical Care and Intensive Care Medicine ,Subspecialty ,03 medical and health sciences ,0302 clinical medicine ,Internal medicine ,Internal Medicine ,medicine ,Humans ,030212 general & internal medicine ,Transplantation ,business.industry ,Original Articles ,Confidence interval ,Family medicine ,Cohort ,Female ,Educational Measurement ,Board certification ,business ,Cohort study - Abstract
Background and objectives Medical specialty and subspecialty fellowship programs administer subject-specific in-training examinations to provide feedback about level of medical knowledge to fellows preparing for subsequent board certification. This study evaluated the association between the American Society of Nephrology In-Training Examination and the American Board of Internal Medicine Nephrology Certification Examination in terms of scores and passing status. Design, setting, participants, & measurements The study included 1684 nephrology fellows who completed the American Society of Nephrology In-Training Examination in their second year of fellowship training between 2009 and 2014. Regression analysis examined the association between In-Training Examination and first-time Nephrology Certification Examination scores as well as passing status relative to other standardized assessments. Results This cohort included primarily men (62%) and international medical school graduates (62%), and fellows had an average age of 32 years old at the time of first completing the Nephrology Certification Examination. An overwhelming majority (89%) passed the Nephrology Certification on their first attempt. In-Training Examination scores showed the strongest association with first-time Nephrology Certification Examination scores, accounting for approximately 50% of the total explained variance in the model. Each SD increase in In-Training Examination scores was associated with a difference of 30 U (95% confidence interval, 27 to 33) in certification performance. In-Training Examination scores also were significantly associated with passing status on the Nephrology Certification Examination on the first attempt (odds ratio, 3.46 per SD difference in the In-Training Examination; 95% confidence interval, 2.68 to 4.54). An In-Training Examination threshold of 375, approximately 1 SD below the mean, yielded a positive predictive value of 0.92 and a negative predictive value of 0.50. Conclusions American Society of Nephrology In-Training Examination performance is significantly associated with American Board of Internal Medicine Nephrology Certification Examination score and passing status.
- Published
- 2018
13. Clinical Knowledge and Trends in Physicians' Prescribing of Opioids for New Onset Back Pain, 2009-2017
- Author
-
Weifeng Weng, Michael L. Barnett, Jonathan L. Vandergrift, Bradley M. Gray, and Rebecca S. Lipner
- Subjects
Adult ,Male ,medicine.medical_specialty ,MEDLINE ,Maintenance of Certification ,medicine ,Back pain ,Humans ,Practice Patterns, Physicians' ,Medical prescription ,Original Investigation ,business.industry ,Research ,Percentage point ,General Medicine ,Middle Aged ,Low back pain ,Analgesics, Opioid ,Online Only ,Cross-Sectional Studies ,Medical Education ,Quartile ,Opioid ,Back Pain ,Emergency medicine ,Female ,Clinical Competence ,medicine.symptom ,business ,medicine.drug - Abstract
This cross-sectional study compares the association of clinical knowledge with opioid prescribing from 2009 to 2011 when prescribing peaked nationally with 2015 to 2017 when guidelines shifted away from opioid prescribing., Key Points Question Is clinical knowledge associated with opioid prescribing and has this association changed over time? Findings In this cross-sectional study from 2009 to 2017 of 10 246 physicians, opioids were prescribed during 21.6% new onset low back pain office visits. From 2015 to 2017, opioid prescription rates were 4.6 percentage points lower in visits with physicians in the highest vs lowest quartile of performance on American Board Internal Medicine’s Maintenance of Certification examination despite there being no difference in the earlier 2009 to 2011 or 2012 to 2014 periods. Meaning These findings suggest that physicians with higher clinical knowledge scores had reduced opioid prescribing in 2015 to 2017, when guidelines were rapidly changed toward reduced opioid prescribing., Importance Opioid musculoskeletal pain overprescribing was widespread in the mid-2000s. The degree to which prescribing changed as awareness of the danger grew among physicians with different levels of clinical knowledge remains unstudied. Objective To compare the association of clinical knowledge with opioid prescribing from 2009 to 2011 when prescribing peaked nationally with 2015 to 2017 when guidelines shifted away from opioid prescribing. Design, Setting, and Participants This cross-sectional study included 10 246 midcareer general internal medicine physicians in the United States who saw patients who were Medicare beneficiaries with Part D enrollment from 2009 to 2017. Main Outcomes and Measures Any opioid prescription and high dosage or long duration (HDLD) (>7 days or >50 daily morphine milligram equivalents) opioid prescriptions filled within 7 days of applicable visits for new low back pain concerns. Associations between opioid prescribing for new low back pain concerns during outpatient visits and clinical knowledge measured by prior year American Board of Internal Medicine (ABIM) Maintenance of Certification examination performance were estimated using serial cross-sectional logit regressions. Regression covariates included yearly examination quartile (ie, knowledge quartile) interacted with 3-year group dummies (ie, early: 2009-2011; middle: 2012-2014; late: 2015-2017), state and year dummies, physician, practice, patient characteristics, and state opioid regulations. Results Of the 55 387 low back pain visits included in this study, 37 185 (67.1%) were visits with female patients, 41 978 (75.8%) were with White patients, and the mean (SE) age of patients was 76.2 (
- Published
- 2021
14. Mortality in U.S. Physicians Likely to Perform Fluoroscopy-guided Interventional Procedures Compared with Psychiatrists, 1979 to 2008
- Author
-
Neal Naito, Martha S. Linet, Estelle Ntowe, Rebecca S Lipner, Ruth A Kleinerman, Amy Berrington de Gonzalez, Donald L. Miller, Ethel S. Gilbert, and Cari M Kitahara
- Subjects
Male ,Pediatrics ,medicine.medical_specialty ,Neoplasms, Radiation-Induced ,Radiography, Interventional ,National Death Index ,030218 nuclear medicine & medical imaging ,03 medical and health sciences ,symbols.namesake ,0302 clinical medicine ,Risk Factors ,Occupational Exposure ,Physicians ,Humans ,Medicine ,Radiology, Nuclear Medicine and imaging ,Poisson regression ,Mortality ,Original Research ,Cause of death ,Psychiatry ,business.industry ,Mortality rate ,Medical school ,Radiation Exposure ,United States ,Confidence interval ,Large cohort ,Fluoroscopy ,030220 oncology & carcinogenesis ,Relative risk ,symbols ,Female ,business - Abstract
Purpose To compare total and cause-specific mortality rates between physicians likely to have performed fluoroscopy-guided interventional (FGI) procedures (referred to as FGI MDs) and psychiatrists to determine if any differences are consistent with known radiation risks. Materials and Methods Mortality risks were compared in nationwide cohorts of 45 634 FGI MDs and 64 401 psychiatrists. Cause of death was ascertained from the National Death Index. Poisson regression was used to estimate relative risks (RRs) and 95% confidence intervals (CIs) for FGI MDs versus psychiatrists, with adjustment (via stratification) for year of birth and attained age. Results During follow-up (1979-2008), 3506 FGI MDs (86 women) and 7814 psychiatrists (507 women) died. Compared with psychiatrists, FGI MDs had lower total (men: RR, 0.80 [95% CI: 0.77, 0.83]; women: RR, 0.80 [95% CI: 0.63, 1.00]) and cancer (men: RR, 0.92 [95% CI: 0.85, 0.99]; women: RR, 0.83 [95% CI: 0.58, 1.18]) mortality. Mortality because of specific types of cancer, total and specific types of circulatory diseases, and other causes were not elevated in FGI MDs compared with psychiatrists. On the basis of small numbers, leukemia mortality was elevated among male FGI MDs who graduated from medical school before 1940 (RR, 3.86; 95% CI: 1.21, 12.3). Conclusion Overall, total deaths and deaths from specific causes were not elevated in FGI MDs compared with psychiatrists. These findings require confirmation in large cohort studies with individual doses, detailed work histories, and extended follow-up of the subjects to substantially older median age at exit. © RSNA, 2017 Online supplemental material is available for this article.
- Published
- 2017
15. Performance on the Cardiovascular In-Training Examination in Relation to the ABIM Cardiovascular Disease Certification Examination
- Author
-
Steven A. Haist, Naomi F. Botkin, Jeffrey T. Kuvin, Julia H. Indik, Furman S. McDonald, Jonathan D. Rubright, Rebecca S. Lipner, and Lauren M Duhigg
- Subjects
medicine.medical_specialty ,Certification ,business.industry ,education ,Cardiology ,Medical school ,Internship and Residency ,Disease ,030204 cardiovascular system & hematology ,United States ,03 medical and health sciences ,0302 clinical medicine ,Cardiovascular Diseases ,Education, Medical, Graduate ,Family medicine ,Internal medicine ,Secondary analysis ,medicine ,Humans ,Clinical Competence ,030212 general & internal medicine ,Cardiology and Cardiovascular Medicine ,business - Abstract
The American College of Cardiology In-Training Exam (ACC-ITE) is incorporated into most U.S. training programs, but its relationship to performance on the American Board of Internal Medicine Cardiovascular Disease (ABIM CVD) Certification Examination is unknown. ACC-ITE scores from third-year fellows from 2011 to 2014 (n = 1,918) were examined. Covariates for regression analyses included sex, age, medical school country, U.S. Medical Licensing Examination Step, and ABIM Internal Medicine Certification Examination scores. A secondary analysis examined fellows (n = 511) who took the ACC-ITE in the first and third years. ACC-ITE scores were the strongest predictor of ABIM CVD scores (p < 0.0001), and the most significant predictor of passing (p < 0.0001). The change in ACC-ITE scores from first to third year was a strong predictor of the ABIM CVD score (p < 0.001). The ACC-ITE is strongly associated with performance on the ABIM CVD Certification Examination.
- Published
- 2017
16. The ABMS MOC Part III Examination
- Author
-
Mellie Villahermosa Pouwels, David G. Nichols, John J. Norcini, Jeffrey P. Gold, Richard E. Hawkins, Mira Irons, Joshua M. Cohen, Susan Dentzer, Catherine M. Welcher, Lois Margaret Nora, Thomas Horn, Cynthia A. Lien, R. Barrett Noone, Eric S. Holmboe, Earl J. Reisdorff, Rebecca S. Lipner, and Kevin W. Eva
- Subjects
Value (ethics) ,Educational measurement ,Quality management ,Process (engineering) ,business.industry ,media_common.quotation_subject ,010102 general mathematics ,General Medicine ,Certification ,01 natural sciences ,Education ,Maintenance of Certification ,03 medical and health sciences ,0302 clinical medicine ,Relevance (law) ,Medicine ,Engineering ethics ,Conversation ,030212 general & internal medicine ,0101 mathematics ,business ,media_common - Abstract
This article describes the presentations and discussions at a conference co-convened by the Council on Medical Education of the American Medical Association (AMA) and by the American Board of Medical Specialties (ABMS). The conference focused on the ABMS Maintenance of Certification (MOC) Part III Examination. This article, reflecting the conference agenda, covers the value of and evidence supporting the examination, as well as concerns about the cost of the examination, and-given the current format-its relevance. In addition, the article outlines alternative formats for the examination that four ABMS member boards are currently developing or implementing. Lastly, the article presents contrasting views on the approach to professional self-regulation. One view operationalizes MOC as a high-stakes, pass-fail process while the other perspective holds MOC as an organized approach to support continuing professional development and improvement. The authors hope to begin a conversation among the AMA, the ABMS, and other professional stakeholders about how knowledge assessment in MOC might align with the MOC program's educational and quality improvement elements and best meet the future needs of both the public and the physician community.
- Published
- 2016
17. Current Demographic Status of Cardiologists in the United States
- Author
-
Kara Fisher, Laxmi S. Mehta, Pamela S. Douglas, Michael J. Dill, William J. Oetgen, David A. Acosta, Stephanie J. Mitchell, Rebecca S. Lipner, and Anne K. Rzeszut
- Subjects
Male ,medicine.medical_specialty ,Population ,education ,MEDLINE ,Ethnic group ,Context (language use) ,030204 cardiovascular system & hematology ,Subspecialty ,03 medical and health sciences ,0302 clinical medicine ,Cardiologists ,Underrepresented Minority ,Health care ,medicine ,Humans ,030212 general & internal medicine ,Registries ,Healthcare Disparities ,Societies, Medical ,Retrospective Studies ,education.field_of_study ,Interventional cardiology ,business.industry ,Brief Report ,United States ,Family medicine ,Workforce ,Female ,Self Report ,Cardiology and Cardiovascular Medicine ,business - Abstract
IMPORTANCE: Increasing cardiology workforce diversity will expand the talent of the applicant pool and may reduce health care disparities. OBJECTIVE: To assess US cardiology physician workforce demographics by sex and race/ethnicity in the context of the US population and the available pipelines of trainees. DESIGN, SETTING, AND PARTICIPANTS: This cross-sectional study used data from the Association of American Medical Colleges, the American Medical Association, and the American Board of Internal Medicine to stratify medical students, resident physicians, fellows, and cardiologists by sex and race/ethnicity. Additionally, proportional changes from 2006 through 2016 were assessed for adult and pediatric cardiology. Data analysis took place from August 2018 to January 2019. MAIN OUTCOMES AND MEASURES: Percentage of cardiologists and trainees by sex and race/ethnicity in 2016, as well as changes in proportions between 2006 and 2016. RESULTS: Despite a high percentage of female internal medicine resident physicians (10 765 of 25 252 [42.6%]), female physicians were underrepresented in adult general cardiology fellowships (584 of 2720 [21.5%]) and procedural subspecialty fellowships (interventional cardiology, 30 of 305 [9.8%]; electrophysiology, 24 of 175 [13.7%]). The percentage of female adult cardiologists slightly increased from 2006 through 2016 (from 8.9% to 12.6%; slope, 0.36; P
- Published
- 2019
18. Incorporating Physician Input Into a Maintenance of Certification Examination: A Content Validity Tool
- Author
-
Rebecca S. Lipner, Marianne M. Green, Paul A. Poniatowski, Jeremy W. Dugosh, Rebecca A. Baranowski, George W. Dec, and Gerald K. Arnold
- Subjects
Adult ,Male ,Certification ,020205 medical informatics ,Process (engineering) ,Attitude of Health Personnel ,02 engineering and technology ,Education ,Maintenance of Certification ,03 medical and health sciences ,0302 clinical medicine ,Cardiologists ,Blueprint ,0202 electrical engineering, electronic engineering, information engineering ,Content validity ,Internal Medicine ,Humans ,030212 general & internal medicine ,Statistic ,Medical education ,Descriptive statistics ,Reproducibility of Results ,General Medicine ,Middle Aged ,United States ,Test (assessment) ,Scale (social sciences) ,Female ,Clinical Competence ,Educational Measurement ,Psychology - Abstract
PURPOSE As part of the American Board of Internal Medicine's (ABIM's) continuing effort to update its Maintenance of Certification (MOC) program, a content validity tool was used to conduct structured reviews of MOC exam blueprints (i.e., test specification tables) by the physician community. Results from the Cardiovascular Disease MOC blueprint review are presented to illustrate the process ABIM conducted for several internal medicine disciplines. METHOD Ratings of topic frequency and importance were collected from cardiologists in 2016 using a three-point scale (low, medium, high). The web-based survey instrument presented 188 blueprint topic descriptions, each combined with five patient-related tasks (e.g., diagnosis, treatment). Descriptive statistics and chi-square analysis were employed. RESULTS Responses from 441 review participants were analyzed. Frequency and importance ratings were aggregated as a composite statistic representing clinical relevance, and exam assembly criteria were modified to select questions, or items, addressing clinically relevant content only. Specifically, ≥ 88% of exam items now address high-importance topics, including ≤ 15% on topics that are also low frequency; and ≤ 12% of exam items now address medium-importance topics, including ≤ 3% on topics that are also low frequency. The updated blueprint has been published for test takers and provides enhanced information on content that would and would not be tested in subsequent examinations. It is linked to more detailed feedback that examinees receive on items answered incorrectly. CONCLUSIONS The blueprint review garnered valuable feedback from the physician community and provided new evidence for the content validity of the Cardiovascular Disease MOC exam.
- Published
- 2019
19. Performance on the Adult Rheumatology In-Training Examination and Relationship to Outcomes on the Rheumatology Certification Examination
- Author
-
Kristine M. Lohr, Marcy B. Bolster, Sarah Zirkle, Joanne Valeriano-Marcet, Rebecca S. Lipner, Janine L. Hawley, Steven A. Haist, Workforce Issues, Amanda L. Clauser, Brian J. Hess, and Allan C. Gelber
- Subjects
medicine.medical_specialty ,Educational measurement ,business.industry ,education ,Immunology ,MEDLINE ,Certification ,Odds ratio ,Logistic regression ,United States Medical Licensing Examination ,Confidence interval ,Rheumatology ,Family medicine ,Internal medicine ,medicine ,Physical therapy ,Immunology and Allergy ,business - Abstract
Objective The American College of Rheumatology (ACR) Adult Rheumatology In-Training Examination (ITE) is a feedback tool designed to identify strengths and weaknesses in the content knowledge of individual fellows-in-training and the training program curricula. We determined whether scores on the ACR ITE, as well as scores on other major standardized medical examinations and competency-based ratings, could be used to predict performance on the American Board of Internal Medicine (ABIM) Rheumatology Certification Examination. Methods Between 2008 and 2012, 629 second-year fellows took the ACR ITE. Bivariate correlation analyses of assessment scores and multiple linear regression analyses were used to determine whether ABIM Rheumatology Certification Examination scores could be predicted on the basis of ACR ITE scores, United States Medical Licensing Examination scores, ABIM Internal Medicine Certification Examination scores, fellowship directors’ ratings of overall clinical competency, and demographic variables. Logistic regression was used to evaluate whether these assessments were predictive of a passing outcome on the Rheumatology Certification Examination. Results In the initial linear model, the strongest predictors of the Rheumatology Certification Examination score were the second-year fellows’ ACR ITE scores (β = 0.438) and ABIM Internal Medicine Certification Examination scores (β = 0.273). Using a stepwise model, the strongest predictors of higher scores on the Rheumatology Certification Examination were second-year fellows’ ACR ITE scores (β = 0.449) and ABIM Internal Medicine Certification Examination scores (β = 0.276). Based on the findings of logistic regression analysis, ACR ITE performance was predictive of a pass/fail outcome on the Rheumatology Certification Examination (odds ratio 1.016 [95% confidence interval 1.011–1.021]). Conclusion The predictive value of the ACR ITE score with regard to predicting performance on the Rheumatology Certification Examination supports use of the Adult Rheumatology ITE as a valid feedback tool during fellowship training.
- Published
- 2015
20. Assessing the Quality of Osteoporosis Care in Practice
- Author
-
Rebecca S. Lipner, Brian J. Hess, Weifeng Weng, and Lorna A. Lynn
- Subjects
medicine.medical_specialty ,Composite score ,business.industry ,Medical record ,media_common.quotation_subject ,Osteoporosis ,Retrospective cohort study ,medicine.disease ,Family medicine ,Internal Medicine ,medicine ,Physical therapy ,Quality (business) ,Performance measurement ,Board certification ,business ,Reliability (statistics) ,media_common - Abstract
Patients with osteoporosis can sustain fractures following falls or other minimal trauma. This risk of fracture can be reduced through appropriate diagnostic testing, pharmacologic therapy, and other readily measured standards of care. Our aim was to develop a credible clinical performance assessment to measure physicians’ quality of osteoporosis care, and determine reasonable performance standards for both competent and excellent care. This was a retrospective cohort study. Three hundred and eighty one general internists and subspecialists with time-limited board certification were included in the study. Performance rates on eight evidence-based measures were obtained from the American Board of Internal Medicine (ABIM) Osteoporosis Practice Improvement Module® (PIM), a web-based tool that uses medical chart reviews to help physicians assess and improve care. We applied a patented methodology, using an adaptation of the Angoff standard-setting method and the Dunn-Rankin method, with an expert panel skilled in osteoporosis care to form a composite and establish standards for both competent and excellent care. Physician and practice characteristics, including a practice infrastructure score based on the Physician Practice Connections Readiness Survey (PPC-RS), were used to examine the validity of the inferences made from the composite scores. The mean composite score was 67.54 out of 100 maximum points with a reliability of 0.92. The standard for competent care was 46.87, and for excellent care it was 83.58. Both standards had high classification accuracies (0.95). Sixteen percent of physicians performed below the competent care standard, while 22 % met the excellent care standard. Specialists scored higher than generalists, and better practice infrastructure was associated with higher composite scores, providing some validity evidence. We developed a rigorous methodology for assessing physicians’ osteoporosis care. Clinical performance feedback relative to absolute standards of care provides physicians with a meaningful approach to self-evaluation to improve patient care.
- Published
- 2015
21. Dual Process Theory and Intermediate Effect: Are Faculty and Residents' Performance on Multiple-Choice, Licensing Exam Questions Different?
- Author
-
Rebecca S. Lipner, Steven J. Durning, Ting Dong, Lambert Schuwirth, Cees P. M. van der Vleuten, Eric S. Holmboe, Anthony R. Artino, Onderwijsontw & Onderwijsresearch, and RS: SHE - R1 - Research (OvO)
- Subjects
Adult ,Male ,Faculty, Medical ,media_common.quotation_subject ,MEDLINE ,Healthcare improvement science Radboud Institute for Health Sciences [Radboudumc 18] ,Reading (process) ,Internal Medicine ,Reaction Time ,Medicine ,Humans ,Schools, Medical ,Process Measures ,Multiple choice ,Analytic reasoning ,media_common ,Licensure ,Medical education ,Analysis of Variance ,business.industry ,Public Health, Environmental and Occupational Health ,Internship and Residency ,Dual process theory ,General Medicine ,Achievement ,Licensure, Medical ,United States ,Dual (category theory) ,Reading ,Pattern Recognition, Physiological ,Clinical Competence ,business - Abstract
Background: Clinical reasoning is essential for the practice of medicine. Dual process theory conceptualizes reasoning as falling into two general categories: nonanalytic reasoning (pattern recognition) and analytic reasoning (active comparing and contrasting of alternatives). The debate continues regarding how expert performance develops and how individuals make the best use of analytic and nonanalytic processes. Several investigators have identified the unexpected finding that intermediates tend to perform better on licensing examination items than experts, which has been termed the “intermediate effect.” Purpose: We explored differences between faculty and residents on multiple-choice questions (MCQs) using dual process measures (both reading and answering times) to inform this ongoing debate. Method: Faculty (board-certified internists; experts) and residents (internal medicine interns; intermediates) answered live licensing examination MCQs (U.S. Medical Licensing Examination Step 2 Clinical Knowledge and American Board of Internal Medicine Certifying Examination) while being timed. We conducted repeated analysis of variance to compare the 2 groups on average reading time, answering time, and accuracy on various types of items. Results: Faculty and residents did not differ significantly in reading time [F (1, 35) = 0.01, p = 0.93], answering time [F (1, 35) = 0.60, p = 0.44], or accuracy [F (1, 35) = 0.24, p = 0.63] regardless of easy or hard items. Discussion: Dual process theory was not evidenced in this study. However, this lack of difference between faculty and residents may have been affected by the small sample size of participants and MCQs may not reflect how physicians made decisions in actual practice setting.
- Published
- 2015
22. The Relationship Between Performance on the Infectious Diseases In-Training and Certification Examinations
- Author
-
Stephanie Woodward, Rebecca S. Lipner, Janine L. Hawley, Brian J. Hess, N. Cary Engleberg, Steven A. Haist, and Irina Grabovsky
- Subjects
Microbiology (medical) ,Licensure ,medicine.medical_specialty ,Medical knowledge ,Certification ,business.industry ,education ,Odds ratio ,Logistic regression ,Communicable Diseases ,United States Medical Licensing Examination ,United States ,Infectious Diseases ,Infectious disease (medical specialty) ,Family medicine ,Internal Medicine ,medicine ,Humans ,Fellowships and Scholarships ,business ,Fellowship training - Abstract
Background The Infectious Diseases Society of America In-Training Examination (IDSA ITE) is a feedback tool used to help fellows track their knowledge acquisition during fellowship training. We determined whether the scores on the IDSA ITE and from other major medical knowledge assessments predict performance on the American Board of Internal Medicine (ABIM) Infectious Disease Certification Examination. Methods The sample was 1021 second-year fellows who took the IDSA ITE and ABIM Infectious Disease Certification Examination from 2008 to 2012. Multiple regression analysis was used to determine if ABIM Infectious Disease Certification Examination scores were predicted by IDSA ITE scores, prior United States Medical Licensing Examination (USMLE) scores, ABIM Internal Medicine Certification Examination scores, fellowship director ratings of medical knowledge, and demographic variables. Logistic regression was used to evaluate if these same assessments predicted a passing outcome on the certification examination. Results IDSA ITE scores were the strongest predictor of ABIM Infectious Disease Certification Examination scores (β = .319), followed by prior ABIM Internal Medicine Certification Examination scores (β = .258), USMLE Step 1 scores (β = .202), USMLE Step 3 scores (β = .130), and fellowship directors' medical knowledge ratings (β = .063). IDSA ITE scores were also a significant predictor of passing the Infectious Disease Certification Examination (odds ratio, 1.017 [95% confidence interval, 1.013-1.021]). Conclusions The significant relationship between the IDSA ITE score and performance on the ABIM Infectious Disease Certification Examination supports the use of the ITE as a valid feedback tool in fellowship training.
- Published
- 2014
23. Comparison of Content on the American Board of Internal Medicine Maintenance of Certification Examination With Conditions Seen in Practice by General Internists
- Author
-
Marianne M. Green, Rebecca S. Lipner, Jonathan L. Vandergrift, and Bradley M. Gray
- Subjects
medicine.medical_specialty ,Certification ,Office Visits ,Concordance ,Office visits ,health care facilities, manpower, and services ,education ,MEDLINE ,01 natural sciences ,Sensitivity and Specificity ,Maintenance of Certification ,03 medical and health sciences ,0302 clinical medicine ,Internal medicine ,Physicians ,Specialty Boards ,Health care ,Outcome Assessment, Health Care ,Hospital discharge ,medicine ,Content validity ,Internal Medicine ,Humans ,030212 general & internal medicine ,0101 mathematics ,Practice Patterns, Physicians' ,health care economics and organizations ,Original Investigation ,business.industry ,010102 general mathematics ,General Medicine ,United States ,Family medicine ,Ambulatory ,Clinical Competence ,Educational Measurement ,business - Abstract
Importance Success on the internal medicine (IM) examination is a central requirement of the American Board of Internal Medicine’s (ABIM’s) Maintenance of Certification program (MOC). Therefore, it is important to understand the degree to which this examination reflects conditions seen in practice, one dimension of content validity, which focuses on the match between content in the discipline and the topics on the examination questions. Objective To assess whether the frequency of questions on IM-MOC examinations were concordant with the frequency of conditions seen in practice. Design, Setting, and Participants The 2010-2013 IM-MOC examinations were used to calculate the percentage of questions for 186 medical condition categories from the examination blueprint, which balances examination content by considering importance and frequency of conditions seen in practice. Nationally representative estimates of conditions seen in practice by general internists were estimated from the primary diagnosis for 13 832 office visits (2010-2013 National Ambulatory Medical Care Surveys) and 108 472 hospital stays (2010 National Hospital Discharge Survey). Exposures Prevalence of conditions included on the IM-MOC examination questions. Main Outcomes and Measures The outcome measure was the concordance between the percentages of IM-MOC examination questions and the percentages of conditions seen in practice during either office visits or hospital stays for each of 186 condition categories (eg, diabetes mellitus, ischemic heart disease, liver disease). The concordance thresholds were 0.5 SD of the weighted mean percentages of the applicable 186 conditions seen in practice (0.74% for office visits; 0.51% for hospital stays). If the absolute differences between the percentages of examination questions and the percentages of office visit conditions or hospital stay conditions seen were less than the applicable concordance threshold, then the condition category was judged to be concordant. Results During the 2010-2013 IM-MOC examination periods, 3600 questions (180 questions per examination form) were administered and 3461 questions (96.1%) were mapped into the 186 study conditions (mean, 18.6 questions per condition). Comparison of the percentages of 186 categories of medical conditions seen in 13 832 office visits and 108 472 hospital stays with the percentages of 3461 questions on IM-MOC examinations revealed that 2389 examination questions (69.0%; 95% CI, 67.5%-70.6% involving 158 conditions) were categorized as concordant. For concordance between questions and office visits only, 2010 questions (58.08%; 95% CI, 56.43%-59.72% of all examination questions) involving 145 conditions were categorized as concordant. For concordance between questions and hospital stays only, 1456 questions (42.07%; 95% CI, 40.42%-43.71% of all examination questions) involving 122 conditions were categorized as concordant. Conclusions and Relevance Among questions on IM-MOC examinations from 2010-2013, 69% were concordant with conditions seen in general internal medicine practices, although some areas of discordance were identified.
- Published
- 2017
24. Career Outcomes of the Graduates of the American Board of Internal Medicine Research Pathway, 1995–2007
- Author
-
Mary E. Klotman, Rebecca S. Lipner, Robert F. Todd, Myron L. Weisfeldt, Darren P. Hearn, Robert A. Salata, Joel T. Katz, and Sherry X. Xian
- Subjects
medicine.medical_specialty ,Medical education ,business.industry ,Residency curriculum ,education ,General Medicine ,Research Personnel ,United States ,humanities ,Education ,Cross-Sectional Studies ,Research Support as Topic ,Internal medicine ,Family medicine ,Internal Medicine ,medicine ,Humans ,Curriculum ,business ,health care economics and organizations - Abstract
In 1995, the American Board of Internal Medicine (ABIM) formalized an integrated residency curriculum including both clinical and research training (the Research Pathway), designed to develop careers of physician-scientists. Individuals who completed Pathway training between 1995 and 2007 were surveyed to determine the extent to which graduates established research-oriented careers.In 2012, the authors used a Web-based, 56-question, multiple-choice electronic survey of 813 participants in Research Pathway programs who completed their residency training between the years of 1995 and 2007. Survey questions addressed source and type of funding, research productivity, and job title/content. Descriptive and inferential analyses were performed.Forty-seven percent of solicited Pathway graduates participated in the survey. Ninety-seven percent of the respondents completed Pathway training. Ninety-one percent reported some research effort, with a group average of 58.6% of total professional effort spent in research. Seventy-two percent currently hold positions in academic medicine; 8.6% in the biomedical industry; and 2.1% in government medical service. Over 85% reported extramural research funding, with 81.4% receiving research support from federal sources. Among the variables positively correlated with the highest level of research engagement were previous graduate-level research training, any first-author publications arising from the Pathway research experience, and the receipt of extramural career development funding supporting the Pathway research.On the basis of a very high level of active research engagement reported by 385 ABIM Research Pathway graduates, this special research training track appears to be effectively meeting its goal of training biomedical scientists.
- Published
- 2013
25. The current state of medical simulation in interventional cardiology: A clinical document from the Society for Cardiovascular Angiography and Intervention's (SCAI) Simulation Committee
- Author
-
Andrew J. Klein, Samir Pancholy, J. Jeffery Marshall, Sunil V. Rao, Daniel H. Steinberg, John C. Messenger, Rebecca S. Lipner, and Sandy M. Green
- Subjects
medicine.medical_specialty ,Interventional cardiology ,business.industry ,Medical simulation ,education ,General Medicine ,Cardiovascular angiography ,Simulation training ,Food and drug administration ,Maintenance of Certification ,Intervention (counseling) ,medicine ,Radiology, Nuclear Medicine and imaging ,Medical physics ,Radiology ,Clinical document ,Cardiology and Cardiovascular Medicine ,business - Abstract
Objectives To assess the current use and application of simulators in interventional cardiology. Background Despite a paucity of data on the efficacy of simulation in medicine, cardiovascular simulation training is now a mandated part of cardiovascular fellowship training. Additionally, simulators have been endorsed by the Food and Drug Administration as a way to teach physicians new and novel procedures. We sought to establish the current use of simulators in cardiovascular medicine. Methods A systematic review was done of available training programs, and currently existing data regarding simulation training. A panel of experts was convened to review this data and provide recommendations as how simulation should be used in the field of interventional cardiology. Results This document provides a comprehensive review of the current state of simulation and how we as a society must formulate well validated studies to more closely examine and explore how this technology can be further studied and validated. Conclusions Simulation will likely take on a larger role in cardiovascular training and maintenance of certification, but at the current time lacks a large body of evidence for its use. © 2013 Wiley Periodicals, Inc.
- Published
- 2013
26. The Relationship Between Communication Scores From the USMLE Step 2 Clinical Skills Examination and Communication Ratings for First-Year Internal Medicine Residents
- Author
-
Brian E. Clauser, Marcia L. Winward, Rebecca S. Lipner, Monica M. Cuddy, and Mary M. Johnston
- Subjects
Male ,medicine.medical_specialty ,education ,MEDLINE ,Sample (statistics) ,Context (language use) ,Education ,Interpersonal relationship ,Social skills ,Internal medicine ,Internal Medicine ,Humans ,Medicine ,Interpersonal Relations ,Licensure ,Analysis of Variance ,Medical education ,business.industry ,Communication ,Multilevel model ,Internship and Residency ,General Medicine ,Licensure, Medical ,United States Medical Licensing Examination ,United States ,Linear Models ,Female ,Clinical Competence ,business - Abstract
Purpose This study extends available evidence about the relationship between scores on the Step 2 Clinical Skills (CS) component of the United States Medical Licensing Examination and subsequent performance in residency. It focuses on the relationship between Step 2 CS communication and interpersonal skills scores and communication skills ratings that residency directors assign to residents in their first postgraduate year of internal medicine training. It represents the first large-scale evaluation of the extent to which Step 2 CS communication and interpersonal skills scores can be extrapolated to examinee performance in supervised practice. Method Hierarchical linear modeling techniques were used to examine the relationships among examinee characteristics, residency program characteristics, and residency-director-provided ratings. The sample comprised 6,306 examinees from 238 internal medicine residency programs who completed Step 2 CS for the first time in 2005 and received ratings during their first year of internal medicine residency training. Results Although the relationship is modest, Step 2 CS communication and interpersonal skills scores predict communication skills ratings for first-year internal medicine residents after accounting for other factors. Conclusions The results of this study make a reasonable case that Step 2 CS communication and interpersonal skills scores provide useful information for predicting the level of communication skill that examinees will display in their first year of internal medicine residency training. This finding demonstrates some level of extrapolation from the testing context to behavior in supervised practice, thus providing validity-related evidence for using Step 2 CS communication and interpersonal skills scores in high-stakes decisions.
- Published
- 2013
27. Performance of Physicians Trained Through the Research Pathway in Internal Medicine
- Author
-
Eric S. Holmboe, Rebecca S. Lipner, and Carola Lelieveld
- Subjects
Adult ,Male ,medicine.medical_specialty ,Biomedical Research ,Certification ,Faculty, Medical ,education ,Affect (psychology) ,Patient care ,Education ,Specialty Boards ,Internal medicine ,Internal Medicine ,medicine ,Humans ,Career Choice ,Education, Medical ,business.industry ,Internship and Residency ,General Medicine ,Achievement ,Family medicine ,Clinical training ,Female ,Clinical Competence ,Curriculum ,business - Abstract
Educators in internal medicine are concerned that reducing clinical training from three years to two could negatively affect physicians' ability to provide good patient care. Physician-scientists already follow a short-track research pathway that shortens clinical training to two years. The authors examine whether this shortened training affects ability.The authors use a national sample of 101,031 physicians who took their first internal medicine certification examination between 1993 and 2008 and trained in either a traditional or research pathway. They collected data, including demographics, exam information, and maintenance of certification (MOC) return rates. They used regression models to assess the relationship between training pathway and MOC exam scores and eventual certification status, adjusting for physician characteristics.In this study, research pathway training did not adversely impact internal medicine certification status. Although the scores of physicians who followed the research pathway were slightly lower, the effect size was small. In a subset of research pathway physicians, 63% remained in academic medicine and 37% continued to spend a substantial portion of time in medical research 10 years later.Different training pathways can lead to similar achievements in clinical judgment. The educational model, competency-based rather than time-dependent, that works for research pathway physicians could be extended to other talented trainees who would benefit by customizing training to meet career goals.
- Published
- 2012
28. Relationship of Electronic Medical Knowledge Resource Use and Practice Characteristics with Internal Medicine Maintenance of Certification Examination Scores
- Author
-
Colin P. West, Furman S. McDonald, Rebecca S. Lipner, Andrew J. Halvorsen, Carola Jacobs, Darcy A. Reed, and Eric S. Holmboe
- Subjects
Adult ,Male ,Medical knowledge ,medicine.medical_specialty ,Certification ,Cross-sectional study ,Maintenance of Certification ,Internal medicine ,Internal Medicine ,Humans ,Medicine ,Quality of care ,Decision Making, Computer-Assisted ,Original Research ,Medical education ,business.industry ,Internship and Residency ,Middle Aged ,Licensure, Medical ,Cross-Sectional Studies ,Family medicine ,Resource use ,Female ,Clinical Competence ,Clinical competence ,business - Abstract
Maintenance of certification examination performance is associated with quality of care. We aimed to examine relationships between electronic medical knowledge resource use, practice characteristics and examination scores among physicians recertifying in internal medicine.We conducted a cross-sectional study of 3,958 United States physicians who took the Internal Medicine Maintenance of Certification Examination (IM-MOCE) between January 1, 2006 and December 31, 2008, and who held individual licenses to one or both of two large electronic knowledge resource programs. We examined associations between physicians' IM-MOCE scores and their days of electronic resource use, practice type (private practice, residency teaching clinic, inpatient, nursing home), practice model (single or multi-specialty), sex, age, and medical school location.In the 365 days prior to the IM-MOCE, physicians used electronic resources on a mean (SD, range) of 20.3 (36.5, 0-265) days. In multivariate analyses, the number of days of resource use was independently associated with increased IM-MOCE scores (0.07-point increase per day of use, p = 0.02). Increased age was associated with decreased IM-MOCE scores (1.8-point decrease per year of age, p 0.001). Relative to physicians working in private practice settings, physicians working in residency teaching clinics and hospital inpatient practices had higher IM-MOCE scores by 29.1 and 20.0 points, respectively (both p 0.001).Frequent use of electronic resources was associated with modestly enhanced IM-MOCE performance. Physicians involved in residency education clinics and hospital inpatient practices had higher IM-MOCE scores than physicians working in private practice settings.
- Published
- 2012
29. Factors That Influence General Internistsʼ and Surgeonsʼ Performance on Maintenance of Certification Exams
- Author
-
Hao Song, Rebecca S. Lipner, Robert S. Rhodes, and Thomas W. Biester
- Subjects
Adult ,Male ,medicine.medical_specialty ,Certification ,Isolation (health care) ,Attitude of Health Personnel ,education ,Specialty ,Education ,Maintenance of Certification ,Continuing medical education ,Specialty Boards ,Surveys and Questionnaires ,Health care ,Internal Medicine ,Humans ,Medicine ,Practice Patterns, Physicians' ,Design improvement ,Solo practice ,Primary Health Care ,business.industry ,General Medicine ,United States ,General Surgery ,Family medicine ,Education, Medical, Continuing ,Female ,Clinical Competence ,business - Abstract
PURPOSE Good clinical judgment is important to providing high-quality patient care. Keeping current in one's field is challenged by rapid advances in health care and demanding practices. Understanding the collective factors that influence a practicing physician's clinical judgment could help medical educators design improvement programs that target specific audiences. METHOD Data from two medical specialty boards, the American Board of Internal Medicine and American Board of Surgery, were used. Multiple regression analyses were conducted relating first-attempt performance on the maintenance of certification (MOC) exam with physician age, amount of continuing medical education (CME) undertaken, number of physicians in the practice, medical school type, and prior exam performance. Data were based on demographics and exam scores of 18,447 general internists and 4,961 general surgeons who took the MOC exam for the first time between 2003 and 2007. RESULTS Similar findings were obtained for general internists and surgeons. Younger physicians, those with higher scores on initial certification, physicians in group not solo practice, and U.S. medical graduates were significantly more likely to pass the MOC exam (P
- Published
- 2011
30. Setting a Fair Performance Standard for Physicians’ Quality of Patient Care
- Author
-
Lorna A. Lynn, Weifeng Weng, Rebecca S. Lipner, Brian J. Hess, and Eric S. Holmboe
- Subjects
Adult ,Male ,medicine.medical_specialty ,Adolescent ,media_common.quotation_subject ,MEDLINE ,Patient care ,Cohort Studies ,Young Adult ,Nursing ,Physicians ,Diabetes Mellitus ,Internal Medicine ,Humans ,Medicine ,Quality (business) ,Prospective Studies ,Aged ,Quality of Health Care ,Retrospective Studies ,media_common ,business.industry ,Public health ,Editorials ,Clinical performance ,Retrospective cohort study ,Middle Aged ,Employee Performance Appraisal ,Female ,Clinical Competence ,Patient Care ,business ,Cohort study - Abstract
Assessing physicians' clinical performance using statistically sound, evidence-based measures is challenging. Little research has focused on methodological approaches to setting performance standards to which physicians are being held accountable.Determine if a rigorous approach for setting an objective, credible standard of minimally-acceptable performance could be used for practicing physicians caring for diabetic patients.Retrospective cohort study.Nine hundred and fifty-seven physicians from the United States with time-limited certification in internal medicine or a subspecialty.The ABIM Diabetes Practice Improvement Module was used to collect data on ten clinical and two patient experience measures. A panel of eight internists/subspecialists representing essential perspectives of clinical practice applied an adaptation of the Angoff method to judge how physicians who provide minimally-acceptable care would perform on individual measures to establish performance thresholds. Panelists then rated each measure's relative importance and the Dunn-Rankin method was applied to establish scoring weights for the composite measure. Physician characteristics were used to support the standard-setting outcome.Physicians abstracted 20,131 patient charts and 18,974 patient surveys were completed. The panel established reasonable performance thresholds and importance weights, yielding a standard of 48.51 (out of 100 possible points) on the composite measure with high classification accuracy (0.98). The 38 (4%) outlier physicians who did not meet the standard had lower ratings of overall clinical competence and professional behavior/attitude from former residency program directors (p = 0.01 and p = 0.006, respectively), lower Internal Medicine certification and maintenance of certification examination scores (p = 0.005 and p0.001, respectively), and primarily worked as solo practitioners (p = 0.02).The standard-setting method yielded a credible, defensible performance standard for diabetes care based on informed judgment that resulted in a reasonable, reproducible outcome. Our method represents one approach to identifying outlier physicians for intervention to protect patients.
- Published
- 2010
31. The Comprehensive Care Project: Measuring Physician Performance in Ambulatory Practice
- Author
-
Sheldon Greenfield, Sherrie H. Kaplan, Rebecca S. Lipner, Sarah Hood, Gerald K. Arnold, Weifeng Weng, Sharon-Lise T. Normand, and Eric S. Holmboe
- Subjects
Chronic care ,medicine.medical_specialty ,business.industry ,Intraclass correlation ,Health Policy ,Medical record ,Certification ,External validity ,Acute care ,Health care ,Ambulatory ,medicine ,Physical therapy ,business - Abstract
Objective. To investigate the feasibility, reliability, and validity of comprehensively assessing physician-level performance in ambulatory practice. Data Sources/Study Setting. Ambulatory-based general internists in 13 states participated in the assessment. Study Design. We assessed physician-level performance, adjusted for patient factors, on 46 individual measures, an overall composite measure, and composite measures for chronic, acute, and preventive care. Between- versus within-physician variation was quantified by intraclass correlation coefficients (ICC). External validity was assessed by correlating performance on a certification exam. Data Collection/Extraction Methods. Medical records for 236 physicians were audited for seven chronic and four acute care conditions, and six age- and gender-appropriate preventive services. Principal Findings. Performance on the individual and composite measures varied substantially within (range 5–86 percent compliance on 46 measures) and between physicians (ICC range 0.12–0.88). Reliabilities for the composite measures were robust: 0.88 for chronic care and 0.87 for preventive services. Higher certification exam scores were associated with better performance on the overall (r=0.19; p
- Published
- 2010
32. Evaluating Validity Evidence for USMLE Step 2 Clinical Skills Data Gathering and Data Interpretation Scores: Does Performance Predict History-Taking and Physical Examination Ratings for First-Year Internal Medicine Residents?
- Author
-
Brian E. Clauser, Marcia L. Winward, Rebecca S. Lipner, Mary M. Johnston, and Monica M. Cuddy
- Subjects
medicine.medical_specialty ,Educational measurement ,Canada ,020205 medical informatics ,MEDLINE ,Physical examination ,02 engineering and technology ,Education ,03 medical and health sciences ,0302 clinical medicine ,0202 electrical engineering, electronic engineering, information engineering ,medicine ,Internal Medicine ,Humans ,Medical history ,030212 general & internal medicine ,Medical History Taking ,Physical Examination ,Licensure ,Medical education ,Data collection ,medicine.diagnostic_test ,business.industry ,Internship and Residency ,General Medicine ,Licensure, Medical ,United States Medical Licensing Examination ,United States ,Family medicine ,Linear Models ,Clinical Competence ,Educational Measurement ,business ,Clinical skills - Abstract
To add to the small body of validity research addressing whether scores from performance assessments of clinical skills are related to performance in supervised patient settings, the authors examined relationships between United States Medical Licensing Examination (USMLE) Step 2 Clinical Skills (CS) data gathering and data interpretation scores and subsequent performance in history taking and physical examination in internal medicine residency training.The sample included 6,306 examinees from 238 internal medicine residency programs who completed Step 2 CS for the first time in 2005 and whose performance ratings from their first year of residency training were available. Hierarchical linear modeling techniques were used to examine the relationships among Step 2 CS data gathering and data interpretation scores and history-taking and physical examination ratings.Step 2 CS data interpretation scores were positively related to both history-taking and physical examination ratings. Step 2 CS data gathering scores were not related to either history-taking or physical examination ratings after other USMLE scores were taken into account.Step 2 CS data interpretation scores provide useful information for predicting subsequent performance in history taking and physical examination in supervised practice and thus provide validity evidence for their intended use as an indication of readiness to enter supervised practice. The results show that there is less evidence to support the usefulness of Step 2 CS data gathering scores. This study provides important information for practitioners interested in Step 2 CS specifically or in performance assessments of medical students' clinical skills more generally.
- Published
- 2015
33. Association of Physician Certification in Interventional Cardiology With In-Hospital Outcomes of Percutaneous Coronary Intervention
- Author
-
Joseph Brennan, Rebecca S. Lipner, Brahmajee K. Nallamothu, Brian J. Hess, Paul N. Fiorilli, Henry H. Ting, John C. Messenger, Karl E. Minges, Jeptha P. Curtis, Eric S. Holmboe, and Jeph Herrin
- Subjects
Male ,medicine.medical_specialty ,Certification ,medicine.medical_treatment ,Article ,Case mix index ,Percutaneous Coronary Intervention ,Risk Factors ,Physiology (medical) ,Angioplasty ,Physicians ,medicine ,Humans ,Myocardial infarction ,Hospital Mortality ,Intensive care medicine ,Aged ,Interventional cardiology ,business.industry ,Percutaneous coronary intervention ,Middle Aged ,medicine.disease ,Treatment Outcome ,Hospital outcomes ,Conventional PCI ,Female ,Cardiology Service, Hospital ,Cardiology and Cardiovascular Medicine ,business - Abstract
Background— The value of American Board of Internal Medicine certification has been questioned. We evaluated the Association of Interventional Cardiology certification with in-hospital outcomes of patients undergoing percutaneous coronary intervention (PCI) in 2010. Methods and Results— We identified physicians who performed ≥10 PCIs in 2010 in the CathPCI Registry and determined interventional cardiology (ICARD) certification status using American Board of Internal Medicine data. We compared in-hospital outcomes of patients treated by certified and noncertified physicians using hierarchical multivariable models adjusted for differences in patient characteristics and PCI volume. Primary end points were all-cause in-hospital mortality and bleeding complications. Secondary end points included emergency coronary artery bypass grafting, vascular complications, and a composite of any adverse outcome. With 510 708 PCI procedures performed by 5175 physicians, case mix and unadjusted outcomes were similar among certified and noncertified physicians. The adjusted risks of in-hospital mortality (odds ratio, 1.10; 95% confidence interval, 1.02–1.19) and emergency coronary artery bypass grafting (odds ratio, 1.32; 95% confidence interval, 1.12–1.56) were higher in the non–ICARD-certified group, but the risks of bleeding and vascular complications and the composite end point were not statistically significantly different between groups. Conclusions— We did not observe a consistent association between ICARD certification and the outcomes of PCI procedures. Although there was a significantly higher risk of mortality and emergency coronary artery bypass grafting in patients treated by non–ICARD-certified physicians, the risks of vascular complications and bleeding were similar. Our findings suggest that ICARD certification status alone is not a strong predictor of patient outcomes and indicate a need to enhance the value of subspecialty certification.
- Published
- 2015
34. Performance on the adult rheumatology in-training examination and relationship to outcomes on the rheumatology certification examination
- Author
-
Kristine M, Lohr, Amanda, Clauser, Brian J, Hess, Allan C, Gelber, Joanne, Valeriano-Marcet, Rebecca S, Lipner, Steven A, Haist, Janine L, Hawley, Sarah, Zirkle, and Marcy B, Bolster
- Subjects
Certification ,Rheumatology ,Humans ,Clinical Competence ,Educational Measurement - Abstract
The American College of Rheumatology (ACR) Adult Rheumatology In-Training Examination (ITE) is a feedback tool designed to identify strengths and weaknesses in the content knowledge of individual fellows-in-training and the training program curricula. We determined whether scores on the ACR ITE, as well as scores on other major standardized medical examinations and competency-based ratings, could be used to predict performance on the American Board of Internal Medicine (ABIM) Rheumatology Certification Examination.Between 2008 and 2012, 629 second-year fellows took the ACR ITE. Bivariate correlation analyses of assessment scores and multiple linear regression analyses were used to determine whether ABIM Rheumatology Certification Examination scores could be predicted on the basis of ACR ITE scores, United States Medical Licensing Examination scores, ABIM Internal Medicine Certification Examination scores, fellowship directors' ratings of overall clinical competency, and demographic variables. Logistic regression was used to evaluate whether these assessments were predictive of a passing outcome on the Rheumatology Certification Examination.In the initial linear model, the strongest predictors of the Rheumatology Certification Examination score were the second-year fellows' ACR ITE scores (β = 0.438) and ABIM Internal Medicine Certification Examination scores (β = 0.273). Using a stepwise model, the strongest predictors of higher scores on the Rheumatology Certification Examination were second-year fellows' ACR ITE scores (β = 0.449) and ABIM Internal Medicine Certification Examination scores (β = 0.276). Based on the findings of logistic regression analysis, ACR ITE performance was predictive of a pass/fail outcome on the Rheumatology Certification Examination (odds ratio 1.016 [95% confidence interval 1.011-1.021]).The predictive value of the ACR ITE score with regard to predicting performance on the Rheumatology Certification Examination supports use of the Adult Rheumatology ITE as a valid feedback tool during fellowship training.
- Published
- 2015
35. Association between imposition of a Maintenance of Certification requirement and ambulatory care-sensitive hospitalizations and health care costs
- Author
-
Lorna A. Lynn, Jonathan L. Vandergrift, Bradley M. Gray, Jeffrey S. McCullough, Rebecca S. Lipner, James D. Reschovsky, Mary M. Johnston, and Eric S. Holmboe
- Subjects
medicine.medical_specialty ,Certification ,Time Factors ,MEDLINE ,Medicare ,Maintenance of Certification ,Cohort Studies ,Ambulatory care ,Specialty Boards ,Health care ,Outcome Assessment, Health Care ,medicine ,Ambulatory Care ,Internal Medicine ,Humans ,Aged ,Quality Indicators, Health Care ,business.industry ,General Medicine ,Health Care Costs ,United States ,Hospitalization ,Family medicine ,Cohort ,Ambulatory ,Emergency medicine ,business ,Cohort study - Abstract
Importance In 1990, the American Board of Internal Medicine (ABIM) ended lifelong certification by initiating a 10-year Maintenance of Certification (MOC) program that first took effect in 2000. Despite the importance of this change, there has been limited research examining associations between the MOC requirement and patient outcomes. Objective To measure associations between the original ABIM MOC requirement and outcomes of care. Design, Setting, and Participants Quasi-experimental comparison between outcomes for Medicare beneficiaries treated in 2001 by 2 groups of ABIM-certified internal medicine physicians (general internists). One group (n = 956), initially certified in 1991, was required to fulfill the MOC program in 2001 (MOC-required) and treated 84 215 beneficiaries in the sample; the other group (n = 974), initially certified in 1989, was grandfathered out of the MOC requirement (MOC-grandfathered) and treated 69 830 similar beneficiaries in the sample. We compared differences in outcomes for the beneficiary cohort treated by the MOC-required general internists before (1999-2000) and after (2002-2005) they were required to complete MOC, using the beneficiary cohort treated by the MOC-grandfathered general internists as the control. Main Outcomes and Measures Quality measures were ambulatory care–sensitive hospitalizations (ACSHs), measured using prevention quality indicators. Ambulatory care–sensitive hospitalizations are hospitalizations triggered by conditions thought to be potentially preventable through better access to and quality of outpatient care. Other outcomes included health care cost measures (adjusted to 2013 dollars). Results Annual incidence of ACSHs (per 1000 beneficiaries) increased from the pre-MOC period (37.9 for MOC-required beneficiaries vs 37.0 for MOC-grandfathered beneficiaries) to the post-MOC period (61.8 for MOC-required beneficiaries vs 61.4 for MOC-grandfathered beneficiaries) for both cohorts, as did annual per-beneficiary health care costs (pre-MOC period, $5157 for MOC-required beneficiaries vs $5133 for MOC-grandfathered beneficiaries; post-MOC period, $7633 for MOC-required beneficiaries vs $7793 for MOC-grandfathered beneficiaries). The MOC requirement was not statistically associated with cohort differences in the growth of the annual ACSH rate (per 1000 beneficiaries, 0.1 [95% CI, −1.7 to 1.9];P = .92), but was associated with a cohort difference in the annual, per-beneficiary cost growth of −$167 (95% CI, −$270.5 to −$63.5;P = .002; 2.5% of overall mean cost). Conclusion and Relevance Imposition of the MOC requirement was not associated with a difference in the increase in ACSHs but was associated with a small reduction in the growth differences of costs for a cohort of Medicare beneficiaries.
- Published
- 2014
36. Website ratings of physicians and their quality of care
- Author
-
Jeffrey S. McCullough, Jonathan L. Vandergrift, Bradley M. Gray, Rebecca S. Lipner, and Guodong Gordon Gao
- Subjects
medicine.medical_specialty ,Internet ,business.industry ,Family medicine ,Health care ,Internal Medicine ,medicine ,Humans ,The Internet ,Quality of care ,business ,United States ,Quality of Health Care - Published
- 2014
37. Blink or think: can further reflection improve initial diagnostic impressions?
- Author
-
Valerie Thompson, Mark L. Graber, Rebecca S. Lipner, Brian J. Hess, and Eric S. Holmboe
- Subjects
Male ,Reflection (computer programming) ,Time Factors ,Decision Making ,Diagnostic accuracy ,Certification ,Item difficulty ,Keystroke logging ,Choice Behavior ,Education ,Hierarchical generalized linear model ,Thinking ,Specialty Boards ,Diagnosis ,Internal Medicine ,Humans ,Cognitive skill ,Medical diagnosis ,Internship and Residency ,General Medicine ,United States ,Linear Models ,Female ,Educational Measurement ,Psychology ,Social psychology ,Cognitive psychology - Abstract
PURPOSE Experienced clinicians derive many diagnoses intuitively, because most new problems they see closely resemble problems they've seen before. The majority of these diagnoses, but not all, will be correct. This study determined whether further reflection regarding initial diagnoses improves diagnostic accuracy during a high-stakes board exam, a model for studying clinical decision making. METHOD Keystroke response data were used from 500 residents who took the 2010 American Board of Internal Medicine (ABIM) Internal Medicine Certification Examination. Data included time to initial response on each question, whether the answer was correct, and whether or not the resident changed her or his initial response. The focus was on 80 diagnosis questions that comprised realistic clinical vignettes with multiple-choice single-best answers. Cognitive skill (ability) was measured using overall exam scores. Case complexity was determined using item difficulty (proportion of examinees that correctly answered the question). A hierarchical generalized linear model was used to assess the relationship between time spent on initial responses and the probability of correctly answering the questions. RESULTS On average, residents changed their responses on 12% of all diagnosis questions (or 9.6 questions out of 80). Changing an answer from incorrect to correct was almost twice as likely as changing an answer from correct to incorrect. The relationship between response time and accuracy was complex. CONCLUSIONS Further reflection appears to be beneficial to diagnostic accuracy, especially for more complex cases.
- Published
- 2014
38. ACC IN-TRAINING EXAMINATION PREDICTS OUTCOMES ON THE ABIM CERTIFICATION EXAMINATION
- Author
-
Rebecca S. Lipner, Julia Indik, Steven A. Haist, Jeffrey Kuvin, Lauren M Duhigg, Jonathan D. Rubright, Furman McDonald, and Naomi Botkin
- Subjects
Medical education ,business.industry ,Medicine ,Certification ,Cardiology and Cardiovascular Medicine ,business - Published
- 2017
39. The association between residency training and internists' ability to practice conservatively
- Author
-
Eric S. Holmboe, Rebecca S. Lipner, Mary M. Johnston, and Brenda E. Sirovich
- Subjects
Adult ,Male ,medicine.medical_specialty ,Certification ,Referral ,Cross-sectional study ,MEDLINE ,Unnecessary Procedures ,Article ,Health care ,Internal Medicine ,Medicine ,Humans ,Practice Patterns, Physicians' ,Association (psychology) ,Referral and Consultation ,business.industry ,Practice patterns ,Internship and Residency ,Health Care Costs ,United States ,Cross-Sectional Studies ,Family medicine ,Linear Models ,Female ,business ,Residency training - Abstract
Growing concern about rising costs and potential harms of medical care has stimulated interest in assessing physicians' ability to minimize the provision of unnecessary care.To assess whether graduates of residency programs characterized by low-intensity practice patterns are more capable of managing patients' care conservatively, when appropriate, and whether graduates of these programs are less capable of providing appropriately aggressive care.Cross-sectional comparison of 6639 first-time takers of the 2007 American Board of Internal Medicine certifying examination, aggregated by residency program (n = 357).Intensity of practice, measured using the End-of-Life Visit Index, which is the mean number of physician visits within the last 6 months of life among Medicare beneficiaries 65 years and older in the residency program's hospital referral region.The mean score by program on the Appropriately Conservative Management (ACM) (and Appropriately Aggressive Management [AAM]) subscales, comprising all American Board of Internal Medicine certifying examination questions for which the correct response represented the least (or most, respectively) aggressive management strategy. Mean scores on the remainder of the examination were used to stratify programs into 4 knowledge tiers. Data were analyzed by linear regression of ACM (or AAM) scores on the End-of-Life Visit Index, stratified by knowledge tier.Within each knowledge tier, the lower the intensity of health care practice in the hospital referral region, the better residency program graduates scored on the ACM subscale (P .001 for the linear trend in each tier). In knowledge tier 4 (poorest), for example, graduates of programs in the lowest-intensity regions had a mean ACM score in the 38th percentile compared with the 22nd percentile for programs in the highest-intensity regions; in tier 2, ACM scores ranged from the 75th to the 48th percentile in regions from lowest to highest intensity. Graduates of programs in low-intensity regions tended, more weakly, to score better on the AAM subscale (in 3 of 4 knowledge tiers).Regardless of overall medical knowledge, internists trained at programs in hospital referral regions with lower-intensity medical practice are more likely to recognize when conservative management is appropriate. These internists remain capable of choosing an aggressive approach when indicated.
- Published
- 2014
40. Characteristics of internal medicine physicians and their practices that have differential impacts on their maintenance of certification
- Author
-
Bradley G. Brossman and Rebecca S. Lipner
- Subjects
Adult ,Male ,medicine.medical_specialty ,Certification ,media_common.quotation_subject ,education ,Sample (statistics) ,Education ,Maintenance of Certification ,Poverty Areas ,Health care ,medicine ,Internal Medicine ,Practice Management, Medical ,Humans ,Quality (business) ,Multinomial logistic regression ,media_common ,Aged ,Medical education ,Poverty ,business.industry ,Age Factors ,Differential (mechanical device) ,General Medicine ,Middle Aged ,United States ,Logistic Models ,Family medicine ,Group Practice ,Female ,Psychology ,business ,Specialization - Abstract
PURPOSE One way to ensure quality of health care in the United States is through maintenance of certification (MOC). In this study, the authors explored whether participation in the internal medicine MOC program varies by physician-level characteristics, professional activities, and the size and location of the practice. They also sought to determine which component of MOC was incomplete for physicians who participated but did not complete the program. METHOD The authors used a theoretical realist approach to understand whether participation in the American Board of Internal Medicine MOC program varies according to physician and practice characteristics. The data came from a study sample that consisted of all physicians whose original certification was granted in internal medicine from 1990 through 1999; the study was conducted in 2013. Chi-square tests of independence and a multinomial logistic regression were conducted to determine which physician-level characteristics, professional activities, and practice characteristics were significantly associated with MOC participation. RESULTS Results showed that physicians who completed MOC tended to have higher certification exam scores; were younger; were U.S. medical graduates; practiced as subspecialists and in the Midwest; spent more time in patient care, teaching, or administration; worked in nonsolo practices; or were employed in counties with less than 20% of persons in poverty. CONCLUSIONS As certifying boards evaluate their programs, they need to continuously improve their features to assure the public that physicians maintaining certification are providing high-quality patient care.
- Published
- 2014
41. Assessing the effects of the 2003 resident duty hours reform on internal medicine board scores
- Author
-
Dylan S. Small, Charles L. Bosk, Patrick S Romano, Kamal M.F. Itani, Jeffrey H. Silber, Orit Even-Shoshan, Rebecca S. Lipner, Amy K. Rosen, Yanli Wang, Sophia Korovaichuk, Michael J. Halenar, and Kevin G. Volpp
- Subjects
Adult ,Male ,medicine.medical_specialty ,media_common.quotation_subject ,education ,Clinical Sciences ,Specialty ,Graduate medical education ,Workload ,Education ,Accreditation ,Cohort Studies ,03 medical and health sciences ,Patient safety ,0302 clinical medicine ,Quality of life (healthcare) ,Internal medicine ,Medical ,Work Schedule Tolerance ,Specialty Boards ,General & Internal Medicine ,Internal Medicine ,Medicine ,Humans ,030212 general & internal medicine ,Graduate ,Duty ,media_common ,Retrospective Studies ,Medical education ,business.industry ,Knowledge level ,Internship and Residency ,Research Reports ,General Medicine ,United States Medical Licensing Examination ,United States ,3. Good health ,Education, Medical, Graduate ,Family medicine ,Health Care Reform ,ComputingMethodologies_DOCUMENTANDTEXTPROCESSING ,Female ,Health care reform ,Clinical Competence ,business ,030217 neurology & neurosurgery ,Curriculum and Pedagogy - Abstract
Supplemental Digital Content is available in the text., Purpose To determine whether the 2003 Accreditation Council for Graduate Medical Education (ACGME) duty hours reform affected medical knowledge as reflected by written board scores for internal medicine (IM) residents. Method The authors conducted a retrospective cohort analysis of postgraduate year 1 (PGY-1) Internal Medicine residents who started training before and after the 2003 duty hour reform using a merged data set of American Board of Internal Medicine (ABIM) Board examination and the National Board of Medical Examiners (NMBE) United States Medical Licensing Examination (USMLE) Step 2 Clinical Knowledge test scores. Specifically, using four regression models, the authors compared IM residents beginning PGY-1 training in 2000 and completing training unexposed to the 2003 duty hours reform (PGY-1 2000 cohort, n = 5,475) to PGY-1 cohorts starting in 2001 through 2005 (n = 28,008), all with some exposure to the reform. Results The mean ABIM board score for the unexposed PGY-1 2000 cohort (n = 5,475) was 491, SD = 85. Adjusting for demographics, program, and USMLE Step 2 exam score, the mean differences (95% CI) in ABIM board scores between the PGY-1 2001, 2002, 2003, 2004 and 2005 cohorts minus the PGY-1 2000 cohort were −5.43 (−7.63, −3.23), −3.44 (−5.65, −1.24), 2.58 (0.36, 4.79), 11.10 (8.88, 13.33) and 11.28 (8.98, 13.58) points respectively. None of these differences exceeded one-fifth of an SD in ABIM board scores. Conclusions The duty hours reforms of 2003 did not meaningfully affect medical knowledge as measured by scores on the ABIM board examinations.
- Published
- 2014
42. Correlations Between Ratings on the Resident Annual Evaluation Summary and the Internal Medicine Milestones and Association With ABIM Certification Examination Scores Among US Internal Medicine Residents, 2013-2014
- Author
-
Stanley J. Hamstra, William Iobst, Sarah Hood, Karen E. Hauer, Rebecca S. Lipner, Jonathan L. Vandergrift, Furman S. McDonald, Eric S. Holmboe, and Brian J. Hess
- Subjects
medicine.medical_specialty ,Educational measurement ,Academic year ,020205 medical informatics ,business.industry ,education ,MEDLINE ,02 engineering and technology ,General Medicine ,Certification ,03 medical and health sciences ,0302 clinical medicine ,Rating scale ,Internal medicine ,Family medicine ,Developmental Milestone ,0202 electrical engineering, electronic engineering, information engineering ,medicine ,Milestone (project management) ,030212 general & internal medicine ,business ,Association (psychology) - Abstract
Importance US internal medicine residency programs are now required to rate residents using milestones. Evidence of validity of milestone ratings is needed. Objective To compare ratings of internal medicine residents using the pre-2015 resident annual evaluation summary (RAES), a nondevelopmental rating scale, with developmental milestone ratings. Design, Setting, and Participants Cross-sectional study of US internal medicine residency programs in the 2013-2014 academic year, including 21 284 internal medicine residents (7048 postgraduate-year 1 [PGY-1], 7233 PGY-2, and 7003 PGY-3). Exposures Program director ratings on the RAES and milestone ratings. Main Outcomes and Measures Correlations of RAES and milestone ratings by training year; correlations of medical knowledge ratings with American Board of Internal Medicine (ABIM) certification examination scores; rating of unprofessional behavior using the 2 systems. Results Corresponding RAES ratings and milestone ratings showed progressively higher correlations across training years, ranging among competencies from 0.31 (95% CI, 0.29 to 0.33) to 0.35 (95% CI, 0.33 to 0.37) for PGY-1 residents to 0.43 (95% CI, 0.41 to 0.45) to 0.52 (95% CI, 0.50 to 0.54) for PGY-3 residents (all P values P values P P P P Conclusions and Relevance Among US internal medicine residents in the 2013-2014 academic year, milestone-based ratings correlated with RAES ratings but with a greater difference across training years. Both rating systems for medical knowledge correlated with ABIM certification examination scores. Milestone ratings may better detect problems with professionalism. These preliminary findings may inform establishment of the validity of milestone-based assessment.
- Published
- 2016
43. Certification and Specialization
- Author
-
Rebecca S. Lipner, John J. Norcini, and Harry R. Kimball
- Subjects
medicine.medical_specialty ,Certification ,health care facilities, manpower, and services ,education ,Treatment outcome ,Cardiology ,Myocardial Infarction ,Hospital mortality ,Severity of Illness Index ,Education ,Internal medicine ,Severity of illness ,Internal Medicine ,medicine ,Humans ,Hospital Mortality ,cardiovascular diseases ,Myocardial infarction ,health care economics and organizations ,business.industry ,General Medicine ,Pennsylvania ,medicine.disease ,Treatment Outcome ,Emergency medicine ,Linear Models ,Medicine ,Family Practice ,business ,Specialization - Abstract
To learn whether there are differences among certified and self-designated cardiologists, internists, and family practitioners in terms of the mortality of their patients with acute myocardial infarction (AMI).Data on all patients admitted with AMI were collected for calendar year 1993 by the Pennsylvania Health Care Cost Containment Council and analyzed. Certified and self-designated family practitioners, internists, and cardiologists (n = 4,546) were compared with respect to the characteristics of their patients' illnesses. In addition, a regression model was fitted in which mortality was the dependent measure and the independent variables were the probability of death, hospital characteristics (location and the availability of advanced cardiac care), and physician characteristics (patient volume, years since graduation from medical school, specialty, and certification status).On average, cardiologists treated more patients than did generalists, and their patients were less severely ill. In the regression analysis, all variables were statistically significant except the availability of advanced cardiac care. Holding all other variables constant, treatment by a certified physician was associated with a 15% reduction in mortality among patients with AMI.Less patient mortality was associated with treatment by physicians who were cardiologists, cared for larger numbers of AMI patients, were closer to their graduation from medical school, and were certified.
- Published
- 2000
44. Functional Neuroimaging Correlates of Burnout among Internal Medicine Residents and Faculty Members
- Author
-
Thomas J. Beckman, Christopher M. Wittich, Anthony R. Artino, Cees P. M. van der Vleuten, Steven J. Durning, Michelle E. Costanzo, Eric S. Holmboe, Rebecca S. Lipner, Liselotte N. Dyrbye, Lambert Schuwirth, and Michael J. Roy
- Subjects
medicine.medical_specialty ,lcsh:RC435-571 ,education ,Burnout ,Quality of life (healthcare) ,Functional neuroimaging ,Internal medicine ,lcsh:Psychiatry ,medicine ,Middle frontal gyrus ,Psychiatry ,Emotional exhaustion ,Original Research ,medicine.diagnostic_test ,burnout ,cognitive load ,fMRI ,Cognition ,Effective primary care and public health [NCEBP 7] ,United States Medical Licensing Examination ,Psychiatry and Mental health ,expertise ,clinical reasoning ,Functional magnetic resonance imaging ,Psychology ,psychological phenomena and processes ,Clinical psychology - Abstract
Contains fulltext : 125473.pdf (Publisher’s version ) (Open Access) Burnout is prevalent in residency training and practice and is linked to medical error and suboptimal patient care. However, little is known about how burnout affects clinical reasoning, which is essential to safe and effective care. The aim of this study was to examine how burnout modulates brain activity during clinical reasoning in physicians. Using functional Magnetic Resonance Imaging (fMRI), brain activity was assessed in internal medicine residents (n = 10) and board-certified internists (faculty, n = 17) from the Uniformed Services University (USUHS) while they answered and reflected upon United States Medical Licensing Examination and American Board of Internal Medicine multiple-choice questions. Participants also completed a validated two-item burnout scale, which includes an item assessing emotional exhaustion and an item assessing depersonalization. Whole brain covariate analysis was used to examine blood-oxygen-level-dependent (BOLD) signal during answering and reflecting upon clinical problems with respect to burnout scores. Higher depersonalization scores were associated with less BOLD signal in the right dorsolateral prefrontal cortex and middle frontal gyrus during reflecting on clinical problems and less BOLD signal in the bilateral precuneus while answering clinical problems in residents. Higher emotional exhaustion scores were associated with more right posterior cingulate cortex and middle frontal gyrus BOLD signal in residents. Examination of faculty revealed no significant influence of burnout on brain activity. Residents appear to be more susceptible to burnout effects on clinical reasoning, which may indicate that residents may need both cognitive and emotional support to improve quality of life and to optimize performance and learning. These results inform our understanding of mental stress, cognitive control as well as cognitive load theory.
- Published
- 2013
45. Do Early Career Indicators of Clinical Skill Predict Subsequent Career Outcomes and Practice Characteristics for General Internists?
- Author
-
Rebecca S. Lipner, Bradley M. Gray, Eric S. Holmboe, and James D. Reschovsky
- Subjects
Male ,Educational measurement ,Certification ,Cross-sectional study ,education ,MEDLINE ,Job Satisfaction ,Nursing ,Residence Characteristics ,Physicians ,Internal Medicine ,Medicine ,Humans ,Early career ,business.industry ,Health Policy ,Racial Groups ,Internship and Residency ,Professional Practice ,humanities ,Cross-Sectional Studies ,Income ,Job satisfaction ,Female ,Clinical Competence ,Educational Measurement ,Board certification ,business ,Clinical skills - Abstract
To study relationships between clinical skill measures assessed at the beginning of general internists' careers and their career outcomes and practice characteristics.General Internist Community Tracking Study Physician Survey respondents (2000-2001, 2004-2005) linked with residency program evaluations and American Board of Internal Medicine board certification examination score records; n = 2,331.Cross-sectional regressions of career outcome and practice characteristic measures on board examination scores/success, residency evaluations interacted with residency type, and potential confounding variables.Failure to achieve board certification was associated with $27,206 (18 percent, p.05) less income and 14.9 percent more minority patients relative to physicians scoring in the bottom quartile on their initial examination who eventually became certified (p.01). Other skill measures were not associated with income. Scoring in the top rather than bottom quartile on the board certification examination was associated with 9 percent increased likelihood of reporting high career satisfaction (p.05). Among physicians trained in community hospital residency programs, lower evaluations were associated with 14.5 percent higher share of minority patients (p.05). Both skill measures were associated with practice type.There are associations between early career skill measures and career outcomes. In addition, minority patients are more likely to be treated by physicians with lower early career clinical skills measures than nonminority patients.
- Published
- 2012
46. The Value of Patient and Peer Ratings in Recertification
- Author
-
Gregory S Fortna, Linda L. Blank, Rebecca S. Lipner, and Brian F Leas
- Subjects
Male ,medicine.medical_specialty ,Validation study ,Certification ,Self-Evaluation Programs ,Education, Medical ,Self-Evaluation Program ,Attitude of Health Personnel ,business.industry ,General Medicine ,Middle Aged ,Professional competence ,Education ,Professional Competence ,Family medicine ,Internal Medicine ,Humans ,Medicine ,Female ,business ,Attitude to Health ,Value (mathematics) ,Specialization ,Total Quality Management - Published
- 2002
47. Clinical protocols and trainee knowledge about mechanical ventilation
- Author
-
Scarlett L. Bellamy, Rebecca S. Lipner, Gordon D. Rubenfeld, Jason D. Christie, Jeremy M. Kahn, Brian J. Hess, Meeta Prasad, and Eric S. Holmboe
- Subjects
Adult ,Male ,medicine.medical_specialty ,Certification ,Critical Care ,Journal Club Critique ,Sedation ,medicine.medical_treatment ,Decision Making ,Context (language use) ,law.invention ,Cohort Studies ,Clinical Protocols ,law ,medicine ,Internal Medicine ,Humans ,Fellowships and Scholarships ,Retrospective Studies ,Mechanical ventilation ,Protocol (science) ,business.industry ,Data Collection ,Retrospective cohort study ,General Medicine ,Decision Support Systems, Clinical ,Intensive care unit ,Respiration, Artificial ,United States ,Education, Medical, Graduate ,Ventilation (architecture) ,Physical therapy ,Female ,Clinical Competence ,medicine.symptom ,business - Abstract
Expanded abstract Citation Prasad M, Holmboe ES, Lipner RS, Hess BJ, Christie JD, Bellamy SL, Rubenfeld GD, Kahn JM. Clinical Protocols and Trainee Knowledge About Mechanical Ventilation. JAMA. 2011; 306(9):935-941. PubMed PMID: 21900133 This is available on http://www.pubmed.gov Background Clinical protocols are associated with improved patient outcomes; however, they may negatively affect medical education by removing trainees from clinical decision making. Methods Objective: To study the relationship between critical care training with mechanical ventilation protocols and subsequent knowledge about ventilator management. Design: A retrospective cohort equivalence study linking a national survey of mechanical ventilation protocol availability with knowledge about mechanical ventilation. Exposure to protocols was defined as high intensity if an intensive care unit had 2 or more protocols for at least 3 years and as low intensity if 0 or 1 protocol. Setting: Accredited US pulmonary and critical care fellowship programs. Subjects: First-time examinees of the American Board of Internal Medicine (ABIM) Critical Care Medicine Certification Examination in 2008 and 2009. Intervention: N/A Outcomes: Knowledge, measured by performance on examination questions specific to mechanical ventilation management, calculated as a mechanical ventilation score using item response theory. The score is standardized to a mean (SD) of 500 (100), and a clinically important difference is defined as 25. Variables included in adjusted analyses were birth country, residency training country, and overall first-attempt score on the ABIM Internal Medicine Certification Examination. Results The 90 of 129 programs (70%) responded to the survey. Seventy seven programs (86%) had protocols for ventilation liberation, 66 (73%) for sedation management, and 54 (60%) for lung-protective ventilation at the time of the survey. Eighty eight (98%) of these programs had trainees who completed the ABIM Critical Care Medicine Certification Examination, totaling 553 examinees. Of these 88 programs, 27 (31%) had 0 protocols, 19 (22%) had 1 protocol, 24 (27%) had 2 protocols, and 18 (20%) had 3 protocols for at least 3 years. 42 programs (48%) were classified as high intensity and 46 (52%) as low intensity, with 304 trainees (55%) and 249 trainees (45%), respectively. In bi-variable analysis, no difference in mean scores was observed in high-intensity (497; 95% CI, 486-507) vs low-intensity programs (497; 95% CI, 485-509). Mean difference was 0 (95% CI, -16 to 16), with a positive value indicating a higher score in the high-intensity group. In multivariable analyses, no association of training was observed in a high-intensity program with mechanical ventilation score (adjusted mean difference, -5.36; 95% CI, -20.7 to 10.0). Conclusions Among first-time ABIM Critical Care Medicine Certification Examination examinees, training in a high-intensity ventilator protocol environment compared with a low-intensity environment was not associated with worse performance on examination questions about mechanical ventilation management.
- Published
- 2011
48. Where Have All the General Internists Gone?
- Author
-
Gregory S. Fortna, Wayne H. Bylsma, Rebecca S. Lipner, and Gerald K. Arnold
- Subjects
Adult ,Male ,Gerontology ,medicine.medical_specialty ,Economic shortage ,Primary care ,Subspecialty ,Cohort Studies ,General Practitioners ,Internal Medicine ,medicine ,Humans ,Aged ,Original Research ,Aged, 80 and over ,Career Choice ,business.industry ,Data Collection ,Public health ,Editorials ,Mail survey ,Middle Aged ,Career satisfaction ,Family medicine ,Stepping stone ,Medicine ,Female ,business ,Cohort study - Abstract
A shortage of primary care physicians is expected, due in part to decreasing numbers of physicians entering general internal medicine (GIM). Practicing general internists may contribute to the shortage by leaving internal medicine (IM) for other careers in and out of medicine. To better understand mid-career attrition in IM. Mail survey to a national sample of internists originally certified by the American Board of Internal Medicine in GIM or an IM subspecialty during the years 1990 to 1995. Self-reported current status as working in IM, working in another medical or non-medical field, not currently working but plan to return, or retired; and career satisfaction. Nine percent of all internists in the 1990–1995 certification cohorts and a significantly larger proportion of general internists (17%) than IM subspecialists [(4%) P
- Published
- 2010
49. Toward better care coordination through improved communication with referring physicians
- Author
-
Eric S. Holmboe, Lorna A. Lynn, Rebecca S. Lipner, and Brian J. Hess
- Subjects
Male ,medicine.medical_specialty ,Performance report ,Descriptive statistics ,business.industry ,Communication ,Interprofessional Relations ,MEDLINE ,General Medicine ,Middle Aged ,Subspecialty ,Education ,Family medicine ,Scale (social sciences) ,Surveys and Questionnaires ,Practice improvement ,medicine ,Humans ,Generalizability theory ,Female ,business ,Referral and Consultation - Abstract
Background Effective care coordination requires good physician-to-physician communication. The authors evaluated a new tool called the Communication with Referring Physicians Practice Improvement Module (CRP-PIM), which assesses and encourages improved communication among physician consultants and referring physicians. Method Eight-hundred three consultants (internists and subspecialists) completed a practice system survey and were rated by 12,212 referring physicians on 13 communication processes using a six-point scale. Consultants received an interactive performance report and selected targets for improvement. Data were analyzed using descriptive statistics, correlations, t tests, and factor analysis. Results Mean overall rating was high, at 5.53 (SD 0.23, range 2.46-5.95); consultants still identified areas for improvement. The generalizability coefficient for overall ratings was 0.78. Factor analysis supported two categories of ratings associated with consultants' gender, subspecialty, residency performance ratings, and specific practice system features. Conclusions The CRP-PIM provides a psychometrically viable measure and encourages consultants to improve communication with referring physicians.
- Published
- 2009
50. Variation in Internal Medicine Residency Clinic Practices: Assessing Practice Environments and Quality of Care
- Author
-
Lorna A. Lynn, Judy A. Shea, F. Daniel Duffy, Rebecca S. Lipner, Eric S. Holmboe, and Jeanette Mladenovic
- Subjects
Adult ,Male ,medicine.medical_specialty ,Professional practice ,macromolecular substances ,Ambulatory Care Facilities ,Patient satisfaction ,Nursing ,Risk Factors ,Internal Medicine ,Medicine ,Humans ,Quality of care ,Practice Patterns, Physicians' ,Aged ,Quality of Health Care ,Medical education ,business.industry ,musculoskeletal, neural, and ocular physiology ,Public health ,Data Collection ,Internship and Residency ,Middle Aged ,musculoskeletal system ,Preventive cardiology ,Outcome and Process Assessment, Health Care ,Socioeconomic Factors ,Cardiovascular Diseases ,Patient Satisfaction ,General practice ,Original Article ,Female ,Clinical Competence ,Clinical competence ,business ,tissues - Abstract
Few studies have systematically and rigorously examined the quality of care provided in educational practice sites.The objectives of this study were to (1) describe the patient population cared for by trainees in internal medicine residency clinics; (2) assess the quality of preventive cardiology care provided to these patients; (3) characterize the practice-based systems that currently exist in internal medicine residency clinics; and (4) examine the relationships between quality, practice-based systems, and features of the program: size, type of program, and presence of an electronic medical record.This is a cross-sectional observational study.This study was conducted in 15 Internal Medicine residency programs (23 sites) throughout the USA.The participants included site champions at residency programs and 709 residents.Abstracted charts provided data about patient demographics, coronary heart disease risk factors, processes of care, and clinical outcomes. Patients completed surveys regarding satisfaction. Site teams completed a practice systems survey.Chart abstraction of 4,783 patients showed substantial variability across sites. On average, patients had between 3 and 4 of the 9 potential risk factors for coronary heart disease, and approximately 21% had at least 1 important barrier of care. Patients received an average of 57% (range, 30-77%) of the appropriate interventions. Reported satisfaction with care was high. Sites with an electronic medical record showed better overall information management (81% vs 27%) and better modes of communication (79% vs 43%).This study has provided insight into the current state of practice in residency sites including aspects of the practice environment and quality of preventive cardiology care delivered. Substantial heterogeneity among the training sites exists. Continuous measurement of the quality of care provided and a better understanding of the training environment in which this care is delivered are important goals for delivering high quality patient care.
- Published
- 2008
Catalog
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.