Search

Purpose: Little is known about the acquisition of clinical reasoning skills in medical school, the development of clinical reasoning over the medical curriculum as a whole, and the impact of various curricular methodologies on these skills. This study investigated (1) whether there are differences in clinical reasoning skills between learners at different years of medical school, and (2) whether there are differences in performance between students at schools with various curricular methodologies., Method: Students (n = 2,394) who had completed zero to three years of medical school at five U.S. medical schools participated in a cross-sectional study in 2008. Students took the same diagnostic pattern recognition (DPR) and clinical data interpretation (CDI) tests. Percent correct scores were used to determine performance differences. Data from all schools and students at all levels were aggregated for further analysis., Results: Student performance increased substantially as a result of each year of training. Gains in DPR and CDI performance during the third year of medical school were not as great as in previous years across the five schools. CDI performance and performance gains were lower than DPR performance and gains. Performance gains attributable to training at each of the participating medical schools were more similar than different., Conclusions: Years of training accounted for most of the variation in DPR and CDI performance. As a rule, students at higher training levels performed better on both tests, though the expected larger gains during the third year of medical school did not materialize.

Purpose: In May 2007, the Association of American Medical Colleges and the Carl J. Shapiro Institute for Education and Research cosponsored "Millennium Conference 2007: A Collaborative Approach to Educational Research" (MC07). Educational leaders from eight U.S. medical schools and the host school (Harvard Medical School) sought to develop an operational list of the national medical education research priorities identified at the MC07., Method: The authors asked a diverse group of medical educators to evaluate the research priorities broadly outlined by MC07 participants, further refining the priorities, framing them into research questions with testable hypotheses, and ranking them. Through an iterative process among representatives from each of the MC07 participating institutions, 11 research priorities were identified, and each was reframed as a problem to be addressed with a testable hypothesis. Then, in a multiinstitutional survey, MC07 participants ranked each priority by its perceived national importance, feasibility, fundability, and amenability for multiinstitutional research., Results: The impact of medical school simulation training on residents' performance emerged as the highest-rated priority, and the impact of faculty development on learner outcomes was the lowest-rated priority among MC07 participating schools., Conclusions: The process of framing medical education priorities in the form of testable hypotheses with measurable outcomes was an effective way for a diverse group of national medical education leaders to develop an agenda for educational research. The authors hope that this list will inform the national discussion on priorities in medical education research and will serve to help move this agenda forward.

Purpose: To investigate whether and how use of an online remediation system requiring reflective review of performance and self-assessment influenced students' performance on objective structured clinical examination (OSCE) station repeats (subsequent to failure on the first attempt) and their self-assessments of their performance (between the first and second attempts)., Method: Fourth-year medical students' performances on seven OSCE stations were videotaped at University of Michigan Medical School in 2006. Failing students took the exam again; remediation included self-assessment and review, plus faculty guidance for failures that were greater than one standard error of measurement of the distribution. A total of 1,171 possible observations of students' actual performance and performance self-assessments were analyzed using independent and dependent t tests and within-subjects ANOVA., Results: Results indicate statistically significant changes in students' performance between first and second attempts and statistically significant improvements in self-assessment between first and second attempts. No significant changes were found between self-assessed and faculty-guided remediation., Conclusions: This study provides evidence that OSCE remediation combining review, reflection, and self-assessment has a salutary effect on (subsequent) performance and self-assessment of performance.

Purpose: The third-year students at one medical school told the authors that values core to patient-centered care were impossible to practice in clerkships, in a culture where supervisors role modeled behaviors in direct conflict with patient-centered care. As they developed a new medical student curriculum, the authors designed the Family Centered Experience (FCE) to help students achieve developmental goals and understand the importance of and provide a foundation for patient-centered care., Method: The authors solicited members of the first cohort to complete the FCE (the class of 2007) to participate in this focus-group-based study halfway through the third year. They explored the influence of the FCE on students' experiences in the third-year clerkships, and how conflicts between the two learning experiences shaped these students' values and behaviors., Results: Students reported that during clerkships they experienced strong feelings of powerlessness and conflict between what they had learned about patient-centered care in the first two years and what they saw role modeled in the third year. Based on students' comments, the authors categorized students into one of three groups: those whose patient-centered values were maintained, compromised, or transformed., Conclusions: Students revealed that their conflict was connected to feelings of powerlessness, along with exacerbating factors including limited time, concerns about expectations for their behavior, and pessimism about change. Role modeling had a significant influence on consequences related to students' patient-centered values.

Purpose: The authors investigated adaptation of Bloom's and Simpson's taxonomies for the medical (student) setting, and using the adapted taxonomies to determine whether a summative objective structured clinical examination (OSCE) used at their medical school was assessing higher-order knowledge, skills, and attitudes., Method: Two faculty members (including H.M.H.) adapted the taxonomies and used them to categorize (knowledge, skills, or attitudes) and rank (by level within the taxonomies) every item on every OSCE station checklist. Interrater reliability was moderate to high., Results: Although there was a range of domains and levels within and across stations, on average every OSCE station was assessing learning behaviors at a lower level than expectations articulated in the school's goals for medical students' education., Conclusions: The adapted taxonomies were useful for assessing the domains and levels of behaviors measured on the summative OSCE, and they can also be used to modify existing checklists or to create new assessment instruments that meet the expectations articulated in a school's goals for medical students' education.

Purpose: To use qualitative analysis of interview transcripts with clinician-educators who facilitate small-group discussions on psychosocial themes--including doctoring--to answer the question, "What impact does facilitating small-group discussions of the patient's experience with chronic illness, the doctor-patient relationship, and doctoring have on faculty instructors' attitudes regarding their roles as clinicians and teachers?", Method: In 2006, in-depth, face-to-face interviews using an open-ended question format were conducted with individual faculty small-group instructors teaching in the Family Centered Experience and Longitudinal Case Studies courses at the University of Michigan Medical School. Interview transcripts were analyzed using grounded theory methodology to identify emerging themes. Accuracy of interpretations and saturation of themes was confirmed by repeated contextual reading of the transcripts., Results: Several major thematic codes emerged from the data. Facilitation of small-group discussions of psychosocial topics and doctoring fostered reflective approaches to patient care and teaching; enhanced interpersonal relationships between facilitators and their students, colleagues, and patients; and acted as a source of fulfillment and renewal among faculty facilitators., Conclusions: Small-group teaching of the art of doctoring may stimulate personal and professional growth among faculty facilitators and renewed interest in teaching and patient care.

Purpose: To examine the effects of the new resident work-hour restrictions on medical students, as measured by their perceptions of the quality of their experiences during the required clerkships., Method: Evaluations of four clerkships were compared for two student cohorts at the University of Michigan Medical School. The first cohort, from the class of 2002-03, completed their clinical clerkships the year before the work-hour restrictions were implemented, and the second cohort, from the class of 2003-04, completed their clerkships the same year the restrictions were implemented., Results: There were significant and notable differences in the experiences of the two cohorts. Students' perceptions of the quality of their experiences in the surgery-oriented clerkships (obstetrics-gynecology and surgery) in particular were significantly lower (i.e., more negative) in the 2003-04 cohort than in the previous cohort for the same clerkships. The nonsurgery-oriented clerkships (internal medicine and pediatrics) hired hospitalists, who offset the residents' workload (internal medicine) and assumed teaching responsibilities (pediatrics). Between 2002-03 and 2003-04, students' perceptions of the quality of their experience in the internal medicine clerkship remained mostly stable, and increased in several areas for the students in the pediatrics clerkship., Conclusions: Implementation of resident work-hour restrictions had significant effects on the education of the medical students studied. These effects need to be carefully analyzed and considered to ensure quality education for medical students. The findings also highlight that the nature of students' perceptions was related to preparations made (or not) by specific clerkships as restricted work-hour regulations were adopted.

Computer-assisted instruction (CAI) holds significant promise for meeting the current challenges of medical education by providing consistent and quality teaching materials regardless of training site. The Computer-assisted Learning in Pediatrics Project (CLIPP) was created over three years (2000-2003) to meet this potential through multi-institutional development of interactive Internet-based patient simulations that comprehensively teach the North American core pediatrics clerkship curriculum. Project development adhered to four objectives: (1) comprehensive coverage of the core curriculum; (2) uniform approach to CAI pedagogy; (3) multi-institutional development by educators; and (4) extensive evaluation by users. Pediatrics clerkship directors from 30 institutions worked in teams to develop a series of 31 patient case simulations. An iterative process of case content and pedagogy development, case authoring, peer review, and pilot-testing ensured that the needs of clerkship directors and medical students were met. Fifty medical schools in the United States and Canada are presently using CLIPP. More than 8,000 students have completed over 98,000 case sessions, with an average of 2,000 case sessions completed per week at this time. Each CLIPP case has been completed by more than 3,000 students. The current cost of CLIPP development is approximately $70 per student user, or $6 per case session. The project's success demonstrates that multi-institutional development and implementation of a peer-reviewed comprehensive CAI learning program by medical educators is feasible and provides a useful model for other organizations to develop similar programs. Although CAI development is both time-consuming and costly, the initial investment decreases significantly with broad use over time.

Purpose: To assess students' performances on a health-beliefs communication OSCE station to determine whether there were differences in cultural competence based on the students' ethnic backgrounds., Method: A total of 71 students completed a health-beliefs communication OSCE station in which they were required to address the health beliefs and cultural concerns of a standardized patient (SP) portraying an African American woman with diabetes. The SPs rated students' performances on a ten-item interview assessment checklist. Scores on the station were standardized within SPs to adjust for differences in their use of the rating scale. A factor analysis was performed to determine conceptual constructs on the interview assessment checklist. Subscale means were computed for each student. T-tests of these subscale scores were conducted to investigate gender and ethnic differences between subgroups of students. The underrepresented minority (URM) students (five African Americans and three Mexican Americans) were compared with all other students, and the white students were compared with all others. To assess the magnitudes of the differences between subgroups, effect sizes (ES(m)) were computed for means comparisons., Results: Factor analysis formed two factors: Disease Beliefs and Management, and Cultural Concerns. Two remaining items loaded on a third factor that had reliability too low to support further analysis. Meaningful differences were found in cultural sensitivity based on students' ethnic backgrounds. The URM students performed better than did all other students in addressing the patient's concerns about altering culturally-based dietary behaviors for diabetes self-care [URM students' mean standardized score (SD) = 0.42 (0.15); all others = -0.01 (0.67); ES(m) = 1.05]. White students performed better than did all other students in assessing the patient's concerns about using insulin to control her blood sugar levels [white students' mean standardized score (SD) = 0.13 (0.40); all others = -0.10 (0.64); ES(m) = 0.4]., Conclusion: Cultural competency deficits and differences were measurable using a health-beliefs communications station, and these differences were meaningful enough to warrant faculty discussion and research about how to ensure that students master this competency.

In 1997, five years after a major curricular reform at the University of Michigan Medical School, the authors revisited the Goals for Medical Education (written by faculty to guide the reform process) to identify factors that had facilitated or hindered their achievement. By reviewing responses to identical questionnaires circulated to faculty in 1993 and again in 1997, they learned that considerably more lectures were being used to deliver curricular content in the first-year curriculum than the faculty thought was ideal, and that less social science, humanities, and ethics material was being presented in the first year than the faculty thought was ideal. The authors also learned that consensus between faculty basic scientists and faculty clinicians about the content that would make up an ideal first-year curriculum had diverged since adoption of the new curriculum. Movement toward decreasing the amounts of social sciences, humanities, and ethics in the first year of medical school was particularly pronounced among the basic scientists, who felt this material was being taught prematurely and at the expense of essential basic science content. In contrast, by 1997 much closer agreement had developed between the two groups regarding time they would allocate for lectures; this agreement unfortunately reflected a stagnation in the adoption of active learning methods. Movement toward increasing the amount of time for lectures in the first-year curriculum was particularly pronounced among the clinicians, who reported feeling more and more pressured to bring in clinical revenues. Based on faculty comments and the school's experience with centralized governance and centralized funding, the authors propose a direct linkage between institutional funding to departments and the teaching effort of faculty in the departments, and sufficient, centralized funding to relieve pressure on faculty and to foster educational creativity. They maintain that this may be the most effective way to guarantee ongoing innovation, support interdisciplinary teaching, and subsequently move the curriculum and teachers completely away from content that is isolated within traditional department structures. At the same time they acknowledge that changing faculty attitudes presents a challenge.

Purpose: Accurate self-assessment is an essential skill for the self-directed learning activities and appropriate patient referral decisions of practicing physicians. However, many questions about the characteristics of self-assessment remain unanswered. One is whether self-assessment is a generalizable skill or dependent on the characteristics of the task. This study examines the self-assessment skills of medical students across two task formats: performance-based and cognitive-based., Method: In 1997 and 1998, fourth-year medical students at the University of Michigan assessed their own performances on ten stations of a clinical examination. The examination used two formats: performance tasks (the examination or history taking of standardized patients) and cognitive tasks (interpreting vignettes or test results and then answering paper-and-pencil questions). Three measures of self-assessment accuracy were used: a bias index (average difference between the students' estimates of their performances and their actual scores), a deviation index (average absolute difference between estimate and actual score), and an actual score-estimate-of-performance correlation (the correlation between the estimate and actual scores)., Results: The student bias and deviation indices were similar on the cognitive and the performance tasks. The correlations also indicated similarity between the two types of tasks., Conclusion: The results indicate that the format of the task does not influence students' abilities to self-assess their performances, and that students' self-assessment abilities are consistent over a range of skills and tasks. The authors also emphasize the importance of sampling tasks while conducting self-assessment research.