Search

Purpose: Competency-based medical education relies on feedback from workplace-based assessment (WBA) to direct learning. Unfortunately, WBAs often lack rich narrative feedback and show bias towards Medical Expert aspects of care. Building on research examining interactive assessment approaches, the Queen's University Internal Medicine residency program introduced a facilitated, team-based assessment initiative ("Feedback Fridays") in July 2017, aimed at improving holistic assessment of resident performance on the inpatient medicine teaching units. In this study, we aim to explore how Feedback Fridays contributed to formative assessment of Internal Medicine residents within our current model of competency-based training., Method: A total of 53 residents participated in facilitated, biweekly group assessment sessions during the 2017 and 2018 academic year. Each session was a 30-minute facilitated assessment discussion done with one inpatient team, which included medical students, residents, and their supervising attending. Feedback from the discussion was collected, summarized, and documented in narrative form in electronic WBA forms by the program's assessment officer for the residents. For research purposes, verbatim transcripts of feedback sessions were analyzed thematically., Results: The researchers identified four major themes for feedback: communication, intra- and inter-personal awareness, leadership and teamwork, and learning opportunities. Although feedback related to a broad range of activities, it showed strong emphasis on competencies within the intrinsic CanMEDS roles. Additionally, a clear formative focus in the feedback was another important finding., Conclusions: The introduction of facilitated team-based assessment in the Queen's Internal Medicine program filled an important gap in WBA by providing learners with detailed feedback across all CanMEDS roles and by providing constructive recommendations for identified areas for improvement., Competing Interests: The authors have no conflicts of interest., (© 2024 Braund, Dalgarno, O’Dell, Taylor; licensee Synergies Partners.)

Background: Personal learning plans (PLPs) have gained traction in postgraduate medical education as an avenue for enhancing resident learning. However, implementing PLPs in real-world education settings presents unique challenges. To realise the potential of PLPs, we must understand the factors that influence the quality of PLP implementation. The purpose of this study was to explore the use and implementation of PLPs during residency training from the residents' and academic advisors' perspectives within a competency-based residency programme., Methods: We conducted semi-structured interviews with residents (n = 18) and academic advisors (n = 9) in an Internal Medicine residency programme at a Canadian academic centre. Interviews were audio recorded, transcribed verbatim and analysed using open coding., Findings: Three higher order themes were developed to represent the participants' perceptions of implementing PLPs in a competency-based residency programme: (a) setting the stage for learning, (b) fostering meaningful engagement and (c) learning through reflection. Results indicated that implementing PLPs requires collaboration between residents and academic advisors and supports from the broader programme and institution. PLP implementation is an iterative process that can provide a salient avenue for reflection and the development of self-regulation skills., Discussion and Conclusion: PLPs can be a useful tool to foster self-regulated learning skills in residency education. It is imperative to consider how social and environmental supports can be enacted to facilitate engagement with, and implementation of, PLPs., (© 2023 Association for the Study of Medical Education and John Wiley & Sons Ltd.)

Objective: As competency-based medical education is being implemented across Canada, there is an increasing need to evaluate the progress to date, including identification of strengths and weaknesses, to inform program development. Ophthalmology is preparing for a national launch in coming years. The purpose of this study was to describe key stakeholders' lived experiences in the competency-based medical education foundation-of-discipline stage in one ophthalmology department., Design: Using a case-study approach, a qualitative rapid-cycle evaluation was conducted during the 2018-2019 academic year., Participants: Residents, faculty, academic advisors, competence committee members, the program director, the program administrator, and the educational consultant were invited to participate in the program evaluation., Methods: The rapid-cycle evaluation consisted of 2 evaluation cycles, with the first round of interviews and focus groups occurring in October 2018 and the second round in March 2019. Recommendations were implemented in November 2019 and June 2019. All data were analyzed thematically using NVivo., Results: Three main themes emerged across all data sets: developing a shared understanding (e.g., role expectations and changes to assessment), refining assessment processes and tools (e.g., the need for streamlining and clarification), and feedback (e.g., perceived benefits and value of narrative comments)., Conclusions: Exploring lived experiences in this study resulted in positive and immediate improvements to the residency program. The recommendations and approach will be useful to other Canadian departments and institutions as they prepare for Competence by Design., (Copyright © 2022 Canadian Ophthalmological Society. Published by Elsevier Inc. All rights reserved.)

Objective: To describe a virtual, competency-based skin and wound care (SWC) skills training model. The ECHO (Extension for Community Healthcare Outcomes) Ontario SWC pivoted from an in-person boot camp to a virtual format because of the COVID-19 pandemic., Methods: An outcome-based program evaluation was conducted. Participants first watched guided commentary and videos of experts performing in nine SWC multiskills videos, then practiced and video-recorded themselves performing those skills; these recordings were assessed by facilitators. Data were collected using pre-post surveys and rubric-based assessments. Descriptive statistics and thematic analysis were applied to data analysis., Results: Fifty-five healthcare professionals participated in the virtual boot camp, measured by the submission of at least one video. A total of 216 videos were submitted and 215 assessment rubrics were completed. Twenty-nine participants completed the pre-boot camp survey (53% response rate) and 26 responded to the post-boot camp survey (47% response rate). The strengths of the boot camp included the applicability of virtual learning to clinical settings, boot camp supplies, tool kits, and teaching strategies. The analysis of survey responses indicated that average proficiency scores were greater than 80% for three videos, 50% to 70% for three of the videos, and less than 50% for three of the videos. Participants received lower scores in local wound care and hand washing points of contact. The barriers of the boot camp included technical issues, time, level of knowledge required at times, and lack of equipment and access to interprofessional teams., Conclusions: This virtual ECHO SWC model expanded access to practical skills acquisition. The professional development model presented here is generalizable to other healthcare domains., (Copyright © 2024 Wolters Kluwer Health, Inc. All rights reserved.)

Residents and faculty have described a burden of assessment related to the implementation of competency-based medical education (CBME), which may undermine its benefits. Although this concerning signal has been identified, little has been done to identify adaptations to address this problem. Grounded in an analysis of an early Canadian pan-institutional CBME adopter's experience, this article describes postgraduate programs' adaptations related to the challenges of assessment in CBME. From June 2019-September 2022, 8 residency programs underwent a standardized Rapid Evaluation guided by the Core Components Framework (CCF). Sixty interviews and 18 focus groups were held with invested partners. Transcripts were analyzed abductively using CCF, and ideal implementation was compared with enacted implementation. These findings were then shared back with program leaders, adaptations were subsequently developed, and technical reports were generated for each program. Researchers reviewed the technical reports to identify themes related to the burden of assessment with a subsequent focus on identifying adaptations across programs. Three themes were identified: (1) disparate mental models of assessment processes in CBME, (2) challenges in workplace-based assessment processes, and (3) challenges in performance review and decision making. Theme 1 included entrustment interpretation and lack of shared mindset for performance standards. Adaptations included revising entrustment scales, faculty development, and formalizing resident membership. Theme 2 involved direct observation, timeliness of assessment completion, and feedback quality. Adaptations included alternative assessment strategies beyond entrustable professional activity forms and proactive assessment planning. Theme 3 related to resident data monitoring and competence committee decision making. Adaptations included adding resident representatives to the competence committee and assessment platform enhancements. These adaptations represent responses to the concerning signal of significant burden of assessment within CBME being experienced broadly. The authors hope other programs may learn from their institution's experience and navigate the CBME-related assessment burden their invested partners may be facing., (Copyright © 2023 by the Association of American Medical Colleges.)

Background: Medical assistance in dying (MAID) became legal across Canada when Bill C-14 was passed in 2016. Currently, little is known about the most effective strategies for providing MAID education, and the importance of integrating MAID into existing curricula. In this study, a set of learning objectives (LOs) was developed to inform a foundational MAID curriculum in Canadian Family Medicine (FM) residency training programs., Methods: Mixed methods were used to develop LOs based on a published needs assessment from a large, four-site family medicine residency program in southeastern Ontario. Draft LOs were evaluated and revised by faculty and resident leaders using a modified Delphi process and a focus group. LOs were mapped to the existing family medicine residency curriculum, as well as the College of Family Physicians of Canada's Priority Topics., Results: Nine LOs were developed to provide a foundational education regarding MAID. While all LOs could be mapped to the Domains of Clinical Care within the departmental curriculum, they mapped inconsistently to departmental Entrustable Professional Activities and the Priority Topics. LOs focused on patient education and identification of patient goals were most readily mapped to existing curricular framework, while LOs with MAID-exclusive content revealed gaps in the current curriculum., Conclusions: The developed LOs provide a guide to ensure family medicine residents obtain generalist-level knowledge to counsel their patients about MAID. These LOs can serve as a model for developing LOs for both family medicine and specialist residency programs in Canada and in countries where MAID is legal., (© 2022. The Author(s).)

Objectives: Systematic program evaluation of the Queen's University diagnostic radiology residency program following transition to a competency-based medical education (CBME) curriculum., Methods: Rapid Evaluation methodology and the Core Components Framework were utilized to measure CBME implementation. A combination of interviews and focus groups were held with program leaders (n = 6), faculty (n = 10), both CBME stream and traditional stream residents (n = 6), and program staff (n = 2). Interviews and focus groups were transcribed and analyzed abductively. Study team met with program leaders to review common themes and plan potential adaptations., Results: Strengths of CBME implementation included more frequent and timely feedback as well as the role of the Academic Advisor. However, frontline faculty felt insufficiently supported with regards to the theory and practical implementation of the new curriculum and found assessment tools unintuitive. The circumstances surrounding the curricular implementation also resulted in some negative sentiment. Additional faculty and resident education workshops were identified as areas for improvement as well as changes to assessment tools for increased clarity. Residents overall viewed the changes favorably, with traditional stream residents indicating that they also had a desire for increased feedback., Conclusions: Rapid Evaluation is an effective method for program assessment following curricular change in diagnostic radiology. A departmental champion driving enthusiasm for change from within may be valuable. Adequate resident and faculty education is key to maximize change and smooth the transition. Advances in knowledge: This study provides insights for other radiology training programs transitioning to a CBME framework and provides a structure for programmatic assessment., (Copyright © 2021 Elsevier B.V. All rights reserved.)

Purpose: All postgraduate residency programs in Canada are transitioning to a competency-based medical education (CBME) model divided into 4 stages of training. Queen's University has been the first Canadian institution to mandate transitioning to CBME across all residency programs, including Diagnostic Radiology. This study describes the implementation of CBME with a focus on the third developmental stage, Core of Discipline, in the Diagnostic Radiology residency program at Queen's University. We describe strategies applied and challenges encountered during the adoption and implementation process in order to inform the development of other CBME residency programs in Diagnostic Radiology., Methods: At Queen's University, the Core of Discipline stage was developed using the Royal College of Physicians and Surgeons of Canada's (RCPSC) competence continuum guidelines and the CanMEDS framework to create radiology-specific entrustable professional activities (EPAs) and milestones for assessment. New committees, administrative positions, and assessment strategies were created to develop these assessment guidelines. Currently, 2 cohorts of residents (n = 6) are enrolled in the Core of Discipline stage., Results: EPAs, milestones, and methods of evaluation for the Core of Discipline stage are described. Opportunities during implementation included tracking progress toward educational objectives and increased mentorship. Challenges included difficulty meeting procedural volume requirements, inconsistent procedural tracking, improving feedback mechanisms, and administrative burden., Conclusion: The transition to a competency-based curriculum in an academic Diagnostic Radiology residency program is significantly resource and time intensive. This report describes challenges faced in developing the Core of Discipline stage and potential solutions to facilitate this process.

Purpose: The Royal College of Physicians and Surgeons of Canada (RCPSC) has mandated the transition of postgraduate medical training in Canada to a competency-based medical education (CBME) model divided into 4 stages of training. As part of the Queen's University Fundamental Innovations in Residency Education proposal, Queen's University in Canada is the first institution to transition all of its residency programs simultaneously to this model, including Diagnostic Radiology. The objective of this report is to describe the Queen's Diagnostic Radiology Residency Program's implementation of a CBME curriculum., Methods: At Queen's University, the novel curriculum was developed using the RCPSC's competency continuum and the CanMEDS framework to create radiology-specific entrustable professional activities (EPAs) and milestones. In addition, new committees and assessment strategies were established. As of July 2015, 3 cohorts of residents (n = 9) have been enrolled in this new curriculum., Results: EPAs, milestones, and methods of evaluation for the Transition to Discipline and Foundations of Discipline stages, as well as the opportunities and challenges associated with the implementation of a competency-based curriculum in a Diagnostic Radiology Residency Program, are described. Challenges include the increased frequency of resident assessments, establishing stage-specific learner expectations, and the creation of volumetric guidelines for case reporting and procedures., Conclusions: Development of a novel CBME curriculum requires significant resources and dedicated administrative time within an academic Radiology department. This article highlights challenges and provides guidance for this process.

The post-graduate medical programs at Queen's University transitioned to a competency-based medical education framework on July 1, 2017. In advance of this transition, the Medical Oncology program participated in a pilot of six Entrustable Professional Activities (EPAs) focused workplace-based assessment (WBA) tools with faculty and residents. The purpose of this sequential explanatory mixed method study was to determine the extent to which these WBAs provided quality feedback for residents. The WBAs were introduced into daily clinical practice and, once completed, were collected by the research team. A resident focus group (n = 4) and faculty interviews (n = 5) were also conducted. Focus group and interview data were analyzed using an emergent thematic analysis. Data from the completed assessment tools were analyzed using both descriptive statistics and a literature-informed framework developed to assess the quality of feedback. Six main findings emerged: Verbal feedback is preferred over written; providing both written and verbal feedback is important; effective feedback was seen as timely, specific, and actionable; the process was conceptualized as coaching rather than high stakes; there were logistical concerns about the WBAs, and additional clarification about the WBA tools is needed. This study provides insight into faculty and resident perceptions of quality feedback and the potential for WBA tools to assist in providing effective feedback to residents as we shift to competency-based medical education in Canada. Our results suggest the need for additional faculty development around the use of the tools, and their intended role, and the elements of quality feedback.

Purpose: Radiation treatment planning (RTP) is a unique skill that requires interdisciplinary collaboration among radiation oncologists (ROs), dosimetrists, and medical physicists (MP) to train and assess residents. With the adoption of competency-based medical education (CBME) in Canada, it is essential residency program curricula focuses on developing competencies in RTP to facilitate entrustment. Our study investigates how radiation oncology team members' perspectives on RTP education align with requirements of the CBME approach, and its implications for improving residency training., Methods and Materials: This qualitative research study took place in the Department of Oncology at a midsize academic institution. Through convenience sampling, focus groups were conducted with radiation oncologists (n = 11), dosimetrists (n = 7), medical physicists (n = 7), and residents (n = 7). Thematic design was adopted to analyze the transcripts through open coding resulting in 3 overarching themes., Results: The results identified existing strengths and weaknesses of the residency program and future opportunities to redesign the curriculum and assessment process within a CBME model. Three overarching themes emerged from the analysis: (1) the strengths of RTP in the CBME environment; (2) challenges of RTP in CBME; and (3) opportunities for change. Stakeholders were optimistic CBME will help enrich resident learning with the increased frequency and quality of competency-based assessments. Participants suggested building a library of cases and developing computer-based learning resources to provide a safe environment to develop skills in contouring, dosimetry, and plan evaluation, in accordance with CBME training., Conclusions: This study identified future opportunities to redesign the RTP curriculum and assessment process within a CBME model. The need for innovative teaching and learning strategies, including case libraries, computer-based learning, and quality assessments, were highlighted in designing an innovative RTP planning curriculum., (Copyright © 2019 Elsevier Inc. All rights reserved.)

Objective: As competency-based medical education (CBME) rolls out across Canada, the assessment process is changing. Our purpose was to involve stakeholders in the selection and modification of workplace-based assessment (WBA) tools for use in an ophthalmology residency program., Design: This is a qualitative case study conducted in one ophthalmology department at a midsized teaching hospital in eastern Ontario., Participants: Ophthalmology faculty and residents within the Emergency Eye Clinic participated in the study., Methods: Phase 1 consisted of faculty piloting the tools and providing written feedback. Phase 2 consisted of 2 focus groups, 1 for residents (n = 9) and 1 for faculty (n = 6), to explore their experiences with the 4 piloted adapted WBA tools., Results: Residents and faculty discussed ongoing issues with buy-in and formalizing feedback through the new assessment process. Residents also reiterated the need for more constructive feedback delivered in a timely and sensitive manner. Generally, residents did not value numerical scales on the tools and preferred written comments. Both residents and faculty valued oral over written feedback given the interactive nature of oral feedback., Conclusions: This study provides insight into faculty and resident perspectives about WBA tools within one ophthalmology department. These results informed the development of WBA tools within the department and highlighted the importance of shifting the assessment culture to accommodate programmatic approaches to assessment in CBME. Involving key stakeholders in the change process has been a valuable strategy. Future research should examine whether or not these perspectives change after CBME implementation., (Copyright © 2019 Canadian Ophthalmological Society. Published by Elsevier Inc. All rights reserved.)

Objective: To examine the perspectives of family medicine preceptors and residents, including their interest and intent to participate in and their knowledge and willingness to teach or learn about medical assistance in dying (MAID)., Design: Two anonymous surveys were distributed via e-mail using a Dillman approach to residents and preceptors. Responses were collected between August 23 and November 29, 2016. Data were analyzed using descriptive and inferential statistics., Setting: The large, 4-site Queen's University family medicine residency program in southeastern Ontario., Participants: A total of 71 preceptors and 62 residents., Main Outcome Measures: Physician and resident knowledge of and experience, comfort, and confidence with MAID; willingness to participate in MAID; perspectives on the effect of MAID on team relationships; and the importance, desired content, and delivery of MAID education., Results: Overall, 45.2% of preceptors and 33.3% of residents responded. A low proportion of both preceptors and residents felt competent or comfortable discussing and exploring MAID with a patient, with preceptors feeling significantly more competent and comfortable than residents ( P < .001 and P < .01, respectively). Paradoxically, significantly more residents than preceptors were willing to be part of a clinical team providing MAID through oral or intravenous routes ( P < .001). In spite of this willingness to be involved, significantly fewer residents felt safe discussing personal perspectives on MAID in various clinical environments ( P < .001). Most participants from both groups believed it was important to include MAID in the core family medicine residency curriculum and identified specific curriculum content and delivery strategies., Conclusion: Family medicine preceptors and residents are willing and want to learn about MAID. Our research demonstrates a need to integrate MAID into the family medicine residency curriculum, with faculty development and continuing professional development for preceptors., (Copyright© the College of Family Physicians of Canada.)

Background: Formal and informal medical curricula convey expectations about professionalization, that is, the development of physician identity, and also about professionalism. This study examined whether, in general, junior residents experienced any dissonance between these roles and focused particularly on how they negotiated conflicts between compassion, self-care, duty and medical expertise., Methods: In 2015, purposive sampling was used to select 21 first-year residents at a Canadian medical school. Participants listened to a 5-min audio-recording narrated in either male or female voice. Facing compassion fatigue after three obstetrical disasters over less than 2 days the resident narrator asks to go home. Participants reacted in writing to questions about this request and relevant teaching/modelling. Responses were analyzed using a qualitative, exploratory, thematic research design., Results: Four themes were identified: i) empathy, self-doubt and fear of weakness, ii) the need for support from and communication with physicians and others, iii) education received, and iv) professionalization outranks professionalism. Participants agreed that under the circumstances the narrator's care, compassion and request were appropriate. Never the less, many grappled with feeling that asking to be relieved of work demonstrated weakness and a shirking of responsibility. Respondents had received no formal teaching about balancing compassion for patients or self with professional duty. Preceptors' informal teaching and modeling valorized scientific disengagement above all else. What emerged was participants' drive to become detached clinicians who set aside emotional responses and interactions that could impede and be incompatible with professionalization. However, participants also recognized and lamented what was lost in such a transformation., Conclusion: In the transition from student to practitioner, trainees' views and the modeling they receive shift emotion and compassion, whether for self or patients, from assets to liabilities as they aim to be invincible medical experts.