Search

Competency-based education has become central to the training and assessment of post-graduate medical trainees or residents . In competency-based education, there is a strong focus on outcomes and professional performance. Typically, holistic tasks are used to train, practice and assess the defined outcomes or competencies. In residency training, these tasks are part of the day-to-day clinical practice. The performance of residents in the workplace needs to be captured and stored. A portfolio has been used as an instrument for storage and collection of workplace-based assessment and feedback in various countries, like the Netherlands and the United States. The collection of information in a portfolio can serve or be used for a variety of purposes. These are: In post-graduate medical education, these purposes can be combined but this is not always reported transparently. In this paper, we will discuss the different perspectives, how a portfolio can serve these three purposes and what are opportunities and challenges of combining multiple purposes.

Introduction: Health professions education (HPE) has adopted the conceptualization of validity as an argument. However, the theoretical and practical aspects of how validity arguments should be developed, used and evaluated in HPE have not been deeply explored. Articulating the argumentation theory undergirding validity and validation can help HPE better operationalise validity as an argument. To better understand this, the authors explored how HPE validity scholars conceptualise assessment validity arguments and argumentation, seeking to understand potential consequences of these views on validation practices. Methods: The authors used critical case sampling to identify HPE assessment validity experts in three ways: (1) participation in a prominent validity research group, (2) appearing in a bibliometric study of HPE validity publications and (3) authorship of recent HPE validity literature. Qualitative semi‐structured interviews were conducted with 16 experts in HPE assessment validity from four different countries. The authors used reflexive thematic analysis to develop themes relevant to their research question. Results: The authors developed three themes grounded in participants' responses: (1) In theory, HPE validity is a social and situated argument. (2) In practice, the absence of audience and evaluation stymies the social nature of HPE validity. (3) Lack of validity argumentation creates and maintains power differentials within HPE. Participants articulated that current HPE validation practices are rooted in post‐positivist epistemology when they should be situated (i.e. context‐dependent), audience‐centric and inclusive. Discussion: When discussing validity argumentation in theory, participants' descriptions reflect an interpretivist lens for evaluation that is misaligned with real‐world validity practices. This misalignment likely arises from HPE's adoption of "validity as an argument" as a slogan, without integrating theoretical and practical principles of argumentation theory. How do HPE experts conceptualize the argumentation aspect of validity? @Midwest_MedPeds @ab_martini @LaraVarpio @erikdriessen @DrDanSchumacher explore the gap between theory and practice. [ABSTRACT FROM AUTHOR]

While portfolios are increasingly used to assess competence, the validity of such portfolio-based assessments has hitherto remained unconfirmed. The purpose of the present research is therefore to further our understanding of how assessors form judgments when interpreting the complex data included in a competency-based portfolio. Eighteen assessors appraised one of three competency-based mock portfolios while thinking aloud, before taking part in semi-structured interviews. A thematic analysis of the think-aloud protocols and interviews revealed that assessors reached judgments through a 3-phase cyclical cognitive process of acquiring, organizing, and integrating evidence. Upon conclusion of the first cycle, assessors reviewed the remaining portfolio evidence to look for confirming or disconfirming evidence. Assessors were inclined to stick to their initial judgments even when confronted with seemingly disconfirming evidence. Although assessors reached similar final (pass-fail) judgments of students' professional competence, they differed in their information-processing approaches and the reasoning behind their judgments. Differences sprung from assessors' divergent assessment beliefs, performance theories, and inferences about the student. Assessment beliefs refer to assessors' opinions about what kind of evidence gives the most valuable and trustworthy information about the student's competence, whereas assessors' performance theories concern their conceptualizations of what constitutes professional competence and competent performance. Even when using the same pieces of information, assessors furthermore differed with respect to inferences about the student as a person as well as a (future) professional. Our findings support the notion that assessors' reasoning in judgment and decision-making varies and is guided by their mental models of performance assessment, potentially impacting feedback and the credibility of decisions. Our findings also lend further credence to the assertion that portfolios should be judged by multiple assessors who should, moreover, thoroughly substantiate their judgments. Finally, it is suggested that portfolios be designed in such a way that they facilitate the selection of and navigation through the portfolio evidence.

During placements abroad, healthcare students are confronted with different personal and professional challenges, related to participation in practice. This study investigates when and how students respond to such challenges, and which coping and support mechanisms students use to overcome these. Twenty-five international students shared their experiences about physiotherapy placement in The Netherlands. Using a critical incident technique, we asked participants to recall events where participation was affected by an unforeseen situation, in or outside the clinic. Further, we explored students' strategies of seeking support within their social network to overcome individual challenges. Two researchers applied thematic analysis to the interview data, following an iterative approach. Team discussions supported focused direction of data collection and analysis, before conceptualizing results. Participants described a wide range of challenges. The scope and impact level of challenges varied widely, including intercultural differences, language barriers and inappropriate behaviour in the workplace, students' personal context and wellbeing. Mechanisms employed by students to overcome these challenges depended on the type of event (personal or professional), making purposeful use of their available network. Students involve clinical staff, peers, family and friends during placement abroad, to make deliberate use of their support network to overcome challenges in participation, whereas the academic network remains distant. Findings may help reflect on the roles and responsibilities of academic staff and other professionals involved with placements abroad. Healthcare programmes should ensure support before, during and after placement is within students' reach. [ABSTRACT FROM AUTHOR]

Crossborder curriculum partnerships, entailing the transposition of an entire curriculum and the related degree(s) from "home" to "host" institution, are a rather new phenomenon in internationalization in education. The literature describes successful and unsuccessful partnerships, but critical factors for the success or failure of sustainable partnerships remain to be identified. We conducted a narrative literature review to find such factors. Using an iterative approach, we analyzed 39 articles retrieved from Web of Science, Google Scholar, ERIC, PubMed, and PsycInfo and meeting the inclusion criteria. We developed a framework of 13 factors in four domains: students, teachers, curriculum, and soft and hard project management. Simply copy-pasting a curriculum is generally considered to be destined for failure. To overcome challenges, partners should take preventive and affirmative measures across multiple domains. The findings may provide guidance to those considering or engaged in designing, developing, managing, and reviewing a crossborder partnership.

Early curricular exposure to interprofessional education (IPE) is intended to acclimatize health professional trainees to shared-care in the practice settings they will ultimately join. However, IPE activities typically reside outside actual organizational and social systems in which interprofessional care is delivered. We aimed to explore how pharmacist trainees experience collaborator and communicator competency roles during team-based workplace-based learning. Participants maintained written diaries reflecting on interprofessional collaboration and communication during an eight-week hospital clerkship. Diary entries and transcripts from semi-structured follow-up interviews were analyzed from the social constructivist perspective using reflective thematic analysis. Participant accounts of on-ward activities represented most collaborator and communicator roles outlined in pharmacy and interprofessional competency frameworks, but were predominantly between the pharmacist trainee and physicians. Pharmacist trainees did not routinely engage with other health professions on a daily basis. Additionally, reported encounters with other team members were typically information exchanges and not episodes of authentic interdependent or shared care. Interactions were almost completely devoid of perceived interpersonal or role conflict. These findings offer insight into how pharmacist trainees perceive and develop competencies for team-based care. Further work is required to understand how such limited scope of interprofessional communication and collaboration might ultimately impair quality patient care. [ABSTRACT FROM AUTHOR]