Search

Clinical workplaces offer postgraduate trainees a wealth of opportunities to learn from experience. To promote deliberate and meaningful learning self-regulated learning skills are foundational. We explored trainees' learning activities related to patient encounters to better understand what aspects of self-regulated learning contribute to trainees' development, and to explore supervisor's role herein. We conducted a qualitative non-participant observational study in seven general practices. During two days we observed trainee's patient encounters, daily debriefing sessions and educational meetings between trainee and supervisor and interviewed them separately afterwards. Data collection and analysis were iterative and inspired by a phenomenological approach. To organise data we used networks, time-ordered matrices and codebooks. Self-regulated learning supported trainees to increasingly perform independently. They engaged in self-regulated learning before, during and after encounters. Trainees' activities depended on the type of medical problem presented and on patient, trainee and supervisor characteristics. Trainees used their sense of confidence to decide if they could manage the encounter alone or if they should consult their supervisor. They deliberately used feedback on their performance and engaged in reflection. Supervisors appeared vital in trainees' learning by reassuring trainees, discussing experience, knowledge and professional issues, identifying possible unawareness of incompetence, assessing performance and securing patient safety. Self-confidence, reflection and feedback, and support from the supervisor are important aspects of self-regulated learning in practice. The results reflect how self-regulated learning and self-entrustment promote trainees' increased participation in the workplace. Securing organized moments of interaction with supervisors is beneficial to trainees' self-regulated learning.

Traditionally, an anatomy practical examination is conducted using a free response format (FRF). However, this format is resource-intensive, as it requires a relatively large time investment from anatomy course faculty in preparation and grading. Thus, several interventions have been reported where the response format was changed to a selected response format (SRF). However, validity evidence from those interventions has not proved entirely adequate for the practical anatomy examination, and thus, further investigation was required. In this study, the validity evidence of SRF was examined using multiple choice questions (MCQs) constructed according to different levels of Bloom's taxonomy in comparison with the traditional free response format. A group of 100 medical students registered in a gross anatomy course volunteered to be enrolled in this study. The experimental MCQ examinations were part of graded midterm and final steeplechase practical examination. Volunteer students were instructed to complete the practical examinations twice, once in each of two separate examination rooms. The two separate examinations consisted of a traditional free response format and MCQ format. Scores from the two examinations (FRF and MCQ) displayed a strong correlation, even with higher level Bloom's taxonomy questions. In conclusion, the results of this study provide empirical evidence that the SRF (MCQ) response format is a valid method and can be used as an alternative to the traditional FRF steeplechase examination. (Contains 4 tables.)

Purpose: This study aims to investigate quality of feedback as offered by supervisor-assessors with varying levels of assessor expertise following assessment of performance in residency training in a health care setting. It furthermore investigates if and how different levels of assessor expertise influence feedback characteristics. Design/methodology/approach: Experienced (n = 18) and non-experienced (n = 16) supervisor-assessors with different levels of assessor expertise in general practice (GP) watched two videotapes, each presenting a trainee in a "real-life" patient encounter. After watching each videotape, participants documented performance ratings, wrote down narrative feedback comments and verbalized their feedback. Deductive content analysis of feedback protocols was used to explore quality of feedback. Between-group differences were assessed using qualitative-based quantitative analysis of feedback data. Findings: Overall, specificity and usefulness of both written and verbal feedback was limited. Differences in assessor expertise did not seem to affect feedback quality. Research limitations/implications: Results of the study are limited to a specific setting (GP) and assessment context. Further study in other settings and larger sample sizes may contribute to better understanding of the relation between assessor characteristics and feedback quality. Practical implications: Findings suggest that even with supervisor-assessors with varying levels of assessor expertise who are trained in performance assessment and the provision of performance feedback, high-quality feedback is not self-evident; coaching "on the job" of feedback providers and continuous evaluation of feedback processes in performance management systems is crucial. Instruments should facilitate provision of meaningful feedback in writing. Originality/value: The paper investigates quality of feedback immediately following assessment of performance, and links feedback quality to assessor expertise. Findings can contribute to improvement of performance management systems and assessments for developmental purposes. (Contains 2 tables and 2 figures.)

Little is known about the influence of language background in problem-based learning (PBL) tutorial groups on group processes and students' academic achievement. This study investigated the relationship between language background, secondary school score, tutorial group processes, and students' academic achievement in PBL. A validated tutorial group effectiveness questionnaire was administered to undergraduate medical students in a PBL curriculum at the Nelson R. Mandela School of Medicine (NRMSM) in South Africa. Although 58 percent of the students did not speak English as their first language, the tutorials were in English. Furthermore, secondary school scores differed strongly due to inadequate resources between secondary schools. A path analysis was conducted to test a causal model in which the two independent variables were English as the First Language (EFL) and secondary school scores. These variables were assumed to influence the process variables (cognitive, motivational, and demotivational group processes). Input and process variables were assumed to influence the two output variables, being overall group productivity and students' academic achievement. All data were analyzed at the individual student level (N = 387). A very good model fit was found (CMIN/DF = 0.68, GFI = 1.00, TLI = 1.02, CFI = 1.00, RMSEA = 0.00). EFL and secondary school scores positively affected students' academic achievement (respectively beta = 0.24 and beta = 0.16). EFL negatively affected motivational group processes (beta = -0.22). Cognitive group processes positively influenced overall group productivity (beta = 0.31) and so did motivational group processes (beta = 0.27). Demotivational group processes negatively predicted academic achievement and overall group productivity (beta = -0.15, and beta = -0.25). The model resulted in an R-square of 0.15 and 0.45 for academic achievement and overall group productivity, respectively. EFL and secondary school scores had a positive effect on academic achievement. Cognitive and motivational group processes had a positive effect on overall group productivity, while EFL negatively impacted motivational group processes. We recommend English language development courses to be formally included into curricula to enhance student learning.

Collaborative approaches such as Problem Based Learning (PBL) may provide the opportunity to bring together diverse students but their efficacy in practice and the complications that arise due to the mixed ethnicity needs further investigation. This study explores the key advantages and problems of heterogeneous PBL groups from the students' and teachers' opinions. Focus groups were conducted with a stratified sample of second year medical students and their PBL teachers. We found that students working in heterogeneous groupings interact with students with whom they don't normally interact with, learn a lot more from each other because of their differences in language and academic preparedness and become better prepared for their future professions in multicultural societies. On the other hand we found students segregating in the tutorials along racial lines and that status factors disempowered students and subsequently their productivity. Among the challenges was also that academic and language diversity hindered student learning. In light of these the recommendations were that teachers need special diversity training to deal with heterogeneous groups and the tensions that arise. Attention should be given to create "the right mix" for group learning in diverse student populations. The findings demonstrate that collaborative heterogeneous learning has two sides that need to be balanced. On the positive end we have the "ideology" behind mixing diverse students and on the negative the "practice" behind mixing students. More research is needed to explore these variations and their efficacy in more detail. (Contains 1 table.)

Introduction: Many of the residents who supervise medical students in clinical practice are unfamiliar with the principles of effective supervision. Training in teaching skills is therefore seen as an effective strategy to improve the quality of clinical supervision. Method: Twenty seven medical residents were matched and assigned to an experimental group (n = 14) and a control group (n = 13). The experimental group participated in a two-day workshop on teaching skills. Using standardized questionnaires, the teaching abilities of all participants were assessed anonymously by medical students, before and after the workshop, to determine for any effect of the intervention. Results: A significant improvement in the teaching abilities of the medical residents in the experimental group was observed following the workshop (t = -2.68, p = 0.02). The effect size within the experimental group was large (d = 1.17), indicating that the workshop led to a measurable positive change in the medical residents' teaching abilities. The effect size estimated from the post intervention scores on teaching ability of the two groups showed a moderate improvement (d = 0.57) in the experimental group compared with the control group. Discussion: Medical students rated the teaching abilities of the workshop participants after the training more highly than those of the residents in the control group. The ability to adjust teaching to the needs of the students and teach effective communication and diagnostic clinical skills were among the features that characterized effective teaching. Properly designed, teacher-training workshops could be effective and feasible methods to improve the quality of teaching by medical residents.

Investigates the predictive value of written longitudinal tests (progress tests), block-related written tests, and OSCEs in relation to peer-rated competence of medical students. (Author/SOE)

Developed a method to estimate the cutscore precisions for empirical standard-setting methods by using resampling. Illustrated the method with two actual datasets consisting of 86 Dutch medical residents and 155 Canadian medical students taking objective structured clinical examinations. Results show the applicability of the method. (SLD)

In a problem-based curriculum, students generate learning issues that are the guidelines for individual study. This study investigates the essential characteristics of learning issues and the importance they have in each year of training. Findings indicate that a useful learning issue contains a keyword that demarcates the content of a topic to be studied and is formulated concisely and is unambiguous. (Author/PVD)

Purpose: According to the principles of programmatic assessment, a valid high-stakes assessment of the students' performance should amongst others, be based on a multiple data points, supposedly leading to saturation of information. Saturation of information is generated when a data point does not add important information to the assessor. In establishing saturation of information, institutions often set minimum requirements for the number of assessment data points to be included in the portfolio. Methods: In this study, we aimed to provide validity evidence for saturation of information by investigating the relationship between the number of data points exceeding the minimum requirements in a portfolio and the consensus between two independent assessors. Data were analyzed using a multiple logistic regression model. Results: The results showed no relation between the number of data points and the consensus. This suggests that either the consensus is predicted by other factors only, or, more likely, that assessors already reached saturation of information. This study took the first step in investigating saturation of information, further research is necessary to gain in-depth insights of this matter in relation to the complex process of decision-making. [ABSTRACT FROM AUTHOR]

Programmatic assessment is both a philosophy and a method for assessment. It has been developed in medical education as a response to the limitation of the dominant testing or measurement approaches and to better align with changes in how medical competence was conceptualised. It is based on continual collection of assessment and feedback information which is collected in a portfolio and periodically discussed with a mentor or coach. Students produce reflections in which they analyse the assessment information triangulated across methods to meaningfully- rather than purely numericallyanalyse their strengths and weakness in the different competency domains. Decisions about students' progress are made proportionally, in that low-stakes decisions are made when only limited assessment information is available but high-stakes decisions will and can be made on rich information. Quality of the process and credibility of the outcomes is determined by a combination of psychometric methods, qualitative rigour, and through organisational due processes. The method is still young, preliminary results are promising but more empirical justification research is needed. [ABSTRACT FROM AUTHOR]

Context: Single‐best‐answer questions (SBAQs) have been widely used to test knowledge because they are easy to mark and demonstrate high reliability. However, SBAQs have been criticised for being subject to cueing. Objectives: We used a novel assessment tool that facilitates efficient marking of open‐ended very‐short‐answer questions (VSAQs). We compared VSAQs with SBAQs with regard to reliability, discrimination and student performance, and evaluated the acceptability of VSAQs. Methods: Medical students were randomised to sit a 60‐question assessment administered in either VSAQ and then SBAQ format (Group 1, n = 155) or the reverse (Group 2, n = 144). The VSAQs were delivered on a tablet; responses were computer‐marked and subsequently reviewed by two examiners. The standard error of measurement (SEM) across the ability spectrum was estimated using item response theory. Results: The review of machine‐marked questions took an average of 1 minute, 36 seconds per question for all students. The VSAQs had high reliability (alpha: 0.91), a significantly lower SEM than the SBAQs (p < 0.001) and higher mean item–total point biserial correlations (p < 0.001). The VSAQ scores were significantly lower than the SBAQ scores (p < 0.001). The difference in scores between VSAQs and SBAQs was attenuated in Group 2. Although 80.4% of students found the VSAQs more difficult, 69.2% found them more authentic. Conclusions: The VSAQ format demonstrated high reliability and discrimination and items were perceived as more authentic. The SBAQ format was associated with significant cueing. The present results suggest the VSAQ format has a higher degree of validity. [ABSTRACT FROM AUTHOR]

Background: In postgraduate training, there is a need to continuously assess the learning and working conditions to optimize learning. Students or trainees respond to the learning climate as they perceive it. The Dutch Residency Educational Climate Test (D-RECT) is a learning climate measurement tool with well-substantiated validity. However, it was originally designed for Dutch postgraduate trainees and it remains to be shown whether extrapolation to non-Western settings is viable. The dual objective of this study was to revalidate D-RECT outside of a Western setting and to evaluate the factor structure of a recently revised version of the D-RECT containing 35 items. Methods: We invited Filipino internal medicine residents from 96 hospitals to complete the revised 35-item D-RECT. Subsequently, we performed a confirmatory factor analysis to check the fit of the 9 scale model of the revised 35-item D-RECT. Inter-rater reliability was assessed using generalizability theory. Results: Confirmatory factor analysis unveiled that the factor structure of the revised 35-item D-RECT provided a reasonable fit to the Filipino data, after removal of 7 items. Five to seven evaluations of individual residents were needed per scale to obtain a reliable result. Conclusion: Even in a non-Western setting, the D-RECT exhibited psychometric validity. This study validated the factor structure of the revised 35-item D-RECT after some modifications. We recommend that its application be extended to other Asian countries and specialties. [ABSTRACT FROM AUTHOR]

Where do we stand now? In the 30 years that have passed since The Edinburgh Declaration on Medical Education, we have made tremendous progress in research on fostering 'self-directed and independent study' as propagated in this declaration, of which one prime example is research carried out on problem-based learning. However, a large portion of medical education happens outside of classrooms, in authentic clinical contexts. Therefore, this article discusses recent developments in research regarding fostering active learning in clinical contexts. Self-regulated, lifelong learning in medical education Clinical contexts are much more complex and flexible than classrooms, and therefore require a modified approach when fostering active learning. Recent efforts have been increasingly focused on understanding the more complex subject of supporting active learning in clinical contexts. One way of doing this is by using theory regarding self-regulated learning ( SRL), as well as situated learning, workplace affordances, self-determination theory and achievement goal theory. Combining these different perspectives provides a holistic view of active learning in clinical contexts. Entry to practice, vocational training and continuing professional development Research on SRL in clinical contexts has mostly focused on the undergraduate setting, showing that active learning in clinical contexts requires not only proficiency in metacognition and SRL, but also in reactive, opportunistic learning. These studies have also made us aware of the large influence one's social environment has on SRL, the importance of professional relationships for learners, and the role of identity development in learning in clinical contexts. Additionally, research regarding postgraduate lifelong learning also highlights the importance of learners interacting about learning in clinical contexts, as well as the difficulties that clinical contexts may pose for lifelong learning. However, stimulating self-regulated learning in undergraduate medical education may also make postgraduate lifelong learning easier for learners in clinical contexts. [ABSTRACT FROM AUTHOR]

Workplace-Based Assessment (WBA) plays a pivotal role in present-day competency-based medical curricula. Validity in WBA mainly depends on how stakeholders (e.g. clinical supervisors and learners) use the assessments-rather than on the intrinsic qualities of instruments and methods. Current research on assessment in clinical contexts seems to imply that variable behaviours during performance assessment of both assessors and learners may well reflect their respective beliefs and perspectives towards WBA. We therefore performed a Q methodological study to explore perspectives underlying stakeholders' behaviours in WBA in a postgraduate medical training program. Five different perspectives on performance assessment were extracted: Agency, Mutuality, Objectivity, Adaptivity and Accountability. These perspectives reflect both differences and similarities in stakeholder perceptions and preferences regarding the utility of WBA. In comparing and contrasting the various perspectives, we identified two key areas of disagreement, specifically 'the locus of regulation of learning' (i.e., self-regulated versus externally regulated learning) and 'the extent to which assessment should be standardised' (i.e., tailored versus standardised assessment). Differing perspectives may variously affect stakeholders' acceptance, use-and, consequently, the effectiveness-of assessment programmes. Continuous interaction between all stakeholders is essential to monitor, adapt and improve assessment practices and to stimulate the development of a shared mental model. Better understanding of underlying stakeholder perspectives could be an important step in bridging the gap between psychometric and socio-constructivist approaches in WBA. [ABSTRACT FROM AUTHOR]

In medical education, students are increasingly regarded as active seekers of feedback rather than passive recipients. Previous research showed that in the intentions of students to seek feedback, a learning and performance goal can be distinguished. In this study, we investigated the intentions (defined as level and orientation of motivation) of different performing students (low, average, and high performing students) to seek feedback in the clinical workplace using Self-Determination Theory. We conducted a quantitative study with students in their clinical clerkships and grouped them based on their performance. The level of motivation was measured by the number of Mini-CEXs each student collected. The orientation of motivation was measured by conducting the Academic Self-Regulation Questionnaire. We found that high performing students were more motivated and demonstrated higher self-determination compared to low performing students. [ABSTRACT FROM AUTHOR]

Background:It remains unclear which item format would best suit the assessment of clinical reasoning: context-rich single best answer questions (crSBAs) or key-feature problems (KFPs). This study compared KFPs and crSBAs with respect to students’ acceptance, their educational impact, and psychometric characteristics when used in a summative end-of-clinical-clerkship pediatric exam. Methods:Fifth-year medical students (n = 377) took a computer-based exam that included 6–9 KFPs and 9–20 crSBAs which assessed their clinical reasoning skills, in addition to an objective structured clinical exam (OSCE) that assessed their clinical skills. Each KFP consisted of a case vignette and three key features using a “long-menu” question format. We explored students’ perceptions of the KFPs and crSBAs in eight focus groups and analyzed statistical data of 11 exams. Results:Compared to crSBAs, KFPs were perceived as more realistic and difficult, providing a greater stimulus for the intense study of clinical reasoning, and were generally well accepted. The statistical analysis revealed no difference in difficulty, but KFPs resulted more reliable and efficient than crSBAs. The correlation between the two formats was high, while KFPs correlated more closely with the OSCE score. Conclusions:KFPs with long-menu exams seem to bring about a positive educational effect without psychometric drawbacks. [ABSTRACT FROM PUBLISHER]

Background: Despite growing evidence of the benefits of including assessment for learning strategies within programmes of assessment, practical implementation of these approaches is often problematical. Organisational culture change is often hindered by personal and collective beliefs which encourage adherence to the existing organisational paradigm. We aimed to explore how these beliefs influenced proposals to redesign a summative assessment culture in order to improve students' use of assessment-related feedback. Methods: Using the principles of participatory design, a mixed group comprising medical students, clinical teachers and senior faculty members was challenged to develop radical solutions to improve the use of post-assessment feedback. Follow-up interviews were conducted with individual members of the group to explore their personal beliefs about the proposed redesign. Data were analysed using a socio-cultural lens. Results: Proposed changes were dominated by a shared belief in the primacy of the summative assessment paradigm, which prevented radical redesign solutions from being accepted by group members. Participants' prior assessment experiences strongly influenced proposals for change. As participants had largely only experienced a summative assessment culture, they found it difficult to conceptualise radical change in the assessment culture. Although all group members participated, students were less successful at persuading the group to adopt their ideas. Faculty members and clinical teachers often used indirect techniques to close down discussions. The strength of individual beliefs became more apparent in the follow-up interviews. Conclusions: Naïve epistemologies and prior personal experiences were influential in the assessment redesign but were usually not expressed explicitly in a group setting, perhaps because of cultural conventions of politeness. In order to successfully implement a change in assessment culture, firmly-held intuitive beliefs about summative assessment will need to be clearly understood as a first step. [ABSTRACT FROM AUTHOR]

Students feel insufficiently supported in clinical environments to engage in active learning and achieve a high level of self-regulation. As a result clinical learning is highly demanding for students. Because of large differences between students, supervisors may not know how to support them in their learning process. We explored patterns in undergraduate students' self-regulated learning behavior in the clinical environment, to improve tailored supervision, using Q-methodology. Q-methodology uses features of both qualitative and quantitative methods for the systematic investigation of subjective issues by having participants sort statements along a continuum to represent their opinion. We enrolled 74 students between December 2014 and April 2015 and had them characterize their learning behavior by sorting 52 statements about self-regulated learning behavior and explaining their response. The statements used for the sorting were extracted from a previous study. The data was analyzed using by-person factor analysis to identify clusters of individuals with similar sorts of the statements. The resulting factors and qualitative data were used to interpret and describe the patterns that emerged. Five resulting patterns were identified in students' self-regulated learning behavior in the clinical environment, which we labelled: Engaged, Critically opportunistic, Uncertain, Restrained and Effortful. The five patterns varied mostly regarding goals, metacognition, communication, effort, and dependence on external regulation for learning. These discrete patterns in students' self-regulated learning behavior in the clinical environment are part of a complex interaction between student and learning context. The results suggest that developing self-regulated learning behavior might best be supported regarding individual students' needs. [ABSTRACT FROM AUTHOR]

Background: Medical education in Sub-Saharan Africa is in need of reform to promote the number and quality of physicians trained. Curriculum change and innovation in this region, however, face a challenging context that may affect curriculum outcomes. Research on outcomes of curriculum innovation in Sub-Saharan Africa is scarce. We investigated curriculum outcomes in a Sub-Saharan African context by comparing students' perceived preparedness for practice within three curricula in Mozambique: a conventional curriculum and two innovative curricula. Both innovative curricula used problem-based learning and community-based education. Methods: We conducted a comparative mixed methods study. We adapted a validated questionnaire on perceived professional competencies and administered it to 5th year students of the three curricula (n = 140). We conducted semi-structured interviews with 5th year students from these curricula (n = 12). Additional contextual information was collected. Statistical and thematic analyses were conducted. Results: Perceived preparedness for practice of students from the conventional curriculum was significantly lower than for students from one innovative curriculum, but significantly higher than for students from the other innovative curriculum. Major human and material resource issues and disorganization impeded the latter's sense of preparedness. Both innovative curricula, however, stimulated a more holistic approach among students toward patients, as well an inquiring and independent attitude, which is valuable preparation for Sub-Saharan African healthcare. Discussion: In Sub-Saharan Africa, risks and benefits of curriculum innovation are high. Positive outcomes add value to local healthcare in terms of doctors' meaningful preparedness for practice, but instead outcomes can be negative due to the implementation challenges sometimes found in Sub-Saharan African contexts. Before embarking on innovative curriculum reform, medical schools need to assess their capability and motivation for innovation. [ABSTRACT FROM AUTHOR]

Objective: The fitness to practise of international medical graduates (IMGs) is usually evaluated with standardised assessment tests. Practising doctors should, however, be assessed on their performance rather than their competency, for which reason workplace-based assessment (WBA) has gained increasing attention. Our aim was to assess the composite reliability of WBA instruments for assessing the performance of IMGs.Design and Setting: Between June 2010 and April 2015, 142 IMGs were assessed by 99 calibrated assessors; each cohort was assessed at their workplace over 6 months. The IMGs completed 970 case-based discussions (CBDs), 1741 Mini-Clinical Examination Exercises (mini-CEX) and 1020 multisource feedback (MSF) sessions.Participants: 103 male and 39 female candidates based in urban and rural hospitals of the Hunter New England Health region, from 28 countries (Africa, Asia, Europe, South America, South Pacific).Main Outcome Measures: The reliability of the three WBA tools; the composite reliability of the tools as a group.Results: The composite reliability of our WBA toolbox program was good: the composite reliability coefficient for five CBDs and 12 mini-CEX was 0.895 (standard error of measurement, 0.138). When the six MSF results were included, the composite reliability coefficient was 0.899 (standard error of measurement, 0.125).Conclusions: WBA is a reliable method for assessing IMGs when multiple tools and assessors are used over a period of time. This form of assessment meets the criteria for "good assessment" (reliability ≥ 0.8) and can be applied in other settings. [ABSTRACT FROM AUTHOR]

Background: Evidence tailored to sub-Saharan Africa on outcomes of innovations in medical education is needed to encourage and advance their implementation in this region. Aim: To investigate preparedness for practice of students and graduates from an innovative and a conventional medical curriculum in a sub-Saharan African context. Methods: Using mixed methods we compared junior doctors and fifth-year students from two Mozambican medical schools: one with an innovative problem- and community-based curriculum and one with a conventional lecture- and discipline-based curriculum. A questionnaire on professional competencies was administered, semi-structured interviews were conducted, and work diaries were collected. The findings were integrated in a conceptual model. Results: Six areas of tension between global health care ideals and local health care practice emerged from the data that challenged doctors' motivation and preparedness for practice. Four elements of the innovative curriculum equipped students and graduates with skills, attitudes and competencies to better cope with these tensions. Students and graduates from the innovative curriculum rated significantly higher levels on various competencies and expressed more satisfaction with the curriculum and its usefulness for their work. Conclusion: An innovative problem- and community-based curriculum can improve sub-Saharan African doctors' motivation and preparedness to tackle the challenges of health care practice in this region. [ABSTRACT FROM AUTHOR]

Background: Consistent identification and prevention of failure for at-risk medical students is challenging, failing courses is costly to all stakeholders, and there is need for further research into duration, timing and structure of interventions to help students in difficulty. Aims: To verify the value of a new exam two weeks into medical school as a predictor of failure, and explore the requirements for a preventative intervention. Methods: Students who failed the two-week exam were invited to a series of large-group workshops and small-group follow-up meetings. Participants' subsequent exam performance was compared with non-participants. Results: About 71% of students who performed poorly in the new exam subsequently failed a course. Attendance at the workshops made no difference to short- or long-term pass rates. Attendance at more than three follow-up small group sessions significantly improved pass rates two semesters later, and was influenced by teacher experience. Conclusions: Close similarity between predictor task and target task is important for accurate prediction of failure. Consideration should be given to dose effect and class size in the prevention of failure of at-risk students, and we recommend a systemic approach to intervention/remediation programmes, involving a whole semester of mandatory, weekly small group meetings with experienced teachers. [ABSTRACT FROM AUTHOR]

Background To get insight in how theoretical knowledge is transformed into clinical skills, important information may arise from mapping the development of anatomical knowledge during the undergraduate medical curriculum. If we want to gain a better understanding of teaching and learning in anatomy, it may be pertinent to move beyond the question of how and consider also the what, why and when of anatomy education. Methods A purposive sample of 78 medical students from the 2nd, 3rd, 4th and 6th year of a PBL curriculum participated in 4 focus groups. Each group came together twice, and all meetings were recorded and transcribed verbatim. Data were analysed with template analysis using a phenomenographical approach. Results Five major topics emerged and are described covering the students' perceptions on their anatomy education and anatomical knowledge: 1) motivation to study anatomy, 2) the relevance of anatomical knowledge, 3) assessment of anatomical knowledge, 4) students' (in)security about their anatomical knowledge and 5) the use of anatomical knowledge in clinical practice. Conclusions Results indicated that a PBL approach in itself was not enough to ensure adequate learning of anatomy, and support the hypothesis that educational principles like time-on-task and repetition, have a stronger impact on students' perceived and actual anatomical knowledge than the educational approach underpinning a curriculum. For example, students state that repetitive studying of the subject increases retention of knowledge to a greater extent than stricter assessment, and teaching in context enhances motivation and transfer. Innovations in teaching, like spiral curriculum, teaching in context and teaching for transfer, and assessment, like assessment for learning: rewarding understanding and higher order cognitive skills, are required to improve anatomy education. [ABSTRACT FROM AUTHOR]

Background: Previous work has shown that a programme that draws on a blend of theories makes a positive difference to outcomes for students who fail and repeat their first semester at medical school. Exploration of student and teacher perspectives revealed that remediation of struggling medical students can be achieved through a cognitive apprenticeship within a small community of inquiry. This community needs expert teachers capable of performing a unique combination of roles (facilitator, nurturing mentor, disciplinarian, diagnostician and role model), with high levels of teaching presence and practical wisdom. Yet, despite participants' convergent opinions on the elements of effective remediation, significant differences were found between outcomes of students working with experienced and inexperienced teachers. The current study explores the actual practice of teachers on this remediation course, aiming to exemplify elements of our theory of remediation and explore differences between teachers. Methods: Since it is in the classroom context that the interactions that constitute the complex process of remediation emerge, this practice-based research has focused on direct observation of classroom teaching. Nineteen hours of small group sessions were recorded and transcribed. Drawing on ethnography and sociocultural discourse analysis, selected samples of talk-in-context demonstrate how the various elements of remediation play out in practice, highlighting aspects that are most effective, and identifying differences between experienced and novice teachers. Results: Long-term student outcomes are strongly correlated to teacher experience (r, 0.81). Compared to inexperienced teachers, experienced teachers provide more challenging, disruptive facilitation, and take a dialogic stance that encourages more collaborative group dynamics. They are more expert at diagnosing cognitive errors, provide frequent metacognitive time-outs and make explicit links across the curriculum. Conclusions: Remediation is effective in small groups where dialogue is used for collaborative knowledge construction and social regulation. This requires facilitation by experienced teachers who attend to details of both content and process, and use timely interventions to foster curiosity and the will to learn. These teachers should actively challenge students' language use, logical inconsistencies and uncertainties, problematize their assumptions, and provide a metacognitive regulatory voice that can generate attitudinal shifts and nurture the development of independent critical thinkers. [ABSTRACT FROM AUTHOR]

Context There is little research into how to deliver summative assessment student feedback effectively. The main aims of this study were to clarify how students engage with feedback in this context and to explore the roles of learning-related characteristics and previous and current performance. Methods A website was developed to deliver feedback about the objective structural clinical examination ( OSCE) in various formats: station by station or on skills across stations. In total, 138 students (in the third year out of five) completed a questionnaire about goal orientation, motivation, self-efficacy, control of learning beliefs and attitudes to feedback. Individual website usage was analysed over an 8-week period. Latent class analyses were used to identify profiles of students, based on their use of different aspects of the feedback website. Differences in learning-related student characteristics between profiles were assessed using analyses of variance ( anovas). Individual website usage was related to OSCE performance. Results In total, 132 students (95.7%) viewed the website. The number of pages viewed ranged from two to 377 (median 102). Fifty per cent of students engaged comprehensively with the feedback, 27% used it in a minimal manner, whereas a further 23% used it in a more selective way. Students who were comprehensive users of the website scored higher on the value of feedback scale, whereas students who were minimal users scored higher on extrinsic motivation. Higher performing students viewed significantly more web pages showing comparisons with peers than weaker students did. Students who just passed the assessment made least use of the feedback. Conclusions Higher performing students appeared to use the feedback more for positive affirmation than for diagnostic information. Those arguably most in need engaged least. We need to construct feedback after summative assessment in a way that will more effectively engage those students who need the most help. [ABSTRACT FROM AUTHOR]

Context Why and how do students seek feedback on their performance in the clinical workplace and which factors influence this? These questions have remained largely unanswered in research into workplace learning during clinical clerkships. Research on feedback has focused mainly on feedback providers. Whether and how feedback recipients actively seek feedback are under-examined issues. Research in organisational psychology has proposed a mechanism whereby feedback seeking is influenced by motives and goal orientation mediated by the perceived costs and benefits of feedback. Building on a recently published model of resident doctors' feedback-seeking behaviour, we conducted a qualitative study to explore students' feedback-seeking behaviours in the clinical workplace. Methods Between April and June 2011, we conducted semi-structured face-to-face interviews with veterinary medicine students in Years 5 and 6 about their feedback-seeking behaviour during clinical clerkships. In the interviews, 14 students were asked about their goals and motives for seeking feedback, the characteristics of their feedback-seeking behaviour and factors influencing that behaviour. Using template analysis, we coded the interview transcripts and iteratively reduced and displayed the data until agreement on the final template was reached. Results The students described personal and interpersonal factors to explain their reasons for seeking feedback. The factors related to intentions and the characteristics of the feedback provider, and the relationship between the feedback seeker and provider. Motives relating to image and ego, particularly when students thought that feedback might have a positive effect on image and ego, influenced feedback-seeking behaviour and could induce specific behaviours related to students' orientation towards particular sources of feedback, their orientation towards particular topics for and timing of feedback, and the frequency and method of feedback-seeking behaviour. Conclusions This study shows that during clinical clerkships, students actively seek feedback according to personal and interpersonal factors. Perceived costs and benefits influenced this active feedback-seeking behaviour. These results may contribute towards the optimising and developing of meaningful educational opportunities during clerkships. [ABSTRACT FROM AUTHOR]

Medical Education 2012: 46: 738-747 Context Medical schools worldwide are increasingly switching to student-centred methods such as problem-based learning (PBL) to foster lifelong self-directed learning (SDL). The cross-cultural applicability of these methods has been questioned because of their Western origins and because education contexts and learning approaches differ across cultures. Objectives This study evaluated PBL's cross-cultural applicability by investigating how it is applied in three medical schools in regions with different cultures in, respectively, East Asia, the Middle East and Western Europe. Specifically, it investigated how students' cultural backgrounds impact on SDL in PBL and how this impact affects students. Methods A qualitative, cross-cultural, comparative case study was conducted in three medical schools. Data were collected through 88 semi-structured, in-depth interviews with Year 1 and 3 students, tutors and key persons involved in PBL, 32 observations of Year 1 and 3 PBL tutorials, document analysis, and contextual information. The data were thematically analysed using the template analysis method. Comparisons were made among the three medical schools and between Year 1 and 3 students across and within the schools. Results The cultural factors of uncertainty and tradition posed a challenge to Middle Eastern students' SDL. Hierarchy posed a challenge to Asian students and achievement impacted on both sets of non-Western students. These factors were less applicable to European students, although the latter did experience some challenges. Several contextual factors inhibited or enhanced SDL across the cases. As students grew used to PBL, SDL skills increased across the cases, albeit to different degrees. Conclusions Although cultural factors can pose a challenge to the application of PBL in non-Western settings, it appears that PBL can be applied in different cultural contexts. However, its globalisation does not postulate uniform processes and outcomes, and culturally sensitive alternatives might be developed. [ABSTRACT FROM AUTHOR]

Background: Self-assessment is recognized as a necessary skill for lifelong learning. It is widely reported to offer numerous advantages to the learner. The research evaluated the impact of students' and supervisors' self-assessment and feedback training on students' perceptions and practices of self-assessment. Moreover, it evaluated the effect of self-assessment process on students' study strategies within a community of clinical practice. Methods: We conducted a qualitative phenomenological study from May 2008 to December 2009.We held 37 semi-structured individual interviews with three different cohorts of undergraduate medical students until we reached data saturation. The cohorts were exposed to different contexts while experiencing their clinical years' assessment program. In the interviews, students' perceptions and interpretations of 'self-assessment practice' and 'supervisor-provided feedback' within different contexts and the resulting study strategies were explored. Results: The analysis of interview data with the three cohorts of students yielded three major themes: strategic practice of self-assessment, self-assessment and study strategies, and feedback and study strategies. It appears that self-assessment is not appropriate within a summative context, and its implementation requires cultural preparation. Despite education and orientation on the two major components of the self-assessment process, feedback was more effective in enhancing deeper study strategies. Conclusion: This research suggests that the theoretical advantages linked to the self-assessment process are a result of its feedback component rather than the practice of self-assessment isolated from feedback. Further research exploring the effects of different contextual and personal factors on students' self-assessment is needed. [ABSTRACT FROM AUTHOR]

OBJECTIVES This study aimed to investigate the relationship between the authenticity of instructional formats and outcome measures within a pre-clerkship clinical reasoning course. METHODS We conducted a randomised, prospective, crossover study with Year 2 medical students taking a pre-clerkship clinical reasoning course. Students were randomised to small groups and exposed to three formats of differing instructional authenticity (paper case, DVD presentation, standardised patient [SP] presentation) across three subject areas (abdominal pain, anaemia, polyuria). Three student cohorts were taught using one instructional format per subject area so that each cohort received a different instructional format for each of the three subject areas. Outcome measures (objective structured clinical examination, video quiz, written examination) were selected to determine the effect of each instructional format on the clinical reasoning of students. RESULTS Increasingly authentic instructional formats did not significantly improve clinical reasoning performance across all outcome measures and subject areas. However, the results of the video quiz showed significant differences in the anaemia subject area between students who had been instructed using the paper case and live SP-based formats (scores of 47.4 and 57.6, respectively; p = 0.01) and in the abdominal pain subject area, in which students instructed using the DVD format scored higher than students instructed using either the paper case or SP-based formats (scores of 41.6, 34.9 and 31.2, respectively; p = 0.002). CONCLUSIONS Increasing the authenticity of instructional formats does not appear to significantly improve clinical reasoning performance in a pre-clerkship course. Medical educators should balance increases in authenticity with factors such as cognitive load, subject area and learner experience when designing new instructional formats. [ABSTRACT FROM AUTHOR]

Background: Publications in a variety of journals have described the problem of medical students'' decreasing anatomical knowledge. Interestingly, the number of people making this assertion is growing, despite a lack of empirical evidence that today's medical graduates actually know less about anatomy than medical students in the past. Nevertheless, many people are claiming that students'' anatomical knowledge is impaired due to negative effects from several factors, including teaching by non-medically qualified teachers, diminished use of cadaver dissection as a teaching tool and neglect of vertical integration of anatomy teaching. Aim: To find empirical evidence for the factors claimed to have an influence on anatomical knowledge of students. Method: A literature search. Results: There is a lack of sufficient quantity and quality of information within the existing literature to support any of the claims, but the gathered literature did reveal some fascinating insights which are discussed. Conclusion: Anatomy education should be made as effective as possible, as nobody will deny that medical students cannot do without anatomical knowledge. Because of promising findings in the areas of teaching in context, vertical integration and assessment strategies, it is recommended that future research into anatomy education should focus on these factors. [ABSTRACT FROM AUTHOR]

Medical Education 2011: : 329-338 Script concordance test (SCT) scores are intended to reflect respondents' competence in interpreting clinical data under conditions of uncertainty. The validity of inferences based on SCT scores has not been rigorously established. This study was conducted in order to develop a structured validity argument for the interpretation of test scores derived through use of the script concordance method. We searched the PubMed, EMBASE and PsycINFO databases for articles pertaining to script concordance testing. We then reviewed these articles to evaluate the construct validity of the script concordance method, following an established approach for analysing validity data from five categories: content; response process; internal structure; relations to other variables, and consequences. Content evidence derives from clear guidelines for the creation of authentic, ill-defined scenarios. High internal consistency reliability supports the internal structure of SCT scores. As might be expected, SCT scores correlate poorly with assessments of pure factual knowledge, in which correlations for more advanced learners are lower. The validity of SCT scores is weakly supported by evidence pertaining to examinee response processes and educational consequences. Published research generally supports the use of SCT to assess the interpretation of clinical data under conditions of uncertainty, although specifics of the validity argument vary and require verification in different contexts and for particular SCTs. Our review identifies potential areas of further validity inquiry in all five categories of evidence. In particular, future SCT research might explore the impact of the script concordance method on teaching and learning, and examine how SCTs integrate with other assessment methods within comprehensive assessment programmes. [ABSTRACT FROM AUTHOR]

CONTEXT The practice of medicine involves many stakeholders (or participant groups such as patients, doctors and trainees). Based on their respective goals, perceptions and understandings, and on what is being measured, these stakeholders may have dramatically different viewpoints of the same event. There are many ways to characterise what occurred in a clinical encounter; these include an oral presentation (faculty perspective), a written note (trainee perspective), and the patient's perspective. In the present study, we employed two established theories as frameworks with the purpose of assessing the extent to which different views of the same clinical encounter (a three-component, Year 2 medical student objective structured clinical examination [OSCE] station) are similar to or differ from one another. METHODS We performed univariate comparisons between the individual items on each of the three components of the OSCE: the standardised patient (SP) checklist (patient perspective); the post-encounter form (trainee perspective), and the oral presentation rating form (faculty perspective). Confirmatory factor analysis (CFA) of the three-component station was used to assess the fit of the three-factor (three-viewpoint) model. We also compared tercile performance across these three views as a form of extreme groups analysis. RESULTS Results from the CFA yielded a measurement model with reasonable fit. Moderate correlations between the three components of the station were observed. Individual trainee performance, as measured by tercile score, varied across components of the station. CONCLUSIONS Our work builds on research in fields outside medicine, with results yielding small to moderate correlations between different perspectives (and measurements) of the same event (SP checklist, post-encounter form and oral presentation rating form). We believe obtaining multiple perspectives of the same encounter provides a more valid measure of a student's clinical performance. [ABSTRACT FROM AUTHOR]

Background: Many medical schools provide academic support programmes to aid increasing numbers of students from diverse backgrounds. There have been calls for research into successful intervention programmes, and for detailed descriptions of how they work. Aims: To explore the efficacy of a mandatory intervention programme for at-risk medical students. Method: Students who failed and then repeated first semester were required to participate in a cognitive skills programme, following a syllabus based on principles drawn from both educational experience and multi-disciplinary theory and practice. Performance of programme participants was compared to the performance of students who repeated prior to the mandatory programme. Results: Of the participants ( n = 216), 91% passed their repeat semester, compared to 58% ( n = 715) for controls ( p < 0.0001). This significant effect persisted for progression through the school for the subsequent three semesters ( p < 0.0005). Conclusion: A mandatory programme that draws on a blend of theories and research-proven techniques can make a positive difference to the outcomes for at-risk medical students. [ABSTRACT FROM AUTHOR]

Objectives This study aimed to examine what students perceive as the ideal features of virtual patient (VP) design in order to foster learning with a special focus on clinical reasoning. Methods A total of 104 Year 5 medical students worked through at least eight VPs representing four different designs during their paediatric clerkship. The VPs were presented in two modes and differed in terms of the authenticity of the user interface (with or without graphics support), predominant question type (long- versus short-menu questions) and freedom of navigation (relatively free versus predetermined). Each mode was presented in a rich and a poor version with regard to the use of different media and questions and explanations explicitly directed at clinical reasoning. Five groups of between four and nine randomly selected students ( n = 27) participated in focus group interviews facilitated by a moderator using a questioning route. The interviews were videotaped, transcribed and analysed. Summary reports were approved by the students. Results Ten principles of VP design emerged from the analysis. A VP should be relevant, of an appropriate level of difficulty, highly interactive, offer specific feedback, make optimal use of media, help students focus on relevant learning points, offer recapitulation of key learning points, provide an authentic web-based interface and student tasks, and contain questions and explanations tailored to the clinical reasoning process. Conclusions Students perceived the design principles identified as being conducive to their learning. Many of these principles are supported by the results of other published studies. Future studies should address the effects of these principles using quantitative controlled designs. [ABSTRACT FROM AUTHOR]

Objectives The lack of published studies into effective skills teaching in clinical skills centres inspired this study of student views of the teaching behaviours of skills teachers. Methods We organised focus group discussions with students from Years 1–3 of a 6-year undergraduate medical curriculum. A total of 30 randomly selected students, divided into three groups, took part in two sessions. They discussed what teaching skills helped them to acquire physical examination skills. Results Students’ opinions related to didactic skills, interpersonal and communication skills and preconditions. Students appreciated didactic skills that stimulate deep and active learning. Another significant set of findings referred to teachers’ attitudes towards students. Students wanted teachers to be considerate and to take them seriously. This was reflected in student descriptions of positive behaviours, such as: ‘responding to students’ questions’; ‘not exposing students’ weaknesses in front of the group’, and ‘[not] putting students in an embarrassing position in skill demonstrations’. They also appreciated enthusiasm in teachers. Important preconditions included: the integration of skills training with basic science teaching; linking of skills training to clinical practice; the presence of clear goals and well-structured sessions; good time management; consistency of teaching, and the appropriate personal appearance of teachers and students. Conclusions The teaching skills and behaviours that most facilitate student acquisition of physical examination skills are interpersonal and communication skills, followed by a number of didactic interventions, embedded in several preconditions. Findings related to interpersonal and communication skills are comparable with findings pertaining to the teaching roles of tutors and clinical teachers; however, the didactic skills merit separate attention as teaching skills for use in skills laboratories. The results of this study should be complemented by a study performed in a larger population and a study exploring teachers’ views. [ABSTRACT FROM AUTHOR]

Context The clinical learning climate affects undergraduate medical students’ behaviour, satisfaction and success. Most studies predominantly describe aspects of the clinical learning climate using quantitative methodologies, such as questionnaires. This study aimed to illuminate medical students’ perceptions of the clinical learning climate, and which factors and their interactions explain differences in clinical learning climates. Methods We carried out a multi-method case study. Twelve departments of obstetrics and gynaecology distributed the Postgraduate Hospital Educational Environment Measure (PHEEM), a reliable questionnaire measuring the clinical learning environment, among medical students. After analysis (usinganova and post hoc tests), 14 medical students from the highest- and lowest-scoring departments participated in semi-structured interviews. We analysed the transcribed recordings using a content analysis approach. Researchers agreed on coding and an expert group reached consensus on the themes of the analysis. Results We found a significant difference between departments in PHEEM scores. The interviews indicated that department and medical student characteristics determine the clinical learning climate. For departments, ‘legitimacy’, ‘clerkship arrangements’ and ‘focus on personal development’ were the main themes. For medical students, ‘initial initiatives’, ‘continuing development’ and ‘clerkship fatigue’ were the principal themes. The amount and nature of participation played a central role in all themes. Conclusions Differences between clinical learning climates appear to be related to differing approaches to participation among departments. Participation depends on characteristics of both departments and students, and the interactions among them. The outcomes give valuable clues to how a favourable clinical learning climate is shaped. [ABSTRACT FROM AUTHOR]

Context We addressed the assessment of professional behaviour in tutorial groups by investigating students' perceptions of the frequency and impact of critical incidents that impede this assessment and 5 factors underlying these critical incidents. Methods A questionnaire asking students to rate the frequency and impact of 40 critical incidents relating to effective assessment of professional behaviour on a 5-point Likert scale was developed and sent to all undergraduate medical students in Years 2–4 of a 6-year undergraduate curriculum. Results The response rate was 70% ( n = 393). Important factors underlying critical incidents are: lack of effective interaction; lack of thoroughness; tutors' failure to confront students with unprofessional behaviour; lack of effort to find solutions, and lack of student motivation. Confirmatory factor analysis showed a good model fit. Because the relationship between frequency of occurrence and degree of impediment varies, the best information about the true impact of critical incidents and the underlying factors is provided by the product of frequency and degree of impediment. Frequency of occurrence remains stable and degree of impediment increases in Years 2–4. Conclusions The results of this study can be used to design and improve faculty development programmes aimed at improving assessment of professional behaviour. Training programmes should motivate tutors by providing background information as to why and how sound assessment of professional behaviour is to be performed and encourage tutors to confront students with and discuss all aspects of professional behaviour, as well as provide appropriate feedback. [ABSTRACT FROM AUTHOR]

Context The portfolio is becoming increasingly accepted as a valuable tool for learning and assessment. The validity of portfolio assessment, however, may suffer from bias due to irrelevant qualities, such as lay-out and writing style. We examined the possible effects of such qualities in a portfolio programme aimed at stimulating Year 1 medical students to reflect on their professional and personal development. In later curricular years, this portfolio is also used to judge clinical competence. Methods We developed an instrument, the Portfolio Analysis Scoring Inventory, to examine the impact of form and content aspects on portfolio assessment. The Inventory consists of 15 items derived from interviews with experienced mentors, the literature, and the criteria for reflective competence used in the regular portfolio assessment procedure. Forty portfolios, selected from 231 portfolios for which ratings from the regular assessment procedure were available, were rated by 2 researchers, independently, using the Inventory. Regression analysis was used to estimate the correlation between the ratings from the regular assessment and those resulting from the Inventory items. Results Inter-rater agreement ranged from 0.46 to 0.87. The strongest predictor of the variance in the regular ratings was ‘quality of reflection’ (R 0.80; R2 66%). No further items accounted for a significant proportion of variance. Irrelevant items, such as writing style and lay-out, had negligible effects. Conclusions The absence of an impact of irrelevant criteria appears to support the validity of the portfolio assessment procedure. Further studies should examine the portfolio's validity for the assessment of clinical competence. [ABSTRACT FROM AUTHOR]

Objective To explore student perceptions of factors contributing to the effectiveness of discussions in the reporting phase of the problem-based learning (PBL) process, where students report and synthesise the results of self-study. Methods Forty-eight Year 1 and 2 medical students participated in 6 focus group interviews about the characteristics of effective group discussions and possible improvements. The data were analysed qualitatively in several stages. Results The analysis yielded 4 main characteristics of effective discussions: asking for, giving and receiving explanations; integrating and applying knowledge; discussing differences with regard to learning content, and guiding and monitoring the content and the group process of the discussion. Integrating and applying knowledge included structuring, relating and summarising information and providing examples from practice. Discussing different opinions included discussing a variety of literature resources and disagreements. The main learning effects mentioned by the students were retention, understanding, integration and application of knowledge. Conclusions Students have clear ideas about what promotes effective discussions during the reporting phase. Their PBL experience has provided them with some insights that are in line with theory and research on collaborative learning. Future research should examine differences between student and tutor perceptions of the quality of discussions. Introductions to PBL for students and tutors should include training in asking open but focused questions, supporting explanations with arguments and dealing with conflicts about learning content. Tutors should be trained in giving effective and personal feedback. Collaborative creation of external knowledge representations (i.e. concept maps) should be advocated, as should variety of literature resources. [ABSTRACT FROM AUTHOR]

Objective To investigate the effects of a virtual learning environment (VLE) on group interaction and consultation of information resources during the preliminary phase, self-study phase and reporting phase of the problem-based learning process in an undergraduate medical curriculum. Methods A questionnaire was administered to 355 medical students in Years 1 and 2 to ask them about the perceived usefulness of a virtual learning environment that was created with Blackboard for group interaction and the use of learning resources. Results The students indicated that the VLE supported face-to-face interaction in the preliminary discussion and in the reporting phase but did not stimulate computer-mediated distance interaction during the self-study phase. They perceived that the use of multimedia in case presentations led to a better quality of group discussion than if case presentations were exclusively text-based. They also indicated that the information resources that were hyperlinked in the VLE stimulated the consultation of these resources during self-study, but not during the reporting phase. Conclusions Students indicated that the use of a VLE in the tutorial room and the inclusion of multimedia in case presentations supported processes of active learning in the tutorial groups. However, if we want to exploit the full potential of asynchronous computer-mediated communication to initiate in-depth discussion during the self-study phase, its application will have to be selective and deliberate. Students indicated that the links in the VLE to selected information in library repositories supported their learning. [ABSTRACT FROM AUTHOR]

Aim Portfolios are often used as an instrument with which to stimulate students to reflect on their experiences. Research has shown that working with portfolios does not automatically stimulate reflection. In this study we addressed the question: What are the conditions for successful reflective use of portfolios in undergraduate medical education? Methodology/research design We designed a portfolio that was aimed at stimulating reflection in early undergraduate medical education, using experiences described in the medical education literature and elsewhere. Conditions for reflective portfolio use were identified through interviews with 13 teachers (mentors), who were experienced in mentoring students in the process of developing their portfolios. The interviews were analysed according to the principles of grounded theory. Results The conditions for successful reflective use of portfolios that emerged from the interviews fell into 4 categories: coaching; portfolio structure and guidelines; relevant experiences and materials, and summative assessment. According to the mentors, working with a portfolio designed to meet these conditions will stimulate students' reflective abilities. Conclusion This study shows that portfolios are a potentially valuable method of assessing and developing students' reflective skills in undergraduate medical training, provided certain conditions for effective portfolios are recognised and met. Portfolios have a strong potential for enhancing learning and assessment but they are very vulnerable and may easily lead to disappointment. Before implementing portfolios in education, one should first consider whether the necessary conditions can be fulfilled, including an appropriate portfolio structure, an appropriate assessment procedure, the provision of enough new experiences and materials, and sufficient teacher capacity for adequate coaching and assessment. [ABSTRACT FROM AUTHOR]

Introduction: In health science education clinical clerkships serve the twofold purpose of guiding student learning and assessment of performance. Evidently, both formative and summative assessment procedures are needed in clerkship assessment. In-training evaluation (ITE) has the potential to serve both assessment functions. Implementation of effective ITE, however, has been shown to be problematic, partly because integration of assessment functions may have negative consequences for teaching and learning. This study investigates student perceptions of the impact of an integrated assessment approach, seeking to refine criteria for effective ITE. Method: In the curriculum of Maastricht Midwifery School (MMS), clerkship assessment is based on ITE serving both assessment functions. The ITE model is based on principles of extensive work sampling, and frequent documentation of performance. A focus group technique was used to explore student perceptions on the impact of the ITE approach on student learning and supervisor teaching behaviour, and on the usefulness of information for decision making. Results: Results indicate that the assessment approach is effective in guidance of student learning. Furthermore, students consider the frequent performance documentation essential in clerkship grading. Acceptance and effectivity of ITE requires a learning environment which is safe and respectful. Transparency of assessment processes is the key to success. Suggestions for improvement focus on variation in evaluation formats, improvement of feedback (narrative, complete) and student involvement in assessment. Conclusion: ITE can fulfill both its formative and summative purposes when some crucial conditions are taken into account. Careful training of both supervisors and students in the use of ITE for student learning and performance measurement is essential. [ABSTRACT FROM AUTHOR]

There are data that suggest that medical students do not feel sufficiently prepared for clinical practice in the clerkships. The transition from pre-clinical to clinical training causes problems. To seek quantitative verification of qualitative findings from an earlier focus group study on problems medical students encounter when entering the clinical phase of undergraduate training. At the start of the clinical phase, all Year 4 students at Maastricht Medical School were surveyed on the transition from pre-clinical to clinical training and its effects on workload, knowledge, skills and learning. The response rate was 67%. Students were uncertain as to how to behave and act, mainly because they did not know what was expected of them. They experienced a drastic increase in workload and a lack of time for studying. They considered themselves to be moderately prepared with regard to knowledge and they regarded their physical examination skills as satisfactory. Students reported having difficulty applying theoretical knowledge in clinical practice and perceived shortcomings in basic science knowledge. In addition, they felt compelled to change their learning strategies. The results of this study confirm the findings of the focus group study. The students experienced problems related to professional socialisation and workload and deficiencies in knowledge and the organisation of knowledge. A good starting point for improvement may involve exploring students' suggestions of an extensive introduction into the clerkships, a more gradual transition with regard to workload and closer integration of pre-clinical and clinical education. [ABSTRACT FROM AUTHOR]

Problem-based learning (PBL) is widely used in higher education. There is evidence available that students and faculty are highly satisfied with PBL. Nevertheless, in educational practice problems are often encountered, such as tutors who are too directive, problems that are too well-structured, and dysfunctional tutorial groups. The aim of this paper is to demonstrate that PBL has the potential to prepare students more effectively for future learning because it is based on four modern insights into learning: constructive, self-directed, collaborative and contextual. These four learning principles are described and it is explained how they apply to PBL. In addition, available research is reviewed and the current debate in research on PBL is described. It is argued that problems encountered in educational practice usually stem from poor implementation of PBL. In many cases the way in which PBL is implemented is not consistent with the current insights on learning. Furthermore, it is argued that research on PBL should contribute towards a better understanding of why and how the concepts of constructive, self-directed, collaborative and contextual learning work or do not work and under what circumstances. Examples of studies are given to illustrate this issue. [ABSTRACT FROM AUTHOR]

Introduction:In group learning settings like problem-based learning (PBL), the quality of interaction is closely related to group success. However, research and practice have shown that the interaction in tutorial groups is not optimal. In the present study, a questionnaire was used to measure students’ perceptions of occurrence and desirability of three interaction types, i.e. exploratory questioning, cumulative reasoning, and handling knowledge conflicts. The discrepancies between the perceptions of occurrence and desirability enabled us to illustrate how the questionnaire can be used to improve the group interaction process in the tutorial group.Method:The subjects consisted of all second-year medical students of Maastricht University (N=240, response rate 73%). The questionnaire consisted of a list of eleven statements representing the three interaction types (factors). Students were asked to rate each statement on a 5-point Likert scale for two types of perceptions, i.e. occurrence and desirability.Results:The average scores on occurrence and desirability of the interaction types varied between 3.4 and 3.7 (scale 1-5) and between 3.6 and 4.3, respectively. For two interaction types, significant differences between occurrence and desirability were found.Conclusion:The scores for occurrence were reasonable, and the desirability scores were significantly higher than the occurrence scores for two of the three interaction types, i.e., exploratory questioning and cumulative reasoning. The results of the present study imply that in the students’ opinion, the interaction process in the tutorial group can be improved. The questionnaire provides useful information to detect shortcomings in the tutorial group interaction. [ABSTRACT FROM AUTHOR]

To explore learning outcomes from international traineeships for undergraduate medical students. In-depth interviews were conducted with 24 undergraduate medical students at Maastricht University Medical School, the Netherlands. The 24 subjects were selected by purposeful sampling. Students reported meaningful learning outcomes in 6 domains: medical knowledge; skills; international health care organisation; international medical education; society and culture, and personal growth. International traineeships appear to provide good opportunities for students to meet the requirements of globalisation as well as some of the generic objectives of undergraduate medical education. The tentative findings of this study need to be confirmed by further studies. [ABSTRACT FROM AUTHOR]

The authors of this article, an assistant professor and a professor of medical education, share their perspectives on developments that need to take place in order for the field of medical education to advance. They address the necessities of effective practical training, accurate and consistent assessment, higher standards in research, and the cultivation of constructive perspectives on assessment.