Search

Vocational education aims at preparing students for their future as professionals; thus, students are often required to undergo a form of on-the-job learning. Assessment of professional performance during on-the-job learning is not based on single observations, but on prolonged participation at the workplace culminating in judgement by a workplace educator. However, little is known about "how" educators reach a judgement. This paper, therefore, aims at exploring how educators inform their judgements about students' professional performance. We consider the workplace to be a participatory learning environment, which entails that judgement about professional performance should be made in relation to the community students participated in and that the educator from that community has a central role. Our study takes an explorative approach based on interviews and uses template analysis to generate insight. Findings revealed that educators use multiple strategies to gather and process information about students to inform their judgement. Findings also showed that assessment starts at the first meeting, when the educator forms a first impression of the student and judges whether or not the student is suitable for the job. Educators at the workplace also showed that they are aware of the context in which they form their judgement.

Weaknesses in the nature of rater judgments are generally considered to compromise the utility of workplace-based assessment (WBA). In order to gain insight into the underpinnings of rater behaviours, we investigated how raters form impressions of and make judgments on trainee performance. Using theoretical frameworks of social cognition and person perception, we explored raters' implicit performance theories, use of task-specific performance schemas and the formation of person schemas during WBA. We used think-aloud procedures and verbal protocol analysis to investigate schema-based processing by experienced (N = 18) and inexperienced (N = 16) raters (supervisor-raters in general practice residency training). Qualitative data analysis was used to explore schema content and usage. We quantitatively assessed rater idiosyncrasy in the use of performance schemas and we investigated effects of rater expertise on the use of (task-specific) performance schemas. Raters used different schemas in judging trainee performance. We developed a normative performance theory comprising seventeen inter-related performance dimensions. Levels of rater idiosyncrasy were substantial and unrelated to rater expertise. Experienced raters made significantly more use of task-specific performance schemas compared to inexperienced raters, suggesting more differentiated performance schemas in experienced raters. Most raters started to develop person schemas the moment they began to observe trainee performance. The findings further our understanding of processes underpinning judgment and decision making in WBA. Raters make and justify judgments based on personal theories and performance constructs. Raters' information processing seems to be affected by differences in rater expertise. The results of this study can help to improve rater training, the design of assessment instruments and decision making in WBA.

Objective: To examine the increase in self-perceived clinical competence during a three-year postgraduate training in general practice and to explore the relation between the growth of self-perceived competence and several background variables. Design: Cohort, 1995-1998. Setting: Three-year Postgraduate Training for General practice in the Netherlands. Participants: All Dutch trainees who followed postgraduate training from September 1995 to September 1998 (N=191). Intervention: We asked the trainees at the start and at the end of their postgraduate training to complete a questionnaire, which assessed their self-perceived knowledge, clinical skills and consultations skills. We collected information about potentially influencing background variables. Amongst these were variables such as: age, gender, prior medical experience, the effort someone has spent upon her/his education, insight in weak and strong areas of clinical competence and knowledge and skills levels. Main outcome measure: Self-perceived competence. Results: A total of 127 trainees completed both questionnaires (190 at the first administration and 128 at the second one). We found statistically significant growth of self-perceived clinical competence. Self-perceived consultation skills increased more than self-perceived knowledge and clinical skills. The afore mentioned background variables did not relate in any way with the growth of self-perceived clinical competence. Conclusion: This study shows that a 3-year postgraduate training in general practice enhances self-perceived clinical competence. However, we still do not know how to explain this improvement. Further study into the theoretical concept of self-assessment in medical education and into the factors contributing to the feeling of being competent, is required.

Compares the academic achievement of students from two Dutch medical schools, one employing problem-based learning (PBL) and one using non-PBL methods. No systematic differences were found on total test scores. Differences were demonstrated only at the level of individual questions. Results indicate that PBL and non-PBL instructional methods have similar effects on medical factual knowledge. (Author/PVD)

Background:In clerkships, students are expected to self-regulate their learning. How clinical departments and their routine approach on clerkships influences students’ self-regulated learning (SRL) is unknown. Aim:This study explores how characteristic routines of clinical departments influence medical students’ SRL. Methods:Six focus groups including 39 purposively sampled participants from one Dutch university were organized to study how characteristic routines of clinical departments influenced medical students’ SRL from a constructivist paradigm, using grounded theory methodology. The focus groups were audio recorded, transcribed verbatim and were analyzed iteratively using constant comparison and open, axial and interpretive coding. Results:Students described that clinical departments influenced their SRL through routines which affected the professional relationships they could engage in and affected their perception of a department’s invested effort in them. Students’ SRL in a clerkship can be supported by enabling them to engage others in their SRL and by having them feel that effort is invested in their learning. Conclusions:Our study gives a practical insight in how clinical departments influenced students’ SRL. Clinical departments can affect students’ motivation to engage in SRL, influence the variety of SRL strategies that students can use and how meaningful students perceive their SRL experiences to be. [ABSTRACT FROM PUBLISHER]

The practice of assessment is governed by an interesting paradox. On the one hand good assessment requires substantial resources which may exceed the capacity of a single institution and we have reason to doubt the quality of our in-house examinations. On the other hand, our parsimonity with regard to our resources makes us reluctant to pool efforts and share our test material. This paper reports on an initiative to share test material across different medical schools. Three medical schools in The Netherlands have successfully set up a partnership for a specific testing method: progress testing. At present, these three schools collaboratively produce high-quality test items. The jointly produced progress tests are administered concurrently by these three schools and one other school, which buys the test. The steps taken in establishing this partnership are described and results are presented to illustrate the unique sort of information that is obtained by cross-institutional assessment. In addition, plans to improve test content and procedure and to expand the partnership are outlined. Eventually, the collaboration may even extend to other test formats. This article is intended to give evidence of the feasibility and exciting potential of between school collaboration in test development and test administration. Our experiences have demonstrated that such collaboration has excellent potential to combine economic benefit with educational advantages, which exceed what is achievable by individual schools. [ABSTRACT FROM AUTHOR]

Aim This study was conducted to investigate the value of a written knowledge test of communication skills for predicting scores on a performance test of communication skills. Method A paper-and-pencil test of knowledge about communication skills and a performance test of communication skills, consisting of four stations with standardised patients, were administered to students of two classes of the medical schools of Maastricht and Leiden, the Netherlands. The results on these tests were compared. Results From the results of both instruments, the classes of the participating students could be recognised equally well: 60% correct qualifications of the classes by the knowledge test and 64% by the multiple station examination. Between the two tests an overall, disattenuated correlation of 0·60 was found (N = 133, P < 0·01), suggesting moderate predictive value of the knowledge test for the performance test of communication skills. The correlation is stronger for students from Maastricht medical school than for their colleagues in Leiden. Correlation between the knowledge of communication skills test and other available test results of the participating Maastricht students is close to zero, suggesting that the test measures a distinct quality of students' competence. Discussion The paper-and-pencil test of knowledge of communication skills has predictive value for the performance of these skills, but this value seems to be less pronounced than similar findings for clinical procedural skills. The stronger relationship between 'knowing how' and 'showing' in the Maastricht student group might be indicative of an effect of the training format. [ABSTRACT FROM AUTHOR]

In order to share the issues involved in setting up a communication skills training programme in a medical school, the development of such a programme at the Skillslab of Maastricht Medical School, the Netherlands, is described and the problems encountered are addressed. A multidisciplinary working group developed teaching goals for communication skills, focused on observable behaviour to be displayed by students. These teaching goals were incorporated in a generic model for doctor-patient communication. A longitudinal training programme was created, throughout the four years of the preclinical curriculum. Students meet in small groups of 10, once every 2 weeks. In between group sessions they practise consultation skills in simulated patient contacts. Communication skills are assessed in the annual multiple station examination. In the development of this programme the following consecutive actions were taken: teaching material was produced, and an assessment tool was developed, as were instruments for programme evaluation. The programme evaluation allowed student feedback to teachers, the teachers' departments, and the administration of the medical school. Finally, teacher training was professionalized. [ABSTRACT FROM AUTHOR]

In recent years, postgraduate assessment programmes around the world have embraced workplace-based assessment (WBA) and its related tools. Despite their widespread use, results of studies on the validity and reliability of these tools have been variable. Although in many countries decisions about residents' continuation of training and certification as a specialist are based on the composite results of different WBAs collected in a portfolio, to our knowledge, the reliability of such a WBA toolbox has never been investigated. Using generalisability theory, we analysed the separate and composite reliability of three WBA tools [mini-Clinical Evaluation Exercise (mini-CEX), direct observation of procedural skills (DOPS), and multisource feedback (MSF)] included in a resident portfolio. G-studies and D-studies of 12,779 WBAs from a total of 953 residents showed that a reliability coefficient of 0.80 was obtained for eight mini-CEXs, nine DOPS, and nine MSF rounds, whilst the same reliability was found for seven mini-CEXs, eight DOPS, and one MSF when combined in a portfolio. At the end of the first year of residency a portfolio with five mini-CEXs, six DOPS, and one MSF afforded reliable judgement. The results support the conclusion that several WBA tools combined in a portfolio can be a feasible and reliable method for high-stakes judgements.

Background: Although the literature suggests that reflection has a positive impact on learning, there is a paucity of evidence to support this notion., Aim: We investigated feedback and reflection in relation to the likelihood that feedback will be used to inform action plans. We hypothesised that feedback and reflection present a cumulative sequence (i.e. trainers only pay attention to trainees' reflections when they provided specific feedback) and we hypothesised a supplementary effect of reflection., Method: We analysed copies of assessment forms containing trainees' reflections and trainers' feedback on observed clinical performance. We determined whether the response patterns revealed cumulative sequences in line with the Guttman scale. We further examined the relationship between reflection, feedback and the mean number of specific comments related to an action plan (ANOVA) and we calculated two effect sizes., Results: Both hypotheses were confirmed by the results. The response pattern found showed an almost perfect fit with the Guttman scale (0.99) and reflection seems to have supplementary effect on the variable action plan., Conclusions: Reflection only occurs when a trainer has provided specific feedback; trainees who reflect on their performance are more likely to make use of feedback. These results confirm findings and suggestions reported in the literature.

Background: Medical students increasingly participate in rotations in primary care settings, such as general practices. Although general practices can differ markedly from hospital settings, research on the instructional quality of general practice rotations is relatively scarce., Aim: We conducted a study to identify which aspects make a significant contribution to the instructional quality of general practice clerkships, as perceived by students., Method: After completing their general practice attachment, 155 fifth-year medical students filled out an evaluation questionnaire. Exploratory factor analysis and reliability analysis identified clusters of correlated independent variables. Subsequent regression analysis revealed the relations between the reduced set of independent variables and the dependent variable 'Instructional quality'., Results: Both the quality of supervision and the size and diversity of the patient mix substantially affected students' experienced instructional quality. Opportunities and facilities to perform independently were correlated with instructional quality, but did not affect the instructiveness directly., Conclusions: Supervision, patient mix and independence are crucial factors for learning in general practice. This is consistent with findings in hospital settings. The perceived quality of instruction hinges on supervision, which is not only the variable most strongly related to instructional quality, but which also affects both the patient mix and students' independence.

Introduction: Clinical skills centres (or Skillslabs) prepare students for patient-encounters. Evidence on teaching skills in these centres is lacking. What teaching skills do teachers view as effective in supporting the acquisition of physical examination skills in undergraduate medical training?, Method: Structured interviews of 10 teachers (1/3 of staff of Maastricht University, Skillslab) were conducted. Selection was based on even representation of age, years teaching experience, gender and previous experience at Maastricht University. A topic grid was used to ensure comparability. Interviews (average 70 min, range 33-95 min) were recorded and transcripts were analyzed independently by two researchers., Results: Teaching skills identified include the ability to adapt content of the training, level of depth and teaching method according to the needs of any particular group. Thorough comprehension of students' context (level of knowledge,prior experience and insight in the curriculum) is considered helpful. Explicitly inviting students to ask questions and providing relevant literature is seen to stimulate learning. Providing constructive feedback is essential, as is linking physical examination skills training to clinical situations. The ideal attitude includes appropriate dress and behaviour, as well as the use of humour. Affinity for teaching is regarded as the most important reason to work as a teacher., Conclusion: Desired characteristics for undergraduate skills teachers resemble findings in other teaching roles. Affinity for teaching and flexibility in teaching methods are novel findings.

Context: Graduate medical education is currently facing major educational reforms. There is a lack of empirical evidence in the literature about the learning processes of residents in the clinical workplace. This qualitative study uses a 'grounded theory' approach to continue the development of a theoretical framework of learning in the clinical workplace by adding the perspective of attending doctors., Methods: A total of 21 Dutch attending doctors involved in the training of residents in obstetrics and gynaecology participated in 1 of 3 focus group sessions. They discussed their perceptions of how residents learn and what factors influence residents' learning. A grounded theory approach was used to analyse the transcribed discussions., Results: Three related themes emerged. The first concerned the central role of participation in work-related activities: according to attending doctors, residents learn by tackling the everyday challenges of clinical work. The second involved the ways in which attending doctors influence what residents learn from work-related activities. The final theme focused on attending doctors' views of the essential characteristics of residents and their development during residency., Conclusions: Attending doctors' perspectives complement current insights derived from similar research among residents and from related literature. As part of an ongoing effort to further develop understanding of how residents learn, this study adds several ways in which attending doctors strive to combine guidance in both patient care and resident training. Furthermore, attending doctors' perspectives draw attention to other aspects of learning in the clinical workplace, such as the role of confidence and the balance between supervision and independence.

Objective: To examine the increase in self-perceived clinical competence during a three-year postgraduate training in general practice and to explore the relation between the growth of self-perceived competence and several background variables., Design: Cohort, 1995-1998., Setting: Three-year Postgraduate Training for General practice in the Netherlands, Participants: All Dutch trainees who followed postgraduate training from September 1995 to September 1998 (N=191)., Intervention: We asked the trainees at the start and at the end of their postgraduate training to complete a questionnaire, which assessed their self-perceived knowledge, clinical skills and consultations skills. We collected information about potentially influencing background variables. Amongst these were variables such as: age, gender, prior medical experience, the effort someone has spent upon her/his education, insight in weak and strong areas of clinical competence and knowledge and skills levels., Main Outcome Measure: Self-perceived competence., Results: A total of 127 trainees completed both questionnaires (190 at the first administration and 128 at the second one). We found statistically significant growth of self-perceived clinical competence. Self-perceived consultation skills increased more than self-perceived knowledge and clinical skills. The afore mentioned background variables did not relate in any way with the growth of self-perceived clinical competence., Conclusion: This study shows that a 3-year postgraduate training in general practice enhances self-perceived clinical competence. However, we still do not know how to explain this improvement. Further study into the theoretical concept of self-assessment in medical education and into the factors contributing to the feeling of being competent, is required.

In the framework of the Bologna Process, internationalization co-ordinators of seven (out of eight) Dutch medical schools completed an electronic survey about internationalization-related aspects of the curriculum. Common features of internationalization in Dutch medical schools were: the numbers of outgoing students exceeded the numbers of incoming students, and most international programmes involved clinical training and research projects. We recommend that Dutch medical schools should pay more attention to 'Internationalization at Home' and focus on conditions that are conducive to participation by foreign students.

Background: Supervision and feedback are essential factors that contribute to the learning environment in the context of workplace learning and their frequency and quality can be improved. Assessment is a powerful tool with which to influence students' learning and supervisors' teaching and thus the learning environment., Objective: To investigate an in-training assessment (ITA) programme in action and to explore its effects on supervision and feedback., Design: A qualitative study using individual, semistructured interviews., Subjects and Setting: Eight students and 17 assessors (9 members of staff and 8 residents) in the internal medicine undergraduate clerkship at Vrije Universiteit Medical Centre, Amsterdam, the Netherlands., Results: The ITA programme in action differed from the intended programme. Assessors provided hardly any follow-up on supervision and feedback given during assessments. Although students wanted more supervision and feedback, they rarely asked for it. Students and assessors failed to integrate the whole range of competencies included in the ITA programme into their respective learning and supervision and feedback. When giving feedback, assessors rarely gave borderline or fail judgements., Discussion and Conclusion: If an ITA programme in action is to be congruent with the intended programme, the implementation of the programme must be monitored. It is also necessary to provide full information about the programme and to ensure this information is given repeatedly. Introducing an ITA programme that includes the assessment of several competencies does not automatically lead to more attention being paid to these competencies in terms of supervision and feedback. Measures that facilitate change in the learning environment seem to be a prerequisite for enabling the assessment programme to steer the learning environment.

There has been considerable change in the field of assessment of medical competence. At the moment, competency-orientated assessment, 'mini-CEX' (brief clinical evaluation exercises) and portfolios are quite popular. These methods are based on research findings indicating that medical competence can better be described as a collection of the complex tasks (so-called competencies) that a doctor must be able to perform than as the sum of knowledge, skills, problem-solving ability and attitudes. Mini-CEX represents a method for the assessment of medical competence reliably and validly in a practical setting. Using a portfolio, information on the student's competence can be collated and evaluated from various sources, including mini-CEX. As such, a portfolio has much in common with a patient chart.

Introduction: The Clinical Teaching Effectiveness Instrument (CTEI) was developed to evaluate the quality of the clinical teaching of educators. Its authors reported evidence supporting content and criterion validity and found favourable reliability findings. We tested the validity and reliability of this instrument in a European context and investigated its reliability as an instrument to evaluate the quality of clinical teaching at group level rather than at the level of the individual teacher., Methods: Students participating in a surgical clerkship were asked to fill in a questionnaire reflecting a student-teacher encounter with a staff member or a resident. We calculated variance components using the urgenova program. For individual score interpretation of the quality of clinical teaching the standard error of estimate was calculated. For group interpretation we calculated the root mean square error., Results: The results did not differ statistically between staff and residents. The average score was 3.42. The largest variance component was associated with rater variance. For individual score interpretation a reliability of > 0.80 was reached with 7 ratings or more. To reach reliable outcomes at group level, 15 educators or more were needed with a single rater per educator., Discussion: The required sample size for appraisal of individual teaching is easily achievable. Reliable findings can also be obtained at group level with a feasible sample size. The results provide additional evidence of the reliability of the CTEI in undergraduate medical education in a European setting. The results also showed that the instrument can be used to measure the quality of teaching at group level.

Sharing and collaboration relating to progress testing already takes place on a national level and allows for quality control and comparisons of the participating institutions. This study explores the possibilities of international sharing of the progress test after correction for cultural bias and translation problems. Three progress tests were reviewed and administered to 3043 Pretoria and 3001 Maastricht medical students. In total, 16% of the items were potentially biased and removed from the test items administered to the Pretoria students (9% due to translation problems; 7% due to cultural differences). Of the three clusters (basic, clinical and social sciences) the social sciences contained most bias (32%), basic sciences least (11%). The differences that were found, comparing the student results of both schools, seem a reflection of the deliberate accentuations that both curricula pursue. The results suggest that the progress test methodology provides a versatile instrument that can be used to assess medical schools across the world. Sharing of test material is a viable strategy and test outcomes are interesting and can be used in international quality control.

Background: Global performance rating is frequently used in clinical training despite its known psychometric drawbacks. Inter-rater reliability is low in undergraduate training but better in residency training, possibly because residency offers more opportunities for supervision. The low or moderate predictive validity of global performance ratings in undergraduate and residency training may be due to low or unknown reliability of both global performance ratings and criterion measures. In an undergraduate clerkship, we investigated whether reliability improves when raters are more familiar with students' work and whether validity improves with increased reliability of the predictor and criterion instrument., Methods: Inter-rater reliability was determined in a clerkship with more student-rater contacts than usual. The in-training assessment programme of the clerkship that immediately followed was used as the criterion measure to determine predictive validity., Results: With four ratings, inter-rater reliability was 0.41 and predictive validity was 0.32. Reliability was lower and validity slightly higher than similar results published for residency training., Conclusion: Even with increased student-rater interaction, the reliability and validity of global performance ratings were too low to warrant the usage of global performance ratings as individual assessment format. However, combined with other assessment measures, global performance ratings may lead to improved integral assessment.

Assessment drives the educational behaviour of students and supervisors. Therefore, an assessment programme targeted at specific competencies may be expected to motivate supervisors and students to pay more attention to those competencies. In-training assessment (ITA) is regarded as a feasible method for assessing a broad range of competencies. Before and after the implementation of an ITA programme in an undergraduate Internal Medicine clerkship we surveyed students on the frequency of unobserved and observed supervision, and the quality of feedback as inferred from the seniority of the person providing it. After the implementation of the ITA programme supervision increased, but the difference was not statistically significant. The quality of feedback showed no significant change either. Inter-student variation in supervision and feedback remained invariably high after the implementation of the ITA programme. Whether these results are attributable to the way the programme was implemented or to the way the results were assessed remains to be clarified.

Competences are becoming more and more prominent in undergraduate medical education. Workplace learning is regarded as crucial in competence learning. Assuming that effective learning depends on adequate supervision, feedback and assessment, the authors studied the occurrence of these three variables in relation to a set of clinical competences. They surveyed students at the end of their rotation in surgery, internal medicine or paediatrics asking them to indicate for each competence how often they had received observed and unobserved supervision, the seniority of the person who provided most of their feedback, and whether the competence was addressed in formal assessments. Supervision was found to be scarce and mostly unobserved. Senior staff did not provide much feedback, and assessment mostly targeted patient-related competences. For all variables, the variation between students exceeded that between disciplines. We conclude that conditions for adequate workplace learning are poorly met and that clerkship experiences show huge inter-student variation.

Background: Medical education uses the cognitive apprenticeship model of student learning extensively. Students rotate among different hospitals and out- patient clinics where they are exposed to a range of professionally relevant contexts. Here they learn to think and act in different domains under the supervision of experts. Previous research has shown that these learning situations involve little teaching. Students see a narrow range of patient problems and feedback is limited. The aim of this study is to investigate relationships among some educational variables in the out-patient clinic., Method: This paper provides a theoretical model that specifies the factors influencing the effectiveness of student rotations at out-patient clinics. The model makes distinctions between input variables, such as organizational quality, number of students contemporaneously involved and available space, and process variables, such as patient mix and supervision, and the output variable of the effectiveness of rotations in out-patient clinics., Results: The model was tested against empirical data from evaluative surveys and showed a reasonable fit. The model offers suggestions for improving the learning environment of clinical rotations., Discussion: The strength of this study lies in its process evaluation perspective which investigates interactions between intervening variables rather than the influence of particular variables in isolation from other variables.

Background: Knowledge is an essential component of medical competence and a major objective of medical education. Thus, the degree of acquisition of knowledge by students is one of the measures of the effectiveness of a medical curriculum. We studied the growth in student knowledge over the course of Maastricht Medical School's 6-year problem-based curriculum., Methods: We analysed 60 491 progress test (PT) scores of 3226 undergraduate students at Maastricht Medical School. During the 6-year curriculum a student sits 24 PTs (i.e. four PTs in each year), intended to assess knowledge at graduation level. On each test occasion all students are given the same PT, which means that in year 1 a student is expected to score considerably lower than in year 6. The PT is therefore a longitudinal, objective assessment instrument. Mean scores for overall knowledge and for clinical, basic, and behavioural/social sciences knowledge were calculated and used to estimate growth curves., Findings: Overall medical knowledge and clinical sciences knowledge demonstrated a steady upward growth curve. However, the curves for behavioural/social sciences and basic sciences started to level off in years 4 and 5, respectively. The increase in knowledge was greatest for clinical sciences (43%), whereas it was 32% and 25% for basic and behavioural/social sciences, respectively., Interpretation: Maastricht Medical School claims to offer a problem-based, student-centred, horizontally and vertically integrated curriculum in the first 4 years, followed by clerkships in years 5 and 6. Students learn by analysing patient problems and exploring pathophysiological explanations. Originally, it was intended that students' knowledge of behavioural/social sciences would continue to increase during their clerkships. However, the results for years 5 and 6 show diminishing growth in basic and behavioural/social sciences knowledge compared to overall and clinical sciences knowledge, which appears to suggest there are discrepancies between the actual and the planned curricula. Further research is needed to explain this.

The purpose of this paper is to identify the key theoretical and empirical considerations that should underpin effective training for supervisors. Decisions about the content of training courses are complex because there is no appropriate model of supervision in medicine. This paper argues that, in the absence of an explanatory model, effective training for supervisors should be based on existing relevant understandings about learning processes and models of supervision, together with relevant empirical data. It explores some useful models of supervision, considers helpful aspects of theories about learning from experience and identifies some relevant empirical findings to identify some key theoretical and empirical considerations that should underpin effective training for supervisors. This paper offers a framework, derived from both empirical and theoretical work, to guide the content of effective supervision training courses. It does not prescribe structure or organization of training but suggests a basis for devising specific courses for response to local needs.

Aim of the Study: The communication skills of students of the Dutch medical schools of Maastricht and Leiden were compared, to assess the effectiveness of these schools' different approaches to communication skills training. Both schools have a six-year undergraduate medical curriculum, divided into four preclinical years and two years of clinical clerkships. The Maastricht problem-based curriculum offers an integrated clinical skills training programme, including communication skills, which runs throughout the first four years. Communication skills training in Leiden is concentrated in courses in the preclinical phase, at the beginning of the clinical phase and preceding two clerkships., Method: Communication skills of fourth-year and sixth-year students (N = 161) of both universities were assessed using four OSCE stations in which students did entire consultations with standardised patients. Trained observers rated these consultations, using a checklist., Results: Maastricht students of both year groups obtained significantly higher checklist scores for their communication skills than their Leiden colleagues. The Leiden students' scores increase between years 4 and 6, whereas those of the Maastricht students showed no significant change., Discussion: The higher scores obtained by the Maastricht students indicate a greater overall effectiveness of a longitudinal, integrated approach compared with concentrated courses. Absence of formal training in the clinical phase in Maastricht leads to stabilisation of communication skills, whereas the increase in the Leiden students' scores between years 4 and 6 offers evidence that formal communication skills training during the clinical phase does pay off. These findings suggest that the preferred approach to communication skills training would be an integrated, longitudinal programme, which continues during the clinical years.