Search

Background: Although simulation training is increasingly used to meet modern technology and patient safety demands, its successful integration within surgical curricula is still rare. The Dutch Urological Practical Skills (D-UPS) curriculum provides modular simulation-based training of technical and non-technical basic urological skills in the local hospital setting. This study aims to assess the educational impact of implementing the D-UPS curriculum in the Netherlands and to provide focus points for improvement of the D-UPS curriculum according to the participants.Methods: Educational impact was assessed by means of qualitative individual module-specific feedback and a quantitative cross-sectional survey among residents and supervisors. Twenty out of 26 Dutch teaching hospitals participated. The survey focussed on practical aspects, the D-UPS curriculum in general, and the impact of the D-UPS curriculum on the development of technical and non-technical skills.Results: A considerable survey response of 95 % for residents and 76 % for supervisors was obtained. Modules were attended by junior and senior residents, supervised by a urologist, and peer teaching was used. Ninety percent of supervisors versus 67 % of residents judged the D-UPS curriculum as an important addition to current residency training (p = 0.007). Participants' aggregated general judgement of the modules showed a substantial percentage favorable score (M ± SE: 57 ± 4 %). The impact of training on, e.g., knowledge of materials/equipment and ability to anticipate on complications was high, especially for junior residents (77 ± 5 and 71 ± 7 %, respectively). Focus points for improvement of the D-UPS curriculum according to the participants include adaptation of the training level to residents' level of experience and focus on logistics.Conclusion: The simulation-based D-UPS curriculum has a high educational impact. Residents and supervisors consider the curriculum to be an important addition to current residency training. Focus points for improvement of the D-UPS curriculum according to the participants include increased attention to logistics and integration of a spiral learning approach. [ABSTRACT FROM AUTHOR]

Objectives This study set out to examine how much time students and teachers devote to different learning-oriented interactions during seminar sessions and students’ and teachers’ perceptions about the occurrence and desirability of these interactions. Methods Students and teachers participating in eight seminar group sessions in Year 4 of an undergraduate veterinary curriculum completed an 11-item questionnaire which asked them to rate, on a 5-point Likert scale, the frequency of occurrence and level of desirability of three learning-oriented types of interaction: exploratory questioning; cumulative reasoning, and handling of conflict about knowledge. The questionnaire also invited positive and negative responses to aspects of group interactions and an overall mark (1–10) for the seminars and group interactions. Four group sessions were video-recorded and analysed using a coding scheme. The amount of time devoted to the different interactions was calculated. Results Both students and teachers gave scores of 3.0–3.5 for frequency of occurrence of exploratory questioning and cumulative reasoning and < 3.0 for occurrence of handling of conflict about knowledge. The desired occurrences of all interaction types were significantly higher than the actual occurrences according to students and teachers. Teachers were responsible for the majority of the interactions (93%). The percentages of session time devoted to teacher-centred cumulative reasoning, exploratory questioning and handling of conflict about knowledge were 65.8%, 15.6% and 3.1%, respectively. Conclusions Group interactions in seminar groups are dominated by the posing of questions by teachers to students. The moderate occurrence of group interactions as perceived by students and teachers may be explained by the inadequate preparation of teachers and students to stimulate group interactions. [ABSTRACT FROM AUTHOR]

Context One goal of undergraduate assessment is to test students’ (future) performance. In the area of skills testing, the objective structured clinical examination (OSCE) has been of great value as a tool with which to test a number of skills in a limited time, with bias reduction and improved reliability. But can OSCEs measure undergraduate internship expertise in basic clinical skills? Methods Undergraduate students ( n = 32) were given a questionnaire listing 182 basic clinical skills. We asked them to score the number of times they had performed each skill during their internships (a 12-month period in Year 6). We assessed the students at the end of Year 5 (before the start of their internships) and again at the start of Year 7 (undergraduate training takes 7 years in Belgium, with internships during Year 6), using a 14-station OSCE assessing basic clinical skills. Global ratings were used to score performance. The relationship between internship experience and the OSCE Year 7 score was analysed using a linear regression model, controlling for variation in OSCE scores from Year 5. A multi-level analysis was performed considering students as level-1 units and stations as level-2 units. Results Year 7 OSCE scores (post-internships) were not affected by the number of times that students practised basic medical skills during their internships. Discussion Scores on OSCEs do not seem to reflect clinical expertise acquired during internships. Other more integrated assessment methods may prove to be more valid for testing final undergraduate skills levels. [ABSTRACT FROM AUTHOR]

Objective To test hypotheses regarding the longitudinal effects of problem-based learning (PBL) and conventional learning relating to students’ appreciation of the curriculum, self-assessment of general competencies, summative assessment of clinical competence and indicators of career development. Methods The study group included 2 complete cohorts of graduates who were admitted to the medical curriculum in 1992 (conventional curriculum, n = 175) and 1993 (PBL curriculum, n = 169) at the Faculty of Medicine, University of Groningen, the Netherlands. Data were obtained from student records, graduates’ self-ratings and a literature search. Gender and secondary school grade point average (GPA) scores were included as moderator variables. Data were analysed by a stepwise multiple and logistic regression analysis. Results Graduates of the PBL curriculum scored higher on self-rated competencies. Contrary to expectations, graduates of the PBL curriculum did not show more appreciation of their curriculum than graduates of the conventional curriculum and no differences were found on clinical competence. Graduates of the conventional curriculum needed less time to find a postgraduate training place. No differences were found for scientific activities such as reading scientific articles and publishing in peer- reviewed journals. Women performed better on clinical competence than did men. Grade point average did not affect any of the variables. Conclusions The results suggest that PBL affects self-rated competencies. These outcomes confirm earlier findings. However, clinical competence measures did not support this finding. [ABSTRACT FROM AUTHOR]

Objective To determine the effectiveness of single-point benchmarking and longitudinal benchmarking for inter-school educational evaluation. Methods We carried out a mixed, longitudinal, cross-sectional study using data from 24 annual measurement moments (4 tests × 6 year groups) over 4 years for 4 annual progress tests assessing the graduation-level knowledge of all students from 3 co-operating medical schools. Participants included undergraduate medical students (about 5000) from 3 medical schools. The main outcome measures involved between-school comparisons of progress test results based on different benchmarking methods. Results Variations in relative school performance across different tests and year groups indicate instability and low reliability of single-point benchmarking, which is subject to distortions as a result of school-test and year group-test interaction effects. Deviations of school means from the overall mean follow an irregular, noisy pattern obscuring systematic between-school differences. The longitudinal benchmarking method results in suppression of noise and revelation of systematic differences. The pattern of a school’s cumulative deviations per year group gives a credible reflection of the relative performance of year groups. Conclusions Even with highly comparable curricula, single-point benchmarking can result in distortion of the results of comparisons. If longitudinal data are available, the information contained in a school’s cumulative deviations from the overall mean can be used. In such a case, the mean test score across schools is a useful benchmark for cross-institutional comparison. [ABSTRACT FROM AUTHOR]

Context We addressed the assessment of professional behaviour in tutorial groups by investigating students' perceptions of the frequency and impact of critical incidents that impede this assessment and 5 factors underlying these critical incidents. Methods A questionnaire asking students to rate the frequency and impact of 40 critical incidents relating to effective assessment of professional behaviour on a 5-point Likert scale was developed and sent to all undergraduate medical students in Years 2–4 of a 6-year undergraduate curriculum. Results The response rate was 70% ( n = 393). Important factors underlying critical incidents are: lack of effective interaction; lack of thoroughness; tutors' failure to confront students with unprofessional behaviour; lack of effort to find solutions, and lack of student motivation. Confirmatory factor analysis showed a good model fit. Because the relationship between frequency of occurrence and degree of impediment varies, the best information about the true impact of critical incidents and the underlying factors is provided by the product of frequency and degree of impediment. Frequency of occurrence remains stable and degree of impediment increases in Years 2–4. Conclusions The results of this study can be used to design and improve faculty development programmes aimed at improving assessment of professional behaviour. Training programmes should motivate tutors by providing background information as to why and how sound assessment of professional behaviour is to be performed and encourage tutors to confront students with and discuss all aspects of professional behaviour, as well as provide appropriate feedback. [ABSTRACT FROM AUTHOR]

Objective To investigate the effects of a virtual learning environment (VLE) on group interaction and consultation of information resources during the preliminary phase, self-study phase and reporting phase of the problem-based learning process in an undergraduate medical curriculum. Methods A questionnaire was administered to 355 medical students in Years 1 and 2 to ask them about the perceived usefulness of a virtual learning environment that was created with Blackboard for group interaction and the use of learning resources. Results The students indicated that the VLE supported face-to-face interaction in the preliminary discussion and in the reporting phase but did not stimulate computer-mediated distance interaction during the self-study phase. They perceived that the use of multimedia in case presentations led to a better quality of group discussion than if case presentations were exclusively text-based. They also indicated that the information resources that were hyperlinked in the VLE stimulated the consultation of these resources during self-study, but not during the reporting phase. Conclusions Students indicated that the use of a VLE in the tutorial room and the inclusion of multimedia in case presentations supported processes of active learning in the tutorial groups. However, if we want to exploit the full potential of asynchronous computer-mediated communication to initiate in-depth discussion during the self-study phase, its application will have to be selective and deliberate. Students indicated that the links in the VLE to selected information in library repositories supported their learning. [ABSTRACT FROM AUTHOR]

Introduction: In health science education clinical clerkships serve the twofold purpose of guiding student learning and assessment of performance. Evidently, both formative and summative assessment procedures are needed in clerkship assessment. In-training evaluation (ITE) has the potential to serve both assessment functions. Implementation of effective ITE, however, has been shown to be problematic, partly because integration of assessment functions may have negative consequences for teaching and learning. This study investigates student perceptions of the impact of an integrated assessment approach, seeking to refine criteria for effective ITE. Method: In the curriculum of Maastricht Midwifery School (MMS), clerkship assessment is based on ITE serving both assessment functions. The ITE model is based on principles of extensive work sampling, and frequent documentation of performance. A focus group technique was used to explore student perceptions on the impact of the ITE approach on student learning and supervisor teaching behaviour, and on the usefulness of information for decision making. Results: Results indicate that the assessment approach is effective in guidance of student learning. Furthermore, students consider the frequent performance documentation essential in clerkship grading. Acceptance and effectivity of ITE requires a learning environment which is safe and respectful. Transparency of assessment processes is the key to success. Suggestions for improvement focus on variation in evaluation formats, improvement of feedback (narrative, complete) and student involvement in assessment. Conclusion: ITE can fulfill both its formative and summative purposes when some crucial conditions are taken into account. Careful training of both supervisors and students in the use of ITE for student learning and performance measurement is essential. [ABSTRACT FROM AUTHOR]

Background: This research focuses on the relation between individual study and group discussion. In a problem-based curriculum, it is expected that the way students prepare themselves during individual study (i.e., search and prepare the literature) will influence the quality of the reporting phase. Purpose: To investigate whether searching for different literature resources and preparing the literature (by making summaries to explain the literature) affects the quality of the reporting phase. Method : A 23-item questionnaire was developed, reflecting 2 factors of the search phase and 1 factor of the preparing phase of the individual study. Two factors (breadth and depth of the discussion) reflected the reporting phase. Participants were 1st-year students (N = 195, 90%) at the Medical School of the Maastricht University in the Netherlands during the academic year 1997-1998. Results: Regression analyses show that the search phase and the preparing phase explained 29% of the variance of the breadth and 38% of the depth of the reporting phase. Conclusions: Searching different literature resources has a small and negative impact on the quality of the reporting phase. However, preparing extensively for the next tutorial meeting is very important, especially for the depth of the reporting phase. Therefore, when new knowledge must be integrated in the tutorial group, students must be taught to prepare themselves by making summaries that are useful and effective during the discussion. [ABSTRACT FROM AUTHOR]