Search

Arguably, constructive alignment has been the major challenge for assessment in the context of problem-based learning (PBL). PBL focuses on promoting abilities such as clinical reasoning, team skills and metacognition. PBL also aims to foster self-directed learning and deep learning as opposed to rote learning. This has incentivized researchers in assessment to find possible solutions. Originally, these solutions were sought in developing the right instruments to measure these PBL-related skills. The search for these instruments has been accelerated by the emergence of competency-based education. With competency-based education assessment moved away from purely standardized testing, relying more heavily on professional judgment of complex skills. Valuable lessons have been learned that are directly relevant for assessment in PBL. Later, solutions were sought in the development of new assessment strategies, initially again with individual instruments such as progress testing, but later through a more holistic approach to the assessment program as a whole. Programmatic assessment is such an integral approach to assessment. It focuses on optimizing learning through assessment, while at the same gathering rich information that can be used for rigorous decision-making about learner progression. Programmatic assessment comes very close to achieving the desired constructive alignment with PBL, but its wide adoption-just like PBL-will take many years ahead of us. [ABSTRACT FROM AUTHOR]

Background: Medical education in Sub-Saharan Africa is in need of reform to promote the number and quality of physicians trained. Curriculum change and innovation in this region, however, face a challenging context that may affect curriculum outcomes. Research on outcomes of curriculum innovation in Sub-Saharan Africa is scarce. We investigated curriculum outcomes in a Sub-Saharan African context by comparing students' perceived preparedness for practice within three curricula in Mozambique: a conventional curriculum and two innovative curricula. Both innovative curricula used problem-based learning and community-based education. Methods: We conducted a comparative mixed methods study. We adapted a validated questionnaire on perceived professional competencies and administered it to 5th year students of the three curricula (n = 140). We conducted semi-structured interviews with 5th year students from these curricula (n = 12). Additional contextual information was collected. Statistical and thematic analyses were conducted. Results: Perceived preparedness for practice of students from the conventional curriculum was significantly lower than for students from one innovative curriculum, but significantly higher than for students from the other innovative curriculum. Major human and material resource issues and disorganization impeded the latter's sense of preparedness. Both innovative curricula, however, stimulated a more holistic approach among students toward patients, as well an inquiring and independent attitude, which is valuable preparation for Sub-Saharan African healthcare. Discussion: In Sub-Saharan Africa, risks and benefits of curriculum innovation are high. Positive outcomes add value to local healthcare in terms of doctors' meaningful preparedness for practice, but instead outcomes can be negative due to the implementation challenges sometimes found in Sub-Saharan African contexts. Before embarking on innovative curriculum reform, medical schools need to assess their capability and motivation for innovation. [ABSTRACT FROM AUTHOR]

Contrary to classical problem-based learning, in guided problem-based learning, the learning goals are predetermined by the instructor—on the basis of a detailed decomposition of the subject matter to be studied—to activate prior knowledge and to structure self-study and subsequent group discussion. This study investigated the effects of classical problem-based learning and guided problem-based learning, for different prior knowledge levels, on perceived value and usefulness of the learning activity and on conceptual understanding of statistics. Participants randomly assigned 110 students to 10 problem-based learning groups, and subsequently, the 10 groups were allocated randomly to classical problem-based learning or guided problem-based learning. The results indicate that guided problem-based learning tends to enhance conceptual understanding of statistics more thanbreak; classical problem-based learning once students have some prior knowledge of the subject. Furthermore, guided problem-based learning tends to increase students’ awareness of the value and usefulness of the learning activity. [ABSTRACT FROM PUBLISHER]

Background To get insight in how theoretical knowledge is transformed into clinical skills, important information may arise from mapping the development of anatomical knowledge during the undergraduate medical curriculum. If we want to gain a better understanding of teaching and learning in anatomy, it may be pertinent to move beyond the question of how and consider also the what, why and when of anatomy education. Methods A purposive sample of 78 medical students from the 2nd, 3rd, 4th and 6th year of a PBL curriculum participated in 4 focus groups. Each group came together twice, and all meetings were recorded and transcribed verbatim. Data were analysed with template analysis using a phenomenographical approach. Results Five major topics emerged and are described covering the students' perceptions on their anatomy education and anatomical knowledge: 1) motivation to study anatomy, 2) the relevance of anatomical knowledge, 3) assessment of anatomical knowledge, 4) students' (in)security about their anatomical knowledge and 5) the use of anatomical knowledge in clinical practice. Conclusions Results indicated that a PBL approach in itself was not enough to ensure adequate learning of anatomy, and support the hypothesis that educational principles like time-on-task and repetition, have a stronger impact on students' perceived and actual anatomical knowledge than the educational approach underpinning a curriculum. For example, students state that repetitive studying of the subject increases retention of knowledge to a greater extent than stricter assessment, and teaching in context enhances motivation and transfer. Innovations in teaching, like spiral curriculum, teaching in context and teaching for transfer, and assessment, like assessment for learning: rewarding understanding and higher order cognitive skills, are required to improve anatomy education. [ABSTRACT FROM AUTHOR]

Medical Education 2012: 46: 738-747 Context Medical schools worldwide are increasingly switching to student-centred methods such as problem-based learning (PBL) to foster lifelong self-directed learning (SDL). The cross-cultural applicability of these methods has been questioned because of their Western origins and because education contexts and learning approaches differ across cultures. Objectives This study evaluated PBL's cross-cultural applicability by investigating how it is applied in three medical schools in regions with different cultures in, respectively, East Asia, the Middle East and Western Europe. Specifically, it investigated how students' cultural backgrounds impact on SDL in PBL and how this impact affects students. Methods A qualitative, cross-cultural, comparative case study was conducted in three medical schools. Data were collected through 88 semi-structured, in-depth interviews with Year 1 and 3 students, tutors and key persons involved in PBL, 32 observations of Year 1 and 3 PBL tutorials, document analysis, and contextual information. The data were thematically analysed using the template analysis method. Comparisons were made among the three medical schools and between Year 1 and 3 students across and within the schools. Results The cultural factors of uncertainty and tradition posed a challenge to Middle Eastern students' SDL. Hierarchy posed a challenge to Asian students and achievement impacted on both sets of non-Western students. These factors were less applicable to European students, although the latter did experience some challenges. Several contextual factors inhibited or enhanced SDL across the cases. As students grew used to PBL, SDL skills increased across the cases, albeit to different degrees. Conclusions Although cultural factors can pose a challenge to the application of PBL in non-Western settings, it appears that PBL can be applied in different cultural contexts. However, its globalisation does not postulate uniform processes and outcomes, and culturally sensitive alternatives might be developed. [ABSTRACT FROM AUTHOR]

Objective To test hypotheses regarding the longitudinal effects of problem-based learning (PBL) and conventional learning relating to students’ appreciation of the curriculum, self-assessment of general competencies, summative assessment of clinical competence and indicators of career development. Methods The study group included 2 complete cohorts of graduates who were admitted to the medical curriculum in 1992 (conventional curriculum, n = 175) and 1993 (PBL curriculum, n = 169) at the Faculty of Medicine, University of Groningen, the Netherlands. Data were obtained from student records, graduates’ self-ratings and a literature search. Gender and secondary school grade point average (GPA) scores were included as moderator variables. Data were analysed by a stepwise multiple and logistic regression analysis. Results Graduates of the PBL curriculum scored higher on self-rated competencies. Contrary to expectations, graduates of the PBL curriculum did not show more appreciation of their curriculum than graduates of the conventional curriculum and no differences were found on clinical competence. Graduates of the conventional curriculum needed less time to find a postgraduate training place. No differences were found for scientific activities such as reading scientific articles and publishing in peer- reviewed journals. Women performed better on clinical competence than did men. Grade point average did not affect any of the variables. Conclusions The results suggest that PBL affects self-rated competencies. These outcomes confirm earlier findings. However, clinical competence measures did not support this finding. [ABSTRACT FROM AUTHOR]

Context We addressed the assessment of professional behaviour in tutorial groups by investigating students' perceptions of the frequency and impact of critical incidents that impede this assessment and 5 factors underlying these critical incidents. Methods A questionnaire asking students to rate the frequency and impact of 40 critical incidents relating to effective assessment of professional behaviour on a 5-point Likert scale was developed and sent to all undergraduate medical students in Years 2–4 of a 6-year undergraduate curriculum. Results The response rate was 70% ( n = 393). Important factors underlying critical incidents are: lack of effective interaction; lack of thoroughness; tutors' failure to confront students with unprofessional behaviour; lack of effort to find solutions, and lack of student motivation. Confirmatory factor analysis showed a good model fit. Because the relationship between frequency of occurrence and degree of impediment varies, the best information about the true impact of critical incidents and the underlying factors is provided by the product of frequency and degree of impediment. Frequency of occurrence remains stable and degree of impediment increases in Years 2–4. Conclusions The results of this study can be used to design and improve faculty development programmes aimed at improving assessment of professional behaviour. Training programmes should motivate tutors by providing background information as to why and how sound assessment of professional behaviour is to be performed and encourage tutors to confront students with and discuss all aspects of professional behaviour, as well as provide appropriate feedback. [ABSTRACT FROM AUTHOR]

Objective To explore student perceptions of factors contributing to the effectiveness of discussions in the reporting phase of the problem-based learning (PBL) process, where students report and synthesise the results of self-study. Methods Forty-eight Year 1 and 2 medical students participated in 6 focus group interviews about the characteristics of effective group discussions and possible improvements. The data were analysed qualitatively in several stages. Results The analysis yielded 4 main characteristics of effective discussions: asking for, giving and receiving explanations; integrating and applying knowledge; discussing differences with regard to learning content, and guiding and monitoring the content and the group process of the discussion. Integrating and applying knowledge included structuring, relating and summarising information and providing examples from practice. Discussing different opinions included discussing a variety of literature resources and disagreements. The main learning effects mentioned by the students were retention, understanding, integration and application of knowledge. Conclusions Students have clear ideas about what promotes effective discussions during the reporting phase. Their PBL experience has provided them with some insights that are in line with theory and research on collaborative learning. Future research should examine differences between student and tutor perceptions of the quality of discussions. Introductions to PBL for students and tutors should include training in asking open but focused questions, supporting explanations with arguments and dealing with conflicts about learning content. Tutors should be trained in giving effective and personal feedback. Collaborative creation of external knowledge representations (i.e. concept maps) should be advocated, as should variety of literature resources. [ABSTRACT FROM AUTHOR]

Objective To investigate the effects of a virtual learning environment (VLE) on group interaction and consultation of information resources during the preliminary phase, self-study phase and reporting phase of the problem-based learning process in an undergraduate medical curriculum. Methods A questionnaire was administered to 355 medical students in Years 1 and 2 to ask them about the perceived usefulness of a virtual learning environment that was created with Blackboard for group interaction and the use of learning resources. Results The students indicated that the VLE supported face-to-face interaction in the preliminary discussion and in the reporting phase but did not stimulate computer-mediated distance interaction during the self-study phase. They perceived that the use of multimedia in case presentations led to a better quality of group discussion than if case presentations were exclusively text-based. They also indicated that the information resources that were hyperlinked in the VLE stimulated the consultation of these resources during self-study, but not during the reporting phase. Conclusions Students indicated that the use of a VLE in the tutorial room and the inclusion of multimedia in case presentations supported processes of active learning in the tutorial groups. However, if we want to exploit the full potential of asynchronous computer-mediated communication to initiate in-depth discussion during the self-study phase, its application will have to be selective and deliberate. Students indicated that the links in the VLE to selected information in library repositories supported their learning. [ABSTRACT FROM AUTHOR]

Problem-based learning (PBL) is widely used in higher education. There is evidence available that students and faculty are highly satisfied with PBL. Nevertheless, in educational practice problems are often encountered, such as tutors who are too directive, problems that are too well-structured, and dysfunctional tutorial groups. The aim of this paper is to demonstrate that PBL has the potential to prepare students more effectively for future learning because it is based on four modern insights into learning: constructive, self-directed, collaborative and contextual. These four learning principles are described and it is explained how they apply to PBL. In addition, available research is reviewed and the current debate in research on PBL is described. It is argued that problems encountered in educational practice usually stem from poor implementation of PBL. In many cases the way in which PBL is implemented is not consistent with the current insights on learning. Furthermore, it is argued that research on PBL should contribute towards a better understanding of why and how the concepts of constructive, self-directed, collaborative and contextual learning work or do not work and under what circumstances. Examples of studies are given to illustrate this issue. [ABSTRACT FROM AUTHOR]

Collaborative learning attracts attention because of its potential as a powerful learning strategy. This also holds for PBL. However, group work in PBL sometimes encounters problems and the quality of interaction is not always at the desired level. The aim of the present study was to develop and validate a questionnaire to assess the quality of learning-oriented group interactions in PBL in an uncomplicated way. The questionnaire, to be completed by students involved in PBL, contained items on three group-interaction dimensions: exploratory questions, cumulative reasoning and handling conflicts. It was validated by means of confirmatory factor analysis and regression analysis, the latter to investigate the relation between the three-dimension model and the tutorial group's productivity. The factors underlying the questionnaire were confirmed by the data in a linear structural analysis of the data. The regression analysis showed that the ‘exploratory questions’ and ‘cumulative reasoning’ factors explained together 26% of the variance of the tutorial group's productivity. This study provided evidence for the validity of the questionnaire. The instrument contains tips for students and tutors to stimulate deep processing interactions in the tutorial group. Nevertheless, it seems useful to investigate the external validity of the questionnaire [ABSTRACT FROM AUTHOR]

Junior doctors have reported shortcomings in their general competencies, such as organisational skills and teamwork. We explored graduates' perceptions of how well their training had prepared them for medical practice and in general competencies in particular. We compared the opinions of graduates from problem-based learning (PBL) and non-PBL schools, because PBL is supposed to enhance general competencies.We analysed the responses of 1159 graduates from 1 PBL and 4 non-PBL schools to a questionnaire survey administered 18 months after graduation.Compared with their non-PBL colleagues, the PBL graduates gave higher ratings for the connection between school and work, their medical training and preparation for practice. According to the graduates, the most frequently used competencies with sufficient coverage during medical training were expert knowledge, profession-specific skills and communication skills. The majority of the PBL graduates, but less than half of the non-PBL graduates, indicated that communication skills had been covered sufficiently. All the graduates called for more curriculum attention on working with computers, planning and organisation, and leadership skills. More PBL graduates than non-PBL graduates indicated that they had learned profession-specific methods, communication skills and teamwork in medical school.Overall, the graduates appeared to be satisfied with their knowledge and skills. The results suggest that the PBL school provided better preparation with respect to several of the competencies. However, both PBL and non-PBL graduates identified deficits in their general competencies, such as working with computers and planning and organising work. These competencies should feature more prominently in undergraduate medical education. [ABSTRACT FROM AUTHOR]

Introduction:In group learning settings like problem-based learning (PBL), the quality of interaction is closely related to group success. However, research and practice have shown that the interaction in tutorial groups is not optimal. In the present study, a questionnaire was used to measure students’ perceptions of occurrence and desirability of three interaction types, i.e. exploratory questioning, cumulative reasoning, and handling knowledge conflicts. The discrepancies between the perceptions of occurrence and desirability enabled us to illustrate how the questionnaire can be used to improve the group interaction process in the tutorial group.Method:The subjects consisted of all second-year medical students of Maastricht University (N=240, response rate 73%). The questionnaire consisted of a list of eleven statements representing the three interaction types (factors). Students were asked to rate each statement on a 5-point Likert scale for two types of perceptions, i.e. occurrence and desirability.Results:The average scores on occurrence and desirability of the interaction types varied between 3.4 and 3.7 (scale 1-5) and between 3.6 and 4.3, respectively. For two interaction types, significant differences between occurrence and desirability were found.Conclusion:The scores for occurrence were reasonable, and the desirability scores were significantly higher than the occurrence scores for two of the three interaction types, i.e., exploratory questioning and cumulative reasoning. The results of the present study imply that in the students’ opinion, the interaction process in the tutorial group can be improved. The questionnaire provides useful information to detect shortcomings in the tutorial group interaction. [ABSTRACT FROM AUTHOR]

Introduction Problem-based learning (PBL) is supposed to enhance the integration of basic and clinical sciences. In a non-integrative curriculum, these disciplines are generally taught in separate courses. Problem-based learning students perceive deficiencies in their knowledge of basic sciences, particularly in important areas such as anatomy. Outcome studies on PBL show controversial results, sometimes indicating that medical students at PBL schools have less knowledge of basic sciences than do their colleagues at more traditional medical schools. We aimed to identify differences between PBL and non-PBL students in perceived and actual levels of knowledge of anatomy. Methods Samples of Year 4 students in all eight medical schools in the Netherlands completed a questionnaire on perceived knowledge and took part in a computerised anatomy test consisting of both clinically contextualised items and items without context. Results Problem-based learning students were found to have the same perceived level of anatomy knowledge as students at other medical schools. Differences in actual levels of knowledge were found between schools. No significant effects on knowledge levels were found for PBL schools versus non-PBL schools. Conclusion The results of this study show that PBL does not result in a lower level of anatomy knowledge than more traditional educational approaches. It remains to be ascertained whether the levels students attain are adequate. Subjects for further study are the desired level of anatomy knowledge at the end of undergraduate medical education and the effectiveness of basic science learning within a clinical context and with repetition over the course of the curriculum. [ABSTRACT FROM AUTHOR]

Introduction Problem-based learning (PBL) has gained a foothold within many schools in higher education as a response to the problems faced within traditional education. Discussion Working with PBL tutorial groups is assumed to have positive effects on student learning. Several studies provide empirical evidence that PBL stimulates cognitive effects and leads to restructuring of knowledge and enhanced intrinsic interest in the subject matter. However, staff members do not always experience the positive effects of group work which they had hoped for. When confronted with problems in group work, such as students who only maintain an appearance of being actively involved and students who let others do the work, teachers all too often implement solutions which can be characterized as teacher- directed rather than student-directed. Teachers tend to choose solutions which are familiar from their own experience during professional training, i.e. using the teacher-directed model. These solutions are not effective in improving group work and the negative experiences persist. Conclusion It is argued that teachers should hold on to the underlying educational philosophy when solving problems arising from group work in PBL, by choosing actions which are consistent with the student-directed view of education in PBL. [ABSTRACT FROM AUTHOR]

ObjectivesResearch on tutoring in problem-based learning has not focused so far on the variation in tutoring and how this variation can be interpreted by conceptions about effective tutoring. DesignThis study focuses on the profiles of tutors generated by means of an instrument, the so-called Tutor Intervention Profile (TIP), and tries to determine which profiles are more or less effective. The TIP contains four dimensions of tutor behaviour: (1) elaboration; (2) directing the learning process; (3) integration of knowledge; and (4) stimulating interaction and individual accountability. SettingThe medical school of the University of Maastricht, The Netherlands. SubjectsSixty-seven tutors who run 67 tutorial groups across three units (courses) in the academic year 1996–97. ResultsIt appeared that high, average and low performing tutors differ in their performance on each of the four dimensions of the TIP. Several different profiles of tutor performance could be distinguished, which were more or less effective. One group of tutors demonstrated a tutor intervention profile that was characterized as relying more on the use of expert knowledge, whereas another group of tutors was characterized as relying more on their abilities to stimulate the learning process in the tutorial group. The tutor intervention profile that was perceived by students as most effective showed high scores on each of the four dimensions, as expected. Notably, a tutor stressing the learning process in the tutorial group was perceived as more effective than a tutor stressing content (expert tutor). This is especially true for a relatively poor scoring tutor. ConclusionsThe results of this study are consistent with research on human tutoring and research on tutoring in problem-based learning. [ABSTRACT FROM AUTHOR]

Background: Tutorial group effectiveness is essential for the success of learning in problem-based learning (PBL). Less effective and dysfunctional groups compromise the quality of students learning in PBL. Aims: This article aims to report on the reliability and validity of an instrument aimed at measuring tutorial group effectiveness in PBL. Method: The items within the instrument are clustered around motivational and cognitive factors based on Slavin's theoretical framework. A confirmatory factor analysis (CFA) was carried out to estimate the validity of the instrument. Furthermore, generalizability studies were conducted and alpha coefficients were computed to determine the reliability and homogeneity of each factor. Results: The CFA indicated that a three-factor model comprising 19 items showed a good fit with the data. Alpha coefficients per factor were high. The findings of the generalizability studies indicated that at least 9–10 student responses are needed in order to obtain reliable data at the tutorial group level. Conclusion: The instrument validated in this study has the potential to provide faculty and students with diagnostic information and feedback about student behaviors that enhance and hinder tutorial group effectiveness. [ABSTRACT FROM AUTHOR]