Search

Background: The use of e-exams in higher education is increasing. However, the role of student diversity in the acceptance of e-exams is an under-researched topic. In the current study, we considered student diversity in terms of three sociodemographic characteristics (age, gender, and second language) and three dispositional student characteristics (computer anxiety, test anxiety, and technology openness). Objectives: The main objective of this study was to investigate the relationship between student diversity and acceptance of e-exams. Methods: Our research combined cross-sectional analyses (N = 1639) with data from a natural experiment on the introduction of e-exams versus the established paper-pencil exams (N = 626) and used both self-report and institutional data. Sociodemographic and dispositional characteristics were indirectly related to pre-exam acceptance via expectancy variables from the Technology Acceptance Model framework. Results and Conclusions: Comparisons of post-exam acceptance showed that practical experience with the e-exam led to a significant increase in e-exam acceptance, and that students with low openness toward technology particularly benefited from this effect. Students' exam performance (i.e., grades) was unrelated to the exam format or their pre-exam acceptance of the e-exam format, and this was true across students' sociodemographic and dispositional characteristics. Takeaway: Student diversity plays a role in e-exam acceptance, but its influence is mitigated by first-hand experience with e-exams. The practical implications for higher education institutions aiming to implement e-exams are discussed.

It is well established in educational research that metacognitive monitoring of performance assessed by self-reports, for instance, asking students to report their confidence in provided answers, is based on heuristic cues rather than on actual success in the task. Subjective self-reports are also used in educational research on cognitive load, where they refer to the perceived amount of mental effort invested in or difficulty of each task item. In the present study, we examined the potential underlying bases and the predictive value of mental effort and difficulty appraisals compared to confidence appraisals by applying metacognitive concepts and paradigms. In three experiments, participants faced verbal logic problems or one of two non-verbal reasoning tasks. In a between-participants design, each task item was followed by either mental effort, difficulty, or confidence appraisals. We examined the associations between the various appraisals, response time, and success rates. Consistently across all experiments, we found that mental effort and difficulty appraisals were associated more strongly than confidence with response time. Further, while all appraisals were highly predictive of solving success, the strength of this association was stronger for difficulty and confidence appraisals (which were similar) than for mental effort appraisals. We conclude that mental effort and difficulty appraisals are prone to misleading cues like other metacognitive judgments and are based on unique underlying processes. These findings challenge the accepted notion that mental effort appraisals can serve as reliable reflections of cognitive load.

The way medical students learn anatomy is constantly evolving. Nowadays, technologies such as tablets support established learning methods like drawing. In this study, the effect of drawing on a tablet on medical students' anatomy learning was investigated compared to drawing or summarizing on paper. The quality of drawings or summaries was assessed as a measure of the quality of strategy implementation. Learning outcome was measured with an anatomy test, both immediately afterward and after 4-6 weeks to assess its sustainability. There were no significant group differences in learning outcome at both measurement points. For all groups, there was a significant medium strength correlation between the quality of the drawings or summaries and the learning outcome (p < 0.05). Further analysis revealed that the quality of strategy implementation moderated outcomes in the delayed test: When poorly implemented, drawing on a tablet (M = 48.81) was associated with lower learning outcome than drawing on paper (M = 58.95); The latter (M = 58.89) was related to higher learning outcome than writing summaries (M = 45.59). In case of high-quality strategy implementation, drawing on a tablet (M = 60.98) outperformed drawing on paper (M = 52.67), which in turn was outperformed by writing summaries (M = 62.62). To conclude, drawing on a tablet serves as a viable alternative to paper-based methods for learning anatomy if students can make adequate use of this strategy. Future research needs to identify how to support student drawing, for instance, by offering scaffolds with adaptive feedback to enhance learning.

Many studies investigating inquiry learning in science domains have appeared over the years. Throughout this period, inquiry learning has been regularly criticized by scholars who favor direct instruction over inquiry learning. In this vein, Zhang, Kirschner, Cobern, and Sweller (2022) recently asserted that direct instruction is overall superior to inquiry-based instruction and reproached policy makers for ignoring this fact. In the current article we reply to this assertion and the premises on which it is based. We review the evidence and argue that a more complete and correct interpretation of the literature demonstrates that inquiry-based instruction produces better overall results for acquiring conceptual knowledge than does direct instruction. We show that this conclusion holds for controlled, correlational, and program-based studies. We subsequently argue that inquiry-based and direct instruction each have their specific virtues and disadvantages and that the effectiveness of each approach depends on moderating factors such as the learning goal, the domain involved, and students' prior knowledge and other student characteristics. Furthermore, inquiry-based instruction is most effective when supplemented with guidance that can be personalized based on these moderating factors and can even involve providing direct instruction. Therefore, we posit that a combination of inquiry and direct instruction may often be the best approach to support student learning. We conclude that policy makers rightfully advocate inquiry-based instruction, particularly when students' investigations are supplemented with direct instruction at appropriate junctures.

Conducting experiments fosters conceptual understanding in science education. In various studies, combinations of real (hands-on) and virtual (computer-simulated) experiments have been shown to be especially helpful for gaining conceptual understanding. The present systematic review, based on 42 experimental studies, focuses on the following: (1) What is the relative effectiveness of combining real and virtual experiments compared with a single type of experimentation?; and (2) Which sequence of real and virtual experiments is most effective? The results indicate that: (1) in most cases combinations of real and virtual experiments promote conceptual understanding better than a single type of experimentation; and (2) there is no evidence for the superiority of a particular sequence. We conclude that for combining real and virtual experiments, apart from the individual affordances and the learning objectives of the different experiment types, especially their specific function for the learning task must be considered.

Background: Engaging students in computer-assisted guided inquiry learning has great potential to scaffold their scientific understanding: Students are expected to improve their scientific problem-solving skills, and at the same time gain a deep conceptual understanding of the subject-matter. Additional generative activities such as creating video explanations subsequent to inquiry learning activities can also further deepen students' knowledge. Objectives: In this experiment, we therefore compared the effectiveness of computer-based direct instruction (to mimic traditional classroom teaching) versus computer-based inquiry learning. Methods: University students (N = 118) either received video-based direct instruction (direct instruction), including the demonstration of a virtual experiment, or conducted the virtual experiment themselves supported by prompts (inquiry learning). A third group of students additionally generated a video explanation as consolidation activity subsequent to conducting the virtual experiment (inquiry learning + generative activity). Results and Conclusions: Contrarily to our hypotheses, the direct instruction condition outperformed the inquiry learning conditions. There were no significant differences between the inquiry learning and the inquiry learning + generative activity condition. Moderation analyses revealed that the effectiveness of direct instruction predominantly held true for students with low levels of domain-specific self-concept. All in all, our present study contributes to a better understanding of effects of direct instruction versus guided inquiry learning in computer-based science education settings. Importantly, our findings show that the effectiveness of instructional approaches may depend on students' domain-specific self-concept as a motivational prerequisite. As such it is up for further research in science education to identify motivating instructional strategies to enhance students' learning.

Guided inquiry learning is an effective method for learning about scientific concepts. The present study investigated the effects of combining video modeling (VM) examples and metacognitive prompts on university students' (N = 127) scientific reasoning and self-regulation during inquiry learning. We compared the effects of watching VM examples combined with prompts (VMP) to watching VM examples only, and to unguided inquiry (control) in a training and a transfer task. Dependent variables were scientific reasoning ability, hypothesis and argumentation quality, and scientific reasoning and self-regulation processes. Participants in the VMP and VM conditions had higher hypothesis and argumentation quality in the training task and higher hypothesis quality in the transfer task compared to the control group. There was no added benefit of the prompts. Screen captures and think aloud protocols during the two tasks served to obtain insights into students' scientific reasoning and self-regulation processes. Epistemic network analysis (ENA) and process mining were used to model the co-occurrence and sequences of these processes. The ENA identified stronger co-occurrences between scientific reasoning and self-regulation processes in the two VM conditions compared to the control condition. Process mining revealed that in the VM conditions these processes occurred in unique sequences and that self-regulation processes had many self-loops. Our findings show that video modeling examples are a promising instructional method for supporting inquiry learning on both the process and the learning outcomes level.

Background: When interpreting medical images such as dental panoramic radiographs (Orthopanthomogram, OPT), errors are frequent. Previous research has shown that eye movement modelling examples (EMME) are a supportive training method for medical image interpretation to reduce errors. To date, EMME support for OPTs has not been verified. Objectives: We investigated whether a training with EMME and verbal explanations supports dental students in evaluating OPTs. Methods: Dental students were randomly assigned to an intervention (N = 42) or a control group (N = 41). The intervention group received the EMME between pre- and post-test. In a laboratory study, we measured students' gaze behaviour during evaluating OPTs and the detection rate of anomalies. Results and conclusions: The training led to fewer, shorter, and later fixations on anomalies and no difference in visual coverage of the OPT. The detection rate of anomalies did not improve. We replicated the latter finding in an online study (N = 31). Students may not have been able to apply the information from the EMME to detect anomalies. The image reading processes changed to more efficient rather than deeper visual search. Major takeaways: This study evaluated a training method with EMME for anomaly detection of OPTs. EMMEs did not improve the anomaly detection of dental students and changed their visual search process toward a more efficient rather than a deeper search.

Background Improving scientific reasoning and argumentation are central aims of science education. Because of their complex nature, self-regulation is important for successful scientific reasoning. This study provides a first attempt to investigate how scientific reasoning and self-regulation processes conjointly impact argumentation quality. Methods: In a study with university students (N = 30), we used fine-grained process data of scientific reasoning and self-regulation during inquiry learning to investigate how the co-occurrences between scientific reasoning and self-regulation processes are associated with argumentation quality. Findings: When modeling the co-occurrence of scientific reasoning and self-regulation processes using epistemic network analysis, differences between students showing either high or low argumentation quality become apparent. Students who showed high argumentation quality engaged in different scientific reasoning processes together more often than students with low argumentation quality, and they made more connections between self-regulation and scientific reasoning processes. Contribution: These findings offer educational implications for teaching scientific reasoning. Integrating self-regulation and scientific reasoning during instruction could be beneficial for improving scientific reasoning and argumentation.

Citizen Science projects are continuously growing in popularity as they offer a unique possibility to conduct large-scale research projects as well as allow citizens to broaden their knowledge about the research topic or the process of scientific investigations. However, the benefits for participants vary, depending on the way and the amount of participants' personal involvement in the project. In this study, we investigated whether additional guidance would improve involvement and hence lead to greater knowledge gains, higher commitment and improved scientific reasoning of participants in a Citizen Science project on birdwatching. A group receiving guidance was compared to a group which took part in the same project without receiving additional support. Results showed that both groups enhanced their knowledge about birds and their commitment to birding, while there were no significant changes in scientific reasoning. However, participants receiving additional guidance observed a higher number of different bird species and reported being able to identify significantly more species. Participation in a Citizen Science project either with or without further guidance can be seen as powerful in supporting birders at the beginning of their initial stages. Thus, both versions should be taken into account when designing future Citizen Science projects.

Optics is a core field in the curricula of secondary physics education. In this study, we present the development and validation of a test instrument in the field of optics, the ray optics in converging lenses concept inventory (ROC-CI). It was developed for and validated with middle school students, but can also be adapted for the use in higher levels of physics education. The ROC-CI can be used as a formative or a summative assessment of students' conceptual understanding of image formation by converging lenses, assessing the following: (i) the overall understanding of fundamental concepts related to converging lenses, (ii) the understanding of specific concepts, and (iii) students' propensity for difficulties within this topic. The initial ROC-CI consists of 16 multiple-choice items; however, one item was removed based on various quality checks. We validated the ROC-CI thoroughly with distractor analyses, classical test theory, item response theory, structural analyses, and analyses of students' total scores at different measurement points as quantitative approaches, as well as student interviews and an expert survey as qualitative approaches. The quantitative analyses are mostly based on a dataset of N = 318 middle school students who took the ROC-CI as a post-test. The student interviews were conducted with seven middle school students after they were taught the concepts of converging lenses. The expert survey included five experts who evaluated both individual items and the test as a whole. The analyses showed good to excellent results for the test instrument, corroborating the 15-item ROC-CI's validity and its compliance with the three foci outlined above.

Integrating multiple representations into a coherent mental model is one of the challenges when learning with multimedia. In this experimental study (N = 173), we examined how highlighting corresponding information in text-graph learning material can help higher education students to make the necessary connections and improve learning outcomes in two domains. We compared a control condition to a signaling condition with given highlights and an active signaling condition where students were asked to visually highlight corresponding text and graph information themselves. There was no overall benefit of given signals or active signaling. We discuss prior knowledge and the quality of learner-generated signals as possible explanations. For biology learning material, prior knowledge moderated the effect of active signaling. In economics, the effect of prior knowledge was mediated by the quality of learner-generated correspondences. Our findings suggest that different methods of supporting text-graph integration might be useful for different students and learning material.

Background: It is well established that successful learning with multimedia is challenging, especially for younger learners. Aims: It was investigated whether students would profit from instructional support regarding the use of multimedia learning strategies. Sample: Participants were high school students in 8th, 9th, and 10th grade (N = 168). Methods: Participants were assigned to a no-support control group or one of four experimental groups. In the experimental groups, students received either only a multimedia strategy training before learning (training group) or the training was enriched by prompts (prompts before or during learning) or if-then plans (implementation intentions). In the training, multimedia learning strategies were introduced (e.g., linking information from text and picture). The prompts and implementation intentions were aimed at enhancing the application of the multimedia strategies conveyed through the training. Students learned about the process of mitosis by studying multimedia instructions and were tested regarding the acquired knowledge. It was expected that solely training students to use adequate multimedia learning strategies would not promote learning compared with the control group, rather, that additional support like prompts or implementation intentions would be necessary to enhance learning. Results: Although in the experimental groups, multimedia learning strategies were used more frequently especially in the beginning of the instructional unit, there were no effects on learning outcome. Conclusions: Promoting multimedia strategy use did not improve learning. The quality of the different instructional support measures and their suitability for the target groups are discussed as possible explanations for these findings.

We investigated in an experiment with 180 university students the joint role of prior knowledge, alleged model competence, and social comparison orientation regarding the effectiveness of Eye Movement Modeling Examples (EMME) for supporting multimedia learning. EMME consisted of short videos with gaze replays of an instructed model demonstrating effective multimedia processing strategies. Participants were either instructed that the model in the EMME-videos was a successful learner (competent model) or another participant (peer model). Participants in a control condition received no EMME. Furthermore, we activated domain-relevant prior knowledge in half of the participants before watching the EMME. Against our expectations, we found no influence of either prior knowledge activation or model-observer similarity. As expected, our results indicated that EMME fostered multimedia learning. This was also supported by findings from small-scale meta-analyses that were conducted with the focus on the effect of EMME for multimedia learning and potential moderators of the effect. Moreover, results showed first evidence that social comparison orientation interacts with (alleged) model competence regarding the effectiveness of EMME. Further research is needed to follow up on the influence of individual factors as well as social cues on the effectiveness of EMME.

Video motion analysis allows tracing trajectories of objects in motion and is an established method in physics education. Tablet computers, with their integrated cameras, offer the opportunity to both record and analyze dynamic motions during experiments on a single device. This enables students to work without transitioning the data between camera and computer, but with ubiquitously available applications on mobile devices. This article describes a model experiment to examine Kepler's laws of motion using tablet computers with a video analysis application.