Search

Background Study: The research discusses the need for a paradigm shift in engineering education current practices to accommodate the digital native students. The paper emphasizes the importance of integrating disruptive technologies, namely Virtual Reality (VR) through Head Mounted Displays VR (HMD VR) and Desktop Based VR (DB VR) and comparing it with the traditional teaching methods. The research focuses on second‐year undergraduate students enrolled in a concrete structures course. Objectives: The objective of the study is to analyse the impact of DB VR and HMD VR on students' motivation, performance and workload in comparison with traditional 2D drawings. The study also aims to investigate how simulation sickness and system usability could impact students' motivation and performance when interpreting concrete structures. Methods: The study divided second‐year civil engineering students into three groups, 2D, DB VR and HMD VR. The performance and motivation levels of students were assessed based on the number of mistakes identified and an intrinsic motivation survey. Furthermore, data on system usability and simulation sickness were collected. Spearman rank correlation was conducted to analyse the relationships between the variables tested. Results: The results have shown that students' motivation and performance were much higher when using VR in general and HMD VR specifically, students' efficiency and accuracy were also observed. On the other hand, usability was found to be moderately correlated with motivation, with students rating HMD VR as the most usable approach. A moderate inverse correlation was observed between simulation sickness and motivation, indicating that higher simulation sickness led to lower motivation levels. Conclusion: The study concludes that integrating VR in general, DB VR, or HMD VR into a concrete structures course for undergraduate students can significantly improve students' performance and motivation. Furthermore, enhancing usability of any of the methods used can also improve the performance and motivation. On the other hand, simulation sickness inversely affects motivation and performance, therefore, VR developers and educators should not neglect it. Lay Description: What is already known about the topic: Traditional teaching methods in engineering education require improvement.Integrating digital technologies into engineering education enhances performance.Digital technologies can potentially enhance motivation. What this paper adds: Compares traditional teaching methods for concrete structures interpretation with virtual reality.Establishes correlations between motivation, performance and usabilityIntroduces how desktop‐based VR and head‐mounted display VR can produce varying results. Implications for practice and/or policy: Decision‐makers can use the information to integrate updated pedagogy into engineering curricula.Allows for further exploration of different digital technologies that can be used for concrete structure interpretation.Allows instructors to introduce virtual reality in their courses. [ABSTRACT FROM AUTHOR]

Background: Computer‐based scaffolding has been intensively used to facilitate students' self‐regulated learning (SRL). However, most previous studies investigated how computer‐based scaffoldings affected the cognitive aspect of SRL, such as knowledge gains and understanding levels. In contrast, more evidence is needed to examine the effects of scaffolding on the metacognitive dimension and efficiency outcome of SRL. Objectives: This study aims to examine the role of computer‐based scaffolding in students' metacognitive monitoring and problem‐solving efficiency. Methods: Seventy‐two medical students completed two clinical reasoning tasks in BioWorld, an intelligent tutoring system (ITS) designed for promoting medical students' diagnostic expertise. During solving the tasks, students were asked to report their confidence judgements about proposed diagnoses. Computer trace data were used to identify task completion time (CT) and students' use of three scaffolding types, that is, conceptual, strategic, and metacognitive. Then we calculated students' metacognitive monitoring accuracy (i.e., calibration) and problem‐solving efficiency. Results and Conclusions: One‐sample t‐test demonstrated that students inaccurately monitored their learning processes and were overconfident in both tasks. Linear mixed‐effects models (LMMs) indicated that the intensive use of metacognitive scaffolding positively predicted students' metacognitive monitoring accuracy. Moreover, strategic scaffolding was negatively related to problem‐solving efficiency, whereas metacognitive scaffolding positively influenced problem‐solving efficiency. Takeaways: This study shows the importance of metacognitive scaffolding in improving the accuracy of metacognitive monitoring and problem‐solving efficiency. Findings from this study provide new insights for instructors and ITS developers to optimise the design of scaffoldings. Lay Description: What is already known about this topic?: Computer‐based scaffolding can facilitate students' knowledge gains and academic performance during self‐regulated learning (SRL).The effects of computer‐based scaffolding on the metacognitive dimension and efficiency outcome of SRL are still in a nascent phase. What this paper adds?: This paper explores how different types of computer‐based scaffolding affect students' metacognitive monitoring and problem‐solving efficiency.Metacognitive scaffolding improved the accuracy of medical students' confidence judgements.Metacognitive scaffolding promoted medical students' diagnostic problem‐solving efficiency.Strategic scaffolding had a negative effect on problem‐solving efficiency. Implications for practice: Instructors could provide more metacognitive scaffoldings to facilitate students' metacognitive monitoring accuracy.The designers of intelligent tutoring systems and instructors should consider the costs associated with using scaffoldings. [ABSTRACT FROM AUTHOR]

Background: Screen‐sharing technologies enable applications such as screen mirroring, video streaming and instant messaging across multiple device screens. Despite their increasing use in many contemporary classrooms, there is a paucity of research directly examining pedagogical benefits and issues of these technologies. Objectives: This study investigated the influence of screen‐sharing technologies on teachers' practices, highlighting pedagogical benefits and issues encountered. Methods: The paper drew on a sample of 321 K‐12 teachers and utilised principal components analysis, descriptive statistics and inductive coding. Results and Conclusions: Teachers reported greater mobility, increased ease of content sharing and deeper learner cognition as attributes of improved learning and teaching with the technologies. However, a minority highlighted technical issues such as network and hardware problems affecting their confidence. Despite increased mobility as an affordance, teachers' perceptions about mobility largely appeared to be predicated on assumptions that the technologies were intended for didactic instruction. Takeaways: The study contributes to a more nuanced understanding of screen‐sharing affordances while underscoring learner‐led screensharing as a focus for future research and practice. Lay Description: What is already known about this topic: Screen‐sharing technologies are becoming commonplace in many contemporary educational settings.The technologies represent integrated systems that enable functions such as mirroring, video streaming, online polls, real‐time editing, screen‐capturing and learner analytics.Screen‐sharing is indirectly examined in several studies with findings indicating improvements in group awareness, emotional engagement, learner confidence to share ideas and teachers' visualization of concepts.Existing findings are largely anecdotal and there are very few studies that have focused directly on screen‐sharing affordances. What this paper adds: An empirical study directly examining teachers' first‐hand perspectives of using screen‐sharing technologies.Benefits relate to greater task focus, deeper thinking, improvements to teaching practice and ease of sharing content.A minority of teachers experienced issues such as technical problems, inappropriate sharing and distraction.Mobility was recognized as a key affordance though remained underutilized by many teachers. Implications for practice and/or policy: Professional learning accompanying the use of screen‐sharing technologies can support teachers to take advantage of all features of screen sharing such as enhanced teacher mobility.Institutions need to provide requisite technical and professional support for teachers to effectively and reliably leverage screen‐sharing in the classroom.There is a need to explore teacher's and learner's screen‐sharing uses in situ to more fully understand issues and possibilities. [ABSTRACT FROM AUTHOR]

Background: The emergence of the COVID‐19 and the resulting global pandemic has ushered in far‐reaching changes for countries across the world, not least of which are changes to their education systems. With traditional location‐based exams no longer possible at universities, the uptake of online proctored exams (OPE) has occurred at a pace not seen prior to the pandemic. Students' experiences of online proctored exams during the pandemic are reasonably well‐understood in terms of digital access and ease of use of the technology. However, less is known about students' perceptions of digital confidence and competence to complete an online exam, both of which are important digital equity considerations. Objectives: This study investigates students' digital confidence and competence to undertake online proctored exams to determine whether issues of equity exist for students. Methods: This study reports the results of a survey (N = 761) of one university's students' experiences of end‐of‐semester online proctored exams in New Zealand. Results: Most students were positive about online exams, felt reasonably confident to complete an exam, and had the necessary digital access (i.e., devices, internet) and competence to succeed. However, digital inequalities were found between students' perceptions of digital competence based on ethnicity. While more time learning online equated to increasing self‐reported digital competence for most ethnic groups, this was not the case for Pacific learners. Takeaways: Perceptions of low digital competence can contribute to digital inequalities. Educators can support learners to develop positive perceptions of digital competence by teaching digital literacy skills. Lay Description: What is already known about this topic: Online proctored exams (OPE) have replaced many traditional exams because of the pandemic.Research on the use of online proctored exams during the pandemic suggests some acceptance among students.Apart from access related issues, little is known about digital inequalities associated with online exams. What this paper adds: Most participants were positive about OPE and felt reasonably confident to successfully complete them.Confident students were more likely to report that the exam software was easy to use.Perceptions of digital competence differed based on ethnicity.Marginalized groups were more likely to experience digital inequalities than other groups. Implications for practice and/or policy: Digital inequality is about more than issues of digital access (i.e., devices, internet).Provide differentiated technical support for students who express low digital competence.Teaching online exam digital literacy skills might increase perceptions of digital competence. [ABSTRACT FROM AUTHOR]

Background: Benefited from advances in technology, virtual reality (VR) has been widely applied to learning content in operational training as well as hands‐on courses. However, most current studies tend to evaluate learning effectiveness in this application, and few were focused on how learners can be benefited from transferring the knowledge learned to real‐world field performance. Moreover, in application‐oriented hands‐on courses such as embedded electronic circuits, to our best knowledge, none were presented in interactive learning materials with the combination of VR and neither were the understanding of the changes in cognition, learning anxiety, and learning confidence during the learning process. Method and Objective: We combine VR technology with hands‐on tasks to design a VR‐based embedded electronic circuit learning system. We conduct a quasi‐experiment to investigate differences in knowledge, comprehension, and application levels in different learning environments, and to assess learning performance, learning anxiety, and learning confidence levels when applying the knowledge learned to real‐world hands‐on tasks. Results: Groups that receive VR‐mediated training exhibit superior knowledge, comprehension, and application levels. In addition, learners with higher levels of knowledge and application exhibit lower learning anxiety and higher learning confidence during practical application tasks. Conclusions: We investigate the learning outcomes of learners on practical hands‐on tasks after VR‐mediated learning. To improve the learning experience and performance for learners in an embedded electronic circuit course, we discuss the learning performance in terms of the knowledge and concepts learned in the VR environment and transferred to the real world. The results show that learners achieve better cognitive levels in the learning process through the VR system described here. Better performance on hands‐on tasks was also obtained as well as low anxiety and high confidence levels. Lay Description: What Is Already Known about this Topic: Multimedia learning materials are important for improving hands‐on practical ability.Multimedia learning materials are already being used to promote learning effectiveness and outcomes.There is a significant impact on learning anxiety and learning confidence in the cognitive process. What this Paper Adds: Embedded electronic circuits course presented by IVR reduces learning anxiety and increases learning confidence in the hands‐on practical task.Through IVR learning, students can construct their knowledge better and be able to perform better in hands‐on tasks. Implications for Practice and/or Policy: We show the effectiveness of a hands‐on embedded electronic circuit course when transferring and applying knowledge to real‐world hands‐on tasks after learning in a virtual environment.Learners exhibit better performance on practical hands‐on tasks, as well as lower anxiety and higher confidence levels.Future work could explore adaptive factors by learners such as feedback and prompts given by learners in the VR learning environment to better understand the changes and effects in learners' cognitive processes. What Are the 1 or 2 Major Takeaways from the Study: According to these results, the combination of IVR in hands‐on courses is an effective learning method, which can effectively improve students' knowledge, comprehension, and application ability.We reveal the potential for hands‐on embedded courses to outperform traditional lecture courses through VR learning. Learners exhibit higher confidence and lower anxiety in the process of hands‐on practice. [ABSTRACT FROM AUTHOR]

Background: Motivation is an important factor in the learning process and supporting students' motivation in mathematics is a significant challenge for educators. Educational technologies, such as digital games, offer potential for engagement in mathematics learning activities. Objectives: To contrast the general decrement in student motivation in mathematics, a multilevel meta‐analysis was carried out to synthesize the results of studies concerning the impact of digital games on K‐12 student motivation in mathematics. Methods: Standardized measure of effect size (dppc2) for pre‐ post‐control group designs was used, and different sources of dependency among the effects were taken into account. Moreover, through meta‐regressions, we examined whether specific characteristics of the participants, interventions and outcomes were associated with effect size differences throughout the studies. Results and Conclusions: A total of 20 primary studies (43 effect sizes) meeting eligibility criteria was included. Results showed a significant overall effect (dppc2 = 0.27; 95%CI = [0.14; 0.41]) and a great heterogeneity between studies. Moderator analyses showed differences in effect size associated to the duration of intervention and motivational construct in terms of expectancy and value. Implications: Overall, the findings indicate that digital games are effective tools compared to conventional teaching practices. The results are promising and could be useful for the design of digital educational interventions aimed at promoting motivation in mathematics. Lay Description: What is already known about this topic: Motivation in term of expectancy and value is an important factor in the learning process.Digital games influence student motivation to learn in K‐12 education.Concerning mathematics, previous meta‐analyses studied the effects of digital games on math achievement but not on motivation. What this paper adds: This meta‐analysis synthesizes the impact of digital games on motivation in mathematics.The targeted learner audience is K‐12 students.Results show a significant overall effect of digital games on motivation and a great heterogeneity.The effect is greater if motivation is measured in terms of expectancy than of value.The duration of intervention moderates the effect: short interventions have the highest effects. Implications for practice and/or policy: Digital games promote motivation in mathematics for K‐12 students compared to conventional teaching practices.Engaging and innovative educational activities, such as digital games, might contrast the worldwide decline of enrolments in the STEM field. [ABSTRACT FROM AUTHOR]

Background: Computational thinking (CT) has been broadly considered one of the 21st‐century competencies, and an emerging trend has been seen in integrating CT into primary education. Cumulative research was conducted to investigate the influencing factors of CT learning performance, and an ample range of factors has been identified, involving both cognitive and non‐cognitive facets. However, limited has been done in exploring the non‐cognitive factors, and even less at the primary education level. Objective: To address this gap, this study bridged CT with personality in the primary school context, and more importantly, it proposed a mediator in the personality‐CT relationship that is, attitudinal beliefs, which are amenable to change, thereby allowing further support for nurturing the traits. Method: Based on the Big Five model of personality, standard tests were administered to a sample of 434 primary school students (ages 8–11), and data were analysed using structural equation modelling via Mplus. To improve the robustness of the results, control variables (i.e., demographic features, coding experience) were added to the research model, and a bootstrap approach with 5000 resamples was used to examine the mediating effect. Result and Conclusion: Findings demonstrated that Conscientiousness had a positive effect on CT, and attitudinal beliefs mediated the effect of Open‐mindedness (positive) and Negative Emotionality (negative) on CT. The study contributes to the literature by enriching the CT network with non‐intellectual components and unravelling the mechanism of CT regarding how disposition traits turn into learning performance. The results implicate practitioners on the importance of encouraging conscientious behaviours and nurturing positive attitudinal beliefs in CT primary education. Lay Description: What is already known about this topic: Personality traits can play a role in students' learning performance.The relationship between personality and computational thinking (CT) has been verified in teenage cohorts.Simply studying personalities may have limited practical implications, as these traits tend to be stable features that practitioners have little control over. What this paper adds: This is the first study investigating the effect of personalities on CT performance at the primary education level.The study examined the association between conscientiousness and CT performance.This is the first study revealing the underlying mechanism of the personality‐CT relationship.The study identified the mediating role of attitudinal beliefs in the personality‐CT relationship. The implications of study findings for practitioners: The study enriched the nomological network of CT in the primary context with essential non‐cognitive components.The study unravelled the underlying mechanism of the personality‐CT relationship, helping explain how personality traits turn into learning performance.The study indicated the importance of encouraging conscientious behaviours and nurturing positive attitudinal beliefs in CT primary education. [ABSTRACT FROM AUTHOR]

Background: In a context where synchronous online teaching has become a new trend of instruction for online education due to the COVID‐19 pandemic, it is valuable and insightful to examine what factors contribute to teachers' satisfaction with synchronous online teaching. Objective: Informed by the technology acceptance model (TAM), this study investigated English‐as‐a‐foreign‐language (EFL) university teachers' synchronous online teaching satisfaction in China from social (i.e., subjective norms), institutional (i.e., facilitating conditions), and individual (i.e., self‐efficacy, attitudes toward use, perceived usefulness, and perceived ease of use) levels during the COVID‐19 pandemic. Methods: A total of 250 in‐service EFL university teachers participated in this study. An online questionnaire was adaptively developed to measure teachers' perceptions of and satisfaction with synchronous online teaching. The structural equation modelling (i.e., path analyses) was performed to find out a model that can best represent EFL university teachers' synchronous online teaching satisfaction. Results and Conclusion: The results showed that facilitating conditions, self‐efficacy, attitudes toward use, and perceived usefulness are direct contributors to EFL university teachers' satisfaction with synchronous online teaching. Whereas, perceived ease of use, self‐efficacy, and subjective norms are indirect contributors through the mediation of attitudes toward use. Moreover, different from previous TAM research, facilitating conditions have been found to be the most significant direct factor positively contributing to satisfaction. The findings of this study are expected to shed light on how to enhance teachers' synchronous online teaching satisfaction. Lay Description: What is already known about this topic: The technology acceptance model (TAM) has been frequently adopted to examine teachers' acceptance of technology in various contexts over the last two decades.The TAM model identifies three key factors that contribute to people's intention of technology use: perceived usefulness, perceived ease of, and attitudes toward technology use.Although the TAM model has been extensively examined in various technology‐supported teaching contexts, there has been a lack of focus on livestream technology‐supported synchronous online teaching. What the paper adds: EFL university teachers' synchronous online teaching satisfaction during the COVID‐19 in China.Teachers' satisfaction with synchronous online teaching is a joint interplay of individual (i.e., self‐efficacy, attitudes toward use, perceived usefulness, and perceived ease of use), institutional (i.e., facilitating conditions), and social (i.e., subjective norms) factors.Facilitating conditions, self‐efficacy, attitudes toward use, and perceived usefulness are direct contributors, while perceived ease of use, self‐efficacy, and subjective norms are indirect contributors to teachers' synchronous online teaching satisfaction through the mediation of attitudes toward use.Different from previous TAM research, facilitating conditions have been found to be the most significant direct factor positively contributing to satisfaction. Implications for practice and/or policy: This study offers a diagnostic measure for schools and universities to understand the status quo of their teachers' perceptions of and satisfaction with synchronous online teaching.Universities are advised to provide teachers with readily accessible support and training to enhance their self‐efficacy for synchronous online teaching so that their satisfaction with synchronous online teaching can be strengthened. [ABSTRACT FROM AUTHOR]

Background: The transition from teacher‐centred towards student‐centred approaches in English language teaching, accompanied by developments in educational technology, has attracted researchers' attention to reverse teaching or flipped class. The related literature asserts that this mode of instruction might influence instructors' and students' participation in the class. Objectives: To shed more light on the role of flipped class in affecting language learning strategies and skills, this study applied a sequential explanatory mixed‐methods approach to explore the impact of flipped class on English as a foreign language (EFL) learners' writing metacognitive strategies and writing skills. Methods: Forty‐six intermediate EFL learners with an age range of 21–27, studying at a private language institute, were randomly divided into two groups of 23 learners. The two groups were randomly assigned to a flipped class, which received writing metacognitive strategies and writing skills through video clips before the class time, and a non‐flipped class, which received writing metacognitive strategies and writing skills in a conventional way during the class time. Results and Conclusions: The results revealed that both flipped and non‐flipped classes improved the EFL learners' writing metacognitive strategies, writing performance, writing content, and writing organisation. Furthermore, one‐way ANCOVA analyses indicated that the flipped class outperformed the non‐flipped class in writing metacognitive strategies, writing performance, writing content, and writing organisation. Thematic analyses, which were used to help analyse individual semi‐structured interviews, uncovered a number of categories and themes, signifying the flipped learners' positive perceptions towards the flipped class, such as enhancing motivation, self‐confidence, and writing collaboration. Implications: Pedagogical implications were discussed for flipping writing metacognitive strategies and writing skills. Lay Description: What is already known about this topic?: Metacognitive strategies, including planning, monitoring, and evaluation strategies, help English language learners become more successful writers.Writing skills, including writing content, writing organisation, and language use, help learners deal with collaborative writing activities effectively.Flipped class has been shown to be an effective mode of instruction to improve English language learners' language learning strategies and skills. What this paper adds?: Flipped class improves English language learners' writing metacognitive strategies, writing performance, writing content, and writing organisation.Flipped class is more effective than non‐flipped class in improving English language learners' writing metacognitive strategies and writing skills.English language learners' motivation, self‐confidence, and writing collaboration are increased as a result of the flipped writing course. Pedagogical implications: Writing metacognitive strategies and writing skills need to be flipped in English language contexts in order to free up time for more effective in‐class collaborative writing activities. [ABSTRACT FROM AUTHOR]

Background: Providing students with worked out problem solutions is a beneficial instructional technique in STEM disciplines, and studying examples that have been worked out incorrectly may be especially helpful for reducing misconceptions in students with low prior content knowledge. However, past results are inconclusive and the effects of incorrect worked examples alone or in combination with correct examples remains unclear. Objectives: We aim to address whether studying incorrect examples alone or in combination with correct examples can support the reduction of students' fraction misconceptions, operationalized as errors made with high confidence. Methods: After incorrectly solving a sampling problem, 130 students in 4th through 11th grade in the U.S. were randomly assigned to a condition in an online problem set focused on fraction equivalence. Students studied either single‐type worked examples (i.e., correct or incorrect; n = 49) or combination‐type worked examples (correct and incorrect; n = 41) or engaged in a problem‐solving control (n = 50). Results: Studying a combination of correct and incorrect worked examples was as effective as the problem‐solving control with feedback at improving fraction equivalence knowledge and reducing the rate of high‐confidence errors. Students in both the combination condition and the problem‐solving with feedback condition outperformed those who studied either correct or incorrect worked examples alone. Conclusions: Results support the inclusion of a combination of correct and incorrect worked examples when teaching students with low prior content knowledge. Studying a combination of example types within an online tutor helps to reduce misconceptions about fractions, a topic students commonly struggle with. A problem‐solving task with corrective feedback worked equally well. Lay Description: What is already known about this topic: Studying worked examples of mathematical solutions improves student learning.Incorrect examples, either alone or in combination with correct examples, are particularly effective for improving learning for students with low prior knowledge in the target content.Comparing correct and incorrect examples is also effective at improving problem‐solving but this effect may be specific to those with high prior knowledge.Still unknown are the impacts of these different combinations of examples on misconceptions in particular. What this paper adds: We show that studying a combination of correct and incorrect examples reduces math misconceptions.Problem‐solving with corrective feedback within an online tutor also has this effect. Implications for practice and/or policy: Using a combination of example types will help reduce students' misconceptions about fractions. [ABSTRACT FROM AUTHOR]

Background: Explorative online information search activities are self‐regulated learning processes that require monitoring in the form of accurate metacognitive judgments about one's own knowledge. People have to judge what they know, but also understand what they do not know. Previous research has explored those two aspects in relation to each other mostly by employing measures of metacognitive calibration and points toward a potential detrimental effect of using the internet to answer knowledge test items. Objectives: This research aimed to disentangle those two aspects of knowledge and to describe a false certainty effect (FaCE), indicating an increase in confidence in the correctness of incorrect responses in a knowledge test after online information search. We also aimed to further explore the conditions under which this effect occurs. Methods: In two studies participants' knowledge and on‐item confidence ratings were measured before and after a short online information search activity. In Study 1, we analyzed data of two samples with and without knowledge gain. In Study 2, we manipulated the familiarity of knowledge test items and whether there was an information search activity. Results: Study 1 showed that false certainty occurred even when a search activity did not lead to any learning success. This FaCE, however, was stronger when there was actual knowledge gain. In Study 2, we found that the effect was caused by the information search activity itself and not by the pre‐post methodology of identical knowledge‐test items. Implications: Our results demonstrate the emergence of increased confidence in the correctness of incorrect responses in knowledge tests after online information search activities. Educators and researchers should be aware of this undesired false certainty effect of computer‐assisted learning on individuals' knowledge monitoring. Lay Description: What is already known about this topic: Online information search in order to learn about a knowledge topic is a frequent activity in everyday life and different educational contexts.Individuals engaging in online search need to regulate their learning behaviour, which can be challenging.Monitoring what is known and (not yet) known is an important aspect of those regulatory processes. What this paper adds: Online information search activities with or without knowledge gain result in increased certainty in one's knowledge.Such activities also increase false certainty in what is not known as measured by confidence in the correctness of false answers to knowledge test items.This increase in false certainty can be observed for different knowledge topics and varying information search contexts. Implications for practice and/or policy: Our results highlight the need for educators to think about efforts to reduce the false certainty effect in online information search. [ABSTRACT FROM AUTHOR]

Background: The sudden growth in online instruction due to COVID‐19 restrictions has given renewed urgency to questions about remote learning that have remained unresolved. Web‐based assessment software provides instructors an array of options for varying testing parameters, but the pedagogical impacts of some of these variations has yet to be examined. Objectives: The current study examines whether question order affects student performance on online college math assessments. Drawing on the literature of testing and math anxiety, we hypothesized that difficult questions near the beginning of an assessment would have a destructive effect on student confidence, which would in turn have a deleterious effect on their performance. Methods: We employed an observational 'big data' methodology, analysing 23,468 final exams completed by students in 10 different courses over eight semesters at a Math Emporium in a large technical university in the eastern United States. Students were freshmen and sophomores enrolled in non‐engineering math courses. We regressed the final score on the difficulty level of the first and second questions, controlling for several other factors. Results and Conclusions: We found that several factors—day of the week, amount of time before the deadline, number of minutes spent on the exam—have more of an impact on score than question order. This pattern was consistent across sexes. Takeaways: Our findings contradict some previous studies, which have found that difficult early questions degrade student performance, and that this affect is more pronounced in females. This work enriches our understanding of how students respond to online assessment. Lay Description: What is already known about this topic: Previous studies have had mixed results about the effect of question difficulty ordering on student performance.Furthermore, few studies have examined this issue for computer assessments. What this paper adds: We employ a novel methodology with a uniquely large data set.Our findings indicate that difficulty ordering has no effect on student performance. Implications for practice: Math instructors can use the random ordering feature of computer assessment generating tools because question order does not affect performance. [ABSTRACT FROM AUTHOR]

Background: The feedback offered to students in audience response systems may enhance conformity bias, while asking closed‐type questions alone does not allow students to externalize and elaborate on their knowledge. Objectives: The study explores how writing short justifications and accessing peer justifications as collective feedback could affect students' performance, confidence and opinions in multiple‐choice audience response systems that apply the Peer Instruction model of voting/revoting. Methods: For 8 weeks, 98 students, enrolled in an undergraduate course, attended each lecture following a flipped classroom approach. At the beginning of each lecture, students participated in a quiz with eight multiple‐choice questions. Four of these questions included a justification form in which students could elaborate on their answers. The students were randomly grouped into two conditions according to the collective feedback they received: the Shared group (n = 54) could see both the percentage each question choice received from the class and the respective peer justifications, while the Unshared group (n = 44) could only see the percentage information. Results: Analysis showed that students in both groups performed significantly better in questions with the justification form being available. Also, the two groups were comparable in terms of performance and self‐reported level of confidence suggesting no main effect for making peer justification available. Despite this, students in the Shared group expressed a significantly more positive opinion in the end‐of‐activity questionnaire in terms of perceived learning gains and the helpfulness of writing justifications for their answers. Take Away: Writing short justifications can have a positive impact on students' academic performance. Lay Description: What is currently known about the subject matter: Audience response systems (ARS) typically include closed‐type items.Therefore, students do not have the opportunity to elaborate on their answers.Externalizing and elaborating on one's answer could enhance understanding. What their paper adds to this: Integration of short justifications alongside multiple‐choice questions.System feedback includes percentage, confidence and peer justifications.Analysis on how writing/reading justifications affect performance in ARS. Implications of study findings for practitioners: Writing short justifications enhances student performance.Being able to read peer justifications does not affect student performance.Being able to read peer justifications increases activity acceptance. [ABSTRACT FROM AUTHOR]

While the educational disruption caused by the Covid‐19 pandemic underscores the importance of blended learning in higher education, research on the effectiveness of blended learning is still inconclusive. Drawing from the motivational design model of the ARCS (i.e., attention, relevance, confidence, and satisfaction), this study attempts to fill the gap to evaluate effectiveness of blended learning from a multi‐dimensional perspective. Participants were randomly assigned into three experimental groups (i.e., face‐to‐face, pure online, and blended). A questionnaire survey was administered in each group after the trial courses. The data was analysed by using the one‐way ANOVA with post hoc tests. The results showed that blended learning outperformed pure online learning in enhancing students' attention, confidence, and satisfaction perceptions. Additionally, blended learning had a higher level of satisfaction perception than face‐to‐face learning. Follow‐up interviews were also conducted to provide an in‐depth understanding of how blended learning motivated students during the learning process. Considering that blended learning may become a new normal in higher education after the Covid‐19 pandemic, the findings of the present study provide evidences to support the effectiveness of the blended learning approach in addressing students' motivational needs. Lay Description: What is already known about this topic?: Blended learning, also called as hybrid learning, is a learning approach that combines face‐to‐face learning with online learning;It is able to integrate benefits afforded by both traditional face‐to‐face learning and pure online learning to deliver course content;However, the findings concerned with the effectiveness of blended learning are mixed;The measurements of learning effectiveness in previous studies are often based on single variables (e.g., test score or students' satisfaction), but neglect the multi‐dimensional nature of learning effectiveness. What this paper adds?: Based on motivational design model of the ARCS (i.e., attention, relevance, confidence, and satisfaction), the present study compared the effectiveness of blended learning with other learning approaches (e.g., pure online learning and face‐to‐face learning) through a randomized experiment;It was identified that blended learning outperformed pure online learning in enhancing students' perceptions of attention, confidence, and satisfaction;Blended learning also had a higher level of satisfaction perception compared to face‐to‐face learning;Last but not least, evaluating learning effectiveness from an integrated lens of objective assessment based on test scores and subjective assessment based on the multi‐motivational perspectives is an important first step to understanding the effectiveness of blended learning to support learning in higher education in the future. Implications for practice and/or policy: As blended learning outperforms pure online in several motivational appeals, it is recommended that universities should consider conducting blended learning as far as possible rather than pure online learning;Learning strategies can be applied to trigger students' curiosity and keep them engaged continuously in the learning process, such as utilizing a variety of online quality resources, and interacting with students from other universities through online communities;As the confidence of taking blended learning courses varies among different levels of students, instructors should try to provide sufficient support during the learning process especially for the online sections;Since satisfaction is identified as a critical motivator, instructors should pay more attention on how to improve students' satisfaction through the design of blended learning, such as try controlling the length of course videos and interacting with students synchronously in the online course platforms;Last but not least, since some of the tasks in blended learning need to be initiated and completed by students themselves, it is necessary for educational institutions to consider incorporating the training for self‐regulation as part of their competence based training. [ABSTRACT FROM AUTHOR]

There is a lack of studies that examine the role of a pedagogical agent on student development in a specific learning situation that involves psychological and cognitive preparatory activities in high school settings. We examined the effectiveness of pedagogical agent (APT) cognitive and affective feedback on learner motivation and well‐being. We applied an experimental research design, involving 45 fourth‐year high school students, divided in experimental and control groups (APT vs. human tutor). We performed a quantitative analysis to collect and analyse data of students using our APT. APT cognitive feedback had a positive effect on students' motivation for learning by encouraging students' proposals and initiatives and arousing students' interest in the topic. In addition, APT affective feedback fostered an appropriate emotional climate and creative environment for learning by enhancing students' curiosity, creativity and confidence for carrying out the activity, while reducing students' negative emotions such as boredom and anger. This study provided us useful insights about the affective (and cognitive) competencies that a virtual affective pedagogical agent needs to have in order to support students' mental and emotional health throughout a learning situation. Yet, further research is needed to consolidate these findings and make APT more adaptive to different learning situations. Lay Description: What is currently known about this topic: Animated pedagogical agents were extensively used to provide customized feedback.Their aim was to improve both students' emotional state and learning performance.Both the conditions and agent design issues still need to be further investigated.Learning situations may involve psychological and cognitive preparatory activities.Effects of an APT in these learning situations have not been investigated yet. What this paper adds: It analyses the role of an APT in psychological and cognitive preparatory activities.APT provides a variety of cognitive and affective feedback types.APT had a positive effect on students' motivation for learning through encouraging students' proposals and initiatives and arousing students' interest in the topic.APT fostered an appropriate emotional climate through encouraging creativity and strengthening students' confidence for carrying out the activity. Implications for practice and/or policy: APT can be a valuable support to teachers and students in complex learning tasks.Pedagogical agent designers are given useful insights for enhancing agents design.A pedagogical agent needs to be endowed with specific pedagogical competencies.Psychological and cognitive preparatory activities require APT emotional involvement. [ABSTRACT FROM AUTHOR]

This exploratory experimental study investigates the impact of motivational strategies based on the Attention, Relevance, Confidence, Satisfaction, and Volition (ARCS‐V) model on online learners' academic performance, motivation, volition, and course interest. The research was conducted over an 11‐week semester with 122 undergraduate online learners within two groups. One group received a traditional e‐course, while the other group was offered the course with extra motivational strategies derived from the ARCS‐V model. The results revealed that the group who used motivational strategies showed significantly higher gains in motivation, academic performance, and course interest scores. However, there were no significant differences between the groups regarding the volition. Furthermore, the motivation and interest variables were measured with Attention, Relevance, Confidence, and Satisfaction subscales of the ARCS‐V model. In terms of interest variable, there was only a statistically significant difference on the Attention subscale. Regarding motivation variable, the results also showed a statistically significant difference on the attention, confidence, and satisfaction subsections of the ARCS‐V model. The findings of the present study offer insights into ARCSV model‐based research by examining the effects of the model as a valid and reliable framework for online learning environments. The implications and directions for future research are then discussed. Practitioner Notes/ Lay Description: What is already known about this topic: Learning motivation is the most vital factor that influencing effective and efficient learning process.The attention, relevance, confidence, and satisfactionARCS model of motivational design has been used myriad times to design motivational instructions in a wide range of educational settings (from traditional to computer‐assisted instruction and distance education).Few studies address the online learners" motivation through the attention, relevance, confidence, satisfaction, and volition (ARCS‐V) ‐based motivational strategies. What this paper adds to this: A quasi‐experimental study was conducted in online learning environment to research the effects of the ARCS‐V ‐based motivational strategies.The impact of the ARCS‐V ‐based motivational strategies on online learners" academic performance, motivation, volition, and course interest was investigated.The results showed that the ARCS‐V ‐based motivational strategies had positive effects on online learners' regarding to academic performance, motivation, volition, and course interest. The implications of study findings for practitioners: This research provided evidences for effects of the ARCS‐V motivational strategies on online learners.Online learners who took the ARCS‐V ‐based motivational messages had positive effects regarding to academic performance, motivation, volition, and course interest. [ABSTRACT FROM AUTHOR]

When solving a mathematical problem, students who do not have sufficient conceptual understanding may perform poorly and exhibit misconceptions. This study was aimed to examine students' conceptual understanding and significant misconceptions when solving number sense‐related problems. An online three‐tier diagnostic test was administered to 125 fifth‐grade students with varied socio‐economic backgrounds in Hong Kong. Only 14.40% of the students exhibited high performance with high confidence, indicating that these students had a profound conceptual understanding of number sense. In addition, the majority of the students (66.40%) did not demonstrate number sense; these students exhibited several significant misconceptions and could solve the questions only by using a rule‐based method or guessing. Accordingly, most students performed unsatisfactorily on number sense‐related problems. This study is imperative in identifying early predictors and provides information for further compatible interventions in the teaching and learning of number sense in Hong Kong in particular and worldwide in general. Lay Description: What is already known about this topic: Students must be instilled with conceptual understanding to achieve mastery of mathematical understanding and be able to properly solve complex or novel problems.Students would likely exhibit misconceptions if they do not have sufficient conceptual understanding.Students' conceptual understanding can be examined by evaluating their confidence levels in solving a problem. What this paper adds: A three‐tier diagnostic test (question and answer, reasoning, and confidence) can be used to examine students' conceptual understanding.Students performed unsatisfactorily on number sense because they lack conceptual understanding of topics related to number sense.Students held significant misconceptions on understanding the basic meaning of numbers and operations, recognizing the number size, using multiple representations of numbers and operation, recognizing the relative effect of operations on numbers, and judging the reasonableness of a computational result. Implications for practice and/or policy: Conceptual understanding of related topics reflecting number sense should be prioritized over procedural knowledge and mathematical rules.Lack of conceptual understanding of relevant topics and relying on mathematical rules and formulas are the main root causes of students' unsatisfactory performance.The deliberate use of estimation questions, multiple presentations, and judging the reasonableness of a result can help learners develop their conceptual understanding of number sense. [ABSTRACT FROM AUTHOR]

The aim of this study is to outline the development and changes in pre‐service teachers' technological pedagogical content knowledge (TPACK) assessments during the first 3 years in teacher education. Specifically, research was conducted at three measurement points over a 3‐year teacher education period. The target group consisted of pre‐service teachers (N = 148) from three Finnish universities. Results indicate a growth in confidence related to all TPACK areas during the research period. The strongest gains were in pedagogical content knowledge. In addition, the gains were larger in other areas related to pedagogical knowledge than areas related to technology or content knowledge. In areas without pedagogical knowledge, the changes were more moderate. In the discussion section, recommendations are provided on the potential of longitudinal use of the TPACK model to study and improve the development of pre‐service teachers' TPACK. Lay Description: What is already known about this topic: There are several studies focusing on pre‐service teachers' self‐perceived technological pedagogical content knowledge (TPACK) areasThere are differences amongst pre‐service teachers based on their confidence with different TPACK areasThere is a lack of longitudinal studies focusing on changes in pre‐service teachers' TPACK profiles during teacher educationWhat this paper adds: This research provides 3 years perspective for changes in pre‐service teachers' TPACK during teacher educationConfidence for different TPACK areas evolve at different paces during teacher educationHighest gains were for TPACK areas related to pedagogyThe relation of TPACK areas change during teacher education, that is, how differently or similarly TPACK areas are assessed compared with each otherImplications for practice and/or policy: There is a need for better support for pre‐service teachers' technological content knowledge and technological knowledge in teacher educationIn future studies, it is important to outline factors affecting the changes in TPACK profilesProfiling of pre‐service teachers' TPACK is needed for targeting appropriate support. [ABSTRACT FROM AUTHOR]

The aim of the present study (n = 113) was to examine how (objective and subjective) information on peers' preparation, confidence, and past performance can support students in answering correctly in audience response systems (aka clickers). The result analysis shows that in the "challenging" questions, in which answers diverged, students who received additional information about peers' self‐reported preparation and/or confidence outperformed students who were only given the objective percentage with or without past performance feedback. In addition, students expressed a positive attitude towards the activity, commenting its usefulness in better understanding course material and identifying misconceptions. Lay Description: What is already known about this topic: Audience response systems (ARS) typically provide anonymous feedback (i.e., percentage)Information on how much a partner knows is important for peer answer evaluationSystematic research of such metacognitive information on peers in ARS is missing What this paper adds: This study explores the use of objective and subjective feedback metrics in ARSThese metrics are percentage, preparation, confidence, and past performanceIt also analyses how such metrics may impact student attitudes and performance Implications for practice and/or policy: Main effect for preparation and confidence metrics in "challenging" questionsPositive student evaluation of ARS for deeper understanding and clarifying misconceptions [ABSTRACT FROM AUTHOR]

This study was conducted to investigate the effect of web‐based teaching on paediatric nursing internship students' self‐confidence and anxiety levels in the clinical decision‐making process. The study sample consisted of 61 students who received internship training in the Pediatric Nursing department. There were 30 students in the control group and 31 students in the experimental group. Data were collected using a sociodemographic form, and nursing anxiety and self‐confidence levels were measured using a clinical decision‐making scale. The data were analysed using a t test, a Mann‐Whitney U test, a correlation analysis, and a regression analysis, along with power and effect size. The self‐confidence scores of the experimental group were higher than the scores of the control group (p < 0.05), and the anxiety scores of the experimental group were lower than the scores of the control group (p < 0.05). The web‐based training program accounted for 17.8% of the change in self‐confidence and 12.8% of the change in anxiety level. Therefore, the web‐based training program was effective in increasing nursing students' self‐confidence levels and decreasing their anxiety levels in the clinical decision‐making process. Lay Description: Problem There is a general lack of an identified theoretical framework of "Effect of Web‐Based Education on Self‐Confidence and Anxiety Levels of Pediatric Nursing Interns in Clinical Decision‐Making Process."What is already known Web‐based education are effective educational methods to improve the learning outcome through nursing intern student knowledge and practice. But there is not enough information about the effect of web‐based education on self‐confidence and anxiety levels of paediatric nursing interns in clinical decision‐making process.What this paper adds This study provides evidence for web‐based education effect the self‐confidence and anxiety levels of paediatric nursing interns in clinical decision‐making process. [ABSTRACT FROM AUTHOR]

Background: In the context of large‐scale educational assessments, the effort required to code open‐ended text responses is considerably more expensive and time‐consuming than the evaluation of multiple‐choice responses because it requires trained personnel and long manual coding sessions. Aim: Our semi‐supervised coding method eco (exploring coding assistant) dynamically supports human raters by automatically coding a subset of the responses. Method: We map normalized response texts into a semantic space and cluster response vectors based on their semantic similarity. Assuming that similar codes represent semantically similar responses, we propagate codes to responses in optimally homogeneous clusters. Cluster homogeneity is assessed by strategically querying informative responses and presenting them to a human rater. Following each manual coding, the method estimates the code distribution respecting a certainty interval and assumes a homogeneous distribution if certainty exceeds a predefined threshold. If a cluster is determined to certainly comprise homogeneous responses, all remaining responses are coded accordingly automatically. We evaluated the method in a simulation using different data sets. Results: With an average miscoding of about 3%, the method reduced the manual coding effort by an average of about 52%. Conclusion: Combining the advantages of automatic and manual coding produces considerable coding accuracy and reduces the required manual effort. Lay Description: We present a new (semi‐)automatic method for coding text responses.The method supports the human coders in their work and acts as an assistant. The exploring coding assistant eco groups all responses in a first unsupervised step and explore the clusters by continuously selecting responses for manual coding to gather supervised information.Based on the coding information, eco automatically codes similar responses and reduces the manual coding effort. [ABSTRACT FROM AUTHOR]

This study offers new insights into the ongoing debate about whether physical and virtual materials are equally effective in inquiry-based science instruction. Physical materials were predicted to have a surplus value when haptic feedback helps discern object characteristics or when the perceived credibility of experimental data can impede conceptual change. Both assumptions were tested by comparing the belief revisions and confidence ratings of children ( n = 60) engaged in an inquiry task about falling objects. Children were assigned to one of three instructional conditions that differed with regard to the type of materials and the possibility to manipulate those materials. Main findings confirmed the alleged benefits of physical manipulation in correcting misconceptions about object characteristics that are perceived by touch. Belief revision about visually discernible characteristics proved independent of the type of material and type of manipulation, as was children's confidence in their post-instructional beliefs. Together, these findings indicate that tactile cues derived from physical manipulation can have a unique contribution to children's science learning. [ABSTRACT FROM AUTHOR]