Search

Formative assessment is considered to be helpful in students' learning support and teaching design. Following Aufschnaiter's and Alonzo's framework, formative assessment practices of teachers can be subdivided into three practices: eliciting evidence, interpreting evidence and responding. Since students' conceptions are judged to be important for meaningful learning across disciplines, teachers are required to assess their students' conceptions. The focus of this article lies on the discussion of learning analytics for supporting the assessment of students' conceptions in class. The existing and potential contributions of learning analytics are discussed related to the named formative assessment framework in order to enhance the teachers' options to consider individual students' conceptions. We refer to findings from biology and computer science education on existing assessment tools and identify limitations and potentials with respect to the assessment of students' conceptions. Practitioner notesWhat is already known about this topic Students' conceptions are considered to be important for learning processes, but interpreting evidence for learning with respect to students' conceptions is challenging for teachers.Assessment tools have been developed in different educational domains for teaching practice.Techniques from artificial intelligence and machine learning have been applied for automated assessment of specific aspects of learning.What does the paper add Findings on existing assessment tools from two educational domains are summarised and limitations with respect to assessment of students' conceptions are identified.Relevent data that needs to be analysed for insights into students' conceptions is identified from an educational perspective.Potential contributions of learning analytics to support the challenging task to elicit students' conceptions are discussed.Implications for practice and/or policy Learning analytics can enhance the eliciting of students' conceptions.Based on the analysis of existing works, further exploration and developments of analysis techniques for unstructured text and multimodal data are desirable to support the eliciting of students' conceptions. [ABSTRACT FROM AUTHOR]

Technologies and teaching practices can provide a rich log data, which enables learning analytics (LA) to bring new insights into the learning process for ultimately enhancing student success. This type of data has been used to discover student online learning patterns, relationships between online learning behaviors and assessment performance. Previous studies have provided empirical evidence that not all log variables were significantly associated with student academic achievement and the relationships varied across courses. Therefore, this study employs a systematic review with meta‐analysis method to provide a comprehensive review of the log variables that have an impact on student academic achievement. We searched six databases and reviewed 88 relevant empirical studies published from 2010 to 2021 for an in‐depth analysis. The results show different types of log variables and the learning contexts investigated in the reviewed studies. We also included four moderating factors to do moderator analyses. A further significance test was performed to test the difference of effect size among different types of log variables. Limitations and future research expectations are provided subsequently. Practitioner notesWhat is already known about this topic Significant relationship between active engagement in online courses and academic achievement was identified in a number of previous studies.Researchers have reviewed the literature to examine different aspects of applying LA to gain insights for monitoring student learning in digital environments (eg, data sources, data analysis techniques).What this paper adds Presents a new perspective of the log variables, which provides a reliable quantitative conclusion of log variables in predicting student academic achievement.Conducted subgroup analysis, examined four potential moderating variables and identified their moderating effect on several log variables such as regularity of study interval, number of online sessions, time‐on‐task, starting late and late submission.Compared the effect of generic and course‐specific, basic and elaborated log variables, and found significant difference between the basic and elaborated.Implications for practice and/or policy A depth of understanding of these log variables may enable researchers to build robust prediction models.It can guide the instructors to timely adjust teaching strategies according to their online learning behaviors. [ABSTRACT FROM AUTHOR]

As universities around the world have begun to use learning management systems (LMSs), more learning data have become available to gain deeper insights into students' learning processes and make data‐driven decisions to improve student learning. With the availability of rich data extracted from the LMS, researchers have turned much of their attention to learning analytics (LA) applications using educational data mining techniques. Numerous LA models have been proposed to predict student achievement in university courses. To design predictive LA models, researchers often follow a data‐driven approach that prioritizes prediction accuracy while sacrificing theoretical links to learning theory and its pedagogical implications. In this study, we argue that instead of complex variables (e.g., event logs, clickstream data, timestamps of learning activities), data extracted from online formative assessments should be the starting point for building predictive LA models. Using the LMS data from multiple offerings of an asynchronous undergraduate course, we analysed the utility of online formative assessments in predicting students' final course performance. Our findings showed that the features extracted from online formative assessments (e.g., completion, timestamps and scores) served as strong and significant predictors of students' final course performance. Scores from online formative assessments were consistently the strongest predictor of student performance across the three sections of the course. The number of clicks in the LMS and the time difference between first access and due dates of formative assessments were also significant predictors. Overall, our findings emphasize the need for online formative assessments to build predictive LA models informed by theory and learning design. Practitioner notesWhat is already known about this topic Higher education institutions often use learning analytics for the early identification of low‐performing students or students at risk of dropping out.Most predictive models in learning analytics rely on immutable student characteristics (e.g., gender, race and socioeconomic status) and complex variables extracted from log data within a learning management system.Prioritizing prediction accuracy without theory orientation often yields "black‐box" models that fail to inform educators on what remedies need to be taken to improve student learning.What this paper adds Predictive models in learning analytics should consider learning theory, pedagogy and learning design to identify key predictors of student learning.Online formative assessments can be a starting point for building predictive models that are not only accurate but also provide educators with actionable insights on how student learning can be improved.Time‐related and score‐related features extracted from online formative assessments are particularly useful for predicting students' course performance.Implications for practice and/or policy This study provides strong evidence for using online formative assessments as the foundation for predictive models in learning analytics.Student data from online formative assessments can help educators provide students with feedback while informing future formative assessment cycles.Higher education institutions should avoid the hype around complex data from learning management systems and instead rely on effective learning tools such as online formative assessments to revolutionize the use of learning analytics. [ABSTRACT FROM AUTHOR]

The advancement of technologies has promoted the increasing popularity and integration of mobile technologies in science education in the past decade. These trends have led to an increased interest among scholars to understand the effects of mobile technologies in science education and whether those effects differ depending on how mobile technologies are used in learning and teaching (eg, student‐led, teacher‐led, collaborative). In this study, we performed a meta‐analysis of 34 studies that directly examined the effects of users' pedagogical role on K‐16 students' achievement in science when engaging in mobile learning (ML). The analysis of the 34 studies yielded an overall significant main effect of ML on K‐16 science learning outcomes. We applied the mixed‐effects model with moderator variables and found that users' pedagogical role significantly moderated the ML effects as a whole. Collaborative and student‐led uses had a statistically significant impact on student science learning, whereas teacher‐led use did not. Findings from this meta‐analysis are consistent with prior research, providing synthesized research‐based evidence of the effects of ML on science learning that holds implications for both mobile curriculum design and mobile technology use. Practitioner notesWhat is already known about this topicMobile technology has been increasingly adopted in science learning with great potential to support learning and teaching.Prior meta‐analysis has suggested multiple moderators in measuring the mobile learning effect.Prior empirical studies examined the effect of mobile users' pedagogical role in the specific subject domains (eg, physics) and grade levels (eg, high school).What this paper addsThis meta‐analysis is among the first to examine the moderator effect of mobile users' pedagogical roles on ML in K‐16 science education.This study found that mobile technology use is associated with significant science learning outcomes across 34 studies.This study found that the effect of mobile learning was moderated by mobile users' pedagogical roles (ie, who initiated the use). Collaborative use between teachers and students tends to be the most effective. Teacher‐led use tends to be the least effective.Implications for practiceThis study suggests that we should consider who leads the use of mobile technology when integrating mobile learning in science education.In particular, educators should encourage collaborative and student‐led mobile use for learning and instruction. [ABSTRACT FROM AUTHOR]

Situational engagement plays a critical role in promoting students' academic performance. In a smart classroom environment, this study collected longitudinal real‐time data for 105 college students at a university in central China to investigate the relationship among situational engagement, personal characteristics and learning environment perceptions. Hierarchical linear modelling showed that environmental perception and students' personal factors have different effects on situational engagement. Specifically, (1) social support perceptions, autonomous motivation and controlled motivation have a significant impact on behavioural engagement; (2) perceptions of social and media support, autonomous motivation and controlled motivation have a significant impact on shallow cognitive engagement; and (3) perceptions of teacher and social support, self‐efficacy and autonomous motivation significantly predict deep cognitive and emotional engagement. This study suggests that the effect of the perception regarding advanced technology‐supported learning environments on students' situational engagement is limited, and instructors should pay more attention to improving students' perceptions of teacher and social support, self‐efficacy and autonomous motivation to promote students' situational deep cognitive engagement in smart classrooms. Practitioner notesWhat is already known about this topic Compared with overall engagement, situational engagement fluctuates and changes with time and context.Situational engagement is a product of environmental and personal factors.Few studies have focused on the nature of situational engagement and how environmental and personal factors influence situational engagement in smart classrooms.What the paper adds This study contributes to the existing literature by investigating the critical factors that predict situational engagement, using the experience sampling method in a smart classroom at a Chinese university.Environmental perception, self‐efficacy and students' motivation factors have different effects on situational engagement in a smart classroom.Perceptions of teacher and social support, self‐efficacy and autonomous motivation significantly predict deep cognitive and emotional engagement, while perceptions of media support only have a significant impact on shallow cognitive engagement.Personal factors (controlled and autonomous motivation) moderate the relationship between environmental perception factors and situational engagement.Implications for practice and/or policy Rather than only providing external technology‐rich conditions, instructors should focus more on improving students' perceptions of teacher and social support, self‐efficacy and autonomous motivation in the smart classroom environment.Instructors should promote students' perception of teacher support and their autonomous motivation to enhance their deep cognitive engagement. [ABSTRACT FROM AUTHOR]