Search

Self‐regulated learning (SRL) is an essential skill to achieve one's learning goals. This is particularly true for online learning environments (OLEs) where the support system is often limited compared to a traditional classroom setting. Likewise, existing research has found that learners often struggle to adapt their behaviour to the self‐regulatory demands of OLEs. Even so, existing SRL analysis tools have limited utility for real‐time or individualised support of a learner's SRL strategy during a study session. Accordingly, we explore a reinforcement learning based approach to learning optimal SRL strategies for a specific learning task. Specifically, we utilise the sequences of SRL processes acted by 44 participants, and their assessment scores for a prescribed learning task, in a purpose‐built OLE to develop a long short‐term memory (LSTM) network based reward function. This is used to train a reinforcement learning agent to find the optimal sequence of SRL processes for the learning task. Our findings indicate that the developed agents were able to effectively select SRL processes so as to maximise a prescribed learning goal as measured by predicted assessment score and predicted knowledge gains. The contributions of this work will facilitate the development of a tool which can detect sub‐optimal SRL strategy in real‐time and enable individualised SRL focused scaffolding. Practitioner notesWhat is already known about this topic Learners often fail to adequately adapt their behavior to the self‐regulatory demands of e‐Learning environments.In order to promote effective Self‐regulated learning (SRL) capabilities, researchers and educators need tools that are able to analyze and diagnose a learner's SRL strategy use.Current methods for SRL analysis are more often descriptive as opposed to prescriptive and have limited utility for real‐time analysis or support of a learner's SRL behavior.What this paper adds This paper proposes the use of Reinforcement Learning for prescriptive analytics of SRL. We train a Reinforcement Learning agent on sequences of SRL processes acted by learners in order to learn the optimal SRL strategy for a given learning task.Implications for practice and/or policy Our work will facilitate the development of a tool which can detect sub‐optimal SRL strategy in real‐time and enable individualized SRL focused scaffolding.The implications of our work can aid in course design by predicting the self‐regulatory load imposed by a given task.The ability to model SRL strategies using Reinforcement Learning can be extended to simulate or test SRL theories. [ABSTRACT FROM AUTHOR]

Scaffolds that support self‐regulated learning (SRL) have been found to improve learning outcomes. The effects of scaffolds can differ depending on how learners use them and how specific scaffolds might influence learning processes differently. Personalized scaffolds have been proposed to be more beneficial for learning due to their adaptivity to learning progress and individualized content to learning needs. The present study investigated finer‐grained effects of how personalized scaffolds driven by a rule‐based artificial intelligence system influenced SRL processes, especially how students learned with them. Using a pre‐post experimental design, we investigated personalized scaffolds based on university students' real‐time learning processes in a technologically enhanced learning environment. Students in the experimental group (n = 30) received personalized scaffolds, while the control group (n = 29) learned without scaffolds. All students completed a 45‐minute learning task with trace data recorded. Findings indicated scaffold effects on students' subsequent learning behaviour. Additionally, only scaffold interaction correlated to essay performance and suggests that the increase in frequencies of SRL activities alone does not contribute directly to learning outcomes. As guidelines for real‐time SRL support are lacking, this study provides valuable insights to enhance SRL support with adaptive learning technologies. Practitioner notesWhat is already known about this topic Self‐regulated learning scaffolds, especially adaptive scaffolds, improve learning.Personalized scaffolds have effects on self‐regulated learning activities.Past research focused on aggregated effects of scaffolds.What this paper adds Investigates how students learn with personalized scaffolds in terms of frequencies of learning activities and scaffold interaction.Takes a closer look at which learning activities and when the effects of personalized scaffolds occur.Examines how finer‐grained effects of personalized scaffolds correspond to learning outcomes.Implications for practice and/or policy Personalized scaffold effects vary across learning, and future research should consider finer‐grained investigations of SRL support in order to better understand their influence on learning.The number of personalized scaffolds provided should be reconsidered in the future as students only use some of the support provided, especially when task demands increase.Personalized scaffold interaction is linked to improvement in task performance, so future research should also focus on students' appropriate use of self‐regulated learning support. [ABSTRACT FROM AUTHOR]

Self-regulated learning (SRL) is the ability to regulate cognitive, metacognitive, motivational, and emotional states while learning and is posited to be a strong predictor of academic success. It is therefore important to provide learners with effective instructions to promote more meaningful and effective SRL processes. One way to implement SRL instructions is through providing real-time SRL scaffolding while learners engage with a task. However, previous studies have tended to focus on fixed scaffolding rather than adaptive scaffolding that is tailored to student actions. Studies that have investigated adaptive scaffolding have not adequately distinguished between the effects of adaptive and fixed scaffolding compared to a control condition. Moreover, previous studies have tended to investigate the effects of scaffolding at the task level rather than shorter time segments--obscuring the impact of individual scaffolds on SRL processes. To address these gaps, we (a) collected trace data about student activities while working on a multi-source writing task and (b) analyzed these data using a cutting-edge learning analytic technique--ordered network analysis (ONA)--to model, visualize, and explain how learners' SRL processes changed in relation to the scaffolds. At the task level, our results suggest that learners who received adaptive scaffolding have significantly different patterns of SRL processes compared to the fixed scaffolding and control conditions. While not significantly different, our results at the task segment level suggest that adaptive scaffolding is associated with earlier engagement in SRL processes. At both the task level and task segment level, those who received adaptive scaffolding, compared to the other conditions, exhibited more task-guided learning processes such as referring to task instructions and rubrics in relation to their reading and writing. This study not only deepens our understanding of the effects of scaffolding at different levels of analysis but also demonstrates the use of a contemporary learning analytic technique for evaluating the effects of different kinds of scaffolding on learner's SRL processes. [ABSTRACT FROM AUTHOR]

Background: Many learners struggle to productively self‐regulate their learning. To support the learners' self‐regulated learning (SRL) and boost their achievement, it is essential to understand the cognitive and metacognitive processes that underlie SRL. To measure these processes, contemporary SRL researchers have largely utilized think aloud or trace data, however, not without challenges. Objectives: In this paper, we present the findings of a study that investigated how concurrent analysis and integration of think aloud and trace data could advance the measurement of SRL and assist in better understanding the mechanisms of SRL processes, especially those details that remain obscured by observing each data channel individually. Methods: We concurrently collected think aloud and trace data generated by 44 university students in a laboratory setting and analysed those data relative to the same timeline. Results: We found that the two data channels could be interchangeably used to measure SRL processes for only 17.18% of all the time segments identified in a learning task. Moreover, SRL processes for around 45% of all the time segments could be detected via either trace data or think aloud data. For another 27.17% of all the time segments, different SRL processes were detected in both data channels. Conclusions: Our results largely suggest that the two data collection methods can be used to complement each other in measuring SRL. In particular, we found that think aloud and trace data could provide different perspectives on SRL. The integration of the two methods further allowed us to reveal a more complex and more comprehensive temporal associations among SRL processes compared to using a single data collection method. In future research, the integrated measurement of SRL can be used to improve the detection of SRL processes and provide a fuller picture of SRL. Lay Description: What is already known about this topic: To support the learners' self‐regulated learning (SRL) and boost their achievement, it is essential to understand the cognitive and metacognitive processes that underlie SRL.To measure SRL processes, contemporary researchers have largely utilized think aloud or trace data, however, not without challenges.Think aloud and trace data should complement each other and, when analysed concurrently, can provide a more valid and fuller picture of SRL than when analysed separately, which is typically the case in the SRL research to date. What this paper adds: We proposed a novel alignment approach to triangulate the measurement of self‐regulated learning (SRL) based on trace and think aloud data.We defined integration rules to integrate the measurement results from trace data and think aloud, which helped to provide a fuller picture of SRL.The integrated results revealed a more complex, complete and comprehensive SRL process map compared to using a single method. Implications for practice and/or policy: First, our results suggest that using a single measurement method can often reveal SRL processes only partially.Second, our findings indicated that the integration of the two measurement methods could not address all their methodological shortcomings and more research is needed towards new integrative approaches that can further reduce the number of misaligned results.In future research, the integrated measurement of SRL can be used to improve the detection of SRL processes and provide a fuller picture of SRL.More specifically, the integrated measurement of SRL can be used in the future to better (1) test the effects of instructional SRL interventions, for example, scaffolding; and (2) evaluate how learners use specific learning tools. [ABSTRACT FROM AUTHOR]

Self-Regulated Learning (SRL) is related to increased learning performance. Scaffolding learners in their SRL activities in a computer-based learning environment can help to improve learning outcomes, because students do not always regulate their learning spontaneously. Based on theoretical assumptions, scaffolds should be continuously adaptive and personalized to students' ongoing learning progress in order to promote SRL. The present study aimed to investigate the effects of analytics-based personalized scaffolds, facilitated by a rule-based artificial intelligence (AI) system, on students' learning process and outcomes by real-time measurement and support of SRL using trace data. Using a pre-post experimental design, students received personalized scaffolds (n = 36), generalized scaffolds (n = 32), or no scaffolds (n = 30) during learning. Findings indicated that personalized scaffolds induced more SRL activities, but no effects were found on learning outcomes. Process models indicated large similarities in the temporal structure of learning activities between groups which may explain why no group differences in learning performance were observed. In conclusion, analytics-based personalized scaffolds informed by students' real-time SRL measured and supported with AI are a first step towards adaptive SRL supports incorporating artificial intelligence that has to be further developed in future research. • Analytics-based scaffolds using trace data can support learning in real-time. • Personalized scaffolds induce metacognitive activities. • Personalized scaffolds most effective in promoting monitoring activities. • Students seldom plan and evaluate their learning and need more focused support. • Process models reveal possible explanation of missing effects on learning outcome. [ABSTRACT FROM AUTHOR]