Munshi, Anabil, Biswas, Gautam, Baker, Ryan, Ocumpaugh, Jaclyn, Hutt, Stephen, and Paquette, Luc
Background: Providing adaptive scaffolds to help learners develop effective self‐regulated learning (SRL) behaviours has been an important goal for intelligent learning environments. Adaptive scaffolding is especially important in open‐ended learning environments (OELE), where novice learners often face difficulties in completing their learning tasks. Objectives: This paper presents a systematic framework for adaptive scaffolding in Betty's Brain, a learning‐by‐teaching OELE for middle school science, where students construct a causal model to teach a virtual agent, generically named Betty. We evaluate the adaptive scaffolding framework and discuss its implications on the development of more effective scaffolds for SRL in OELEs. Methods: We detect key cognitive/metacognitive inflection points, that is, moments where students' behaviours and performance change during learning, often suggesting an inability to apply effective learning strategies. At inflection points, Mr. Davis (a mentor agent in Betty's Brain) or Betty (the teachable agent) provides context‐specific conversational feedback, focusing on strategies to help the student become a more productive learner, or encouragement to support positive emotions. We conduct a classroom study with 98 middle schoolers to analyse the impact of adaptive scaffolds on students' learning behaviours and performance. We analyse how students with differential pre‐to‐post learning outcomes receive and use the scaffolds to support their subsequent learning process in Betty's Brain. Results and Conclusions: Adaptive scaffolding produced mixed results, with some scaffolds (viz., strategic hints that supported debugging and assessment of causal models) being generally more useful to students than others (viz., encouragement prompts). Additionally, there were differences in how students with high versus low learning outcomes responded to some hints, as suggested by the differences in their learning behaviours and performance in the intervals after scaffolding. Overall, our findings suggest how adaptive scaffolding in OELEs like Betty's Brain can be further improved to better support SRL behaviours and narrow the learning outcomes gap between high and low performing students. Implications: This paper contributes to our understanding and impact of adaptive scaffolding in OELEs. The results of our study indicate that successful scaffolding has to combine context‐sensitive inflection points with conversational feedback that is tailored to the students' current proficiency levels and needs. Also, our conceptual framework can be used to design adaptive scaffolds that help students develop and apply SRL behaviours in other computer‐based learning environments. Lay Description: What is already known about this topic: SRL, which involves the regulation of cognitive, affective, metacognitive and motivational (CAMM) processes, is an important construct for effective learning.Novice learners in open‐ended learning environments (OELEs) often engage in sub‐optimal SRL strategies and encounter learning and problem‐solving difficulties.These students are likely to benefit from in‐the‐moment scaffolding, but designing adaptive scaffolds for SRL in OELEs is a challenging task. What this paper adds: The design and implementation of an adaptive scaffolding framework in the Betty's Brain OELE, that (a) detects key cognitive‐metacognitive inflection points during learning, and (b) provides feedback (strategic hints and encouragements) to help students overcome their learning difficulties at the inflection points and develop more effective SRL behaviors.A method to evaluate the adaptive scaffolding framework by analyzing log data collected from a classroom experiment.Findings from the data analysis that provide evidence on scaffold effectiveness and inform future design of adaptive scaffolds in OELEs. Implications of study findings for practitioners: The adaptive scaffolding framework developed in this paper can be extended to other OELEs.The findings from scaffold evaluation can be used to improve the design of the adaptive scaffolding framework in OELEs, for example, by considering affect transitions and cognitive‐affective relationships to build more effective scaffolds for affect regulation. [ABSTRACT FROM AUTHOR]