Search

Contains fulltext : 298865.pdf (Publisher’s version ) (Open Access), Background: Providing feedback in massive open online courses (MOOCs) is challenging due to the massiveness and heterogeneity of learners' population. Learning analytics (LA) solutions aim at scaling up feedback interventions and supporting instructors in this endeavour. Paper Objectives: This paper focuses on instructor-led feedback mediated by LA tools in MOOCs. Our goal is to answer how, to what extent data-driven feedback is provided to learners, and what its impact is. Methods We conducted a systematic literature review on the state-of-the-art LA-informed instructor-led feedback in MOOCs. From a pool of 227 publications, we selected 38 articles that address the topic of LA-informed feedback in MOOCs mediated by instructors. We applied etic content analysis to the collected data. Results and Conclusions: The results revealed a lack of empirical studies exploring LA to deliver feedback, and limited attention on pedagogy to inform feedback practices. Our findings suggest the need for systematization and evaluation of feedback. Additionally, there is a need for conceptual tools to guide instructors' in the design of LA-based feedback. Takeaways: We point out the need for systematization and evaluation of feedback. We envision that this research can support the design of LA-based feedback, thus contributing to bridge the gap between pedagogy and data-driven practice in MOOCs., 22 p.

The effectiveness of using learning analytics for learning design primarily depends upon two concepts: grounding and alignment. This is the primary conjecture for the study described in this paper. In our design-based research study, we design, test, and evaluate teacher-facing learning analytics for an online inquiry science unit on global climate change. We design our learning analytics in accordance with a socioconstructivism-based pedagogical framework, called Knowledge Integration, and the principles of learning analytics Implementation Design. Our methodology for the design process draws upon the principle of the Orchestrating for Learning Analytics framework to engage stakeholders (i.e. teachers, researchers, and developers). The resulting learning analytics were aligned to unit activities that engaged students in key aspects of the knowledge integration process. They provided teachers with actionable insight into their students' understanding at critical junctures in the learning process. We demonstrate the efficacy of the learning analytics in supporting the optimization of the unit's learning design. We conclude by synthesizing the principles that guided our design process into a framework for developing and evaluating learning analytics for learning design.

© 2019 Australasian Journal of Educational Technology. Despite the recent surge of interest in learning analytics (LA), their adoption in everyday classroom practice is still slow. Knowledge gaps and lack of inter-stakeholder communication (particularly with educational practitioners) have been posited as critical factors for previous LA adoption failures. Yet, what issues should researchers, practitioners and other actors communicate about, when considering the adoption of an LA innovation in a particular context? We reviewed and synthesised existing literature on four focus areas related to LA, their adoption, implications for practice, and more general factors that have emerged as crucial when studying everyday classroom adoption of technologies (i.e., classroom orchestration). This synthesis resulted in two conversational frameworks and an inter-stakeholder communication tool. These can be used to guide and support conversations and decision-making about the adoption of LA innovations. We illustrate their usefulness with examples of use in ongoing LA adoption processes in Australia, Spain and Estonia.

© 2017 Elsevier Ltd Across a broad range of design professions, there has been extensive research on design practices and considerable progress in creating new computer-based systems that support design work. Our research is focused on educational/instructional design for students’ learning. In this sub-field, progress has been more limited. In particular, neither research nor systems development have paid much attention to the fact that design is becoming a more collaborative endeavor. This paper reports the latest research outcomes from R&D in the Educational Design Studio (EDS), a facility developed iteratively over four years to support and understand collaborative, real-time, co-present design work. The EDS serves to (i) enhance our scientific understanding of design processes and design cognition and (ii) provide insights into how designers’ work can be improved through appropriate technological support. In the study presented here, we introduced a complex, multi-user, digital design tool into the existing ecology of tools and resources available in the EDS. We analysed the activity of four pairs of ‘teacher-designers’ during a design task. We identified different behaviors - in reconfiguring the task, the working methods and toolset usage. Our data provide new insights about the affordances of different digital and analogue design surfaces used in the Studio.

This paper presents our proposed methods developed to contribute to our understanding of a complex and heterogeneous activity: face-to-face collaborative design and learning. We build on principles of multimodal learning analytics and synthesis research to explore different dimensions of collaboration including the analysis of discourse, tools usage, inscriptions, gestures, physical mobility, focus of attention, decision making, design processes, conversational turns, positioning and other social interactions. We propose that to understand what occurs in a heterogeneous and complex collaboration situation we should see it as a whole: A complex and physically, socially and epistemically situated activity.

Ubiquitous and pervasive computing devices, such as interactive tabletops, whiteboards, tablets and phones, have the potential to enhance the management and awareness of learning activities in important ways. They provide students with natural ways to interact with collaborators, and can help teachers create and manage learning tasks that can be carried out both in the classroom and at a distance. But how can these emerging technologies be successfully integrated into current teaching practice? This paper proposes an approach to integrate, from the technological perspective, collaborative learning activities using these kinds of devices. Our approach is based on the concept of orchestration, which tackles the critical task for teachers to coordinate student's learning activities within the constraints of authentic educational settings. Our studies within authentic learning settings enabled us to identify three main elements that are important for ubiquitous and pervasive learning settings. These are i) regulation mechanisms, ii) interconnection with existing web-based learning environments, and iii) awareness tools.

Interactive tabletops can be used to provide new ways to support face-to-face collaborative learning. A little explored and somewhat hidden potential of these devices is that they can be used to enhance teachers' awareness of students' progress by exploiting captured traces of interaction. These data can make key aspects of collaboration visible and can highlight possible problems. In this paper, we explored the potential of an enriched tabletop to automatically and unobtrusively capture data from collaborative interactions. By analyzing that data, there was the potential to discover trends in students' activity. These can help researchers, and eventually teachers, to become aware of the strategies followed by groups. We explored whether it was possible to differentiate groups, in terms of the extent of collaboration, by identifying the interwoven patterns of students' speech and their physical actions on the interactive surface. The analysis was validated on a sample of 60 students, working in triads in a concept mapping learning activity. The contribution of this paper is an approach for analyzing students' interactions around an enriched interactive tabletop that is validated through an empirical study that shows its operationalization to extract frequent patterns of collaborative activity. © 2013 International Society of the Learning Sciences, Inc. and Springer Science+Business Media New York.

If multi-tabletop classrooms were available in each school, how would teachers plan and enact their activities to enhance learning and collaboration? How can they evaluate how the activities actually went compared with the plan? Teachers' effectiveness in orchestrating the classroom has a direct impact on students learning. Interactive tabletops offer the potential to support teachers by enhancing their awareness and classroom control. This paper describes our mechanisms to help a teacher orchestrate a classroom activity using multiple interactive tabletops. We analyse automatically captured interaction data to assess whether the activity design, as intended by the teacher, was actually followed during its enactment. We report on an authentic classroom study embedded in the curricula of an undergraduate Management unit. This involved 236 students across 14 sessions. The main contribution of the paper is an approach for designing a multi-tabletop classroom that can help teachers plan their learning activities; and provide data for assessment and reflection on the enactment of a series of classroom sessions. © 2012 ACM.