Search

Combining individual and collaborative learning is common, but dynamic combinations (which happen as-the-need arises, rather than in preplanned ways, and may happen on an individual basis) are rare. This work reports findings from a technology probe study exploring alternative designs for classroom co-orchestration support for dynamically transitioning between individual and collaborative learning. The study involved (1) a technology-probe classroom study in an authentic, AI-supported classroom to understand teachers' and students' needs for co-orchestration support over dynamic transitions; and (2) workshops and interviews with students and teachers to get informed feedback about their lived experiences. About 118 students and 3 teachers from a middle school in the US experienced a pairing policy--student, teacher, and AI-controlled pairing policy--(i.e., identifying students needing help and potential helpers) for switching from individual to a peer-tutoring activity. This work aims to answer the following questions: (1) How did students and teachers react to these pairing policies? and (2) What are students' and teachers' desires for sharing control over the orchestration of dynamic transitions? Findings suggest the need for a form of hybrid control between students, teachers, and AI systems over transitions, as well as for adaptivity and adaptability for different classroom characteristics, teachers, and students' prior knowledge.

Using data to generate a deeper understanding of collaborative learning is not new, but automatically analyzing log data has enabled new means of identifying key indicators of effective collaboration and teamwork that can be used to predict outcomes and personalize feedback. Collaboration analytics is emerging as a new term to refer to computational methods for identifying salient aspects of collaboration from multiple group data sources for learners, educators, or other stakeholders to gain and act upon insights. Yet, it remains unclear how collaboration analytics go beyond previous work focused on modelling group interactions for the purpose of adapting instruction. This paper provides a conceptual model of collaboration analytics to help researchers and designers identify the opportunities enabled by such innovations to advance knowledge in, and provide enhanced support for, collaborative learning and teamwork. We argue that mapping from low-level data to higher-order constructs that are educationally meaningful, and that can be understood by educators and learners, is essential to assessing the validity of collaboration analytics. Through four cases, the paper illustrates the critical role of theory, task design, and human factors in the design of interfaces that inform actionable insights for improving collaboration and group learning.

Teachers' spatial behaviours in the classroom can strongly influence students' engagement, motivation and other behaviours that shape their learning. However, classroom teaching behaviour is ephemeral, and has largely remained opaque to computational analysis. Inspired by the notion of Spatial Pedagogy, this paper presents a system called 'Moodoo' that automatically tracks and models how teachers make use of the classroom space by analysing indoor positioning traces. We illustrate the potential of the system through an authentic study with seven teachers enacting three distinct learning designs with more than 200 undergraduate students in the context of science education. The system automatically extracts spatial metrics (e.g. teacher-student ratios, frequency of visits to students' personal spaces, presence in classroom spaces of interest, index of dispersion and entropy), mapping from the teachers' low-level positioning data to higher-order spatial constructs. We illustrate how these spatial metrics can be used to generate a deeper understanding of how the pedagogical commitments embedded in the learning design, and personal teaching strategies, are reflected in the ways teachers use the learning space to provide support to students.

Learning Analytics (LA) systems can offer new insights into learners' behaviours through analysis of multiple data streams. There remains however a dearth of research about how LA interfaces can enable effective communication of educationally meaningful insights to teachers and learners. This highlights the need for a participatory, horizontal co-design process for LA systems. Inspired by the notion of translucence, this paper presents LAT-EP (Learning Analytics Translucence Elicitation Process), a five-step process to design for the effective use of translucent LA systems. LAT-EP was operationalised in an authentic multimodal learning analytics (MMLA) study in the context of teamwork in clinical simulation. Results of this process are illustrated through a series of visual proxies co-designed with teachers, each presenting traces of social, physical, affective and epistemic evidence captured while teams of student nurses practised clinical skills in a simulated hospital setting.

From a human-centred computing perspective, supporting the interpretation of educational dashboards and visualizations by the people intended to use them exposes critical design challenges that may often be trivialized. Empirical evidence already shows that "usable" visualizations are not necessarily effective from an educational perspective. Since an educator's interpretation of visualized data is essentially the construction of a narrative about student progress, in this paper, we propose the concept of "Educational Data Storytelling" as an approach for explaining student data by aligning educational visualizations with the intended learning design. We present a pilot study that explores the effectiveness of these data storytelling elements based on educator responses to prototypes by analyzing the kinds of stories they articulate, their eye-tracking behaviour, and their preferences after inspecting a series of student data visualizations. The dual purpose is to understand the contribution of each visual element for data storytelling, as well as the effectiveness of the enhancements when combined.

There is growing interest in creating learning analytics feedback interfaces that support students directly. While dashboards and other visualizations are proliferating, the evidence is that many fail to provide meaningful insights that help students reflect productively. The contribution of this article is qualitative and quantitative evidence from two studies evaluating a multimodal teamwork analytics tool in authentic clinical teamwork simulations. Collocated activity data are rendered to help nursing students reflect on errors and stress-related incidents during simulations. The user interface explicitly guides student reflection using data storytelling principles, tuned to the intended learning outcomes. The results demonstrate the potential of interfaces that "tell one data story at a time," by helping students to identify misconceptions and errors; think about strategies they might use to address errors, and reflect on their arousal levels. The results also illuminate broader issues around automated formative assessment, and the intelligibility and accountability of learning analytics.

The term "Classroom Proxemics" refers to how teachers and students use classroom space, and the impact of this and the spatial design on learning and teaching. This study addresses the divide between, on the one hand, substantial work on proxemics based on classroom observations and, on the other hand, emerging work to design automated feedback that helps teachers identify salient patterns in their use of the classroom space. This study documents how digital analytics were designed in service of a senior teacher's practice-based inquiry into classroom proxemics. Indoor positioning data from four teachers were analysed, visualized and used as evidence to compare three distinct learning designs enacted in a physics classroom. This study demonstrates how teachers can make effective use of such visualizations, to gain insight into their classroom practice. This is evidenced by (a) documenting teachers' reflections on visualizations of positioning data, both their own and that of peers and (b) identifying the types of indicator (operationalized as analytical metrics) that foreground the most useful information for teachers to gain insight into their practice.