Search

There is little debate regarding the importance of student feedback for improving the learning process. However, there remain significant workload barriers for instructors that impede their capacity to provide timely and meaningful feedback. The increasing role technology is playing in the education space may provide novel solutions to this impediment. As students interact with the various learning technologies in their course of study, they create digital traces that can be captured and analysed. These digital traces form the new kind of data that are frequently used in learning analytics to develop actionable recommendations that can support student learning. This paper explores the use of such analytics to address the challenges impeding the capacity of instructors to provide personalised feedback at scale. The case study reported in the paper showed how the approach was associated with a positive impact on student perception of feedback quality and on academic achievement. The study was conducted with first year undergraduate engineering students enrolled in a computer systems course with a blended learning design across three consecutive years (N2013 = 290, N2014 = 316 and N2015 = 415).

Learning is a social experience and having meaningful connections with peers and instructors is important for student learning. The interpersonal relationships between students and their instructor can positively influence students’ well-being, motivation and self-efficacy (Aguilera-Hermida, 2020; Almendingen et al., 2021; Gillis & Krull, 2020; Kim & Sax, 2009; Marković et al., 2021; Parpala et al., 2021; Pitsick, 2018). Creating productive interpersonal relationships with peers contributes to students’ beliefs of being supported, respected, and valued, and increases the likelihood of students asking their peers for help (Mäkitalo-Siegl & Fischer, 2011). When students feel connected to their peers they are more likely to engage with their peers in ways that support their learning and deepen their knowledge as a result (Shim et al., 2013). Interaction with instructors can also positively influence learning outcomes and student well-being (Pitsick, 2018), and instructors can be a valuable source of help and guidance (Ryan et al., 2001). However, during the COVID-19 pandemic and the shift to emergency remote teaching and learning, students’ relationship with peers was significantly impacted (Motz et al., 2022) and forcing peer-to-peer interaction through mandating camera feeds on during live synchronous video classes disproportionately affected students from disadvantaged backgrounds and those experiencing anxiety or depression (Castelli & Sarvary, 2021). As students were adapting to learn during the pandemic, they increased their reliance on their instructor and highly ranked instructor engagement as a factor that positively influenced their motivation (Nguyen, 2021). As motivation increases, so does self-efficacy, and when students feel supported, engaged, connected and valued by their peers and instructors, they are more likely to be successful students (Zepke, 2018). This study examines students’ experiences in using technology to connect with peers and their instructors during the COVID-19 pandemic when learning remotely. The research inquiry focusses on the second-year cohort as prior research has revealed that this group of learners tend to struggle with their learning (Kyndt et al., 2017; Milsom, 2015; Milsom & Yorke, 2015; Southgate et al., 2014; Virtue et al., 2017; Webb & Cotton, 2019) and experience higher levels of anxiety and depression compared to students in other years of university study prior to the COVID 19 pandemic (Liu et al., 2019). To examine their experience in peer-to-peer networks and their interactions with instructors for help seeking, interviews were undertaken at a large metropolitan Australian University in 2021 with 26 second-year students across different disciplines who had experienced emergency remote teaching in their first and second year of study. The findings reveal that students resist using the discussion board in the Learning Management System because of perceptions of exposure and embarrassment in asking questions when they feel they are expected to know the answer. Students report that synchronous video classes using technology such as Zoom, increase feelings of isolation and they reach out to their peers via social media technology instead. Students are intentional in their choice of technology in connecting with peers, however in the absence of physical connections, there remains a gap in productive engagement with peers. The findings show that second-year students are reluctant to reach out to their instructor when technology is their only mode of interaction, and students report that they would have been more likely to ask for help during a face-to-face class.

Digital education, now common in higher education, is particularly evident in the expansion of blended and fully online offerings at universities. Central to this expansion are educational developers, staff who support teaching and learning improvement in courses they do not themselves teach. Working closely with staff, students, and the curriculum, educational developers see first-hand how the digital learning agenda is both implemented and experienced. This article reports on findings from a national study of three educational development groups: academic developers, academic language and learning developers, and online educational designers, from 14 Australian universities. Although their institutional settings, roles, and work practices varied considerably, a central theme was the tension arising from a perceived shift in institutional priorities from 'people development' to 'product development': that is, from building human (educator) capacity towards curriculum resource development, particularly for the online environment. Participants reported a decline in autonomy, with institutional strategy and targeted projects increasingly directing both the work that gets done, and the skill sets required to do it. Their observations have implications for how universities conceptualise the development and support of the educational process. Refereed/Peer-reviewed

This article reports on the findings of a study that investigated the effects of instructional conditions and prior experience on students' self-reflection. The study was conducted with the use of a video annotation tool that was used by undergraduate performing arts students to reflect on their video-recorded performances. The study shows a consistent positive effect of previous experience with the video annotation tool for engagement with reflection. Graded instructional conditions with feedback had a positive effect on increasing higher order reflections particularly for students with prior experience with the video annotation tool for reflective purposes. The finding suggests that when including reflection in the curriculum, it is important to consider introducing it at a program or degree level rather than individual courses in order to provide an opportunity for students to gain experience with reflection and any particular tool that is used (e.g., a video annotation tool). Furthermore, reflective tasks should be scaffolded into the curriculum with ample opportunity for formative feedback and summative assessment in order to encourage higher order thinking and foster students' metacognitive awareness and monitoring for increased goal-setting and acknowledgement of the motive or effect of their observed behavior. Refereed/Peer-reviewed

This paper presents the results of a natural experiment investigating the effects of instructional conditions and experience on the adoption and sustained use of a learning tool. The experiment was conducted with undergraduate students, enrolled into four performing art courses (N = 77) at a research intensive university in Canada. The students used the video annotation software CLAS for course-based self-assessment on their performances. Although existing research offers insights into the factors predicting students’ intentions of accepting a learning tool, much less is known about factors that affect actual adoption and sustained tool use. The study explored the use of CLAS amongst undergraduate students in four courses across two consecutive semesters. Trace data of students’ tool use, graph-based measures of metacognitive monitoring, and text cohesion of video annotations were used to estimate the volume of tool use and the quality of the learning strategy and learning products created. The results confirmed that scaffolding (e.g., graded activity with instructional feedback) is required to guide students’ initial tool use, although scaffolding did not have an independent significant effect on the quantity of tool use. The findings demonstrated that the use of the tool is strongly influenced by the experience an individual student gains from scaffolded conditions. That is, the students sustained their use of the learning tool in future courses even when the tool use was not graded nor was instructional feedback provided. An important implication is that students’ tool use is not solely driven by motivation – rather, it is shaped by instructional conditions and experience with the tool use. Refereed/Peer-reviewed

There is little debate regarding the importance of student feedback for improving the learning process. However, there remain significant workload barriers for instructors that impede their capacity to provide timely and meaningful feedback. The increasing role technology is playing in the education space may provide novel solutions to this impediment. As students interact with the various learning technologies in their course of study, they create digital traces that can be captured and analysed. These digital traces form the new kind of data that are frequently used in learning analytics to develop actionable recommendations that can support student learning. This paper explores the use of such analytics to address the challenges impeding the capacity of instructors to provide personalised feedback at scale. The case study reported in the paper showed how the approach was associated with a positive impact on student perception of 21quality and on academic achievement. The study was conducted with first year undergraduate engineering students enrolled in a computer systems course with a blended learning design across three consecutive years (N2013 = 290, N2014 = 316 and N2015 = 415). Refereed/Peer-reviewed

The success of the flipped classroom (FC) is effectively reliant on the level of student engagement with the preparatory activities prior to attending face-to-face teaching sessions. Information about the nature and level of student engagement with these activities can help instructors make informed decisions regarding how to best support student learning. Despite the comprehensive data collection enabled by the increasing presence of education technologies, few studies have used these data to investigate the range of strategies students employ in FC models. This study addresses this deficit by proposing an analytical approach that allows for exploring a) the strategies students use to interact with online preparation activities; and b) evolution of those strategies over the duration of a course delivered with a FC pedagogy. The proposed approach identified eight learning strategies and six trajectories of strategy change over the duration of the course, with statistically significant effects of strategy change trajectories on academic performance. Refereed/Peer-reviewed

Flipped classroom (FC) is an active learning design requiring students to complete assigned pre-class learning activities in preparation for face-to-face sessions. Students’ timely, regular, and productive engagement with the pre-class activities is considered critical for the success of the overall FC design, as these activities serve to prepare students for effective participation in face-to-face sessions. However, there is limited empirical evidence on the strength of association between students’ regularity of engagement with the pre-class activities and their learning performance in a FC course. Hence, the current study uses learning trace data from three consecutive offerings of a FC course to examine students’ regularity of pre-class learning activities and its association with the students’ course performance. In particular, the study derives several indicators of regularity from the trace data, including indicators related to time management and those reflecting regularity in the pattern of engagement with pre-class learning activities. The association with course performance is examined by building predictive regression models with the defined indicators as features. To examine the relevance of incorporating the specificities of the instructional design in predictive models, we designed and compared two kinds of indicators: generic (i.e. course-design-agnostic) and course-design-specific indicators. The study identified several indicators of regularity of pre-class activities as significant predictors of course performance. It also demonstrated that predictive models with only generic indicators were able to explain only a small portion of the overall variability in the students’ course performance, and were significantly outperformed by models that incorporated course specific indicators. Finally, the study findings point to the importance of assisting students in regulating their use of learning resources during class preparation activities in a FC. Refereed/Peer-reviewed

The use of standards-based assessment (SBA) has gained prominence in higher education due to a wide range of research evidence that supports its effectiveness in improving learning and teaching. Although the concept is widely used in academic discourse and practice, it has multiple interpretations which have led to diverse assessment practices to the extent that some of these depart from the principles of SBA. To help build a common understanding of what constitutes SBA practices, we explored the construct of academic SBA practices using both theoretical and empirical approaches. We developed a tool, based on the principles of SBA emerging from practices noted in the literature and identified from focus groups. We used factor analysis to extract the dimensions of the construct and to establish empirical evidence for the utilisation of the tool using a data set of 410 academics who engaged in self-assessment. Results showed that a six-factor model is the most parsimonious among other models. We used these dimensions to develop a framework for describing academic SBA practices. The use of the framework and tool has critical implications for curriculum design, professional practice and development, and policy articulation Refereed/Peer-reviewed

Videos are becoming a core component of many pedagogical approaches, particularly with the rise in interest in blended learning, flipped classrooms, and massive open and online courses (MOOCs). Although there are a variety of types of videos used for educational purposes, lecture videos are the most widely adopted. Furthermore, with recent advances in video streaming technologies, learners’ digital footprints when accessing videos can be mined and analyzed to better understand how they learn and engage with them. The collection, measurement, and analysis of such data for the purposes of understanding how learners use videos can be referred to as video analytics. Coupled with more traditional data collection methods, such as interviews or surveys, and performance data to obtain a holistic view of how and why learners engage and learn with videos, video analytics can help inform course design and teaching practice. In this chapter, we provide an overview of videos integrated in the curriculum including an introduction to multimedia learning and discuss data mining approaches for investigating learner use, engagement with, and learning with videos, and provide suggestions for future directions.

© 2016 Copyright held by the owner/author(s). The pervasive collection of data has opened the possibility for educational institutions to use analytics methods to improve the quality of the student experience. However, the adoption of these methods faces multiple challenges particularly at the course level where instructors and students would derive the most benefit from the use of analytics and predictive models. The challenge lies in the knowledge gap between how the data is captured, processed and used to derive models of student behavior, and the subsequent interpretation and the decision to deploy pedagogical actions and interventions by instructors. Simply put, the provision of learning analytics alone has not necessarily led to changing teaching practices. In order to support pedagogical change and aid interpretation, this paper proposes a model that can enable instructors to readily identify subpopulations of students to provide specific support actions. The approach was applied to a first year course with a large number of students. The resulting model classifies students according to their predicted exam scores, based on indicators directly derived from the learning design.

The higher education sector has seen a shift in teaching approaches over the past decade with an increase in the use of video for delivering lecture content as part of a flipped classroom or blended learning model. Advances in video technologies have provided opportunities for students to now annotate videos as a strategy to support their achievement of the intended learning outcomes. However, there are few studies exploring the relationship between video annotations, student approaches to learning, and academic performance. This study seeks to narrow this gap by investigating the impact of students' use of video annotation software coupled with their approaches to learning and academic performance in the context of a flipped learning environment. Preliminary findings reveal a significant positive relationship between annotating videos and exam results. However, negative effects of surface approaches to learning, cognitive strategy use and test anxiety on midterm grades were also noted. This indicates a need to better promote and scaffold higher order cognitive strategies and deeper learning with the use of video annotation software. Refereed/Peer-reviewed

This paper reports on a subset of findings from a larger study investigating resistance from academic staff to the integration of technology with on-campus foreign language teaching at one North American higher education institution. The study revealed that the factors influencing technology adoption paralleled Davis’ Technology Acceptance Model’s tenets of perceived usefulness and ease of use. Further, this study supports Lai and Savage’s (2013) assertion of a lack of attention to the pedagogical affordances of technology when adoption decisions are made by instructors, thus we highlight the need for higher education leaders to determine strategies promoting awareness of the benefits technology-enabled teaching and learning can bring to advance educationally-rich flexible learning opportunities. Refereed/Peer-reviewed

Although video annotation software is no longer considered as a new innovation, its application in promoting student self-regulated learning and reflection skills has only begun to emerge in the research literature. Advances in text and video analytics provide the capability of investigating students’ use of the tool and the psychometrics and linguistic processes evident in their written annotations. This paper reports on a study exploring students’ use of a video annotation tool when two different instructional approaches were deployed – graded and non-graded self-reflection annotations within two courses in the performing arts. In addition to counts and temporal locations of self-reflections, the Linguistic Inquiry and Word Counts (LIWC) framework was used for the extraction of variables indicative of the linguistic and psychological processes associated with self-reflection annotations of videos. The results indicate that students in the course with graded selfreflections adopted more linguistic and psychological related processes in comparison to the course with non-graded selfreflections. In general, the effect size of the graded reflections was lower for students who took both courses in parallel. Consistent with prior research, the study identified that students tend to make the majority of their self-reflection annotations early in the video time line. The paper also provides several suggestions for future research to better understand the application of video annotations in facilitating student learning. Refereed/Peer-reviewed

Web technologies, such as lecture recordings, have the capacity to capture and store massive amounts of data from individuals' online behavior. Such data can provide insight into student learning processes and the relationship between online trace data and academic performance alerting educators to when intervention may be required or if their learning activities may need to be adjusted. This paper discusses how data captured from students' use of lecture recordings accessed through a Collaborative Lecture Annotation System (CLAS) when aggregated and correlated with assessment data can help educators evaluate the impact of the recordings on their students' learning. Such information can help inform and alert educators to when adjustments may be required to their pedagogical approach. Refereed/Peer-reviewed

With the rapid rise in interest in open and online education and flexible learning initiatives across the higher education sector, senior administrators are establishing strategies and policies concerning technology-enabled learning. However, technology adoption and integration with pedagogical practice is complex and multi-dimensional with the socio-cultural nuances that impact acceptance often remaining undetected. Reporting on a subset of results from a larger investigation of factors influencing lecturers’ technology adoption, in this paper the author reveals how the relational ties and technology-related conversations amongst lecturers stimulate the exchange of ideas. Understanding how lecturers learn about new technologies can help higher education leaders to provide the support mechanisms necessary to foster further knowledge sharing and eventual technology adoption by educators. Refereed/Peer-reviewed