Search

This study explores the development of an eye-tracking solution for paralyzed students, enabling them to access and utilize personal computers for their education. It relies on eye-tracking technology, enabling computer control through eye movements. The study followed four phases: problem analysis, solution development, evaluation, and documentation. In the analysis phase, the problem for developing a solution was defined based on the interviews with the instructor, the paralyzed student, and his parents. The iterative and incremental development process was followed in the development phase with four development cycles. At the end of this phase, an eye-tracking-based computer control system and design principles were obtained to develop such a system. During the evaluation phase, paralyzed student used the system for two semesters. The final phase documented design principles for further eye-tracking systems to support paralyzed individuals' academic lives. By adhering to these design principles, there is a need to develop and adapt more solutions and systems for the benefit of paralyzed people, enabling them to access and maintain their academic lives. The study highlights the potential of eye-tracking technology for paralyzed students and promotes the development of similar solutions.

Eye-tracking (ET) method provides a promising channel for educational researchers to connect learning outcomes to cognitive processes. The main principle of ET is that our gaze and our focus of attention are connected. Due to the advent of digital technologies, eye tracking studies are increasingly growing in different fields and in mathematics education. We assume that the provided task is one of the ways to analyse deeply cognitive processes, and we wonder how ET studies are dealing with the integration of digital technology in task-design in geometry. Starting from Strohmaier et al. (2020) we found three studies, one focused on geometric proofs and two based on construction of geometric objects. We highlight the contributions of integrating digital technology in learning and instruction, and in research in geometry.

Teacher professional vision as a concept is gaining importance in research on teaching, and recently models for studying teacher professional vision and student self-regulated learning (SRL) have been proposed. There are interview and video intervention studies investigating teacher professional vision for SRL, but no real-life classroom research so far. This study investigated the role of student SRL behaviour, as it was reported by students themselves and teachers, in teacher attention distribution as part of teacher professional vision. Ten teachers and their 158 students at high school level in Lithuania took part in the research. The first step of the study resulted in identifying four student SRL-profiles, which differed based on student level of SRL and the extent to which teacher and student assessments coincided: mixed lower-regulated, mixed higher-regulated, systematic lower-regulated, systematic higher-regulated. The profiles demonstrated only a partial overlap in teacher and student judgement of student SRL. The second step of the study explored whether scores of students' SRL from student and teacher reports were related to teachers' distribution of visual attention in one lesson. The results showed that only one teacher rating scale of student information-seeking behaviour had a slight correlation with teacher attention. The results imply rather bottom-up trends in teacher attention to students in the classroom when it comes to SRL. Besides, the study results highlight the not directly observable nature of SRL processes and imply a difficulty for teachers to assess student SRL.

This study explored early childhood education and care (ECEC) teachers' visual gaze and related reflections on pedagogical actions during pedagogical activities in groups of children under three years of age in Finland. The data were collected from play and teacher-guided activities using mobile eye-tracking glasses, the retrospective thinking aloud (RTA) method, and semi-structured interviews. The results showed that even though the teachers were surprised about some aspects of the visual gaze metrics, they reflected on and gave reasons for their visual gazes on children. When observing gaze data from play, teachers explained the high amount of gaze by citing children's particular needs. When observing gaze data from guided activities, teachers reflected on children's unpredictable behavior and noted that the children's need for support in concentration was linked to more gazes by the teacher. The findings showed that both during play and guided activities, children seeking a gaze and the position of children in the classroom influenced the number of teachers' gazes. In the teachers' explanations of their visual gaze and related pedagogical actions, five categories were identified: protection; physical and emotional availability, teaching and learning; facilitation; and initiatives. This explorative study showed that teachers utilize their knowledge concerning children's individuality, development, and learning when they explain their decisions concerning their visual gaze and pedagogical activities with toddlers. The use of mobile eye-tracking technology is relatively new; therefore, its applications to ECEC are pioneering for the development of the field in relation to the practices and research of toddlers' groups and groups with older children in ECEC.

With the prominence of assessments in education, there is an increasing need to create new forms of assessment that more accurately reflect the needs of the entire student population, particularly neurodivergent learners. To address this challenge, this paper explores the potential for using eye tracking data in a game-based learning environment to assess student's implicit knowledge. Data was collected from a sample of 66 neurodivergent college students playing the physics game Impulse while their eye movements and game play behaviors were recorded. The results indicate that gaze allocation patterns were predictive of students' physics knowledge and aligned with previously identified behavior indicators of learning. These findings provide evidence for further development of eye movement-based assessments in computer-based instruction and demonstrate how these data can be collected, organized, and analyzed.

This paper investigates the cognitive processes involved in English word recognition among young EFL learners using eye-tracking methodology. A quasi-experimental mixed method design was used to investigate how young L2 learners engage with basic words, with or without pictorial cues. A total of seventeen 6th-grade pupils from two schools participated in the experiment. The participants were presented with a list of 20 words and were asked to read them aloud while their eye movements were tracked to discern their viewing patterns. Immediately after the reading task, stimulated-recall interviews were conducted to triangulate and validate the participants' viewing behaviors. Results indicate that participants focused significantly more on the text than the accompanying pictures yet demonstrated better performance in recognizing and reading the words presented in a picture-based mode. Some participants reported that the pictures were not viewed because the words were easy to read. In contrast, others struggled to read certain words due to an over-reliance on their background knowledge, which sometimes led to misinterpretation. These results emphasize the importance of integrating visual cues with word recognition instruction in early language learning contexts, highlighting when and how these cues should be utilized effectively.

This paper presents a systematic literature review aimed at consolidating knowledge on the application of eye-tracking technology in the diagnosis of dyslexia among school-aged children (6-12 years). Through a meticulous search and selection process, 20 studies conducted over the last 10 years were identified and analyzed to evaluate the effectiveness of this technology. The findings highlight the varied methodologies, participant demographics, and outcomes of these studies, underscoring the potential of eye tracking as a non-invasive, objective tool in the early detection of and intervention for dyslexia. Despite facing limitations such as heterogeneity in study designs and the need for standardized protocols, this review illuminates the significant promise of eye-tracking technology in enhancing dyslexia diagnosis. It identifies gaps in current research, proposes avenues for future investigation, and offers evidence-based recommendations for practitioners. This endeavor not only enriches the present understanding of dyslexia diagnosis, but also establishes a foundation to ultimately improve educational outcomes for dyslexic learners.

During and after the COVID-19 pandemic, online learning has gained popularity. Video conferencing, such as Zoom, has become the new normal in almost every individual's life. The purpose of this study is to observe the usage and preference of Virtual Background (VB) during video conferencing through a survey, whereas the effect of VB on attention during online meetings is evaluated through an eye tracker experiment. An online survey is conducted to observe the usage and preference of Indonesian users of Zoom in applied VB. Based on the most preferred VB, an eye tracker experiment was conducted to evaluate participants' attention during online learning using the three most preferred VB: office VB, plain background, and thematic VB. Eye tracker parameters, including Percentage of Participants who Fixated (PFF), Total Fixation Duration (TFD), Time to First Fixation (TFF), and Fixation Count (FC), were measured. The survey result showed that 71% of 303 respondents preferred their lecturers to use VB during Zoom meetings, 26% preferred office VB, 25% preferred plain VB, and 20% preferred thematic VB. An experiment that is conducted to evaluate attention during online meetings with three different VBs using an eye tracker shows that attention to lecture in plain VB is the best compared to other VBs, shown by the highest value of TFF and lowest TFD and FC. Implications of the result are discussed.

Following efforts to promote internationalization at academic institutions, the use of multiple languages on educational slides (e.g., PowerPoint) has gradually increased. Multilingualism in learning has its advantages, but having multiple languages on educational slides can lead to crowding and cognitive overload. To investigate how students perceive multilingual slides, evaluations were gathered from Japanese (N = 20) and Indonesian students (N = 20) during an eye-tracking experiment in which their visual attention distribution on the slides was assessed. The slides contained text in three languages (English, Japanese, and Bahasa Indonesia) and were varied according to their layout. One group watched slides with text separated in blocks, with one text block for each language, while the other group watched slides consisting of a single, mixed block with each sentence describing the same information in a different language. The students' evaluations showed that slides with a mixed layout were judged as more crowded and required more processing effort than slides with a separated-block layout. Furthermore, while the students dwelled their gaze significantly longer on text in their native language (either Bahasa Indonesia or Japanese) on separated-block slides, for slides with a mixed layout, the gaze patterns did not significantly differ between languages. The results of a comprehension quiz taken after the slide presentation, however, showed that students performed better after having watched the slides with the mixed layout. Thus, although judged as more crowded and requiring a wider attention distribution, slides with a mixed layout may be preferable in multilingual education.

The study examines the interactive functions of gesture repetitions as a specific form of interpersonal synchronization in argumentative decision-making processes of peers (1-6 graders). Based on a collection of 13 instances, gesture repetitions are investigated in the process of collaboratively co-constructing arguments. Drawing on multimodal interaction analysis, a description is provided of how gestures are aligned and laminated with other multimodal resources, such as body posture and gaze, into multimodal repetitions during the co-construction of both arguments and counterarguments. The study illustrates the way in which multimodal repetitions serve to mark coherence between the participants' turns and contribute to the argument. As the multimodal resources are highly synchronized with each other, multimodal repetitions also make the collaboration of specific participants publicly visible to all interactants, thereby attaching more importance to the sharedness--and persuasiveness--of the constructed argument. The analysis therefore focuses on both depictive and pragmatic gestures that are conceived as parts of multimodal gestalts (Mondada, 2014), and describes different trajectories of co-constructions that entail interactively successful as well as unsuccessful examples.

The aim was to test the use of eye-tracking methodology for the early detection of ASD in a task of association between unfamiliar objects and pseudowords. Significant differences were found between ASD (n = 57) and TD (n = 57) Spanish speaking toddlers in the number and time of fixation. The TD children showed more and longer fixations on eyes and mouth while the ASD children attended almost exclusively to objects, making it difficult to integrate lexical and phonological information. Moreover, the TD toddlers looked at the mouth when the pseudoword was produced while the ASD toddlers did not. Gaze fixation on eyes and mouth during word learning recorded by eye-tracking may be used as a biomarker for the early diagnosis of ASD.

We investigated the role of cue weighting, second language (L2) proficiency, and L2 daily exposure in L2 learning of suprasegmentals different from the first language (L1), using eye-tracking. Spanish monolinguals, English-Spanish learners, and Mandarin--Spanish learners saw a paroxytone and an oxytone verb (e.g., "FIRma-firMÓ" "s/he signs-signed"), listened to a sentence containing one of the verbs, and chose the one that they heard. The three languages have contrastive lexical stress, but suprasegmentals have a greater functional load in Mandarin than in English. Monolinguals predicted suffixes accurately with both stress conditions and favored oxytones, but learners predicted suffixes accurately only with oxytones, the condition activating fewer lexical competitors. Monolinguals predicted suffixes accurately sooner but at a slower rate than did learners. L2 proficiency, but not L1 or L2 exposure, facilitated L2 predictions. In conclusion, learners of a contrastive-stress L1 rely on L2 suprasegmentals to the same extent as monolinguals, regardless of their L1. Lower L2 proficiency and higher cognitive load (more lexical competitors) reduce learners' reliance on suprasegmentals.

Problem solving is one of the high-level thinking skills and essential in teaching mathematical concepts and procedures. The eye-tracking method allows educators to see and interpret different problem-solving behaviours of students. The purpose of this study was to investigate the problem-solving behaviours of university students based on eye tracking statistics when faced with a geometry problem, and to explain these behaviours in terms of the students' success and learning styles. The research design was a case study approach that combined quantitative and qualitative data. Eight first-year students from the department of elementary mathematics education in a private University, Turkey, participated in this study. They were asked to solve a specific geometry question using the GeoGebra software. While solving this question, their eye movements were recorded and analysed using an eye-tracking program. Results were analysed to investigate their problem-solving skills and behaviours based on Polya's mathematical problem-solving stages. Results of the study suggest that the effort devoted to the understanding and planning stages of problem-solving are important factors that contribute to success in this case. Results also revealed that participated students with a converger learning style were more successful in each step of the problem-solving process. Additionally, it could be concluded that the input area had only been used by converger students, indicating that they devoted time and effort to creating and trying formulas.

The rise of precision education has encouraged teachers to use intelligent diagnostic systems to understand students' learning processes and provide immediate guidance to prevent students from giving up when facing learning difficulties. However, current research on precision education rarely employs multimodal learning analytics approaches to understand students' learning behaviors. Therefore, this study aims to investigate the impact of teachers intervene based on different modalities of learning analytics diagnosing systems on students' learning behaviors, learning performance, and motivation in STEM collaborative learning activities. We conducted a quasi-experiment with three groups: a control group without any learning analytics system assistance, experimental group 1 with a unimodal learning analytics approach based on image data, and experimental group 2 with a multimodal learning analytics approach based on both image and voice data. We collected students' image or voice data according to the experimental design and employed artificial intelligence techniques for facial expression recognition, eye gaze tracking, and speech recognition to identify students' learning behaviors. The results of this research indicate that teacher interventions, augmented by learning analytics systems, have a significant positive impact on student learning outcomes and motivation. In experimental group 2, the acquisition of multimodal data facilitated a more precise identification and addressing of student learning challenges. Relative to the control group, students in the experimental groups exhibited heightened self-efficacy and were more motivated learners. Moreover, students in experimental group 2 demonstrated a deeper level of engagement in collaborative processes and the behavior associated with constructing knowledge.

Perceptual learning theory suggests that perceptual grouping in mathematical expressions can direct students' attention toward specific parts of problems, thus impacting their mathematical reasoning. Using in-lab eye tracking and a sample of 85 undergraduates from a STEM-focused university, we investigated how higher-order operator position (HOO; i.e., multiplication/division operators and the presence of superfluous brackets impacted students' time to first fixation to the HOO, response time, and percent of correct responses). Students solved order-of-operations problems presented in six ways (3 HOO positions × presence of brackets). We found that HOO position and presence of superfluous brackets had separate and combined impacts on calculating arithmetic expressions. Superfluous brackets most influenced undergraduates' performance when higher-order operators were located in the center of mathematical expressions. Implications for learning and future directions are discussed about observing eye movements and gaining insights into students' processes when solving arithmetic expressions.

This article describes a novel method for quantifying fixation disparity and evaluates its role in visuospatial cognition during an authentic learning task, specifically, the determination of molecule chirality in organic chemistry involving mental rotation and pattern comparison. The first study examined the influence of molecular model dimensionality (2D vs. 3D) on chirality determination performance and visual attention of 55 participants. The second study explored how the sustained playing of the tile-matching game Mahjong, a pattern comparison game, can affect visual attention and visuospatial performance during the chirality determination task of 59 participants. Fixation disparity was one of the eye tracking variables explored. Both studies revealed that (1) individuals with higher fixation disparity underperformed on the chirality task, which involves mental rotation and pattern comparison, and (2) fixation disparity improved over time in participants who played Mahjong. This work provides important implications for using fixation disparity as a possible biomarker of visuospatial performance.

Past work has shown that eye movements are affected by long-term memory across different tasks and instructional manipulations. In the current study, we tested whether these memory-based eye movements persist when memory retrieval is under intentional control. Participants encoded multiple scenes with six objects (three faces; three tools). Next, they completed a memory regulation and visual search task, while undergoing eye tracking. Here, scene cues were presented and participants either retrieved the encoded associate, suppressed it, or substituted it with a specific object from the other encoded category. Following a delay, a search display consisting of six dots intermixed with the six encoded objects was presented. Participants' task was to fixate one remaining dot after five had disappeared. Incidental viewing of the objects was of interest. Results revealed that performance in a final recognition phase was impaired for suppressed pairs, but only when the associate was a tool. During the search task, incidental associate viewing was lower when participants attempted to control retrieval, whereas one object from the nonassociate category was most viewed in the substitute condition. Additionally, viewing patterns in the search phase were related to final recognition performance, but the direction of this association differed between conditions. Overall, these results suggest that eye movements are attracted to information retrieved from long-term memory and held active (the associate in the retrieve condition, or an object from the other category in the substitute condition). Furthermore, the level of viewing may index the strength of the representation of retrieved information.

Research on first language (L1) reading has long since established the link between the proficiency of the reader and their efficiency in oculomotor control. More proficient readers make longer saccades and land closer to the word's center, which is a word's optimal viewing position, and make fewer refixations. Eye-tracking studies of second language (L2) reading have so far provided little evidence in this regard. This study analyzes spatial oculomotor measures in the Multilingual Eye-movement Corpus, which contains data on English text reading and its component skills from 543 participants representing 12 different L1s. Our analyses establish a strong role of proficiency in English, both for L1 and L2 readers of English. While most effects replicated ones observed in L1 reading, we also found that more proficient readers of English were less accurate in targeting optimal viewing positions. We link this finding to Fitts' law of motor control for aimed movements. This article discusses the theoretical implications of the novel findings for reading research.

The study of infant gaze has long been a key tool for understanding the developing mind. However, labor-intensive data collection and processing limit the speed at which this understanding can be advanced. Here, we demonstrate an asynchronous workflow for conducting violation-of-expectation (VoE) experiments, which is fully "hands-off" for the experimenter. We first replicate four classic VoE experiments in a synchronous online setting, and show that VoE can generate highly replicable effects through remote testing. We then confirm the accuracy of a state-of-the-art gaze annotation software, iCatcher+ in a new setting. Third, we train parents to control the experiment flow based on the infant's gaze. Combining all three innovations, we then conduct an asynchronous automated infant-contingent VoE experiment. The hands-off workflow successfully replicates a classic VoE effect: infants look longer at inefficient actions than efficient ones. We compare the resulting effect size and statistical power to the same study run in-lab and synchronously via Zoom. The hands-off workflow significantly reduces the marginal cost and time per participant, enabling larger sample sizes. By enhancing the reproducibility and robustness of findings relying on infant looking, this workflow could help support a cumulative science of infant cognition. Tools to implement the workflow are openly available.

Real-time attention coordination in parent-toddler dyads is often studied in tightly controlled laboratory settings. These studies have demonstrated the importance of joint attention in scaffolding the development of attention and the types of dyadic behaviors that support early language learning. Little is known about how often these behaviors occur in toddlers' everyday lives. We brought wireless head-mounted eye trackers to families' homes to study the moment-to-moment patterns of toddlers' and parents' visual attention and manual activity in daily routines. Our sample consisted of English- and Spanish-speaking families who all reported being middle- or upper middle-class. Toddlers were 2 to 3 years old. Consistent with the findings from previous laboratory studies, we found variability in how frequently toddlers attended to named objects in two everyday activities--Object Play and Mealtime. We then tested whether parent-toddler joint attention in the seconds before a naming utterance increased toddler's attention on the named object. We found that joint attention accompanied by the attended object being held increased the child's attention to the labeled object during naming. We posit that in the rich, noisy world of toddlers' everyday lives, embodied attention plays a critical role in coordinating dyadic behaviors and creating informative naming moments. Our findings highlight the importance of studying toddlers' natural behavior in the real world.

This study delves into the syntactic parsing abilities of children and infants exposed to Catalan as their first language. Focusing first on ages 3 to 6, we conducted two sentence-picture matching tasks. In experiment 1, 3 to 4-year-old children failed in identifying singular third-person subjects within null-subject sentences, although they performed above chance in all other scenarios, including plural third-person subjects and sentences with overt full DP subjects. This is reminiscent of the results of Pérez-Leroux for Spanish. In experiment 2, with the same design but involving numeral distractors, children's performance was above chance level across all conditions from age 3 to 4. Then, in experiment 3, we moved to a younger age range with the help of eye-tracking techniques. The findings revealed that infants at 22 months had the ability to parse subject--verb agreement in sentences with third-person null subjects, and at 19 months there was evidence of parsing for third-person plural null subjects. These findings are inconsistent with the perception of children grappling with syntactic agreement computation. We argue that instances of underperformance in subject--verb agreement parsing identified in the literature often stem from task-related and pragmatic issues rather than core syntactic delay. If so, the putative asymmetry between early production of verbal inflection and late comprehension disappears; rather, the results suggest early establishment of matching operations and mastery of language-specific agreement properties before production starts.

Science centres are informal learning spaces embedded with artefacts embodying mediational affordances. This exploratory and small-scale mixed methods study juxtaposes eye-tracking technologies and qualitative interviews to examine how visitors to a gallery navigated this space and interacted with different artefacts. A total of 15 visitors to the science centre gallery, Energy Story, participated in the study. The findings revealed inconclusive results about the directionality of their navigation. The mediational affordances of the artefacts, as interpreted from the interactive elements and interaction of the visitors and interviews, suggested that it was better to distribute the mediational affordances across a few artefacts in an exhibit rather than have one artefact embody several affordances. The concept of "mediational threshold" was suggested as a topic for future study. The findings contributed to the academic literature on eye-tracking studies at science centres. They also provided ideas for science centre curators and teachers who bring students with diverse learning needs to this mediational space.

In this study, we examined the effect of visual cues in a second language listening test on test takers' viewing behaviours and their test performance. Fifty-seven learners of English in Korea took a video-based listening test, with their eye movements recorded, and 23 of them were interviewed individually after the test. The participants viewed the visual cues longer than the items in the multiple-choice questions. Looking at the correct answer choice was related to a higher test score, while looking at the speaker(s) in the video and the distractors of the test items to a lower test score. Viewing the PowerPoint slides showed mixed effects on test performance, depending on different eye-movement measures. Stimulated-recall interviews shed further light on the possible reasons for the different patterns of the participants' eye movements. Overall, the participants held the positive view that the visual cues aided them in comprehending the aural input and in completing the listening tasks more successfully. We discuss these findings in relation to the authenticity of tasks and the construct relevance of video-based listening tests.

"Hospital" can refer to a physical place or more figuratively to the people associated with it. Such place-for-institution metonyms are common in everyday language, but there remain several open questions in the literature regarding how they are processed. The goal of the current eyetracking experiments was to investigate how metonyms are interpreted when they appear as sentence subjects in structures that are temporarily syntactically ambiguous versus unambiguous (e.g., "The hospital [that was] requested by the doctor…"). If comprehenders have a bias to interpret metonyms in subject position as agents (Fishbein & Harris, 2014), they should initially access the figurative (institutional) sense of the metonym. This interpretation is rendered incorrect at the disambiguating by-phrase, which should lead to reanalysis (i.e., garden-path effects). In Experiment 1, larger garden-path effects were observed for metonyms compared to inanimate control nouns that did not have a figurative sense. In Experiment 2, garden-path effects were equivalent for metonyms and animate sentence subjects. In addition, there was some evidence that readers exhibited initial difficulty at the verb (e.g., "requested") when it immediately followed the metonym compared to the inanimate control nouns in Experiment 1. Overall, the results suggest that the subject-as-agent heuristic is a powerful cue during sentence processing, which can prompt the comprehender to access a figurative interpretation of a metonym.

This study examined the extent to which textual enhancement and task manipulation affect the learners' attentional processing and the development of second language (L2) grammatical knowledge. A total of 73 Korean college students read an opinion news article in one of four experimental conditions: (1) textually enhanced, careful reading, (2) textually enhanced, expeditious reading, (3) textually non-enhanced, careful reading, and (4) textually non-enhanced, expeditious reading. For the enhanced conditions, the target L2 construction, i.e. the use of English participle phrases in the restrictive use, was typographically enhanced using a different color. In addition, the reading task was manipulated in terms of the speed and the manner of reading, i.e. careful reading to remember textual information as accurately as possible or expeditious reading to figure out the gist as soon as possible. While reading the article, learners' eye-movements were recorded with an eye-tracker to measure the allocation of attentional resources as well as reading processes. In addition, stimulated recalls were collected for qualitative analysis of learners' attentional processes. The results revealed that both textual enhancement and task manipulation had significant effects on the way participants allocated their attentional resources during reading, while it did not affect their knowledge of the target constructions as reflected in their grammaticality judgment scores.

In the realm of mathematics education, geometry problems assume a pivotal role by fostering abstract thinking, establishing a connection between theory and practice, and offering a tangible portrayal of reality. This study focuses on comprehending problem-solving methodologies by observing the eye movements of 45 primary and multi-year grammar school pupils, aged 11 to 14, as they tackled pictorial geometry problems without computation. The utilization of eye-tracking technology, specifically the OGAMA tool, was essential in unveiling the nuanced strategies employed by students. Visual attention metrics were determined through fixations on predefined areas of interest, identified using the ScanGraph tool. Through an analysis of eye movements, participants were categorized into three distinct groups based on their problem-solving strategies. This categorization facilitated an exploration of the correlation between the chosen strategy and the success rate in solving geometry problems without computational aids. The findings underscore the imperative for continued investigation into strategies for solving geometry problems without computation. Additionally, the research aims to broaden its scope by delving into the metacognitive strategies applied in solving imaginative geometric tasks.

It is known that the rhythms of speech are visible on the face, accurately mirroring changes in the vocal tract. These low-frequency visual temporal movements are tightly correlated with speech output, and both visual speech (e.g., mouth motion) and the acoustic speech amplitude envelope entrain neural oscillations. Low-frequency visual temporal information ('visual prosody') is known from behavioural studies to be perceived by infants, but oscillatory studies are currently lacking. Here we measure cortical tracking of low-frequency visual temporal information by 5- and 8-month-old infants using a rhythmic speech paradigm (repetition of the syllable 'ta' at 2 Hz). Eye-tracking data were collected simultaneously with EEG, enabling computation of cortical tracking and phase angle during visual-only speech presentation. Significantly higher power at the stimulus frequency indicated that cortical tracking occurred across both ages. Further, individual differences in preferred phase to visual speech related to subsequent measures of language acquisition. The difference in phase between visual-only speech and the same speech presented as auditory-visual at 6- and 9-months was also examined. These neural data suggest that individual differences in early language acquisition may be related to the phase of entrainment to visual rhythmic input in infancy.

With the widespread use of masks in the COVID-19 pandemic, it is crucial to understand how emotion recognition is affected by partial face covering. Since individuals with autism spectrum condition often tend to look at the lower half of the face, they are likely to be particularly restricted in emotion recognition by people wearing masks, since they are now forced to look at the upper half of the face. This study compared the recognition of basic and complex emotions in individuals with and without autism spectrum condition, when faces were presented uncovered, with face masks, or with sunglasses. We also used eye tracking to examine group differences in gaze patterns during emotion recognition. Individuals with autism spectrum condition were less accurate at recognizing emotions in all three conditions. Averaged across the three stimulus types, individuals with autism spectrum condition had greater difficulty recognizing anger, fear, pride, and embarrassment than control group. There was no group difference in emotion recognition between the three conditions. However, compared to individuals without autism spectrum condition, there was no evidence of either gaze avoidance or preference for the mouth region. Our results suggest that emotion recognition is reduced in individuals with autism spectrum condition, but this is not due to differences in gaze patterns.

Being looked at is an important communicative signal, and attenuated responses to such direct gaze have been suggested as an early sign of autism. Using live eye tracking, we examined whether direct gaze elicits different gaze responses in infants at ages 10, 14 and 18 months with and without later autism in real-life interaction. The sample consisted of 169 infants: 35 with elevated likelihood of autism and subsequent diagnosis, 94 without subsequent diagnosis and 40 with typical likelihood of autism. Infants in all groups tended to look more towards the adult's face shortly after the direct gaze occurred. Neither how much nor how quickly the infants responded to the direct gaze differentiated the without elevated likelihood of autism and subsequent diagnosis and with elevated likelihood of autism and subsequent diagnosis groups. Infants in the typical likelihood group looked more at the face after the direct-gaze event than infants in the two elevated likelihood groups, but this result is tentative. In an exploratory analysis, infants in the elevated likelihood of autism and subsequent diagnosis group looked away quicker from faces with direct gaze than infants in the typical likelihood group, but this measure did not correlate with dimensional autism or differentiate between the two elevated likelihood groups. The current results suggest that attenuated behavioural responses to direct gaze in infancy are neither strong nor specific early markers of autism.

Sustained attention (SA) is an endogenous form of attention that emerges in infancy and reflects cognitive engagement and processing. SA is critical for learning and has been measured using different methods during screen-based and interactive contexts involving social and nonsocial stimuli. How SA differs by measurement method, context, and stimuli across development in infancy is not fully understood. This 2-year longitudinal study examines attention using one measure of overall looking behavior and three measures of SA--mean look duration, percent time in heart rate-defined SA, and heart rate change during SA--in N = 53 infants from 1 to 24 months across four unique task conditions: social videos, nonsocial videos, social interactions (face-to-face play), and nonsocial interactions (toy engagement). Results suggest that developmental changes in attention differ by measurement method, task context (screen or interaction), and task stimulus (social or nonsocial). During social interactions, overall looking and look durations declined after age 3-4 months, whereas heart rate-defined attention measures remained stable. All SA measures were greater for videos than for live interaction conditions throughout the first 6 months, but SA to social and nonsocial stimuli within each task context were equivalent. In the second year of life, SA measured with look durations was greater for social videos compared to other conditions, heart rate-defined SA was greater for social videos compared to nonsocial interactions, and heart rate change during SA was similar across conditions. Together, these results suggest that different measures of attention to social and nonsocial stimuli may reflect unique developmental processes and are important to compare and consider together, particularly when using infant attention as a marker of typical or atypical development.

Emotions are a complex multi-faceted phenomenon. To assess the complexity of emotions from different facets, multi-modal approaches are necessary. However, multi-modal approaches are rarely used for assessing emotions, especially in the context of computer programming. This study adopts a multi-modal approach to understand the changes in students' perception of emotions before and after working on programming problems. Understanding these changes in students' perceptions may enable educators to devise interventions that help students adjust their perceptions and regulate their emotions as per their skills. We conducted a one-on-one programming session and retrospective think-aloud interview with 17 students from an introductory programming course. During the programming session, students filled surveys and performed four programming tasks. While working on these tasks, students' eye gaze, video of face and screen, and electrodermal activity data were also collected using a non-invasive device. The data collection for this study was multi-modal, with a mix of both qualitative and quantitative data collection methods. Data analysis was primarily qualitative, with additional triangulation of qualitative and biometric data for select exemplars. The findings of this study suggest that students experience changes in emotions because of many reasons, for instance, they encountered repeated errors, they set high standards for their performance, or they could not manage time. For some students, negative emotions changed to positive emotions when they solved errors without any external help or achieved more than what they expected going into the task. Moreover, the triangulation of qualitative and biometric data of two participants provides a fine-grained analysis of their emotions and behaviors and confirmed the change in the perception of their emotions while performing the programming tasks.

While overt social atypicalities remain a key component of the autistic phenotype, recent reframing of autistic social motivation suggests that these atypicalities do not overlap with their actual level of social engagement. Our study aimed to investigate autistic preschoolers' visual attention toward social situations with unequal interactive load and determine the potential benefits of parallel competition, a form of lateral tutorship. The study observed 26 autistic preschoolers and 20 typically developing children. First, a gaze-contingent procedure measured visual attention toward videos of parallel competitive play, overtly cooperative play, and a non-social object. Then, a motor task and a cognitive task were conducted, both independently and with a parallel competitor to assess the effect of parallel engagement on children's performance. Eye-tracking demonstrated autistic children displayed reduced attention toward competition than typically developing children. However, behavioral data revealed the presence of a parallel competitor significantly and similarly improved performance for autistics and typically developing children. These findings suggest a dissociation between social attention and social facilitation in young autistic children, indicating that atypical visual patterns toward social situations do not necessarily preclude them from benefiting from these situations. As such, activities parallel to the child activities, or lateral tutorship, may represent an addition to traditional joint-interactive activities in early education for autistic children.

Autistic people often experience difficulties navigating face-to-face social interactions. Historically, the empirical literature has characterised these difficulties as cognitive 'deficits' in social information processing. However, the empirical basis for such claims is lacking, with most studies failing to capture the complexity of social interactions, often distilling them into singular communicative modalities (e.g. gaze-based communication) that are rarely used in isolation in daily interactions. The current study examined how gaze was used in concert with communicative hand gestures during joint attention interactions. We employed an immersive virtual reality paradigm, where autistic (n = 22) and non-autistic (n = 22) young people completed a collaborative task with a non-autistic confederate. Integrated eye-, head- and hand-motion-tracking enabled dyads to communicate naturally with each other while offering objective measures of attention and behaviour. Autistic people in our sample were similarly, if not more, effective in responding to hand-cued joint attention bids compared with non-autistic people. Moreover, both autistic and non-autistic people demonstrated an ability to adaptively use gaze information to aid coordination. Our findings suggest that the intersecting fields of autism and social neuroscience research may have overstated the role of eye gaze during coordinated social interactions.

Using eye-tracking, we studied allocation of attention to faces where the emotional expression and eye-gaze dynamically changed in an ecologically-valid manner. We tested typically-developed (TD) adults low or high in autistic-like traits (Experiment 1), and adults with high-functioning autism (HFA; Experiment 2). All groups fixated more on the eyes than on any of the other facial area, regardless of emotion and gaze direction, though the HFA group fixated less on the eyes and more on the nose than TD controls. The sequence of dynamic facial changes affected the groups similarly, with reduced attention to the eyes and increased attention to the mouth. The results suggest that dynamic emotional face scanning patterns are stereotypical and differ only modestly between TD and HFA adults.

Background: Guided gaze is the instructor's gaze towards teaching materials to guide students' attention, and it plays a vital role in enhancing video-based education. The duration of guided gaze, indicating how long instructors focus on teaching materials, varies based on the lecture design. Nevertheless, the impact of varying durations of guided gaze, especially concerning students' prior knowledge, remains inadequately understood. Objectives: This study investigates the influence of the instructor's guided gaze duration and students' prior knowledge on learning performance and affective experiences in video lectures. Methods: 145 fifth-grade students participated and were divided into high and low prior knowledge groups based on a pre-test. Within each group, students were randomly assigned to view one of three video lectures with different guided gaze durations (high vs. medium vs. low). Learning performance and affective experiences (learning experience, satisfaction, and emotions) were measured as dependent variables. Results and Conclusion: The results revealed that low guided gaze duration significantly improves learning performance for students with low prior knowledge. Conversely, high guided gaze duration negatively impacts learning experience, satisfaction, and positive emotions. Additionally, students with high prior knowledge reported higher learning experience and satisfaction. These findings highlight the interaction between guided gaze duration and prior knowledge in students' learning performance. Implications: Our findings provide valuable implications for the design of guided gaze duration in video lectures based on students' prior knowledge. By adjusting guided gaze duration appropriately, instructors can optimise students' learning performance and affective experiences.

Post-secondary data literacy education is critical to students' academic and career success. However, the literature has not adequately addressed the conceptualization and assessment of data literacy for post-secondary students. In this study, we introduced a novel digital performance-based assessment for teaching and evaluating post-secondary students' data literacy skills. The purpose of this study is to validate the assessment and identify problematic items for later modifications using the argument-based approach to validation. We analyzed students' item responses and eye movements using psychometric and eye-tracking analyses to collect two types of validity evidence: internal structure and response processes. Descriptive and psychometric results showed that the nine example items measuring basic data analysis were of acceptable psychometric quality. The eye-tracking analysis of two representative items indicated that most students first attended to and processed expected item areas when the items were available. In addition, the critical item regions for task success were associated with students' highest cognitive effort. These results rejected our alternative score interpretation that the developed assessment questions evaluate students' abilities that are weakly connected to the skill of basic data analysis. Possible explanations of the findings and theoretical and pedagogical implications of our study were discussed.

A substantial quantity of research has explored whether readers' eye movements are sensitive to the distinction between function and content words. No clear answer has emerged, in part due to the difficulty of accounting for differences in length, frequency, and predictability between the words in the two classes. Based on evidence that readers differentially overlook function word errors, we hypothesized that function words may be more frequently skipped or may receive shorter fixations. We present two very large-scale eyetracking experiments using selected sentences from a corpus of natural text, with each sentence containing a target function or content word. The target words in the two classes were carefully matched on length, frequency, and predictability, with the latter variable operationalized in terms of next-word probability obtained from the large language model GPT-2. While the experiments replicated a range of expected effects, word class did not have any clear influence on target word skipping probability, and there was some evidence for a "content" word advantage in fixation duration measures. These results indicate that readers' tendency to overlook function word errors is not due to reduced time spent encoding these words. The results also broadly support the implicit assumption in prominent models of eye movement control in reading that a word's syntactic category does not play an important role in decisions about when and where to move the eyes.

This study aims to provide a systematic review of recent eye-tracking studies conducted with children and adolescents in learning settings, as well as a scoping review of the technologies and machine learning approaches used for eye-tracking. To this end, 68 empirical studies containing 78 experiments were analyzed. Eye-tracking devices as well as the ever-evolving mechanisms of gaze prediction endorsed in the prior and current research were identified. The review results indicated a set of salient patterns governing the employment of eye-tracking measures and the inferred cognitive constructs in learning, along with the common practices in analyzing and presenting the eye-tracking data. Eye-tracking has been used to track engagement, learning interactions, and learning-relevant cognitive activities mainly in a research lab or a highly-controlled learning setting. The mechanisms of gaze capturing and prediction with learners in a dynamic and authentic learning environment are evolving.

Incidental learning is a type of informal learning occurring consciously with unintentional acts. Within the scope of this study, informal learning on a digital learning platform was examined in the context of cognitive load. The current study investigated the changes in incidental learning within two different scenarios: extraneous irrelevant content (V1) vs. extraneous relevant content (V2) represented in various modalities. Data were collected in a mixed manner using eye-tracker and electroencephalogram devices. Both incidental and actual learning scores of V2 group were higher than the V1 group. For the incidental learning context, visual modality was superior to other modalities, but the dynamic visuals were perceived as disturbing in comparison to static ones. The V1 group had higher number of errors during task engagement. The eye fixation patterns of both groups were similar to each other. Fixation durations on the dynamic visual extraneous content area were recorded the longest among all extraneous content. The V2 group reported higher mental effort. The efficiency metric calculations yielded contradictory findings depending on the cognitive load values obtained from self-ratings vs. cognitive load index (CLI).

At present, the use of eye-tracking data in immersive Virtual Reality (iVR) learning environments is set to become a powerful tool for maximizing learning outcomes, due to the low-intrusiveness of eye-tracking technology and its integration in commercial iVR Head Mounted Displays. However, the most suitable technologies for data processing should first be identified before their use in learning environments can be generalized. In this research, the use of machine-learning techniques is proposed for that purpose, evaluating their capabilities to classify the quality of the learning environment and to predict user learning performance. To do so, an iVR learning experience simulating the operation of a bridge crane was developed. Through this experience, the performance of 63 students was evaluated, both under optimum learning conditions and under stressful conditions. The final dataset included 25 features, mostly temporal series, with a dataset size of up to 50M data points. The results showed that different classifiers (KNN, SVM and Random Forest) provided the highest accuracy when predicting learning performance variations, while the accuracy of user learning performance was still far from optimized, opening a new line of future research. This study has the objective of serving as a baseline for future improvements to model accuracy using complex machine-learning techniques.

Advances in neuro-technology provide new insights into how individual students learn in educational contexts. However, applying it poses challenges for teachers in natural settings. This paper presents an example of the use and applicability of eye-tracking technology in Higher Education. We worked with a sample of 20 students from three universities (Burgos and Valladolid in Spain and Miño in Portugal). The objectives were: (1) to determine whether there were significant differences in indicators of cognitive effort (FC, FD, SC, PD, VC) found with eye-tracking technology between students with and without prior knowledge; (2) to determine whether there were clusters of learning behavior patterns among students; and (3) to analyze differences in the visualization of behavior patterns. A quasi-experimental design without a control group and a descriptive design were used. The results indicated significant differences in learning outcomes between students with and without prior knowledge. In addition, two clusters were found in indicators of cognitive effort. Finally, a comparative analysis of learning behavior patterns between students in cluster 1 vs. cluster 2 was performed. Eye-tracking technology makes it possible to record large data about the learning process. However, using it in natural educational settings currently requires teachers to have technological and data mining skills.

The utilization of new technologies in teaching and learning is always one of the main concerns of the educational system. The increasing development of technology has caused comprehensive changes, especially in education. In this regard, Augmented Reality (AR) is one of these important educational technologies. AR creates an interaction between the real world and virtual objects, which creates a bridge between traditional educational tools and the technology, and this can affect student performance. This study was conducted to investigate the effect of AR on the level of attention of first elementary students in an experimental sciences course. To achieve this goal, the focused and sustained attention of 30 female students while using the software was measured in two groups lecture method and learning using AR through an eye tracker. The results of the t-test for the two components of focused attention and sustained attention indicate the effectiveness of AR in promoting students' attention. The findings of this study have important implications for learning stakeholders about the effect of AR as an educational and interactive tool on the attention of first elementary students in the course of experimental sciences.

Inclusive learning environments, in which children on the autism spectrum (AS) are educated alongside with neurotypical children, are being implemented by governments across Europe and world-wide. The rapid change towards implementing inclusive learning environments has resulted, however, in scarce research reports using multimodal data collected on social interactions in such environments. To this, our study presents a novel experimental multi-method research design to holistically capture natural interactions between children on the AS and neurotypical children in inclusive learning settings through multimodal data collection tools involving well-established as well as emerging educational technologies and methods: mobile eye tracking, wide-angle video cameras and video stimulated accounts (VSA). The children's perspectives regarding the practical research design implementation, as reflected in feedback forms collected, indicate that a relatively unobtrusive and non-distracting collection of multimodal data is achievable through sufficient planning and participatory strategies. This work contributes with a new multi-method research design to gather multimodal data in inclusive learning environments, looking at better understanding and strengthening children's social interactions. The multi-method research design described here can also be applied to other contexts, such as after-school activities or group therapy sessions.

Atypical habituation to repetitive information has been commonly reported in Autism Spectrum Disorder (ASD) but it is not yet clear whether similar abnormalities are present in Neurofibromatosis Type 1 (NF1). We employed a cross-syndrome design using a novel eye tracking paradigm to measure habituation in preschoolers with NF1, children with idiopathic ASD and typically developing (TD) children. Eye movements were recorded to examine fixation duration to simultaneously presented repeating and novel stimuli. Children with NF1 showed a bias for longer look durations to repeating stimuli at the expense of novel stimuli, and slower habituation in NF1 was associated with elevated ASD traits. These findings could indicate aberrant modulation of bottom-up attentional networks that interact with the emergence of ASD phenotypes.

Students with Autism Spectrum Disorder (ASD) tend to struggle with reading comprehension, often resulting in difficulties with inference generation. While most of the previous research has focused on the product of comprehension, we report a preliminary validation of an experimental reading task in English to measure, by means of eye-movements, the time course of generating consistent and inconsistent inferences during reading. The task was tested with a group of 12 students with ASD (age range: 10-15) who showed accuracy differences between inference and control conditions. Participants spent longer reading in the inconsistent than control condition regarding go past times and second pass times and made more regressions into the target and post-target regions, but these differences were not significant.

Acquisition of visual attention-following skills, notably gaze- and point-following, contributes to infants' ability to share attention with caregivers, which in turn contributes to social learning and communication. However, the development of gaze- and point-following in the first 18 months remains controversial, in part because of different testing protocols and standards. To address this, we longitudinally tested N = 43 low-risk, North American middle-class infants' tendency to follow gaze direction, pointing gestures, and gaze-and-point combinations. Infants were tested monthly from 4 to 12 months of age. To control motivational differences, infants were taught to expect contingent reward videos in the target locations. No-cue trials were included to estimate spontaneous target fixation rates. A comparison sample (N = 23) was tested at 9 and 12 months to estimate practice effects. Results showed gradual increases in both gaze- and point-following starting around 7 months, and modest month-to-month individual stability from 8 to 12 months. However, attention-following did not exceed chance levels until after 6 months. Infants rarely followed cues to locations behind them, even at 12 months. Infants followed combined gaze-and-point cues more than gaze alone, and followed points at intermediate levels (not reliably different from the other cues). The comparison group's results showed that practice effects did not explain the age-related increase in attention-following. The results corroborate and extend previous findings that North American middle-class infants' attention-following in controlled laboratory settings increases slowly and incrementally between 6 and 12 months of age.

Background: Executive function (EF) plays a crucial role in children's reading. However, previous studies were based on offline products of reading comprehension. Online research is needed to reveal the core mechanisms underlying children's reading processing. By measuring children's working memory (WM) and cognitive flexibility (CF), we investigated whether individual differences in EF could modulate sentence processing and, if so, how they exert their roles. Methods: The present study manipulated semantic congruency and the association between crucial words in a sentence. We recruited 89 Chinese children aged 9-12 years and monitored their eye movement. Results: The study revealed distinct associations between reader- and text-related characteristics, as evidenced by eye-movement patterns during reading. A significant incongruency effect was observed in reading, underscoring the children's capacity to discern incongruent information. Children's WM and CF were found to modulate this process. Specifically, high-WM children showed more effective integration of incongruent information when the textual context was closely related during the later-stage processing. In contrast, low-WM children faced more challenges with incongruent words. Additionally, CF was influential during the early processing period. High-CF children exhibited longer early-stage reading times for incongruent words in associated contexts. Conclusions: Individual differences in EF can modulate children's online sentence processing. However, different EF components may play different roles.

This study aims to shed light on the contribution of universal versus language specific factors on reading. We examined eye movements of Arabic readers and analyzed effects specific to Arabic such as perceptual complexity, diglossia and morphology, in addition to universal factors such as word length and frequency. Twenty native Arabic speakers read continuous texts in Modern Standard Arabic (MSA) while their eye movements were monitored. A corpus-based analyses was carried to test effects specific to Arabic and effects of the benchmark eye movement factors. We found that perceptually more complex words received longer fixation durations, moreover, differences in processing words unique in MSA versus words shared between MSA and spoken Arabic Vernacular were found. This is the first indication for these effects during an eye movement reading task. However, the effect of morphological length was not significant when included in the model with all predictors. Lastly, the benchmark factors were significant showing effects for word length, word frequency and part of speech. Short and frequent words are processed faster than longer and less frequent words. Function words are often skipped. We conclude that eye movement of Arabic readers reflect proficient reading, yet they also exhibit an on-going challenge in processing the written language.

We report the results of one visual-world eye-tracking experiment and two referent selection tasks in which we investigated the effects of information structure in the form of prosody and word order manipulation on the processing of subject pronouns "er" and "der" in German. Factors such as subjecthood, focus, and topicality, as well as order of mention have been linked to an increased probability of certain referents being selected as the pronoun's antecedent and described as increasing this referent's prominence, salience, or accessibility. The goal of this study was to find out whether pronoun processing is primarily guided by linguistic factors (e.g., grammatical role) or nonlinguistic factors (e.g., first-mention), and whether pronoun interpretation can be described in terms of referents' "prominence" / "accessibility" / "salience." The results showed an overall subject preference for "er," whereas "der" was affected by the object role and focus marking. While focus increases the attentional load and enhances memory representation for the focused referent making the focused referent more available, ultimately it did not affect the final interpretation of "er," suggesting that "prominence" or the related concepts do not explain referent selection preferences. Overall, the results suggest a primacy of linguistic factors in determining pronoun resolution.

With the increased sophistication of technology, humans have the possibility to offload a variety of tasks to algorithms. Here, we investigated whether the extent to which people are willing to offload an attentionally demanding task to an algorithm is modulated by the availability of a bonus task and by the knowledge about the algorithm's capacity. Participants performed a multiple object tracking (MOT) task which required them to visually track targets on a screen. Participants could offload an unlimited number of targets to a "computer partner". If participants decided to offload the entire task to the computer, they could instead perform a bonus task which resulted in additional financial gain - however, this gain was conditional on a high performance accuracy in the MOT task. Thus, participants should only offload the entire task if they trusted the computer to perform accurately. We found that participants were significantly more willing to completely offload the task if they were informed beforehand that the computer's accuracy was flawless (Experiment 1 vs. 2). Participants' offloading behavior was not significantly affected by whether the bonus task was incentivized or not (Experiment 2 vs. 3). These results combined with those from our previous study (Wahn et al. in PLoS ONE 18:e0286102, 2023), which did not include a bonus task but was identical otherwise, show that the human willingness to offload an attentionally demanding task to an algorithm is considerably boosted by the availability of a bonus task - even if not incentivized - and by the knowledge about the algorithm's capacity.