Search

Contains fulltext : 292672.pdf (Publisher’s version ) (Open Access) Mental simulation is an important aspect of narrative reading. In a previous study, we found that gaze durations are differentially impacted by different kinds of mental simulation. Motor simulation, perceptual simulation, and mentalizing as elicited by literary short stories influenced eye movements in distinguishable ways (Mak & Willems, 2019). In the current study, we investigated the existence of a common neural locus for these different kinds of simulation. We additionally investigated whether individual differences during reading, as indexed by the eye movements, are reflected in domain-specific activations in the brain. We found a variety of brain areas activated by simulation-eliciting content, both modality-specific brain areas and a general simulation area. Individual variation in percent signal change in activated areas was related to measures of story appreciation as well as personal characteristics (i.e., transportability, perspective taking). Taken together, these findings suggest that mental simulation is supported by both domain-specific processes grounded in previous experiences, and by the neural mechanisms that underlie higher-order language processing (e.g., situation model building, event indexing, integration). 21 p.

Whereas social visual attention has been examined in computer-mediated (e.g., shared screen) or video-mediated (e.g., FaceTime) interaction, it has yet to be studied in mixed-media interfaces that combine video of the conversant along with other UI elements. We analyzed eye gaze of 37 dyads (74 participants) who were tasked with negotiating the price of a new car (as a buyer and seller) using mixed-media video conferencing under competitive or cooperative negotiation instructions (experimental manipulation). We used multidimensional recurrence quantification analysis to extract spatio-temporal patterns corresponding to mutual gaze (individuals look at each other), joint attention (individuals focus on the same elements of the interface), and gaze aversion (an individual looks at their partner, who is looking elsewhere). Our results indicated that joint attention predicted the sum of points attained by the buyer and seller (i.e., the joint score). In contrast, gaze aversion was associated with faster time to complete the negotiation, but with a lower joint score. Unexpectedly, mutual gaze was highly infrequent and unrelated to the negotiation outcomes and none of the gaze patterns predicted subjective perceptions of the negotiation. There were also no effects of gender composition or negotiation condition on the gaze patterns or negotiation outcomes. Our results suggest that social visual attention may operate differently in mixed-media collaborative interfaces than in face-to-face interaction. As mixed-media collaborative interfaces gain prominence, our work can be leveraged to inform the design of gaze-sensitive user interfaces that support remote negotiations among other tasks.

During mind wandering, visual processing of external information is attenuated. Accordingly, mind wandering is associated with changes in gaze behaviors, albeit findings are inconsistent in the literature. This heterogeneity obfuscates a complete view of the moment-to-moment processing priorities of the visual system during mind wandering. We hypothesize that this observed heterogeneity is an effect of idiosyncrasy across tasks with varying spatial allocation demands, visual processing demands, and discourse processing demands and reflects a strategic, compensatory shift in how the visual system operates during mind wandering. We recorded eye movements and mind wandering (via thought-probes) as 132 college-aged adults completed a battery of 7 short (6 min) tasks with different visual demands. We found that for tasks requiring extensive sampling of the visual field, there were fewer fixations, and, depending on the specific task, fixations were longer and/or more dispersed. This suggests that visual sampling is sparser and potentially slower and more dispersed to compensate for the decreased sampling rate during mind wandering. For tasks that demand centrally focused gaze, mind wandering was accompanied by more exploratory eye movements, such as shorter and more dispersed fixations as well as larger saccades. Gaze behaviors were not reliably associated with mind wandering during a film comprehension task. These findings provide insight into how the visual system prioritizes external information when attention is focused inward and indicates the importance of task demands when assessing the relationship between eye movements, visual processing, and mind wandering. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Prospective memory (PM) enables people to remember to complete important tasks in the future. Failing to do so can result in consequences of varying severity. Here, we investigated how PM error-consequence severity impacts the neural processing of relevant cues for triggering PM and the ramification of that processing on the associated prospective task performance. Participants role-played a cafeteria worker serving lunches to fictitious students and had to remember to deliver an alternative lunch to students (as PM cues) who would otherwise experience a moderate or severe aversive reaction. Scalp-recorded, event-related potential (ERP) measures showed that the early-latency frontal positivity, reflecting the perception-based neural responses to previously learned stimuli, did not differ between the severe versus moderate PM cues. In contrast, the longer-latency parietal positivity, thought to reflect full PM cue recognition and post-retrieval processes, was elicited earlier by the severe than the moderate PM cues. This faster instantiation of the parietal positivity to the severe-consequence PM cues was then followed by faster and more accurate behavioral responses. These findings indicate how the relative importance of a PM can be neurally instantiated in the form of enhanced and faster PM-cue recognition and processing and culminate into better PM.

The striatum receives dense dopaminergic projections making it a key region of the dopaminergic system. Its dysfunction has been implicated in various conditions including Parkinson’s disease and substance use disorder. However, the investigation of dopamine-specific functioning in humans is problematic as the striatum is highly interconnected and current MRI approaches are unable to differentiate between dopaminergic and other projections. Here, we demonstrate that “connectopic mapping” –a novel approach for characterizing fine-grained and overlapping modes of functional connectivity– can be used to map dopaminergic projections and as such, enables the investigation of dopamine-related functioning both in health and disease.We applied connectopic mapping to resting-state functional MRI data of the Human Connectome Project (population cohort; N=839) and selected the second-order striatal connectivity mode for further analyses. We first validated its specificity to dopaminergic projections by demonstrating a very high spatial correlation (r=0.884) with dopamine transporter availability –a marker of dopaminergic projections– derived from DaT-SPECT scans of 209 healthy control subjects of the Parkinson’s Progression Markers Initiative. Next, we obtained the subject-specific second-order modes from 20 controls, and 39 Parkinson’s disease patients scanned under placebo and under dopamine replacement therapy (L-DOPA), and show that our proposed marker of dopamine function indeed tracks Parkinson’s disease diagnosis, symptom severity and sensitivity to L-DOPA. Finally, across 30 daily alcohol users and 38 daily smokers of the Human Connectome Project, we establish strong associations between the second-order striatal connectivity mode and self-reported weekly use of alcohol and nicotine.Our findings provide compelling evidence that the second-order mode of functional connectivity in striatum maps onto dopaminergic projections, tracks inter-individual differences in symptom severity and L-DOPA sensitivity in Parkinson’s disease patients, and exhibits strong associations with levels of nicotine and alcohol use in a population-based cohort. We hereby provide a new biomarker for dopamine-related dysfunction in the human brain with potential clinical utility that could foster insights into the neurobiological underpinnings of various dopamine-associated conditions.

This article explores the relationship between low- and high-level aspects of reading by studying the interplay between word processing, as measured with eye tracking, and narrative absorption and liking, as measured with questionnaires. Specifically, we focused on how individual differences in sensitivity to lexical word characteristics—measured as the effect of these characteristics on gaze duration—were related to narrative absorption and liking. By reanalyzing a large data set consisting of three previous eye-tracking experiments in which subjects (N = 171) read literary short stories, we replicated the well-established finding that word length, lemma frequency, position in sentence, age of acquisition, and orthographic neighborhood size of words influenced gaze duration. More importantly, we found that individual differences in the degree of sensitivity to three of these word characteristics, i.e., word length, lemma frequency, and age of acquisition, were negatively related to print exposure and to a lesser degree to narrative absorption and liking. Even though the underlying mechanisms of this relationship are still unclear, we believe the current findings underline the need to map out the interplay between, on the one hand, the technical and, on the other hand, the subjective processes of reading by studying reading behavior in more natural settings.

When two people read the same story, they might both end up liking it very much. However, this does not necessarily mean that their reasons for liking it were identical. We therefore ask what factors contribute to “liking” a story, and—most importantly—how people vary in this respect. We found that readers like stories because they find them interesting, amusing, suspenseful and/or beautiful. However, the degree to which these components of appreciation were related to how much readers liked stories differed between individuals. Interestingly, the individual slopes of the relationships between many of the components and liking were (positively or negatively) correlated. This indicated, for instance, that individuals displaying a relatively strong relationship between interest and liking, generally display a relatively weak relationship between sadness and liking. The individual differences in the strengths of the relationships between the components and liking were not related to individual differences in expertize, a characteristic strongly associated with aesthetic appreciation of visual art. Our work illustrates that it is important to take into consideration the fact that individuals differ in how they arrive at their evaluation of literary stories, and that it is possible to quantify these differences in empirical experiments. Our work suggests that future research should be careful about “overfitting” theories of aesthetic appreciation to an “idealized reader,” but rather take into consideration variations across individuals in the reason for liking a particular story.

Vision is crucial for many everyday activities, but the mind is not always focused on what the eyes see. Mind wandering occurs frequently and is associated with attenuated visual and cognitive processing of external information. Corresponding changes in gaze behavior-namely, fewer, longer, and more dispersed fixations-suggest a shift in how the visual system samples external information. Using three computational models of visual salience and two innovative approaches for measuring semantic informativeness, the current work assessed whether these changes reflect how the visual system prioritizes visually salient and semantically informative scene content, two major determinants in most theoretical frameworks and computational models of gaze control. Findings showed that, in a static scene viewing task, fixations were allocated to scene content that was more visually salient 10 seconds prior to probe-caught, self-reported mind wandering compared to self-reported attentive viewing. The relationship between mind wandering and semantic content was more equivocal, with weaker evidence that fixations are more likely to fall on locally informative scene regions. This indicates that the visual system is still able to discriminate visually salient and semantically informative scene content during mind wandering and may fixate on such information more frequently than during attentive viewing. Theoretical implications are discussed in light of these findings.

Item does not contain fulltext Physiological limitations on the visual system require gaze to move from location to location to extract the most relevant information within a scene. Therefore, gaze provides a real-time index of the information-processing priorities of the visual system. We investigated gaze allocation during mind wandering (MW), a state where cognitive priorities shift from processing task-relevant external stimuli (i.e., the visual world) to task-irrelevant internal thoughts. In both a main study and a replication, we recorded the eye movements of college-aged adults who studied images of urban scenes and responded to pseudorandom thought probes on whether they were mind wandering or attentively viewing at the time of the probe. Probe-caught MW was associated with fewer and longer fixations, greater fixation dispersion, and more frequent eyeblinks (only observed in the main study) relative to periods of attentive scene viewing. These findings demonstrate that gaze indices typically considered to represent greater engagement with scene processing (e.g., longer fixations) can also indicate MW. In this way, the current work exhibits a need for empirical investigations and computational models of gaze control to account for MW for a more accurate representation of the moment-to-moment information-processing priorities of the visual system.

Decades of research have established that the content of language (e.g. lexical characteristics of words) predicts eye movements during reading. Here we investigate whether there exist individual differences in ‘stable’ eye movement patterns during narrative reading. We computed Euclidean distances from correlations between gaze durations time courses (word level) across 102 participants who each read three literary narratives in Dutch. The resulting distance matrices were compared between narratives using a Mantel test. The results show that correlations between the scaling matrices of different narratives are relatively weak (r ≤ .11) when missing data points are ignored. However, when including these data points as zero durations (i.e. skipped words), we found significant correlations between stories (r > .51). Word skipping was significantly positively associated with print exposure but not with self-rated attention and story-world absorption, suggesting that more experienced readers are more likely to skip words, and do so in a comparable fashion. We interpret this finding as suggesting that word skipping might be a stable individual eye movement pattern.

Contains fulltext : 220656.pdf (Publisher’s version ) (Closed access)

Contains fulltext : 208584.pdf (Publisher’s version ) (Open Access) Understanding the functional organisation of the hippocampus is crucial for understanding its role in cognition and disorders in which it is implicated. Different views have been proposed of how function is distributed along its long axis: one view suggests segregation, whereas the alternative view postulates a more gradual organisation. Here, we applied a novel 'connectopic mapping' data-analysis approach to the resting-state fMRI data of participants of the Human Connectome Project, and demonstrate that the functional organisation of the hippocampal longitudinal axis is gradual rather than segregated into parcels. In addition, we show that inter-individual variations in this gradual organisation predict variations in recollection memory better than a characterisation based on functional parcellation. These results present an important step forward in understanding the functional organisation of the human hippocampus and have important implications for translating between rodent and human research.

The last decade has seen an increase in studies investigating the neural correlates of mind wandering. Many studies have implicated the default network (DN), particularly the medial temporal lobe (MTL) subsystem of the DN (DNMTL), as a primary network activated when someone's mind is wandering ([

Mind wandering is a ubiquitous phenomenon in which attention shifts from task-related to task-unrelated thoughts. The last decade has witnessed an explosion of interest in mind wandering, but research has been stymied by a lack of objective measures, leading to a near-exclusive reliance on self-reports. We addressed this issue by developing an eye-gaze-based, machine-learned model of mind wandering during computerized reading. Data were collected in a study in which 132 participants reported self-caught mind wandering while reading excerpts from a book on a computer screen. A remote Tobii TX300 or T60 eyetracker recorded their gaze during reading. The data were used to train supervised classification models to discriminate between mind wandering and normal reading in a manner that would generalize to new participants. We found that at the point of maximal agreement between the model-based and self-reported mind-wandering means (smallest difference between the group-level means: M model = .310, M self = .319), the participant-level mind-wandering proportional distributions were similar and were significantly correlated (r = .400). The model-based estimates were internally consistent (r = .751) and predicted text comprehension more strongly than did self-reported mind wandering (r model = −.374, r self = −.208). Our results also indicate that a robust strategy of probabilistically predicting mind wandering in cases with poor or missing gaze data led to improved performance on all metrics, as compared to simply discarding these data. Our findings demonstrate that an automated objective measure might be available for laboratory studies of mind wandering during reading, providing an appealing alternative or complement to self-reports.

The field of psychology of time has typically distinguished between prospective timing and retrospective duration estimation: in prospective timing, participants attend to and encode time, whereas in retrospective estimation, estimates are based on the memory of what happened. Prior research on prospective timing has primarily focused on attentional mechanisms to explain timing behavior, but it remains unclear the extent to which memory processes may also play a role. The present studies investigate this issue, and specifically, the role of newly learned encoded event structure. Two structural properties of dynamic event sequences were examined, which are known to modulate retrospective duration estimates: the perceived number of segments and the similarity between them. We found that when duration and episodic event content are both attended to and encoded, more segments and less similarity between them led to longer attributed durations, despite clock duration remaining constant. In contrast, when only duration is attended to, only the number of segments influenced estimated durations. These findings indicate that incidentally or intentionally encoded episodic event structure modulates prospective duration judgments. Based on these and previous findings, implications for the role of memory mechanisms on prospective paradigms are discussed. (PsycINFO Database Record

The important role that pragmatics plays in the acquisition of morphology has been hardly studied. In this contribution we focus on the pragmatic strategies of adult caretakers in their reactions to children's early morphological productions in three different languages (French, German, Lithuanian). The most relevant distinction proposed is that between metadiscursive and conversational reactions, i.e. between reactions on linguistic form and on content. In contrast to the latter, the former represent interruptions of the flow of interaction. The distribution of these two types of reactions provides the child with abundant direct and indirect positive and negative evidence about whether his/her preceding morphological production has been well formed or ill formed. Among these reactions, which may consist in reformulations, expansions, and others, we emphasize particularly repetitions and their pragmatic functions and show that they are partially specific to child-directed speech. A special type of young children's morphological productions are bare infinitives. In contrast to their grammar-theoretical accounts in generative studies, we follow a pragmatic approach, based on child-directed speech and caretakers’ reactions, which evidences the caretakers’ tolerance of ambiguity and thus the importance of inferential work in child-adult interactions. Despite great grammatical differences between French, German and Lithuanian, the pragmatic strategies used by caretakers are very similar in quality and quantity.

Every day we read about or watch events in the world and can easily understand or remember how long they last. What aspects of an event are retained in memory? And how do we extract temporal information from our memory representations? These issues are central to human cognition, as they underlie a fundamental aspect of our mental life, namely our representation of time. This paper reviews previous language studies and reports a visual learning study indicating that properties of the events encoded in memory shape the representation of their duration. The evidence indicates that for a given event, the extent to which its associated properties or sub-components differ from one another modulates our representation of its duration. These properties include the similarity between sub-events and the similarity between the situational contexts in which an event occurs. We suggest that the diversity of representations that we associate with events in memory plays an important role in remembering and estimating the duration of experienced or described events.