Search

An observer's pupil dilates and constricts in response to variables such as ambient and focal luminance, cognitive effort, the emotional stimulus content, and working memory load. The pupil's memory load response is of particular interest, as it might be used for estimating observers' memory load while they are performing a complex task, without adding an interruptive and confounding memory test to the protocol. One important task in which working memory's involvement is still being debated is visual search, and indeed a previous experiment by Porter, Troscianko, and Gilchrist (Quarterly Journal of Experimental Psychology, 60, 211-229, 2007) analyzed observers' pupil sizes during search to study this issue. These authors found that pupil size increased over the course of the search, and they attributed this finding to accumulating working memory load. However, since the pupil response is slow and does not depend on memory load alone, this conclusion is rather speculative. In the present study, we estimated working memory load in visual search during the presentation of intermittent fixation screens, thought to induce a low, stable level of arousal and cognitive effort. Using standard visual search and control tasks, we showed that this paradigm reduces the influence of non-memory-related factors on pupil size. Furthermore, we found an early increase in working memory load to be associated with more efficient search, indicating a significant role of working memory in the search process.

When we look at real-world scenes, attention seems disproportionately attracted by texts that are embedded in these scenes, for instance, on signs or billboards. The present study was aimed at verifying the existence of this bias and investigating its underlying factors. For this purpose, data from a previous experiment were reanalyzed and four new experiments measuring eye movements during the viewing of real-world scenes were conducted. By pairing text objects with matching control objects and regions, the following main results were obtained: (a) Greater fixation probability and shorter minimum fixation distance of texts confirmed the higher attractiveness of texts; (b) the locations where texts are typically placed contribute partially to this effect; (c) specific visual features of texts, rather than typically salient features (e.g., color, orientation, and contrast), are the main attractors of attention; (d) the meaningfulness of texts does not add to their attentional capture; and (e) the attraction of attention depends to some extent on the observer's familiarity with the writing system and language of a given text.

Generalized social anxiety disorder (GSAD) is characterized by excessive fears of scrutiny and negative evaluation, but neural circuitry related to scrutiny in GSAD has been little studied. In this study, 16 unmedicated adults with GSAD and 16 matched healthy comparison (HC) participants underwent functional magnetic resonance imaging to assess neural response to viewed images of faces simulating movement into eye contact versus away from eye contact. GSAD patients were then treated for 8 weeks with paroxetine, and 15 patients were re-imaged. At baseline, GSAD patients had elevated neural response to eye contact in parahippocampal cortex, inferior parietal lobule, supramarginal gyrus, posterior cingulate and middle occipital cortex. During paroxetine treatment, symptomatic improvement was associated with decreased neural response to eye contact in regions including inferior and middle frontal gyri, anterior cingulate, posterior cingulate, precuneus and inferior parietal lobule. Both the magnitude of GSAD symptom reduction with paroxetine treatment and the baseline comparison of GSAD vs. HCs were associated with neural processing of eye contact in distributed networks that included regions involved in self-referential processing. These findings demonstrate that eye contact in GSAD engages neurocircuitry consistent with the heightened self-conscious emotional states known to characterize GSAD patients during scrutiny., (2011 Elsevier Ireland Ltd. All rights reserved.)

The perception of objects in our visual world is influenced by not only their low-level visual features such as shape and color, but also their high-level features such as meaning and semantic relations among them. While it has been shown that low-level features in real-world scenes guide eye movements during scene inspection and search, the influence of semantic similarity among scene objects on eye movements in such situations has not been investigated. Here we study guidance of eye movements by semantic similarity among objects during real-world scene inspection and search. By selecting scenes from the LabelMe object-annotated image database and applying latent semantic analysis (LSA) to the object labels, we generated semantic saliency maps of real-world scenes based on the semantic similarity of scene objects to the currently fixated object or the search target. An ROC analysis of these maps as predictors of subjects' gaze transitions between objects during scene inspection revealed a preference for transitions to objects that were semantically similar to the currently inspected one. Furthermore, during the course of a scene search, subjects' eye movements were progressively guided toward objects that were semantically similar to the search target. These findings demonstrate substantial semantic guidance of eye movements in real-world scenes and show its importance for understanding real-world attentional control., (Copyright © 2011 Elsevier Ltd. All rights reserved.)

Can people react to objects in their visual field that they do not consciously perceive? We investigated how visual perception and motor action respond to moving objects whose visibility is reduced, and we found a dissociation between motion processing for perception and for action. We compared motion perception and eye movements evoked by two orthogonally drifting gratings, each presented separately to a different eye. The strength of each monocular grating was manipulated by inducing adaptation to one grating prior to the presentation of both gratings. Reflexive eye movements tracked the vector average of both gratings (pattern motion) even though perceptual responses followed one motion direction exclusively (component motion). Observers almost never perceived pattern motion. This dissociation implies the existence of visual-motion signals that guide eye movements in the absence of a corresponding conscious percept.

Latent semantic analysis (LSA) and transitional probability (TP), two computational methods used to reflect lexical semantic representation from large text corpora, were employed to examine the effects of word predictability on Chinese reading. Participants' eye movements were monitored, and the influence of word complexity (number of strokes), word frequency, and word predictability on different eye movement measures (first-fixation duration, gaze duration, and total time) were examined. We found influences of TP on first-fixation duration and gaze duration and of LSA on total time. The results suggest that TP reflects an early stage of lexical processing while LSA reflects a later stage.

Recently, there has been great interest among vision researchers in developing computational models that predict the distribution of saccadic endpoints in naturalistic scenes. In many of these studies, subjects are instructed to view scenes without any particular task in mind so that stimulus-driven (bottom-up) processes guide visual attention. However, whenever there is a search task, goal-driven (top-down) processes tend to dominate guidance, as indicated by attention being systematically biased toward image features that resemble those of the search target. In the present study, we devise a top-down model of visual attention during search in complex scenes based on similarity between the target and regions of the search scene. Similarity is defined for several feature dimensions such as orientation or spatial frequency using a histogram-matching technique. The amount of attentional guidance across visual feature dimensions is predicted by a previously introduced informativeness measure. We use eye-movement data gathered from participants' search of a set of naturalistic scenes to evaluate the model. The model is found to predict the distribution of saccadic endpoints in search displays nearly as accurately as do other observers' eye-movement data in the same displays.

Previous research indicates that removing initial strokes from Chinese characters makes them harder to read than removing final or internal ones. In the present study, we examined the contribution of important components to character configuration via singular value decomposition. The results indicated that when the least important segments, which did not seriously alter the configuration (contour) of the character, were deleted, subjects read as fast as when no segments were deleted. When the most important segments, which are located in the left side of a character and written first, were deleted, reading speed was greatly slowed. These results suggest that singular value decomposition, which has no information about stroke writing order, can identify the most important strokes for Chinese character identification. Furthermore, they also suggest that contour may be correlated with stroke writing order. (Contains 3 tables and 8 figures.)

Background: Prior studies of oculomotor function in Parkinson's disease (PD) have either focused on saccades without considering smooth pursuit, or tested smooth pursuit while excluding saccades. The present study investigated the control of saccadic eye movements during pursuit tasksand assessed the quality of binocular coordinationas potential sensitive markers of PD. Methods: Observers fixated on a central cross while a target moved toward it. Once the target reached the fixation cross, observers began to pursue the moving target. To further investigate binocular coordination, the moving target was presented on both eyes (binocular condition), or on one eye only (dichoptic condition). Results: The PD group made more saccades than age-matched normal control adults (NC) both during fixation and pursuit. The difference between left and right gaze positions increased over time during the pursuit period for PD but not for NC. The findings were not related to age, as NC and young-adult control group (YC) performed similarly on most of the eye movement measures, and were not correlated with classical measures of PD severity (e.g., Unified Parkinson's Disease Rating Scale (UPDRS) score). Discussion: Our results suggest that PD may be associated with impairment not only in saccade inhibition, but also in binocular coordination during pursuit, and these aspects of dysfunction may be useful in PD diagnosis or tracking of disease course. [ABSTRACT FROM AUTHOR]

It is currently unknown whether changes to the oculomotor system can induce changes to the distribution of spatial attention around a fixated target. Previous studies have used perceptual performance tasks to show that adaptation of saccadic eye movements affects dynamic properties of visual attention, in particular, attentional shifts to a cued location. In this study, we examined the effects of saccadic adaptation on the static distribution of visual attention around fixation (attentional field). We used the classic double step adaptation procedure and a flanker task to test for differences in the attentional field after forward and backward adaptation. Reaction time (RT) measures revealed that the shape of the attentional field changed significantly after backward adaptation as shown through altered interference from distracters at different eccentricities but not after forward adaptation. This finding reveals that modification of saccadic amplitudes can affect metrics of not only dynamic properties of attention but also its static properties. A major implication is that the neural mechanisms underlying fundamental selection mechanisms and the oculomotor system can reweight each other. [ABSTRACT FROM AUTHOR]

Previous research indicates that removing initial strokes from Chinese characters makes them harder to read than removing final or internal ones. In the present study, we examined the contribution of important components to character configuration via singular value decomposition. The results indicated that when the least important segments, which did not seriously alter the configuration (contour) of the character, were deleted, subjects read as fast as when no segments were deleted. When the most important segments, which are located in the left side of a character and written first, were deleted, reading speed was greatly slowed. These results suggest that singular value decomposition, which has no information about stroke writing order, can identify the most important strokes for Chinese character identification. Furthermore, they also suggest that contour may be correlated with stroke writing order. [ABSTRACT FROM AUTHOR]

Latent semantic analysis (LSA) and transitional probability (TP), two computational methods used to reflect lexical semantic representation from large text corpora, were employed to examine the effects of word predictability on Chinese reading. Participants' eye movements were monitored, and the influence of word complexity (number of strokes), word frequency, and word predictability on different eye movement measures (first-fixation duration, gaze duration, and total time) were examined. We found influences of TP on first-fixation duration and gaze duration and of LSA on total time. The results suggest that TP reflects an early stage of lexical processing while LSA reflects a later stage. [ABSTRACT FROM AUTHOR]

Abstract: Inspection time (IT) is the most popular simple psychometric measure that is used to account for a large part of the variance in human mental ability, with the estimated corrected correlation between IT and IQ being −0.50. In this study, we investigate the relationship between IT and the performance and oculomotor variables measured during three simple visual tasks. Participants’ ITs were first measured using a slight variation of the standard IT task, which was followed by the three simple visual tasks that were designed to test participants’ visual–attentional control and visual working memory under varying degrees of difficulty; they included a visual search task, a comparative visual search task, and a visual memorization task. Significant correlations were found between IT and performance variables for each of the visual tasks. The implications of the correlation between IT and performance-related variables are discussed. Oculomotor variables on the other hand only correlated significantly with IT during the retrieval phase of the visual memorization task, which is likely a product of differences in participants’ ability to memorize objects during the loading phase of the experiment. This leads us to the conclusion that the oculomotor variables we measured do not correlate with IT in general, but may in the case where a systematic benefit would be realized. [Copyright &y& Elsevier]

Perceptual integration of audio—visual stimuli is fundamental to our everyday conscious experience. Eye-movement analysis may be a suitable tool for studying such integration, since eye movements respond to auditory as well as visual input. Previous studies have shown that additional auditory cues in visual-search tasks can guide eye movements more efficiently and reduce their latency. However, these auditory cues were task-relevant since they indicated the target position and onset time. Therefore, the observed effects may have been due to subjects using the cues as additional information to maximize their performance, without perceptually integrating them with the visual displays. Here, we combine a visual-tracking task with a continuous, task-irrelevant sound from a stationary source to demonstrate that audio—visual perceptual integration affects low-level oculomotor mechanisms. Auditory stimuli of constant, increasing, or decreasing pitch were presented. All sound categories induced more smooth-pursuit eye movement than silence, with the greatest effect occurring with stimuli of increasing pitch. A possible explanation is that integration of the visual scene with continuous sound creates the perception of continuous visual motion. Increasing pitch may amplify this effect through its common association with accelerating motion. [ABSTRACT FROM AUTHOR]

Abstract: Visual search is a fundamental and routine task of everyday life. Studying visual search promises to shed light on the basic attentional mechanisms that facilitate visual processing. To investigate visual attention during search processes, numerous studies measured the selectivity of observers’ saccadic eye movements for local display features. These experiments almost entirely relied on simple, artificial displays with discrete search items and features. The present study employed complex search displays and targets to examine task-driven (top-down) visual guidance by low-level features under more natural conditions. Significant guidance by local intensity, contrast, spatial frequency, and orientation was found, and its properties such as magnitude and resolution were analyzed across dimensions. Moreover, feature-ratio effects were detected, which correspond to distractor-ratio effects in simple search displays. These results point out the limitations of current purely stimulus-driven (bottom-up) models of attention during scene perception. [Copyright &y& Elsevier]

The Area Activation Model (Pomplun, Reingold, Shen, & Williams, 2000) is a computational model predicting the statistical distribution of saccadic endpoints in visual search tasks. Its basic assumption is that saccades in visual search tend to foveate display areas that provide a maximum amount of task-relevant information for processing during the subsequent fixation. In the present study, a counterintuitive prediction by the model is empirically tested, namely that saccadic selectivity towards stimulus features depends on the spatial arrangement of search items. We find good correspondence between simulated and empirically observed selectivity patterns, providing strong support for the Area Activation Model. [Copyright &y& Elsevier]

Examines the eye movements of chess players in attempts to choose the best move. Evaluation on the fixation trials and amplitude cascades; Ability of expert player to encode chess configurations to guide peripheral movements of the eye; Production of patterns in saccadic selectivity by piece saliency.

We address the question of inferring the search target from fixation behavior in visual search. Such inference is possible since during search, our attention and gaze are guided toward visual features similar to those in the search target. We strive to answer two fundamental questions: what are the most powerful algorithmic principles for this task, and how does their performance depend on the amount of available eye movement data and the complexity of the target objects? In the first two experiments, we choose a random-dot search paradigm to eliminate contextual influences on search. We present an algorithm that correctly infers the target pattern up to 50 times as often as a previously employed method and promises sufficient power and robustness for interface control. Moreover, the current data suggest a principal limitation of target inference that is crucial for interface design: if the target pattern exceeds a certain spatial complexity level, only a subpattern tends to guide the observers׳ eye movements, which drastically impairs target inference. In the third experiment, we show that it is possible to predict search targets in natural scenes using pattern classifiers and classic computer vision features significantly above chance. The availability of compelling inferential algorithms could initiate a new generation of smart, gaze-controlled interfaces and wearable visual technologies that deduce from their users׳ eye movements the visual information for which they are looking. In a broader perspective, our study shows directions for efficient intent decoding from eye movements. [ABSTRACT FROM AUTHOR]

A previous study (Vision Research 51 (2011) 1192–1205) found evidence for semantic guidance of visual attention during the inspection of real-world scenes, i.e., an influence of semantic relationships among scene objects on overt shifts of attention. In particular, the results revealed an observer bias toward gaze transitions between semantically similar objects. However, this effect is not necessarily indicative of semantic processing of individual objects but may be mediated by knowledge of the scene gist, which does not require object recognition, or by known spatial dependency among objects. To examine the mechanisms underlying semantic guidance, in the present study, participants were asked to view a series of displays with the scene gist excluded and spatial dependency varied. Our results show that spatial dependency among objects seems to be sufficient to induce semantic guidance. Scene gist, on the other hand, does not seem to affect how observers use semantic information to guide attention while viewing natural scenes. Extracting semantic information mainly based on spatial dependency may be an efficient strategy of the visual system that only adds little cognitive load to the viewing task. [ABSTRACT FROM AUTHOR]

The distractor-ratio effect refers to the finding that search performance in a conjunctive visual search task depends on the relative frequency of two types or subsets of distractors when the total number of items in a display is fixed. Previously, Shen, Reingold, and Pomplun (2000) examined participants' patterns of eye movements in a distractor-ratio paradigm and demonstrated that on any given trial saccadic endpoints were biased towards the smaller subset of distractors and participants flexibly switched between different subsets across trials. The current study explored the boundary conditions of this tendency to flexibly search through a smaller subset of distractors by examining the influence of several manipulations known to modulate search efficiency, including stimulus discriminability (Experiment 1), within-dimension versus crossdimension conjunction search and distractor heterogeneity (Experiment 2). The results indicated that the flexibility of visual guidance and saccadic bias exemplified by the distractor-ratio effect is a robust phenomenon that mediates search efficiency by adapting to changes in the relative informativeness of stimulus dimensions and features. [ABSTRACT FROM AUTHOR]