Search

The definition of the visual cortex is primarily based on the evidence that lesions of this area impair visual perception. However, this does not exclude that the visual cortex may process more information than of retinal origin alone, or that other brain structures contribute to vision. Indeed, research across the past decades has shown that non-visual information, such as neural activity related to reward expectation and value, locomotion, working memory and other sensory modalities, can modulate primary visual cortical responses to retinal inputs. Nevertheless, the function of this non-visual information is poorly understood. Here we review recent evidence, coming primarily from studies in rodents, arguing that non-visual and motor effects in visual cortex play a role in visual processing itself, for instance disentangling direct auditory effects on visual cortex from effects of sound-evoked orofacial movement. These findings are placed in a broader framework casting vision in terms of predictive processing under control of frontal, reward- and motor-related systems. In contrast to the prevalent notion that vision is exclusively constructed by the visual cortical system, we propose that visual percepts are generated by a larger network—the extended visual system—spanning other sensory cortices, supramodal areas and frontal systems. This article is part of the theme issue 'Decision and control processes in multisensory perception'. [ABSTRACT FROM AUTHOR]

Primary sensory areas constitute crucial nodes during perceptual decision making. However, it remains unclear to what extent they mainly constitute a feedforward processing step, or rather are continuously involved in a recurrent network together with higher-order areas. We found that the temporal window in which primary visual cortex is required for the detection of identical visual stimuli was extended when task demands were increased via an additional sensory modality that had to be monitored. Late-onset optogenetic inactivation preserved bottom-up, early-onset responses which faithfully encoded stimulus features, and was effective in impairing detection only if it preceded a late, report-related phase of the cortical response. Increasing task demands were marked by longer reaction times and the effect of late optogenetic inactivation scaled with reaction time. Thus, independently of visual stimulus complexity, multisensory task demands determine the temporal requirement for ongoing sensory-related activity in V1, which overlaps with report-related activity. How primary sensory cortices contribute to decision making remains poorly understood. Here the authors report that increasing task demands extend the temporal window in which the primary visual cortex is required for detecting identical stimuli. [ABSTRACT FROM AUTHOR]

The posterior parietal cortex (PPC) plays a key role in integrating sensory inputs from different modalities to support adaptive behavior. Neuronal activity in PPC reflects perceptual decision-making across behavioral tasks, but the mechanistic involvement of PPC is unclear. In an audiovisual change detection task, we tested the hypothesis that PPC is required to arbitrate between the noisy inputs from the two different modalities and help decide in which modality a sensory change occurred. In trained male mice, we found extensive single-neuron and population-level encoding of task-relevant visual and auditory stimuli, trial history, as well as upcoming behavioral responses. However, despite these rich neural correlates, which would theoretically be sufficient to solve the task, optogenetic inactivation of PPC did not affect visual or auditory performance. Thus, despite neural correlates faithfully tracking sensory variables and predicting behavioral responses, PPC was not relevant for audiovisual change detection. This functional dissociation questions the role of sensory- and task-related activity in parietal associative circuits during audiovisual change detection. Furthermore, our results highlight the necessity to dissociate functional correlates from mechanistic involvement when exploring the neural basis of perception and behavior. [ABSTRACT FROM AUTHOR]