Search

Hearing is an active process, and recent studies show that even the ear is affected by cognitive states or motor actions. One example are movements of the eardrum induced by saccadic eye movements, known as "eye movement-related eardrum oscillations" (EMREOs). While these are systematically shaped by the direction and size of saccades, the consequences of saccadic eye movements and their resulting EMREOs for hearing remain unclear. We here studied their implications for the detection of near-threshold clicks in human participants. Across three experiments, sound detection was not affected by their time of presentation relative to saccade onset, by saccade amplitude or direction. While the EMREOs were shaped by the direction and amplitude of the saccadic movement, inducing covert shifts in spatial attention did not affect the EMREO, suggesting that this signature of active sensing is restricted to overt changes in visual focus. Importantly, in our experiments, fluctuations in the EMREO amplitude were not related to detection performance, at least when monaural cues are sufficient. Hence, while eye movements may shape the transduction of acoustic information, the behavioral implications remain to be understood. [ABSTRACT FROM AUTHOR]

Our senses often receive conflicting multisensory information, which our brain reconciles by adaptive recalibration. A classic example is the ventriloquism aftereffect, which emerges following both cumulative (long-term) and trial-wise exposure to spatially discrepant multisensory stimuli. Despite the importance of such adaptive mechanisms for interacting with environments that change over multiple timescales, it remains debated whether the ventriloquism aftereffects observed following trial-wise and cumulative exposure arise from the same neurophysiological substrate. We address this question by probing electroencephalography recordings from healthy humans (both sexes) for processes predictive of the aftereffect biases following the exposure to spatially offset audiovisual stimuli. Our results support the hypothesis that discrepant multisensory evidence shapes aftereffects on distinct timescales via common neurophysiological processes reflecting sensory inference and memory in parietal-occipital regions, while the cumulative exposure to consistent discrepancies additionally recruits prefrontal processes. During the subsequent unisensory trial, both trial-wise and cumulative exposure bias the encoding of the acoustic information, but do so distinctly. Our results posit a central role of parietal regions in shaping multisensory spatial recalibration, suggest that frontal regions consolidate the behavioral bias for persistent multisensory discrepancies, but also show that the trial-wise and cumulative exposure bias sound position encoding via distinct neurophysiological processes. [ABSTRACT FROM AUTHOR]

Biases in sensory perception can arise from both experimental manipulations and personal trait-like features. These idiosyncratic biases and their neural underpinnings are often overlooked in studies on the physiology underlying perception. A potential candidate mechanism reflecting such idiosyncratic biases could be spontaneous alpha band activity, a prominent brain rhythm known to influence perceptual reports in general. Using a temporal order judgment task, we here tested the hypothesis that alpha power reflects the overcoming of an idiosyncratic bias. Importantly, to understand the interplay between idiosyncratic biases and contextual (temporary) biases induced by experimental manipulations, we quantified this relation before and after temporal recalibration. Using EEG recordings in human participants (male and female), we find that prestimulus frontal alpha power correlates with the tendency to respond relative to an own idiosyncratic bias, with stronger a leading to responses matching the bias. In contrast, alpha power does not predict response correctness. These results also hold after temporal recalibration and are specific to the alpha band, suggesting that alpha band activity reflects, directly or indirectly, processes that help to overcome an individual's momentary bias in perception. We propose that combined with established roles of parietal α in the encoding of sensory information frontal a reflects complementary mechanisms influencing perceptual decisions. [ABSTRACT FROM AUTHOR]

The entrainment of slow rhythmic auditory cortical activity to the temporal regularities in speech is considered to be a central mechanism underlying auditory perception. Previous work has shown that entrainment is reduced when the quality of the acoustic input is degraded, but has also linked rhythmic activity at similar time scales to the encoding of temporal expectations. To understand these bottom-up and top-down contributions to rhythmic entrainment, we manipulated the temporal predictive structure of speech by parametrically altering the distribution of pauses between syllables or words, thereby rendering the local speech rate irregular while preserving intelligibility and the envelope fluctuations of the acoustic signal. Recording EEG activity in human participants, we found that this manipulation did not alter neural processes reflecting the encoding of individual sound transients, such as evoked potentials. However, the manipulation significantly reduced the fidelity of auditory delta (but not theta) band entrainment to the speech envelope. It also reduced left frontal alpha power and this alpha reduction was predictive of the reduced delta entrainment across participants. Our results show that rhythmic auditory entrainment in delta and theta bands reflect functionally distinct processes. Furthermore, they reveal that delta entrainment is under top-down control and likely reflects prefrontal processes that are sensitive to acoustical regularities rather than the bottom-up encoding of acoustic features. [ABSTRACT FROM AUTHOR]

The phase of low-frequency network activity in the auditory cortex captures changes in neural excitability, entrains to the temporal structure of natural sounds, and correlates with the perceptual performance in acoustic tasks. Although these observations suggest a causal link between network rhythms and perception, it remains unknown how precisely they affect the processes by which neural populations encode sounds. We addressed this question by analyzing neural responses in the auditory cortex of anesthetized rats using stimulus-response models. These models included a parametric dependence on the phase of local field potential rhythms in both stimulus-unrelated background activity and the stimulus-response transfer function. We found that phase-dependent models better reproduced the observed responses than static models, during both stimulation with a series of natural sounds and epochs of silence. This was attributable to two factors: (1) phase-dependent variations in background firing (most prominent for delta; 1-4 Hz); and (2) modulations of response gain that rhythmically amplify and attenuate the responses at specific phases of the rhythm (prominent for frequencies between 2 and 12 Hz). These results provide a quantitative characterization of how slow auditory cortical rhythms shape sound encoding and suggest a differential contribution of network activity at different timescales. In addition, they highlight a putative mechanism that may implement the selective amplification of appropriately timed sound tokens relative to the phase of rhythmic auditory cortex activity. [ABSTRACT FROM AUTHOR]

Effective interactions between conspecific individuals can depend upon the receiver forming a coherent multisensory representation of communication signals, such as merging voice and face content. Neuroimaging studies have identified face- or voice-sensitive areas (Belin et al., 2000; Petkov et al., 2008; Tsao et al., 2008), some of which have been proposed as candidate regions for face and voice integration (von Kriegstein et al., 2005). However, it was unclear how multisensory influences occur at the neuronal level within voice- or face-sensitive regions, especially compared with classically defined multisensory regions in temporal association cortex (Stein and Stanford, 2008). Here, we characterize auditory (voice) and visual (face) influences on neuronal responses in a right-hemisphere voicesensitive region in the anterior supratemporal plane (STP) of Rhesus macaques. These results were compared with those in the neighboring superior temporal sulcus (STS). Within the STP, our results show auditory sensitivity to several vocal features, which was not evident in STS units. We also newly identify a functionally distinct neuronal subpopulation in the STP that appears to carry the area’s sensitivity to voice identity related features. Audiovisual interactions were prominent in both the STP and STS. However, visual influences modulated the responses of STS neurons with greater specificity and were more often associated with congruent voice-face stimulus pairingsthan STP neurons. Together,the results revealthe neuronal processes subserving voice-sensitive fMRI activity patterns in primates, generate hypotheses for testing in the visual modality, and clarify the position of voice-sensitive areas within the unisensory and multisensory processing hierarchies. [ABSTRACT FROM AUTHOR]

The encoding of sensory information by populations of cortical neurons forms the basis for perception but remains poorly understood. To understand the constraints of cortical population coding we analyzed neural responses to natural sounds recorded in auditory cortex of primates (Macaca mulatta). We estimated stimulus information while varying the composition and size of the considered population. Consistent with previous reports we found that when choosing subpopulations randomly from the recorded ensemble, the average population information increases steadily with population size. This scaling was explained by a model assuming that each neuron carried equal amounts of information, and that any overlap between the information carried by each neuron arises purely from random sampling within the stimulus space. However, when studying subpopulations selected to optimize information for each given population size, the scaling of information was strikingly different: a small fraction of temporally precise cells carried the vast majority of information. This scaling could be explained by an extended model, assuming that the amount of information carried by individual neurons was highly nonuniform, with few neurons carrying large amounts of information. Importantly, these optimal populations can be determined by a single biophysical marker--the neuron's encoding time scale--allowing their detection and readout within biologically realistic circuits. These results show that extrapolations of population information based on random ensembles may overestimate the population size required for stimulus encoding, and that sensory cortical circuitsmayprocess information using small but highly informative ensembles. [ABSTRACT FROM AUTHOR]

Oscillatory activity in sensory cortices reflects changes in local excitation-inhibition balance, and recent work suggests that phase signatures of ongoing oscillations predict the perceptual detection of subsequent stimuli. Low-frequency oscillations are also entrained by dynamic natural scenes, suggesting that the chance of detecting a brief target depends on the relative timing of this to the entrained rhythm. We tested this hypothesis in humans by implementing a cocktail-party-like scenario requiring subjects to detect a target embedded in a cacophony of background sounds. Using EEG to measure auditory cortical oscillations, we find that the chance of target detection systematically depends on both power and phase of theta-band (2-6 Hz) but not alpha-band (8-12 Hz) oscillations before target. Detection rates were higher and responses faster when oscillatory power was low and both detection rate and response speed were modulated by phase. Intriguingly, the phase dependency was stronger for miss than for hit trials, suggesting that phase has a inhibiting but not ensuring role for detection. Entrainment of theta range oscillations prominently occurs during the processing of attended complex stimuli, such as vocalizations and speech. Our results demonstrate that this entrainment to attended sensory environments may have negative effects on the detection of individual tokens within the environment, and they support the notion that specific phase ranges of cortical oscillations act as gatekeepers for perception. [ABSTRACT FROM AUTHOR]

The precise timing of spikes of cortical neurons relative to stimulus onset carries substantial sensory information. To access this information the sensory systems would need to maintain an internal temporal reference that reflects the precise stimulus timing. Whether and how sensory systems implement such reference frames to decode time-dependent responses, however, remains debated. Studying the encoding of naturalistic sounds in primate (Macaca mulatta) auditory cortex we here investigate potential intrinsic references for decoding temporally precise information. Within the population of recorded neurons, we found one subset responding with stereotyped fast latencies that varied little across trials or stimuli, while the remaining neurons had stimulus-modulated responses with longer and variable latencies. Computational analysis demonstrated that the neurons with stereotyped short latencies constitute an effective temporal reference for relative coding. Using the response onset of a simultaneously recorded stereotyped neuron allowed decoding most of the stimulus information carried by onset latencies and the full spike train of stimulus-modulated neurons. Computational modeling showed that few tens of such stereotyped reference neurons suffice to recover nearly all information that would be available when decoding the same responses relative to the actual stimulus onset. These findings reveal an explicit neural signature of an intrinsic reference for decoding temporal response patterns in the auditory cortex of alert animals. Furthermore, they highlight a role for apparently unselective neurons as an early saliency signal that provides a temporal reference for extracting stimulus information from other neurons [ABSTRACT FROM AUTHOR]

The claustrum receives afferent inputs from multiple sensory-related brain areas, prompting speculation about a role in integrating information across sensory modalities. Here we directly test this hypothesis by probing neurons in the primate claustrum for functional characteristics of multisensory processing. To this end we recorded neuronal responses to naturalistic audio-visual stimuli from the claustra of alert monkeys. Our results reveal the existence of distinct claustral zones comprised of unimodal neurons associated with the auditory and visual modalities. In a visual zone within the ventral claustrum neurons responded to visual stimuli but not to sounds, whereas in an auditory zone located within the central claustrum neurons responded to sounds but not to visual stimuli. Importantly, we find that neurons within either zone are not influenced by stimuli in the other modality and do not exhibit the typical response characteristics usually associated with multisensory processing. While these results confirm the notion of the claustrum as a multisensory structure per Se, they argue against the hypothesis of the claustrum serving as an integrator of sensory information. [ABSTRACT FROM AUTHOR]

Neurons in sensory cortices are often topographically organized according to their response preferences. We here show that such an organization of response preferences also exists in multisensory association cortex. Using electrophysiological mappings, we probed the modality preference to auditory and visual stimuli of neurons in the superior temporal association cortex of nonhuman primates. We found that neurons preferring the same modality (auditory or visual) often co-occur in close spatial proximity or occur intermingled with bimodal neurons. Neurons preferring different modalities, in contrast, occur spatially separated. This organization at the scale of individual neurons leads to extended patches of same modality preference when analyzed at the scale of millimeters, revealing largerscale regions that preferentially respond to the same modality. In addition, we find that neurons exhibiting signs of multisensory interactions, such as superadditive or subadditive response summation, also occur in spatial clusters. Together, these results reveal a spatial organization of modality preferences in a higher association cortex and lend support to the notion that topographical organizations might serve as a general principle of integrating information within and across the sensory modalities. [ABSTRACT FROM AUTHOR]

Human imaging studies implicate the insular cortex in processing complex sounds and vocal communication signals such as speech. In addition, lesions of the insula often manifest as deficits in sound or speech recognition (auditory agnosia) and speech production. While models of acoustic perception assign an important role to the insula, little is known about the underlying neuronal substrate. Studying a vocal primate, we identified a predominantly auditory region in the caudal insula and therein discovered a neural representation of conspecific communication sounds. When probed with natural sounds, insula neurons exhibited higher response selectivity than neurons in auditory cortex, and in contrast to these, responded preferentially to conspecific vocalizations. Importantly, insula neurons not only preferred conspecific vocalizations over a wide range of environmental sounds and other animal vocalizations, but also over acoustically manipulated versions of these, demonstrating that this preference for vocalizations arises both from spectral and temporal features of the sounds. In addition, individual insula neurons responded highly selectively to only a few vocalizations and allowed the decoding of sound identity from single-trial responses. These findings characterize the caudal insula as a selectively responding auditory region, possibly part of a processing stream involved in the representation of communication sounds. Importantly, our results provide a neural counterpart for the human imaging and lesion findings and uncover a basis for a supposed role of the insula in processing vocal communication sounds such as speech. [ABSTRACT FROM AUTHOR]

The effects of behavioral training on early visual representations have been elusive when assessed with firing rates. Learning-induced changes in performance, however, suggest that representations should encompass early cortical stages. Here, we address the question of whether training-induced effects are pertinent to neuronal activity outside the task proper, which is a requirement if subsequent perceptional processes should profit from training. To search for a neuronal signature of training effects beyond firing rates, we measured local field potentials, multiunit and isolated spike activity during passive viewing of previously learned stimulus response associations (S + and S-) in areas 17/18 and 21a of two alert cats. Evoked potential responses as well as gamma oscillations even during the first 200 msec were found to be stronger for S + in both areas. Most importantly, the later parts of the response (>200 msec) not only exhibit a highly significant difference in coherent gamma oscillations for S+ and S- both within and across areas, but are also characterized by a pronounced preference in firing rate for S + in area 21 a, whereas primary cortex shows a nonsignificant trend for weaker spike responses. From these results, we conclude that training-induced plasticity occurs in adult visual cortex for behaviorally relevant stimuli by changing primarily the temporal structure of neuronal activity at early stages of cortical processing, whereas later stages of cortical processing express the increased coherence of their input in elevated firing rates. [ABSTRACT FROM AUTHOR]

Merging the information from different senses is essential for successful interaction with real-life situations. Indeed, sensory integration can reduce perceptual ambiguity, speed reactions, or change the qualitative sensory experience. It is widely held that integration occurs at later processing stages and mostly in higher association cortices; however, recent studies suggest that sensory convergence can occur in primary sensory cortex. A good model for early convergence proved to be the auditory cortex, which can be modulated by visual and tactile stimulation; however, given the large number and small size of auditory fields, neither human imaging nor microelectrode recordings have systematically identified which fields are susceptible to multisensory influences. To reconcile findings from human imaging with anatomical knowledge from nonhuman primates, we exploited high-resolution imaging (functional magnetic resonance imaging) of the macaque monkey to study the modulation of auditory processing by visual stimulation. Using a functional parcellation of auditory cortex, we localized modulations to individual fields. Our results demonstrate that both primary (core) and nonprimary (belt) auditory fields can be activated by the mere presentation of visual scenes. Audiovisual convergence was restricted to caudal fields [prominently the core field (primary auditory cortex) and belt fields (caudomedial field, caudolateral field, and mediomedial field)] and continued in the auditory parabelt and the superior temporal sulcus. The same fields exhibited enhancement of auditory activation by visual stimulation and showed stronger enhancement for less effective stimuli, two characteristics of sensory integration. Together, these findings reveal multisensory modulation of auditory processing prominently in caudal fields but also at the lowest stages of auditory cortical processing. [ABSTRACT FROM AUTHOR]