Search

Touch can be localized either on the skin in anatomical coordinates, or, after integration with posture, in external space. Sighted individuals are thought to encode touch in both coordinate systems concurrently, whereas congenitally blind individuals exhibit a strong bias for using anatomical coordinates. We investigated the neural correlates of this differential dominance in the use of anatomical and external reference frames by assessing oscillatory brain activity during a tactile spatial attention task. The EEG was recorded while sighted and congenitally blind adults received tactile stimulation to uncrossed and crossed hands while detecting rare tactile targets at one cued hand only. In the sighted group, oscillatory alpha-band activity (8-12Hz) in the cue-target interval was reduced contralaterally and enhanced ipsilaterally with uncrossed hands. Hand crossing attenuated the degree of posterior parietal alpha-band lateralization, indicating that attention deployment was affected by external spatial coordinates. Beamforming suggested that this posture effect originated in the posterior parietal cortex. In contrast, cue-related lateralization of central alpha-band as well as of beta-band activity (16-24Hz) were unaffected by hand crossing, suggesting that these oscillations exclusively encode anatomical coordinates. In the blind group, central alpha-band activity was lateralized, but did not change across postures. The pattern of beta-band activity was indistinguishable between groups. Because the neural mechanisms for posterior alpha-band generation seem to be linked to developmental vision, we speculate that the lack of this neural mechanism in blind individuals is related to their preferred use of anatomical over external spatial codes in sensory processing.

Previous research has shown that redundant information in faces and voices leads to faster emotional categorization compared to incongruent emotional information even when attending to only one modality. The aim of the present study was to test whether these crossmodal effects are predominantly due to a response conflict rather than interference at earlier, e.g. perceptual processing stages. In Experiment 1, participants had to categorize the valence and rate the intensity of happy, sad, angry and neutral unimodal or bimodal face-voice stimuli. They were asked to rate either the facial or vocal expression and ignore the emotion expressed in the other modality. Participants responded faster and more precisely to emotionally congruent compared to incongruent face-voice pairs in both the Attend Face and in the Attend Voice condition. Moreover, when attending to faces, emotionally congruent bimodal stimuli were more efficiently processed than unimodal visual stimuli. To study the role of a possible response conflict, Experiment 2 used a modified paradigm in which emotional and response conflicts were disentangled. Incongruency effects were significant even in the absence of response conflicts. The results suggest that emotional signals available through different sensory channels are automatically combined prior to response selection.

Blind people rely much more on voices compared to sighted individuals when identifying other people. Previous research has suggested a faster processing of auditory input in blind individuals than sighted controls and an enhanced activation of temporal cortical regions during voice processing. The present study used event-related potentials (ERPs) to single out the sub-processes of auditory person identification that change and allow for superior voice processing after congenital blindness. A priming paradigm was employed in which two successive voices (S1 and S2) of either the same (50% of the trials) or different actors were presented. Congenitally blind and matched sighted participants made an old-young decision on the S2. During the pre-experimental familiarization with the stimuli, congenitally blind individuals showed faster learning rates than sighted controls. Reaction times were shorter in person-congruent trials than in person-incongruent trials in both groups. ERPs to S2 stimuli in person-incongruent as compared to person-congruent trials were significantly enhanced at early processing stages (100-160 ms) in congenitally blind participants only. A later negative ERP effect (>200 ms) was found in both groups. The scalp topographies of the experimental effects were characterized by a central and parietal distribution in the sighted but a more posterior distribution in the congenitally blind. These results provide evidence for an improvement of early voice processing stages and a reorganization of the person identification system as a neural correlate of compensatory behavioral improvements following congenital blindness.

Changes in limb posture (such as crossing the hands) can impair people's performance in tasks such as those involving temporal order judgements, when one tactile stimulus is presented to either hand. This crossed hands deficit has been attributed to a conflict between externally and anatomically anchored reference systems when people localize tactile stimuli. Interestingly, however, the performance of congenitally blind adults does not seem to be affected by crossing the hands, suggesting a default use of an anatomically rather than an externally anchored reference system for tactile localization. In the present study, 12 congenitally blind and 12 sighted adults were instructed to attend to either the left or the right hand on a trial-by-trial basis in order to detect rare deviants (consisting of a double touch) at that hand, while ignoring both deviants at the other hand and frequent standard stimuli (consisting of a single touch) presented to either hand. Only the sighted participants performed less accurately when they crossed their hands. Concurrent electroencephalogram recordings revealed an early contralateral attention positivity, followed by an attention negativity in the sighted group when they adopted the uncrossed hands posture. For the crossed hand posture, only the attention negativity was observed with reduced amplitude in the sighted group. By contrast, the congenitally blind group displayed an event-related potential attention negativity that did not vary when the posture of their hands was changed. These results demonstrate that the default use of an external frame of reference for tactile localization seems to depend on developmental vision.

PURPOSE: Intra- and crossmodal neuroplasticity have been reported to underlie superior voice processing skills in congenitally blind individuals. The present study used event-related potentials (ERPs) in order to test if such compensatory plasticity is limited to the developing brain. METHODS: Late blind individuals were compared to sighted controls in their ability to identify human voices. A priming paradigm was employed in which two successive voices (S1, S2) of the same (person-congruent) or different speakers (person-incongruent) were presented. Participants made an old-young decision on the S2. RESULTS: In both groups ERPs to the auditory S2 were more negative in person-incongruent than in person-congruent trials between 200-300 ms. A topographic analysis suggested a more posteriorly shifted distribution of the Person Match effect (person-incongruent minus person-congruent trials) in late blind individuals compared to sighted controls. CONCLUSION: In contrast to congenitally blind individuals, late blind individuals did not show an early Person Match effect in the time range of the N1, suggesting that crossmodal compensation is mediated by later processing steps rather than by changes at early perceptual levels.

The aim of the present study was to better understand the interaction of face and voice processing when identifying people. In a S1-S2 crossmodal priming fMRI experiment, the target (S2) was a disyllabic voice stimulus, whereas the modality of the prime (S1) was manipulated blockwise and consisted of the silent video of a speaking face in the crossmodal condition or of a voice stimulus in the unimodal condition. Primes and targets were from the same speaker (person-congruent) or from two different speakers (person-incongruent). Participants had to classify the S2 as either an old or a young person. Response times were shorter after a congruent than after an incongruent face prime. The right posterior superior temporal sulcus (pSTS) and the right angular gyrus showed a significant person identity effect (person-incongruent > person-congruent) in the crossmodal condition but not in the unimodal condition. In the unimodal condition, a person identity effect was observed in the bilateral inferior frontal gyrus. Our data suggest that both the priming with a voice and with a face result in a preactivated voice representation of the respective person, which eventually facilitates (person-congruent trials) or hampers (person-incongruent trials) the processing of the identity of a subsequent voice. This process involves activation in the right pSTS and in the right angular gyrus for voices primed by faces, but not for voices primed by voices. Hum Brain Mapp 38:2553-2565, 2017.

Behavioral and event-related potential (ERP) studies have shown that spatial attention is gradually distributed around the center of the attentional focus. The present study compared uni- and crossmodal gradients of spatial attention to investigate whether the orienting of auditory and visual spatial attention is based on modality specific or supramodal representations of space. Auditory and visual stimuli were presented from five speaker locations positioned in the right hemifield. Participants had to attend to the innermost or outmost right position in order to detect either visual or auditory deviant stimuli. Detection rates and event-related potentials (ERPs) indicated that spatial attention is distributed as a gradient. Unimodal spatial ERP gradients correlated with the spatial resolution of the modality. Crossmodal spatial gradients were always broader than the corresponding unimodal spatial gradients. These results suggest that both modality specific and supramodal spatial representations are activated during orienting attention in space

Hearing a voice and seeing a face are essential parts of person identification and social interaction. It has been suggested that both types of information do not only interact at late processing stages but rather interact at the level of perceptual encoding (<200 ms). The present study analysed when visual and auditory representations of person identity modulate the processing of voices. In unimodal trials, two successive voices (S1-S2) of the same or of two different speakers were presented. In the crossmodal condition, the S1 consisted of the face of the same or a different person with respect to the following voice stimulus. Participants had to decide whether the voice probe (S2) was from an elderly or a young person. Reaction times to the S2 were shorter when these stimuli were person-congruent, both in the uni- and crossmodal conditions. ERPs recorded to the person-incongruent as compared to the person-congruent trials (S2) were enhanced at early (100-140 ms) and later processing stages (270-530 ms) in the crossmodal condition. A similar later negative ERP effect (270-530 ms) was found in the unimodal condition as well. These results suggest that identity information conveyed by a face is capable to modulate the sensory processing of voice stimuli.

Blind individuals are trained in identifying other people through voices. In congenitally blind adults the anterior fusiform gyrus has been shown to be active during voice recognition. Such crossmodal changes have been associated with a superiority of blind adults in voice perception. The key question of the present functional magnetic resonance imaging (fMRI) study was whether visual deprivation that occurs in adulthood is followed by similar adaptive changes of the voice identification system. Late blind individuals and matched sighted participants were tested in a priming paradigm, in which two voice stimuli were subsequently presented. The prime (S1) and the target (S2) were either from the same speaker (person-congruent voices) or from two different speakers (person-incongruent voices). Participants had to classify the S2 as either coming from an old or a young person. Only in late blind but not in matched sighted controls, the activation in the anterior fusiform gyrus was modulated by voice identity: late blind volunteers showed an increase of the BOLD signal in response to person-incongruent compared with person-congruent trials. These results suggest that the fusiform gyrus adapts to input of a new modality even in the mature brain and thus demonstrate an adult type of crossmodal plasticity.

BACKGROUND: The present study asked whether the processing of affective prosody is modulated by spatial attention. Pseudo-words with a neutral, happy, threatening, and fearful prosody were presented at two spatial positions. Participants attended to one position in order to detect infrequent targets. Emotional prosody was task irrelevant. The electro-encephalogram (EEG) was recorded to assess processing differences as a function of spatial attention and emotional valence. RESULTS: Event-related potentials (ERPs) differed as a function of emotional prosody both when attended and when unattended. While emotional prosody effects interacted with effects of spatial attention at early processing levels (< 200 ms), these effects were additive at later processing stages (> 200 ms). CONCLUSIONS: Emotional prosody, therefore, seems to be partially processed outside the focus of spatial attention. Whereas at early sensory processing stages spatial attention modulates the degree of emotional voice processing as a function of emotional valence, emotional prosody is processed outside of the focus of spatial attention at later processing stages.

Blind people rely more on vocal cues when they recognize a person’s identity than sighted people. Indeed, a number of studies have reported better voice recognition skills in blind than in sighted adults. The present functional magnetic resonance imaging study investigated changes in the functional organization of neural systems involved in voice identity processing following congenital blindness. A group of congenitally blind individuals and matched sighted control participants were tested in a priming paradigm, in which two voice stimuli (S1, S2) were subsequently presented. The prime (S1) and the target (S2) were either from the same speaker (person-congruent voices) or from two different speakers (person-incongruent voices). Participants had to classify the S2 as either a old or a young person. Person-incongruent voices (S2) compared with person-congruent voices elicited an increased activation in the right anterior fusiform gyrus in congenitally blind individuals but not in matched sighted control participants. In contrast, only matched sighted controls showed a higher activation in response to person-incongruent compared with person-congruent voices (S2) in the right posterior superior temporal sulcus. These results provide evidence for crossmodal plastic changes of the person identification system in the brain after visual deprivation. Hum Brain Mapp 35:4607–4619