Back to Search Start Over

The stimulus‐driven and representation‐driven cross‐modal attentional spreading are both modulated by audiovisual temporal synchrony.

Authors :
Zhao, Song
Ma, Fangfang
Xie, Jimei
Zhou, Yuxin
Feng, Chengzhi
Feng, Wenfeng
Source :
Psychophysiology; Mar2024, Vol. 61 Issue 3, p1-15, 15p
Publication Year :
2024

Abstract

Multisensory integration and attention can interact in a way that attention to the visual constituent of a multisensory object results in an attentional spreading to its ignored auditory constituent, which can be either stimulus‐driven or representation‐driven depending on whether the object's visual constituent receives extra representation‐based selective attention. Previous research using simple unrelated audiovisual combinations has shown that the stimulus‐driven attentional spreading is contingent on audiovisual temporal simultaneity. However, little is known about whether this temporal constraint applies also to the representation‐driven attentional spreading, and whether it holds for the stimulus‐driven process elicited by real‐life multisensory objects. The current event‐related potential study investigated these questions by systematically manipulating the visual‐to‐auditory stimulus onset asynchrony (SOA: 0/100/300 ms) in an object‐selective visual recognition task wherein the representation‐driven and stimulus‐driven spreading processes, measured as two distinct auditory negative difference (Nd) components, could be isolated independently. Our results showed that both the representation‐driven and stimulus‐driven Nds decreased as the SOA increased. Interestingly, the representation‐driven Nd was completely absent, whereas the stimulus‐driven Nd was still robust, when the auditory constituents were delayed by 300 ms. These findings not only indicate that the role of audiovisual simultaneity in the representation‐driven attentional spreading has been underestimated, but also suggest that learned associations between the unisensory constituents of real‐life objects render the stimulus‐driven attentional spreading more tolerant of audiovisual asynchrony. By using two distinct auditory Nd components to track the representation‐driven and stimulus‐driven visual‐to‐auditory attentional spreading effects, this study is the first to demonstrate that: (a) the role of audiovisual temporal synchrony in the representation‐driven spreading has been underestimated in extant literature; (b) highly learned association between the unisensory constituents of a meaningful multisensory object can render the synchrony‐sensitive stimulus‐driven spreading still prominent even at a large audiovisual asynchrony. Thus, it provides novel insights into the multifaceted influences of low‐level temporal correspondence and high‐level semantic relevance on the interplay between attention and multisensory integration. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
00485772
Volume :
61
Issue :
3
Database :
Complementary Index
Journal :
Psychophysiology
Publication Type :
Academic Journal
Accession number :
175305186
Full Text :
https://doi.org/10.1111/psyp.14527