Back to Search
Start Over
Gesture's body orientation modulates the <scp>N400</scp> for visual sentences primed by gestures
- Source :
- Human Brain Mapping
- Publication Year :
- 2020
- Publisher :
- Wiley, 2020.
-
Abstract
- Body orientation of gesture entails social‐communicative intention, and may thus influence how gestures are perceived and comprehended together with auditory speech during face‐to‐face communication. To date, despite the emergence of neuroscientific literature on the role of body orientation on hand action perception, limited studies have directly investigated the role of body orientation in the interaction between gesture and language. To address this research question, we carried out an electroencephalography (EEG) experiment presenting to participants (n = 21) videos of frontal and lateral communicative hand gestures of 5 s (e.g., raising a hand), followed by visually presented sentences that are either congruent or incongruent with the gesture (e.g., “the mountain is high/low…”). Participants underwent a semantic probe task, judging whether a target word is related or unrelated to the gesture‐sentence event. EEG results suggest that, during the perception phase of handgestures, while both frontal and lateral gestures elicited a power decrease in both the alpha (8–12 Hz) and the beta (16–24 Hz) bands, lateral versus frontal gestures elicited reduced power decrease in the beta band, source‐located to the medial prefrontal cortex. For sentence comprehension, at the critical word whose meaning is congruent/incongruent with the gesture prime, frontal gestures elicited an N400 effect for gesture‐sentence incongruency. More importantly, this incongruency effect was significantly reduced for lateral gestures. These findings suggest that body orientation plays an important role in gesture perception, and that its inferred social‐communicative intention may influence gesture‐language interaction at semantic level.<br />We collected EEG when participants process visual sentences primed by frontal and lateral gestures. Lateral gestures elicited reduced beta band power decrease during perception. Additionally, in the visual sentences, the N400 effect, as derived from semantic incongruency between the critical word and the gesture prime, was reduced for lateral gestures.
- Subjects :
- Adult
Male
media_common.quotation_subject
Prefrontal Cortex
Electroencephalography
050105 experimental psychology
Young Adult
03 medical and health sciences
0302 clinical medicine
body orientation
Kinesics
Perception
medicine
Humans
N400
0501 psychology and cognitive sciences
Radiology, Nuclear Medicine and imaging
Prefrontal cortex
semantics
Evoked Potentials
Research Articles
media_common
beta oscillations
Psycholinguistics
Gestures
Radiological and Ultrasound Technology
medicine.diagnostic_test
Social perception
05 social sciences
social perception
Comprehension
Alpha Rhythm
Pattern Recognition, Visual
Reading
Neurology
gesture
Female
Neurology (clinical)
Anatomy
Beta Rhythm
Psychology
030217 neurology & neurosurgery
Sentence
Research Article
Cognitive psychology
Gesture
Subjects
Details
- ISSN :
- 10970193 and 10659471
- Volume :
- 41
- Database :
- OpenAIRE
- Journal :
- Human Brain Mapping
- Accession number :
- edsair.doi.dedup.....3918942f15ad38d881b358a6f36cfef7