Search

It has been suggested that actions can provide a fruitful conceptual context for sound symbolism phenomena, and that tight interaction between manual and articulatory processes might cause that hand actions, in particular, are sound-symbolically associated with specific speech sounds. Experiment 1 investigated whether novel words, built from speech sounds that have been previously linked to precision or power grasp responses, are implicitly associated with perceived actions that present precision manipulation or whole-hand grasp tool-use or the corresponding utilisation pantomimes. In the two-alternative forced-choice task, the participants were more likely to match novel words to tool-use actions and corresponding pantomimes that were sound-symbolically congruent with the words. Experiment 2 showed that the same or even larger sound–action symbolism effect can be observed when the pantomimes present unfamiliar utilisation actions. Based on this we propose that the sound–action symbolism might originate from the same sensorimotor mechanisms that process the meaning of iconic gestural signs. The study presents a novel sound–action phenomenon and supports the view that hand–mouth interaction might manifest itself by associating specific speech sounds with grasp-related utilisations. [ABSTRACT FROM AUTHOR]

The aim of the present study was to investigate the role of mental representation processes during the planning, reaching, and use phases of actions with tools commonly used toward the body (TB, e.g., toothbrush) or away from the body (AB, e.g., pencil). In the first session, healthy participants were asked to perform TB (i.e., making circular movements with the toothbrush near the mouth) and AB (i.e., making circular movements with the pencil near the desk) actions both with (i.e., actual use) and without the tool in hand (i.e., the pantomime of tool use). In the second session, the same participants performed a series of mental rotation tasks involving body‐ (i.e., face and hands) and object‐related (i.e., abstract lines) stimuli. The temporal and kinematic analysis of the motor actions showed that the time required to start the pantomimes (i.e., the planning phase) was shorter for the AB action than for the TB action. In contrast, the reaching phase lasted longer for the AB action than for the TB action. Furthermore, the TB pantomime was associated with the performance in the mental rotation of body‐related stimuli, especially during the planning and reaching phases, whereas the AB pantomime was more related to the performance in the mental rotation of object‐related stimuli, especially during the tool use phase. Thus, the results revealed that the direction of a goal‐directed motor action influences the dynamics of the different phases of the motor action and can determine the type of mental images involved in the planning and execution of the action. [ABSTRACT FROM AUTHOR]

Recent years have witnessed a growing interest in behavioral and neuroimaging studies on the processing of symbolic communicative gestures, such as pantomimes and emblems, but well-controlled stimuli have been scarce. This study describes a dataset of more than 200 video clips of an actress performing pantomimes (gestures that mimic object-directed/object-use actions; e.g., playing guitar), emblems (conventional gestures; e.g., thumbs up), and meaningless gestures. Gestures were divided into four lists. For each of these four lists, 50 Italian and 50 American raters judged the meaningfulness of the gestures and provided names and descriptions for them. The results of these rating and norming measures are reported separately for the Italian and American raters, offering the first normed set of meaningful and meaningless gestures for experimental studies. The stimuli are available for download via the Figshare database. [ABSTRACT FROM AUTHOR]

The middle temporal gyrus (MTG) has been shown to be recruited during the processing of words, but also during the observation of actions. Here we investigated how information related to words and gestures is organized along the MTG. To this aim, we measured the BOLD response in the MTG to video clips of gestures and spoken words in 17 healthy human adults (male and female). Gestures consisted of videos of an actress performing object-use pantomimes (iconic representations of object-directed actions; e.g., playing guitar), emblems (conventional gestures, e.g., thumb up), and meaningless gestures. Word stimuli (verbs, nouns) consisted of video clips of the same actress pronouncing words. We found a stronger response to meaningful compared with meaningless gestures along the whole left and large portions of the right MTG. Importantly, we observed a gradient, with posterior regions responding more strongly to gestures (pantomimes and emblems) than words and anterior regions showing a stronger response to words than gestures. In an intermediate region in the left hemisphere, the response was significantly higher to words and emblems (i.e., items with a greater arbitrariness of the sign-to-meaning mapping) than to pantomimes. These results show that the large-scale organization of information in the MTG is driven by the input modality and may also reflect the arbitrariness of the relationship between sign and meaning. [ABSTRACT FROM AUTHOR]

Since the first studies on limb apraxia carried out by Hugo Liepmann more than a century ago, research interests focused on the way humans process manual gestures by assessing gesture production after patients suffered neurologic deficits. Recent reviews centered their attention on deficits in gesture imitation or processing object-related gestures, namely pantomimes and transitive gestures, thereby neglecting communicative/intransitive gestures. This review will attempt to reconcile limb apraxia in its entirety. To this end, the existing cognitive models of praxis processing that have been designed to account for the complexity of this disorder will be taken into account, with an attempt to integrate in these models the latest findings in the studies of limb apraxia, in particular on meaningful gestures. Finally, this overview questions the very nature of limb apraxia when other cognitive deficits are observed. [ABSTRACT FROM AUTHOR]

Background and purpose: Although apraxia is a typical consequence of Alzheimer's disease (AD), the profile of apraxic impairments is still subject to debate. Here, we analysed apraxia components in patients with AD with mild-to-moderate or moderately severe dementia. Methods: Thirty-one patients were included. We first evaluated simple gestures, that is, the imitation of finger and hand configurations, symbolic gestures (recognition, production on verbal command and imitation), pantomimes (recognition, production on verbal command, imitation and production with the object), general knowledge and complex gestures (tool-object association, function-tool association, production of complex actions and knowledge about action sequences). Tests for dementia (Mini Mental State Examination and the Dementia Rating Scale), language disorders, visual agnosia and executive function were also administered. Results: Compared with controls, patients showed significant difficulties ( P ≤ 0.01) in subtests relating to simple gestures (except for the recognition and imitation of symbolic gestures). General knowledge about tools, objects and action sequences was less severely impaired. Performance was frequently correlated with the severity of dementia. Multiple-case analyses revealed that (i) the frequency of apraxia depended on the definition used, (ii) ideomotor apraxia was more frequent than ideational apraxia, (iii) conceptual difficulties were slightly more frequent than production difficulties in the early stage of AD and (iv) difficulties in gesture recognition were frequent (especially for pantomimes). Conclusion: Patients with AD can clearly show gesture apraxia from the mild-moderate stage of dementia onwards. Recognition and imitation disorders are relatively frequent (especially for pantomimes). We did not find conceptual difficulties to be the main problem in early-stage AD. [ABSTRACT FROM AUTHOR]

Abstract: Several studies indicate that both posterior superior temporal sulcus/middle temporal gyrus (pSTS/MTG) and left inferior frontal gyrus (LIFG) are involved in integrating information from different modalities. Here we investigated the respective roles of these two areas in integration of action and language information. We exploited the fact that the semantic relationship between language and different forms of action (i.e. co-speech gestures and pantomimes) is radically different. Speech and co-speech gestures are always produced together, and gestures are not unambiguously understood without speech. On the contrary, pantomimes are not necessarily produced together with speech and can be easily understood without speech. We presented speech together with these two types of communicative hand actions in matching or mismatching combinations to manipulate semantic integration load. Left and right pSTS/MTG were only involved in semantic integration of speech and pantomimes. Left IFG on the other hand was involved in integration of speech and co-speech gestures as well as of speech and pantomimes. Effective connectivity analyses showed that depending upon the semantic relationship between language and action, LIFG modulates activation levels in left pSTS. This suggests that integration in pSTS/MTG involves the matching of two input streams for which there is a relatively stable common object representation, whereas integration in LIFG is better characterized as the on-line construction of a new and unified representation of the input streams. In conclusion, pSTS/MTG and LIFG are differentially involved in multimodal integration, crucially depending upon the semantic relationship between the input streams. [Copyright &y& Elsevier]

We report two experiments that provide converging behavioural and neurophysiological evidence on the relationship between the meaning of iconic gestures and words. Experiment 1 exploited a semantic priming paradigm and revealed interference between gestures and words when they were not related in meaning, but no facilitation when they were. This result was confirmed in Experiment 2, where ERPs were recorded during silent word reading with the same paradigm. The analysis showed a negative deflection peaking near 400 ms (N400) and, in the left hemisphere, greater negative values for verbs than for nouns. Differently from the classical distribution obtained with verbal stimuli, we found an N400 that spread more over central-anterior areas of the scalp, suggesting that the meaning systems of gesture and language do not overlap completely. These results are consistent with the view that the meaning systems for gesture and speech are tightly integrated. [ABSTRACT FROM AUTHOR]

The case of a patient is reported who presented consistently with overt deficits in producing pantomimes in the absence of any other deficits in producing meaningful gestures. This pattern of spared and impaired abilities is difficult to reconcile with the current layout of cognitive models for praxis. This patient also showed clear impairment in a dual-task paradigm, a test taxing the co-ordination aspect of working memory, though performed normally in a series of other neuropsychological measures assessing language, visuo-spatial functions, reasoning function, and executive function. A specific working memory impairment associated with a deficit of pantomiming in the absence of any other disorders in the production of meaningful gestures suggested a way to modify the model to account for the data. Pantomimes are a particular category of gestures, meaningful, yet novel. We posit that by their very nature they call for the intervention of a mechanism to integrate and synthesise perceptual inputs together with information made available from the action semantics (knowledge about objects and functions) and the output lexicon (stored procedural programmes). This processing stage conceived as a temporary workspace where gesture information is actively manipulated, would generate new motor programmes to carry out pantomimes. The model of gesture production is refined to include this workspace. [Copyright &y& Elsevier]