Search

Infants’ ability to discriminate facial expressions has been widely explored, but little is known about the rapid and automatic ability to discriminate a given expression against many others in a single experiment. Here we investigated the development of facial expression discrimination in infancy with fast periodic visual stimulation coupled with scalp electroencephalography (EEG). EEG was recorded in eighteen 3.5- and eighteen 7-month-old infants presented with a female face expressing disgust, happiness, or a neutral emotion (in different stimulation sequences) at a base stimulation frequency of 6 Hz. Pictures of the same individual expressing other emotions (either anger, disgust, fear, happiness, sadness, or neutrality, randomly and excluding the expression presented at the base frequency) were introduced every six stimuli (at 1 Hz). Frequency-domain analysis revealed an objective (i.e., at the predefined 1-Hz frequency and harmonics) expression-change brain response in both 3.5- and 7-month-olds, indicating the visual discrimination of various expressions from disgust, happiness and neutrality from these early ages. At 3.5 months, the responses to the discrimination from disgust and happiness expressions were located mainly on medial occipital sites, whereas a more lateral topography was found for the response to the discrimination from neutrality, suggesting that expression discrimination from an emotionally neutral face relies on distinct visual cues than discrimination from a disgust or happy face. Finally, expression discrimination from happiness was associated with a reduced activity over posterior areas and an additional response over central frontal scalp regions at 7 months as compared to 3.5 months. This result suggests developmental changes in the processing of happiness expressions as compared to negative/neutral ones within this age range.

Visual categorization is the brain ability to rapidly and automatically respond to a certain category of inputs. Whether category-selective neural responses are purely visual or can be influenced by other sensory modalities remains unclear. Here, we test whether odors modulate visual categorization, expecting that odors facilitate the neural categorization of congruent visual objects, especially when the visual category is ambiguous. Scalp electroencephalogram (EEG) was recorded while natural images depicting various objects were displayed in rapid 12-Hz streams (i.e., 12 images / second) and variable exemplars of a target category (either human faces, cars, or facelike objects in dedicated sequences) were interleaved every 9th stimulus to tag category-selective responses at 12/9 = 1.33 Hz in the EEG frequency spectrum. During visual stimulation, participants (N = 26) were implicitly exposed to odor contexts (either body, gasoline or baseline odors) and performed an orthogonal cross-detection task. We identify clear category-selective responses to every category over the occipito-temporal cortex, with the largest response for human faces and the lowest for facelike objects. Critically, body odor boosts the response to the ambiguous facelike objects (i.e., either perceived as nonface objects or faces) over the right hemisphere, especially for participants reporting their presence post-stimulation. By contrast, odors do not significantly modulate other category-selective responses, nor the general visual response recorded at 12 Hz, revealing a specific influence on the categorization of congruent ambiguous stimuli. Overall, these findings support the view that the brain actively uses cues from the different senses to readily categorize visual inputs, and that olfaction, which has long been considered as poorly functional in humans, is well placed to disambiguate visual information.

A recent body of research has emerged regarding the interactions between olfaction and other sensory channels to process social information. The current review examines the influence of body odors on face perception, a core component of human social cognition. First, we review studies reporting how body odors interact with the perception of invariant facial information (i.e., identity, sex, attractiveness, trustworthiness, and dominance). Although we mainly focus on the influence of body odors based on axillary odor, we also review findings about specific steroids present in axillary sweat (i.e., androstenone, androstenol, androstadienone, and estratetraenol). We next survey the literature showing body odor influences on the perception of transient face properties, notably in discussing the role of body odors in facilitating or hindering the perception of emotional facial expression, in relation to competing frameworks of emotions. Finally, we discuss the developmental origins of these olfaction-to-vision influences, as an emerging literature indicates that odor cues strongly influence face perception in infants. Body odors with a high social relevance such as the odor emanating from the mother have a widespread influence on various aspects of face perception in infancy, including categorization of faces among other objects, face scanning behavior, or facial expression perception. We conclude by suggesting that the weight of olfaction might be especially strong in infancy, shaping social perception, especially in slow-maturing senses such as vision, and that this early tutoring function of olfaction spans all developmental stages to disambiguate a complex social environment by conveying key information for social interactions until adulthood.

Recognizing facial expressions of emotions is a fundamental ability for adaptation to the social environment. To date, it remains unclear whether the spatial distribution of eye movements predicts accurate recognition or, on the contrary, confusion in the recognition of facial emotions. In the present study, we asked participants to recognize facial emotions while monitoring their gaze behavior using eye-tracking technology. In Experiment 1a, 40 participants (20 women) performed a classic facial emotion recognition task with a 5-choice procedure (anger, disgust, fear, happiness, sadness). In Experiment 1b, a second group of 40 participants (20 women) was exposed to the same materials and procedure except that they were instructed to say whether (i.e., Yes/No response) the face expressed a specific emotion (e.g., anger), with the five emotion categories tested in distinct blocks. In Experiment 2, two groups of 32 participants performed the same task as in Experiment 1a while exposed to partial facial expressions composed of actions units (AUs) present or absent in some parts of the face (top, middle, or bottom). The coding of the AUs produced by the models showed complex facial configurations for most emotional expressions, with several AUs in common. Eye-tracking data indicated that relevant facial actions were actively gazed at by the decoders during both accurate recognition and errors. False recognition was mainly associated with the additional visual exploration of less relevant facial actions in regions containing ambiguous AUs or AUs relevant to other emotional expressions. Finally, the recognition of facial emotions from partial expressions showed that no single facial actions were necessary to effectively communicate an emotional state. In contrast, the recognition of facial emotions relied on the integration of a complex set of facial cues.

Humans exhibit a marked specialization to process the most experienced facial morphologies. In particular, nonhuman primate faces are poorly discriminated compared to human faces in behavioral tasks. So far however, a clear and consistent marker that quantifies our expertise in human over monkey face discrimination directly from brain activity is lacking. Here, using scalp electroencephalography (EEG), we isolate a direct signature of individuation abilities for human and nonhuman (i.e., macaque faces) primate faces. Human or monkey faces were rapidly presented at a base rate of 12 Hz in upright or inverted orientations while participants performed an orthogonal behavioral task. In each stimulation sequence, eight face images of one individual were used as base stimuli, while images of other individuals were briefly introduced every 9th stimulus to quantify an identity-change response at 1.33 Hz and harmonics (i.e., integer multiples) in the EEG frequency spectrum. The brain response to upright human faces was twice as large as to monkey faces, and reduced following picture-plane inversion for human faces only. This reflects the disruption of high-level face identity discrimination developed for the canonical upright human face. No difference was observed between upright monkey faces and inverted human faces, suggesting non-expert visual processes for those two face formats associated with little experience. In addition, the size of the inversion effect for human, but not monkey faces, was predictive of the expertise effect (i.e., difference between upright human and monkey faces) at the individual level. This result suggests a selective ability to discriminate human faces that does not contribute to the individuation of other unexperienced face morphologies such as monkey faces. Overall, these findings indicate that human expertise for conspecific face discrimination can be isolated and quantified in individual human brains.

Variation in facial emotion processing abilities may contribute to variability in penetrance for psychotic symptoms in 22q11.2DS. However, the precise nature of the social cognitive dysfunction (i.e., facial expression perception vs. emotion recognition), the potential additional roles of genetic and environmental variabilities, and consequently the possibility of using this neurocognitive marker in clinical monitoring remain unclear. The present case study aimed at testing the hypothesis that when confounding factors are controlled, the presence of psychotic symptoms in 22q11.2DS is associated, at the individual level, with a neural marker of facial expression perception rather than explicit emotional face recognition. Two monozygotic twins with 22q11.2DS discordant for psychiatric manifestations performed (1) a classical facial emotion labelling task and (2) an implicit neural measurement of facial expression perception using a frequency-tagging approach in electroencephalography (EEG). Analysis of the periodic brain response elicited by a change of facial expression from neutrality indicated that the twin with psychotic symptoms did not detect emotion among neutral faces while the twin without the symptoms did. In contrast, both encountered difficulties labelling facial emotion. The results from this exploratory twin study support the idea that impaired facial expression perception rather than explicit recognition of the emotion expressed might be a neurocognitive endophenotype of psychotic symptoms that could be reliable at a clinical level. Although confirmatory studies should be required, it facilitates further discussion on the etiology of the clinical phenotype in 22q11.2DS. Keywords: 22q11.2DS, Facial expression perception, Endophenotype, Psychotic symptoms, Frequency-tagging, Electroencephalography

Rare neurodevelopmental syndromes often present social cognitive deficits that may underlie difficulties in social interactions and increase the risk of psychosis or autism spectrum disorders. However, little is known regarding the specificities of social cognitive impairment across syndromes while it remains a major challenge for the care. Our review provides an overview of social cognitive dysfunctions in rare diseases associated with psychiatric symptoms (with a prevalence estimated between 1 in 1,200 and 1 in 25,000 live births: 22q11.2 deletion syndrome, Angelman syndrome, Fragile X syndrome, Klinefelter syndrome, Prader–Willi syndrome, Rett syndrome, Smith–Magenis syndrome, Turner syndrome, and Williams syndrome) and shed some light on the specific mechanisms that may underlie these skills in each clinical presentation. We first detail the different processes included in the generic expression “social cognition” before summarizing the genotype, psychiatric phenotype, and non-social cognitive profile in each syndrome. Then, we offer a systematic review of the social cognitive abilities and the disturbed mechanisms they are likely associated with. We followed the PRISMA process, including the definition of the relevant search terms, the selection of studies based on clear inclusion, and exclusion criteria and the quality appraisal of papers. We finally provide insights that may have considerable influence on the development of adapted therapeutic interventions such as social cognitive training (SCT) therapies specifically designed to target the psychiatric phenotype. The results of this review suggest that social cognition impairments share some similarities across syndromes. We propose that social cognitive impairments are strongly involved in behavioral symptoms regardless of the overall cognitive level measured by intelligence quotient. Better understanding the mechanisms underlying impaired social cognition may lead to adapt therapeutic interventions. The studies targeting social cognition processes offer new thoughts about the development of specific cognitive training programs, as they highlight the importance of connecting neurocognitive and SCT techniques.

It has been established that the recognition of facial expressions integrates contextual information. In this study, we aimed to clarify the influence of contextual odors. The participants were asked to match a target face varying in expression intensity with non-ambiguous expressive faces. Intensity variations in the target faces were designed by morphing expressive faces with neutral faces. In addition, the influence of verbal information was assessed by providing half the participants with the emotion names. Odor cues were manipulated by placing participants in a pleasant (strawberry), aversive (butyric acid), or no-odor control context. The results showed two main effects of the odor context. First, the minimum amount of visual information required to perceive an expression was lowered when the odor context was emotionally congruent: happiness was correctly perceived at lower intensities in the faces displayed in the pleasant odor context, and the same phenomenon occurred for disgust and anger in the aversive odor context. Second, the odor context influenced the false perception of expressions that were not used in target faces, with distinct patterns according to the presence of emotion names. When emotion names were provided, the aversive odor context decreased intrusions for disgust ambiguous faces but increased them for anger. When the emotion names were not provided, this effect did not occur and the pleasant odor context elicited an overall increase in intrusions for negative expressions. We conclude that olfaction plays a role in the way facial expressions are perceived in interaction with other contextual influences such as verbal information.