Search

Facial expressions are among the earliest behaviors infants use to express emotional states, and are crucial to preverbal social interaction. Manual coding of infant facial expressions, however, is laborious and poses limitations to replicability. Recent developments in computer vision have advanced automated facial expression analyses in adults, providing reproducible results at lower time investment. Baby FaceReader 9 is commercially available software for automated measurement of infant facial expressions, but has received little validation. We compared Baby FaceReader 9 output to manual micro-coding of positive, negative, or neutral facial expressions in a longitudinal dataset of 58 infants at 4 and 8 months of age during naturalistic face-to-face interactions with the mother, father, and an unfamiliar adult. Baby FaceReader 9's global emotional valence formula yielded reasonable classification accuracy (AUC = .81) for discriminating manually coded positive from negative/neutral facial expressions; however, the discrimination of negative from neutral facial expressions was not reliable (AUC = .58). Automatically detected a priori action unit (AU) configurations for distinguishing positive from negative facial expressions based on existing literature were also not reliable. A parsimonious approach using only automatically detected smiling (AU12) yielded good performance for discriminating positive from negative/neutral facial expressions (AUC = .86). Likewise, automatically detected brow lowering (AU3+AU4) reliably distinguished neutral from negative facial expressions (AUC = .79). These results provide initial support for the use of selected automatically detected individual facial actions to index positive and negative affect in young infants, but shed doubt on the accuracy of complex a priori formulas., (© 2024. The Author(s).)

Oxytocin is a neuropeptide positively associated with prosociality in adults. Here, we studied whether infants' salivary oxytocin can be reliably measured, is developmentally stable, and is linked to social behavior. We longitudinally collected saliva from 62 U.S. infants (44 % female, 56 % Hispanic/Latino, 24 % Black, 18 % non-Hispanic White, 11 % multiracial) at 4, 8, and 14 months of age and offline-video-coded the valence of their facial affect in response to a video of a smiling woman. We also captured infants' affective reactions in terms of excitement/joyfulness during a live, structured interaction with a singing woman in the Early Social Communication Scales at 14 months. We detected stable individual differences in infants' oxytocin levels over time (over minutes and months) and in infants' positive affect over months and across contexts (video-based and in live interactions). We detected no statistically significant changes in oxytocin levels between 4 and 8 months but found an increase from 8 to 14 months. Infants with higher oxytocin levels showed more positive facial affect to a smiling person video at 4 months; however, this association disappeared at 8 months, and reversed at 14 months (i.e., higher oxytocin was associated with less positive facial affect). Infant salivary oxytocin may be a reliable physiological measure of individual differences related to socio-emotional development., Competing Interests: Declaration of competing interest The authors have no conflicts of interest to declare., (Copyright © 2024 Elsevier Inc. All rights reserved.)

Communicating emotional intensity plays a vital ecological role because it provides valuable information about the nature and likelihood of the sender's behavior. 1 , 2 , 3 For example, attack often follows signals of intense aggression if receivers fail to retreat. 4 , 5 Humans regularly use facial expressions to communicate such information. 6 , 7 , 8 , 9 , 10 , 11 Yet how this complex signaling task is achieved remains unknown. We addressed this question using a perception-based, data-driven method to mathematically model the specific facial movements that receivers use to classify the six basic emotions-"happy," "surprise," "fear," "disgust," "anger," and "sad"-and judge their intensity in two distinct cultures (East Asian, Western European; total n = 120). In both cultures, receivers expected facial expressions to dynamically represent emotion category and intensity information over time, using a multi-component compositional signaling structure. Specifically, emotion intensifiers peaked earlier or later than emotion classifiers and represented intensity using amplitude variations. Emotion intensifiers are also more similar across emotions than classifiers are, suggesting a latent broad-plus-specific signaling structure. Cross-cultural analysis further revealed similarities and differences in expectations that could impact cross-cultural communication. Specifically, East Asian and Western European receivers have similar expectations about which facial movements represent high intensity for threat-related emotions, such as "anger," "disgust," and "fear," but differ on those that represent low threat emotions, such as happiness and sadness. Together, our results provide new insights into the intricate processes by which facial expressions can achieve complex dynamic signaling tasks by revealing the rich information embedded in facial expressions., Competing Interests: Declaration of interests P.G.S. is on the advisory board of this Current Biology., (Copyright © 2023 The Author(s). Published by Elsevier Inc. All rights reserved.)

Although still-face effects are well-studied, little is known about the degree to which the Face-to-Face/Still-Face (FFSF) is associated with the production of intense affective displays. Duchenne smiling expresses more intense positive affect than non-Duchenne smiling, while Duchenne cry-faces express more intense negative affect than non-Duchenne cry-faces. Forty 4-month-old infants and their mothers completed the FFSF, and key affect-indexing facial Action Units (AUs) were coded by expert Facial Action Coding System coders for the first 30 s of each FFSF episode. Computer vision software, automated facial affect recognition (AFAR), identified AUs for the entire 2-min episodes. Expert coding and AFAR produced similar infant and mother Duchenne and non-Duchenne FFSF effects, highlighting the convergent validity of automated measurement. Substantive AFAR analyses indicated that both infant Duchenne and non-Duchenne smiling declined from the FF to the SF, but only Duchenne smiling increased from the SF to the RE. In similar fashion, the magnitude of mother Duchenne smiling changes over the FFSF were 2-4 times greater than non-Duchenne smiling changes. Duchenne expressions appear to be a sensitive index of intense infant and mother affective valence that are accessible to automated measurement and may be a target for future FFSF research., (© 2023 International Congress of Infant Studies.)

Automated detection of facial action units in infants is challenging. Infant faces have different proportions, less texture, fewer wrinkles and furrows, and unique facial actions relative to adults. For these and related reasons, action unit (AU) detectors that are trained on adult faces may generalize poorly to infant faces. To train and test AU detectors for infant faces, we trained convolutional neural networks (CNN) in adult video databases and fine-tuned these networks in two large, manually annotated, infant video databases that differ in context, head pose, illumination, video resolution, and infant age. AUs were those central to expression of positive and negative emotion. AU detectors trained in infants greatly outperformed ones trained previously in adults. Training AU detectors across infant databases afforded greater robustness to between-database differences than did training database specific AU detectors and outperformed previous state-of-the-art in infant AU detection. The resulting AU detection system, which we refer to as Infant AFAR (Automated Facial Action Recognition), is available to the research community for further testing and applications in infant emotion, social interaction, and related topics., (© 2022. The Author(s).)

According to dominant theories of affect, humans innately and universally express a set of emotions using specific configurations of prototypical facial activity. Accordingly, thousands of studies have tested emotion recognition using sets of highly intense and stereotypical facial expressions, yet their incidence in real life is virtually unknown. In fact, a commonplace experience is that emotions are expressed in subtle and nonprototypical forms. Such facial expressions are at the focus of the current study. In Experiment 1, we present the development and validation of a novel stimulus set consisting of dynamic and subtle emotional facial displays conveyed without constraining expressers to using prototypical configurations. Although these subtle expressions were more challenging to recognize than prototypical dynamic expressions, they were still well recognized by human raters, and perhaps most importantly, they were rated as more ecological and naturalistic than the prototypical expressions. In Experiment 2, we examined the characteristics of subtle versus prototypical expressions by subjecting them to a software classifier, which used prototypical basic emotion criteria. Although the software was highly successful at classifying prototypical expressions, it performed very poorly at classifying the subtle expressions. Further validation was obtained from human expert face coders: Subtle stimuli did not contain many of the key facial movements present in prototypical expressions. Together, these findings suggest that emotions may be successfully conveyed to human viewers using subtle nonprototypical expressions. Although classic prototypical facial expressions are well recognized, they appear less naturalistic and may not capture the richness of everyday emotional communication. (PsycINFO Database Record, ((c) 2017 APA, all rights reserved).)

Few behavioral indices of risk for autism spectrum disorders (ASD) are present before 12 months, and potential biomarkers remain largely unexamined. This prospective study of infant siblings of children with ASD (n = 16) and low-risk comparison infants (n = 15) examined group differences in event-related potentials (ERPs) indexing processing of facial positive affect (N290/P400, Nc) at 9 months and their relation to joint attention at 15 months. Group differences were most pronounced for subtle facial expressions, in that the low-risk group exhibited relatively longer processing (P400 latency) and greater attention resource allocation (Nc amplitude). Exploratory analyses found associations between ERP responses and later joint attention, suggesting that attention to positive affect cues may support the development of other social competencies.

Although the distinction between positive and negative facial expressions is assumed to be clear and robust, recent research with intense real-life faces has shown that viewers are unable to reliably differentiate the valence of such expressions (Aviezer, Trope, & Todorov, 2012). Yet, the fact that viewers fail to distinguish these expressions does not in itself testify that the faces are physically identical. In Experiment 1, the muscular activity of victorious and defeated faces was analyzed. Higher numbers of individually coded facial actions--particularly smiling and mouth opening--were more common among winners than losers, indicating an objective difference in facial activity. In Experiment 2, we asked whether supplying participants with valid or invalid information about objective facial activity and valence would alter their ratings. Notwithstanding these manipulations, valence ratings were virtually identical in all groups, and participants failed to differentiate between positive and negative faces. While objective differences between intense positive and negative faces are detectable, human viewers do not utilize these differences in determining valence. These results suggest a surprising dissociation between information present in expressions and information used by perceivers., ((c) 2015 APA, all rights reserved).)

In infants, eye constriction-the Duchenne marker-and mouth opening appear to index the intensity of both positive and negative facial expressions. We combined eye constriction and mouth opening that co-occurred with smiles and cry-faces (respectively, the prototypic expressions of infant joy and distress) to measure emotional expression intensity. Expression intensity and heart rate were measured throughout the face-to-face/still-face (FFSF) in a sample of infants with prenatal cocaine exposure who were at risk for developmental difficulties. Smiles declined and cry-faces increased in the still-face episode, but the distribution of eye constriction and mouth opening in smiles and cry-faces did not differ across episodes of the FFSF. As time elapsed in the still face episode potential indices of intensity increased, cry-faces were more likely to be accompanied by eye constriction and mouth opening. During cry-faces there were also moderately stable individual differences in the quantity of eye constriction and mouth opening. Infant heart rate was higher during cry-faces and lower during smiles, but did not vary with intensity of expression or by episode. In sum, infants express more intense negative affect as the still-face progresses, but do not show clear differences in expressive intensity between episodes of the FFSF., (Copyright © 2013 Elsevier Inc. All rights reserved.)

The still-face paradigm (SFP) was designed to assess infant expectations that parents will respond to infant communicative signals. During the still-face (SF) episode, the parent ceases interaction and maintains a neutral expression. Original, qualitative descriptions of infant behavior suggested changes within the SF episode: infants decrease bidding and disengage from their impassive parent. Research has documented changes in mean levels of infant behavior between episodes of the SFP. The hypothesis that infant behavior changes within the SF episode has not been empirically tested. In this study, hierarchical linear modeling indicated that infant gazing at the parent, smiling, and social bidding (smiling while gazing at the parent) decreased with time in the SF episode, while infant cry-face expressions increased. Changes in infant behaviors within the SF episode were associated with infant attachment and infant internalizing problems. The dynamic still-face effect quantifies infant initiation of interaction in the face of parental unresponsiveness and is a potential predictor of individual differences in development., (PsycINFO Database Record (c) 2013 APA, all rights reserved)

Although emotional functioning is impaired in children with autism, it is unclear if this impairment is due to difficulties with facial expression, autonomic responsiveness, or the verbal description of emotional states. To shed light on this issue, we examined responses to pleasant and unpleasant odors in eight children (8-14 years) with high-functioning autism and 8 age-matched typically developing controls. Despite subtle differences in the facial actions of the children with autism, children in both groups had similar facial and autonomic emotional responses to the odors. However, children with autism were less likely than controls to report an emotional reaction to the odors that matched their facial expression, suggesting difficulties in the self report of emotional states.

Facial expressions frequently involve multiple individual facial actions. How do facial actions combine to create emotionally meaningful expressions? Infants produce positive and negative facial expressions at a range of intensities. It may be that a given facial action can index the intensity of both positive (smiles) and negative (cry-face) expressions. Objective, automated measurements of facial action intensity were paired with continuous ratings of emotional valence to investigate this possibility. Degree of eye constriction (the Duchenne marker) and mouth opening were each uniquely associated with smile intensity and, independently, with cry-face intensity. In addition, degree of eye constriction and mouth opening were each unique predictors of emotion valence ratings. Eye constriction and mouth opening index the intensity of both positive and negative infant facial expressions, suggesting parsimony in the early communication of emotion.

In the still‐face episode of the Face‐to‐Face/Still‐Face (FFSF), parents are asked to become unresponsive. However, infant–parent interaction may be irrepressible, and there is some evidence that interaction during the still‐face is associated with attachment outcome. To explore these questions, we independently coded the continuous affective valence (negative to positive) of seventy‐three 6‐month‐old infants (45 males; 36 Hispanic/Latinx; 38 White, 3 Black/African‐American, 2 Asian, 30 multiracial) and their parents (Mage = 36 years; 5 males; 30 Hispanic/Latinx; 65 White, 3 Black/African‐American, 2 Asian, 2 unknown) during the FFSF and assessed attachment at 15 months with the Strange Situation Procedure (n = 66). There was a mean positive correlation between moment‐to‐moment parent and infant affective valence, indicating synchronous affective interaction during the still‐face (d = 0.63). Higher levels of affect interaction during the still‐face episode were detected in infants later classified as disorganised compared to securely attached (d = 0.97). Findings underscore the importance of testing for still‐face interaction and suggest that this interaction may be an unappreciated predictor of infant attachment outcomes. [ABSTRACT FROM AUTHOR]

Best practice for the assessment of autism spectrum disorder (ASD) symptom severity relies on clinician ratings of the Autism Diagnostic Observation Schedule, 2nd Edition (ADOS-2), but the association of these ratings with objective measures of children's social gaze and smiling is unknown. Sixty-six preschool-age children (49 boys, M = 39.97 months, SD = 10.58) with suspected ASD (61 confirmed ASD) were administered the ADOS-2 and provided social affect calibrated severity scores (SA CSS). Children's social gaze and smiling during the ADOS-2, captured with a camera contained in eyeglasses worn by the examiner and parent, were obtained via a computer vision processing pipeline. Children who gazed more at their parents (p =.04) and whose gaze at their parents involved more smiling (p =.02) received lower social affect severity scores, indicating fewer social affect symptoms, adjusted R2 =.15, p =.003. [ABSTRACT FROM AUTHOR]

Infants at risk for autism spectrum disorders (ASD) may have difficulty integrating smiles into initiating joint attention (IJA) bids. A specific IJA pattern, anticipatory smiling, may communicate preexisting positive affect when an infant smiles at an object and then turns the smile toward the social partner. We compared the development of anticipatory smiling at 8, 10, and 12 months in infant siblings of children with ASD (high-risk siblings) and without ASD (low-risk siblings). High-risk siblings produced less anticipatory smiling than low-risk siblings, suggesting early differences in communicating preexisting positive affect. While early anticipatory smiling distinguished the risk groups, IJA not accompanied by smiling best predicted later severity of ASD-related behavioral characteristics among high-risk siblings. High-risk infants appear to show lower levels of motivation to share positive affect with others. However, facility with initiating joint attention in the absence of a clear index of positive affective motivation appears to be central to the prediction of ASD symptoms.

Interaction with unfamiliar partners is a component of social life from infancy onward. Yet little is known about preverbal communication with strangers. This study compared the development of infant communication with strangers to communication with mothers and fathers and examined the contribution of temperament to partner‐specific communication patterns. A sample of 58 infants was observed at four and eight months during separate home‐based face‐to‐face interactions with three partners (mother, father, and stranger). Infant visual, facial, and vocal communication behaviors were coded microanalytically. Each parent reported on infant temperament at both ages. Multilevel regression analyses indicated that infants gazed longer at strangers than at fathers, exhibited less smiling to strangers than to mothers, and produced fewer vocalizations with strangers than with either parent. Both age and temperament moderated these differences. Vocal communication with fathers became more frequent at eight months; smiling to mothers was accentuated among infants with higher levels of temperamental surgency. Importantly, levels of communication behaviors with strangers were concurrently and longitudinally associated with those with mothers and fathers. Overall, findings suggest that infant emotional communication patterns are modulated by individual temperamental differences and are reproduced in and over time, though at different levels, when interacting with novel partners. [ABSTRACT FROM AUTHOR]

Darwin proposed that smiles with eye constriction (Duchenne smiles) index strong positive emotion in infants, while cry-faces with eye constriction index strong negative emotion. Research has supported Darwin’s proposal with respect to smiling, but there has been little parallel research on cry-faces (open-mouth expressions with lateral lip stretching). To investigate the possibility that eye constriction indexes the affective intensity of positive and negative emotions, we first conducted the Face-to-Face/Still-Face (FFSF) procedure at 6 months. In the FFSF, three minutes of naturalistic infant-parent play interaction (which elicits more smiles than cry-faces) are followed by two minutes in which the parent holds an unresponsive still-face (which elicits more cry-faces than smiles). Consistent with Darwin’s proposal, eye constriction was associated with stronger smiling and with stronger cry-faces. In addition, the proportion of smiles with eye constriction was higher during the positive-emotion eliciting play episode than during the still-face. In parallel, the proportion of cry-faces with eye constriction was higher during the negative-emotion eliciting still-face than during play. These results are consonant with the hypothesis that eye constriction indexes the affective intensity of both positive and negative facial configurations. A preponderance of eye constriction during cry-faces was observed in a second elicitor of intense negative emotion, vaccination injections, at both 6 and 12 months of age. The results support the existence of a Duchenne distress expression that parallels the more well-known Duchenne smile. This suggests that eye constriction–the Duchenne marker–has a systematic association with early facial expressions of intense negative and positive emotion. [ABSTRACT FROM AUTHOR]

Infants with older siblings with Autism Spectrum Disorders (ASD-sibs) are at risk for socioemotional difficulties. ASD-sibs were compared to infants with typically developing older siblings (TD-sibs) using the face-to-face/still-face (FFSF) at 6 months and the Early Social Communication Scale (ESCS) at 8, 10, 12, 15, and/or 18 months. ASD-sibs smiled for a lower proportion of the FFSF than TD-sibs and lacked emotional continuity between episodes. With respect to TD-sibs, ASD-sibs engaged in lower rates of initiating joint attention at 15 months, lower rates of higher-level behavioral requests at 12 months, and responded to fewer joint attention bids at 18 months. The results suggest subtle, inconsistent, but multi-faceted deficits in emotional expression and referential communication in infants at-risk for ASDs. [ABSTRACT FROM AUTHOR]

Adults' perceptions provide information about the emotional meaning of infant facial expressions. This study asks whether similar facial movements influence adult perceptions of emotional intensity in both infant positive (smile) and negative (cry face) facial expressions. Ninety-five college students rated a series of naturally occurring and digitally edited images of infant facial expressions. Naturally occurring smiles and cry faces involving the co-occurrence of greater lip movement, mouth opening, and eye constriction, were rated as expressing stronger positive and negative emotion, respectively, than expressions without these 3 features. Ratings of digitally edited expressions indicated that eye constriction contributed to higher ratings of positive emotion in smiles (i.e., in Duchenne smiles) and greater eye constriction contributed to higher ratings of negative emotion in cry faces. Stronger mouth opening contributed to higher ratings of arousal in both smiles and cry faces. These findings indicate a set of similar facial movements are linked to perceptions of greater emotional intensity, whether the movements occur in positive or negative infant emotional expressions. This proposal is discussed with reference to discrete, componential, and dynamic systems theories of emotion. [ABSTRACT FROM AUTHOR]