Search

Adolescence is associated with maturation of function within neural networks supporting the processing of social information. Previous longitudinal studies have established developmental influences on youth’s neural response to facial displays of emotion. Given the increasing recognition of the importance of non-facial cues to social communication, we build on existing work by examining longitudinal change in neural response to vocal expressions of emotion in 8- to 19-year-old youth. Participants completed a vocal emotion recognition task at two timepoints (1 year apart) while undergoing functional magnetic resonance imaging. The right inferior frontal gyrus, right dorsal striatum and right precentral gyrus showed decreases in activation to emotional voices across timepoints, which may reflect focalization of response in these areas. Activation in the dorsomedial prefrontal cortex was positively associated with age but was stable across timepoints. In addition, the slope of change across visits varied as a function of participants’ age in the right temporo-parietal junction (TPJ): this pattern of activation across timepoints and age may reflect ongoing specialization of function across childhood and adolescence. Decreased activation in the striatum and TPJ across timepoints was associated with better emotion recognition accuracy. Findings suggest that specialization of function in social cognitive networks may support the growth of vocal emotion recognition skills across adolescence.

The perception of facial and vocal emotional expressions engages overlapping regions of the brain. However, at a behavioral level, the ability to recognize the intended emotion in both types of nonverbal cues follows a divergent developmental trajectory throughout childhood and adolescence. The current study a) identified regions of common neural activation to facial and vocal stimuli in 8- to 19-year-old typically-developing adolescents, and b) examined age-related changes in blood-oxygen-level dependent (BOLD) response within these areas. Both modalities elicited activation in an overlapping network of subcortical regions (insula, thalamus, dorsal striatum), visual-motor association areas, prefrontal regions (inferior frontal cortex, dorsomedial prefrontal cortex), and the right superior temporal gyrus. Within these regions, increased age was associated with greater frontal activation to voices, but not faces. Results suggest that processing facial and vocal stimuli elicits activation in common areas of the brain in adolescents, but that age-related changes in response within these regions may vary by modality.

The ability to recognize others' emotions based on vocal emotional prosody follows a protracted developmental trajectory during adolescence. However, little is known about the neural mechanisms supporting this maturation. The current study investigated age-related differences in neural activation during a vocal emotion recognition (ER) task. Listeners aged 8 to 19 years old completed the vocal ER task while undergoing functional magnetic resonance imaging. The task of categorizing vocal emotional prosody elicited activation primarily in temporal and frontal areas. Age was associated with a) greater activation in regions in the superior, middle, and inferior frontal gyri, b) greater functional connectivity between the left precentral and inferior frontal gyri and regions in the bilateral insula and temporo-parietal junction, and c) greater fractional anisotropy in the superior longitudinal fasciculus, which connects frontal areas to posterior temporo-parietal regions. Many of these age-related differences in brain activation and connectivity were associated with better performance on the ER task. Increased activation in, and connectivity between, areas typically involved in language processing and social cognition may facilitate the development of vocal ER skills in adolescence.

Adolescents born preterm (

Objective Many transgender adolescents experience clinically elevated anxiety and depression. Testosterone (T), used as a gender affirming treatment, may reduce symptoms of anxiety and depression. We assessed the effect of gender affirming T treatment on internalizing symptoms, body image dissatisfaction, and activation patterns within the amygdala-prefrontal cortex circuit in transgender adolescent boys. Method Symptoms of generalized anxiety, social anxiety, depression, suicidality and body image dissatisfaction were measured by self-report and brain activation was measured during a face processing task with functional MRI in a group of 19 adolescent transgender boys receiving T treatment and 23 not receiving gonadal hormone treatment (UT). Results Severity of anxiety and depression was significantly lower in the T treated group relative to the UT group, along with a trend of lower suicidality. The T group also reported less distress with body features and exhibited stronger connectivity within the amygdala-prefrontal cortex circuit compared to the UT group. Finally, group differences on depression and suicidality were directly associated with body image dissatisfaction, and anxiety symptoms were moderated by amygdala-prefrontal cortex connectivity differences between groups. Conclusion T treatment is associated with lower levels of internalizing symptoms among transgender adolescent boys. T is also associated with greater body satisfaction and greater connectivity in a neural circuit associated with anxiety and depression. Satisfaction with body image was found to overlap with the association between T and both depression and suicidality, and amygdala-prefrontal co-activation moderated the role of T on anxiety.

Refractory focal epilepsy (rFE) is commonly comorbid with impaired social functioning, which significantly reduces quality of life. Previous research has identified a mentalizing network in the brain-composed of the anterior temporal cortex, medial prefrontal cortex (mPFC), posterior temporal sulcus (pSTS), and temporoparietal junction-that is thought to play a critical role in social cognition. In typically-developing (TD) youth, this network undergoes a protracted developmental process with cortical thinning and white matter expansion occurring across adolescence. Because epilepsy is associated with both social dysfunction and irregular neural development, we investigated whether gray and white matter in the mentalizing network differed between youth with rFE (n = 22) and TD youth (n = 41) aged 8-21 years. Older age was associated with reduced cortical thickness in the bilateral mPFC in TD youth, but not in rFE youth. Compared to TD youth, rFE youth had greater white matter density in the right pSTS. Our findings suggest that rFE youth show atypical patterns of cortical thickness and white matter density in regions of the brain that are typically associated with social information processing, potentially as a result of ongoing seizures, comorbid conditions, or other illness-related factors. These results encourage future research to examine whether such variations in neural structure are predictive of specific social deficits in rFE youth.

Pediatric anxiety and depression significantly impair youth’s social and emotional functioning. The increased emergence of affective disorders during adolescence points to the involvement of several developing systems at the neural and behavioral level. This chapter characterizes deficits in social information processing and their underlying neural correlates in pediatric affective disorders. While typically-developing adolescents show enhanced amygdala response to salient stimuli in the context of deficient prefrontal cortex (PFC) regulation, anxious and depressed youth show hyperactivation in both regions in response to negative or threatening cues. Additionally, depressed adolescents show reduced limbic response to positive stimuli, suggesting deficits in appetitive motivational systems. These behavioral and neural patterns are related to phenotypic symptoms characteristic of anxiety and depression in youth.

Despite prior extensive investigations of the interactions between the amygdala and prefrontal cortex, few studies have simultaneously considered activation and structural connectivity in this circuit, particularly as it pertains to adolescent socioemotional development. The current multi-modal study delineated the correspondence between uncinate fasciculus (UF) connectivity and amygdala habituation in a large adolescent sample that was drawn from a population-based sample. We then examined the influence of demographic variables (age, gender, and pubertal status) on the relation between UF connectivity and amygdala habituation. 106 participants (15-17 years) completed DTI and an fMRI emotional face processing task. Left UF fractional anisotropy was associated with left amygdala habituation to fearful faces, suggesting that increased structural connectivity of the UF may facilitate amygdala regulation. Pubertal status moderated this structure-function relation, such that the association was stronger in those who were less mature. Therefore, UF connectivity may be particularly important for emotion regulation during early puberty. This study is the first to link structural and functional limbic circuitry in a large adolescent sample with substantial representation of ethnic minority participants, providing a more comprehensive understanding of socioemotional development in an understudied population.

Extremely preterm birth has been associated with atypical visual and neural processing of faces, as well as differences in gray matter structure in visual processing areas relative to full-term peers. In particular, the right fusiform gyrus, a core visual area involved in face processing, has been shown to have structural and functional differences between preterm and full-term individuals from childhood through early adulthood. The current study used multiple neuroimaging modalities to build a machine learning model based on the right fusiform gyrus to classify extremely preterm birth status.Extremely preterm adolescents (n = 20) and full-term peers (n = 24) underwent structural and functional magnetic resonance imaging. Group differences in gray matter density, measured via voxel-based morphometry (VBM), and blood-oxygen level-dependent (BOLD) response to face stimuli were explored within the right fusiform. Using group difference clusters as seed regions, analyses investigating outgoing white matter streamlines, regional homogeneity, and functional connectivity during a face processing task and at rest were conducted. A data driven approach was utilized to determine the most discriminative combination of these features within a linear support vector machine classifier.Group differences in two partially overlapping clusters emerged: one from the VBM analysis showing less density in the extremely preterm cohort and one from BOLD response to faces showing greater activation in the extremely preterm relative to full-term youth. A classifier fit to the data from the cluster identified in the BOLD analysis achieved an accuracy score of 88.64% when BOLD, gray matter density, regional homogeneity, and functional connectivity during the task and at rest were included. A classifier fit to the data from the cluster identified in the VBM analysis achieved an accuracy score of 95.45% when only BOLD, gray matter density, and regional homogeneity were included.Consistent with previous findings, we observed neural differences in extremely preterm youth in an area that plays an important role in face processing. Multimodal analyses revealed differences in structure, function, and connectivity that, when taken together, accurately distinguish extremely preterm from full-term born youth. Our findings suggest a compensatory role of the fusiform where less dense gray matter is countered by increased local BOLD signal. Importantly, sub-threshold differences in many modalities within the same region were informative when distinguishing between extremely preterm and full-term youth.

Does silently talking to yourself in the third-person constitute a relatively effortless form of self control? We hypothesized that it does under the premise that third-person self-talk leads people to think about the self similar to how they think about others, which provides them with the psychological distance needed to facilitate self control. We tested this prediction by asking participants to reflect on feelings elicited by viewing aversive images (Study 1) and recalling negative autobiographical memories (Study 2) using either “I” or their name while measuring neural activity via ERPs (Study 1) and fMRI (Study 2). Study 1 demonstrated that third-person self-talk reduced an ERP marker of selfreferential emotional reactivity (i.e., late positive potential) within the first second of viewing aversive images without enhancing an ERP marker of cognitive control (i.e., stimulus preceding negativity). Conceptually replicating these results, Study 2 demonstrated that third-person self-talk was linked with reduced levels of activation in an a priori defined fMRI marker of self-referential processing (i.e., medial prefrontal cortex) when participants reflected on negative memories without eliciting increased levels of activity in a priori defined fMRI markers of cognitive control. Together, these results suggest that third-person self-talk may constitute a relatively effortless form of self-control. This research was supported by funds provided by Michigan State University and the National Institutes of Health (HD065879) to JM and both funds provided by the University of Michigan and a grant provided by the John Templeton Foundation (#349798, #348747) to EK.

Adolescence is a period of intensive development in body, brain, and behaviour. Potentiated by changes in hormones and neural response to social stimuli, teenagers undergo a process of social re-orientation away from their caregivers and towards expanding peer networks. The current study examines how relative relational closeness to peers (compared to parents) during adolescence is linked to neural response to the facial emotional expressions of other teenagers. Self-reported closeness with friends (same- and opposite-sex) and parents (mother and father), and neural response to facial stimuli during fMRI, was assessed in 8- to 19-year-old typically-developing youth (n = 40, mean age = 13.90 years old, SD = 3.36; 25 female). Youth who reported greater relative closeness with peers than with parents showed decreased activation in the dorsolateral prefrontal cortex (dlPFC) during stimulus presentation, which may reflect lessened inhibitory control or regulatory response to peer-aged faces. Functional connectivity between the dlPFC and dorsal striatum was greatest in older youth who were closer to peers; in contrast, negative coupling between these regions was noted for both younger participants who were closer to peers and older participants who were closer to their parents. In addition, the association between relative closeness to peers and neural activation in regions of the social brain varied by emotion type and age. Results suggest that the re-orientation towards peers that occurs during adolescence is accompanied by changes in neural response to peer-aged social signals in social cognitive, prefrontal, and subcortical networks.

Individuals with epilepsy often experience social difficulties and deficits in social cognition. It remains unknown how disruptions to neural networks underlying such skills may contribute to this clinical phenotype. The current study compared the organization of relevant brain circuits—the “mentalizing network” and a salience-related network centered on the amygdala—in youth with and without epilepsy. Functional connectivity between the nodes of these networks was assessed, both at rest and during engagement in a social cognitive task (facial emotion recognition), using functional magnetic resonance imaging. There were no group differences in resting-state connectivity within either neural network. In contrast, youth with epilepsy showed comparatively lower connectivity between the left posterior superior temporal sulcus and the medial prefrontal cortex—but greater connectivity within the left temporal lobe—when viewing faces in the task. These findings suggest that the organization of a mentalizing network underpinning social cognition may be disrupted in youth with epilepsy, though differences in connectivity within this circuit may shift depending on task demands. Our results highlight the importance of considering functional task-based engagement of neural systems in characterizations of network dysfunction in epilepsy.

Individuals with epilepsy are at risk for social cognition deficits, including impairments in the ability to recognize nonverbal cues of emotion (i.e., emotion recognition [ER] skills). Such deficits are particularly pronounced in adult patients with childhood-onset seizures and are already evident in children and adolescents with epilepsy. Though these impairments have been linked to blunted neural response to emotional information in faces in adult patients, little is known about the neural correlates of ER deficits in youth with epilepsy. The current study compared ER accuracy and neural response to emotional faces during functional magnetic resonance imaging (fMRI) in youth with intractable focal epilepsy and typically developing youth. Relative to typically developing participants, individuals with epilepsy showed a) reduced accuracy in the ER task and b) blunted response to emotional faces (vs. neutral faces) in the bilateral fusiform gyri and right superior temporal gyrus (STG). Activation in these regions was correlated with performance, suggesting that aberrant response within these face-responsive regions may play a functional role in ER impairments. Reduced engagement of neural circuits relevant to processing socioemotional cues may be markers of risk for social cognitive deficits in youth with focal epilepsy.

The amygdala is critically involved in processing emotion. Through bidirectional connections, the prefrontal cortex (PFC) is hypothesized to influence amygdala reactivity. However, research that elucidates the nature of amygdala-PFC interactions - through mapping amygdala-prefrontal tracts, quantifying variability among tracts, and linking this variability to amygdala activation - is lacking. Using probabilistic tractography to map amygdala-prefrontal white matter connectivity in 142 adolescents, the present study found that white matter connectivity was greater between the amygdala and the subgenual cingulate, orbitofrontal (OFC), and dorsomedial (dmPFC) prefrontal regions than with the dorsal cingulate and dorsolateral regions. Then, using a machine-learning regression, we found that greater amygdala-PFC white matter connectivity was related to attenuated amygdala reactivity. This effect was driven by amygdala white matter connectivity with the dmPFC and OFC, supporting implicit emotion processing theories which highlight the critical role of these regions in amygdala regulation. This study is among the first to map and compare specific amygdala-prefrontal white matter tracts and to relate variability in connectivity to amygdala activation, particularly among a large sample of adolescents from a well-sampled study. By examining the association between specific amygdala-PFC tracts and amygdala activation, the present study provides novel insight into the nature of this emotion-based circuit.

Infant looking patterns during interaction offer an early window into social and nonsocial engagement. Recent evidence indicates that infant looks exhibit temporal dependency—one look duration predicts the next look duration. It is unknown, however, whether temporal dependency emerges as infants structure their own looking or whether it is influenced by interaction. We examined whether a perturbation of social interaction affected temporal dependency. Using the Face-to-Face/Still-Face procedure, we compared temporal dependency during parental interaction (the Face-to-Face & Reunion episodes) to parental non-responsiveness (the Still-Face episode). Overall, the durations of successive infant looks were predictable; past behavior constrained current behavior. The duration of one look at the parent (Face Look) predicted the duration of the next Face Look. Likewise, the duration of a look at any place that was not the parent’s face (Away Look) predicted the duration of the next Away Look. The temporal dependency of Face Looks (social engagement) was unaffected by the Still-Face perturbation, but the temporal dependency of Away Looks (nonsocial engagement) declined during the Still-Face. Infant temporal structuring of engagement during social looking is not dependent on parental interaction while the disruption of interaction affects infants’ structuring of their own non-social engagement.

Depression is linked to increased amygdala activation to neutral and negatively valenced facial expressions. Amygdala activation may be predictive of changes in depressive symptoms over time. However, most studies in this area have focused on small, predominantly female and homogenous clinical samples. Studies are needed to examine how amygdala reactivity relates to the course of depressive symptoms dimensionally, prospectively and in populations diverse in gender, race and socioeconomic status. A total of 156 men from predominately low-income backgrounds completed an fMRI task where they viewed emotional facial expressions. Left and right amygdala reactivity to neutral, but not angry or fearful, facial expressions relative to a non-face baseline at age 20 predicted greater depressive symptoms 2 years later, controlling for age 20 depressive symptoms. Heightened bilateral amygdala reactivity to neutral facial expressions predicted increases in depressive symptoms 2 years later in a large community sample. Neutral facial expressions are affectively ambiguous and a tendency to interpret these stimuli negatively may reflect to cognitive biases that lead to increases in depressive symptoms over time. Individual differences in amygdala reactivity to neutral facial expressions appear to identify those at most risk for a more problematic course of depressive symptoms across time.

Although the distinction between positive and negative facial expressions is assumed to be clear and robust, recent research with intense real-life faces has shown that viewers are unable to reliably differentiate the valence of such expressions (Aviezer, Trope, & Todorov, 2012). Yet, the fact that viewers fail to distinguish these expressions does not in itself testify that the faces are physically identical. In Experiment 1, the muscular activity of victorious and defeated faces was analyzed. Higher numbers of individually coded facial actions--particularly smiling and mouth opening--were more common among winners than losers, indicating an objective difference in facial activity. In Experiment 2, we asked whether supplying participants with valid or invalid information about objective facial activity and valence would alter their ratings. Notwithstanding these manipulations, valence ratings were virtually identical in all groups, and participants failed to differentiate between positive and negative faces. While objective differences between intense positive and negative faces are detectable, human viewers do not utilize these differences in determining valence. These results suggest a surprising dissociation between information present in expressions and information used by perceivers.

Emotions, when viewed from the affective neuroscience perspective, arise from organized patterns of brain activity, which function to generate adaptive behavioral responses. Behavior that emerges from emotional brain engagement can almost always be characterized as motivated. Thus, emotion and motivation are highly interdependent concepts, particularly when it comes to behavioral expression. However, emotions do not always generate behavior, and behavioral outcomes of emotional engagement—that is, motivated behavior—are not always adaptive. The intersection and dissociation of emotion and motivation are reviewed in this chapter from an affective neuroscience perspective that is heavily influenced by the work of Jaak Panksepp.

Internalizing disorders (i.e., depression and anxiety) are common comorbidities in people with epilepsy. In adults with epilepsy, comorbid depression or anxiety is associated with worse seizure control and reduced quality of life, and may be linked to specific neural biomarkers. Less is known about brain correlates of internalizing symptoms in pediatric populations. In the current study, we performed a retrospective analysis of 45 youth between the ages of 6 and 18 years old with intractable epilepsy. Individuals were evaluated for internalizing symptoms on the Child Behavior Checklist (CBCL) and underwent magnetic resonance (MR) and fluorodeoxyglucose (FDG)-positron emission tomography (PET) imaging as part of the clinical evaluation for surgical treatment of epilepsy. Forty-two percent of patients experienced clinically significant internalizing symptoms based on parent report. Compared with individuals who scored in the normal range, youth with clinical levels of internalizing problems showed overall reductions in cortex volume, as well as widespread reductions in cortical thickness and functional activation in the bilateral occipital/parietal lobe, left temporal regions, and left inferior frontal cortex on MR and PET scans. There were no group differences in amygdala or hippocampus volumes, nor other patient- or illness-related variables such as age, sex, or the type, lateralization, or duration of epilepsy. Results suggest that high rates of internalizing disorders are present in youth with refractory epilepsy. Multifocal reductions in cortical thickness and function may be nonspecific risk factors for clinically meaningful internalizing symptoms in youth with chronic epilepsy. As such, the presence of broad cortical thinning and reduced glucose uptake upon radiological examination may warrant more focused clinical evaluation of psychological symptoms.

In infants, eye constriction—the Duchenne marker—and mouth opening appear to index the intensity of both positive and negative facial expressions. We combined eye constriction and mouth opening that co-occurred with smiles and cry-faces (respectively, the prototypic expressions of infant joy and distress) to measure emotional expression intensity. Expression intensity and heart rate were measured throughout the Face-to-Face/Still Face (FFSF) in a sample of infants with prenatal cocaine exposure who were at risk for developmental difficulties. Smiles declined and cry-faces increased in the still-face episode, but the distribution of eye constriction and mouth opening in smiles and cry-faces did not differ across episodes of the FFSF. As time elapsed in the still face episode potential indices of intensity increased, cry-faces were more likely to be accompanied by eye constriction and mouth opening. During cry-faces there were also moderately stable individual differences in the quantity of eye constriction and mouth opening. Infant heart rate was higher during cry-faces and lower during smiles, but did not vary with intensity of expression or by episode. In sum, infants express more intense negative affect as the still-face progresses, but do not show clear differences in expressive intensity between episodes of the FFSF.

Although looking time is used to assess infant perceptual and cognitive processing, little is known about the temporal structure of infant looking. To shed light on this temporal structure, 127 three-month-olds were assessed in an infant-controlled habituation procedure and presented with a pre-recorded display of a woman addressing the infant using infant-directed speech. Previous individual look durations positively predicted subsequent look durations over a six look window, suggesting a temporal dependency between successive infant looks. The previous look duration continued to predict the subsequent look duration after accounting for habituation-linked declines in look duration, and when looks were separated by an inter-trial interval in which no stimulus was displayed. Individual differences in temporal dependency, the strength of associations between consecutive look durations, are distinct from individual differences in mean infant look duration. Nevertheless, infants with stronger temporal dependency had briefer mean look durations, a potential index of stimulus processing. Temporal dependency was evident not only between individual infant looks but between the durations of successive habituation trials (total looking within a trial). Finally, temporal dependency was evident in associations between the last look at the habituation stimulus and the first look at a novel test stimulus. Thus temporal dependency was evident across multiple timescales (individual looks and trials comprised of multiple individual looks) and persisted across conditions including brief periods of no stimulus presentation and changes from a familiar to novel stimulus. Associations between consecutive look durations over multiple timescales and stimuli suggest a temporal structure of infant attention that has been largely ignored in previous work on infant looking.

Social deficits in autism spectrum disorder (ASD) are linked to amygdala functioning and functional connection between the amygdala and subgenual anterior cingulate cortex (sACC) is involved in the modulation of amygdala activity. Impairments in behavioral symptoms and amygdala activation and connectivity with the sACC seem to vary by serotonin transporter-linked polymorphic region (5-HTTLPR) variant genotype in diverse populations. The current preliminary investigation examines whether amygdala-sACC connectivity differs by 5-HTTLPR genotype and relates to social functioning in ASD. A sample of 108 children and adolescents (44 ASD) completed an fMRI face-processing task. Youth with ASD and low expressing 5-HTTLPR genotypes showed significantly greater connectivity than youth with ASD and higher expressing genotypes as well as typically developing (TD) individuals with both low and higher expressing genotypes, in the comparison of happy vs. baseline faces and happy vs. neutral faces. Moreover, individuals with ASD and higher expressing genotypes exhibit a negative relationship between amygdala-sACC connectivity and social dysfunction. Altered amygdala-sACC coupling based on 5-HTTLPR genotype may help explain some of the heterogeneity in neural and social function observed in ASD. This is the first ASD study to combine genetic polymorphism analyses and functional connectivity in the context of a social task. Keywords: Autism spectrum disorder, Serotonin, Amygdala, Subgenual anterior cingulate cortex, 5-HTTLPR, Connectivity, Face-processing, Heterogeneity

Facial expressions frequently involve multiple individual facial actions. How do facial actions combine to create emotionally meaningful expressions? Infants produce positive and negative facial expressions at a range of intensities. It may be that a given facial action can index the intensity of both positive (smiles) and negative (cry-face) expressions. Objective, automated measurements of facial action intensity were paired with continuous ratings of emotional valence to investigate this possibility. Degree of eye constriction (the Duchenne marker) and mouth opening were each uniquely associated with smile intensity and, independently, with cry-face intensity. Additionally, degree of eye constriction and mouth opening were each unique predictors of emotion valence ratings. Eye constriction and mouth opening index the intensity of both positive and negative infant facial expressions, suggesting parsimony in the early communication of emotion.

Positive emotional engagement develops in the context of face-to-face interactions during the first six months of life. Deficits in emotional engagement are characteristic of autism spectrum disorder (ASD) and may characterize the younger siblings of children with ASD (high-risk siblings). High-risk siblings are likely to exhibit a broad range of positive emotional engagement that may or may not be associated with ASD outcomes. We examined positive emotional engagement (i.e., smiling rate and contingent responsiveness to the partner’s smile) during the infant-parent interaction episodes of the Face-to-Face/Still Face protocol at six months of age. The sample included 43 high-risk infant siblings, 11 of whom went on to an ASD diagnosis, and 25 low-risk siblings with no family history of ASD. Low-risk siblings and high-risk siblings without ASD showed the typical “still-face effect” (i.e., decreases in smiling rate after period of parental non-responsiveness), but high-risk siblings with later ASD outcomes did not show this decrease. Although high-risk siblings without an ASD diagnosis were less likely to respond to their parents’ smiles than low-risk siblings, the children with eventual ASD did not differ from the other groups in contingent responsiveness. Findings suggest that subtle differences in positive emotional engagement are present in the early development of high-risk siblings but are not consistently associated with ASD outcomes.

Many high-profile societal problems involve an individual or group repeatedly attacking another – from child-parent disputes, sexual violence against women, civil unrest, violent conflicts and acts of terror, to current cyber-attacks on national infrastructure and ultrafast cyber-trades attacking stockholders. There is an urgent need to quantify the likely severity and timing of such future acts, shed light on likely perpetrators, and identify intervention strategies. Here we present a combined analysis of multiple datasets across all these domains which account for >100,000 events, and show that a simple mathematical law can benchmark them all. We derive this benchmark and interpret it, using a minimal mechanistic model grounded by state-of-the-art fieldwork. Our findings provide quantitative predictions concerning future attacks; a tool to help detect common perpetrators and abnormal behaviors; insight into the trajectory of a ‘lone wolf'; identification of a critical threshold for spreading a message or idea among perpetrators; an intervention strategy to erode the most lethal clusters; and more broadly, a quantitative starting point for cross-disciplinary theorizing about human aggression at the individual and group level, in both real and online worlds.

State–space modeling techniques provide a convenient modeling platform for representing systematic trends as well as patterns of intraindividual variability around these trends. Their flexibility in accommodating multivariate processes renders them particularly suited to studying dyadic and family processes that show complex ebbs and flows over time. Using dyadic data collected during the Face-to-Face/Still-Face (FFSF) procedure, examples are provided to explicate the use of state–space models to capture two kinds of changes: systematic trends that are relatively smooth and slow-varying, and transient patterns of intraindividual variability that are manifested on a moment-to-moment basis.

We investigated the dynamics of head motion in parents and infants during an age-appropriate, well-validated emotion induction, the Face-to-Face/Still-Face procedure. Participants were 12 ethnically diverse 6-month-old infants and their mother or father. During infant gaze toward the parent, infant angular amplitude and velocity of pitch and yaw decreased from face-to-face (FF) to still-face (SF) episodes and remained lower in the following Reunion (RE). During infant gaze away from the parent, angular velocity of pitch decreased from FF to SF and remained lower in the RE. Windowed cross-correlation suggested strong bidirectional effects with frequent shifts in the direction of influence. The number of significant positive and negative peaks was higher during FF than RE. Gaze toward and away from the parent was modestly predicted by head orientation. Together, these findings suggest that head motion is strongly related to age-appropriate emotion challenge, are consistent with the hypothesis that perturbations of normal responsiveness carry-over even after the parent resumes normal responsiveness in the reunion, and that there are frequent changes in direction of influence in the postural domain.

To model the dynamics of social interaction, it is necessary both to detect specific Action Units (AUs) and variation in their intensity and coordination over time. An automated method that performs well when detecting occurrence may or may not perform well for intensity measurements. We compared two dimensionality reduction approaches - Principal Components Analysis with Large Margin Nearest Neighbor (PCA+LMNN) and Laplacian Eigenmap - and two classifiers, SVM and K-Nearest Neighbor. Twelve infants were video-recorded during face-to-face interactions with their mothers. AUs related to positive and negative affect were manually coded from the video by certified FACS coders. Facial features were tracked using Active Appearance Models (AAM) and registered to a canonical view before extracting Histogram of Oriented Gradients (HOG) features. All possible combinations of dimensionality reduction approaches and classifiers were tested using a leave-onesubject-out cross-validation. For detecting consistency (i.e. reliability as measured by ICC), PCA+LMNN and SVM classifiers gave best results.

Intensity measurements of infant facial expressions are central to understand emotion-mediated interactions and emotional development. We evaluate alternative image representations for automatic measurement of the intensity of spontaneous facial Action Units (AUs) related to infant emotion expression. Twelve infants were video-recorded during face-to-face interactions with their mothers. Facial features were tracked using active appearance models (AAMs) and registered to a canonical view. Three feature representations were compared: shape and grey scale texture, Histogram of Oriented Gradients (HOG), and Local Binary Pattern Histograms (LBPH). To reduce the high dimensionality of the appearance features (grey scale texture, HOG, and LBPH), a non-linear algorithm was used (Laplacian Eigenmaps). For each representation, support vector machine classifiers were used to learn six gradations of AU intensity (0 to maximal). The target AUs were those central to positive and negative infant emotion. Shape plus grey scale texture performed best for AUs that involve non-rigid deformations of permanent facial features (e.g., AU 12 and AU 20). These findings suggest that AU intensity detection may be maximized by choosing feature representations best suited for specific AU.

This paper presents the possibility of using pattern recognition algorithms of infant gaze patterns at six months of age among children at high risk for an autism spectrum disorder (ASD). ASDs, which must be diagnosed by 3 years of age, are characterized by communication and interaction impairments which frequently involve disturbances of visual attention and gaze patterning. We used video cameras to record the face-to-face interactions of 32 infant subjects with their parents. The video was manually coded to determine the eye gaze pattern of infants by marking where the infant was looking in each frame (either at their parent's face or away from their parent's face). In order to identify infants ASD diagnosis at three years, we analyzed infant eye gaze patterns at six months. Variable-order Markov Models (VMM) were used to create models for typically developing comparison children as well as children with an ASD. The models correctly classified infants who did and did not develop an ASD diagnosis with an accuracy rate of 93.75 percent. Employing an assessment tool at a very young age offers the hope of early intervention, potentially mitigating the effects of the disorder throughout the rest of the child's life.

Darwin proposed that smiles with eye constriction (Duchenne smiles) index strong positive emotion in infants, while cry-faces with eye constriction index strong negative emotion. Research has supported Darwin's proposal with respect to smiling, but there has been little parallel research on cry-faces (open-mouth expressions with lateral lip stretching). To investigate the possibility that eye constriction indexes the affective intensity of positive and negative emotions, we first conducted the Face-to-Face/Still-Face (FFSF) procedure at 6 months. In the FFSF, three minutes of naturalistic infant-parent play interaction (which elicits more smiles than cry-faces) are followed by two minutes in which the parent holds an unresponsive still-face (which elicits more cry-faces than smiles). Consistent with Darwin's proposal, eye constriction was associated with stronger smiling and with stronger cry-faces. In addition, the proportion of smiles with eye constriction was higher during the positive-emotion eliciting play episode than during the still-face. In parallel, the proportion of cry-faces with eye constriction was higher during the negative-emotion eliciting still-face than during play. These results are consonant with the hypothesis that eye constriction indexes the affective intensity of both positive and negative facial configurations. A preponderance of eye constriction during cry-faces was observed in a second elicitor of intense negative emotion, vaccination injections, at both 6 and 12 months of age. The results support the existence of a Duchenne distress expression that parallels the more well-known Duchenne smile. This suggests that eye constriction-the Duchenne marker-has a systematic association with early facial expressions of intense negative and positive emotion.