Search

International audience; The large heterogeneity observed among individuals with similar audiograms for understanding speech in noisy environments still remains poorly understood. Supra-threshold sensory mechanisms, i.e. that operate above detection threshold, likely play a prominent role in these interindividual differences, but a precise view of where and how distortions arise along the auditory processing hierarchy is lacking. Spectrotemporal modulations (STM) - noise signals whose envelope is jointly modulated in time and frequency - offer a unified mathematical framework to probe these supra-threshold processes as they are recruited with speech signals. Yet, at present, it remains unknown how STMs are processed by the human auditory system, and how this processing varies between individuals. In order to provide a clear computational understanding of STM processing for both normal-hearing (NH) and hearing-impaired (HI) individuals, we developed a novel methodological framework that combines psychophysical reverse-correlation experiments deployed in the modulation domain with simulations from current supra-threshold auditory models. In this talk, we will present recent results collected in various tasks where both normal-hearing and hearing-impaired listeners detect or discriminate specific target STMs embedded in other masking STMs. We will show which aspects of their results can be accounted for by frequency selectivity and temporal-envelope based mechanisms, and which cannot, highlighting the need to consider additional mechanisms. Finally, we will discuss how, by focusing on the origins of the variability that remains unaccounted for by these models, this joint experimental-modeling approach could actually be used to pinpoint the peripheral and central components underlying supra-threshold hearing distortions in each individual.

Understanding how people rate their confidence is critical for the characterization of a wide range of perceptual, memory, motor and cognitive processes. To enable the continued exploration of these processes, we created a large database of confidence studies spanning a broad set of paradigms, participant populations and fields of study. The data from each study are structured in a common, easy-to-use format that can be easily imported and analysed using multiple software packages. Each dataset is accompanied by an explanation regarding the nature of the collected data. At the time of publication, the Confidence Database (which is available at ) contained 145 datasets with data from more than 8,700 participants and almost 4 million trials. The database will remain open for new submissions indefinitely and is expected to continue to grow. Here we show the usefulness of this large collection of datasets in four different analyses that provide precise estimations of several foundational confidence-related effects., NIH National Institute of Mental Health (NIMH)

1AbstractPriors and payoffs are known to affect perceptual decision-making, but little is understood about how they influence confidence judgments. For optimal perceptual decision-making, both priors and payoffs should be considered when selecting a response. However, for confidence to reflect the probability of being correct in a perceptual decision, priors should affect confidence but payoffs should not. To experimentally test whether human observers follow this normative behavior, we conducted an orientation-discrimination task with varied priors and payoffs, probing both perceptual and metacognitive decision-making. We then examined the placement of discrimination and confidence criteria according to several plausible Signal Detection Theory models. In the normative model, observers use the optimal discrimination criterion (i.e., the criterion that maximizes expected gain) and confidence criteria that shift with the discrimination criterion that maximizes accuracy (i.e., are not affected by payoffs). No observer was consistent with this model, with the majority exhibiting non-normative confidence behavior. One subset of observers ignored both priors and payoffs for confidence, always fixing the confidence criteria around the neutral discrimination criterion. The other group of observers incorrectly incorporated payoffs into their confidence by always shifting their confidence criteria with the same gains-maximizing criterion used for discrimination. Such metacognitive mistakes could have negative consequences outside the laboratory setting, particularly when priors or payoffs are not matched for all the possible decision alternatives.

International audience; Metaperception is the self-monitoring and self-control of one's own perception. Perceptual confidence is the prototypical example of metaperception. Perceptual confidence refers to the ability to judge whether a perceptual decision is correct. We argue that metaperception is not limited to confidence but includes other judgments such as the estimation of familiarity and the aesthetic experience of sensory events. Perceptual confidence has recently received a surge of interests due in particular to the design of careful psychophysical experiments and powerful computational models. In psychophysics, the use of confidence ratings is the dominant methodology, but other paradigms are available, including the confidence forced choice. In this latter paradigm, participants are presented with two stimuli, make perceptual decisions about these stimuli, and then choose which decision is more likely to be correct. One benefit of confidence forced choice is that it disregards confidence biases to focus on confidence sensitivity. Confidence forced choice might also be a paradigm that will allow us to establish whether confidence is estimated serially or in parallel to the perceptual decision.

International audience; Recent works suggest that the global-local organizational principles of auditory processing are comparable to that of visual processing, with a superior efficiency as well as stronger interferences of global over local processing. Yet, the factors governing auditory local-global processing organization remain poorly understood. Here, we introduce a novel paradigm that attempts to better characterize local-global temporal processing taking into account musical expertise. The ability of non-musicians as well as expert musicians to detect local and/or global pitch changes occurring in short hierarchical sequences is assessed. Importantly, melodic structures of different complexity are considered, in which the changes can occur at various temporal positions and over different scales, thus forcing listeners to attend to the whole sequences. Built in a signal detection theory framework, this experimental paradigm provides ideal conditions to assess potential global-local interference effects and tease apart differences in processing efficiencies vs. response strategies. On average, our results demonstrate a clear distinction between the local-global processing organization of non-musicians and musicians. While non-musicians show clear global advantage and global-to-local interference ef- fects, in line with previous observations, this pattern is reversed in musicians. Yet, we observe important interindividual differences within each group, with some non-musicians exhibiting a global-local organization similar to that of expert listeners. Overall, these results provide a detailed characterization of how the different temporal processing scales are re-organized following long-term musical training, with a reversal of the initial global predominance to provide mu- sicians with enhanced analytic listening abilities. More interestingly, they suggest that this reorganization is mediated by both increased general auditory abilities as well as the acquisition of novel discrimination strategies. Overall, the present study yields new insights regarding the organization of our perceptual system to deal with auditory information over different temporal scales, and shows how this can be reshaped through experience and training.

International audience

International audience; We investigated whether the moment at which an event is perceived depends on its temporal context. Participants learned a mapping between time and space by watching the hand of a clock rotating a full revolution in a fixed duration. Then the hand was removed, and a target disc was flashed within a fixed-interval duration. Participants were to indicate where the hand would have been at the time of the target. In three separate experiments, we estimated the disruption from a distractor disc that was presented before or after the target disc, with a variable time between them. The target was either revealed at the end of the trial or cued beforehand, and in the latter case, was cued by either color or temporal order. We found an attraction to the presentation time of the distractor when both events were attended equally (target revealed at the end). When the target was cued beforehand, the reported time was under-or overestimated, depending on whether the nature of distractor had to be decoded (precued by color) or not (precued by order). In summary, the perceived time of an event is always affected by other events in temporal proximity, but the nature of this effect depends on how each event is attended.

International audience; The precision to locate individual features in depth can often be improved by integrating information over space. However, this integration can sometimes be extremely detrimental, as for example in the case of the Westheimer-McKee phenomenon where features are grouped to form an object. We replicate here the known loss of precision in this phenomenon and document an additional loss of accuracy. These detrimental effects are still present when the object is elicited by other principles of organization, including a cross-modal auditory cue. Similar effects of object formation are found on lateral motion sensitivity. We then present a simple probabilistic model based on the integration of estimated depth within an object and propagation of object mean depth and uncertainty back to the elementary features of the object. This propagation of object uncertainty is a hitherto underestimated side-effect of object formation.

The world teems with complex sounds that animals have to interpret in order to survive. To do so, their brain must represent the richness of the sounds' acoustic structure, from simple to high-order features. Understanding how it does it, however, remains filled with challenges. In this thesis, these questions were explored through a new technical prism, namely functional UltraSound imaging (fUSi). First, fUSi was used to investigate with a high fidelity the topographical organization of the auditory system, as well as its connectivity with other brain areas. Second, it provided fundamental clues for our understanding of how natural sounds are encoded in the auditory cortex, and hints at the human particularities for speech processing. Last, it gave us access to non-continuous topographical encoding, with the example of spatial localization. Through these three aspects, we exposed the different spatially organized modules of processing that overlap within a single brain area.; Le monde extérieur regorge de sons complexes, que chaque animal doit interpréter afin de survivre. Pour ce faire, leur cerveau se doit de représenter toute la richesse de la structure acoustique de ces sons, jusque dans leurs propriétés les plus complexes. Dans cette thèse, cette question est explorée à travers un nouveau prisme, l'imagerie fonctionnelle ultrasonore (fUS). Dans un premier temps, l'imagerie fUS est utilisée pour étudier avec une haute fidélité l'organisation topographique du système auditif, ainsi que ses connexions avec d'autres aires cérébrales. Dans un deuxième temps, elle permet d'explorer des aspects fondamentaux de la façon dont le cortex auditif encode les sons naturels, ainsi que les spécificités humaines pour le traitement du langage. Enfin, elle révèle des formes topographiques mais non continues d'encodage, avec l'exemple de la localisation spatiale des sons. À travers ces trois aspects sont révélés les différents modules de traitement de l'information auditive, spatialement organisés, qui se superposent au sein d'une aire cérébrale unique.

The world teems with complex sounds that animals have to interpret in order to survive. To do so, their brain must represent the richness of the sounds' acoustic structure, from simple to high-order features. Understanding how it does it, however, remains filled with challenges. In this thesis, these questions were explored through a new technical prism, namely functional UltraSound imaging (fUSi). First, fUSi was used to investigate with a high fidelity the topographical organization of the auditory system, as well as its connectivity with other brain areas. Second, it provided fundamental clues for our understanding of how natural sounds are encoded in the auditory cortex, and hints at the human particularities for speech processing. Last, it gave us access to non-continuous topographical encoding, with the example of spatial localization. Through these three aspects, we exposed the different spatially organized modules of processing that overlap within a single brain area., Le monde extérieur regorge de sons complexes, que chaque animal doit interpréter afin de survivre. Pour ce faire, leur cerveau se doit de représenter toute la richesse de la structure acoustique de ces sons, jusque dans leurs propriétés les plus complexes. Dans cette thèse, cette question est explorée à travers un nouveau prisme, l'imagerie fonctionnelle ultrasonore (fUS). Dans un premier temps, l'imagerie fUS est utilisée pour étudier avec une haute fidélité l'organisation topographique du système auditif, ainsi que ses connexions avec d'autres aires cérébrales. Dans un deuxième temps, elle permet d'explorer des aspects fondamentaux de la façon dont le cortex auditif encode les sons naturels, ainsi que les spécificités humaines pour le traitement du langage. Enfin, elle révèle des formes topographiques mais non continues d'encodage, avec l'exemple de la localisation spatiale des sons. À travers ces trois aspects sont révélés les différents modules de traitement de l'information auditive, spatialement organisés, qui se superposent au sein d'une aire cérébrale unique.

Temporal attention enhances the perceptual representation of a stimulus at a particular point in time. The number of possible attentional episodes in a given period is limited, but whether observers’ confidence reflects such limitations is still unclear. To investigate this issue, we adapted an “Attentional Blink” paradigm, presenting observers with a rapid visual stream of letters containing two targets cued for subsequent perceptual reports and confidence judgments. We found three main results. First, when two targets fell within the same attentional episode, the second target underwent a strong under-confidence bias. In other words, confidence neglected that a single attentional episode can benefit to both targets. Second, despite this initial bias, confidence was strongly correlated with response probability. Third, as confidence was yoked to the evidence used in perceptual reports, it remains blind to delays in response selection for the second target. Notably, the second target was often mistaken with a later item associated with higher confidence. These results suggest that confidence does not perfectly evaluate the limits of temporal attention in challenging situations.

International audience; Humans and animals maintain accurate sound discrimination in the presence of loud sources of background noise. It is commonly assumed that this ability relies on the robustness of auditory cortex responses. However, only a few attempts have been made to characterize neural discrimination of communication sounds masked by noise at each stage of the auditory system and to quantify the noise effects on the neuronal discrimination in terms of alterations in amplitude modulations. Here, we measured neural discrimination between communication sounds masked by a vocalization-shaped stationary noise from multiunit responses recorded in the cochlear nucleus, inferior colliculus, auditory thalamus, and primary and secondary auditory cortex at several signal-to-noise ratios (SNRs) in anesthetized male or female guinea pigs. Masking noise decreased sound discrimination of neuronal populations in each auditory structure, but collicular and thalamic populations showed better performance than cortical populations at each SNR. In contrast, in each auditory structure, discrimination by neuronal populations was slightly decreased when tone-vocoded vocalizations were tested. These results shed new light on the specific contributions of subcortical structures to robust sound encoding, and suggest that the distortion of slow amplitude modulation cues conveyed by communication sounds is one of the factors constraining the neuronal discrimination in subcortical and cortical levels.SIGNIFICANCE STATEMENT Dissecting how auditory neurons discriminate communication sounds in noise is a major goal in auditory neuroscience. Robust sound coding in noise is often viewed as a specific property of cortical networks, although this remains to be demonstrated. Here, we tested the discrimination performance of neuronal populations at five levels of the auditory system in response to conspecific vocalizations masked by noise. In each acoustic condition, subcortical neurons better discriminated target vocalizations than cortical ones and in each structure, the reduction in discrimination performance was related to the reduction in slow amplitude modulation cues.

International audience; There is increasing evidence that hearing-impaired (HI) individuals do not use the same listening strategies as normal-hearing (NH) individuals, even when wearing optimally fitted hearing aids. In this perspective, better characterization of individual perceptual strategies is an important step toward designing more effective speech-processing algorithms. Here, we describe two complementary approaches for (a) revealing the acoustic cues used by a participant in a /d/-/g/ categorization task in noise and (b) measuring the relative contributions of these cues to decision. These two approaches involve natural speech recordings altered by the addition of a "bump noise." The bumps were narrowband bursts of noise localized on the spectrotemporal locations of the acoustic cues, allowing the experimenter to manipulate the consonant percept. The cue-weighting strategies were estimated for three groups of participants: 17 NH listeners, 18 HI listeners with high-frequency loss, and 15 HI listeners with flat loss. HI participants were provided with individual frequency-dependent amplification to compensate for their hearing loss. Although all listeners relied more heavily on the high-frequency cue than on the low-frequency cue, an important variability was observed in the individual weights, mostly explained by differences in internal noise. Individuals with high-frequency loss relied slightly less heavily on the high-frequency cue relative to the low-frequency cue, compared with NH individuals, suggesting a possible influence of supra-threshold deficits on cue-weighting strategies. Altogether, these results suggest a need for individually tailored speech-in-noise processing in hearing aids, if more effective speech discriminability in noise is to be achieved.

International audience; Machine learning classification techniques are frequently applied to structural and resting-state fMRI data to identify brain-based biomarkers for developmental disorders. However, task-related fMRI has rarely been used as a diagnostic tool. Here, we used structural MRI, resting-state connectivity and task-based fMRI data to detect congenital amusia, a pitch-specific developmental disorder. All approaches discriminated amusics from controls in meaningful brain networks at similar levels of accuracy. Interestingly, the classifier outcome was specific to deficit-related neural circuits, as the group classification failed for fMRI data acquired during a verbal task for which amusics were unimpaired. Most importantly, classifier outputs of task-related fMRI data predicted individual behavioral performance on an independent pitch-based task, while this relationship was not observed for structural or resting-state data. These results suggest that task-related imaging data can potentially be used as a powerful diagnostic tool to identify developmental disorders as they allow for the prediction of symptom severity.

An outstanding challenge for consciousness research is to characterize the neural signature of conscious access independently of any decisional processes. Here we present a model-based approach that uses inter-trial variability to identify the brain dynamics associated with stimulus processing. We demonstrate that, even in the absence of any task or behavior, the electroencephalographic response to auditory stimuli shows bifurcation dynamics around 250–300 milliseconds post-stimulus. Namely, the same stimulus gives rise to late sustained activity on some trials, and not on others. This late neural activity is predictive of task-related reports, and also of reports of conscious contents that are randomly sampled during task-free listening. Source localization further suggests that task-free conscious access recruits the same neural networks as those associated with explicit report, except for frontal executive components. Studying brain dynamics through variability could thus play a key role for identifying the core signatures of conscious access, independent of report., Current knowledge on the neural basis of consciousness mostly relies on situations where people report their perception. Here, the authors provide evidence for the idea that bifurcation in brain dynamics reflects conscious perception independent of report.

International audience; Can members of a remote Amazonian tribe and Boston-trained musicians share similarities in their mental representations of auditory pitch? Yes, as shown by an impressive new set of psychoacoustic evidence, which highlights the universal importance of relative pitch patterns.

International audience; The ability to detect amplitude modulation (AM) is essential to distinguish the spectro-temporal features of speech from those of a competing masker. Previous work shows that AM sensitivity improves until 10 years of age. This may relate to the development of sensory factors (tuning of AM filters, susceptibility to AM masking) or to changes in processing efficiency (reduction in internal noise, optimization of decision strategies). To disentangle these hypotheses, three groups of children (5-11 years) and one of young adults completed psychophysical tasks measuring thresholds for detecting sinusoidal AM (with a rate of 4, 8, or 32 Hz) applied to carriers whose inherent modulations exerted different amounts of AM masking. Results showed that between 5 and 11 years, AM detection thresholds improved and that susceptibility to AM masking slightly increased. However, the effects of AM rate and carrier were not associated with age, suggesting that sensory factors are mature by 5 years. Subsequent modelling indicated that reducing internal noise by a factor 10 accounted for the observed developmental trends. Finally, children's consonant identification thresholds in noise related to some extent to AM sensitivity. Increased efficiency in AM detection may support better use of temporal information in speech during childhood.

SummaryHumans engagement in music rests on underlying elements such as the listeners’ cultural background and general interest in music, all shaping the way music is processed in the brain and perceived. Crucially, these factors modulate how listeners anticipate musical events, a process inducing instantaneous neural responses as the music confronts these expectations. Measuring such neural correlates would represent a direct window into high-level brain processing of music. Here we recorded electroencephalographic and electrocorticographic brain responses as participants listened to Bach melodies. We assessed the relative contributions of the acoustic versus melodic components of the music to the neural signal. Acoustic features included envelope and its derivative. Melodic features included information on melodic progressions (pitch) and their tempo (onsets), which were extracted from a Markov model predicting the next note based on a corpus of Western music and the preceding proximal musical context. We related the music to brain activity with a linear temporal response function, and demonstrated that cortical responses to music encode melodic expectations. Specifically, individual-subject neural signals were better predicted by a combination of acoustic and melodic expectation features than by either alone. This effect was most pronounced at response latencies up to 350ms, and in both planum temporale and Heschl’s gyrus. Finally, expectations of pitch and onset-time of musical notes exerted independent cortical effects, and such influences were modulated by the listeners’ musical expertise. Overall, this study demonstrates how the interplay of experimental and theoretical approaches can yield novel insights into the cortical encoding of melodic expectations.

What has been previously experienced can systematically affect human perception in the present. We designed a novel psychophysical experiment to measure the perceptual effects of adapting to dynamically changing stimulus statistics. Observers are presented with a series of oriented Gabor patches and are asked occasionally to judge the orientation of highly ambiguous test patches. We developed a computational model to quantify the influence of past stimuli presentations on the observers' perception of test stimuli over multiple timescales and to show that this influence is distinguishable from simple response biases. The experimental results reveal that perception is attracted toward the very recent past and simultaneously repulsed from stimuli presented at short to medium timescales and attracted to presentations further in the past. All effects differ significantly both on their relative strength and their respective duration. Our model provides a structured way of quantifying serial effects in psychophysical experiments, and it could help experimenters in identifying such effects in their data and distinguish them from less interesting response biases.

Does the moment when an event is perceived depends on where it is presented? To measure when participants perceived events, they were first familiarized with trial duration, by watching the hand of a clock rotating. Then, the hand was removed, and stimuli were presented at a random time from the trial onset. Participants indicated the location where the hand would have been when the stimulus was presented. The stimuli’s eccentricity, the appearance, and location of the spatial features of the clock were varied. The targets were reported earlier if they were presented in spatial proximity to the clock outline, even when it was not presented during the trial. The effect was replicated with stimuli presented at the same distance from fixation but at different distances from the spatial features. In summary, the time of an event is perceived earlier if it is presented near attended features in the visual scene.

International audience; Amyotrophic lateral sclerosis (ALS) is a neurodegenerative disorder causing a progressive motor weakness of all voluntary muscles, whose progression challenges communication modalities such as handwriting or speech. The current study investigated whether ALS subjects can use Eye-On-Line (EOL), a novel eye-operated communication device allowing, after training, to voluntarily control smooth-pursuit eye-movements (SPEM) so as to eye-write in cursive. To that aim, ALS participants (n = 12) with preserved eye-movements but impaired handwriting were trained during six on-site visits. The primary outcome of the study was the recognition of eye-written digits (0-9) from ALS and healthy control subjects by naïve "readers." Changes in oculomotor performance and the safety of EOL were also evaluated. At the end of the program, 69.4% of the eye-written digits from 11 ALS subjects were recognized by naïve readers, similar to the 67.3% found for eye-written digits from controls participants, with however, large inter-individual differences in both groups of "writers." Training with EOL was associated with a transient fatigue leading one ALS subject to drop out the study at the fifth visit. Otherwise, itching eyes was the most common adverse event (3 subjects). This study shows that, despite the impact of ALS on the motor system, most ALS participants could improve their mastering of eye-movements, so as to produce recognizable eye-written digits, although the eye-traces sometimes needed smoothing to ease digit legibility from both ALS subjects and control participants. The capability to endogenously and voluntarily generate eye-traces using EOL brings a novel way to communicate for disabled individuals, allowing creative personal and emotional expression.

Between 1 to 5 out of 100 people worldwide has never experienced normotypic vision due to a condition called amblyopia, and about 1 out of 4000 suffer from inherited retinal dystrophies that progressively lead them to blindness. While a wide range of technologies and therapies are being developed to restore vision, a fundamental question still remains unanswered: would the adult visual brain retain a sufficient plastic potential to learn how to see after a prolonged period of abnormal visual experience? In this review we summarize studies showing that the visual brain of sighted adults retains a type of developmental plasticity, called homeostatic plasticity, and this property has been recently exploited successfully for adult amblyopia recover. Next, we discuss how the brain circuits reorganizes when visual stimulation is partially restored by means of a bionic eye in late blinds with Retinitis Pigmentosa. The primary visual cortex in these patients slowly became activated by the artificial visual stimulation, indicating that sight restoration therapies can rely on a considerable degree of spared plasticity in adulthood., 28 pages, 2 figures

International audience; Social interactions entail reciprocal reactions where one’s communicative acts triggers responses in others. Fluent interpersonal exchange relies on the ability to discriminate behaviors produced by others that are responses to one’s actions, thus involving a social sense of agency. Given the pivotal role of gaze in human communication, we propose to use gaze following as a model for studying the sense of agency in social actions. The experiment investigates the influence of sensory expertise and timing of the action’s effects by comparing feedback provided by a human avatar versus a nonfigurative animated object (an arrow) and by varying the control exerted by participants’ gaze on the feedback (avatar vs arrow). Results revealed a linear relationship between the judgement of agency and feedback latencies and higher agency discriminating performances with the avatar. These outcomes suggest that classical cognitive accounts of the sense of agency can be expanded to the realm of social actions and provide important information for designing virtual agents to train social gaze interactions.

International audience

The ability to recognize many sounds in everyday soundscapes is a useful and impressive feature of auditory perception in which timbre likely plays a key role. This chapter discusses what is known of timbre in the context of sound source recognition. It first surveys the methodologies that have been used to characterize a listener’s ability to recognize sounds and then examines the types of acoustic cues that could underlie the behavioral findings. In some studies, listeners were directly asked to recognize familiar sounds or versions of them that were truncated, filtered, or distorted by other resynthesis methods that preserved some cues but not others. In other studies, listeners were exposed to novel sounds, and the build-up of cues over time or the learning of new cues was tracked. The evidence currently available raises an interesting debate that can be articulated around two qualitatively different hypotheses: Are sounds recognized through distinctive features unique to each sound category (but of which there would need to be many to cover all recognized categories) or rather, are sounds recognized through a relatively small number of perceptual dimensions in which different sounds have their own recognizable position?

International audience; Evidence from psycholinguistic studies suggests that the impact of steady noise on envelope perception has two main components: (1) a masking effect: at low SNR, crucial envelope cues in the signal become masked, compromising recognition accuracy; and (2) a confounding effect: intrinsic envelope modulations arising from the filtering of noise into critical bands can be confused with useful modulations in the signal. Reverse correlation techniques are particularly suitable for exploring the confounding effect of noise on perception. However, the only attempt at applying this technique to an AM detection task yielded mixed results [Ardoint et al., 2007].This project aims at estimating psychophysical kernels in the envelope domain for a 4-Hz AM detection task. Here we will present some promising pilot data on 2 participants (5.000 and 2.000 trials), together with simulated data from the Modulation Filterbank (MFB) model. The results reveal that both real and simulated listeners are able to track the modulation peaks in the 4-Hz target. However, unlike the MFB model, human psychophysical kernels are in phase opposition with the ideal template, suggesting that they may represent fluctuations in the target and masker as a short-term signal-to-noise ratio in the envelope power domain (SNRenv).

Adaptive decision-making requires precise monitoring of decision quality in light of both sensory uncertainty and the variability inherent in cognitive functions. Such monitoring, or metacognitive reasoning, can be assessed by relating subjective confidence in a perceptual decision to objective accuracy. Selective attention is a known modulator of sensory processing, and reliable metacognitive access to attention may be the key to cope with the variability of the environment. The present dissertation investigates the temporal construction of visual confidence during and after the allocation of selective attention either to a point in time (temporal attention) or to a point in space (spatial attention). In both the temporal and spatial domain, we observe that attention constrains metacognitive ability, both during and after allocation. The robust temporal binding observed in the present thesis between attention and metacognition induces dissociations between confidence and accuracy when attention is misallocated. The empirical results presented in this work highlight a systematic inability to integrate the temporal dynamics of selective attention into metacognitive judgments., La dynamique du monde qui nous entoure nécessite sans cesse d'adapter nos décisions à son incertitude latente. Cette incertitude définit autant notre perception que le fonctionnement même de nos fonctions cognitives. La « métacognition » d’un individu - la manière dont il raisonne sur ses propres perceptions - peut être étudiée en comparant sa confiance à la qualité objective de ses décisions perceptives. Parce que l’attention sélective est une source importante de modulation sensorielle, une bonne métacognition des effets de l’attention sur la perception semble primordiale. La façon dont la confiance émerge du processus d’orientation de l'attention, et se développe ensuite dans l'espace et le temps, fait l'objet de cette thèse. Nous y décrivons notamment la solide dépendance que la confiance cultive à l'égard de l’attention visuelle, une dépendance qui subsiste à chaque étape du processus attentionnel. Les travaux expérimentaux présentés dans cette thèse suggèrent ainsi une dépendance si forte qu’une orientation erronée de l’attention passe souvent inaperçue au niveau métacognitif. Ces résultats témoignent de l'incapacité de la confiance à prendre en compte certaines des limites temporelles de l'attention sélective.

International audience; Sentence comprehension requires inferring, from a sequence of words, the structure of syntactic relationships that bind these words into a semantic representation. Our limited ability to build some specific syntactic structures, such as nested center-embedded clauses (e.g., “The dog that the cat that the mouse bit chased ran away”), suggests a striking capacity limitation of sentence processing, and thus offers a window to understand how the human brain processes sentences. Here, we review the main hypotheses proposed in psycholinguistics to explain such capacity limitation. We then introduce an alternative approach, derived from our recent work on artificial neural networks optimized for language modeling, and predict that capacity limitation derives from the emergence of sparse and feature-specific syntactic units. Unlike psycholinguistic theories, our neural network-based framework provides precise capacity-limit predictions without making any a priori assumptions about the form of the grammar or parser. Finally, we discuss how our framework may clarify the mechanistic underpinning of language processing and its limitations in the human brain.

International audience

International audience; Objectives: The aim of this study was to investigate whether short-term inverse occlusion, combined with moderate physical exercise, could promote the recovery of visual acuity and stereopsis in a group of adult anisometropic amblyopes. Methods: Ten adult anisometropic patients underwent six brief (2 h) training sessions over a period of 4 weeks. Each training session consisted in the occlu-sion of the amblyopic eye combined with physical exercise (intermittent cycling on a stationary bike). Visual acuity (measured with ETDRS charts), stereoacuity (measured with the TNO test), and sensory eye dominance (measured with binocular rivalry) were tested before and after each training session, as well as in follow-up visits performed 1 month, 3 months, and 1 year after the end of the training. Results: After six brief (2 h) training sessions, visual acuity improved in all 10 patients (0.15 AE 0.02 LogMar), and six of them also recovered stereopsis. The improvement was preserved for up to 1 year after training. A pilot experiment suggested that physical activity might play an important role for the recovery of visual acuity and stereopsis. Conclusions: Our results suggest a noninvasive training strategy for adult human amblyopia based on an inverse-occlusion procedure combined with physical exercise.

To adapt to an ever-changing environment, it is important that perceptual systems are able to transform themselves and exhibit learning throughout life. In this thesis, we have studied auditory perceptual learning of pitch and selective attention. We have developed behavioral training protocols on tablets requiring the use of the audio-motor loop and evaluated them on pitch perception and informational masking tasks. We also suggested an electrophysiological method (EEG) aiming at characterizing auditory selective attention. The main results showed that rapid perceptual learning can be observed in informational masking tasks, but without any obvious advantage for audio-motor training. In addition, a previously unknown effect of frequency on informational masking was discovered, suggesting the existence of an “informational audiogram”., Pour s'adapter à un environnement changeant, il est important que les systèmes perceptifs gardent la possibilité de se transformer et de faire l'objet d'apprentissages tout au long de la vie. Dans cette thèse, nous avons étudié des mécanismes d'apprentissage auditif dans le domaine de la perception de la hauteur et de l'attention sélective. Nous avons développé des protocoles comportementaux sur tablette permettant la mise en action de la boucle audio-motrice, étudié leur pertinence dans des tâches de perception de hauteur, fait de même pour des tâches de masquage informationnel et suggéré une méthode électrophysiologique (EEG) visant à caractériser l’attention sélective. Les résultats montrent que des effets d’apprentissage peuvent être observés dans les tâches de masquage informationnel, sans spécificité évidente pour l’entraînement audio-moteur, mais avec un effet de la zone fréquentielle inconnu jusqu’ici.

International audience; Filters are commonly used to reduce noise and improve data quality. Filter theory is part of a scientist's training, yet the impact of filters on interpreting data is not always fully appreciated. This paper reviews the issue, explains what is a filter, what problems are to be expected when using them, how to choose the right filter, or how to avoid filtering by using alternative tools. Time-frequency analysis shares some of the same problems that filters have, particularly in the case of wavelet transforms. We recommend reporting filter characteristics with sufficient details, including a plot of the impulse or step response as an inset.

Relevant events in our environment are embedded in the complex, multisensory stream of information. Time perception is malleable, and numerous time illusions suggest that the perceived time of events is affected by context. The work presented in this thesis investigated how different aspects of human time perception and timing an action are affected by context. In the first part of the thesis, we investigated how the explicitness of the event onset affects perceived elapsed time between two points in time. The temporal context affected the estimates more in the implicit onset condition. The estimates were more biased towards the mean of the presented durations, and sensitivity of duration discrimination sensitivity was lower in the condition with no explicit onset of the duration to be timed. The effects of the temporal and spatial context on the perceived time of events were addressed in the second part. The findings suggest that the perceived time of events can be easily and compulsory biased by the temporal and spatial context. Findings from these studies support the hypothesis that the perceived time of events does not always correspond the the perceptual latencies measured in the reaction time tasks, and that the saliency is an important cue for the perceived time. Finally, in the third part, we investigated how different sources of uncertainty affect the timing and self-evaluation of an action. The findings suggest that timing an action and evaluating its outcome may, at least in part, rely on different computations., Les événements pertinents de notre environnement sont intégrés au flux d'information complexe et multisensoriel qui nous parvient. La perception du temps est malléable et de nombreuses illusions suggèrent que le temps perçu est influencé par le contexte. Dans le cadre de cette thèse, nous nous sommes intéressés à l’influence de différents aspects du contexte sur la perception du temps et du timing des actions chez l’humain. Dans la première partie de cette thèse, nous avons étudié le rôle du caractère explicite de l’apparition d’un événement sur la durée perçue de l’intervalle entre deux événements. Nous avons montré que l’influence du contexte temporel était plus forte dans la condition d’apparition implicite, pour laquelle le biais d’estimation des vers la moyenne des durées présentées est plus fort, et la sensibilité plus basse. Dans la deuxième partie de la thèse, nous avons étudié les effets du contexte temporel et spatial sur le temps perçu des événements. Les résultats de ces études suggèrent que le moment perçu de l’apparition d’un événement ne correspond pas toujours aux latences perceptives mesurées par des taches de temps de réaction, et que la saillance est un indice important pour percevoir le temps. Enfin, dans la troisième partie, nous avons examiné comment différentes sources d’incertitude influencent le timing perçu d’une action et son auto-évaluation. Les résultats suggèrent que ces deux aspects s’appuieraient au moins en partie sur des processus différents.

Navigating a busy street while talking on the phone is trivial for a majority of the population. However, how the brain extracts the relevant information from the ever-changing and cluttered acoustic environment to produce the appropriate behavior remains poorly understood. The proposed thesis investigates neural basis of the extraction of relevant information in complex, continuous streams for goal-directed behavior using a combination technique linking electrophysiology to psychophysics. Humans and ferrets performed a similar change detection task that consisted of reporting changes in the underlying statistics of a toned cloud. The brain electrical activity was recorded (scalp level for humans and cell level for ferrets) while subjects engaged in the task. Overall, we find area-specific cortical responses: change-related responses are generalized along the cortical pathway. In addition, task engagement strongly modulates the frontal cortex where decision-related responses are found., Se déplacer dans une rue tout en discutant au téléphone est une action triviale pour une majorité de la population. Cependant, comment le cerveau parvient à extraire les informations pertinentes d'un environnement acoustique aussi complexe afin de produire un comportement adéquat reste encore actuellement peu compris. La thèse présentée explore les bases neurales de l'extraction d'informations pertinentes dans un flux complexe et continu afin de produire un comportement. Les sujets (humains et furets) détectent des changements dans les statistiques de nuages de tons pendant que leur activité électrique cérébrale (sur le scalp, pour le furet) est enregistrée. Les différentes zones du cortex enregistrées présentent des activités spécifiques : les réponses liées au changement se généralisent le long de la hiérarchie corticale. De plus, l'engagement dans la tâche module spécifiquement les réponses frontales au changement et à la décision.

Over the past few years, the field of visual social cognition and face processing has been dramatically impacted by a series of data-driven studies employing computer-graphics tools to synthesize arbitrary meaningful facial expressions. In the auditory modality, reverse correlation is traditionally used to characterize sensory processing at the level of spectral or spectro-temporal stimulus properties, but not higher-level cognitive processing of e.g. words, sentences or music, by lack of tools able to manipulate the stimulus dimensions that are relevant for these processes. Here, we present an open-source audio-transformation toolbox, called CLEESE, able to systematically randomize the prosody/melody of existing speech and music recordings. CLEESE works by cutting recordings in small successive time segments (e.g. every successive 100 milliseconds in a spoken utterance), and applying a random parametric transformation of each segment’s pitch, duration or amplitude, using a new Python-language implementation of the phase-vocoder digital audio technique. We present here two applications of the tool to generate stimuli for studying intonation processing of interrogative vs declarative speech, and rhythm processing of sung melodies.

International audience

Perception deals with temporal sequences of events, like series of phonemes for audition, dynamic changes in pressure for touch textures, or moving objects for vision. Memory processes are thus needed to make sense of the temporal patterning of sensory information. Recently, we have shown that auditory temporal patterns could be learned rapidly and incidentally with repeated exposure [Kang et al., 2017]. Here, we tested whether rapid incidental learning of temporal patterns was specific to audition, or if it was a more general property of sensory systems. We used a same behavioral task in three modalities: audition, touch, and vision, for stimuli having identical temporal statistics. Participants were presented with sequences of acoustic pulses for audition, motion pulses to the fingertips for touch, or light pulses for vision. Pulses were randomly and irregularly spaced, with all inter-pulse intervals in the sub-second range and all constrained to be longer than the temporal acuity in any modality. This led to pulse sequences with an average inter-pulse interval of 166 ms, a minimum inter-pulse interval of 60 ms, and a total duration of 1.2 s. Results showed that, if a random temporal pattern re-occurred at random times during an experimental block, it was rapidly learned, whatever the sensory modality. Moreover, patterns first learned in the auditory modality displayed transfer of learning to either touch or vision. This suggests that sensory systems may be exquisitely tuned to incidentally learn re-occurring temporal patterns, with possible cross-talk between the senses.

The effect of the number of modulation cycles (N) on frequency-modulation (FM) detection thresholds (FMDTs) was measured with and without interfering amplitude modulation (AM) for hearing-impaired (HI) listeners, using a 500-Hz sinusoidal carrier and FM rates of 2 and 20 Hz. The data were compared with FMDTs for normal-hearing (NH) listeners and AM detection thresholds (AMDTs) for NH and HI listeners [Wallaert, Moore, and Lorenzi (2016). J. Acoust. Soc. 139, 3088–3096; Wallaert, Moore, Ewert, and Lorenzi (2017). J. Acoust. Soc. 141, 971–980]. FMDTs were higher for HI than for NH listeners, but the effect of increasing N was similar across groups. In contrast, AMDTs were lower and the effect of increasing N was greater for HI listeners than for NH listeners. A model of temporal-envelope processing based on a modulation filter-bank and a template-matching decision strategy accounted better for the FMDTs at 20 Hz than at 2 Hz for young NH listeners and predicted greater temporal integration of FM than observed for all groups. These results suggest that different mechanisms underlie AM and FM detection at low rates and that hearing loss impairs FM-detection mechanisms, but preserves the memory and decision processes responsible for temporal integration of FM.The effect of the number of modulation cycles (N) on frequency-modulation (FM) detection thresholds (FMDTs) was measured with and without interfering amplitude modulation (AM) for hearing-impaired (HI) listeners, using a 500-Hz sinusoidal carrier and FM rates of 2 and 20 Hz. The data were compared with FMDTs for normal-hearing (NH) listeners and AM detection thresholds (AMDTs) for NH and HI listeners [Wallaert, Moore, and Lorenzi (2016). J. Acoust. Soc. 139, 3088–3096; Wallaert, Moore, Ewert, and Lorenzi (2017). J. Acoust. Soc. 141, 971–980]. FMDTs were higher for HI than for NH listeners, but the effect of increasing N was similar across groups. In contrast, AMDTs were lower and the effect of increasing N was greater for HI listeners than for NH listeners. A model of temporal-envelope processing based on a modulation filter-bank and a template-matching decision strategy accounted better for the FMDTs at 20 Hz than at 2 Hz for young NH listeners and predicted greater temporal integration of FM than observ...

International audience; An auditory illusion caught the world’s attention recently. For the same noisy speech utterance, different people reported hearing either ‘Laurel’ or ‘Yanny’. The dichotomy highlights how perceptions are inferences from inherently ambiguous sensory information, even though ambiguity is often unnoticed.

Using a same-different discrimination task, it has been shown that discrimination performance for sequences of complex tones varying just detectably in pitch is less dependent on sequence length (1, 2, or 4 elements) when the tones contain resolved harmonics than when they do not [Cousineau, Demany, and Pessnitzer (2009). J. Acoust. Soc. Am. 126, 3179-3187]. This effect had been attributed to the activation of automatic frequency-shift detectors (FSDs) by the shifts in resolved harmonics. The present study provides evidence against this hypothesis by showing that the sequence-processing advantage found for complex tones with resolved harmonics is not found for pure tones or other sounds supposed to activate FSDs (narrow bands of noise and wide-band noises eliciting pitch sensations due to interaural phase shifts). The present results also indicate that for pitch sequences, processing performance is largely unrelated to pitch salience per se: for a fixed level of discriminability between sequence elements, sequences of elements with salient pitches are not necessarily better processed than sequences of elements with less salient pitches. An ideal-observer model for the same-different binary-sequence discrimination task is also developed in the present study. The model allows the computation of d' for this task using numerical methods.

Frequency modulation (FM) is a common acoustic feature of natural sounds and is known to play a role in robust sound source recognition. Auditory neurons show precise stimulus-synchronized discharge patterns that may be used for the representation of low-rate FM. However, it remains unclear whether this representation is based on synchronization to slow temporal envelope (ENV) cues resulting from cochlear filtering or phase locking to faster temporal fine structure (TFS) cues. To investigate the plausibility of those encoding schemes, single units of the ventral cochlear nucleus of guinea pigs of either sex were recorded in response to sine FM tones centered at the unit's best frequency (BF). The results show that, in contrast to high-BF units, for modulation depths within the receptive field, low-BF units (in vivodata also reveal a high level of diversity in responses across unit types. TFS cues are mainly conveyed by low-frequency and primary-like units and ENV cues by chopper and onset units. The diversity of responses exhibited by cochlear nucleus neurons provides a neural basis for a dual-coding scheme of FM in the brainstem based on both ENV and TFS cues.SIGNIFICANCE STATEMENTNatural sounds, including speech, convey informative temporal modulations in frequency. Understanding how the auditory system represents those frequency modulations (FM) has important implications as robust sound source recognition depends crucially on the reception of low-rate FM cues. Here, we recorded 115 single-unit responses from the ventral cochlear nucleus in response to FM and provide the first physiological evidence of a dual-coding mechanism of FM via synchronization to temporal envelope cues and phase locking to temporal fine structure cues. We also demonstrate a diversity of neural responses with different coding specializations. These results support the dual-coding scheme proposed by psychophysicists to account for FM sensitivity in humans and provide new insights on how this might be implemented in the early stages of the auditory pathway.

International audience; This study investigated to which extent the primary auditory cortex of young normal-hearing and mild hearing-impaired aged animals is able to maintain invariant representation of critical temporal-modulation features when sounds are submitted to degradations of fine spectro-temporal acoustic details. This was achieved by recording ensemble of cortical responses to conspecific vocalizations in guinea pigs with either normal hearing or mild age-related sensorineural hearing loss. The vocalizations were degraded using a tone vocoder. The neuronal responses and their discrimination capacities (estimated by mutual information) were analyzed at single recording and population levels. For normal-hearing animals, the neuronal responses decreased as a function of the number of the vocoder frequency bands, so did their discriminative capacities at the single recording level. However, small neuronal populations were found to be robust to the degradations induced by the vocoder. Similar robustness was obtained when broadband noise was added to exacerbate further the spectro-temporal distortions produced by the vocoder. A comparable pattern of robustness to degradations in fine spectro-temporal details was found for hearing-impaired animals. However, the latter showed an overall decrease in neuronal discrimination capacities between vocalizations in noisy conditions. Consistent with previous studies, these results demonstrate that the primary auditory cortex maintains robust neural representation of temporal envelope features for communication sounds under a large range of spectro-temporal degradations.

International audience; The global loudness of a varying intensity sound is greater when the intensity increases than when it decreases. This global loudness asymmetry was found to be larger for pure tones than for broadband noises. In this study, our aim was to determine whether this difference between pure tones and noises is due to the difference in bandwidth between sounds or to the difference in the strength of the sensation of pitch. The loudness asymmetry was measured for broadband and for narrow-band signals that do or do not elicit a sensation of pitch. The asymmetry was greater for sounds that elicit a sensation of pitch whatever their bandwidth. The loudness model for time varying sounds [1] predicted well the asymmetry for the broadband noise that does not elicit a sensation of pitch and for a multi-tonal sound. For the other sounds the asymmetry was greater than predicted. It is known that loudness and pitch interact. The difference in asymmetry between sounds that elicit pitch and sounds that do not elicit pitch might be due to this interaction.

Contrast is the most fundamental property of images. Consequently, any comprehensive model of biological vision must incorporate this attribute and provide a veritable description of its impact on visual perception. Current theoretical and computational models predict that vision should modify its characteristics at low contrast: for example, it should become broader (more lowpass) to protect from noise, as often demonstrated by individual neurons. We find that the opposite is true for human discrimination of elementary image elements: vision becomes sharper, not broader, as contrast approaches threshold levels. Furthermore, it suffers from increased internal variability at low contrast and it transitions from a surprisingly linear regime at high contrast to a markedly nonlinear processing mode in the low-contrast range. These characteristics are hard-wired in that they happen on a single trial without memory or expectation. Overall, the empirical results urge caution when attempting to interpret human vision from the standpoint of optimality and related theoretical constructs. Direct measurements of this phenomenon indicate that the actual constraints derive from intrinsic architectural features, such as the co-existence of complex-cell-like and simple-cell-like components. Small circuits built around these elements can indeed account for the empirical results, but do not appear to operate in a manner that conforms to optimality even approximately. More generally, our results provide a compelling demonstration of how far we still are from securing an adequate computational account of the most basic operations carried out by human vision., Author summary We can view cortex from two fundamentally different perspectives: a powerful device for performing optimal inference, or an assembly of biological components not built for achieving statistical optimality. The former approach is attractive thanks to its elegance and potentially wide applicability, however the basic facts of human pattern vision do not support it. Instead, they indicate that the idiosyncratic behaviour produced by visual cortex is primarily dictated by its hardware components. The output of these components can be steered towards optimality by our cognitive apparatus, but only to a marginal extent. We conclude that current theories of visually-guided behaviour are at best inadequate, calling for a rebalanced view of the roles played by theoretical and experimental thinking about this function.

Les groupes a mediation musicotherapique sont frequemment utilises dans le cadre de la prise en charge des enfants autistes de par leur interet marque pour l’objet sonore. Il convient alors de determiner les caracteristiques specifiques de cette mediation en tant que dispositif symbolisant refere a la theorie psychanalytique. Dans cette perspective, nous proposons dans ce travail de suivre pas a pas la trajectoire therapeutique et l’evolution d’un enfant autiste, Harpocrate, au sein d’un dispositif de ce type durant une annee. Il apparait ainsi que les fonctions maternelle et paternelle sont complementaires dans l’etayage du processus de symbolisation qui se deploie progressivement dans la rencontre avec le medium sonore et l’intersubjectivite. La trajectoire mise en scene par cet enfant aide alors a mieux saisir les facteurs symboligenes de la mediation sonore, lui permettant d’explorer son experience interne, le conduisant progressivement a son entree dans le langage.

Significance In speech, social evaluations of a speaker’s dominance or trustworthiness are conveyed by distinguishing, but little-understood, pitch variations. This work describes how to combine state-of-the-art vocal pitch transformations with the psychophysical technique of reverse correlation and uses this methodology to uncover the prosodic prototypes that govern such social judgments in speech. This finding is of great significance, because the exact shape of these prototypes, and how they vary with sex, age, and culture, is virtually unknown, and because prototypes derived with the method can then be reapplied to arbitrary spoken utterances, thus providing a principled way to modulate personality impressions in speech., Human listeners excel at forming high-level social representations about each other, even from the briefest of utterances. In particular, pitch is widely recognized as the auditory dimension that conveys most of the information about a speaker’s traits, emotional states, and attitudes. While past research has primarily looked at the influence of mean pitch, almost nothing is known about how intonation patterns, i.e., finely tuned pitch trajectories around the mean, may determine social judgments in speech. Here, we introduce an experimental paradigm that combines state-of-the-art voice transformation algorithms with psychophysical reverse correlation and show that two of the most important dimensions of social judgments, a speaker’s perceived dominance and trustworthiness, are driven by robust and distinguishing pitch trajectories in short utterances like the word “Hello,” which remained remarkably stable whether male or female listeners judged male or female speakers. These findings reveal a unique communicative adaptation that enables listeners to infer social traits regardless of speakers’ physical characteristics, such as sex and mean pitch. By characterizing how any given individual’s mental representations may differ from this generic code, the method introduced here opens avenues to explore dysprosody and social-cognitive deficits in disorders like autism spectrum and schizophrenia. In addition, once derived experimentally, these prototypes can be applied to novel utterances, thus providing a principled way to modulate personality impressions in arbitrary speech signals.

Communication sounds, including speech, contain relatively slow (

International audience; Languages show systematic variation in their sound patterns and grammars. Accordingly, they have been classified into typological categories such as stress-timed vs syllable-timed, or Head-Complement (HC) vs Complement-Head (CH). To date, it has remained incompletely understood how these linguistic properties are reflected in the acoustic characteristics of speech in different languages. In the present study, the amplitude-modulation (AM) and frequency-modulation (FM) spectra of 1797 utterances in ten languages were analyzed. Overall, the spectra were found to be similar in shape across languages. However, significant effects of linguistic factors were observed on the AM spectra. These differences were magnified with a perceptually plausible representation based on the modulation index (a measure of the signal-to-noise ratio at the output of a logarithmic modulation filterbank): the maximum value distinguished between HC and CH languages, with the exception of Turkish, while the exact frequency of this maximum differed between stress-timed and syllable-timed languages. An additional study conducted on a semi-spontaneous speech corpus showed that these differences persist for a larger number of speakers but disappear for less constrained semi-spontaneous speech. These findings reveal that broad linguistic categories are reflected in the temporal modulation features of different languages, although this may depend on speaking style.

In human listeners, the temporal voice areas (TVAs) are regions of the superior temporal gyrus and sulcus that respond more to vocal sounds than a range of nonvocal control sounds, including scrambled voices, environmental noises, and animal cries. One interpretation of the TVA’s selectivity is based on low-level acoustic cues: compared to control sounds, vocal sounds may have stronger harmonic content or greater spectrotemporal complexity. Here, we show that the right TVA remains selective to the human voice even when accounting for a variety of acoustical cues. Using fMRI, single vowel stimuli were contrasted with single notes of musical instruments with balanced harmonic-to-noise ratios and pitches. We also used “auditory chimeras”, which preserved subsets of acoustical features of the vocal sounds. The right TVA was preferentially activated only for the natural human voice. In particular, the TVA did not respond more to artificial chimeras preserving the exact spectral profile of voices. Additional acoustic measures, including temporal modulations and spectral complexity, could not account for the increased activation. These observations rule out simple acoustical cues as a basis for voice selectivity in the TVAs.

National audience; Nous disposons d’une capacité remarquable à nous former instantanément des représentations sociales de nos interlocuteurs au cours d’une interaction sociale, en particulier à travers leur voix. Linguistes et éthologistes ont observé le rôle de la prosodie vocale (les caractéristiques acoustiques, i.e. non verbales, comme l’intonation, la vitesse d’élocution, les accents toniques) dans la communication humaine depuis des décennies, mais les filtres exacts utilisés par notre cerveau pour inférer des traits sociaux à partir de ces caractéristiques prosodiques restaient jusqu’à présent inaccessibles. Je présenterai ici une approche basée sur l’utilisation conjointe d’algorithmes de transformation de la voix et de méthodes psychophysique de « corrélation inverse » permettant d’accéder expérimentalement à ces filtres perceptifs haut-niveau et donc de remonter au prototype auditif mental d’un trait social donné. Je discuterai des résultats d’une première série d’expériences où nous avons caractérisé en particulier les filtres qui décodent l’intonation dans le mot ‘bonjour’ lorsque nous évaluons si un locuteur est ‘digne de confiance’ ou lorsque nous évaluons s’il est ‘socialement dominant’. J’évoquerai enfin des perspectives applicative et fondamentale offertes par la caractérisation de ces filtres auditifs sociaux. Applicative : les utiliser pour « maquiller » socialement, de manière paramétrique, n’importe quelle autre voix. Fondamentale : les mesurer chez des personnes souffrant de déficits spécifiques au traitement de la voix afin d’identifier les composantes des mécanismes haut-niveau altérées (e.g., gain, forme temporelle du filtre) par leur pathologie, ce qui constituerait une première étape vers la rééducation individualisée.