Search

A previous modelling study reported that spectro-temporal cues perceptually relevant to humans provide enough information to accurately classify "natural soundscapes" recorded in four distinct temperate habitats of a biosphere reserve [Thoret, Varnet, Boubenec, Ferriere, Le Tourneau, Krause, and Lorenzi (2020). J. Acoust. Soc. Am. 147, 3260]. The goal of the present study was to assess this prediction for humans using 2 s samples taken from the same soundscape recordings. Thirty-one listeners were asked to discriminate these recordings based on differences in habitat, season, or period of the day using an oddity task. Listeners' performance was well above chance, demonstrating effective processing of these differences and suggesting a general high sensitivity for natural soundscape discrimination. This performance did not improve with training up to 10 h. Additional results obtained for habitat discrimination indicate that temporal cues play only a minor role; instead, listeners appear to base their decisions primarily on gross spectral cues related to biological sound sources and habitat acoustics. Convolutional neural networks were trained to perform a similar task using spectro-temporal cues extracted by an auditory model as input. The results are consistent with the idea that humans exclude the available temporal information when discriminating short samples of habitats, implying a form of a sub-optimality., (© 2023 Author(s). All article content, except where otherwise noted, is licensed under a Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).)

Natural soundscapes correspond to the acoustical patterns produced by biological and geophysical sound sources at different spatial and temporal scales for a given habitat. This pilot study aims to characterize the temporal-modulation information available to humans when perceiving variations in soundscapes within and across natural habitats. This is addressed by processing soundscapes from a previous study [Krause, Gage, and Joo. (2011). Landscape Ecol. 26, 1247] via models of human auditory processing extracting modulation at the output of cochlear filters. The soundscapes represent combinations of elevation, animal, and vegetation diversity in four habitats of the biosphere reserve in the Sequoia National Park (Sierra Nevada, USA). Bayesian statistical analysis and support vector machine classifiers indicate that: (i) amplitude-modulation (AM) and frequency-modulation (FM) spectra distinguish the soundscapes associated with each habitat; and (ii) for each habitat, diurnal and seasonal variations are associated with salient changes in AM and FM cues at rates between about 1 and 100 Hz in the low (<0.5 kHz) and high (>1-3 kHz) audio-frequency range. Support vector machine classifications further indicate that soundscape variations can be classified accurately based on these perceptually inspired representations.

A model using temporal-envelope cues was previously developed to explain perceptual interference effects between amplitude modulation and frequency modulation (FM). As that model could not accurately predict FM sensitivity and the interference effects, temporal fine structure (TFS) cues were added to the model. Thus, following the initial stage of the model consisting of a linear filter bank simulating cochlear filtering, processing was split into an 'envelope path' based on envelope power cues and a 'TFS path' based on a measure of the distribution of time intervals between successive zero-crossings. This yielded independent detectability indices for envelope and TFS cues, which were optimally combined to produce a single decision statistic. Independent internal noises in the envelope and TFS paths were adjusted to match the data. Simulations indicate that TFS cues are required to account for FM data for young normal-hearing listeners and that TFS processing is impaired for both older normal-hearing and hearing-impaired listeners. The role of TFS was further assessed by relating the monaural FM sensitivity to measures of interaural phase difference, commonly assumed to rely on binaural TFS sensitivity. The model demonstrates that binaural TFS sensitivity is considerably lower than monaural TFS sensitivity. Similar to FM thresholds, interaural phase difference sensitivity declined with age and hearing loss, although higher degradations were observed in binaural temporal processing compared to monaural processing. Overall, this model provides a novel tool to explore the mechanisms involved in FM processing in the normal auditory system and the degradations in FM sensitivity with ageing and hearing loss., (© 2018 Federation of European Neuroscience Societies and John Wiley & Sons Ltd.)

Frequency modulation (FM) and amplitude modulation (AM) detection thresholds were measured at 40 dB sensation level for young (22-28 yrs) and older (44-66 yrs) listeners with normal audiograms for a carrier frequency of 500 Hz and modulation rates of 2 and 20 Hz. The number of modulation cycles, N, varied between 2 and 9. For FM detection, uninformative AM at the same rate as the FM was superimposed to disrupt excitation-pattern cues. For both groups, AM and FM detection thresholds were lower for the 2-Hz than for the 20-Hz rate, and AM and FM detection thresholds decreased with increasing N. Thresholds were higher for older than for younger listeners, especially for FM detection at 2 Hz, possibly reflecting the effect of age on the use of temporal-fine-structure cues for 2-Hz FM detection. The effect of increasing N was similar across groups for both AM and FM. However, at 20 Hz, older listeners showed a greater effect of increasing N than younger listeners for both AM and FM. The results suggest that ageing reduces sensitivity to both excitation-pattern and temporal-fine-structure cues for modulation detection, but more so for the latter, while sparing temporal integration of these cues at low modulation rates.

The dichotomy between acoustic temporal envelope (ENV) and fine structure (TFS) cues has stimulated numerous studies over the past decade to understand the relative role of acoustic ENV and TFS in human speech perception. Such acoustic temporal speech cues produce distinct neural discharge patterns at the level of the auditory nerve, yet little is known about the central neural mechanisms underlying the dichotomy in speech perception between neural ENV and TFS cues. We explored the question of how the peripheral auditory system encodes neural ENV and TFS cues in steady or fluctuating background noise, and how the central auditory system combines these forms of neural information for speech identification. We sought to address this question by (1) measuring sentence identification in background noise for human subjects as a function of the degree of available acoustic TFS information and (2) examining the optimal combination of neural ENV and TFS cues to explain human speech perception performance using computational models of the peripheral auditory system and central neural observers. Speech-identification performance by human subjects decreased as the acoustic TFS information was degraded in the speech signals. The model predictions best matched human performance when a greater emphasis was placed on neural ENV coding rather than neural TFS. However, neural TFS cues were necessary to account for the full effect of background-noise modulations on human speech-identification performance., (Copyright © 2014 the authors 0270-6474/14/3412145-10$15.00/0.)

The role of spectro-temporal modulation cues in conveying tonal information for lexical tones was assessed in native-Mandarin and native-French adult listeners using a lexical-tone discrimination task. The fundamental frequency (F0) of Thai tones was either degraded using an 8-band vocoder that reduced fine spectral details and frequency-modulation cues, or extracted and used to modulate the F0 of click trains. Mandarin listeners scored lower than French listeners in the discrimination of vocoded lexical tones. For click trains, Mandarin listeners outperformed French listeners. These preliminary results suggest that the perceptual weight of the fine spectro-temporal modulation cues conveying F0 information is enhanced for adults speaking a tonal language.

Won et al. (J Acoust Soc Am 132:1113-1119, 2012) reported that cochlear implant (CI) speech processors generate amplitude-modulation (AM) cues recovered from broadband speech frequency modulation (FM) and that CI users can use these cues for speech identification in quiet. The present study was designed to extend this finding for a wide range of listening conditions, where the original speech cues were severely degraded by manipulating either the acoustic signals or the speech processor. The manipulation of the acoustic signals included the presentation of background noise, simulation of reverberation, and amplitude compression. The manipulation of the speech processor included changing the input dynamic range and the number of channels. For each of these conditions, multiple levels of speech degradation were tested. Speech identification was measured for CI users and compared for stimuli having both AM and FM information (intact condition) or FM information only (FM condition). Each manipulation degraded speech identification performance for both intact and FM conditions. Performance for the intact and FM conditions became similar for stimuli having the most severe degradations. Identification performance generally overlapped for the intact and FM conditions. Moreover, identification performance for the FM condition was better than chance performance even at the maximum level of distortion. Finally, significant correlations were found between speech identification scores for the intact and FM conditions. Altogether, these results suggest that despite poor frequency selectivity, CI users can make efficient use of AM cues recovered from speech FM in difficult listening situations.

The current study explored perception of prosody in normal and whispered speech using a two-interval, two-alternative forced-choice psychophysical task where listeners discriminated between French noun phrases pronounced as declaratives or interrogatives. Stimuli were either presented between 50 and 8000 Hz or filtered into one of three broad frequency regions, corresponding to harmonic-resolvability regions for normal speech (resolved, partially resolved, unresolved harmonics). Normal speech was presented against a speech-shaped noise masker, whereas whispered speech was presented in quiet. The results showed that discrimination performance was differentially affected by filtering for normal and whispered speech, suggesting that cues to prosody differ between speech modes. For whispered speech, evidence was mainly derived from the high-frequency region, whereas for normal speech, evidence was mainly derived from the low-frequency (resolved harmonics) region. Modeling of the early stages of auditory processing confirmed that for whispered speech, perception of prosody was not based on temporal auditory cues and suggests that listeners may rely on place of excitation (spectral) cues that are, in contrast with suggestions made by earlier work, distributed across the spectrum.

Objective: This study aimed to assess whether the capacity of cochlear implant (CI) users to identify speech is determined by their capacity to perceive slow (< 20 Hz) temporal modulations., Design: This was achieved by studying the correlation between (1) phoneme identification in quiet and in a steady-state or fluctuating (8 Hz) noises, and (2) amplitude-modulation detection thresholds (MDTs) at 8 Hz (i.e. slow temporal modulations)., Study Sample: Twenty-one CI users, unilaterally implanted with the same device, were tested in free field with their everyday clinical processor., Results: Extensive variability across subjects was observed for both phoneme identification and MDTs. Vowel and consonant identification scores in quiet were significantly correlated with MDTs at 8 Hz (r = - 0.47 for consonants, r = - 0.44 for vowels; p < 0.05). When the masker was a steady-state noise, only consonant identification scores tended to correlate with MDTs at 8 Hz (r = - 0.4; p = 0.07). When the masker was a fluctuating noise, consonant and vowel identification scores were not significantly correlated with MDTs at 8 Hz., Conclusions: Sensitivity to slow amplitude modulations is correlated with vowel and consonant perception in CI users. However, reduced sensitivity to slow modulations does not entirely explain the limited capacity of CI recipients to understand speech in noise.

Purpose: The capacity of 6-month-old infants to discriminate a voicing contrast (/aba/-/apa/) on the basis of amplitude modulation (AM) cues and frequency modulation (FM) cues was evaluated., Method: Several vocoded speech conditions were designed to either degrade FM cues in 4 or 32 bands or degrade AM in 32 bands. Infants were familiarized to the vocoded stimuli for a period of either 1 or 2 min. Vocoded speech discrimination was assessed using the head-turn preference procedure., Results: Infants discriminated /aba/ from /apa/ in each condition; however, familiarization time was found to influence strongly infants' responses (i.e., their preference for novel vs. familiar stimuli)., Conclusions: Six-month-old infants do not require FM cues and can use the slowest (< 16 Hz) AM cues to discriminate voicing. Moreover, 6-month-old infants can use AM cues extracted from only 4 broad-frequency bands to discriminate voicing.

There is much debate on how the spectrotemporal modulations of speech (or its spectrogram) are encoded in the responses of the auditory nerve, and whether speech intelligibility is best conveyed via the "envelope" (E) or "temporal fine-structure" (TFS) of the neural responses. Wide use of vocoders to resolve this question has commonly assumed that manipulating the amplitude-modulation and frequency-modulation components of the vocoded signal alters the relative importance of E or TFS encoding on the nerve, thus facilitating assessment of their relative importance to intelligibility. Here we argue that this assumption is incorrect, and that the vocoder approach is ineffective in differentially altering the neural E and TFS. In fact, we demonstrate using a simplified model of early auditory processing that both neural E and TFS encode the speech spectrogram with constant and comparable relative effectiveness regardless of the vocoder manipulations. However, we also show that neural TFS cues are less vulnerable than their E counterparts under severe noisy conditions, and hence should play a more prominent role in cochlear stimulation strategies.

Previous studies have demonstrated that normal-hearing listeners can understand speech using the recovered "temporal envelopes," i.e., amplitude modulation (AM) cues from frequency modulation (FM). This study evaluated this mechanism in cochlear implant (CI) users for consonant identification. Stimuli containing only FM cues were created using 1, 2, 4, and 8-band FM-vocoders to determine if consonant identification performance would improve as the recovered AM cues become more available. A consistent improvement was observed as the band number decreased from 8 to 1, supporting the hypothesis that (1) the CI sound processor generates recovered AM cues from broadband FM, and (2) CI users can use the recovered AM cues to recognize speech. The correlation between the intact and the recovered AM components at the output of the sound processor was also generally higher when the band number was low, supporting the consonant identification results. Moreover, CI subjects who were better at using recovered AM cues from broadband FM cues showed better identification performance with intact (unprocessed) speech stimuli. This suggests that speech perception performance variability in CI users may be partly caused by differences in their ability to use AM cues recovered from FM speech cues.

This study investigated the ability to use temporal-envelope (E) cues in a consonant identification task when presented within one or two frequency bands. Syllables were split into five bands spanning the range 70-7300 Hz with each band processed to preserve E cues and degrade temporal fine-structure cues. Identification scores were measured for normal-hearing listeners in quiet for individual processed bands and for pairs of bands. Consistent patterns of results were obtained in both the single- and dual-band conditions: identification scores increased systematically with band center frequency, showing that E cues in the higher bands (1.8-7.3 kHz) convey greater information.

Young deaf children using a cochlear implant develop speech abilities on the basis of speech temporal-envelope signals distributed over a limited number of frequency bands. A Headturn Preference Procedure was used to measure looking times in 6-month-old, normal-hearing infants during presentation of repeating or alternating sequences composed of different tokens of /aba/and /apa/ processed to retain envelope information below 64 Hz while degrading temporal fine structure cues. Infants attended longer to the alternating sequences, indicating that they perceive the voicing contrast on the basis of envelope cues alone in the absence of fine spectral and temporal structure information.

This study aimed to assess whether or not temporal envelope (E) and fine structure (TFS) cues in speech convey distinct phonetic information. Syllables uttered by a male and female speaker were (i) processed to retain either E or TFS within 16 frequency bands, (ii) lowpass or highpass filtered at different cut-off frequencies, and (iii) presented for identification to seven listeners. Psychometric functions were fitted using a sigmoid function, and used to determine crossover frequencies (cut-off frequencies at which lowpass and highpass filtering yielded equivalent performance), and gradients at each point of the psychometric functions (change in performance with respect to cut-off frequency). Crossover frequencies and gradients were not significantly different across speakers. Crossover frequencies were not significantly different between E and TFS speech ( approximately 1.5kHz). Gradients were significantly different between E and TFS speech in various filtering conditions. When stimuli were highpass filtered above 2.5kHz, performance was significantly above chance level and gradients were significantly different from 0 for E speech only. These findings suggest that E and TFS convey important but distinct phonetic cues between 1 and 2kHz. Unlike TFS, E conveys information up to 6kHz, consistent with the characteristics of neural phase locking to E and TFS., (Copyright 2009 Elsevier B.V. All rights reserved.)

Recent work has demonstrated that auditory filters recover temporal-envelope cues from speech fine structure when the former were removed by filtering or distortion. This study extended this work by assessing the contribution of recovered envelope cues to consonant perception as a function of the analysis bandwidth, when vowel-consonant-vowel (VCV) stimuli were processed in order to keep their fine structure only. The envelopes of these stimuli were extracted at the output of a bank of auditory filters and applied to pure tones whose frequency corresponded to the original filters' center frequencies. The resulting stimuli were found to be intelligible when the envelope was extracted from a single, wide analysis band. However, intelligibility decreases from one to eight bands with no further decrease beyond this value, indicating that the recovered envelope cues did not play a major role in consonant perception when the analysis bandwidth was narrower than four times the bandwidth of a normal auditory filter (i.e., number of analysis bands > or =8 for frequencies spanning 80 to 8020 Hz).

This psychophysical study explores the extent to which the auditory cortex is necessary for various aspects of temporal-envelope perception, that is, perception of the slow temporal modulations in amplitude known to be crucial for sound identification. The ability to detect 1st- and 2nd-order sinusoidal amplitude modulation (AM) is evaluated in a single patient showing left-hemisphere damage encroaching the primary and secondary auditory cortices. Here, 1st- and 2nd-order AM refer to (1) sinusoidal variation in the amplitude of a 2 kHz pure tone, and (2) sinusoidal variation in the depth of a 64 Hz AM applied to the 2 kHz pure tone, respectively. The results replicate previous findings by showing that damage to the left auditory cortex results in a selective deficit in auditory sensitivity to the lowest 1St-order AM (i.e., 1st-order AM frequencies < 16 Hz). Moreover, a dissociation is apparent between the ability to detect 1st- and 2nd-order temporal-envelope cues. The patient shows poorer than normal ability to detect 2nd-order AM at low frequencies ranging from 4-23 Hz, but normal ability to detect the high (64 Hz) 1st-order AM carrying these 2nd-order modulations. This result indicates that damage to the left primary and secondary auditory cortices affects the ability to detect temporal variations in the local properties of sounds(such as AM depth). It is also consistent with the idea that, as in vision, central nonlinear mechanisms are involved in the computation of such local (or 2nd-order) temporal properties.

Speech intelligibility depends heavily on the accurate perception of auditory temporal envelope cues, that is the slower amplitude modulations present in the speech waveform. In a previous study, McAnally and Stein demonstrated that dyslexics may show impaired audibility (i.e. detectability) of these envelope cues. In the present psychophysical study, the ability to process temporal envelope cues was further investigated in dyslexic children by measuring detection thresholds of sinusoidal amplitude-modulation (SAM) and discrimination thresholds of SAM depth and SAM rate. Each threshold was measured at slow and fast SAM rates of 4 and 128 Hz, respectively. Overall, SAM thresholds were higher in dyslexics than in controls at both rates. The strongest deficit was observed at 4 Hz in the SAM detection task, but a deficit was also apparent at 128 Hz in the SAM discrimination tasks. Therefore, these results reveal that, in addition to reduced audibility of slow and fast envelope cues, some dyslexic children show poor encoding fidelity for these cues (as measured by the discrimination tasks). Overall, these findings are consistent with Tallal's hypothesis according to which the speech and reading deficits in some dyslexics may be caused by impaired temporal processes.

Purpose: This study assessed the role of spectro-temporal modulation cues in the discrimination of 2 phonetic contrasts (voicing and place) for young infants. Method: A visual-habituation procedure was used to assess the ability of French-learning 6-month-old infants with normal hearing to discriminate voiced versus unvoiced (/aba/-/apa/) and labial versus dental (/aba/-/ada/) stop consonants. The stimuli were processed by tone-excited vocoders to degrade frequency-modulation cues while preserving: (a) amplitude-modulation (AM) cues within 32 analysis frequency bands, (b) slow AM cues only (<16 Hz) within 32 bands, and (c) AM cues within 8 bands. Results: Infants exhibited discrimination responses for both phonetic contrasts in each processing condition. However, when fast AM cues were degraded, infants required a longer exposure to vocoded stimuli to reach the habituation criterion. Conclusions: Altogether, these results indicate that the processing of modulation cues conveying phonetic information on voicing and place is "functional" at 6 months. The data also suggest that the perceptual weight of fast AM speech cues may change during development.

Purpose: To investigate the capacity of young children and adults with normal hearing to discriminate speech on the basis of either relatively slow (temporal envelope, E) or fast (temporal fine structure, TFS) auditory cues. Method: Vowel-consonant-vowel nonsense disyllables were processed to preserve either the E or the TFS information in 16 adjacent frequency bands. The band signals were then recombined and resulting stimuli were presented for discrimination to adults or 5-, 6-, and 7-year-old children using an odd-ball paradigm. Discrimination scores (d') and response latencies were measured in each listener. No training was given to listeners. Results: Overall, discrimination scores were high (d' greater than or equal to 1) in all speech-processing conditions, and did not differ across age groups. Overall, and irrespective of age, greater discrimination scores and shorter response latencies were observed for E speech than for TFS speech. Conclusions: These results suggest that normal-hearing children are able to encode and use E and TFS speech cues at adult levels by the age of 5 years. TFS- and E-coded speech stimuli might therefore prove to be a useful tool for the investigation of the developmental time course of speech perception, and for the early diagnosis of peripheral and central auditory processing disorders.