Search

Rationale: Cortical activity is coupled with streams of sensory stimulation. The coupling with the temporal envelope of heard speech is known as the cortical tracking of speech (CTS), and that with movement kinematics is known as the corticokinematic coupling (CKC). Simultaneous measurement of both couplings is desirable in clinical settings, but it is unknown whether the inherent dual-tasking condition has an impact on CTS or CKC., Aim: We aim to determine whether and how CTS and CKC levels are affected when recorded simultaneously., Methods: Twenty-three healthy young adults underwent 64-channel EEG recordings while listening to stories and while performing repetitive finger-tapping movements in 3 conditions: separately (audio- or tapping-only) or simultaneously (audio-tapping). CTS and CKC values were estimated using coherence analysis between each EEG signal and speech temporal envelope (CTS) or finger acceleration (CKC). CTS was also estimated as the reconstruction accuracy of a decoding model., Results: Across recordings, CTS assessed with reconstruction accuracy was significant in 85 % of the subjects at phrasal frequency (0.5 Hz) and in 68 % at syllabic frequencies (4-8 Hz), and CKC was significant in over 85 % of the subjects at movement frequency and its first harmonic. Comparing CTS and CKC values evaluated in separate recordings to those in simultaneous recordings revealed no significant difference and moderate-to-high levels of correlation., Conclusion: Despite the subtle behavioral effects, CTS and CKC are not evidently altered by the dual-task setting inherent to recording them simultaneously and can be evaluated simultaneously using EEG in clinical settings., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 International Brain Research Organization (IBRO). Published by Elsevier Inc. All rights reserved.)

We use MEG and fMRI to determine how predictions are combined with speech input in superior temporal cortex. We compare neural responses to words in which first syllables strongly or weakly predict second syllables (e.g., "bingo", "snigger" versus "tango", "meagre"). We further compare neural responses to the same second syllables when predictions mismatch with input during pseudoword perception (e.g., "snigo" and "meago"). Neural representations of second syllables are suppressed by strong predictions when predictions match sensory input but show the opposite effect when predictions mismatch. Computational simulations show that this interaction is consistent with prediction error but not alternative (sharpened signal) computations. Neural signatures of prediction error are observed 200 ms after second syllable onset and in early auditory regions (bilateral Heschl's gyrus and STG). These findings demonstrate prediction error computations during the identification of familiar spoken words and perception of unfamiliar pseudowords., Competing Interests: Competing interests The authors declare no competing interests., (© 2024. The Author(s).)

To avoid misunderstandings, ironic speakers may accompany their ironic remarks with a particular intonation and specific facial expressions that signal that the message should not be taken at face value. The acoustic realization of the ironic tone of voice differs from language to language, whereas the ironic face manifests the speaker's negative stance and might thus have a universal basis. We conducted a study on 574 participants speaking 6 different languages (French, German, Dutch, English, Mandarin, and Italian-the control group) to verify whether they could recognize ironic remarks uttered in Italian in three different modalities: watching muted videos, listening to audio tracks, and when both cues were present. We found that speakers of other languages could overall recognize irony uttered in Italian when all the markers were present, and they relied mostly on visual cues: In all these language groups, accuracy in the audio-only modality was always lower than accuracy in the video-only modality, although this trend was significant only for Chinese and Dutch participants. Moreover, the rate of recognition in the audio-visual modality was always significantly higher compared to the audio-only, while the difference between the audio-visual and the video-only modality was significant only for the English group. Overall, these results speak in favor of the hypothesis of a common basis for the visual expression of irony, whereas the acoustic markers alone do not constitute a reliable cue for the cross-linguistic recognition of irony., Competing Interests: Declarations Conflict of interest The authors declare that there is no conflict of interest. The authors have no relevant financial or non-financial interests to disclose. Ethical Approval The study was evaluated by the local commission for minimal-risk studies of the Psychology Department and informed consent was obtained from all participants., (© 2024. The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.)

Purpose: To determine if there is an association between vocal gender presentation and the gender and context of the listener., Method: Quantitative and transversal study. 47 speakers of Brazilian Portuguese of different genders were recorded. Recordings included sustained vowel emission, connected speech, and the expressive recital of a poem. Subsequently, four scripts were used in Praat to extract 16 acoustic measurements related to prosody. Voices underwent Auditory-Perceptual Assessment (APA) of the gender presentation by 236 people [65 speech and language pathologist (SLP) with experience in the area of the voice (SLP), 101 cisgender people (CG), and 70 transgender and non-binary people (TNB)]. Gender presentation was evaluated by visual analogue scale. Agreement analyses were executed among quantitative variables and multiple linear regression models were generated to predict APA, taking the judge context/gender and speaker gender into consideration., Results: Acoustic analysis revealed that cis and transgender women had higher median fundamental frequency (fo) values than other genders. Cisgender women exhibited greater breathiness, while cisgender men showed more vocal quality deviations. In terms of APA, significant differences were observed among judge groups: SLP judged vowel samples differently from other groups, and TNB judged speech samples differently (both p<0.001). The predictive measures for the APA varied based on the sample type, speaker gender, and judge group. For vowel samples, only SLP judges had predictive measures (fo and ABI Jitter) for cisgender speakers. In number counting samples, predictive measures for cisgender speakers included fomed and HNR for CG judges, and fomed for both SLP and TNB judges. For transgender and non-binary speakers, predictive measures were fomed for CG and SLP judges, and fomed, CPPs, and ABI for TNB judges. In the poem recital task, predictive measures for cisgender speakers were fomed and HNR for both SLP and CG judges, with additional measures of cvint and sr for CG judges, and fomed, HNR, cvint, and fopeakwidth for TNB judges. For transgender and non-binary speakers, the predictive measures included a wider range of acoustic features such as fomed, fosd, sr, fomin, emph, HNR, Shimmer, and fo peakwidth for SLP judges, and fomed, fosd, sr, fomax, emph, HNR, and Shimmer for CG judges, while TNB judges considered fomed, sr, emph, fosd, Shimmer, HNR, Jitter, and fomax., Conclusions: There is an association between the perception of gender presentation in the voice and the gender or context of the listener and the speaker. Transgender and non-binary judges diverged to a higher degree from cisgender and SLP judges. Compared to the evaluation of cisgender speakers, all judge groups used a greater number of acoustic measurements when analyzing the speech of transgender and non-binary individuals in the poem recital samples., Competing Interests: The authors have declared that no competing interests exist., (Copyright: © 2024 da Cruz Martinho et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.)

Several studies reported various crossmodal correspondences related to tactile features. These previous studies have investigated tactile-related correspondences through explicit matching or subjective evaluation tasks, which required participants to recognize relationships between tactile and other sensory features or rate tactile materials on scales with adjective labels related to visual or auditory features. However, these tasks are prone to occur the experimenter-expectancy effects and arbitrary categorization of tactile materials by the labels, making it difficult to assess implicit and non-arbitrary aspects of crossmodal correspondences. To address this, we used a speeded classification task to examine whether the angularity/roundedness of visual and auditory stimuli correspond to tactile jaggedness/fluffiness. Participants distinguished between angularity or roundedness (Experiment 1: visual shapes; Experiment 2: speech sounds) by pressing right- or left-positioned response keys with task-irrelevant jaggedness or fluffiness without prior instruction on which key represented jaggedness/fluffiness. Results showed faster keypresses for jagged/fluffy responses to angular/rounded stimuli, suggesting an implicit correspondence between these sensory features except for the experimenter-expectancy effects and the influence of the labels. Unlike previous studies that examined the correspondence with simple tactile features (e.g., weight, size), our findings suggest that even complex tactile-quality features, such as jaggedness/fluffiness, implicitly correspond to visual and auditory angularity/roundedness., Competing Interests: Declarations Competing interests The authors declare no competing interests., (© 2024. The Author(s).)

Language comprehension requires semantic processing of individual words and their context within a sentence. Well-characterized event-related potential (ERP) components (the N400 and late positivity component (LPC/P600)) provide neuromarkers of semantic processing, and are robustly evoked when semantic errors are introduced into sentences. These measures are useful for evaluating semantic processing in clinical populations, but it is not known whether they can be evoked in more severe neurodevelopmental disorders where explicit attention to the sentence inputs cannot be objectively assessed (i.e., when sentences are passively listened to). We evaluated whether N400 and LPC/P600 could be detected in adolescents who were explicitly ignoring sentence inputs. Specifically, it was asked whether explicit attention to spoken inputs was required for semantic processing, or if a degree of automatic processing occurs when the focus of attention is directed elsewhere? High-density ERPs were acquired from twenty-two adolescents (12-17 years), under two experimental conditions: 1. individuals actively determined whether the final word in a sentence was congruent or incongruent with sentence context, or 2. passively listened to background sentences while watching a video. When sentences were ignored, N400 and LPC/P600 were robustly evoked to semantic errors, albeit with reduced amplitudes and protracted/delayed latencies. Statistically distinct topographic distributions during passive versus active paradigms pointed to distinct generator configurations for semantic processing as a function of attention. Covert semantic processing continues in neurotypical adolescents when explicit attention is withdrawn from sentence inputs. As such, this approach could be used to objectively investigate semantic processing in populations with communication deficits., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Author(s). Published by Elsevier Inc. All rights reserved.)

Understanding how speech sounds are decoded into linguistic units has been a central research challenge over the last century. This study follows a reverse-correlation approach to reveal the acoustic cues listeners use to categorize French stop consonants in noise. Compared to previous methods, this approach ensures an unprecedented level of detail with only minimal theoretical assumptions. Thirty-two participants performed a speech-in-noise discrimination task based on natural /aCa/ utterances, with C = /b/, /d/, /g/, /p/, /t/, or /k/. The trial-by-trial analysis of their confusions enabled us to map the spectrotemporal information they relied on for their decisions. In place-of-articulation contrasts, the results confirmed the critical role of formant consonant-vowel transitions, used by all participants, and, to a lesser extent, vowel-consonant transitions and high-frequency release bursts. Similarly, for voicing contrasts, we validated the prominent role of the voicing bar cue, with some participants also using formant transitions and burst cues. This approach revealed that most listeners use a combination of several cues for each task, with significant variability within the participant group. These insights shed new light on decades-old debates regarding the relative importance of cues for phoneme perception and suggest that research on acoustic cues should not overlook individual variability in speech perception., (© 2024. The Author(s).)

Purpose: The purpose of this study was to investigate cortical tracking of speech (CTS) in adults who stutter (AWS) compared to typically fluent adults (TFAs) to test the involvement of the speech-motor network in tracking rhythmic speech information., Method: Participants' electroencephalogram was recorded while they simply listened to sentences (listening only) or completed them by naming a picture (listening for speaking), thus manipulating the upcoming involvement of speech production. We analyzed speech-brain coherence and brain connectivity during listening., Results: During the listening-for-speaking task, AWS exhibited reduced CTS in the 3- to 5-Hz range (theta), corresponding to the syllabic rhythm. The effect was localized in the left inferior parietal and right pre/supplementary motor regions. Connectivity analyses revealed that TFAs had stronger information transfer in the theta range in both tasks in fronto-temporo-parietal regions. When considering the whole sample of participants, increased connectivity from the right superior temporal cortex to the left sensorimotor cortex was correlated with faster naming times in the listening-for-speaking task., Conclusions: Atypical speech-motor functioning in stuttering impacts speech perception, especially in situations requiring articulatory alertness. The involvement of frontal and (pre)motor regions in CTS in TFAs is highlighted. Further investigation is needed into speech perception in individuals with speech-motor deficits, especially when smooth transitioning between listening and speaking is required, such as in real-life conversational settings., Supplemental Material: https://doi.org/10.23641/asha.27234885.

Purpose: Categorical perception (CP) manifests in various aspects of human cognition. While there is mounting evidence for CP in facial emotions, CP in vocal emotions remains understudied. The current study attempted to test whether individuals with a tonal language background perceive vocal emotions categorically and to examine how factors such as gender and age influence the plasticity of these perceptual categories., Method: This study examined the identification and discrimination performance of 24 Mandarin-speaking children (14 boys and 10 girls) and 32 adults (16 males and 16 females) when they were presented with three vocal emotion continua. Speech stimuli in each continuum consisted of 11 resynthesized Mandarin disyllabic words., Results: CP phenomena were detected when Mandarin participants perceived vocal emotions. We further found the modulating effect of age and gender in vocal emotion categorization., Conclusions: Our results demonstrate for the first time that a categorical strategy is used by Mandarin speakers when perceiving vocal emotions. Furthermore, our findings reveal that the categorization ability of vocal emotions follows a prolonged course of development and the maturation patterns differ across genders. This study opens a promising line of research for investigating how sensory features are mapped to higher order perception and provides implications for our understanding of clinical populations characterized by altered emotional processing., Supplemental Material: https://doi.org/10.23641/asha.27204057.

Purpose: When vowel formants are externally perturbed, speakers change their production to oppose that perturbation both during the ongoing production (compensation) and in future productions (adaptation). To date, attempts to explain the large variability across individuals in these responses have focused on trait-based characteristics such as auditory acuity, but evidence from other motor domains suggests that attention may modulate the motor response to sensory perturbations. Here, we test the extent to which divided attention impacts sensorimotor control for supralaryngeal articulation., Method: Neurobiologically healthy speakers were exposed to random (Experiment 1) or consistent (Experiment 2) real-time auditory perturbation of vowel formants to measure online compensation and trial-to-trial adaptation, respectively. In both experiments, participants completed two conditions: one with a simultaneous visual distractor task to divide attention and one without this secondary task., Results: Divided visual attention slightly reduced online compensation, but only starting > 300 ms after vowel onset, well beyond the typical duration of vowels in speech. Divided attention had no effect on adaptation., Conclusions: The results from both experiments suggest that the use of sensory feedback in typical speech motor control is a largely automatic process unaffected by divided visual attention, suggesting that the source of cross-speaker variability in response to formant perturbations likely lies within the speech production system rather than in higher-level cognitive processes. Methodologically, these results suggest that compensation for formant perturbations should be measured prior to 300 ms after vowel onset to avoid any potential impact of attention or other higher-order cognitive factors.

Purpose: A relevant aspect of listening is the effort required during speech processing, which can be assessed by pupillometry. Here, we assessed the pupil dilation response of normal-hearing (NH) and hard of hearing (HH) individuals during listening to clear sentences and masked or degraded sentences. We combined this assessment with functional magnetic resonance imaging (fMRI) to investigate the neural correlates of the pupil dilation response., Method: Seventeen NH participants ( M age = 46 years) were compared to 17 HH participants ( M age = 45 years) who were individually matched in age and educational level. Participants repeated sentences that were presented clearly, that were distorted, or that were masked. The sentence intelligibility level of masked and distorted sentences was 50% correct. Silent baseline trials were presented as well. Performance measures, pupil dilation responses, and fMRI data were acquired., Results: HH individuals had overall poorer speech reception than the NH participants, but not for noise-vocoded speech. In addition, an interaction effect was observed with smaller pupil dilation responses in HH than in NH listeners for the degraded speech conditions. Hearing impairment was associated with higher activation across conditions in the left superior temporal gyrus, as compared to the silent baseline. However, the region of interest analysis indicated lower activation during degraded speech relative to clear speech in bilateral frontal regions and the insular cortex, for HH compared to NH listeners. Hearing impairment was also associated with a weaker relation between the pupil response and activation in the right inferior frontal gyrus. Overall, degraded speech evoked higher frontal activation than clear speech., Conclusion: Brain areas associated with attentional and cognitive-control processes may be increasingly recruited when speech is degraded and are related to the pupil dilation response, but this relationship is weaker in HH listeners., Supplemental Material: https://doi.org/10.23641/asha.27162135.

Purpose: Developmental language disorder (DLD) is a multifaceted disorder. Recently, interest has grown in prosodic aspects of DLD, but most investigations of possible prosodic causes focus on speech perception tasks. Here, we focus on speech production from a speech amplitude envelope (AE) perspective. Perceptual studies have indicated a role for difficulties in AE processing in DLD related to sensory/neural processing of prosody. We explore possible matching AE difficulties in production., Method: Fifty-seven children with and without DLD completed a computerized imitation task, copying aloud 30 familiar targets such as "alligator." Children with DLD ( n = 20) were compared with typically developing children (age-matched controls [AMC], n = 21) and younger language controls (YLC, n = 16). Similarity of the child's productions to the target in terms of the continuous AE and pitch contour was computed using two similarity metrics, correlation, and mutual information. Both the speech AE and the pitch contour contain important information about stress patterning and intonational information over time., Results: Children with DLD showed significantly reduced imitation for both the AE and pitch contour metrics compared to AMC children. The opportunity to repeat the targets had no impact on performance for any group. Word length effects were similar across groups., Conclusions: The spoken production of multisyllabic words by children with DLD is atypical regarding both the AE and the pitch contour. This is consistent with a theoretical explanation of DLD based on impaired sensory/neural processing of low-frequency (slow) amplitude and frequency modulations, as predicted by the temporal sampling theory., Supplemental Material: https://doi.org/10.23641/asha.27165690.

Purpose: The aim of this study was to decode intended and overt speech from neuromagnetic signals while the participants performed spontaneous overt speech tasks without cues or prompts (stimuli)., Method: Magnetoencephalography (MEG), a noninvasive neuroimaging technique, was used to collect neural signals from seven healthy adult English speakers performing spontaneous, overt speech tasks. The participants randomly spoke the words yes or no at a self-paced rate without cues. Two machine learning models, namely, linear discriminant analysis (LDA) and one-dimensional convolutional neural network (1D CNN), were employed to classify the two words from the recorded MEG signals., Results: LDA and 1D CNN achieved average decoding accuracies of 79.02% and 90.40%, respectively, in decoding overt speech, significantly surpassing the chance level (50%). The accuracy for decoding intended speech was 67.19% using 1D CNN., Conclusions: This study showcases the possibility of decoding spontaneous overt and intended speech directly from neural signals in the absence of perceptual interference. We believe that these findings make a steady step toward the future spontaneous speech-based brain-computer interface.

Prior literature has debated whether syntax is separable from semantics in the brain. Using functional magnetic resonance imaging and multi-voxel pattern analysis, our previous studies investigated brain activity during morpho-syntactic versus semantic processing. These studies only detected semantic specialization in activation patterns and no syntactic specialization in 5- to 6-year-old and 7- to 8-year-old children. To examine if older children who have mastered morpho-syntactic skills would show specialization for syntax, the current study examined 64 9- to 10-year-old children using the same design and analyses. We observed that only the left IFG pars opercularis was sensitive to syntactic but not semantic information, supporting the hypothesis that this region serves as a core region for syntax. In addition, the left STG which has been implicated in the integration of semantics and syntax, as well as the left MTG and IFG pars triangularis which have been implicated in semantics, were sensitive to both semantic and syntactic information with no evidence of specialization. These findings suggest a lexicalized view of syntax, which argues that semantically sensitive regions are also critical regions for syntactic processing during language comprehension., (© 2024. The Author(s).)

Traditional English corpora mainly collect information from a single modality, but lack information from multimodal information, resulting in low quality of corpus information and certain problems with recognition accuracy. To solve the above problems, this paper proposes to introduce depth information into multimodal corpora, and studies the construction method of English multimodal corpora that integrates electronic images and depth information, as well as the speech recognition method of the corpus. The multimodal fusion strategy adopted integrates speech signals and image information, including key visual information such as the speaker's lip movements and facial expressions, and uses deep learning technology to mine acoustic and visual features. The acoustic model in the Kaldi toolkit is used for experimental research.Through experimental research, the following conclusions were drawn: Under 15-dimensional lip features, the accuracy of corpus A under monophone model was 2.4% higher than that of corpus B under monophone model when the SNR (signal-to-noise ratio) was 10dB, and the accuracy of corpus A under the triphone model at the signal-to-noise ratio of 10dB was 1.7% higher than that of corpus B under the triphone model at the signal-to-noise ratio of 10dB. Under the 32-dimensional lip features, the speech recognition effect of corpus A under the monophone model at the SNR of 10dB was 1.4% higher than that of corpus B under the monophone model at the SNR of 10dB, and the accuracy of corpus A under the triphone model at the SNR of 10dB was 2.6% higher than that of corpus B under the triphone model at the SNR of 10dB. The English multimodal corpus with image and depth information has a high accuracy, and the depth information helps to improve the accuracy of the corpus., (© 2024. The Author(s).)

Different people listening to the same story may converge upon a largely shared interpretation while still developing idiosyncratic experiences atop that shared foundation. What linguistic properties support this individualized experience of natural language? Here, we investigate how the "concrete-abstract" axis-the extent to which a word is grounded in sensory experience-relates to within- and across-subject variability in the neural representations of language. Leveraging a dataset of human participants of both sexes who each listened to four auditory stories while undergoing functional magnetic resonance imaging, we demonstrate that neural representations of "concreteness" are both reliable across stories and relatively unique to individuals, while neural representations of "abstractness" are variable both within individuals and across the population. Using natural language processing tools, we show that concrete words exhibit similar neural representations despite spanning larger distances within a high-dimensional semantic space, which potentially reflects an underlying representational signature of sensory experience-namely, imageability-shared by concrete words but absent from abstract words. Our findings situate the concrete-abstract axis as a core dimension that supports both shared and individualized representations of natural language., Competing Interests: The authors declare no competing financial interests., (Copyright © 2024 the authors.)

The goal of this study was to investigate the impact of the age of acquisition (AoA) on functional brain representations of sign language in two exceptional groups of hearing bimodal bilinguals: native signers (simultaneous bilinguals since early childhood) and late signers (proficient sequential bilinguals, who learnt a sign language after puberty). We asked whether effects of AoA would be present across languages - signed and audiovisual spoken - and thus observed only in late signers as they acquired each language at different life stages, and whether effects of AoA would be present during sign language processing across groups. Moreover, we aimed to carefully control participants' level of sign language proficiency by implementing a battery of language tests developed for the purpose of the project, which confirmed that participants had high competences of sign language. Between-group analyses revealed a hypothesized modulatory effect of AoA in the right inferior parietal lobule (IPL) in native signers, compared to late signers. With respect to within-group differences across languages we observed greater involvement of the left IPL in response to sign language in comparison to spoken language in both native and late signers, indicating language modality effects. Overall, our results suggest that the neural underpinnings of language are molded by the linguistic characteristics of the language as well as by when in life the language is learnt., Competing Interests: Declaration of competing interest None., (Copyright © 2024 Elsevier Ltd. All rights reserved.)

Typological research shows that across languages, trilled [r] sounds are more common in adjectives describing rough as opposed to smooth surfaces. In this study, this lexical research is built on with an experiment with speakers of 28 different languages from 12 different families. Participants were presented with images of a jagged and a straight line and imagined running their finger along each. They were then played an alveolar trill [r] and an alveolar approximant [l] and matched each sound to one of the lines. Participants showed a strong tendency to match [r] with the jagged line and [l] with the straight line, even more consistently than in a comparable cross-cultural investigation of the bouba/kiki effect. The pattern is strongest for matching [r] to the jagged line, but also very strong for matching [l] to the straight line. While this effect was found with speakers of languages with different phonetic realizations of the rhotic sound, it was weaker when trilled [r] was the primary variant. This suggests that when a sound is used phonologically to make systemic meaning contrasts, its iconic potential may become more limited. These findings extend our understanding of iconic crossmodal correspondences, highlighting deep-rooted connections between auditory perception and touch/vision., (© 2024 Author(s). All article content, except where otherwise noted, is licensed under a Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).)

Variability in speech pronunciation is widely observed across different linguistic backgrounds, which impacts modern automatic speech recognition performance. Here, we evaluate the performance of a self-supervised speech model in phoneme recognition using direct articulatory evidence. Findings indicate significant differences in phoneme recognition, especially in front vowels, between American English and Indian English speakers. To gain a deeper understanding of these differences, we conduct real-time MRI-based articulatory analysis, revealing distinct velar region patterns during the production of specific front vowels. This underscores the need to deepen the scientific understanding of self-supervised speech model variances to advance robust and inclusive speech technology., (© 2024 Acoustical Society of America.)

In the development of automatic speech recognition systems, achieving human-like performance has been a long-held goal. Recent releases of large spoken language models have claimed to achieve such performance, although direct comparison to humans has been severely limited. The present study tested L1 British English listeners against two automatic speech recognition systems (wav2vec 2.0 and Whisper, base and large sizes) in adverse listening conditions: speech-shaped noise and pub noise, at different signal-to-noise ratios, and recordings produced with or without face masks. Humans maintained the advantage against all systems, except for Whisper large, which outperformed humans in every condition but pub noise., (© 2024 Author(s). All article content, except where otherwise noted, is licensed under a Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).)

Deriving human neural responses to natural speech is now possible, but the responses to male- and female-uttered speech have been shown to differ. These talker differences may complicate interpretations or restrict experimental designs geared toward more realistic communication scenarios. This study found that when a male talker and a female talker had the same fundamental frequency, auditory brainstem responses (ABRs) were very similar. Those responses became smaller and later with increasing fundamental frequency, as did click ABRs with increasing stimulus rates. Modeled responses suggested that the speech and click ABR differences were reasonably predicted by peripheral and brainstem processing of stimulus acoustics., (© 2024 Acoustical Society of America.)

Gender and language effects on the long-term average speech spectrum (LTASS) have been reported, but typically using recordings that were bandlimited and/or failed to accurately capture extended high frequencies (EHFs). Accurate characterization of the full-band LTASS is warranted given recent data on the contribution of EHFs to speech perception. The present study characterized the LTASS for high-fidelity, anechoic recordings of males and females producing Bamford-Kowal-Bench sentences, digits, and unscripted narratives. Gender had an effect on spectral levels at both ends of the spectrum: males had higher levels than females below approximately 160 Hz, owing to lower fundamental frequencies; females had ∼4 dB higher levels at EHFs, but this effect was dependent on speech material. Gender differences were also observed at ∼300 Hz, and between 800 and 1000 Hz, as previously reported. Despite differences in phonetic content, there were only small, gender-dependent differences in EHF levels across speech materials. EHF levels were highly correlated across materials, indicating relative consistency within talkers. Our findings suggest that LTASS levels at EHFs are influenced primarily by talker and gender, highlighting the need for future research to assess whether EHF cues are more audible for female speech than for male speech., (© 2024 Acoustical Society of America.)

This study investigates the relative perceptual distinction of the [n] vs [l] contrast in different vowel contexts ([&#95;a] vs [&#95;i]) and tonal contexts (high-initial such as HH, HL, vs low-initial such as LL, LH). The results of two speeded AX discrimination experiments indicated that a [n-l] contrast is perceptually more distinct in the [&#95;a] context and with a high-initial tone. The results are consistent with the typology of the [n] vs [l] contrast across Chinese dialects, which is more frequently observed in the [&#95;a] context and with a high-initial tone, supporting a connection between phonological typology and perceptual distinctiveness., (© 2024 Acoustical Society of America.)

Background: It is still not fully explained what kind of cognitive sources the methods used in the assessment of listening effort are more sensitive to and how these measurement results are related to each other. The aim of the study is to ascertain which neural resources crucial for listening effort are most sensitive to objective measurement methods using differently degraded speech stimuli., Methods: A total of 49 individuals between the ages of 19 and 34 with normal hearing participated in the study. In the first stage, simultaneous pupillometry, electroencephalogram (EEG), and single-task paradigm reaction time (RT) measurements were made during the challenging listening and repetition task with noise-vocoded speech. Two speech reception thresholds (SRT) (50% and 80%) for two vocoding conditions (16 and 6 channels) were collected, resulting in 4 conditions. In the second stage, the Rey Auditory Verbal Learning Test (RAVLT) and the test of attention in listening (TAIL) were applied. Stepwise linear regression analyses were conducted to examine the predictors of listening effort measurements., Results: A significant difference was found between 6 and 16 channel stimuli in both pupil dilation change and EEG alpha band power change. In the hardest listening condition, whereas RAVLT scores are significant predictors of pupil dilation change, TAIL scores are significant predictors of EEG alpha power. As the stimulus difficulty decreased, the factors that predicted both EEG and pupillometry results decreased. In the single-task paradigm, a significant regression model could not be obtained at all four difficulty levels., Conclusion: As a result of the study, it was found that the pupil dilation change was more sensitive to auditory memory skills and the EEG alpha power change was more sensitive to auditory attention skills. To our knowledge, this study is the first to investigate the sensitivity of different listening effort measurement methods to auditory cognitive skills., (© 2024 The Author(s). Brain and Behavior published by Wiley Periodicals LLC.)

Background: Speech comprehension impairment in post-stroke aphasia is influenced by speech acoustics. This study investigated the impact of speech rhythm (syllabic isochrony) and rate on comprehension in people with aphasia (PWA). Rhythmical speech was hypothesised to support comprehension in PWA by reducing temporal variation, leading to enhanced speech tracking and more appropriate sampling of the speech stream. Speech rate was hypothesised to influence comprehension through auditory and linguistic processing time., Methods: One group of PWA (n = 19) and two groups of control participants (n = 10 and n = 18) performed a sentence-verification. Sentences were presented in two rhythm conditions (natural vs isochronous) and two rate conditions (typical, 3.6 Hz vs slow, 2.6 Hz) in a 2 × 2 factorial design. PWA and one group of controls performed the experiment with clear speech. The second group of controls performed the experiment with perceptually degraded speech., Results: D-prime analyses measured capacity to detect incongruent endings. Linear mixed effects models investigated the impact of group, rhythm, rate and clarity on d-prime scores. Control participants were negatively affected by isochronous rhythm in comparison to natural rhythm, likely due to alteration in linguistic cues. This negative impact remained or was exacerbated in control participants presented with degraded speech. In comparison, PWA were less affected by isochronous rhythm, despite producing d-prime scores matched to the degraded speech control group. Speech rate affected all groups, but only in interactions with rhythm, indicating that slow-rate isochronous speech was more comprehendible than typical-rate isochronous speech., Conclusions: The comprehension network in PWA interacts differently with speech rhythm. Rhythmical speech may support acoustic speech tracking by enhancing predictability and ameliorate the detrimental impact of atypical rhythm on linguistic cues. Alternatively, reduced temporal prediction in aphasia may limit the impact of deviation from natural temporal structure. Reduction of speech rate below the typical range may not benefit comprehension in PWA., Competing Interests: Declaration of competing interest The authors have no competing interests to declare., (Copyright © 2024 The Author(s). Published by Elsevier Ltd.. All rights reserved.)

Neural representations induced by naturalistic stimuli offer insights into how humans respond to stimuli in daily life. Understanding neural mechanisms underlying naturalistic stimuli processing hinges on the precise identification and extraction of the shared neural patterns that are consistently present across individuals. Targeting the Electroencephalogram (EEG) technique, known for its rich spatial and temporal information, this study presents a framework for Contrastive Learning of Shared SpatioTemporal EEG Representations across individuals (CL-SSTER). CL-SSTER utilizes contrastive learning to maximize the similarity of EEG representations across individuals for identical stimuli, contrasting with those for varied stimuli. The network employs spatial and temporal convolutions to simultaneously learn the spatial and temporal patterns inherent in EEG. The versatility of CL-SSTER was demonstrated on three EEG datasets, including a synthetic dataset, a natural speech comprehension EEG dataset, and an emotional video watching EEG dataset. CL-SSTER attained the highest inter-subject correlation (ISC) values compared to the state-of-the-art ISC methods. The latent representations generated by CL-SSTER exhibited reliable spatiotemporal EEG patterns, which can be explained by properties of the naturalistic stimuli. CL-SSTER serves as an interpretable and scalable framework for the identification of inter-subject shared neural representations in naturalistic neuroscience., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Author(s). Published by Elsevier Inc. All rights reserved.)

Across languages, syllables more likely begin with consonants (vs. vowels) and end with vowels (vs. consonants), so that words that follow (vs. do not follow) this pattern are more familiar. In six experiments (total N = 638), we investigated the influence of beginning and ending letters (vowels vs. consonants) of pseudowords on preferences. Pseudowords that begin with consonants (vs. vowels) were preferred; independently, pseudowords that end with vowels (vs. consonants) were also preferred. Both of these consonant-vowel-preference effects generalized across stimulus sets and across speakers of German and English (Experiments 1a-1c). Additionally, consistent with familiarity as the underlying mechanism, pseudowords with consonant (vs. vowel) beginnings and vowel (vs. consonant) endings were more frequently judged to be real words (Experiment 2). The word-ending effect-but surprisingly, not the word-beginning effect-generalized to auditory stimulus presentation (Experiments 3a-3b). Thus, we find that preferences for vowel (vs. consonant) at word endings are more robust than preferences for consonant (vs. vowel) at word beginnings. By showing that consonant-vowel structure systematically influences preferences, we demonstrate two new associations between word form and affective meaning. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

When speakers learn to change the way they produce a speech sound, how much does that learning generalize to other speech sounds? Past studies of speech sensorimotor learning have typically tested the generalization of a single transformation learned in a single context. Here, we investigate the ability of the speech motor system to generalize learning when multiple opposing sensorimotor transformations are learned in separate regions of the vowel space. We find that speakers adapt to a nonuniform "centralization" perturbation, learning to produce vowels with greater acoustic contrast, and that this adaptation generalizes to untrained vowels, which pattern like neighboring trained vowels and show increased contrast of a similar magnitude. NEW & NOTEWORTHY We show that sensorimotor adaptation of vowels at the edges of the articulatory working space generalizes to intermediate vowels through local transfer of learning from adjacent vowels. These results extend findings on the locality of sensorimotor learning from upper limb control to speech, a complex task with an opaque and nonlinear transformation between motor actions and sensory consequences. Our results also suggest that our paradigm has potential to drive behaviorally relevant changes that improve communication effectiveness.

Infants quickly recognize the sounds of their mother language, perceiving the spectrotemporal acoustic features of speech. However, the underlying neural machinery remains unclear. We used an auditory evoked potential termed frequency-following response (FFR) to unravel the neural encoding maturation for two speech sound characteristics: voice pitch and temporal fine structure. 37 healthy-term neonates were tested at birth and retested at the ages of six and twelve months. Results revealed a reduction in neural phase-locking onset to the stimulus envelope from birth to six months, stabilizing by twelve months. While neural encoding of voice pitch remained consistent across ages, temporal fine structure encoding matured rapidly from birth to six months, without further improvement from six to twelve months. Results highlight the critical importance of the first six months of life in the maturation of neural encoding mechanisms that are crucial for phoneme discrimination during early language acquisition., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Authors. Published by Elsevier Inc. All rights reserved.)

Receptive language deficits and aberrant auditory processing are often observed in individuals with autism spectrum disorders (ASD). Symptoms associated with ASD are observed in rodents prenatally exposed to valproic acid (VPA), including deficits in speech sound discrimination ability. These perceptual difficulties are accompanied by changes in neural activity patterns. In both cortical and subcortical levels of the auditory pathway, VPA-exposed rats have impaired responses to speech sounds. Developing a method to improve these neural deficits throughout the auditory pathway is necessary. The purpose of this study was to investigate the ability of vagus nerve stimulation (VNS) paired with sounds to restore degraded inferior colliculus (IC) responses in VPA-exposed rats. VNS paired with the speech sound "dad" was presented to a group of VPA-exposed rats 300 times per day for 20 days. Another group of VPA-exposed rats were presented with VNS paired with multiple tone frequencies for 20 days. The IC responses were recorded from 19 saline-exposed control rats and 18 VPA-exposed with no VNS, 8 VNS-speech paired VPA-exposed, and 7 VNS-tone paired VPA-exposed female and male rats. Pairing VNS with tones increased the IC response strength to speech sounds by 44% compared to VPA-exposed rats alone. Contrarily, VNS-speech pairing significantly decreased the IC response to speech compared with VPA-exposed rats by 5%. The present research indicates that pairing VNS with tones improved sound processing in rats exposed to VPA and suggests that auditory processing can be improved through targeted plasticity. NEW & NOTEWORTHY Pairing vagus nerve stimulation (VNS) with sounds has improved auditory processing in the auditory cortex of normal-hearing rats and autism models of rats. This study tests the ability of VNS-sound pairing to restore auditory processing in the inferior colliculus (IC) of valproic acid (VPA)-exposed rats. Pairing VNS with tones significantly reversed the degraded sound processing in the IC in VPA-exposed rats. The findings provide evidence that auditory processing in autism rat models can be improved through VNS.

Cochlear implants (CIs) are the most successful neural prostheses, enabling individuals with severe to profound hearing loss to access sounds and understand speech. While CI has demonstrated success, speech perception outcomes vary largely among CI listeners, with significantly reduced performance in noise. This review paper summarizes prior findings on speech-evoked cortical activities in adult CI listeners using functional near-infrared spectroscopy (fNIRS) to understand (a) speech-evoked cortical processing in CI listeners compared to normal-hearing (NH) individuals, (b) the relationship between these activities and behavioral speech recognition scores, (c) the extent to which current fNIRS-measured speech-evoked cortical activities in CI listeners account for their differences in speech perception, and (d) challenges in using fNIRS for CI research. Compared to NH listeners, CI listeners had diminished speech-evoked activation in the middle temporal gyrus (MTG) and in the superior temporal gyrus (STG), except one study reporting an opposite pattern for STG. NH listeners exhibited higher inferior frontal gyrus (IFG) activity when listening to CI-simulated speech compared to natural speech. Among CI listeners, higher speech recognition scores correlated with lower speech-evoked activation in the STG, higher activation in the left IFG and left fusiform gyrus, with mixed findings in the MTG. fNIRS shows promise for enhancing our understanding of cortical processing of speech in CI listeners, though findings are mixed. Challenges include test-retest reliability, managing noise, replicating natural conditions, optimizing montage design, and standardizing methods to establish a strong predictive relationship between fNIRS-based cortical activities and speech perception in CI listeners., (© 2024. The Author(s).)

Introduction: Hearing impairments in Parkinson's Disease (PD) have received limited attention in the past, possibly because PD patients often report no perceived hearing disability, yet negative consequences of hearing impairment might aggravate communication difficulties and social withdrawal., Objective: Our aim was to investigate functional hearing (speech in noise recognition) in PD and evaluate its relationship to neuropsychiatric symptoms, cognition and quality of life., Methods: Participants with PD were recruited in a tertiary movement disorder clinic. Demographic, audiological, neuropsychiatric and quality of life data were collected. Participants underwent pure tone audiometry (PTA) and Hearing in Noise test (HINT) as a part of their audiological evaluation., Results: A total of 29 participants (mean age: 65.8±8.3 years, M:F= 1.6:1, mean disease duration 5.2 ± 4.0 years) completed the study. All assessments were done in the ON state. 19/29 (65.5 %) participants had normal tone audiometry for age; functional hearing loss, however, was present in 17/29 (58.6 %) according to the HINT. 65 % (11/17) of the affected participants had a disease duration of <4 years. The majority (72.4 %) with poor functional hearing did not perceive any hearing impairment. Hearing deficits did not correlate with non-motor symptoms (NMS), including cognition or other quality of life measures., Conclusions: Functional hearing loss is common in PD, often presents early in the disease and the majority of PD patients are unaware of their functional hearing loss. Its potential impact on cognition, communication and quality of life requires further investigation and tailored treatment., Competing Interests: Declaration of Competing Interest None, (Copyright © 2024. Published by Elsevier B.V.)

The middle-ear muscle reflex (MEMR) and medial olivocochlear reflex (MOCR) modify peripheral auditory function, which may reduce masking and improve speech-in-noise (SIN) recognition. Previous work and our pilot data suggest that the two reflexes respond differently to static versus dynamic noise elicitors. However, little is known about how the two reflexes work in tandem to contribute to SIN recognition. We hypothesized that SIN recognition would be significantly correlated with the strength of the MEMR and with the strength of the MOCR. Additionally, we hypothesized that SIN recognition would be best when both reflexes were activated. A total of 43 healthy, normal-hearing adults met the inclusion/exclusion criteria (35 females, age range: 19-29 years). MEMR strength was assessed using wideband absorbance. MOCR strength was assessed using transient-evoked otoacoustic emissions. SIN recognition was assessed using a modified version of the QuickSIN. All measurements were made with and without two types of contralateral noise elicitors (steady and pulsed) at two levels (50 and 65 dB SPL). Steady noise was used to primarily elicit the MOCR and pulsed noise was used to elicit both reflexes. Two baseline conditions without a contralateral elicitor were also obtained. Results revealed differences in how the MEMR and MOCR responded to elicitor type and level. Contrary to hypotheses, SIN recognition was not significantly improved in the presence of any contralateral elicitors relative to the baseline conditions. Additionally, there were no significant correlations between MEMR strength and SIN recognition, or between MOCR strength and SIN recognition. MEMR and MOCR strength were significantly correlated for pulsed noise elicitors but not steady noise elicitors. Results suggest no association between SIN recognition and the MEMR or MOCR, at least as measured and analyzed in this study. SIN recognition may have been influenced by factors not accounted for in this study, such as contextual cues, warranting further study., (Copyright © 2024 The Author(s). Published by Elsevier B.V. All rights reserved.)

Focusing on a specific conversation amidst multiple interfering talkers is challenging, especially for those with hearing loss. Brain-controlled assistive hearing devices aim to alleviate this problem by enhancing the attended speech based on the listener's neural signals using auditory attention decoding (AAD). Departing from conventional AAD studies that relied on oversimplified scenarios with stationary talkers, a realistic AAD task that involves multiple talkers taking turns as they continuously move in space in background noise is presented. Invasive electroencephalography (iEEG) data are collected from three neurosurgical patients as they focused on one of the two moving conversations. An enhanced brain-controlled assistive hearing system that combines AAD and a binaural speaker-independent speech separation model is presented. The separation model unmixes talkers while preserving their spatial location and provides talker trajectories to the neural decoder to improve AAD accuracy. Subjective and objective evaluations show that the proposed system enhances speech intelligibility and facilitates conversation tracking while maintaining spatial cues and voice quality in challenging acoustic environments. This research demonstrates the potential of this approach in real-world scenarios and marks a significant step toward developing assistive hearing technologies that adapt to the intricate dynamics of everyday auditory experiences., (© 2024 The Author(s). Advanced Science published by Wiley‐VCH GmbH.)

Previous research has shown that when domain-general transitional probability (TP) cues to word segmentation are in conflict with language-specific stress cues, English-learning 5- and 7-month-olds rely on TP, whereas 9-month-olds rely on stress. In two artificial languages, we evaluated English-learning infants' sensitivity to TP cues to word segmentation vis-a-vis language-specific vowel phonotactic (VP) cues-English words do not end in lax vowels. These cues were either consistent or conflicting. When these cues were in conflict, 10-month-olds relied on the VP cues, whereas 5-month-olds relied on TP. These findings align with statistical bootstrapping accounts, where infants initially use domain-general distributional information for word segmentation, and subsequently discover language-specific patterns based on segmented words. RESEARCH HIGHLIGHTS: Research indicates that when transitional probability (TP) conflicts with stress cues for word segmentation, English-learning 9-month-olds rely on stress, whereas younger infants rely on TP. In two artificial languages, we evaluated English-learning infants' sensitivity to TP versus vowel phonotactic (VP) cues for word segmentation. When these cues conflicted, 10-month-olds relied on VPs, whereas 5-month-olds relied on TP. These findings align with statistical bootstrapping accounts, where infants first utilize domain-general distributional information for word segmentation, and then identify language-specific patterns from segmented words., (© 2024 John Wiley & Sons Ltd.)

This article reviews empirical methods and findings on early language discrimination, questioning rhythm-class based hypotheses on language discrimination in infancy, as well as the assumption that early language discrimination is driven primarily (or solely) by temporal prosodic cues. The present work argues that within-rhythm class discrimination which - according to the rhythmic hypothesis - is not applicable very early in life, has not been sufficiently tested with infants under 4 months of age, that familiarity with a language is not a prerequisite for its discrimination from another rhythmically similar language, and that the temporal rhythm properties may not universally be the primary cues to language discrimination. Although rhythm taxonomy is now by many understood as outdated, some developmental literature still draws on the assumption that rhythm classification determines infants' language discrimination; other studies consider rhythm along a continuous scale and only a few account for cues to language discrimination other than temporal ones. It is proposed that studies on early language discrimination systematically test the contribution of other than temporal rhythm cues, similarly to recent work on multidimensional psychoacoustic salience in the acquisition of segmental categories., (© 2024 International Congress of Infant Studies.)

The cortical generators of the pure tone MMN and P300 have been thoroughly studied. Their nature and interaction with respect to phoneme perception, however, is poorly understood. Accordingly, the cortical sources and functional connections that underlie the MMN and P300 in relation to passive and active speech sound perception were identified. An inattentive and attentive phonemic oddball paradigm, eliciting a MMN and P300 respectively, were administered in 60 healthy adults during simultaneous high-density EEG recording. For both the MMN and P300, eLORETA source reconstruction was performed. The maximal cross-correlation was calculated between ROI-pairs to investigate inter-regional functional connectivity specific to passive and active deviant processing. MMN activation clusters were identified in the temporal (insula, superior temporal gyrus and temporal pole), frontal (rostral middle frontal and pars opercularis) and parietal (postcentral and supramarginal gyrus) cortex. Passive discrimination of deviant phonemes was aided by a network connecting right temporoparietal cortices to left frontal areas. For the P300, clusters with significantly higher activity were found in the frontal (caudal middle frontal and precentral), parietal (precuneus) and cingulate (posterior and isthmus) cortex. Significant intra- and interhemispheric connections between parietal, cingulate and occipital regions constituted the network governing active phonemic target detection. A predominantly bilateral network was found to underly both the MMN and P300. While passive phoneme discrimination is aided by a fronto-temporo-parietal network, active categorization calls on a network entailing fronto-parieto-cingulate cortices. Neural processing of phonemic contrasts, as reflected by the MMN and P300, does not appear to show pronounced lateralization to the language-dominant hemisphere., (© 2024. The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.)

Exposure to talker variability shapes how learning unfolds in the lab, and occurs in the everyday speech infants hear in daily life. Here, we asked whether aspects of talker variability in speech input are also linked to the onset of word production. We further asked whether these effects were redundant with effects of speech register (i.e., whether speech input was adult- vs. child-directed). To do so, we first extracted a set of highly common nouns from a longitudinal corpus of home recordings from North-American English-learning infants. We then used the acoustic variability in how these tokens were said to predict when the children first produced these same nouns. We found that in addition to frequency, variability in how words sound in 6-17 month's input predicted when children first said these words. Furthermore, while the proportion of child-directed speech also predicted the month of first production, it did so alongside measurements of acoustic variability in children's real-world input. Together, these results add to a growing body of literature suggesting that variability in how words sound in the input is linked to learning both in the lab and in daily life. RESEARCH HIGHLIGHTS: Talker variability shapes learning in the lab and exists in everyday speech; we asked whether it predicts word learning in the real world. Acoustic measurements of early words in infants' input (and their frequency) predicted when infants first said those same words. Speech register also predicted when infants said words, alongside effects of talker variability. Our results provide a deeper understanding of how sources of variability inherent to children's input connect to their learning and development., (© 2024 John Wiley & Sons Ltd.)

The contribution of consonants and vowels in spoken word processing has been widely investigated, and studies have found a phenomenon of a Consonantal bias (C-bias), indicating that consonants carry more weight than vowels. However, across languages, various patterns have been documented, including that of no preference or a reverse pattern of Vowel bias. A central question is how the manifestation of the C-bias is modulated by language-specific factors. This question can be addressed by cross-linguistic studies. Comparing native Hebrew and native English speakers, this study examines the relative importance of transitional probabilities between non-adjacent consonants as opposed to vowels during auditory statistical learning (SL) of an artificial language. Hebrew is interesting because its complex Semitic morphological structure has been found to play a central role in lexical access, allowing us to examine whether morphological properties can modulate the C-bias in early phases of speech perception, namely, word segmentation. As predicted, we found a significant interaction between language and consonant/vowel manipulation, with a higher performance in the consonantal condition than in the vowel condition for Hebrew speakers, namely, C-bias, and no consonant/vowel asymmetry among English speakers. We suggest that the observed interaction is morphologically anchored, indicating that phonological and morphological processes interact during early phases of auditory word perception., Competing Interests: Declaration of conflicting interestsThe author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Objectives: We investigated whether listening effort is dependent on task difficulty for cochlear implant (CI) users when using the Matrix speech-in-noise test. To this end, we measured peak pupil dilation (PPD) at a wide range of signal to noise ratios (SNR) by systematically changing the noise level at a constant speech level, and vice versa., Design: A group of mostly elderly CI users performed the Dutch/Flemish Matrix test in quiet and in multitalker babble at different SNRs. SNRs were set relative to the speech-recognition threshold (SRT), namely at SRT, and 5 and 10 dB above SRT (0 dB, +5 dB, and +10 dB re SRT). The latter 2 conditions were obtained by either varying speech level (at a fixed noise level of 60 dBA) or by varying noise level (with a fixed speech level). We compared these PPDs with those of a group of typical hearing (TH) listeners. In addition, listening effort was assessed with subjective ratings on a Likert scale., Results: PPD for the CI group did not significantly depend on SNR, whereas SNR significantly affected PPDs for TH listeners. Subjective effort ratings depended significantly on SNR for both groups. For CI users, PPDs were significantly larger, and effort was rated higher when speech was varied, and noise was fixed for CI users. By contrast, for TH listeners effort ratings were significantly higher and performance scores lower when noise was varied, and speech was fixed., Conclusions: The lack of a significant effect of varying SNR on PPD suggests that the Matrix test may not be a feasible speech test for measuring listening effort with pupillometric measures for CI users. A rating test appeared more promising in this population, corroborating earlier reports that subjective measures may reflect different dimensions of listening effort than pupil dilation. Establishing the SNR by varying speech or noise level can have subtle, but significant effects on measures of listening effort, and these effects can differ between TH listeners and CI users., Competing Interests: The authors have no conflicts of interest to disclose., (Copyright © 2024 The Authors. Ear & Hearing is published on behalf of the American Auditory Society, by Wolters Kluwer Health, Inc.)

We regularly form impressions of who a person is from their voice, such that we can readily categorise people as being female or male, child or adult, trustworthy or not, and can furthermore recognise who specifically is speaking. How we establish mental representations for such categories of person characteristics has, however, only been explored in detail for voice identity learning. In a series of experiments, we therefore set out to examine whether and how listeners can learn to recognise a novel person characteristic. We specifically asked how diagnostic acoustic properties underpinning category distinctions inform perceptual judgements. We manipulated recordings of voices to create acoustic signatures for a person's handedness (left-handed vs. right-handed) in their voice. After training, we found that listeners were able to successfully learn to recognise handedness from voices with above-chance accuracy, although no significant differences in accuracy between the different types of manipulation emerged. Listeners were, furthermore, sensitive to the specific distributions of acoustic properties that underpinned the category distinctions. We, however, also find evidence for perceptual biases that may reflect long-term prior exposure to how voices vary in naturalistic settings. These biases shape how listeners use acoustic information in the voices when forming representations for distinguishing handedness from voices. This study is thus a first step to examine how representations for novel person characteristics are established, outside of voice identity perception. We discuss our findings in light of theoretical accounts of voice perception and speculate about potential mechanisms that may underpin our results., Competing Interests: Declaration of conflicting interestsThe author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Test-retest reliability-establishing that measurements remain consistent across multiple testing sessions-is critical to measuring, understanding, and predicting individual differences in infant language development. However, previous attempts to establish measurement reliability in infant speech perception tasks are limited, and reliability of frequently used infant measures is largely unknown. The current study investigated the test-retest reliability of infants' preference for infant-directed speech over adult-directed speech in a large sample (N = 158) in the context of the ManyBabies1 collaborative research project. Labs were asked to bring in participating infants for a second appointment retesting infants on their preference for infant-directed speech. This approach allowed us to estimate test-retest reliability across three different methods used to investigate preferential listening in infancy: the head-turn preference procedure, central fixation, and eye-tracking. Overall, we found no consistent evidence of test-retest reliability in measures of infants' speech preference (overall r = 0.09, 95% CI [-0.06,0.25]). While increasing the number of trials that infants needed to contribute for inclusion in the analysis revealed a numeric growth in test-retest reliability, it also considerably reduced the study's effective sample size. Therefore, future research on infant development should take into account that not all experimental measures may be appropriate for assessing individual differences between infants. RESEARCH HIGHLIGHTS: We assessed test-retest reliability of infants' preference for infant-directed over adult-directed speech in a large pre-registered sample (N = 158). There was no consistent evidence of test-retest reliability in measures of infants' speech preference. Applying stricter criteria for the inclusion of participants may lead to higher test-retest reliability, but at the cost of substantial decreases in sample size. Developmental research relying on stable individual differences should consider the underlying reliability of its measures., (© 2024 The Author(s). Developmental Science published by John Wiley & Sons Ltd.)

Objectives: Recently, the Noise-Tolerance Domains Test (NTDT) was applied to study the noise-tolerance domains used by young normal-hearing (NH) listeners during noise acceptance decisions. In this study, we examined how subjective speech intelligibility may drive noise acceptance decisions by applying the NTDT on NH and hearing-impaired (HI) listeners at the signal to noise ratios (SNRs) around the Tracking of Noise-Tolerance (TNT) thresholds., Design: A single-blind, within-subjects design with 22 NH and 17 HI older adults was followed. Listeners completed the TNT to determine the average noise acceptance threshold (TNT Ave ). Then, listeners completed the NTDT at the SNRs of 0, ±3 dB (re: TNT Ave ) to estimate the weighted noise-tolerance domain ratings (WNTDRs) for each domain criterion. Listeners also completed the Objective and Subjective Intelligibility Difference (OSID) Test to establish the individual intelligibility performance-intensity (P-I) functions of the TNT materials. All test measures were conducted at 75 and 82 dB SPL speech input levels. NH and HI listeners were tested in the unaided mode. The HI listeners were also tested using a study hearing aid. The WNTDRs were plotted against subjective speech intelligibilities extrapolated from individual P-I of the OSID at the SNRs corresponding to NTDT test conditions. Listeners were grouped according to their most heavily weighed domain and a regression analysis was performed against listener demographics as well as TNT and OSID performances to determine which variable(s) affected listener grouping., Results: Three linear mixed effects (LMEs) models were used to examine whether WNTDRs changed with subjective speech intelligibility. All three LMEs found significant fixed effects of domain criteria, subjective intelligibility, and speech input level on WNTDRs. In general, heavier weights were assigned to speech interference and loudness domains at poorer intelligibility levels (<50%) with reversals to distraction and annoyance at higher intelligibility levels (>80%). The comparison between NH and HI-unaided showed that NH listeners assigned greater weights to loudness than the HI-unaided listeners. The comparison between NH and HI-aided groups showed similar weights between groups. The comparison between HI-unaided and HI-aided found that HI listeners assigned lower weights to speech interference and greater weights to loudness when tested in aided compared with unaided modes. In all comparisons, loudness was weighed heavier at the 82 dB SPL input level than at the 75 dB SPL input level with greater weights to annoyance in the NH versus HI-unaided comparison and lower weights to distraction in the HI-aided versus HI-unaided comparison. A generalized linear model determined that listener grouping was best accounted for by subjective speech intelligibility estimated at TNT Ave ., Conclusions: The domain criteria used by listeners were driven by their subjective speech intelligibility regardless of their hearing status (i.e., NH versus HI). In general, when subjective intelligibility was poor, the domains of speech interference and loudness were weighed the heaviest. As subjective intelligibility improved, the weightings on annoyance and distraction increased. Furthermore, a listener's criterion for >90% subjective speech understanding at the TNT Ave may allow one to profile the listener., Competing Interests: The authors have no conflicts of interest to disclose., (Copyright © 2024 Wolters Kluwer Health, Inc. All rights reserved.)

Objectives: Modern cochlear implants (CIs) use varying-length electrode arrays inserted at varying insertion angles within variably sized cochleae. Thus, there exists an opportunity to enhance CI performance, particularly in postlinguistic adults, by optimizing the frequency-to-place allocation for electrical stimulation, thereby minimizing the need for central adaptation and plasticity. There has been interest in applying Greenwood or Stakhovskaya et al. function (describing the tonotopic map) to postoperative imaging of electrodes to improve frequency allocation and place coding. Acoustically-evoked electrocochleography (ECochG) allows for electrophysiologic best-frequency (BF) determination of CI electrodes and the potential for creating a personalized frequency allocation function. The objective of this study was to investigate the correlation between early speech-perception performance and frequency-to-place mismatch., Design: This retrospective study included 50 patients who received a slim perimodiolar electrode array. Following electrode insertion, five acoustic pure-tone stimuli ranging from 0.25 to 2 kHz were presented, and electrophysiological measurements were collected across all 22 electrode contacts. Cochlear microphonic tuning curves were subsequently generated for each stimulus frequency to ascertain the BF electrode or the location corresponding to the maximum response amplitude. Subsequently, we calculated the difference between the stimulus frequency and the patient's CI map's actual frequency allocation at each BF electrode, reflecting the frequency-to-place mismatch. BF electrocochleography-total response (BF-ECochG-TR), a measure of cochlear health, was also evaluated for each subject to control for the known impact of this measure on performance., Results: Our findings showed a moderate correlation ( r = 0.51; 95% confidence interval: 0.23 to 0.76) between the cumulative frequency-to-place mismatch, as determined using the ECochG-derived BF map (utilizing 500, 1000, and 2000 Hz), and 3-month performance on consonant-nucleus-consonant words (N = 38). Larger positive mismatches, shifted basal from the BF map, led to enhanced speech perception. Incorporating BF-ECochG-TR, total mismatch, and their interaction in a multivariate model explained 62% of the variance in consonant-nucleus-consonant word scores at 3 months. BF-ECochG-TR as a standalone predictor tended to overestimate performance for subjects with larger negative total mismatches and underestimated the performance for those with larger positive total mismatches. Neither cochlear diameter, number of cochlear turns, nor apical insertion angle accounted for the variability in total mismatch., Conclusions: Comparison of ECochG-BF derived tonotopic electrode maps to the frequency allocation tables reveals substantial mismatch, explaining 26.0% of the variability in CI performance in quiet. Closer examination of the mismatch shows that basally shifted maps at high frequencies demonstrate superior performance at 3 months compared with those with apically shifted maps (toward Greenwood and Stakhovskaya et al.). The implications of these results suggest that electrophysiological-based frequency reallocation might lead to enhanced speech-perception performance, especially when compared with conventional manufacturer maps or anatomic-based mapping strategies. Future research, exploring the prospective use of ECochG-based mapping techniques for frequency allocation is underway., Competing Interests: J.A.H. is a consultant for Cochlear Ltd. C.A.B. is a consultant for Advanced Bionics, Cochlear Ltd., Envoy, and IotaMotion, and has equity interest in Advanced Cochlear Diagnostics, LLC. The other authors have no conflicts of interest to disclose., (Copyright © 2024 Wolters Kluwer Health, Inc. All rights reserved.)

Objectives: This study aimed to determine the speech-to-background ratios (SBRs) at which normal-hearing (NH) and hearing-impaired (HI) listeners can recognize both speech and environmental sounds when the two types of signals are mixed. Also examined were the effect of individual sounds on speech recognition and environmental sound recognition (ESR), and the impact of divided versus selective attention on these tasks., Design: In Experiment 1 (divided attention), 11 NH and 10 HI listeners heard sentences mixed with environmental sounds at various SBRs and performed speech recognition and ESR tasks concurrently in each trial. In Experiment 2 (selective attention), 20 NH listeners performed these tasks in separate trials. Psychometric functions were generated for each task, listener group, and environmental sound. The range over which speech recognition and ESR were both high was determined, as was the optimal SBR for balancing recognition with ESR, defined as the point of intersection between each pair of normalized psychometric functions., Results: The NH listeners achieved greater than 95% accuracy on concurrent speech recognition and ESR over an SBR range of approximately 20 dB or greater. The optimal SBR for maximizing both speech recognition and ESR for NH listeners was approximately +12 dB. For the HI listeners, the range over which 95% performance was observed on both tasks was far smaller (span of 1 dB), with an optimal value of +5 dB. Acoustic analyses indicated that the speech and environmental sound stimuli were similarly audible, regardless of the hearing status of the listener, but that the speech fluctuated more than the environmental sounds. Divided versus selective attention conditions produced differences in performance that were statistically significant yet only modest in magnitude. In all conditions and for both listener groups, recognition was higher for environmental sounds than for speech when presented at equal intensities (i.e., 0 dB SBR), indicating that the environmental sounds were more effective maskers of speech than the converse. Each of the 25 environmental sounds used in this study (with one exception) had a span of SBRs over which speech recognition and ESR were both higher than 95%. These ranges tended to overlap substantially., Conclusions: A range of SBRs exists over which speech and environmental sounds can be simultaneously recognized with high accuracy by NH and HI listeners, but this range is larger for NH listeners. The single optimal SBR for jointly maximizing speech recognition and ESR also differs between NH and HI listeners. The greater masking effectiveness of the environmental sounds relative to the speech may be related to the lower degree of fluctuation present in the environmental sounds as well as possibly task differences between speech recognition and ESR (open versus closed set). The observed differences between the NH and HI results may possibly be related to the HI listeners' smaller fluctuating masker benefit. As noise-reduction systems become increasingly effective, the current results could potentially guide the design of future systems that provide listeners with highly intelligible speech without depriving them of access to important environmental sounds., Competing Interests: The authors have no conflicts of interest to disclose., (Copyright © 2024 Wolters Kluwer Health, Inc. All rights reserved.)

Functional near-infrared spectroscopy (fNIRS), a non-invasive optical neuroimaging technique that is portable and acoustically silent, has become a promising tool for evaluating auditory brain functions in hearing-vulnerable individuals. This study, for the first time, used fNIRS to evaluate neuroplasticity of speech-in-noise processing in older adults. Ten older adults, most of whom had moderate-to-mild hearing loss, participated in a 4-week speech-in-noise training. Their speech-in-noise performances and fNIRS brain responses to speech (auditory sentences in noise), non-speech (spectrally-rotated speech in noise) and visual (flashing chequerboards) stimuli were evaluated pre- (T0) and post-training (immediately after training, T1; and after a 4-week retention, T2). Behaviourally, speech-in-noise performances were improved after retention (T2 vs. T0) but not immediately after training (T1 vs. T0). Neurally, we intriguingly found brain responses to speech vs. non-speech decreased significantly in the left auditory cortex after retention (T2 vs. T0 and T2 vs. T1) for which we interpret as suppressed processing of background noise during speech listening alongside the significant behavioural improvements. Meanwhile, functional connectivity within and between multiple regions of temporal, parietal and frontal lobes was significantly enhanced in the speech condition after retention (T2 vs. T0). We also found neural changes before the emergence of significant behavioural improvements. Compared to pre-training, responses to speech vs. non-speech in the left frontal/prefrontal cortex were decreased significantly both immediately after training (T1 vs. T0) and retention (T2 vs. T0), reflecting possible alleviation of listening efforts. Finally, connectivity was significantly decreased between auditory and higher-level non-auditory (parietal and frontal) cortices in response to visual stimuli immediately after training (T1 vs. T0), indicating decreased cross-modal takeover of speech-related regions during visual processing. The results thus showed that neuroplasticity can be observed not only at the same time with, but also before, behavioural changes in speech-in-noise perception. To our knowledge, this is the first fNIRS study to evaluate speech-based auditory neuroplasticity in older adults. It thus provides important implications for current research by illustrating the promises of detecting neuroplasticity using fNIRS in hearing-vulnerable individuals., (© 2024. The Author(s).)

This study examined how Mandarin-speaking preschoolers with and without a history of late talking (LT) process familiar monosyllabic words with unexpected lexical tones, focusing on both phonological and semantic violations. This study initially enrolled 64 Mandarin-speaking toddlers: 31 with a history of LT (mean age: 27.67 months) and 33 without a history of LT (non-LT) (mean age: 27.85 months). Event-related potentials were recorded at the age of 4 years during a picture-word mismatch task (LT mean age: 51.36 months; non-LT mean age: 51.20 months); in this task, the participants were presented with auditory words either matching (Tone 3) or mismatching with images in terms of their lexical tones; the mismatches encompassed acoustically dissimilar (Tone 1) and similar (Tone 2) mismatches. A significant difference in the phonological mapping negativity (PMN) responses to Tones 1 and 3 was observed only in the non-LT group. However, differences in the N400 responses to Tones 1 and 3 remained consistent across both groups. In addition, greater differences in the PMN responses between Tones 1 and 3 were associated with higher language proficiency during the preschool period. The PMN response serves as an indicator of neural correlates in lexical tone processing, reflecting challenges encountered by preschoolers with a history of LT when processing the lexical tones of familiar words. Furthermore, the PMN response was correlated with concurrent language abilities. These findings indicate the importance of early tonal perception development for Mandarin speakers with a history of LT. RESEARCH HIGHLIGHTS: Preschoolers with a history of late talking (LT), similar to preschoolers without such a history, can establish word expectations and detect the lexical tone violation in real time. However, those with a history of LT require additional time to process acoustic cues and differentiate between word semantics based on lexical tone information. The phonological mapping negativity response serves as an indicator of neural correlates in lexical tone processing, reflecting challenges encountered by preschoolers with a history of LT when processing the lexical tones of familiar words. The present findings indicate the importance of early intervention for Mandarin speakers with a history of LT, with an emphasis on lexical tone processing from toddlerhood., (© 2024 The Author(s). Developmental Science published by John Wiley & Sons Ltd.)

Objectives: Individuals with Down syndrome (DS) have a higher incidence of hearing loss (HL) compared with their peers without developmental disabilities. Little is known about the associations between HL and functional hearing for individuals with DS. This study investigated two aspects of auditory functions, "what" (understanding the content of sound) and "where" (localizing the source of sound), in young adults with DS. Speech reception thresholds in quiet and in the presence of interferers provided insight into speech recognition, that is, the "what" aspect of auditory maturation. Insights into "where" aspect of auditory maturation were gained from evaluating speech reception thresholds in colocated versus separated conditions (quantifying spatial release from masking) as well as right versus left discrimination and sound location identification. Auditory functions in the "where" domain develop during earlier stages of cognitive development in contrast with the later developing "what" functions. We hypothesized that young adults with DS would exhibit stronger "where" than "what" auditory functioning, albeit with the potential impact of HL. Considering the importance of auditory working memory and receptive vocabulary for speech recognition, we hypothesized that better speech recognition in young adults with DS, in quiet and with speech interferers, would be associated with better auditory working memory ability and receptive vocabulary., Design: Nineteen young adults with DS (aged 19 to 24 years) participated in the study and completed assessments on pure-tone audiometry, right versus left discrimination, sound location identification, and speech recognition in quiet and with speech interferers that were colocated or spatially separated. Results were compared with published data from children and adults without DS and HL, tested using similar protocols and stimuli. Digit Span tests assessed auditory working memory. Receptive vocabulary was examined using the Peabody Picture Vocabulary Test Fifth Edition., Results: Seven participants (37%) had HL in at least 1 ear; 4 individuals had mild HL, and 3 had moderate HL or worse. Participants with mild or no HL had ≥75% correct at 5° separation on the discrimination task and sound localization root mean square errors (mean ± SD: 8.73° ± 2.63°) within the range of adults in the comparison group. Speech reception thresholds in young adults with DS were higher than all comparison groups. However, spatial release from masking did not differ between young adults with DS and comparison groups. Better (lower) speech reception thresholds were associated with better hearing and better auditory working memory ability. Receptive vocabulary did not predict speech recognition., Conclusions: In the absence of HL, young adults with DS exhibited higher accuracy during spatial hearing tasks as compared with speech recognition tasks. Thus, auditory processes associated with the "where" pathways appear to be a relative strength than those associated with "what" pathways in young adults with DS. Further, both HL and auditory working memory impairments contributed to difficulties in speech recognition in the presence of speech interferers. Future larger-sized samples are needed to replicate and extend our findings., (Copyright © 2024 Wolters Kluwer Health, Inc. All rights reserved.)

Objectives: Evidence continues to emerge of associations between cochlear implant (CI) outcomes and cognitive functions in postlingually deafened adults. While there are multiple factors that appear to affect these associations, the impact of speech recognition background testing conditions (i.e., in quiet versus noise) has not been systematically explored. The two aims of this study were to (1) identify associations between speech recognition following cochlear implantation and performance on cognitive tasks, and to (2) investigate the impact of speech testing in quiet versus noise on these associations. Ultimately, we want to understand the conditions that impact this complex relationship between CI outcomes and cognition., Design: A scoping review following Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines was performed on published literature evaluating the relation between outcomes of cochlear implantation and cognition. The current review evaluates 39 papers that reported associations between over 30 cognitive assessments and speech recognition tests in adult patients with CIs. Six cognitive domains were evaluated: Global Cognition, Inhibition-Concentration, Memory and Learning, Controlled Fluency, Verbal Fluency, and Visuospatial Organization. Meta-analysis was conducted on three cognitive assessments among 12 studies to evaluate relations with speech recognition outcomes. Subgroup analyses were performed to identify whether speech recognition testing in quiet versus in background noise impacted its association with cognitive performance., Results: Significant associations between cognition and speech recognition in a background of quiet or noise were found in 69% of studies. Tests of Global Cognition and Inhibition-Concentration skills resulted in the highest overall frequency of significant associations with speech recognition (45% and 57%, respectively). Despite the modest proportion of significant associations reported, pooling effect sizes across samples through meta-analysis revealed a moderate positive correlation between tests of Global Cognition ( r = +0.37, p < 0.01) as well as Verbal Fluency ( r = +0.44, p < 0.01) and postoperative speech recognition skills. Tests of Memory and Learning are most frequently utilized in the setting of CI (in 26 of 39 included studies), yet meta-analysis revealed nonsignificant associations with speech recognition performance in a background of quiet ( r = +0.30, p = 0.18), and noise ( r = -0.06, p = 0.78)., Conclusions: Background conditions of speech recognition testing may influence the relation between speech recognition outcomes and cognition. The magnitude of this effect of testing conditions on this relationship appears to vary depending on the cognitive construct being assessed. Overall, Global Cognition and Inhibition-Concentration skills are potentially useful in explaining speech recognition skills following cochlear implantation. Future work should continue to evaluate these relations to appropriately unify cognitive testing opportunities in the setting of cochlear implantation., Competing Interests: A.C.M. has received research grant funding from Cochlear Americas for an investigator-initiated project. A.C.M. has been a paid consultant for Cochlear Americas and Advanced Bionics. A.C.M. is Chief Medical Officer and is on the Board of Directors for Otologic Technologies. The other authors have no conflicts of interest to declare., (Copyright © 2024 Wolters Kluwer Health, Inc. All rights reserved.)

Interest in how ageing affects attention is long-standing, although interactions between sensory and attentional processing in older age are not fully understood. Here, we examined interactions between peripheral hearing and selective attention in a spatialised cocktail party listening paradigm, in which three talkers spoke different sentences simultaneously and participants were asked to report the sentence spoken by a talker at a particular location. By comparing a sample of older (N = 61; age = 55-80 years) and younger (N = 58; age = 18-35 years) adults, we show that, as a group, older adults benefit as much as younger adults from preparatory spatial attention. Although, for older adults, this benefit significantly reduces with greater age-related hearing loss. These results demonstrate that older adults with excellent hearing retain the ability to direct spatial selective attention, but this ability deteriorates, in a graded manner, with age-related hearing loss. Thus, reductions in spatial selective attention likely contribute to difficulties communicating in social settings for older adults with age-related hearing loss. Overall, these findings demonstrate a relationship between mild perceptual decline and attention in older age., (© 2024. The Author(s).)