Search

Nasalance is a valuable clinical biomarker for hypernasality. It is computed as the ratio of acoustic energy emitted through the nose to the total energy emitted through the mouth and nose (eNasalance). A new approach is proposed to compute nasalance using Convolutional Neural Networks (CNNs) trained with Mel-Frequency Cepstrum Coefficients (mfccNasalance). mfccNasalance is evaluated by examining its accuracy: 1) when the train and test data are from the same or from different dialects; 2) with test data that differs in dynamicity (e.g. rapidly produced diadochokinetic syllables versus short words); and 3) using multiple CNN configurations (i.e. kernel shape and use of 1 × 1 pointwise convolution). Dual-channel Nasometer speech data from healthy speakers from different dialects: Costa Rica, more(+) nasal, Spain and Chile, less(-) nasal, are recorded. The input to the CNN models were sequences of 39 MFCC vectors computed from 250 ms moving windows. The test data were recorded in Spain and included short words (-dynamic), sentences (+dynamic), and diadochokinetic syllables (+dynamic). The accuracy of a CNN model was defined as the Spearman correlation between the mfccNasalance for that model and the perceptual nasality scores of human experts. In the same-dialect condition, mfccNasalance was more accurate than eNasalance independently of the CNN configuration; using a 1 × 1 kernel resulted in increased accuracy for +dynamic utterances (p < .000), though not for -dynamic utterances. The kernel shape had a significant impact for -dynamic utterances (p < .000) exclusively. In the different-dialect condition, the scores were significantly less accurate than in the same-dialect condition, particularly for Costa Rica trained models. We conclude that mfccNasalance is a flexible and useful alternative to eNasalance. Future studies should explore how to optimize mfccNasalance by selecting the most adequate CNN model as a function of the dynamicity of the target speech data.

Automatic evaluation of hypernasality has been traditionally computed using monophonic signals (i.e., combining nose and mouth signals). Here, this study aimed to examine if nose signals serve to increase the accuracy of hypernasality evaluation. Using a conventional microphone and a Nasometer, we recorded monophonic, mouth, and nose signals. Three main analyses were performed: (1) comparing the spectral distance between oral/nasalized vowels in monophonic, nose, and mouth signals; (2) assessing the accuracy of Deep Neural Network (DNN) models in classifying oral/nasal sounds and vowel/consonant sounds trained with nose, mouth, and monophonic signals; (3) analyzing the correlation between DNN-derived nasality scores and expert-rated hypernasality scores. The distance between oral and nasalized vowels was the highest in the nose signals. Moreover, DNN models trained on nose signals outperformed in nasal/oral classification (accuracy: 0.90), but were slightly less precise in vowel/consonant differentiation (accuracy: 0.86) compared to models trained on other signals. A strong Pearson’s correlation (0.83) was observed between nasality scores from DNNs trained with nose signals and human expert ratings, whereas those trained on mouth signals showed a weaker correlation (0.36). We conclude that mouth signals partially mask the nasality information carried by nose signals. Significance: the accuracy of hypernasality assessment tools may improve by analyzing nose signals.

The acquisition and evolution of speech production, discourse and communication can be negatively impacted by brain malformations. We describe, for the first time, a case of developmental dynamic dysphasia (DDD) in a right-handed adolescent boy (subject D) with cortical malformations involving language-eloquent regions (inferior frontal gyrus) in both the left and the right hemispheres. Language evaluation revealed a markedly reduced verbal output affecting phonemic and semantic fluency, phrase and sentence generation and verbal communication in everyday life. Auditory comprehension, repetition, naming, reading and spelling were relatively preserved, but executive function was impaired. Multimodal neuroimaging showed a malformed cerebral cortex with atypical configuration and placement of white matter tracts bilaterally and abnormal callosal fibers. Dichotic listening showed right hemisphere dominance for language, and functional magnetic resonance imaging (fMRI) additionally revealed dissociated hemispheric language representation with right frontal activation for phonology and bilateral dominance for semantic processing. Moreover, subject D also had congenital mirror movements (CMM), defined as involuntary movements of one side of the body that mirror intentional movements of the other side. Transcranial magnetic stimulation and fMRI during voluntary unimanual (left and right) hand movements showed bilateral motor cortex recruitment and tractography revealed a lack of decussation of bilateral corticospinal tracts. Genetic testing aimed to detect mutations that disrupt the development of commissural tracts correlating with CMM (e.g., Germline DCC mutations) was negative. Overall, our findings suggest that DDD in subject D resulted from the underdevelopment of the left inferior frontal gyrus with limited capacity for plastic reorganization by its homologous counterpart in the right hemisphere. Corpus callosum anomalies probably contributed to hinder interhemispheric connectivity necessary to compensate language and communication deficits after left frontal involvement.

Automatic tools to detect hypernasality have been traditionally designed to analyze sustained vowels exclusively. This is in sharp contrast with clinical recommendations, which consider it necessary to use a variety of utterance types (e.g., repeated syllables, sustained sounds, sentences, etc.) This study explores the feasibility of detecting hypernasality automatically based on speech samples other than sustained vowels. The participants were 39 patients and 39 healthy controls. Six types of utterances were used: counting 1-to-10 and repetition of syllable sequences, sustained consonants, sustained vowel, words and sentences. The recordings were obtained, with the help of a mobile app, from Spain, Chile and Ecuador. Multiple acoustic features were computed from each utterance (e.g., MFCC, formant frequency) After a selection process, the best 20 features served to train different classification algorithms. Accuracy was the highest with syllable sequences and also with some words and sentences. Accuracy increased slightly by training the classifiers with between two and three utterances. However, the best results were obtained by combining the results of multiple classifiers. We conclude that protocols for automatic evaluation of hypernasality should include a variety of utterance types. It seems feasible to detect hypernasality automatically with mobile devices.

Children acquire vowels earlier than consonants, and the former are less vulnerable to speech disorders than the latter. This study explores the hypothesis that a similar contrast exists later in life and that consonants are more vulnerable to ageing than vowels. Data was obtained with two experiments comparing the speech of Younger Adults (YAs) and Middle-aged Adults (MAs). In the first experiment an Automatic Speech Recognition (ASR) system was trained with a balanced corpus of 29 YAs and 27 MAs. The productions of each speaker were obtained in a Spanish language word (W) and non-word (NW) repetition task. The performance of the system was evaluated with the same corpus used for training using a cross validation approach. The ASR system recognized to a similar extent the Ws of both groups of speakers, but it was more successful with the NWs of the YAs than with those of the MAs. Detailed error analysis revealed that the MA speakers scored below the YA speakers for consonants and also for the place and manner of articulation features; the results were almost identical in both groups of speakers for vowels and for the voicing feature. In the second experiment a group of healthy native listeners was asked to recognize isolated syllables presented with background noise. The target speakers were one YA and one MA that had taken part in the first experiment. The results were consistent with those of the ASR experiment: the manner and place of articulation were better recognized, and vowels and voicing were worse recognized, in the YA speaker than in the MA speaker. We conclude that consonant articulation is more vulnerable to ageing than vowel articulation. Future studies should explore whether or not these early and selective changes in articulation accuracy might be caused by changes in speech perception skills (e.g., in auditory temporal processing).

Donepezil (DP), a cognitive-enhancing drug targeting the cholinergic system, combined with massed sentence repetition training augmented and speeded up recovery of speech production deficits in patients with chronic conduction aphasia and extensive left hemisphere infarctions (Berthier et al., 2014). Nevertheless, a still unsettled question is whether such improvements correlate with restorative structural changes in gray matter and white matter pathways mediating speech production. In the present study, we used pharmacological magnetic resonance imaging to study treatment-induced brain changes in gray matter and white matter tracts in a right-handed male with chronic conduction aphasia and a right subcortical lesion (crossed aphasia). A single-patient, open-label multiple-baseline design incorporating two different treatments and two post-treatment evaluations was used. The patient received an initial dose of DP (5 mg/day) which was maintained during 4 weeks and then titrated up to 10 mg/day and administered alone (without aphasia therapy) during 8 weeks (Endpoint 1). Thereafter, the drug was combined with an audiovisual repetition-imitation therapy (Look-Listen-Repeat, LLR) during 3 months (Endpoint 2). Language evaluations, diffusion weighted imaging (DWI), and voxel-based morphometry (VBM) were performed at baseline and at both endpoints in JAM and once in 21 healthy control males. Treatment with DP alone and combined with LLR therapy induced marked improvement in aphasia and communication deficits as well as in selected measures of connected speech production, and phrase repetition. The obtained gains in speech production remained well-above baseline scores even 4 months after ending combined therapy. Longitudinal DWI showed structural plasticity in the right frontal aslant tract and direct segment of the arcuate fasciculus with both interventions. VBM revealed no structural changes in other white matter tracts nor in cortical areas linked by these tracts. In conclusion, cholinergic potentiation alone and combined with a model-based aphasia therapy improved language deficits by promoting structural plastic changes in right white matter tracts.

Foreign accent syndrome (FAS) is a speech disorder that is defined by the emergence of a peculiar manner of articulation and intonation which is perceived as foreign. In most cases of acquired FAS (AFAS) the new accent is secondary to small focal lesions involving components of the bilaterally distributed neural network for speech production. In the past few years FAS has also been described in different psychiatric conditions (conversion disorder, bipolar disorder, schizophrenia) as well as in developmental disorders (specific language impairment, apraxia of speech). In the present study, two adult males, one with atypical phonetic production and the other one with cluttering, reported having developmental FAS (DFAS) since their adolescence. Perceptual analysis by naïve judges could not confirm the presence of foreign accent, possibly due to the mildness of the speech disorder. However, detailed linguistic analysis provided evidence of prosodic and segmental errors previously reported in AFAS cases. Cognitive testing showed reduced communication in activities of daily living and mild deficits related to psychiatric disorders. Psychiatric evaluation revealed long-lasting internalizing disorders (neuroticism, anxiety, obsessive-compulsive disorder, social phobia, depression, alexithymia, hopelessness, and apathy) in both subjects. Diffusion tensor imaging (DTI) data from each subject with DFAS were compared with data from a group of 21 age- and gender-matched healthy control subjects. Diffusion parameters (MD, AD, and RD) in predefined regions of interest showed changes of white matter microstructure in regions previously related with AFAS and psychiatric disorders. In conclusion, the present findings militate against the possibility that these two subjects have FAS of psychogenic origin. Rather, our findings provide evidence that mild DFAS occurring in the context of subtle, yet persistent, developmental speech disorders may be associated with structural brain anomalies. We suggest that the simultaneous involvement of speech and emotion regulation networks might result from disrupted neural organization during development, or compensatory or maladaptive plasticity. Future studies are required to examine whether the interplay between biological trait-like diathesis (shyness, neuroticism) and the stressful experience of living with mild DFAS lead to the development of internalizing psychiatric disorders.

Este estudio analiza el desarrollo de un grupo de 10 niños sordos a los que se ha colocado un implante coclear (IC) antes de los dos años. El objetivo es comprobar en qué medida el desarrollo post-IC se ve afectado por el grado de estimulación temprana recibida. Se obtienen datos de percepción (cuestionario parental), y producción lingüística y prelingüística (vídeos de producción espontánea y cuestionarios). Además, se realizó una valoración del grado de estimulación recibido pre y post-implante. Los resultados muestran grandes diferencias intra-grupo: 1) en el ritmo de desarrollo lingüístico (léxico productivo a los 12 meses de experiencia auditiva); y 2) en el grado de estimulación. El análisis estadístico mostró que el grado de estimulación a los 12 meses es el único factor de los estudiados que correlaciona con el desarrollo lingüístico tras 12 meses. No correlacionan: edad al implantarse, percepción a los tres meses, ni balbuceo canónico. Tales resultados confirman la gran importancia del entorno, y en particular de la familia, en la rehabilitación del niño implantado.

This article is part of a larger project which aims at describing —from a formal semantics perspective— the temporal structure of discourse in Spanish. In this paper we analyse the role that two Spanish tenses —perfecto simple and perfecto compuesto— play in discourse. Using the framework provided by Discourse Representation Theory, we describe the semantics of these two tenses and we propose a representation for both of them. The representation proposed is based on Dowty's extended now theory of the present perfect (English equivalent for Spanish perfecto compuesto). We show that the extended now theory provides a very intuitive way of representing not only perfecto compuesto, but also the perfecto simple and the effect of several adverbials. Finally, we will examine the discourse relations of sentences in which perfecto simple and perfecto compuesto appear.

La mayoría de los estudios centrados en el desarrollo fonológico del niño sordo con implante coclear prelocutivo destacan positivamente la intervención del mismo en la adquisición de los inventarios fonológicos subrayando que esta población adquiere de la misma forma, aunque de modo más lento, tales fonemas. No obstante, se observa un contraste entre el dominio perceptivo y la producción de estas unidades en su contexto sintagmático. En este trabajo abordamos el dominio de dicho inventario fonémico en un grupo de niños sordos con implante coclear prelocutivo y un grupo de niños con desarrollo típico, así como el análisis de los procesos fonológicos más recurrentes entre los que destacan por su atipicidad la inconsistencia y la omisión de todas las consonantes de una palabra. Palabras clave: implante coclear; desarrollo fonológico; inconsistencia; omisión de consonantes.