1. Sleep deprivation measured by voice analysis
- Author
-
Etienne Thoret, Thomas Andrillon, Caroline Gauriau, Damien Léger, Daniel Pressnitzer, Perception, Représentations, Image, Son, Musique (PRISM), Aix Marseille Université (AMU)-Centre National de la Recherche Scientifique (CNRS), Laboratoire des systèmes perceptifs (LSP), Département d'Etudes Cognitives - ENS Paris (DEC), École normale supérieure - Paris (ENS-PSL), Université Paris sciences et lettres (PSL)-Université Paris sciences et lettres (PSL)-École normale supérieure - Paris (ENS-PSL), Université Paris sciences et lettres (PSL)-Université Paris sciences et lettres (PSL)-Centre National de la Recherche Scientifique (CNRS), Laboratoire d'Informatique et Systèmes (LIS), Aix Marseille Université (AMU)-Université de Toulon (UTLN)-Centre National de la Recherche Scientifique (CNRS), Institute of Language, Communication and the Brain (ILCB), T000362/2018-L, ANR-16-CONV-0002,ILCB,ILCB: Institute of Language Communication and the Brain(2016), ANR-11-LABX-0036,BLRI,Brain & LANGUAGE Research Institute(2011), ANR-11-IDEX-0001,Amidex,INITIATIVE D'EXCELLENCE AIX MARSEILLE UNIVERSITE(2011), ANR-19-CE28-0019,AMBISENSE,Accès à l'ambiguïté perceptive: mesures comportementales, métacognitives et physiologiques de la perception en situation d'incertitude(2019), and ANR-17-EURE-0017,FrontCog,Frontières en cognition(2017)
- Subjects
[SDV.NEU.PC]Life Sciences [q-bio]/Neurons and Cognition [q-bio.NC]/Psychology and behavior ,[SCCO.PSYC]Cognitive science/Psychology ,[INFO.INFO-SD]Computer Science [cs]/Sound [cs.SD] ,[SDV.MHEP.PHY]Life Sciences [q-bio]/Human health and pathology/Tissues and Organs [q-bio.TO] ,[SHS.PSY]Humanities and Social Sciences/Psychology ,[PHYS.MECA.ACOU]Physics [physics]/Mechanics [physics]/Acoustics [physics.class-ph] ,[INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI] - Abstract
We show that sleep deprivation in otherwise normal and healthy adults can be detected through machine-learning analysis of vocal recordings. Importantly, we used fully generic acoustic features, derived from auditory models, together with our own machine learning interpretation method, derived from neuroscience. Sleep deprivation impacted two broad types of acoustic features: one related to speech rhythms, the other related to the timbre of the voice. Such features plausibly reflect two independent physiological processes: one explicit, the cognitive control of speech production, and the other implicit, the inflammation of the vocal apparatus. Crucially, the relative balance of the two processes varied widely across individuals, consistent with the known but unexplained variability in responses to sleep deprivation. Overall, our results suggest that the voice may be used as a “sleep stethoscope” to characterize the individual effects of sleep deprivation. Moreover, the method we applied is fully general and could be adapted to any future investigation of vocal biomarkers using machine-learning techniques.Author summarySleep deprivation has an ever-increasing impact on individuals and societies, from accidents to chronic conditions costing billions to health systems. Yet, to date, there is no quick and objective test for sleep deprivation. We show that sleep deprivation can be detected at the individual level with voice recordings, outlining future cost-effective and non-invasive “sleep stethoscopes”. Importantly, we focused on interpretability, which identified two independent physiological effects of sleep deprivation: a change in prosody, related to cognitive control, and a change in timbre, related to inflammation. This also revealed a striking variability in individual reactions to the same deprivation. The neuroscientific framework we developed, combining auditory models and machine learning, is freely available and could be adapted to any vocal biomarker.
- Published
- 2022
- Full Text
- View/download PDF