Back to Search Start Over

Learning metrics on spectrotemporal modulations reveals the perception of musical instrument timbre

Authors :
Stephen McAdams
Philippe Depalle
Baptiste Caramiaux
Etienne Thoret
Perception, Représentations, Image, Son, Musique (PRISM)
Aix Marseille Université (AMU)-Centre National de la Recherche Scientifique (CNRS)
éQuipe d'AppRentissage de MArseille (QARMA)
Laboratoire d'Informatique et Systèmes (LIS)
Aix Marseille Université (AMU)-Université de Toulon (UTLN)-Centre National de la Recherche Scientifique (CNRS)-Aix Marseille Université (AMU)-Université de Toulon (UTLN)-Centre National de la Recherche Scientifique (CNRS)
Schulich School of Music [Montréal]
McGill University = Université McGill [Montréal, Canada]
Extreme Interaction (EX-SITU)
Inria Saclay - Ile de France
Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)-Laboratoire de Recherche en Informatique (LRI)
CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)-CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)
Laboratoire de Recherche en Informatique (LRI)
CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS)
ANR-16-CONV-0002,ILCB,ILCB: Institute of Language Communication and the Brain(2016)
ANR-11-IDEX-0001,Amidex,INITIATIVE D'EXCELLENCE AIX MARSEILLE UNIVERSITE(2011)
Source :
Nature Human Behaviour, Nature Human Behaviour, 2020, ⟨10.1038/s41562-020-00987-5⟩, Nature Human Behaviour, Nature Research 2020, ⟨10.1038/s41562-020-00987-5⟩
Publication Year :
2020
Publisher :
HAL CCSD, 2020.

Abstract

International audience; Humans excel at using sounds to make judgements about their immediate environment. In particular, timbre is an auditory attribute that conveys crucial information about the identity of a sound source, especially for music. While timbre has been primarily considered to occupy a multidimensional space, unravelling the acoustic correlates of timbre remains a challenge. Here we re-analyse 17 datasets from published studies between 1977 and 2016 and observe that original results are only partially replicable. We use a data-driven computational account to reveal the acoustic correlates of timbre. Human dissimilarity ratings are simulated with metrics learned on acoustic spectrotemporal modulation models inspired by cortical processing. We observe that timbre has both generic and experiment-specific acoustic correlates. These findings provide a broad overview of former studies on musical timbre and identify its relevant acoustic substrates according to biologically inspired models.

Details

Language :
English
ISSN :
23973374
Database :
OpenAIRE
Journal :
Nature Human Behaviour, Nature Human Behaviour, 2020, ⟨10.1038/s41562-020-00987-5⟩, Nature Human Behaviour, Nature Research 2020, ⟨10.1038/s41562-020-00987-5⟩
Accession number :
edsair.doi.dedup.....3b31639c0f3fdc79f9882a28db8333cb
Full Text :
https://doi.org/10.1038/s41562-020-00987-5⟩