1. Active listening.
- Author
-
Friston, Karl J., Sajid, Noor, Quiroga-Martinez, David Ricardo, Parr, Thomas, Price, Cathy J., and Holmes, Emma
- Subjects
- *
ACTIVE listening , *PROSODIC analysis (Linguistics) , *SPEECH perception , *PREDICTIVE validity , *TEST validity - Abstract
This paper introduces active listening, as a unified framework for synthesising and recognising speech. The notion of active listening inherits from active inference, which considers perception and action under one universal imperative: to maximise the evidence for our (generative) models of the world. First, we describe a generative model of spoken words that simulates (i) how discrete lexical, prosodic, and speaker attributes give rise to continuous acoustic signals; and conversely (ii) how continuous acoustic signals are recognised as words. The 'active' aspect involves (covertly) segmenting spoken sentences and borrows ideas from active vision. It casts speech segmentation as the selection of internal actions, corresponding to the placement of word boundaries. Practically, word boundaries are selected that maximise the evidence for an internal model of how individual words are generated. We establish face validity by simulating speech recognition and showing how the inferred content of a sentence depends on prior beliefs and background noise. Finally, we consider predictive validity by associating neuronal or physiological responses, such as the mismatch negativity and P300, with belief updating under active listening, which is greatest in the absence of accurate prior beliefs about what will be heard next. • Describes a generative model for synthesising and recognising speech. • Considers speech segmentation (placing word boundaries) as an active process. • Treats speech segmentation and lexical inferences as complementary. • Associates neural mismatch responses (e.g., MMN) with belief updating. [ABSTRACT FROM AUTHOR]
- Published
- 2021
- Full Text
- View/download PDF