Back to Search Start Over

Implementing machine learning techniques for continuous emotion prediction from uniformly segmented voice recordings.

Authors :
Diemerling, Hannes
Stresemann, Leonie
Braun, Tina
von Oertzen, Timo
Source :
Frontiers in Psychology; 2024, p1-16, 16p
Publication Year :
2024

Abstract

Introduction: Emotional recognition from audio recordings is a rapidly advancing field, with significant implications for artificial intelligence and human-computer interaction. This study introduces a novel method for detecting emotions fromshort, 1.5 s audio samples, aiming to improve accuracy and efficiency in emotion recognition technologies. Methods: We utilized 1,510 unique audio samples from two databases in German and English to train our models. We extracted various features for emotion prediction, employing Deep Neural Networks (DNN) for general feature analysis, Convolutional Neural Networks (CNN) for spectrogram analysis, and a hybrid model combining both approaches (C-DNN). The study addressed challenges associated with dataset heterogeneity, language differences, and the complexities of audio sample trimming. Results: Our models demonstrated accuracy significantly surpassing random guessing, aligning closely with human evaluative benchmarks. This indicates the effectiveness of our approach in recognizing emotional states from brief audio clips. Discussion: Despite the challenges of integrating diverse datasets and managing short audio samples, our findings suggest considerable potential for this methodology in real-time emotion detection from continuous speech. This could contribute to improving the emotional intelligence of AI and its applications in various areas. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
16641078
Database :
Complementary Index
Journal :
Frontiers in Psychology
Publication Type :
Academic Journal
Accession number :
176487478
Full Text :
https://doi.org/10.3389/fpsyg.2024.1300996