1. The uulmMAC database—A multimodal affective corpus for affective computing in human-computer interaction
- Author
-
Dilana Hazer-Rau, Jennifer Spohrs, Friedhelm Schwenker, Andreas Ewald Daucher, Holger Hoffmann, Sascha Meudt, and Harald C. Traue
- Subjects
Computer science ,frustration ,Emotions ,multimodal sensors ,Frustration ,02 engineering and technology ,computer.software_genre ,lcsh:Chemical technology ,Biochemistry ,Field (computer science) ,Analytical Chemistry ,Machine Learning ,User-Computer Interface ,ddc:150 ,Human–computer interaction ,emotion recognition ,DDC 620 / Engineering & allied operations ,0202 electrical engineering, electronic engineering, information engineering ,Interest ,lcsh:TP1-1185 ,Big Five personality traits ,Dialog box ,affective corpus ,Affective computing ,Instrumentation ,media_common ,DDC 150 / Psychology ,Database ,cognitive load ,05 social sciences ,Atomic and Molecular Physics, and Optics ,Human-computer interaction ,Pattern Recognition, Visual ,020201 artificial intelligence & image processing ,ddc:620 ,Maschinelles Lernen ,Mensch-Maschine-Kommunikation ,interest ,media_common.quotation_subject ,overload ,Stability (learning theory) ,Affect (psychology) ,050105 experimental psychology ,Article ,stress research ,human-computer interaction ,Machine learning ,Humans ,0501 psychology and cognitive sciences ,Quality (business) ,DDC 004 / Data processing & computer science ,Electrical and Electronic Engineering ,affective computing ,underload ,Affective Computing ,Emotion recognition ,ddc:004 ,computer ,Cognitive load - Abstract
In this paper, we present a multimodal dataset for affective computing research acquired in a human-computer interaction (HCI) setting. An experimental mobile and interactive scenario was designed and implemented based on a gamified generic paradigm for the induction of dialog-based HCI relevant emotional and cognitive load states. It consists of six experimental sequences, inducing Interest, Overload, Normal, Easy, Underload, and Frustration. Each sequence is followed by subjective feedbacks to validate the induction, a respiration baseline to level off the physiological reactions, and a summary of results. Further, prior to the experiment, three questionnaires related to emotion regulation (ERQ), emotional control (TEIQue-SF), and personality traits (TIPI) were collected from each subject to evaluate the stability of the induction paradigm. Based on this HCI scenario, the University of Ulm Multimodal Affective Corpus (uulmMAC), consisting of two homogenous samples of 60 participants and 100 recording sessions was generated. We recorded 16 sensor modalities including 4 ×, video, 3 ×, audio, and 7 ×, biophysiological, depth, and pose streams. Further, additional labels and annotations were also collected. After recording, all data were post-processed and checked for technical and signal quality, resulting in the final uulmMAC dataset of 57 subjects and 95 recording sessions. The evaluation of the reported subjective feedbacks shows significant differences between the sequences, well consistent with the induced states, and the analysis of the questionnaires shows stable results. In summary, our uulmMAC database is a valuable contribution for the field of affective computing and multimodal data analysis: Acquired in a mobile interactive scenario close to real HCI, it consists of a large number of subjects and allows transtemporal investigations. Validated via subjective feedbacks and checked for quality issues, it can be used for affective computing and machine learning applications.
- Published
- 2020