Fusion of Multichannel Biosignals Towards Automatic Emotion Recognition

Jonghwa Kim and Elisabeth André

erschienen 2009 "Multisensor Fusion and Integration for Intelligent System", "Lecture Notes in Electrical Engineering", Volume 35, Pages 55 - 68

Verlag: Springer

ISBN: 978-3-540-89859-7 DOI:


Endowing the computer with the ability to recognize human emotional states is the most important prerequisites for realizing an affect-sensitive human-computer interaction. In this paper, we deal with all the essential stages of an automatic emotion recognition system using multichannel physiological measures, from data collection to the classification process. Particularly we develop two different classification methods, feature-level fusion and emotion-specific classification scheme. Four-channel biosensors were used to measure electromyogram, electrocardiogram, skin conductivity, and respiration changes while subjects were listening to music. A wide range of physiological features from various analysis domains is proposed to correlate them with emotional states. Classification of four musical emotions is performed by using feature-level fusion combined with an extended linear discriminant analysis (pLDA). Furthermore, by exploiting a dichotomic property of the 2D emotion model, we developed a novel scheme of emotion-specific multilevel dichotomous classification (EMDC) and compare its performance with direct multiclass classification using the pLDA feature-level fusion. Improved recognition accuracy of 95% and 70% for subject-dependent and subject-independent classification, respectively, is achieved by using the EMDC scheme.


  • BibTeX  -  (BibTeX.txt, 0 KB)