Modeling naturalistic affective states via facial, vocal, and bodily expressions recognition

Karpouzis, K; Caridakis, G; Kessous, L; Amir, N; Raouzaiou, A; Malatesta, L; Kollias, S

dc.contributor.author	Karpouzis, K	en
dc.contributor.author	Caridakis, G	en
dc.contributor.author	Kessous, L	en
dc.contributor.author	Amir, N	en
dc.contributor.author	Raouzaiou, A	en
dc.contributor.author	Malatesta, L	en
dc.contributor.author	Kollias, S	en
dc.date.accessioned	2014-03-01T02:44:50Z
dc.date.available	2014-03-01T02:44:50Z
dc.date.issued	2007	en
dc.identifier.issn	03029743	en
dc.identifier.uri	https://dspace.lib.ntua.gr/xmlui/handle/123456789/31968
dc.subject	Affective interaction	en
dc.subject	Facial expressions	en
dc.subject	Hand gestures	en
dc.subject	Multimodal analysis	en
dc.subject	Neural networks	en
dc.subject	Prosody	en
dc.subject.other	Artificial intelligence	en
dc.subject.other	Feedback	en
dc.subject.other	Imaging techniques	en
dc.subject.other	Photography	en
dc.subject.other	Speech recognition	en
dc.subject.other	State feedback	en
dc.subject.other	Video recording	en
dc.subject.other	Affective interaction	en
dc.subject.other	Affective states	en
dc.subject.other	Audio-visual material	en
dc.subject.other	Dimensional representation	en
dc.subject.other	Dynamic approach	en
dc.subject.other	Dynamic events	en
dc.subject.other	Emotional states	en
dc.subject.other	Facial expressions	en
dc.subject.other	Hand gestures	en
dc.subject.other	Human computing	en
dc.subject.other	Human-centered computing	en
dc.subject.other	Human-machine interaction	en
dc.subject.other	Hyderabad , India	en
dc.subject.other	International workshops	en
dc.subject.other	Joint conference	en
dc.subject.other	Multimodal analysis	en
dc.subject.other	Multimodal inputs	en
dc.subject.other	Neural networks	en
dc.subject.other	Prosody	en
dc.subject.other	Prosody information	en
dc.subject.other	Real-world situations	en
dc.subject.other	Simple recurrent network	en
dc.subject.other	Variations of	en
dc.subject.other	Video sequencing	en
dc.subject.other	Human computer interaction	en
dc.title	Modeling naturalistic affective states via facial, vocal, and bodily expressions recognition	en
heal.type	conferenceItem	en
heal.identifier.primary	10.1007/978-3-540-72348-6_5	en
heal.identifier.secondary	http://dx.doi.org/10.1007/978-3-540-72348-6_5	en
heal.publicationDate	2007	en
heal.abstract	Affective and human-centered computing have attracted a lot of attention during the past years, mainly due to the abundance of devices and environments able to exploit multimodal input from the part of the users and adapt their functionality to their preferences or individual habits. In the quest to receive feedback from the users in an unobtrusive manner, the combination of facial and hand gestures with prosody information allows us to infer the users' emotional state, relying on the best performing modality in cases where one modality suffers from noise or bad sensing conditions. In this paper, we describe a multi-cue, dynamic approach to detect emotion in naturalistic video sequences. Contrary to strictly controlled recording conditions of audiovisual material, the proposed approach focuses on sequences taken from nearly real world situations. Recognition is performed via a 'Simple Recurrent Network' which lends itself well to modeling dynamic events in both user's facial expressions and speech. Moreover this approach differs from existing work in that it models user expressivity using a dimensional representation of activation and valence, instead of detecting discrete 'universal emotions', which are scarce in everyday human-machine interaction. The algorithm is deployed on an audiovisual database which was recorded simulating human-human discourse and, therefore, contains less extreme expressivity and subtle variations of a number of emotion labels. © 2007 Springer-Verlag Berlin Heidelberg.	en
heal.journalName	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)	en
dc.identifier.doi	10.1007/978-3-540-72348-6_5	en
dc.identifier.volume	4451 LNAI	en
dc.identifier.spage	91	en
dc.identifier.epage	112	en