Toward emotion indexing of multimedia excerpts
- 1 January 2008
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 19493983,p. 425-432
Abstract
Multimedia indexing is about developing techniques allowing people to effectively find media. Content-based methods become necessary when dealing with large databases. Current technology allows exploring the emotional space which is known to carry very interesting semantic information. In this paper we state the need for an integrated method which extracts reliable affective information and attaches this semantic information to the medium itself. We describe SAMMI [1], a framework explicitly designed to fulfill this need and we present a list of possible applications pointing out the advantages that the emotional information can bring about. Finally, different scenarios are considered for the recognition of the emotions which involve different modalities, feature sets, fusion algorithms, and result optimization methods such as temporal averaging or thresholding.Keywords
This publication has 9 references indexed in Scilit:
- Analysis of vector space model and spatiotemporal segmentation for video indexing and retrieval2007
- Content-based multimedia information retrievalACM Transactions on Multimedia Computing, Communications, and Applications, 2006
- The eNTERFACE’05 Audio-Visual Emotion Database2006
- Affect-based indexing and retrieval of films2005
- Generation of views of TV content using TV viewers' perspectives expressed in live chats on the web2005
- Emotion-based music recommendation by association discovery from film music2005
- Analysis of emotion recognition using facial expressions, speech and multimodal information2004
- Extracting information about emotions in films2003
- Toward an affect-sensitive multimodal human-computer interactionProceedings of the IEEE, 2003