Acoustic and visual signal based context awareness system for mobile application
Authors:
- 22 July 2011
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Consumer Electronics
- Vol. 57 (2) , 738-746
Abstract
In this paper, an acoustic and visual signal based context awareness system is proposed for a mobile application. In particular multimodal system is designed that can sense and determine, in real-time, user contextual information, such as where the user is or what the user does, by processing acoustic and visual signals from the suitable sensors available in a mobile device. A variety of contextual information, such as babble sound in cafeteria, user¿s movement, and etc., can be recognized by the proposed acoustic and visual feature extraction and classification methods. We first describe the overall structure of the proposed system and then the algorithm for each module performing detection or classification of various contextual scenarios is presented. Representative experiments demonstrate the superiority of the proposed system while the actual implementation of the proposed scheme into mobile device such as a smart-phone confirms the effectiveness and realization of the proposed system.Keywords
This publication has 9 references indexed in Scilit:
- Learning Multi-scale Block Local Binary Patterns for Face Recognition2007
- Comparison of Sequence Discriminant Support Vector Machines for Acoustic Event Classification2006
- Acoustic environment classificationACM Transactions on Speech and Language Processing, 2006
- Human skin color clustering for face detection2004
- Environmental Noise Classification for Context-Aware ApplicationsLecture Notes in Computer Science, 2003
- Indoor-outdoor image classification2002
- Automatic classification of environmental noise events by hidden Markov models2002
- A phase-based approach to the estimation of the optical flow field using spatial filteringIEEE Transactions on Neural Networks, 2002
- Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentencesIEEE Transactions on Acoustics, Speech, and Signal Processing, 1980