Multimodal observation systems
Authors:
Open Access
- 26 October 2008
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 933-936
Abstract
In recent years, we have seen a significant research interest in a number of multimodal sensing applications like surveillance, video ethnography, tele-presence, assisted living, life blogging etc. However, these applications are currently evolving as separate silos with no interconnection. Further, the individual application-centric architectures typically tend to focus on specific sensors, specific (hardwired) queries and deal with specific environments. We present a generic sensing architecture 'Observation System', which allows multiple users to undertake different applications through abstracted interaction with a common set of sensors. The observation system observes behavior of various objects in an environment and keeps a record of important events and activities in an eventbase. In this system, multifarious data collected from disparate sensors and other sources are correlated to understand and gain insights in the environment. The observation system has applications in many areas including but not limited to surveillance, traffic monitoring, ethnography, marketing, and healthcare. In this paper, we present the architecture and functionality of such a system and present details of activity detection using multiple sensor streams in a distributed sensing environment. We also present results of such an approach and potential extensions to the analysis of more complex activities and events.Keywords
This publication has 8 references indexed in Scilit:
- S3: The IBM Smart Surveillance System: From Transactional Systems to Observational Systems2007
- Multi-modal emotive computing in a smart house environmentPervasive and Mobile Computing, 2007
- {\rm E} - A Generic Event Model for Event-Centric Multimedia Data Management in eChronicle Applications2006
- Video blogging: content to the maxIEEE MultiMedia, 2005
- A Database Model for Querying Visual Surveillance Videos by Integrating Semantic and Low-Level FeaturesLecture Notes in Computer Science, 2005
- Intelligent distributed surveillance systems: a reviewIEE Proceedings - Vision, Image, and Signal Processing, 2005
- Experiential meeting system2003
- A Language for Content-Based Video RetrievalMultimedia Tools and Applications, 1998