Detecting, tracking and interacting with people in a public space
Authors:
Open Access
- 2 November 2009
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 79-86
Abstract
We have built a system that engages naive users in an audio-visual interaction with a computer in an unconstrained public space. We combine audio source localization techniques with face detection algorithms to detect and track the user throughout a large lobby. The sensors we use are an ad-hoc microphone array and a PTZ camera. To engage the user, the PTZ camera turns and points at sounds made by people passing by. From this simple pointing of a camera, the user is made aware that the system has acknowledged their presence. To further engage the user, we develop a face classification method that identifies and then greets previously seen users. The user can interact with the system through a simple hot-spot based gesture interface. To make the user interactions with the system feel natural, we utilize reconfigurable hardware, achieving a visual response time of less than 100ms. We rely heavily on machine learning methods to make our system self-calibrating and adaptive.Keywords
This publication has 14 references indexed in Scilit:
- Random projection trees and low dimensional manifolds2008
- A joint particle filter for audio-visual speaker tracking2005
- Histograms of Oriented Gradients for Human Detection2005
- Hotspot Components for Gesture-Based Interaction2005
- Joint Audio-Visual Tracking Using Particle FiltersEURASIP Journal on Advances in Signal Processing, 2002
- A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian trackingIEEE Transactions on Signal Processing, 2002
- Looking at people: sensing for ubiquitous and wearable computingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Computer vision for computer interactionACM SIGGRAPH Computer Graphics, 1999
- Eigenfaces for RecognitionJournal of Cognitive Neuroscience, 1991
- Low-dimensional procedure for the characterization of human facesJournal of the Optical Society of America A, 1987