Learning visual models of social engagement
Authors:
- T.E. StarnerTST.E. Starner
- 13 November 2002
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 15301044,p. 141-148
Abstract
We introduce a face detector for wearable computers that exploits constraints in face scale and orientation imposed by the proximity of participants in near social interactions. Using this method we describe a wearable system that perceives "social engagement," i.e., when the wearer begins to interact with other individuals. Our experimental system proved >90% accurate when tested on wearable video data captured at a professional conference. Over 300 individuals were captured during social engagement, and the data was separated into independent training and test sets. A metric for balancing the performance of face detection, localization, and recognition in the context of a wearable interface is discussed. Recognizing social engagement with a user's wearable computer provides context data that can be useful in determining when the user is interruptible. In addition, social engagement detection may be incorporated into a user interface to improve the quality of mobile face recognition software. For example, the user may cue the face recognition system in a socially graceful way by turning slightly away and then toward a speaker when conditions for recognition are favorable.Keywords
This publication has 22 references indexed in Scilit:
- A fast and accurate face detector based on neural networksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- Humanoid robots: a new kind of toolIEEE Intelligent Systems and their Applications, 2000
- Social constraints on animate visionIEEE Intelligent Systems and their Applications, 2000
- Physics-based face database for color researchJournal of Electronic Imaging, 2000
- Looking at people: sensing for ubiquitous and wearable computingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Real-time American sign language recognition using desk and wearable computer based videoIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998
- Neural network-based face detectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998
- Example-based learning for view-based human face detectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998
- Face recognition: the problem of compensating for changes in illumination directionIEEE Transactions on Pattern Analysis and Machine Intelligence, 1997
- The face of interestMotivation and Emotion, 1993