Pair-Activity Analysis From Video Using Qualitative Trajectory Calculus
- 8 May 2017
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 28 (8) , 1850-1863
Abstract
The automated analysis of interacting objects or people from video has many uses, including the recognition of activities, and identification of prototypical or unusual behaviors. Existing techniques generally use temporal sequences of quantifiable real-valued features, such as object position or orientation; however, more recently, qualitative representations have been proposed. In this paper we present a novel and robust qualitative method which can be used both for classification and clustering of pair-activities. We use Qualitative Trajectory Calculus (QTC) to represent the relative motion between two objects, and encodes their interactions as a trajectory of QTC states. A key element is a general and robust means of determining the sequence similarity, which we term Normalized Weighted Sequence Alignment; we show that this is an effective metric for both recognition and clustering problems. We have evaluated our method across three different datasets, and shown that it out-performs state of the art quantitative methods, achieving an error rate of no more than 4.1% for recognition, and cluster purities higher than 90%. Our motivation originates from an interest in automated analysis of animal behaviors, and we present a comprehensive video dataset of fish behaviors (Gasterosteus aculeatus), collected from lab-based experiments.Keywords
This publication has 39 references indexed in Scilit:
- Recognizing pair-activities by causality analysisACM Transactions on Intelligent Systems and Technology, 2011
- Sequence Alignment as a Method for Human Activity Analysis in Space and TimeAnnals of the American Association of Geographers, 2007
- Tracking tourists in the digital ageAnnals of Tourism Research, 2007
- Clustering of time series data—a surveyPattern Recognition, 2005
- Discovering relative motion patterns in groups of moving point objectsInternational Journal of Geographical Information Science, 2005
- Qualitative spatial reasoning: cardinal directions as an exampleInternational Journal of Geographical Information Science, 1996
- Time Series Analysis by Projection. I. Statistical Properties of Fourier AnalysisThe Astronomical Journal, 1996
- Sequence Analysis: New Methods for Old IdeasAnnual Review of Sociology, 1995
- A vector space model for automatic indexingCommunications of the ACM, 1975
- A general method applicable to the search for similarities in the amino acid sequence of two proteinsJournal of Molecular Biology, 1970