Interaction-Based Human Activity Comparison
Authors:
Open Access
- 25 January 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 26 (8) , 2620-2633
Abstract
Traditional methods for motion comparison consider features from individual characters. However, the semantic meaning of many human activities is usually defined by the interaction between them, such as a high-five interaction of two characters. There is little success in adapting interaction-based features in activity comparison, as they either do not have a fixed topology or are in high dimensional. In this paper, we propose a unified framework for activity comparison from the interaction point of view. Our new metric evaluates the similarity of interaction by adapting the Earth Mover's Distance onto a customized geometric mesh structure that represents spatial-temporal interactions. This allows us to compare different classes of interactions and discover their intrinsic semantic similarity. We created five interaction databases of different natures, covering both two-characters (synthetic and real-people) and character-object interactions, which are open for public uses. We demonstrate how the proposed metric aligns well with the semantic meaning of the interaction. We also apply the metric in interaction retrieval and show how it outperforms existing ones. The proposed method can be used for unsupervised activity detection in monitoring systems and activity retrieval in smart animation systems.Keywords
Funding Information
- Engineering and Physical Sciences Research Council (EP/M002632/1)
- Royal Society (IES\R2\181024)
This publication has 39 references indexed in Scilit:
- Topology-based representations for motion planning and generalization in dynamic environments with interactionsThe International Journal of Robotics Research, 2013
- Spatial relationship preserving character motion adaptationACM Transactions on Graphics, 2010
- Character Motion Synthesis by Topology CoordinatesComputer Graphics Forum, 2009
- Interaction patches for multi-character animationACM Transactions on Graphics, 2008
- Emulating human perception of motion similarityComputer Animation and Virtual Worlds, 2008
- Motion patchesACM Transactions on Graphics, 2006
- A data-driven approach to quantifying natural human motionACM Transactions on Graphics, 2005
- Action synopsisACM Transactions on Graphics, 2005
- Automated extraction and parameterization of motions in large data setsACM Transactions on Graphics, 2004
- Interactive control of avatars animated with human motion dataACM Transactions on Graphics, 2002