A Collaborative Filtering Approach to Real-Time Hand Pose Estimation
Authors:
- Chiho ChoiCCChiho Choi
- Ayan SinhaASAyan Sinha
- Joon Hee ChoiJCJoon Hee Choi
- Sujin JangSJSujin Jang
- Karthik RamaniKRKarthik Ramani
- 1 December 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 2336-2344
Abstract
Collaborative filtering aims to predict unknown user ratings in a recommender system by collectively assessing known user preferences. In this paper, we first draw analogies between collaborative filtering and the pose estimation problem. Specifically, we recast the hand pose estimation problem as the cold-start problem for a new user with unknown item ratings in a recommender system. Inspired by fast and accurate matrix factorization techniques for collaborative filtering, we develop a real-time algorithm for estimating the hand pose from RGB-D data of a commercial depth camera. First, we efficiently identify nearest neighbors using local shape descriptors in the RGB-D domain from a library of hand poses with known pose parameter values. We then use this information to evaluate the unknown pose parameters using a joint matrix factorization and completion (JMFC) approach. Our quantitative and qualitative results suggest that our approach is robust to variation in hand configurations while achieving real time performance (≈ 29 FPS) on a standard computer.Keywords
This publication has 27 references indexed in Scilit:
- A literature review and classification of recommender systems researchExpert Systems with Applications, 2012
- Learning preferences of new users in recommender systemsACM SIGKDD Explorations Newsletter, 2008
- Vision-based hand pose estimation: A reviewComputer Vision and Image Understanding, 2007
- Direct visibility of point setsACM Transactions on Graphics, 2007
- Model-based analysis of hand postureIEEE Computer Graphics and Applications, 1995
- Human memory: An adaptive perspective.Psychological Review, 1989
- Locally Weighted Regression: An Approach to Regression Analysis by Local FittingJournal of the American Statistical Association, 1988
- Topological structural analysis of digitized binary images by border followingComputer Vision, Graphics, and Image Processing, 1985
- A fast two-dimensional median filtering algorithmIEEE Transactions on Acoustics, Speech, and Signal Processing, 1979
- Multidimensional binary search trees used for associative searchingCommunications of the ACM, 1975