Discriminative Exemplar Coding for Sign Language Recognition With Kinect
Authors:
- 19 June 2013
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 43 (5) , 1418-1428
Abstract
Sign language recognition is a growing research area in the field of computer vision. A challenge within it is to model various signs, varying with time resolution, visual manual appearance, and so on. In this paper, we propose a discriminative exemplar coding (DEC) approach, as well as utilizing Kinect sensor, to model various signs. The proposed DEC method can be summarized as three steps. First, a quantity of class-specific candidate exemplars are learned from sign language videos in each sign category by considering their discrimination. Then, every video of all signs is described as a set of similarities between frames within it and the candidate exemplars. Instead of simply using a heuristic distance measure, the similarities are decided by a set of exemplar-based classifiers through the multiple instance learning, in which a positive (or negative) video is treated as a positive (or negative) bag and those frames similar to the given exemplar in Euclidean space as instances. Finally, we formulate the selection of the most discriminative exemplars into a framework and simultaneously produce a sign video classifier to recognize sign. To evaluate our method, we collect an American sign language dataset, which includes approximately 2000 phrases, while each phrase is captured by Kinect sensor with color, depth, and skeleton information. Experimental results on our dataset demonstrate the feasibility and effectiveness of the proposed approach for sign language recognition.Keywords
This publication has 26 references indexed in Scilit:
- Enhanced Computer Vision With Microsoft Kinect Sensor: A ReviewIEEE Transactions on Cybernetics, 2013
- Microsoft Kinect Sensor and Its EffectIEEE MultiMedia, 2012
- Inductive Robust Principal Component AnalysisIEEE Transactions on Image Processing, 2012
- Locality-constrained Linear Coding for image classification2010
- Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories2006
- Histograms of Oriented Gradients for Human Detection2005
- A new instrumented approach for translating American Sign Language into sound and text2004
- Estimating 3D hand pose from a cluttered image2003
- Probabilistic tracking in a metric space2002
- Support-vector networksMachine Learning, 1995