Lipreading by Locality Discriminant Graph
- 1 January 2007
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 3 (15224880) , III - 325-325
Abstract
The major problem in building a good lipreading system is to extract effective visual features from the enormous quantity of video sequences data. For appearance-based feature analysis in lipreading, classical methods, e.g. DCT, PCA and LDA, are usually applied to dimensionality reduction. We present a new pattern classification algorithm, called locality discriminant graph (LDG), and develop a novel lipreading framework to successfully apply LDG to the problem. LDG takes the advantages of both manifold learning and Fisher criteria to seek the linear embedding which preserves the local neighborhood affinity within same class while discriminating the neighborhood among different classes. The LDG embedding is computed in closed-form and tuned by the only open parameter of k-NN number. Experiments on AVICAR corpus provide evidence that the graph-based pattern classification methods can outperform classical ones for lipreading.Keywords
This publication has 11 references indexed in Scilit:
- Data Fusion and Multicue Data Matching by Diffusion MapsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2006
- Recent advances in the automatic recognition of audiovisual speechProceedings of the IEEE, 2003
- Laplacian Eigenmaps for Dimensionality Reduction and Data RepresentationNeural Computation, 2003
- Dynamic Bayesian Networks for Audio-Visual Speech RecognitionEURASIP Journal on Advances in Signal Processing, 2002
- An image transform approach for HMM based automatic lipreading2002
- Extraction of visual features for lipreadingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- PCA versus LDAIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- A Global Geometric Framework for Nonlinear Dimensionality ReductionScience, 2000
- An Introduction to the Application of the Theory of Probabilistic Functions of a Markov Process to Automatic Speech RecognitionBell System Technical Journal, 1983
- Auditory-Visual Perception of SpeechJournal of Speech and Hearing Disorders, 1975