Lip Reading using Video and Thermal Images
- 1 January 2006
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 5011-5015
Abstract
This paper describes the lip reading method using video and thermal images. We pay attention to the lip movement. The density of the thermal image expresses the surface temperature, and it is difficult to detect the lip position automatically. Though the video and the thermal images take in the same time, these don't synchronized in time and spatially. Then the time matching and the spatial matching process are applied. Next, a lip region is detected from the video image, and a lip region of the thermal image is detected corresponding to the video region. Finally, the eigenimage waveform is computed, and DP matching is applied. Experiments were conducted for 75 scenes (five words of three subjects). A successful recognition rate of 76.0% with the video image, 44.0% with the thermal image, and 80.0% with both images were obtained. Experimental results show the recognition rate was improves by combining with the video and the thermal imagesKeywords
This publication has 6 references indexed in Scilit:
- Automatic Feature Localization in Thermal Images for Facial Expression Recognition2006
- Illumination invariant face recognition using thermal infrared imagery2005
- Lipreading method using color extraction method and eigenspace techniqueSystems and Computers in Japan, 2004
- Face recognition using temporal image sequence2002
- Real-time estimation of human body posture from monocular thermal images2002
- Automatic Judgement of Human Living States with Thermal ImageTransactions of the Society of Instrument and Control Engineers, 1997