Tongue Coating Grading Identification Using Deep Learning for Hyperspectral Imaging Data
Authors:
Open Access
- 25 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 93151-93159
Abstract
Tongue diagnosis is one of the four diagnostic methods of traditional Chinese medicine (TCM), which has important value in clinical disease diagnosis and efficacy evaluation. The change in tongue coating is a comprehensive cause of multi-dimensional changes such as color, texture, and substance. However, the color tongue image contains less spectral information, which may lead to the lack of key information in tongue diagnosis. Hyperspectral images can obtain reflection information of tongue images in hundreds of spectral bands. Unlike traditional color images, the rich spectral information can more accurately and sensitively describe and classify tongue coating, and has been widely applied in biomedical images. In this paper, we conducted feature extraction and analysis on hyperspectral images of different tongue coatings, and proposed a spectral-spatial feature deep learning framework to classification and quantitative recognition the tongue coating based on hyperspectral image features. Firstly, 360 hyperspectral images of tongue body were collected, and clinicians were identify all tongue coatings and divided them into 6 different grades. The hyperspectral features of each tongue coating area were extracted respectively. In order to reduce noise interference, singular spectrum analysis was used to preprocess the hyperspectral curve features. Considering the actual situation of tongue coating, a depth learning model was established to analyze the spectral and spatial feature of the hyperspectral tongue image to identified the grading of tongue coating. The experimental results showed that tongue coating with different quantization levels had different hyperspectral features, and the recognition rate of tongue coating quantization level can reach 87.21% using the spatial-spectral features.Keywords
Funding Information
- Joint Innovation Foundation of Xin-Huangpu Joint Innovation Institute of Chinese Medicine (2022IR024)
- National Natural Science Foundation of China (82205316)
- Tianjin Key Fields of Traditional Chinese Medicine Science and Technology Project (2021002)
This publication has 46 references indexed in Scilit:
- Hyperspectral Face Recognition With Spatiospectral Information Fusion and PLS RegressionIEEE Transactions on Image Processing, 2015
- Classification of hyperspectral image based on deep belief networks2014
- Parameter Selection Based on Support Vector Machines for Tongue Spectral Identification ModelApplied Mechanics and Materials, 2014
- Deep Learning-Based Classification of Hyperspectral DataIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2014
- On the Optimal Parameters for Reconstruction and Forecasting in Singular Spectrum AnalysisCommunications in Statistics - Simulation and Computation, 2013
- Early detection of disease-oriented state from hyperspectral tongue images with principal component analysis and vector rotation2010
- Singular spectrum analysis for image processingStatistics and Its Interface, 2010
- Tongue color analysis and discrimination based on hyperspectral imagesComputerized Medical Imaging and Graphics, 2009
- A novel hyperspectral medical sensor for tongue diagnosisSensor Review, 2007
- Spectral imaging: Principles and applicationsCytometry Part A, 2006