Interpretable Tongue Constitution Recognition via Reshaped Wavelet Attention
Open Access
- 14 February 2024
- journal article
- research article
- Published by Springer Nature in International Journal of Computational Intelligence Systems
- Vol. 17 (1) , 1-15
Abstract
Currently deep neural networks have been used to perform the tongue constitution recognition, but they are still challenged, failing to extract nice multi-scale and multi-level features. This paper proposes a novel interpretable tongue constitution recognition method based on the reshaped wavelet attention. It separates multi-scale features through discrete wavelet transform and then uses the attention mechanism to weight them. Subsequently, these features are reshaped to the high-dimensional space where the association knowledge of multi-level features are mined and hierarchized so as to fuse them efficiently. Finally, both are integrated into the framework of convolution neural network to generate the more accurate tongue image attributes, by which the tongue constitution recognition is performed. The proposed method not only obtains the higher performance with small cost, but also nicely interprets them. Experimental results show that the proposed method is effective, efficient, and interpretable.Keywords
Funding Information
- National Natural Science Foundation of China (62176095, 62006049)
- Department of Education of Guangdong Province (2022KTSCX068)
- Guangdong Province Introduction of Innovative R &D Team (2020B1111120001)
- Basic and Applied Basic Research Foundation of Guangdong Province (2023A1515010939)
This publication has 62 references indexed in Scilit:
- Wavelet-Attention CNN for image classificationMultimedia Systems, 2022
- Selective Wavelet Attention Learning for Single Image DerainingInternational Journal of Computer Vision, 2021
- Disentangled Non-local Neural Networks2020
- A multimodal deep architecture for traditional Chinese medicine diagnosisConcurrency and Computation: Practice and Experience, 2020
- Transfer learning with deep convolutional neural network for constitution classification with face imageMultimedia Tools and Applications, 2020
- Research on model and algorithm of TCM constitution identification based on artificial intelligenceJournal of Combinatorial Optimization, 2019
- Complexity perception classification method for tongue constitution recognitionArtificial Intelligence in Medicine, 2019
- CBAM: Convolutional Block Attention Module2018
- Natural tongue physique identification using hybrid deep learning methodsMultimedia Tools and Applications, 2018
- Deep Convolutional Neural Networks for Classifying Body Constitution2016