FS3DCIoT: A Few-Shot Incremental Learning Network for Skin Disease Differential Diagnosis in the Consumer IoT
- 22 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Consumer Electronics
- Vol. 69 (4) , 786-797
Abstract
The computer-aided diagnosis (CAD) method based on few-shot learning (FSL) effectively reduces the dependence on labelled medical images. However, the catastrophic forgetting defect of neural networks seriously decreases the ability of CAD methods to meet real diagnosis needs. Moreover, the low classification accuracy and limited categories make FSL classification difficult. A few-shot class incremental learning (FSCIL) method for skin disease diagnosis (SDD) based on the consumer Internet of Things (CIoT) is designed to solve these problems in this paper. First, dermoscopic images and clinical images obtained from CIoT nodes are used to cover more skin disease categories, and a dual-flow modal alignment module is designed to mitigate the modal misalignment of different modal images. Second, a queue of gradient episodic memory (Q-GEM) method is designed to solve the catastrophic forgetting problem. Third, a differential diagnosis method (DDM), which can effectively improve the low classification accuracy of the few-shot learning (FSL) classification network, is designed. Experiments show that the top-3 diagnostic accuracy of the proposed method can match the accuracy level of dermatologists, the accuracy is 11.2% improvement over the SOTA method.Keywords
Funding Information
- Association of Fundamental Computing Education in Chinese Universities (2023-AFCEC-242)
- Nursery Project of Henan University of Chinese Medicine (MP2023-10)
This publication has 22 references indexed in Scilit:
- Few-shot learning for dermatological disease diagnosis2022
- LifeLonger: A Benchmark for Continual Disease Classification2022
- Baby steps towards few-shot learning with multiple semanticsPattern Recognition Letters, 2022
- Few-shot learning for skin lesion image classificationMultimedia Tools and Applications, 2022
- Illuminating the dark spaces of healthcare with ambient intelligenceNature, 2020
- A deep learning system for differential diagnosis of skin diseasesNature Medicine, 2020
- Techniques and algorithms for computer aided diagnosis of pigmented skin lesions—A reviewBiomedical Signal Processing and Control, 2018
- Lifelong Machine Learning2018
- Dermatologist-level classification of skin cancer with deep neural networksNature, 2017
- The Task Rehearsal Method of Life-Long Learning: Overcoming Impoverished Data2002