Multimodal Multi-tasking for Skin Lesion Classification Using Deep Neural Networks
Open Access
- 1 January 2021
- book chapter
- Published by Springer Nature
- p. 27-38
Abstract
Skin cancer is one of the most common types of cancer and, with its increasing incidence, accurate early diagnosis is crucial to improve prognosis of patients. In the process of visual inspection, dermatologists follow specific dermoscopic algorithms and identify important features to provide a diagnosis. This process can be automated as such characteristics can be extracted by computer vision techniques. Although deep neural networks can extract useful features from digital images for skin lesion classification, performance can be improved by providing additional information. The extracted pseudo-features can be used as input (multimodal) or output (multi-tasking) to train a robust deep learning model. This work investigates the multimodal and multi-tasking techniques for more efficient training, given the single optimization of several related tasks in the latter, and generation of better diagnosis predictions. Additionally, the role of lesion segmentation is also studied. Results show that multi-tasking improves learning of beneficial features which lead to better predictions, and pseudo-features inspired by the ABCD rule provide readily available helpful information about the skin lesion.Keywords
This publication has 16 references indexed in Scilit:
- Dermatologist-level classification of skin cancer with deep neural networksNature, 2017
- Deep Residual Learning for Image Recognition2016
- Going deeper with convolutions2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Negative pigment network: An additional dermoscopic feature for the diagnosis of melanomaJournal of the American Academy of Dermatology, 2013
- Cloudy and starry milia‐like cysts: how well do they distinguish seborrheic keratoses from malignant melanomas?Journal of the European Academy of Dermatology and Venereology, 2010
- Lesion border detection in dermoscopy imagesComputerized Medical Imaging and Graphics, 2009
- A methodological approach to the classification of dermoscopy imagesComputerized Medical Imaging and Graphics, 2007
- Parameterization of Dermoscopic Findings for the Internet-based Melanoma Screening System2007
- Dermoscopy: alternative melanocytic algorithms—the ABCD rule of dermatoscopy, menzies scoring method, and 7-point checklistClinics in Dermatology, 2002