Leveraging Expert Knowledge for Label Noise Mitigation in Machine Learning
Open Access
- 22 November 2021
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 11 (22) , 11040
Abstract
In training-based Machine Learning applications, the training data are frequently labeled by non-experts and expose substantial label noise which greatly alters the training models. In this work, a novel method for reducing the effect of label noise is introduced. The rules are created from expert knowledge to identify the incorrect non-expert training data. Using the gradient descent algorithm, the violating data samples are weighted less to mitigate their effects during model training. The proposed method is applied to the image classification problem using Manga109 and CIFAR-10 dataset. The experiments show that when the noise level is up to 50% our proposed method significantly increases the accuracy of the model compared to conventional learning methods.Keywords
Funding Information
- Japan Society for the Promotion of Science (19K11879)
- New Energy and Industrial Technology Development Organization (21K11804)
This publication has 21 references indexed in Scilit:
- Deep Learning for Health InformaticsIEEE Journal of Biomedical and Health Informatics, 2016
- Sketch-based manga retrieval using manga109 datasetMultimedia Tools and Applications, 2016
- Deep Residual Learning for Image Recognition2016
- AggNet: Deep Learning From Crowds for Mitosis Detection in Breast Cancer Histology ImagesIEEE Transactions on Medical Imaging, 2016
- Classification in the Presence of Label Noise: A SurveyIEEE Transactions on Neural Networks and Learning Systems, 2013
- Noise Tolerance Under Risk MinimizationIEEE Transactions on Cybernetics, 2013
- Data Cleaning for Classification Using Misclassification AnalysisJournal of Advanced Computational Intelligence and Intelligent Informatics, 2010
- Methods for labeling error detection in microarrays based on the effect of data perturbation on the regression modelBioinformatics, 2009
- Bayesian Gaussian Process Classification with the EM-EP AlgorithmIEEE Transactions on Pattern Analysis and Machine Intelligence, 2006
- Detecting potential labeling errors in microarrays by data perturbationBioinformatics, 2006