DOWELL: Diversity-Induced Optimally Weighted Ensemble Learner for Predictive Maintenance of Industrial Internet of Things Devices
- 14 July 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 9 (4) , 3125-3134
Abstract
The Industrial Internet of Things (I-IoT) enables a smarter maintenance approach for various industrial applications, such as manufacturing, logistics, etc. This approach is based on continuously observing system data to predict device failures and increase device efficiency. This smart maintenance, also known as predictive maintenance (PDM), finds an optimal maintenance schedule to reduce operational and capital costs. Accurate remaining useful life (RUL) prediction is critical for an effective PDM system. Data-driven RUL estimation methods are quite popular owing to their easier implementation. We observe that the performance of data-driven methods varies drastically based on the data set and underlying system parameters, thus making it difficult to have a single algorithm and a parameter set that work best for all settings. We propose an ensemble learning framework, where accurate and diverse base learners are selected out of 20 different state-of-the-art deep learning models. For accuracy, we discover the optimal weights of base learners by constructing an optimization problem. For diversity, we measure the similarity among base learner predictions and iteratively select the most diversified set of models while keeping the accuracy at a certain level. We show that our approach can have 39.2% faster retraining compared to an accuracy-based ensemble with only 3.4% loss in accuracy.Keywords
Funding Information
- NSF (1527034, 1730158, 1826967, 1830331, 1911095, 1952225)
This publication has 34 references indexed in Scilit:
- Remaining useful life estimation in prognostics using deep convolution neural networksReliability Engineering & System Safety, 2018
- Xception: Deep Learning with Depthwise Separable Convolutions2017
- Long Short-Term Memory Network for Remaining Useful Life estimation2017
- A recurrent neural network based health indicator for remaining useful life prediction of bearingsNeurocomputing, 2017
- LSTM: A Search Space OdysseyIEEE Transactions on Neural Networks and Learning Systems, 2016
- Multi‐objective ensemble generationWIREs Data Mining and Knowledge Discovery, 2015
- Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation2014
- YALMIP : a toolbox for modeling and optimization in MATLAB2005
- On the Relationship between Classical Grid Search and Probabilistic RoadmapsThe International Journal of Robotics Research, 2004
- Convex Optimization2004