Advancing aircraft engine RUL predictions: an interpretable integrated approach of feature engineering and aggregated feature importance
Authors:
Open Access
- 18 August 2023
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 13 (1) , 1-14
Abstract
In this study, we present a comprehensive approach for predicting the remaining useful life (RUL) of aircraft engines, incorporating advanced feature engineering, dimensionality reduction, feature selection techniques, and machine learning models. The process begins with a rolling time series window, followed by the extraction of a multitude of statistical features, and the application of principal component analysis for dimensionality reduction. We utilize a variety of feature selection methods, such as Genetic Algorithm, Recursive Feature Elimination, Least Absolute Shrinkage and Selection Operator Regression, and Feature Importances from a Random Forest model. As a significant contribution, we introduce the novel aggregated feature importances with cross-validation (AFICv) technique, which ranks features based on their mean importance. We establish a selection criterion that retains features with a cumulative mean sum equal to 70%, thereby reducing the complexity of machine learning models and enhancing their generalizability. Four machine learning regression models—Natural and Extreme Gradient Boosting, Random Forest, and Multi-Layer Perceptron—were employed to evaluate the effectiveness of the selected features. The performance of our proposed method is assessed by the evaluation metrics Root Mean Square Error (RMSE) and R2 Score, and also considered within-interval percentages and relative accuracy metrics. Importantly, a novel PCA interpretability was introduced to provide real-world context and enhance the utility of our findings for domain experts. Our results indicate that the proposed AFICv technique efficiently achieves competitive performance across the Commercial Modular Aero-Propulsion System Simulation (C-MAPSS) sub-datasets using a significantly smaller subset of features, thus contributing to a more effective and interpretable RUL prediction methodology for aircraft engines.Keywords
Funding Information
- Eötvös Loránd University
This publication has 59 references indexed in Scilit:
- A new procedure for using envelope analysis for rolling element bearing diagnostics in variable operating conditionsMechanical Systems and Signal Processing, 2013
- Machine remaining useful life prediction: An integrated adaptive neuro-fuzzy and high-order particle filtering approachMechanical Systems and Signal Processing, 2012
- An Overview of Gas Turbines2012
- Prognostics of lithium-ion batteries based on Dempster–Shafer theory and the Bayesian Monte Carlo methodJournal of Power Sources, 2011
- Prognostic modelling options for remaining useful life estimation by industryMechanical Systems and Signal Processing, 2011
- Principal component analysisWIREs Computational Statistics, 2010
- A review of feature selection techniques in bioinformaticsBioinformatics, 2007
- On Lempel–Ziv complexity for multidimensional data analysisPhysica A: Statistical Mechanics and its Applications, 2005
- Permutation Entropy: A Natural Complexity Measure for Time SeriesPhysical Review Letters, 2002
- Lag Order and Critical Values of the Augmented Dickey–Fuller TestJournal of Business & Economic Statistics, 1995