TCN-GAWO: Genetic Algorithm Enhanced Weight Optimization for Temporal Convolutional Network
- 5 March 2024
- journal article
- research article
- Published by Wiley in Journal of Mechanical Design
- Vol. 146 (10) , 1-31
Abstract
This article proposes a genetic algorithm (GA)-enhanced weight optimization method for temporal convolutional network (TCN-GAWO). TCN-GAWO combines the evolutionary process of the genetic algorithm with the gradient-based training and can achieve higher predication/fitting accuracy than traditional temporal convolutional network (TCN). Performances of TCN-GAWO are also more stable. In TCN-GAWO, multiple TCNs are generated with random initial weights first, then these TCNs are trained individually for given epochs, next the selection-crossover-mutation procedure is applied among TCNs to get the evolved offspring. Gradient-based training and selection-crossover-mutation are taken in turns until convergence. The TCN with the optimal performance is then selected. Performances of TCN-GAWO are thoroughly evaluated using realistic engineering data, including C-MAPSS dataset provided by NASA and jet engine lubrication oil dataset provided by airlines. Experimental results show that TCN-GAWO outperforms existing methods for both datasets, demonstrating the effectiveness and the wide range applicability of the proposed method in solving time series problems.Keywords
This publication has 19 references indexed in Scilit:
- Wind power forecasting based on new hybrid model with TCN residual modificationEnergy and AI, 2022
- Optimisation of convolutional neural network architecture using genetic algorithm for the prediction of adhesively bonded joint strengthStructural and Multidisciplinary Optimization, 2022
- CNN architecture optimization using bio-inspired algorithms for breast cancer detection in infrared imagesComputers in Biology and Medicine, 2022
- Control chart recognition based on the parallel model of CNN and LSTM with GA optimizationExpert Systems with Applications, 2021
- Reliability-based topology optimization using stochastic gradientsStructural and Multidisciplinary Optimization, 2021
- Mini-batch sample selection strategies for deep learning based speech recognitionApplied Acoustics, 2021
- Genetic algorithm-determined deep feedforward neural network architecture for predicting electricity consumption in real buildingsEnergy and AI, 2020
- Roulette-wheel selection via stochastic acceptancePhysica A: Statistical Mechanics and its Applications, 2012
- On the momentum term in gradient descent learning algorithmsNeural Networks, 1999
- Learning representations by back-propagating errorsNature, 1986