Distributed Deep Learning Optimization of Heat Equation Inverse Problem Solvers
- 18 July 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
- Vol. 42 (12) , 4831-4843
Abstract
The inversion problem of partial differential equation plays a crucial role in cyber-physical systems applications. This paper presents a novel deep learning optimization approach to constructing a solver of heat equation inversion. To improve the computational efficiency in large-scale industrial applications, data and model parallelisms are incorporated on a platform of multiple GPUs. The advanced Ring-AllReduce architecture is harnessed to achieve an acceleration ratio of 3.46. Then a new multi-GPUs distributed optimization method GradReduce is proposed based on Ring-AllReduce architecture. This method optimizes the original data communication mechanism based on mechanical time and frequency by introducing the gradient transmission scheme solved by linear programming. The experimental results show that the proposed method can achieve an acceleration ratio of 3.84 on a heterogeneous system platform with two CPUs and four GPUs.Keywords
Funding Information
- Key-Area Research and Development Program of Guangdong Province (2021B0101190003, 2021B0101190004, 2021B0101190002)
- Innovation Fund for Industry-University-Research in Chinese Universities (2021FNA02010)
This publication has 24 references indexed in Scilit:
- Perceptual Adversarial Networks for Image-to-Image TransformationIEEE Transactions on Image Processing, 2018
- A Sparse-View CT Reconstruction Method Based on Combination of DenseNet and DeconvolutionIEEE Transactions on Medical Imaging, 2018
- Improved Cuckoo Search Algorithm for Solving Inverse Geometry Heat Conduction ProblemsHeat Transfer Engineering, 2018
- Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurring2017
- ImageNet classification with deep convolutional neural networksCommunications of the ACM, 2017
- Rethinking the Inception Architecture for Computer Vision2016
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Neural-network methods for boundary value problems with irregular boundariesIEEE Transactions on Neural Networks, 2000
- Artificial neural networks for solving ordinary and partial differential equationsIEEE Transactions on Neural Networks, 1998
- Minimum constraints for finite element vector potential problems with Neumann boundary conditionsIEEE Transactions on Magnetics, 1991