Optimization strategies for multi‐block structured CFD simulation based on Sunway TaihuLight
Open Access
- 19 April 2023
- journal article
- research article
- Published by Wiley in Engineering Reports
- Vol. 7 (1)
Abstract
Decomposition and solver are the main performance bottlenecks of multi‐block structured CFD simulation involving complex industrial configurations such as aero‐engine, shock‐boundary layer interactions, turbulence modeling and so on. In this article, we proposed several optimization strategies to improve the computing efficiency of multi‐block structured CFD simulation based on Sunway TaihuLight super computing system, including: (1) a load balancing decomposition approach combined with recursive segmentation of undirected graphs and block mapping for multi‐structured blocks, (2) two‐level parallelism that utilizes MPI + OpenACC2.0* hybrid parallel paradigms with various performance optimizations such as data preprocessing, reducing unnecessary loops of subroutine calls, collapse, and tile syntax, memory access optimization between the main memory and local data memory (LDM), and (3) a carefully orchestrated pipeline and register communication strategy between computing processor elements (CPEs) to tackle the dependence of LU‐SGS (Lower‐Upper Symmetric Gauss–Seidel). Numerical simulations were conducted to evaluate the proposed optimization strategies. The results showed that our parallel implementation provides high load balance and efficiency, achieving a speedup of 8× + for one loop step, and a speed up of 2× + for strong correlation kernels.Keywords
This publication has 22 references indexed in Scilit:
- Parallelization Strategies for Computational Fluid Dynamics Software: State of the Art ReviewArchives of Computational Methods in Engineering, 2016
- Acceleration of CFD Engineering Software on GPU and MIC2015
- Collaborating CPU and GPU for large-scale high-order CFD simulations with complex grids on the TianHe-1A supercomputerJournal of Computational Physics, 2014
- Efficient parallel implementation of large scale 3D structured grid CFD applications on the Tianhe-1A supercomputerComputers & Fluids, 2013
- Computational performance of a parallelized three-dimensional high-order spectral element toolboxComputers & Fluids, 2011
- High performance parallel computing of flows in complex geometriesComptes Rendus Mécanique, 2011
- Parallelization of a multi-blocked CFD code via three strategies for fluid flow and heat transfer analysisComputers & Fluids, 2004
- High-performance computing in computational fluid dynamics: progress and challengesPhilosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 2002
- Partitioning strategies for structured multiblock gridsParallel Computing, 2000
- An Improved Spectral Graph Partitioning Algorithm for Mapping Parallel ComputationsSIAM Journal on Scientific Computing, 1995