Optimization of Reactive Force Field Simulation: Refactor, Parallelization, and Vectorization for Interactions
- 22 June 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Parallel and Distributed Systems
- Vol. 33 (2) , 359-373
Abstract
Molecular dynamics (MD) simulations are playing an increasingly important role in many areas ranging from chemical materials to biological molecules. With the continuing development of MD models, the potentials are getting larger and more complex. In this paper, we focus on the reactive force field (ReaxFF) potential from LAMMPS to optimize the computation of interactions. We present our efforts on refactoring for neighbor list building, bond order computation, as well as valence angles and torsion angles computation. After redesigning these kernels, we develop a vectorized implementation for non-bonded interactions, which is nearly 100 faster than the management processing element (MPE) on the Sunway TaihuLight supercomputer. Furthermore, we have implemented the three-body-list free torsion angles computation, and propose a line-locked software cache method to eliminate write conflicts in the torsion angle and valence angle interactions resulting in an order-of-magnitude speedup on a single SunwayTaihuLight node. In addition, we achieve a speedup of up to 3.5 compared to the KOKKOS package on an Intel Xeon Gold 6148 core. When executed on 1,024 processes, our implementation enables the simulation of 21,233,664 atoms on 66,560 cores with a performance of 0.032 ns/day and a weak scaling efficiency of 95.71%.Keywords
Funding Information
- National Key Research and Development Program of China (2020YFB0204700)
- National Natural Science Foundation of China (61972231, U1806205)
- Key Project of Joint Fund of Shandong Province (ZR2019LZH007)
- Key Technology Research and Development Program of Shandong Province (2018CXGC1211)
- CSC and DAAD
- Center for High Performance Computing and System Simulation
- Pilot National Laboratory for Marine Science and Technology
- Engineering Research Center of Digital Media Technology, Ministry of Education
This publication has 28 references indexed in Scilit:
- CHARMM: The biomolecular simulation programJournal of Computational Chemistry, 2009
- GROMACS 4: Algorithms for Highly Efficient, Load-Balanced, and Scalable Molecular SimulationJournal of Chemical Theory and Computation, 2008
- Scalable molecular dynamics with NAMDJournal of Computational Chemistry, 2005
- The Amber biomolecular simulation programsJournal of Computational Chemistry, 2005
- ReaxFF: A Reactive Force Field for HydrocarbonsThe Journal of Physical Chemistry A, 2001
- Tabulated potentials in molecular dynamics simulationsComputer Physics Communications, 1999
- Parallel multilevel preconditioned conjugate-gradient approach to variable-charge molecular dynamicsComputer Physics Communications, 1997
- GROMACS: A message-passing parallel molecular dynamics implementationComputer Physics Communications, 1995
- Fast Parallel Algorithms for Short-Range Molecular DynamicsJournal of Computational Physics, 1995
- Computer "Experiments" on Classical Fluids. I. Thermodynamical Properties of Lennard-Jones MoleculesPhysical Review B, 1967