DPLM: Dynamics-aware Protein Language Model via Contrastive Learning between Sequence and Molecular Dynamics Simulation Trajectory

Authors:

Abstract
Protein dynamics captures the interactions between residues and the conformational changes they undergo. Encoding such information could enhance a deep learning model’s ability to predict protein properties. Here we introduce a dynamics-aware protein language model (DPLM) that encodes protein dynamics into a sequence-derived representation. We represent each molecular dynamics (MD) trajectory as a sequence of backbone Cα contact maps and encode it with a Video Vision Transformer (ViViT). We then align the ViViT-derived dynamics embedding with the ESM2-derived sequence embedding using dual-view contrastive learning. The root-mean-square fluctuation correlation and dynamic cross-correlation matrix reconstruction confirm that contrastive learning incorporates dynamics information into the sequence embedding. We applied DPLM as a protein representation backbone for predicting diverse dynamics-related downstream tasks, including liquid-liquid phase separation, cryptic-site detection, and mutation effect on protein thermal stability. DPLM shows strong performance, especially where the evolutionary or structural signal is weak. These results show that learning the geometry of molecular motion yields transferable dynamic information that complements the evolutionary and structural features of existing PLMs. Significance Statement: Proteins perform their functions in constant motion. Most protein language models (PLMs) miss this dynamic dimension, learning only from sequence or fixed structure. A few emerging PLMs model dynamics through conformational snapshots or derived dynamic properties rather than the full time-resolved motion. As a result, the temporal ordering inherent in molecular motion is not explicitly captured. We introduce DPLM, a dynamics-aware protein language model that uses self-supervised learning to align protein sequences with their molecular dynamics simulation trajectories. The resulting sequence-based representation encodes general dynamic information and benefits diverse downstream tasks, especially where evolution and structure alone fall short. DPLM offers a general route to physics-informed protein representation.

This publication has 80 references indexed in Scilit: