Predicting peptide aggregation with protein language model embeddings
Preprint
Abstract
Amyloid fibrils, a form of peptide aggregate, are associated with multiple diseases and hinder the development of therapeutics. The experimental characterization of aggregating peptides is resource-intensive and data are scarce, limiting the development of accurate models. We present a deep-learning model, PALM (Predicting Aggregation with Language Model embeddings), which uses transfer learning to predict aggregation from embeddings extracted from a pretrained protein language model (pLM). PALM is trained on the WaltzDB-2.0 dataset to classify peptides and identify aggregation-prone regions within a sequence at single-residue resolution. Compared to existing models, it exhibits competitive performance on diverse held-out experimental datasets. We find that PALM fails to identify single mutations that increase the rate of aggregation of amyloid beta peptide; however, training the PALM architecture on a larger dataset, CANYA NNK1-3, substantially improves performance in this task. These results show that transfer learning with pLM embeddings improves performance when training on small datasets, but highlight that challenging tasks, such as predicting the effect of single mutations, require more experimental data.Keywords
All Related Versions
- Published version: Journal of Chemical Information and Modeling, 66 (9), 5206.
This publication has 38 references indexed in Scilit:
- AggBERT: Best in Class Prediction of Hexapeptide Amyloidogenesis with a Semi-Supervised ProtBERT ModelJournal of Chemical Information and Modeling, 2023
- The expanding amyloid family: Structure, stability, function, and pathogenesisCell, 2021
- Learning the protein language: Evolution, structure, and functionCell Systems, 2021
- ANuPP: A Versatile Tool to Predict Aggregation Nucleating Regions in Peptides and ProteinsJournal of Molecular Biology, 2021
- Amyloid Fibrils as Building Blocks for Natural and Artificial Functional MaterialsAdvanced Materials, 2016
- Protein aggregation and its impact on product qualityCurrent Opinion in Biotechnology, 2014
- On the structural definition of amyloid fibrils and other polypeptide aggregatesCellular and Molecular Life Sciences, 2007
- Prediction of “Aggregation-prone” and “Aggregation-susceptible” Regions in Proteins Associated with Neurodegenerative DiseasesJournal of Molecular Biology, 2005
- Prediction of sequence-dependent and mutational effects on the aggregation of peptides and proteinsNature Biotechnology, 2004
- A general method applicable to the search for similarities in the amino acid sequence of two proteinsJournal of Molecular Biology, 1970