FedEpitope: Parameter-Efficient Federated Protein Language Models for Linear B-Cell Epitope Prediction
Preprint
Abstract
Linear B-cell epitopes are antigenic regions recognised by antibodies that play crucial roles in vaccine development, antibody production, and other therapeutic applications. Their prediction can support peptide-based vaccine candidate screening and diagnostic assay development, but the experimental data required for model development may be distributed across institutions that cannot freely pool their records. We present FedEpitope, a federated framework that adapts the ESM-2 protein language model for peptide-level linear B-cell epitope prediction using Low-Rank Adaptation (LoRA), keeping client-partitioned data local and restricting the communicated trainable model state to approximately 1.11 MB. Simulated benchmarks of FedAvg and FedProx algorithms, evaluated using homology-aware data splits of five biologically heterogeneous, organism-partitioned clients, achieve promising global test performance without centralising training data, with FedAvg outperforming all single-client models in mean AP, F1, and MCC. Additional experiments characterise post-federation personalisation, record-level differential privacy, sensitivity to controlled client heterogeneity, LoRA rank, and generalisation to the independent BCPreds and NetBCE benchmarks, demonstrating the feasibility of parameter-efficient federated protein language model adaptation for data-localised B-cell epitope prediction and the associated trade-offs among predictive performance, personalisation, privacy, communication efficiency, and distribution shift. VISUALKeywords
This publication has 26 references indexed in Scilit:
- Fine-tuning protein language models boosts predictions across diverse tasksNature Communications, 2024
- Structure prediction of protein-ligand complexes from sequence information with UmolNature Communications, 2024
- Development and use of machine learning algorithms in vaccine target selectionnpj Vaccines, 2024
- AlphaFold2 and its applications in the fields of biology and medicineSignal Transduction and Targeted Therapy, 2023
- BepiPred‐3.0: Improved B‐cell epitope prediction using protein language modelsProtein Science, 2022
- MMseqs2 enables sensitive protein sequence searching for the analysis of massive data setsNature Biotechnology, 2017
- Predicting linear B‐cell epitopes using string kernelsJournal of Molecular Recognition, 2008
- Prediction of continuous B‐cell epitopes in an antigen using recurrent neural networkProteins: Structure, Function, and Bioinformatics, 2006
- A semi‐empirical method for prediction of antigenic determinants on protein antigensFEBS Letters, 1990
- New hydrophilicity scale derived from high-performance liquid chromatography peptide retention data: correlation of predicted surface residues with antigenicity and x-ray-derived accessible sitesBiochemistry, 1986