Influ-BERT: a domain-adaptive genomic language model for advancing influenza A virus research
Open Access
- 1 March 2026
- journal article
- Published by Oxford University Press (OUP) in Briefings in Bioinformatics
- Vol. 27 (2)
Abstract
Influenza A virus (IAV) poses a persistent threat to global public health due to its broad host adaptability, frequent anti-genic variation, and potential for cross-species transmission. Accurate identification of IAV subtypes is essential for effective epidemic surveillance and precise disease control. Here, we present Influ-BERT, a domain-adaptive pretrained model based on the Transformer architecture. Optimized from DNABERT-2, Influ-BERT was developed using a dedicated corpus of ~900 000 influenza genome sequences. We constructed a custom Byte Pair Encoding tokenizer, and employed a two-stage training strategy involving domain-adaptive pretraining followed by task-specific fine-tuning. This approach significantly enhanced identification performance for IAV subtypes. Experimental results demonstrate that Influ-BERT outperforms both traditional machine learning approaches and general genomic language models, such as DNABERT-2, Necleotide Transformer, and MegaDNA, in the task of IAV subtype identification. The model consistently achieved F1-scores above 97% across five subtype classification tasks and exhibited stable performance gains for subtypes that are underrepresented in sequencing data, including H5N8, H1N2, and H13N6. Beyond subtype identification, Influ-BERT was successfully applied to additional tasks including respiratory virus identification, IAV pathogenicity prediction, and identification of IAV genomic fragments and functional genes, demonstrating robust performance throughout. Further interpretability analysis using sliding window perturbation confirmed that the model focuses on biologically significant genomic regions, providing insight into its improved predictive capability.Keywords
All Related Versions
This publication has 37 references indexed in Scilit:
- Using artificial intelligence to document the hidden RNA virosphereCell, 2024
- H9N2 avian influenza viruses: challenges and the way forwardThe Lancet Microbe, 2022
- Serum Virus Neutralization Assay for Detection and Quantitation of Serum Neutralizing Antibodies to Influenza A Virus in Swine2020
- Support vector machine2020
- Rapid Evolution of H7N9 Highly Pathogenic Viruses that Emerged in China in 2017Cell Host & Microbe, 2018
- Estimates of global seasonal influenza-associated respiratory mortality: a modelling studyThe Lancet, 2018
- Global burden of respiratory infections due to seasonal influenza in young children: a systematic review and meta-analysisThe Lancet, 2011
- Influenza Virus Evolution, Host Adaptation, and Pandemic FormationCell Host & Microbe, 2010
- Random ForestsMachine Learning, 2001
- Identification and subtyping of avian influenza viruses by reverse transcription-PCRJournal of Virological Methods, 2001