Designing Biological Sequences without Prior Knowledge Using Evolutionary Reinforcement Learning
Open Access
- 24 March 2024
- journal article
- research article
- Published by Association for the Advancement of Artificial Intelligence (AAAI) in Proceedings of the AAAI Conference on Artificial Intelligence
- Vol. 38 (1) , 383-391
Abstract
Designing novel biological sequences with desired properties is a significant challenge in biological science because of the extra large search space. The traditional design process usually involves multiple rounds of costly wet lab evaluations. To reduce the need for expensive wet lab experiments, machine learning methods are used to aid in designing biological sequences. However, the limited availability of biological sequences with known properties hinders the training of machine learning models, significantly restricting their applicability and performance. To fill this gap, we present ERLBioSeq, an Evolutionary Reinforcement Learning algorithm for BIOlogical SEQuence design. ERLBioSeq leverages the capability of reinforcement learning to learn without prior knowledge and the potential of evolutionary algorithms to enhance the exploration of reinforcement learning in the large search space of biological sequences. Additionally, to enhance the efficiency of biological sequence design, we developed a predictor for sequence screening in the biological sequence design process, which incorporates both the local and global sequence information. We evaluated the proposed method on three main types of biological sequence design tasks, including the design of DNA, RNA, and protein. The results demonstrate that the proposed method achieves significant improvement compared to the existing state-of-the-art methods.Keywords
This publication has 20 references indexed in Scilit:
- Deep feature extraction in lifetime prognostics of lithium-ion batteries: Advances, challenges and perspectivesRenewable and Sustainable Energy Reviews, 2023
- Improving de novo protein binder design with deep learningNature Communications, 2023
- BacterAI maps microbial metabolism without prior knowledgeNature Microbiology, 2023
- Controlling gene expression with deep generative design of regulatory DNANature Communications, 2022
- Reward is enoughArtificial Intelligence, 2021
- Synthetic Biology and Computer-Based Frameworks for Antimicrobial Peptide DiscoveryACS Nano, 2021
- De novo design of potent and selective mimics of IL-2 and IL-15Nature, 2019
- Computational design of ligand-binding proteins with high affinity and selectivityNature, 2013
- Design by Directed EvolutionAccounts of Chemical Research, 1998
- The effects of steric mutations on the structure of type III antifreeze protein and its interaction with iceJournal of Molecular Biology, 1998