T-Cell Receptor Optimization with Reinforcement Learning and Mutation Policies for Precesion Immunotherapy
Preprint
Abstract
T cells monitor the health status of cells by identifying foreign peptides displayed on their surface. T-cell receptors (TCRs), which are protein complexes found on the surface of T cells, are able to bind to these peptides. This process is known as TCR recognition and constitutes a key step for immune response. Optimizing TCR sequences for TCR recognition represents a fundamental step towards the development of personalized treatments to trigger immune responses killing cancerous or virus-infected cells. In this paper, we formulated the search for these optimized TCRs as a reinforcement learning (RL) problem, and presented a framework TCRPPO with a mutation policy using proximal policy optimization. TCRPPO mutates TCRs into effective ones that can recognize given peptides. TCRPPO leverages a reward function that combines the likelihoods of mutated sequences being valid TCRs measured by a new scoring function based on deep autoencoders, with the probabilities of mutated sequences recognizing peptides from a peptide-TCR interaction predictor. We compared TCRPPO with multiple baseline methods and demonstrated that TCRPPO significantly outperforms all the baseline methods to generate positive binding and valid TCRs. These results demonstrate the potential of TCRPPO for both precision immunotherapy and peptide-recognizing TCR motif discovery.Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- A guide to cancer immunotherapy: from T cell basic science to clinical practiceNature Reviews Immunology, 2020
- Feedback GAN for DNA optimizes protein functionsNature Machine Intelligence, 2019
- Automatic Chemical Design Using a Data-Driven Continuous Representation of MoleculesACS Central Science, 2018
- Identifying specificity groups in the T cell receptor repertoireNature, 2017
- Therapeutic T cell engineeringNature, 2017
- Neoantigen landscape dynamics during human melanoma–T cell interactionsNature, 2016
- Efficient Selectivity and Backup Operators in Monte-Carlo Tree Search2007
- Framewise phoneme classification with bidirectional LSTM and other neural network architecturesNeural Networks, 2005
- Design by Directed EvolutionAccounts of Chemical Research, 1998
- A genetic algorithm tutorialStatistics and Computing, 1994