Neel Mukkavilli
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Neel Mukkavilli has a total of 5 co-authors. Here are the top co-authors by number of shared publications:
- David A. C. Beck
University of Washington
1 shared publication - David Anastasiu
Santa Clara University
1 shared publication - Hamed Akbari
Department of Bioengineering, School of Engineering, Santa Clara University, Santa Clara, CA, USA
1 shared publication Konstantin Ivanov
Carnegie Mellon University
1 shared publication- Michelle E. McCully
Department of Biology, Santa Clara University, 500 El Camino Real, Santa Clara, CA 95053, USA
1 shared publication
Latest Publications
- Open Access
Uncovering Features of ProteinMPNN with Sparse Autoencoders
Customization and modification of machine learning derived sequences can be achieved by understanding the mechanics behind state-of-the-art protein design models such as ProteinMPNN. Uninterpretability is hypothesized to be due largely to polysemanticity where neural networks store more features than they have dimensions. Here, we introduce sparse autoencoders (SAEs) into ProteinMPNN which expand its latent space and uncovers correlations between the activations in sparse dimensions and the presence of protein features such as secondary structure, residue volume, residue shape, disulfide bridges, and coordination to ligands. Additionally, we show that sparse activations can be manipulated to produce a variant of the short chain variable fragment Brolucizumab that is more thermostable than variants produced by traditional machine learning methods based on high temperature molecular dynamics simulations. Thus, SAEs provide both mechanistic understanding of protein design models and allow customizable manipulation of sequence prediction.
Open AccessUncovering Features of ProteinMPNN with Sparse Autoencoders
Customization and modification of machine learning derived sequences can be achieved by understanding the mechanics behind state-of-the-art protein design models such as ProteinMPNN. Uninterpretability is hypothesized to be due largely to polysemanticity where neural networks store more features than they have dimensions. Here, we introduce sparse autoencoders (SAEs) into ProteinMPNN which expand its latent space and uncovers correlations between the activations in sparse dimensions and the presence of protein features such as secondary structure, residue volume, residue shape, disulfide bridges, and coordination to ligands. Additionally, we show that sparse activations can be manipulated to produce a variant of the short chain variable fragment Brolucizumab that is more thermostable than variants produced by traditional machine learning methods based on high temperature molecular dynamics simulations. Thus, SAEs provide both mechanistic understanding of protein design models and allow customizable manipulation of sequence prediction.