Seyone Chithrananda
Research Subjects
Seyone Chithrananda has a total of 17 co-authors. Here are the top co-authors by number of shared publications:
- Anoushka Bhutani
University of Michigan, USA
1 shared publication Arun Thiagarajan
1 shared publication- Aryan Amit Barsainyan
Deep Forest Sciences
1 shared publication - Bharath Ramsundar
Deep Forest Sciences
1 shared publication Connor Joseph Amorin
Global Security Computing Applications Division, Lawrence Livermore National Laboratory, Livermore, CA, USA
1 shared publication- Derek Jones
University of California San Diego, La Jolla, CA, USA
1 shared publication
Latest Publications
- Open Access
- 3 August 2025
- Published by American Chemical Society (ACS) in ChemRxiv
ChemBERTa-3: An Open Source Training Framework for Chemical Foundation Models
The rapid advancement of machine learning in computational chemistry has opened new doors for designing molecules, predicting molecular properties, and discovering novel materials. However, building scalable and robust models for molecular property prediction remains a significant challenge due to the vast size and complexity of chemical space. In this paper, we introduce ChemBERTa-3, an open-source training framework designed to train and fine-tune large-scale chemical foundation models. We explore the potential of multiple model architectures by evaluating their performance across various molecular datasets from the MoleculeNet suite. Our experiments demonstrated that pre-training on the expansive ZINC20 dataset yields models capable of performing well on both classification and regression tasks, providing valuable insights into drug discovery and materials science. For scalability, we leveraged both AWS-based Ray deployments and on-premise high-performance computing clusters to support the processing power required to train on billions of molecules. In support of reproducible and extensible science, we have open-sourced all ChemBERTa3 models.
- 3 August 2025
- Published by American Chemical Society (ACS) in ChemRxiv
Open AccessChemBERTa-3: An Open Source Training Framework for Chemical Foundation Models
The rapid advancement of machine learning in computational chemistry has opened new doors for designing molecules, predicting molecular properties, and discovering novel materials. However, building scalable and robust models for molecular property prediction remains a significant challenge due to the vast size and complexity of chemical space. In this paper, we introduce ChemBERTa-3, an open-source training framework designed to train and fine-tune large-scale chemical foundation models. We explore the potential of multiple model architectures by evaluating their performance across various molecular datasets from the MoleculeNet suite. Our experiments demonstrated that pre-training on the expansive ZINC20 dataset yields models capable of performing well on both classification and regression tasks, providing valuable insights into drug discovery and materials science. For scalability, we leveraged both AWS-based Ray deployments and on-premise high-performance computing clusters to support the processing power required to train on billions of molecules. In support of reproducible and extensible science, we have open-sourced all ChemBERTa3 models.