Manato Akiyama
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Manato Akiyama has a total of 15 co-authors. Here are the top co-authors by number of shared publications:
- Yasubumi Sakakibara
School of Frontier Engineering, Kitasato University, Sagamihara, Japan
7 shared publications - Kengo Sato
Institute of Science Tokyo
4 shared publications - Aoi Yamato
Keio University
1 shared publication - Hideaki Kakeya
Kyoto University
1 shared publication - Kairi Furui
Institute of Science Tokyo
1 shared publication - Kazuya Kikuchi
Department of Applied Chemistry Graduate School of Engineering The University of Osaka Suita Osaka Japan
1 shared publication
Latest Publications
- Open Access
- 7 November 2024
- Published by American Chemical Society (ACS) in ChemRxiv
Leveraging Tree-Transformer VAE with fragment tokenization for high-performance large chemical generative model
Molecular generation models, especially chemical language model (CLM) utilizing SMILES, a string representation of compounds, face limitations in handling large and complex compounds while maintaining structural accuracy. To address these challenges, we propose FRATTVAE, a Transformer-based variational autoencoder that treats molecules as tree structures with fragments as nodes. FRATTVAE employs several innovative deep learning techniques, including ECFP (Extended Connectivity Fingerprints) based token embeddings and the Transformer’s self-attention mechanism, FRATTVAE efficiently handles large-scale compounds, improving both computational speed and generation accuracy. Evaluations across benchmark datasets, ranging from small molecules to natural compounds, demonstrate that FRATTVAE consistently outperforms existing models, achieving superior reconstruction accuracy and generation quality. Additionally, in molecular optimization tasks, FRATTVAE generated stable, high-quality molecules with desired properties, avoiding structural alerts. These results highlight FRATTVAE as a robust and versatile solution for molecular generation and optimization, making it well-suited for a variety of applications in cheminformatics and drug discovery.
- 7 November 2024
- Published by American Chemical Society (ACS) in ChemRxiv
Open AccessLeveraging Tree-Transformer VAE with fragment tokenization for high-performance large chemical generative model
Molecular generation models, especially chemical language model (CLM) utilizing SMILES, a string representation of compounds, face limitations in handling large and complex compounds while maintaining structural accuracy. To address these challenges, we propose FRATTVAE, a Transformer-based variational autoencoder that treats molecules as tree structures with fragments as nodes. FRATTVAE employs several innovative deep learning techniques, including ECFP (Extended Connectivity Fingerprints) based token embeddings and the Transformer’s self-attention mechanism, FRATTVAE efficiently handles large-scale compounds, improving both computational speed and generation accuracy. Evaluations across benchmark datasets, ranging from small molecules to natural compounds, demonstrate that FRATTVAE consistently outperforms existing models, achieving superior reconstruction accuracy and generation quality. Additionally, in molecular optimization tasks, FRATTVAE generated stable, high-quality molecules with desired properties, avoiding structural alerts. These results highlight FRATTVAE as a robust and versatile solution for molecular generation and optimization, making it well-suited for a variety of applications in cheminformatics and drug discovery.
- Open Access
- 9 January 2024
- Published by American Chemical Society (ACS) in ChemRxiv
Deep learning of multimodal networks with topological regularization for drug repositioning
Motivation: Computational techniques for drug-disease prediction are essential in enhancing drug discovery and repositioning. While many methods utilize multimodal networks from various biolog-ical databases, few integrate comprehensive multi-omics data, including transcriptomes, proteomes, and metabolomes. We introduce STRGNN, a novel graph deep learning approach that predicts drug-disease relationships using extensive multimodal networks comprising proteins, RNAs, metab-olites, and compounds. We have constructed a detailed dataset incorporating multi-omics data and developed a learning algorithm with topological regularization. This algorithm selectively leverages informative modalities while filtering out redundancies. Results: STRGNN demonstrates superior accuracy compared to existing methods and has identified several novel drug effects, corroborating existing literature. STRGNN emerges as a powerful tool for drug prediction and discovery. The source code for STRGNN, along with the dataset for perfor-mance evaluation, is available at https://github.com/yuto-ohnuki/STRGNN.git.
- 9 January 2024
- Published by American Chemical Society (ACS) in ChemRxiv
Open AccessDeep learning of multimodal networks with topological regularization for drug repositioning
Motivation: Computational techniques for drug-disease prediction are essential in enhancing drug discovery and repositioning. While many methods utilize multimodal networks from various biolog-ical databases, few integrate comprehensive multi-omics data, including transcriptomes, proteomes, and metabolomes. We introduce STRGNN, a novel graph deep learning approach that predicts drug-disease relationships using extensive multimodal networks comprising proteins, RNAs, metab-olites, and compounds. We have constructed a detailed dataset incorporating multi-omics data and developed a learning algorithm with topological regularization. This algorithm selectively leverages informative modalities while filtering out redundancies. Results: STRGNN demonstrates superior accuracy compared to existing methods and has identified several novel drug effects, corroborating existing literature. STRGNN emerges as a powerful tool for drug prediction and discovery. The source code for STRGNN, along with the dataset for perfor-mance evaluation, is available at https://github.com/yuto-ohnuki/STRGNN.git.
- Open Access
- 29 May 2023
- Published by American Chemical Society (ACS) in ChemRxiv
Deep generative model of constructing chemical latent space for large molecular structures with 3D complexity
The structural diversity of chemical libraries, which are systematic collections of compounds that have potential to bind to biomolecules, can be represented by chemical latent space. A chemical latent space is a projection of a compound structure into a mathematical space based on several molecular features, and it can express structural diversity within a compound library in order to explore a broader chemical space and generate novel compound structures for drug candidates. Many of the natural compounds produced by living organisms have complicated structures and are highly biologically active. However, no deep learning models exist that can effectively construct chemical latent spaces to handle large and complex compound structures, such as those found in natural compounds, and furthermore manage chirality, which is an essential factor in the 3D complexity of compounds. In this study, we developed a new deep-learning method, called NP-VAE, based on variational autoencoder for handling natural compounds, and constructed a chemical latent space that projected large and complex compound structures including chirality. NP-VAE was successful in construction of the chemical latent space that showed higher accuracy with respect to reconstruction and generalization than the state-of-the-art deep learning methods. Furthermore, by exploring the acquired latent space, we succeeded in comprehensively analyzing a compound library containing natural compounds and generating novel compound structures with optimized functions.
- 29 May 2023
- Published by American Chemical Society (ACS) in ChemRxiv
Open AccessDeep generative model of constructing chemical latent space for large molecular structures with 3D complexity
The structural diversity of chemical libraries, which are systematic collections of compounds that have potential to bind to biomolecules, can be represented by chemical latent space. A chemical latent space is a projection of a compound structure into a mathematical space based on several molecular features, and it can express structural diversity within a compound library in order to explore a broader chemical space and generate novel compound structures for drug candidates. Many of the natural compounds produced by living organisms have complicated structures and are highly biologically active. However, no deep learning models exist that can effectively construct chemical latent spaces to handle large and complex compound structures, such as those found in natural compounds, and furthermore manage chirality, which is an essential factor in the 3D complexity of compounds. In this study, we developed a new deep-learning method, called NP-VAE, based on variational autoencoder for handling natural compounds, and constructed a chemical latent space that projected large and complex compound structures including chirality. NP-VAE was successful in construction of the chemical latent space that showed higher accuracy with respect to reconstruction and generalization than the state-of-the-art deep learning methods. Furthermore, by exploring the acquired latent space, we succeeded in comprehensively analyzing a compound library containing natural compounds and generating novel compound structures with optimized functions.
- Open Access
Direct Inference of Base-Pairing Probabilities with Neural Networks Improves Prediction of RNA Secondary Structures with Pseudoknots
Existing approaches to predicting RNA secondary structures depend on how the secondary structure is decomposed into substructures, that is, the architecture, to define their parameter space. However, architecture dependency has not been sufficiently investigated, especially for pseudoknotted secondary structures. In this study, we propose a novel algorithm for directly inferring base-pairing probabilities with neural networks that do not depend on the architecture of RNA secondary structures, and then implement this approach using two maximum expected accuracy (MEA)-based decoding algorithms: Nussinov-style decoding for pseudoknot-free structures and IPknot-style decoding for pseudoknotted structures. To train the neural networks connected to each base pair, we adopt a max-margin framework, called structured support vector machines (SSVM), as the output layer. Our benchmarks for predicting RNA secondary structures with and without pseudoknots show that our algorithm outperforms existing methods in prediction accuracy.
Open AccessDirect Inference of Base-Pairing Probabilities with Neural Networks Improves Prediction of RNA Secondary Structures with Pseudoknots
Existing approaches to predicting RNA secondary structures depend on how the secondary structure is decomposed into substructures, that is, the architecture, to define their parameter space. However, architecture dependency has not been sufficiently investigated, especially for pseudoknotted secondary structures. In this study, we propose a novel algorithm for directly inferring base-pairing probabilities with neural networks that do not depend on the architecture of RNA secondary structures, and then implement this approach using two maximum expected accuracy (MEA)-based decoding algorithms: Nussinov-style decoding for pseudoknot-free structures and IPknot-style decoding for pseudoknotted structures. To train the neural networks connected to each base pair, we adopt a max-margin framework, called structured support vector machines (SSVM), as the output layer. Our benchmarks for predicting RNA secondary structures with and without pseudoknots show that our algorithm outperforms existing methods in prediction accuracy.
- Open Access
RNA secondary structure prediction using deep learning with thermodynamic integration
RNA secondary structure prediction is one of the key technologies for revealing the essential roles of functional non-coding RNAs. Although machine learning-based rich-parametrized models have achieved extremely high performance in terms of prediction accuracy, the risk of overfitting for such models has been reported. In this work, we propose a new algorithm for predicting RNA secondary structures that uses deep learning with thermodynamic integration, thereby enabling robust predictions. Similar to our previous work, the folding scores, which are computed by a deep neural network, are integrated with traditional thermodynamic parameters to enable robust predictions. We also propose thermodynamic regularization for training our model without overfitting it to the training data. Our algorithm (MXfold2) achieved the most robust and accurate predictions in computational experiments designed for newly discovered non-coding RNAs, with significant 2–10 % improvements over our previous algorithm (MXfold) and standard algorithms for predicting RNA secondary structures in terms of F -value.
Open AccessRNA secondary structure prediction using deep learning with thermodynamic integration
RNA secondary structure prediction is one of the key technologies for revealing the essential roles of functional non-coding RNAs. Although machine learning-based rich-parametrized models have achieved extremely high performance in terms of prediction accuracy, the risk of overfitting for such models has been reported. In this work, we propose a new algorithm for predicting RNA secondary structures that uses deep learning with thermodynamic integration, thereby enabling robust predictions. Similar to our previous work, the folding scores, which are computed by a deep neural network, are integrated with traditional thermodynamic parameters to enable robust predictions. We also propose thermodynamic regularization for training our model without overfitting it to the training data. Our algorithm (MXfold2) achieved the most robust and accurate predictions in computational experiments designed for newly discovered non-coding RNAs, with significant 2–10 % improvements over our previous algorithm (MXfold) and standard algorithms for predicting RNA secondary structures in terms of F -value.
- Open Access
Direct inference of base-pairing probabilities with neural networks improves RNA secondary structure prediction with pseudoknots
Motivation: Existing approaches for predicting RNA secondary structures depend on howto decompose a secondary structure into substructures, so-called the architecture , to define their parameter space. However, the architecture has not been sufficiently investigated especially for pseudoknotted secondary structures. Results: In this paper, we propose a novel algorithm to directly infer base-pairing probabilities with neural networks that does not depend on the architecture of RNA secondary structures, followed by performing the maximum expected accuracy (MEA) based decoding algorithms; Nussinov-style decoding for pseudoknot-free structures, and IPknot-style decoding for pseudoknotted structures. To train the neural networks connected to each base-pair, we adopt a max-margin framework, called structured support vector machines (SSVM), as the output layer. Our benchmarks for predicting RNA secondary structures with and without pseudoknots show that our algorithm achieves the best prediction accuracy compared with existing methods. Availability: The source code is available at https://github.com/keio-bioinformatics/neuralfold/ . Contact: satoken@bio.keio.ac.jp
Open AccessDirect inference of base-pairing probabilities with neural networks improves RNA secondary structure prediction with pseudoknots
Motivation: Existing approaches for predicting RNA secondary structures depend on howto decompose a secondary structure into substructures, so-called the architecture , to define their parameter space. However, the architecture has not been sufficiently investigated especially for pseudoknotted secondary structures. Results: In this paper, we propose a novel algorithm to directly infer base-pairing probabilities with neural networks that does not depend on the architecture of RNA secondary structures, followed by performing the maximum expected accuracy (MEA) based decoding algorithms; Nussinov-style decoding for pseudoknot-free structures, and IPknot-style decoding for pseudoknotted structures. To train the neural networks connected to each base-pair, we adopt a max-margin framework, called structured support vector machines (SSVM), as the output layer. Our benchmarks for predicting RNA secondary structures with and without pseudoknots show that our algorithm achieves the best prediction accuracy compared with existing methods. Availability: The source code is available at https://github.com/keio-bioinformatics/neuralfold/ . Contact: satoken@bio.keio.ac.jp
- Open Access
A max-margin training of RNA secondary structure prediction integrated with the thermodynamic model
Motivation: A popular approach for predicting RNA secondary structure is the thermodynamic nearest neighbor model that finds a thermodynamically most stable secondary structure with the minimum free energy (MFE). For further improvement, an alternative approach that is based on machine learning techniques has been developed. The machine learning based approach can employ a fine-grained model that includes much richer feature representations with the ability to fit the training data. Although a machine learning based fine-grained model achieved extremely high performance in prediction accuracy, a possibility of the risk of overfitting for such model has been reported. Results: In this paper, we propose a novel algorithm for RNA secondary structure prediction that integrates the thermodynamic approach and the machine learning based weighted approach. Ourfine-grained model combines the experimentally determined thermodynamic parameters with a large number of scoring parameters for detailed contexts of features that are trained by the structured support vector machine (SSVM) with the ℓ 1 regularization to avoid overfitting. Our benchmark shows that our algorithm achieves the best prediction accuracy compared with existing methods, and heavy overfitting cannot be observed. Availability: The implementation of our algorithm is available at https://github.com/keio-bioinformatics/mxfold . Contact: satoken@bio.keio.ac.jp
Open AccessA max-margin training of RNA secondary structure prediction integrated with the thermodynamic model
Motivation: A popular approach for predicting RNA secondary structure is the thermodynamic nearest neighbor model that finds a thermodynamically most stable secondary structure with the minimum free energy (MFE). For further improvement, an alternative approach that is based on machine learning techniques has been developed. The machine learning based approach can employ a fine-grained model that includes much richer feature representations with the ability to fit the training data. Although a machine learning based fine-grained model achieved extremely high performance in prediction accuracy, a possibility of the risk of overfitting for such model has been reported. Results: In this paper, we propose a novel algorithm for RNA secondary structure prediction that integrates the thermodynamic approach and the machine learning based weighted approach. Ourfine-grained model combines the experimentally determined thermodynamic parameters with a large number of scoring parameters for detailed contexts of features that are trained by the structured support vector machine (SSVM) with the ℓ 1 regularization to avoid overfitting. Our benchmark shows that our algorithm achieves the best prediction accuracy compared with existing methods, and heavy overfitting cannot be observed. Availability: The implementation of our algorithm is available at https://github.com/keio-bioinformatics/mxfold . Contact: satoken@bio.keio.ac.jp