Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Dhiraj Pyakurel has a total of 8 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Comparative Analysis of LSTM, Transformer, and TCN in Predicting Peptide-MHC Class II Binding Affinity

    by Dhiraj Pyakurel, Aayush Dangol, Abiral Bhattarai, Dipesh Thapa

    Accurate prediction of Major Histocompatibility Complex (MHC) class II-peptide binding affinity remains a critical challenge in immunotherapy and vaccine development due to the complexity of molecular interactions and allele-specific binding preferences. While existing computational approaches have shown promise, identifying the optimal deep learning architecture for this task remains an open question. This study addresses this gap by systematically comparing three state-of-the-art deep learning architectures: Long Short-Term Memory Networks (LSTM), Transformers, and Temporal Convolutional Networks (TCN) using the IEDB2016 dataset containing 134,281 MHC class II-peptide binding records. Our comprehensive evaluation employed five-fold cross-validation and ensemble modeling to assess both regression and classification performance. Results demonstrate that TCN consistently outperforms competing architectures, achieving superior regression metrics with R² of 0.6208 (vs. LSTM: 0.5923, Transformer: 0.5706) and classification performance with AUROC of 0.8766 (vs. LSTM: 0.8736, Transformer: 0.8707). Cross-validation confirmed TCN's robustness (average R²: 0.6229), while ensemble methods further validated its superiority (R²: 0.6805). These findings establish TCN as the most effective architecture for peptide-MHC binding prediction, offering significant implications for computational immunology and therapeutic design.

  • Open Access

    Enhancing the Efficiency of Deep Learning Models for Handwritten Text Recognition by Utilizing Meta-learning Optimization Techniques

    by Rajendra Paudyal, Dhiraj Pyakurel

    Recognizing handwritten text plays a crucial role in converting scanned documents, whether printed or handwritten, into editable and searchable formats. In this study, various models such as CRNN, TCN, and Transformer have been utilized for Handwritten Text Recognition (HTR), where input data consists of sequences of image patches representing English text. The CRNN model employed comprises three layers: a CNN for extracting feature maps from handwritten text images, and Bidirectional Long-Short Term Memory (BLSTM) and Bidirectional Gated Recurrent Unit (BiGRU) in the RNN layer to address the gradient vanishing/exploding issue of simple RNNs. Additionally, TCN and Transformer models are employed for HTR. Optimizers including SGD, RMSprop, Adam, and Adamax, along with fine-tuning of hyperparameters, are utilized to enhance model accuracy. Model performance is evaluated using metrics such as f1 Score, precision, and recall. Meta learner optimization is subsequently employed to enhance the performance of deep learning models. The IAM dataset in English is utilized for training, validation, and testing. The Bi-LSTM model achieves an accuracy of 90.04%, precision of 91.62%, recall of 88.98%, and an f1 Score of 0.9025. With TCN, similar metrics are achieved. The Transformer model achieves an accuracy of 85.86%, precision of 88.94%, recall of 83.86%, and an f1 Score of 0.8626. Furthermore, Bi-GRU achieves an accuracy of 90.32%, precision of 91.56%, recall of 89.53%, and an f1 Score of 0.9050. Following the basic models, a meta model is constructed for the best performing model, demonstrating significant enhancement in Handwritten Text Recognition with an accuracy of 92.30%, precision of 94.80%, recall of 93.18%, and an f1 Score of 0.9425.


  • Open Access

    Comparative Analysis of Snowmelt-Driven Streamflow Forecasting Using Machine Learning Techniques

    by Ukesh Thapa, Bipun Man Pati, Samit Thapa, Dhiraj Pyakurel, Anup Shrestha

    The rapid advancement of machine learning techniques has led to their widespread application in various domains, including water resources. However, snowmelt modeling remains an area that has not been extensively explored. In this study, we propose a state-of-the-art (SOTA) deep learning sequential model, leveraging a Temporal Convolutional Network (TCN), for snowmelt forecasting of the Hindu Kush Himalayan (HKH) region. To evaluate the performance of our proposed model, we conducted a comparative analysis with other popular models, including Support Vector Regression (SVR), Long Short-Term Memory (LSTM), and Transformer models. Furthermore, nested cross-validation (CV) was used with five outer folds and three inner folds, and hyperparameter tuning was performed on the inner folds. To evaluate the performance of the model, the Mean Absolute Error (MAE), Root-Mean-Square Error (RMSE), R square (R2), Kling–Gupta Efficiency (KGE), and Nash–Sutcliffe Efficiency (NSE) were computed for each outer fold. The average metrics revealed that the TCN outperformed the other models, with an average MAE of 0.011, RMSE of 0.023, R2 of 0.991, KGE of 0.992, and NSE of 0.991 for one-day forecasts of streamflow. The findings of this study demonstrate the effectiveness of the proposed deep learning model as compared to traditional machine learning approaches for snowmelt-driven streamflow forecasting. Moreover, the superior performance of this TCN highlights its potential as a promising deep learning model for similar hydrological applications.


  • Open Access

    Comparative Analysis on Snowmelt-Driven Streamflow Forecasting Using Machine Learning Techniques

    by Ukesh Thapa, Bipun Man Pati, Samit Thapa, Dhiraj Pyakurel, Anup Shrestha

    The rapid advancement of machine learning techniques has led to their widespread application in various domains including water resources. However, snowmelt modeling remains an area that has not been extensively explored. In this study, we propose a state-of-the-art (SOTA) deep learning sequential model, leveraging the Temporal Convolutional Network (TCN), for snowmelt-driven discharge modeling in the Himalayan basin of the Hindu Kush Himalayan Region. To evaluate the performance of our proposed model, we conducted a comparative analysis with other popular models including Support Vector Regression (SVR), Long Short Term Memory (LSTM), and Transformer. Furthermore, Nested cross-validation (CV) is used with five outer folds and three inner folds, and hyper-parameter tuning is performed on the inner folds. To evaluate the performance of the model mean absolute error (MAE), root mean square error (RMSE), R square ($R^{2}$), Kling-Gupta Efficiency (KGE), and Nash-Sutcliffe Efficiency (NSE) are computed for each outer fold. The average metrics revealed that TCN outperformed the other models, with an average MAE of 0.011, RMSE of 0.023, $R^{2}$ of 0.991, KGE of 0.992, and NSE of 0.991. The findings of this study demonstrate the effectiveness of the deep learning model as compared to traditional machine learning approaches for snowmelt-driven streamflow forecasting. Moreover, the superior performance of TCN highlights its potential as a promising deep learning model for similar hydrological applications.