Shreyanth H. Giriyappa
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Shreyanth H. Giriyappa has a total of 5 co-authors. Here are the top co-authors by number of shared publications:
- Abdullah M. Basahel
Faculty of Economics and Administration, King Abdulaziz University, Jeddah 21589, Saudi Arabia
1 shared publication - Adnan Ahmed Abi Sen
Hussein ElSayyed Research and Innovation Center, Deanship of Scientific Research and Graduate Studies, University of Prince Mugrin, Madinah 42241, Saudi Arabia
1 shared publication - Furqan Alam
Faculty of Computing and Information Technology (FoCIT), Sohar University, Sohar 311, Oman
1 shared publication - Saqib Qamar
Department of Intelligent Systems, KTH Royal Institute of Technology, 10044 Stockholm, Sweden
1 shared publication - Tahani Saleh Mohammed Alnazzawi
Department of Computer Science, College of Computer Science and Engineering, Taibah University, Madinah 41477, Saudi Arabia
1 shared publication
Latest Publications
- Open Access
A Resource-Efficient Approach to Fine-Tuning a BERT-Base Model for Sentiment Analysis
Fine-tuning a BERT-Base model for specific tasks, such as sentiment analysis, has become resource-intensive and often requires high computational power and memory. This paper introduces SCALE, a novel resource-efficient fine-tuning method that targets the most critical transformer layers, which reduces computational costs without sacrificing performance. By dynamically profiling transformer layers via activation magnitudes and attention entropy, SCALE selects and adapts only the most influential layers with lightweight adapter modules. The proposed method outperforms traditional fine-tuning techniques, achieving a 2.3% improvement in accuracy on the IMDB dataset and reducing training time by 56.3% compared to full-model fine-tuning. Experiments across various sentiment analysis benchmarks demonstrate SCALE’s effectiveness in optimizing fine-tuning for the BERT-base model in resource-constrained environments, achieving up to 99% of the performance of full-model fine-tuning while using only 40% of the parameters. The empirical validation in this study is restricted to binary and multi-class sentiment classification. The evaluation specifically reflects effectiveness in sentiment analysis text classification tasks.
Open AccessA Resource-Efficient Approach to Fine-Tuning a BERT-Base Model for Sentiment Analysis
Fine-tuning a BERT-Base model for specific tasks, such as sentiment analysis, has become resource-intensive and often requires high computational power and memory. This paper introduces SCALE, a novel resource-efficient fine-tuning method that targets the most critical transformer layers, which reduces computational costs without sacrificing performance. By dynamically profiling transformer layers via activation magnitudes and attention entropy, SCALE selects and adapts only the most influential layers with lightweight adapter modules. The proposed method outperforms traditional fine-tuning techniques, achieving a 2.3% improvement in accuracy on the IMDB dataset and reducing training time by 56.3% compared to full-model fine-tuning. Experiments across various sentiment analysis benchmarks demonstrate SCALE’s effectiveness in optimizing fine-tuning for the BERT-base model in resource-constrained environments, achieving up to 99% of the performance of full-model fine-tuning while using only 40% of the parameters. The empirical validation in this study is restricted to binary and multi-class sentiment classification. The evaluation specifically reflects effectiveness in sentiment analysis text classification tasks.