An Emotion Text Classification Model Based on Llama3-8b Using Lora Technique
Authors:
- 12 July 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 380-383
Abstract
This study introduces a method utilizing the Llama3-8b model for emotion text classification. The training process is accelerated by incorporating Lora and FlashAttention techniques. On an emotion text dataset containing six categories, our improved Llama3-8b model demonstrates superior performance in emotion classification, surpassing other transformer models including Bert-Base, Bert-Large, Roberta-Base, and Roberta-Large. The Llama3-8b model, fine-tuned with supervised learning, achieved an accuracy of 0.9262, outperforming all other models and highlighting the advantages of large language models in classification tasks. This study illustrates the potential of specialized fine-tuning techniques in enhancing the performance of language models in domain-specific tasks, particularly in emotion text classification.Keywords
This publication has 6 references indexed in Scilit:
- An Intelligent Chatbot Using NLP and TF-IDF Algorithm for Text Understanding Applied to the Medical Field2021
- A Novel Hybrid Deep Learning Model for Sentiment ClassificationIEEE Access, 2020
- Comparative Study of Deep Learning-Based Sentiment ClassificationIEEE Access, 2020
- A sentiment classification model based on multiple classifiersApplied Soft Computing, 2017
- A multi-label classification based approach for sentiment classificationExpert Systems with Applications, 2015
- Sentiment Classification of Reviews Using SentiWordNet