Chatbot on LINE Application Using Natural Language Processing for Providing Preliminary Solutions in the Use of Medical Equipment for Healthcare Facilities
Authors:
- 2 April 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
This research aims to develop a chatbot on the LINE platform, incorporating Natural Language Processing (NLP) techniques to provide guidance and assist in troubleshooting medical equipment usage within healthcare settings. The proposed system integrates the large language model LLAMA-3.1-8B-Instruct, a vector database, and the LINE Messaging API to enhance the chatbot's capacity to understand user queries and retrieve relevant information swiftly and accurately. The development process emphasizes enabling the chatbot to analyze the context of queries, identify pertinent information, and deliver responses that are both accurate and consistent with medical equipment manuals. The system was evaluated through a series of 30 simulated scenarios, representing common issues encountered in medical equipment use. Evaluation metrics included N-gram Precision, and the performance of the system was assessed through BLEU Score, ROUGE Score, and F1-Score. The results demonstrated that the chatbot provided correct and comprehensive responses in all cases, achieving a BLEU Score of 0.80, a ROUGE Score of 0.83, and an F1-Score of 0.81. These findings indicate that the developed chatbot system possesses significant potential to alleviate the workload of healthcare professionals, reduce the time required to locate information, and enhance the efficiency of patient services. The system provides rapid, accurate, and relevant assistance with medical equipment usage and troubleshooting, aligning with the specific needs of healthcare environments that demand both accuracy and timely responses.Keywords
This publication has 13 references indexed in Scilit:
- Vector Databases and Vector Embeddings-Review2023
- Thai Paraphrasing Tool for Chatbot Intent Recognition Training2022
- LAW-U: Legal Guidance Through Artificial Intelligence Chatbot for Sexual Violence Victims and SurvivorsIEEE Access, 2021
- Text data-augmentation using Text Similarity with Manhattan Siamese long short-term memory for Thai languageJournal of Physics: Conference Series, 2021
- Natural language processing (NLP) in management research: A literature reviewJournal of Management Analytics, 2020
- A Consideration of Evaluation Method of Sentiment Analysis on Social ListeningProcedia Computer Science, 2019
- On Splitting Training and Validation Set: A Comparative Study of Cross-Validation, Bootstrap and Systematic Sampling for Estimating the Generalization Performance of Supervised LearningJournal of Analysis and Testing, 2018
- Introduction to Information Retrieval2008
- Natural language processingAnnual Review of Information Science and Technology, 2003
- Induction of Decision TreesMachine Learning, 1986