Auto Response Generation in Online Medical Chat Services
Authors:
- 15 July 2022
- journal article
- research article
- Published by Springer Nature in Journal of Healthcare Informatics Research
- Vol. 6 (3) , 344-374
Abstract
Telehealth helps to facilitate access to medical professionals by enabling remote medical services for the patients. These services have become gradually popular over the years with the advent of necessary technological infrastructure. The benefits of telehealth have been even more apparent since the beginning of the COVID-19 crisis, as people have become less inclined to visit doctors in person during the pandemic. In this paper, we focus on facilitating chat sessions between a doctor and a patient. We note that the quality and efficiency of the chat experience can be critical as the demand for telehealth services increases. Accordingly, we develop a smart auto-response generation mechanism for medical conversations that helps doctors respond to consultation requests efficiently, particularly during busy sessions. We explore over 900,000 anonymous, historical online messages between doctors and patients collected over 9 months. We implement clustering algorithms to identify the most frequent responses by doctors and manually label the data accordingly. We then train machine learning algorithms using this preprocessed data to generate the responses. The considered algorithm has two steps: a filtering (i.e., triggering) model to filter out infeasible patient messages and a response generator to suggest the top-3 doctor responses for the ones that successfully pass the triggering phase. Among the models utilized, BERT provides an accuracy of 85.41% for precision@3 and shows robustness to its parameters.Keywords
All Related Versions
Funding Information
- Mitacs (IT18383)
This publication has 41 references indexed in Scilit:
- A Chatbot for Psychiatric Counseling in Mental Healthcare Service Based on Emotional Dialogue Analysis and Sentence Generation2017
- Artificial intelligence in medicineMetabolism, 2017
- XGBoost2016
- Smart Reply2016
- A Picture is Worth a Thousand Words2016
- ECNU: Using Traditional Similarity Measurements and Word Embedding for Semantic Textual Similarity Estimation2015
- Effective Approaches to Attention-based Neural Machine Translation2015
- Glove: Global Vectors for Word Representation2014
- Class-indexing-based term weighting for automatic text classificationInformation Sciences, 2013
- Text categorization with Support Vector Machines: Learning with many relevant features1998