Uncertainty Detection: A Multi-View Decision Boundary Approach Against Healthcare Unknown Intents
Open Access
- 24 June 2025
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 15 (13) , 7114
Abstract
Chatbots, an automatic dialogue system empowered by deep learning-oriented AI technology, have gained increasing attention in healthcare e-services for their ability to provide medical information around the clock. A formidable challenge is that chatbot dialogue systems have difficulty handling queries with unknown intents due to the technical bottleneck and restricted user-intent answering scope. Furthermore, the wide variation in a user’s consultation needs and levels of medical knowledge further complicates the chatbot’s ability to understand natural human language. Failure to deal with unknown intents may lead to a significant risk of incorrect information acquisition. In this study, we develop an unknown intent detection model to facilitate chatbots’ decisions in responding to uncertain queries. Our work focuses on algorithmic innovation for high-risk healthcare scenarios, where asymmetric knowledge between patients and experts exacerbates intent recognition challenges. Given the multi-role context, we propose a novel query representation learning approach involving multiple views from chatbot users, medical experts, and system developers. Unknown intent detection is then accomplished through the transformed representation of each query, leveraging adaptive determination of intent decision boundaries. We conducted laboratory-level experiments and empirically validated the proposed method based on the real-world user query data from the Tianchi lab and medical information from the Xunyiwenyao website. Across all tested unknown intent ratios (25%, 50%, and 75%), our multi-view boundary learning method was proven to outperform all benchmark models on the metrics of accuracy score, macro F1-score, and macro F1-scores over known intent classes and over the unknown intent class.Keywords
Funding Information
- Research Grants Council of the Hong Kong Special Administrative Region (CityU 11507323)
This publication has 48 references indexed in Scilit:
- Business chatbots with deep learning technologies: state-of-the-art, taxonomies, and future research directionsArtificial Intelligence Review, 2024
- Healthcare Conversational Agents: Chatbot for Improving Patient-Reported Outcomes2023
- ChatGPT for healthcare services: An emerging stage for an innovative perspectiveBenchCouncil Transactions on Benchmarks, Standards and Evaluations, 2023
- The Future of AI in Medicine: A Perspective from a ChatbotAnnals of Biomedical Engineering, 2022
- Chatbot breakthrough in the 2020s? An ethical reflection on the trend of automated consultations in health careMedicine, Health Care and Philosophy, 2021
- The digital transformation of the healthcare industry: exploring the rise of emerging platform ecosystems and their influence on the role of patientsBusiness Research, 2020
- A post-processing method for detecting unknown intent of dialogue system via pre-trained deep neural network classifierKnowledge-Based Systems, 2019
- A Decade of Health Information Technology Usability Challenges and the Path ForwardJAMA, 2019
- The internet-based knowledge acquisition and management method to construct large-scale distributed medical expert systemsComputer Methods and Programs in Biomedicine, 2004
- Extending the social information processing perspective: New links to attitudes, behaviors, and perceptionsOrganizational Behavior and Human Decision Processes, 1990