LuminaURO: A comprehensive Artificial Intelligence Driven Assistant for enhancing urological diagnostics and patient care
Authors:
- Tuncay SoyluTSTuncay Soylu
- İbRahim TopçuITİbRahim Topçu
- Muhammet İhSan KaramanMKMuhammet İhSan Karaman
- Esra Melis TuzcuETEsra Melis Tuzcu
- Abdullah Harun KınıkAKAbdullah Harun Kınık
- Mustafa Sacit GünerenMGMustafa Sacit Güneren
- Zeynep SalmanZSZeynep Salman
- Perihan DemirPDPerihan Demir
- Beyzanur KaçBKBeyzanur Kaç
Open Access
- 29 May 2025
- journal article
- Published by Anadolu Klinigi Tip Bilimleri Dergisi in Anadolu Kliniği Tıp Bilimleri Dergisi
- Vol. 30 (2) , 278-294
Abstract
Aim: This study aims to develop and validate LuminaURO, a Retrieval-Augmented Generation (RAG)-based AI Assistant specifically designed for urological healthcare, addressing the limitations of conventional Large Language Models (LLMs) in healthcare applications. Methods: We developed LuminaURO using a specialized repository of urological documents and implemented a novel pooling methodology to search multilingual documents and aggregate information for response generation. The system was evaluated using multiple similarity algorithms (OESM, Spacy, T5, and BERTScore) and expert assessment by urologists (n=3). Results: LuminaURO generates responses within 8-15 seconds from multilingual documents and enhances user interaction by providing two contextually relevant follow-up questions per query. The architecture demonstrates significant improvements in search latency, memory requirements, and similarity metrics compared to state-of-the-art approaches. Validation shows similarity scores of 0.6756, 0.7206, 0.9296, 0.9223, and 0.9183 for English responses, and 0.6686, 0.7166, 0.8119, 0.9220, 0.9315, and 0.9086 for Turkish responses. Expert evaluation by urologists revealed similarity scores of 0.9444 and 0.9408 for English and Turkish responses, respectively. Conclusion: LuminaURO successfully addresses the limitations of conventional LLM implementations in healthcare by utilizing specialized urological documents and our innovative pooling methodology for multi-language document processing. The high similarity scores across multiple evaluation metrics and strong expert validation confirm the system’s effectiveness in providing accurate and relevant urological information. Future research will focus on expanding this approach to other medical specialties, with the ultimate goal of developing LuminaHealth, a comprehensive healthcare assistant covering all medical domains.Keywords
This publication has 39 references indexed in Scilit:
- Development and Evaluation of a Retrieval-Augmented Large Language Model Framework for OphthalmologyJAMA Ophthalmology, 2024
- MedExpQA: Multilingual benchmarking of Large Language Models for Medical Question AnsweringArtificial Intelligence in Medicine, 2024
- ChatENT: Augmented Large Language Model for Expert Knowledge Retrieval in Otolaryngology–Head and Neck SurgeryOtolaryngology–Head and Neck Surgery, 2024
- Transformers and large language models in healthcare: A reviewArtificial Intelligence in Medicine, 2024
- Accuracy and consistency of online large language model-based artificial intelligence chat platforms in answering patients' questions about heart failureInternational Journal of Cardiology, 2024
- Urology consultants versus large language models: Potentials and hazards for medical advice in urologyBJUI Compass, 2024
- Quality of Large Language Model Responses to Radiation Oncology Patient Care QuestionsJAMA Network Open, 2024
- Assessment of a Large Language Model’s Responses to Questions and Cases About Glaucoma and Retina ManagementJAMA Ophthalmology, 2024
- Leveraging Large Language Models for Decision Support in Personalized OncologyJAMA Network Open, 2023
- Comparison of Ophthalmologist and Large Language Model Chatbot Responses to Online Patient Eye Care QuestionsJAMA Network Open, 2023