JADE: Jawbone Lesion Diagnosis and Decision Supporting System
Preprint
Abstract
Objectives: To develop and evaluate JADE, a proof-of-concept retrieval-augmented generation (RAG) diagnostic assistive system was designed to enhance large language model (LLM) reasoning for the assessment of jawbone lesions. This study examined whether integrating structured retrieval with GPT-5 improves diagnostic accuracy and stability compared with standalone LLMs. Methods: JADE was developed as a cloud-based application integrating GPT-5 with a curated oral radiology and pathology database using a hybrid semantic-keyword retrieval strategy. Clinical and radiographic characteristics were imported as a structured query to guide retrieval and support diagnostic reasoning. Performance was compared with standalone GPT-5, Claude Sonnet 4.5, DeepSeek-R1, and Gemini 2.5 Flash across 25 cases. Accuracy was analysed using Cochran’s Q test with post-hoc McNemar’s tests and Bonferroni correction. Intra-model stability was measured using the majority agreement ratio, and response time was recorded to assess real-time usability. Results: JADE showed the highest diagnostic performance, correctly identifying 20 out of 25 cases and outperforming all standalone LLMs. Significant differences were observed across models (Cochran’s Q = 33.2, df = 4, p < 0.001), with post-hoc analyses confirming that JADE significantly outperformed GPT-5, Gemini 2.5 Flash, and Claude Sonnet 4.5 ( p < 0.01). JADE also exhibited the greatest run-to-run stability (mean MAR = 0.90 ± 0.18). The average prediction time of 6 ± 0.5 seconds supported its feasibility for real-time clinical use. Conclusions: JADE improved diagnostic accuracy and stability over standalone LLMs, underscoring the value of RAG reasoning in jawbone lesion assessment and its potential for real-time clinical use.Keywords
This publication has 22 references indexed in Scilit:
- Automated classification of panoramic radiographs with inflammatory periapical lesions using a CNN-LSTM architectureJournal of Dentistry, 2025
- Evaluation of the ability of large language models to self-diagnose oral diseasesiScience, 2024
- Large language models in periodontology: Assessing their performance in clinically relevant questionsThe Journal of Prosthetic Dentistry, 2024
- Concordance of clinician, Chat-GPT4, and ORAD diagnoses against histopathology in Odontogenic Keratocysts and tumours: a 15-Year New Zealand retrospective studyOral and Maxillofacial Surgery, 2024
- A review: Exploring the role of ChatGPT in the diagnosis and treatment of oral pathologiesOral Oncology Reports, 2024
- A deep learning approach for radiological detection and classification of radicular cysts and periapical granulomasJournal of Dentistry, 2023
- Oral and Maxillofacial Radiology2019
- Bone-Related Lesions of the JawsSurgical Pathology Clinics, 2017
- Cysts of the Oral and Maxillofacial Regions2007
- An analysis of oral and maxillofacial pathology found in adults over a 30‐year periodJournal of Oral Pathology & Medicine, 2006