Comparative analysis of artificial intelligence tools for the dissemination of colorectal cancer screening guidelines: a novel perspective on early screening education
Open Access
- 2 July 2025
- journal article
- research article
- Published by Wolters Kluwer Health in International Journal of Surgery
- Vol. 111 (11) , 8616-8620
Abstract
This study systematically evaluated the effectiveness of three artificial intelligence (AI) tools – ChatGPT-4o, Claude 3.5, and DeepSeek – in disseminating colorectal cancer screening guidelines to nonmedical populations. Using uniform instructions aligned with the Chinese Society of Clinical Oncology 2024 standards, the AI-generated content was analyzed for accuracy, clarity, and rigor, supplemented by a cross-evaluation mechanism to quantify performance. Key findings revealed that DeepSeek demonstrated superior regional adaptability and logical rigor, while requiring improvements in threshold accuracy; ChatGPT-4o exhibited outdated starting age criteria and oversimplified high-risk population screening protocols; and Claude 3.5 provided a comprehensive framework but lacked critical implementation details. All tools effectively translated complex medical guidelines into accessible language, underscoring AI’s potential in public health education. However, outputs necessitated clinical validation and ethical oversight to mitigate data biases. The study emphasizes AI’s role as an auxiliary tool for medical knowledge dissemination, advocating for continuous algorithmic optimization, multidisciplinary collaboration, and dynamic regulatory mechanisms to ensure alignment with evolving medical standards while balancing scientific precision and public accessibility.Keywords
This publication has 9 references indexed in Scilit:
- Benchmark evaluation of DeepSeek large language models in clinical decision-makingNature Medicine, 2025
- How China created AI model DeepSeek and shocked the worldNature, 2025
- Chinese firm’s large language model makes a splashScience, 2025
- The Chinese Society of Clinical Oncology (CSCO): Clinical guidelines for the diagnosis and treatment of colorectal cancer, 2024 updateCancer Communications, 2024
- Promotion of Knowledge and Trust Surrounding Scarce Resource Allocation PoliciesJAMA Health Forum, 2024
- The performance of large language model-powered chatbots compared to oncology physicians on colorectal cancer queriesInternational Journal of Surgery, 2024
- ChatGPT in medicine: prospects and challenges: a review articleInternational Journal of Surgery, 2024
- ChatGPT and Generative Artificial Intelligence for Medical Education: Potential Impact and OpportunityAcademic Medicine, 2023
- Screening and prevention of colorectal cancerBMJ, 2021