Adding artificial intelligence case malignancy scoring to reduce screen-reading workload in breast screening program: results of the retrospective REAI program
- 26 November 2025
- journal article
- research article
- Published by Springer Nature in La radiologia medica
- Vol. 131 (3) , 406-415
Abstract
Aim The AI case malignancy score (AI-CMS) represents the AI algorithm’s confidence (from 0 to 100%) that a mammography exam is malignant. This work aims to retrospectively evaluate, through simulation on real-world data, a strategy that integrates AI-CMS into a standard screening scenario to reduce the radiologists' workload. Methods A total of 89176 consecutive screening exams from the 2023–2024 Reggio Emilia Breast Screening Program (REBSP) were retrospectively considered, which included 479 biopsy-proven cancers (interval cancers were only partially available, therefore false negatives beyond those detected in the real screening workflow could not be assessed). In the proposed strategy, computer-aided detection (CAD) acts as a reader (CR), recalling women with an AI-CMS greater than a predefined threshold (ranging from 5 to 25%). If the first radiologist (HR1) disagrees with CR, the case goes to a second radiologist (HR2) and, in case of human disagreement, to a third radiologist (HR3). For each threshold, final recall rate (RR), cancer detection rate (CDR), number of detected cancers (DC), predictive positive value (PPV) of recalls, false positive rate (FPR), human reading workload, and economic impact were estimated. Results At AI-CMS thresholds of 5%, 8%, 10%, 15%, 20%, and 25%, human workload decrease ranged from 13.4% to 36.1%. The final RR decreased between 4.3% and 4.0%, slightly lower than the current 4.4% with human double reading. The PPV ranged from 12.6% to 13.3%, higher than the current PPV of 12.2%. The FPR ranged from 3.8% to 3.5%, down from the current 3.9%. With thresholds up to 5%, no true positive cases were missed, maintaining the CDR of 5.4‰ of those detected by current double reading. Considering CAD payback periods of either 6 or 8 years, financial savings from our strategy ranged from approximately 17800 to over 590,000€. Conclusion Integrating AI-CMS support into a standard screening scenario could substantially reduce the screen-reading workload and slightly reduce unnecessary ascertainments without affecting the cancer detection rate. This approach, although limited by its retrospective simulation design and the partial availability of interval cancer data, has also proven to be economically sustainable.Keywords
Funding Information
- Ministero della Salute
This publication has 37 references indexed in Scilit:
- Artificial intelligence for breast cancer detection in mammography and digital breast tomosynthesis: State of the artSeminars in Cancer Biology, 2021
- External Evaluation of 3 Commercial Artificial Intelligence Algorithms for Independent Assessment of Screening MammogramsJAMA Oncology, 2020
- Breast Cancer Screening and Diagnosis: A Synopsis of the European Breast GuidelinesAnnals of Internal Medicine, 2020
- International evaluation of an AI system for breast cancer screeningNature, 2020
- Double reading in breast cancer screening: considerations for policy-makingBritish Journal of Radiology, 2019
- Can we reduce the workload of mammographic screening by automatic identification of normal exams with artificial intelligence? A feasibility studyEuropean Radiology, 2019
- Stand-Alone Artificial Intelligence for Breast Cancer Detection in Mammography: Comparison With 101 RadiologistsJNCI: Journal of the National Cancer Institute, 2019
- Screening-detected Breast Cancers: Discordant Independent Double Reading in a Population-based Screening ProgramRadiology, 2009
- Guidelines for human papillomavirus DNA test requirements for primary cervical cancer screening in women 30 years and olderInternational Journal of Cancer, 2008
- Comparing Screening Mammography for Early Breast Cancer Detection in Vermont and NorwayJNCI: Journal of the National Cancer Institute, 2008