Easy ensemble classifier-group and intersectional fairness and threshold (EEC-GIFT): a fairness-aware machine learning framework for lung cancer screening eligibility using real-world data
Open Access
- 3 March 2025
- journal article
- Published by Oxford University Press (OUP) in JNCI Cancer Spectrum
- Vol. 9 (2)
Abstract
Background: We use real-world data to develop a lung cancer screening (LCS) eligibility mechanism that is both accurate and free from racial bias. Methods: Our data came from the Prostate, Lung, Colorectal, and Ovarian (PLCO) cancer screening trial. We built a systematic fairness-aware machine learning framework by integrating a Group and Intersectional Fairness and Threshold (GIFT) strategy with an easy ensemble classifier—(EEC-) or logistic regression—(LR-) based model. The best LCS eligibility mechanism EEC-GIFT* and LR-GIFT* were applied to the testing dataset and their performances were compared to the 2021 US Preventive Services Task Force (USPSTF) criteria and PLCOM2012 model. The equal opportunity difference (EOD) of developing lung cancer between Black and White smokers was used to evaluate mechanism fairness. Results: The fairness of LR-GIFT* or EEC-GIFT* during training was notably greater than that of the LR or EEC models without greatly reducing their accuracy. During testing, the EEC-GIFT* (85.16% vs 78.08%, P < .001) and LR-GIFT* (85.98% vs 78.08%, P < .001) models significantly improved sensitivity without sacrificing specificity compared to the 2021 USPSTF criteria. The EEC-GIFT* (0.785 vs 0.788, P = .28) and LR-GIFT* (0.785 vs 0.788, P = .30) showed similar area under receiver operating characteristic curve values compared to the PLCOM2012 model. While the average EODs between Blacks and Whites were significant for the 2021 USPSTF criteria (0.0673, P < .001), PLCOM2012 (0.0566, P < .001), and LR-GIFT* (0.0081, P < .001), the EEC-GIFT* model was unbiased (0.0034, P = .07). Conclusion: Our EEC-GIFT* LCS eligibility mechanism can significantly mitigate racial biases in eligibility determination without compromising its predictive performance.Keywords
Funding Information
- 2023 George Edgecomb Society Pilot Research
- Moffitt Cancer Center
- George Edgecomb Society
This publication has 29 references indexed in Scilit:
- Selection Criteria for Lung-Cancer ScreeningNew England Journal of Medicine, 2013
- Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAsFrontiers in Psychology, 2013
- Reduced Lung-Cancer Mortality with Low-Dose Computed Tomographic ScreeningNew England Journal of Medicine, 2011
- Exploratory Undersampling for Class-Imbalance LearningIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2008
- Ethnic and Racial Differences in the Smoking-Related Risk of Lung CancerNew England Journal of Medicine, 2006
- Lung cancer screeningCancer, 2000
- Design of the prostate, lung, colorectal and ovarian (PLCO) cancer screening trialControlled Clinical Trials, 2000
- Comparing the Areas under Two or More Correlated Receiver Operating Characteristic Curves: A Nonparametric ApproachBiometrics, 1988
- Index for rating diagnostic testsCancer, 1950
- Note on the Sampling Error of the Difference Between Correlated Proportions or PercentagesPsychometrika, 1947