Ali Keles
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Ali Keles has a total of 22 co-authors. Here are the top co-authors by number of shared publications:
- Burak Kocak
Department of Radiology, Basaksehir Cam and Sakura City Hospital, Istanbul, Turkey
8 shared publications - Fadime Kose
University of Health Sciences, Başakşehir Çam and Sakura City Hospital, Department of Radiology, İstanbul, Türkiye
5 shared publications - Ismail Mese
Department of Radiology, Uskudar State Hospital, Istanbul, Turkey
3 shared publications - Abdurrezzak Şendur
University of Health Sciences, Başakşehir Çam and Sakura City Hospital, Department of Radiology, İstanbul, Türkiye
2 shared publications - Muhammed Faruk Kazanbas
Department of Radiology, Basaksehir Cam and Sakura City Hospital, Basaksehir, Turkey
2 shared publications - Ozge Coskun
Department of Radiology, Basaksehir Cam and Sakura City Hospital, İstanbul, Türkiye
2 shared publications
Latest Publications
- Open Access
- 12 May 2026
- Published by Springer Nature in BMC Medical Informatics and Decision Making
- Vol. 26 (1)
Benchmarking large language models in breast cancer care: agreement with radiology-led multidisciplinary tumor board decisions
Multidisciplinary tumor boards (MDTBs) play a central role in breast cancer management by integrating imaging findings with clinical and pathological infor
- 12 May 2026
- Published by Springer Nature in BMC Medical Informatics and Decision Making
- Vol. 26 (1)
Open AccessBenchmarking large language models in breast cancer care: agreement with radiology-led multidisciplinary tumor board decisions
Multidisciplinary tumor boards (MDTBs) play a central role in breast cancer management by integrating imaging findings with clinical and pathological infor
- 23 April 2026
- Published by Springer Nature in European Radiology
- Vol. 36 (9) , 1-13
Externally validated yet undertrained: sample size deficits in machine learning-based radiomics
Objective To systematically evaluate training sample size adequacy in externally validated machine learning (ML)-based radiomics models published in high-impact journals and quantify the gap between current practice and theoretical minimum requirements. Materials and methods This study followed a prespecified and publicly archived protocol. Original research articles published between January 2023 and August 2025 in first quartile (Q1) journals were evaluated. Study selection followed a randomized dynamic screening protocol with a priori power-calculated stopping rule to determine the final cohort. Included studies developed binary prediction models using ML algorithms other than logistic regression and reported external validation. A sample size framework, originally developed for logistic regression, was applied as a conservative lower-bound benchmark. Minimum required sample sizes were calculated based on reported training performance, outcome prevalence, and feature dimensionality. Results Of 64 full-text records assessed, 16 (25%) were unassessable due to missing essential parameters (e.g., feature counts) required for sample size estimation. In the assessable final cohort (n = 28), the training sample sizes observed were consistently inadequate, with a median deficit of 195.5 training instances. Only three studies (10.7%) met all criteria for stable prediction model development even under these charitable assumptions. Most studies failed basic heuristics (e.g., 10 events per predictor), with a median events per predictor deficit of 5.8. Conclusion The vast majority of externally validated radiomics models in high-impact journals are trained on datasets statistically insufficient to support their algorithmic complexity. This systemic data deficit renders models prone to overfitting and instability, potentially explaining the field’s reproducibility crisis. Key Points Question Do externally validated machine learning-based radiomics models in high-impact (Q1) journals have sufficient training sample sizes to support their reported model complexity? Findings Nearly 90% of externally validated radiomics models were trained on statistically insufficient datasets, with a median deficit of approximately 200 training instances. Clinical relevance Insufficient training sample sizes undermine model stability and contribute to the reproducibility crisis in radiomics, allowing externally validated models to appear robust while generating unreliable predictions that may misinform clinical decision-making. Graphical Abstract The alternative text for this image may have been generated using AI.
- 23 April 2026
- Published by Springer Nature in European Radiology
- Vol. 36 (9) , 1-13
Externally validated yet undertrained: sample size deficits in machine learning-based radiomics
Objective To systematically evaluate training sample size adequacy in externally validated machine learning (ML)-based radiomics models published in high-impact journals and quantify the gap between current practice and theoretical minimum requirements. Materials and methods This study followed a prespecified and publicly archived protocol. Original research articles published between January 2023 and August 2025 in first quartile (Q1) journals were evaluated. Study selection followed a randomized dynamic screening protocol with a priori power-calculated stopping rule to determine the final cohort. Included studies developed binary prediction models using ML algorithms other than logistic regression and reported external validation. A sample size framework, originally developed for logistic regression, was applied as a conservative lower-bound benchmark. Minimum required sample sizes were calculated based on reported training performance, outcome prevalence, and feature dimensionality. Results Of 64 full-text records assessed, 16 (25%) were unassessable due to missing essential parameters (e.g., feature counts) required for sample size estimation. In the assessable final cohort (n = 28), the training sample sizes observed were consistently inadequate, with a median deficit of 195.5 training instances. Only three studies (10.7%) met all criteria for stable prediction model development even under these charitable assumptions. Most studies failed basic heuristics (e.g., 10 events per predictor), with a median events per predictor deficit of 5.8. Conclusion The vast majority of externally validated radiomics models in high-impact journals are trained on datasets statistically insufficient to support their algorithmic complexity. This systemic data deficit renders models prone to overfitting and instability, potentially explaining the field’s reproducibility crisis. Key Points Question Do externally validated machine learning-based radiomics models in high-impact (Q1) journals have sufficient training sample sizes to support their reported model complexity? Findings Nearly 90% of externally validated radiomics models were trained on statistically insufficient datasets, with a median deficit of approximately 200 training instances. Clinical relevance Insufficient training sample sizes undermine model stability and contribute to the reproducibility crisis in radiomics, allowing externally validated models to appear robust while generating unreliable predictions that may misinform clinical decision-making. Graphical Abstract The alternative text for this image may have been generated using AI.
- Open Access
- 1 January 2026
- Published by XMLink in Korean Journal of Radiology
- Vol. 27 (9) , 829
Reporting Quality of Large Language Model Studies: A Cross-Sectional Audit of High-Ranking Radiology and Medical Imaging Journals
Mese I, et al. Korean J Radiol. 2026 ;27:e72. https://doi.org/10.3348/kjr.2026.0505
- 1 January 2026
- Published by XMLink in Korean Journal of Radiology
- Vol. 27 (9) , 829
Open AccessReporting Quality of Large Language Model Studies: A Cross-Sectional Audit of High-Ranking Radiology and Medical Imaging Journals
Mese I, et al. Korean J Radiol. 2026 ;27:e72. https://doi.org/10.3348/kjr.2026.0505
- Open Access
- 10 February 2025
- Published by Galenos Yayinevi in Diagnostic and Interventional Radiology
- Vol. 31 (5) , 440-455
Adherence to the Checklist for Artificial Intelligence in Medical Imaging (CLAIM): an umbrella review with a comprehensive two-level analysis
Adherence to the Checklist for Artificial Intelligence in Medical Imaging (CLAIM): an umbrella review with a comprehensive two-level analysis - Diagnostic and Interventional Radiology
- 10 February 2025
- Published by Galenos Yayinevi in Diagnostic and Interventional Radiology
- Vol. 31 (5) , 440-455
Open AccessAdherence to the Checklist for Artificial Intelligence in Medical Imaging (CLAIM): an umbrella review with a comprehensive two-level analysis
Adherence to the Checklist for Artificial Intelligence in Medical Imaging (CLAIM): an umbrella review with a comprehensive two-level analysis - Diagnostic and Interventional Radiology
- 6 September 2024
- Published by Springer Nature in European Radiology
- Vol. 35 (4) , 1980-1992
Quality of radiomics research: comprehensive analysis of 1574 unique publications from 89 reviews
Purpose This study aims to comprehensively evaluate the quality of radiomics research by examining unique papers from reviews using the radiomics quality score (RQS). Methods A literature search was conducted in PubMed (last search date: April 14, 2024). Systematic or non-systematic reviews using the RQS to evaluate radiomic studies were potentially included. Exclusion was applied at two levels: first, at the review level, and second, at the study level (i.e., for the individual articles previously evaluated within the reviews). Score-wise and item-wise analyses were performed, along with trend, multivariable, and subgroup analyses based on baseline study characteristics and validation methods. Results A total of 1574 unique papers (published online between 1999 and 2023) from 89 reviews were included in the final analysis. The median RQS percentage was 31% with an IQR of 25% (25th–75th percentiles, 14–39%). A positive correlation between median RQS percentage and publication year (2014–2023) was found, with Kendall’s tau coefficient of 0.908 (p < 0.001), suggesting an improvement in quality over time. The quality of radiomics publications significantly varied according to different subfields of radiology (p < 0.001). Around one-third of the publications (32%) lacked a separate validation set. Papers with internal validation (54%) dominated those with external validation (14%). Higher-quality validation practices were significantly associated with better RQS percentage scores, independent of the validation’s effect on the final score. Item-wise analysis revealed significant shortcomings in several areas. Conclusion Radiomics research quality is low but improving according to RQS. Significant variation exists across radiology subfields. Critical areas were identified for targeted improvement. Clinical relevance statement Our study shows that the quality of radiomics research is generally low but improving over time, with item-wise analysis highlighting critical areas needing improvement. It also reveals that the quality of radiomics research differs across subfields and validation methods. Key Points Overall quality of radiomics research remains low and highly variable, although a significant positive trend suggests an improvement in quality over time. Considerable variations exist in the quality of radiomics publications across different subfields of radiology and validation types. The item-wise analysis highlights several critical areas requiring attention, emphasizing the need for targeted improvements. Graphical abstract
- 6 September 2024
- Published by Springer Nature in European Radiology
- Vol. 35 (4) , 1980-1992
Quality of radiomics research: comprehensive analysis of 1574 unique publications from 89 reviews
Purpose This study aims to comprehensively evaluate the quality of radiomics research by examining unique papers from reviews using the radiomics quality score (RQS). Methods A literature search was conducted in PubMed (last search date: April 14, 2024). Systematic or non-systematic reviews using the RQS to evaluate radiomic studies were potentially included. Exclusion was applied at two levels: first, at the review level, and second, at the study level (i.e., for the individual articles previously evaluated within the reviews). Score-wise and item-wise analyses were performed, along with trend, multivariable, and subgroup analyses based on baseline study characteristics and validation methods. Results A total of 1574 unique papers (published online between 1999 and 2023) from 89 reviews were included in the final analysis. The median RQS percentage was 31% with an IQR of 25% (25th–75th percentiles, 14–39%). A positive correlation between median RQS percentage and publication year (2014–2023) was found, with Kendall’s tau coefficient of 0.908 (p < 0.001), suggesting an improvement in quality over time. The quality of radiomics publications significantly varied according to different subfields of radiology (p < 0.001). Around one-third of the publications (32%) lacked a separate validation set. Papers with internal validation (54%) dominated those with external validation (14%). Higher-quality validation practices were significantly associated with better RQS percentage scores, independent of the validation’s effect on the final score. Item-wise analysis revealed significant shortcomings in several areas. Conclusion Radiomics research quality is low but improving according to RQS. Significant variation exists across radiology subfields. Critical areas were identified for targeted improvement. Clinical relevance statement Our study shows that the quality of radiomics research is generally low but improving over time, with item-wise analysis highlighting critical areas needing improvement. It also reveals that the quality of radiomics research differs across subfields and validation methods. Key Points Overall quality of radiomics research remains low and highly variable, although a significant positive trend suggests an improvement in quality over time. Considerable variations exist in the quality of radiomics publications across different subfields of radiology and validation types. The item-wise analysis highlights several critical areas requiring attention, emphasizing the need for targeted improvements. Graphical abstract
- Open Access
- 20 February 2024
- Published by Galenos Yayinevi in Diagnostic and Interventional Radiology
- Vol. 30 (5) , 291-298
Meta-research on reporting guidelines for artificial intelligence: are authors and reviewers encouraged enough in radiology, nuclear medicine, and medical imaging journals?
Purpose To determine how radiology, nuclear medicine, and medical imaging journals encourage and mandate the use of reporting guidelines for artificial intelligence (AI) in their author and reviewer instructions. Methods The primary source of journal information and associated citation data used was the Journal Citation Reports (June 2023 release for 2022 citation data; Clarivate Analytics, UK). The first- and second-quartile journals indexed in the Science Citation Index Expanded and the Emerging Sources Citation Index were included. The author and reviewer instructions were evaluated by two independent readers, followed by an additional reader for consensus, with the assistance of automatic annotation. Encouragement and submission requirements were systematically analyzed. The reporting guidelines were grouped as AI-specific, related to modeling, and unrelated to modeling. Results Out of 102 journals, 98 were included in this study, and all of them had author instructions. Only five journals (5%) encouraged the authors to follow AI-specific reporting guidelines. Among these, three required a filled-out checklist. Reviewer instructions were found in 16 journals (16%), among which one journal (6%) encouraged the reviewers to follow AI-specific reporting guidelines without submission requirements. The proportions of author and reviewer encouragement for AI-specific reporting guidelines were statistically significantly lower compared with those for other types of guidelines (P < 0.05 for all). Conclusion The findings indicate that AI-specific guidelines are not commonly encouraged and mandated (i.e., requiring a filled-out checklist) by these journals, compared with guidelines related to modeling and unrelated to modeling, leaving vast space for improvement. This meta-research study hopes to contribute to the awareness of the imaging community for AI reporting guidelines and ignite large-scale group efforts by all stakeholders, making AI research less wasteful. Clinical significance This meta-research highlights the need for improved encouragement of AI-specific guidelines in radiology, nuclear medicine, and medical imaging journals. This can potentially foster greater awareness among the AI community and motivate various stakeholders to collaborate to promote more efficient and responsible AI research reporting practices.
- 20 February 2024
- Published by Galenos Yayinevi in Diagnostic and Interventional Radiology
- Vol. 30 (5) , 291-298
Open AccessMeta-research on reporting guidelines for artificial intelligence: are authors and reviewers encouraged enough in radiology, nuclear medicine, and medical imaging journals?
Purpose To determine how radiology, nuclear medicine, and medical imaging journals encourage and mandate the use of reporting guidelines for artificial intelligence (AI) in their author and reviewer instructions. Methods The primary source of journal information and associated citation data used was the Journal Citation Reports (June 2023 release for 2022 citation data; Clarivate Analytics, UK). The first- and second-quartile journals indexed in the Science Citation Index Expanded and the Emerging Sources Citation Index were included. The author and reviewer instructions were evaluated by two independent readers, followed by an additional reader for consensus, with the assistance of automatic annotation. Encouragement and submission requirements were systematically analyzed. The reporting guidelines were grouped as AI-specific, related to modeling, and unrelated to modeling. Results Out of 102 journals, 98 were included in this study, and all of them had author instructions. Only five journals (5%) encouraged the authors to follow AI-specific reporting guidelines. Among these, three required a filled-out checklist. Reviewer instructions were found in 16 journals (16%), among which one journal (6%) encouraged the reviewers to follow AI-specific reporting guidelines without submission requirements. The proportions of author and reviewer encouragement for AI-specific reporting guidelines were statistically significantly lower compared with those for other types of guidelines (P < 0.05 for all). Conclusion The findings indicate that AI-specific guidelines are not commonly encouraged and mandated (i.e., requiring a filled-out checklist) by these journals, compared with guidelines related to modeling and unrelated to modeling, leaving vast space for improvement. This meta-research study hopes to contribute to the awareness of the imaging community for AI reporting guidelines and ignite large-scale group efforts by all stakeholders, making AI research less wasteful. Clinical significance This meta-research highlights the need for improved encouragement of AI-specific guidelines in radiology, nuclear medicine, and medical imaging journals. This can potentially foster greater awareness among the AI community and motivate various stakeholders to collaborate to promote more efficient and responsible AI research reporting practices.
- 5 January 2024
- Published by Springer Nature in European Radiology
- Vol. 34 (8) , 5028-5040
Self-reported checklists and quality scoring tools in radiomics: a meta-research
Objective To evaluate the use of reporting checklists and quality scoring tools for self-reporting purposes in radiomics literature. Methods Literature search was conducted in PubMed (date, April 23, 2023). The radiomics literature was sampled at random after a sample size calculation with a priori power analysis. A systematic assessment for self-reporting, including the use of documentation such as completed checklists or quality scoring tools, was conducted in original research papers. These eligible papers underwent independent evaluation by a panel of nine readers, with three readers assigned to each paper. Automatic annotation was used to assist in this process. Then, a detailed item-by-item confirmation analysis was carried out on papers with checklist documentation, with independent evaluation of two readers. Results The sample size calculation yielded 117 papers. Most of the included papers were retrospective (94%; 110/117), single-center (68%; 80/117), based on their private data (89%; 104/117), and lacked external validation (79%; 93/117). Only seven papers (6%) had at least one self-reported document (Radiomics Quality Score (RQS), Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD), or Checklist for Artificial Intelligence in Medical Imaging (CLAIM)), with a statistically significant binomial test (p < 0.001). Median rate of confirmed items for all three documents was 81% (interquartile range, 6). For quality scoring tools, documented scores were higher than suggested scores, with a mean difference of − 7.2 (standard deviation, 6.8). Conclusion Radiomic publications often lack self-reported checklists or quality scoring tools. Even when such documents are provided, it is essential to be cautious, as the accuracy of the reported items or scores may be questionable. Clinical relevance statement Current state of radiomic literature reveals a notable absence of self-reporting with documentation and inaccurate reporting practices. This critical observation may serve as a catalyst for motivating the radiomics community to adopt and utilize such tools appropriately, thereby fostering rigor, transparency, and reproducibility of their research, moving the field forward. Key Points • In radiomics literature, there has been a notable absence of self-reporting with documentation. • Even if such documents are provided, it is critical to exercise caution because the accuracy of the reported items or scores may be questionable. • Radiomics community needs to be motivated to adopt and appropriately utilize the reporting checklists and quality scoring tools. Graphical Abstract
- 5 January 2024
- Published by Springer Nature in European Radiology
- Vol. 34 (8) , 5028-5040
Self-reported checklists and quality scoring tools in radiomics: a meta-research
Objective To evaluate the use of reporting checklists and quality scoring tools for self-reporting purposes in radiomics literature. Methods Literature search was conducted in PubMed (date, April 23, 2023). The radiomics literature was sampled at random after a sample size calculation with a priori power analysis. A systematic assessment for self-reporting, including the use of documentation such as completed checklists or quality scoring tools, was conducted in original research papers. These eligible papers underwent independent evaluation by a panel of nine readers, with three readers assigned to each paper. Automatic annotation was used to assist in this process. Then, a detailed item-by-item confirmation analysis was carried out on papers with checklist documentation, with independent evaluation of two readers. Results The sample size calculation yielded 117 papers. Most of the included papers were retrospective (94%; 110/117), single-center (68%; 80/117), based on their private data (89%; 104/117), and lacked external validation (79%; 93/117). Only seven papers (6%) had at least one self-reported document (Radiomics Quality Score (RQS), Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD), or Checklist for Artificial Intelligence in Medical Imaging (CLAIM)), with a statistically significant binomial test (p < 0.001). Median rate of confirmed items for all three documents was 81% (interquartile range, 6). For quality scoring tools, documented scores were higher than suggested scores, with a mean difference of − 7.2 (standard deviation, 6.8). Conclusion Radiomic publications often lack self-reported checklists or quality scoring tools. Even when such documents are provided, it is essential to be cautious, as the accuracy of the reported items or scores may be questionable. Clinical relevance statement Current state of radiomic literature reveals a notable absence of self-reporting with documentation and inaccurate reporting practices. This critical observation may serve as a catalyst for motivating the radiomics community to adopt and utilize such tools appropriately, thereby fostering rigor, transparency, and reproducibility of their research, moving the field forward. Key Points • In radiomics literature, there has been a notable absence of self-reporting with documentation. • Even if such documents are provided, it is critical to exercise caution because the accuracy of the reported items or scores may be questionable. • Radiomics community needs to be motivated to adopt and appropriately utilize the reporting checklists and quality scoring tools. Graphical Abstract
- 22 September 2023
- Published by Springer Nature in European Radiology
- Vol. 34 (4) , 2805-2815
Self-reporting with checklists in artificial intelligence research on medical imaging: a systematic review based on citations of CLAIM
Objective To evaluate the usage of a well-known and widely adopted checklist, Checklist for Artificial Intelligence in Medical imaging (CLAIM), for self-reporting through a systematic analysis of its citations. Methods Google Scholar, Web of Science, and Scopus were used to search for citations (date, 29 April 2023). CLAIM’s use for self-reporting with proof (i.e., filled-out checklist) and other potential use cases were systematically assessed in research papers. Eligible papers were evaluated independently by two readers, with the help of automatic annotation. Item-by-item confirmation analysis on papers with checklist proof was subsequently performed. Results A total of 391 unique citations were identified from three databases. Of the 118 papers included in this study, 12 (10%) provided a proof of self-reported CLAIM checklist. More than half (70; 59%) only mentioned some sort of adherence to CLAIM without providing any proof in the form of a checklist. Approximately one-third (36; 31%) cited the CLAIM for reasons unrelated to their reporting or methodological adherence. Overall, the claims on 57 to 93% of the items per publication were confirmed in the item-by-item analysis, with a mean and standard deviation of 81% and 10%, respectively. Conclusion Only a small proportion of the publications used CLAIM as checklist and supplied filled-out documentation; however, the self-reported checklists may contain errors and should be approached cautiously. We hope that this systematic citation analysis would motivate artificial intelligence community about the importance of proper self-reporting, and encourage researchers, journals, editors, and reviewers to take action to ensure the proper usage of checklists. Clinical relevance statement Only a small percentage of the publications used CLAIM for self-reporting with proof (i.e., filled-out checklist). However, the filled-out checklist proofs may contain errors, e.g., false claims of adherence, and should be approached cautiously. These may indicate inappropriate usage of checklists and necessitate further action by authorities. Key Points • Of 118 eligible papers, only 12 (10%) followed the CLAIM checklist for self-reporting with proof (i.e., filled-out checklist). More than half (70; 59%) only mentioned some kind of adherence without providing any proof. • Overall, claims on 57 to 93% of the items were valid in item-by-item confirmation analysis, with a mean and standard deviation of 81% and 10%, respectively. • Even with the checklist proof, the items declared may contain errors and should be approached cautiously.
- 22 September 2023
- Published by Springer Nature in European Radiology
- Vol. 34 (4) , 2805-2815
Self-reporting with checklists in artificial intelligence research on medical imaging: a systematic review based on citations of CLAIM
Objective To evaluate the usage of a well-known and widely adopted checklist, Checklist for Artificial Intelligence in Medical imaging (CLAIM), for self-reporting through a systematic analysis of its citations. Methods Google Scholar, Web of Science, and Scopus were used to search for citations (date, 29 April 2023). CLAIM’s use for self-reporting with proof (i.e., filled-out checklist) and other potential use cases were systematically assessed in research papers. Eligible papers were evaluated independently by two readers, with the help of automatic annotation. Item-by-item confirmation analysis on papers with checklist proof was subsequently performed. Results A total of 391 unique citations were identified from three databases. Of the 118 papers included in this study, 12 (10%) provided a proof of self-reported CLAIM checklist. More than half (70; 59%) only mentioned some sort of adherence to CLAIM without providing any proof in the form of a checklist. Approximately one-third (36; 31%) cited the CLAIM for reasons unrelated to their reporting or methodological adherence. Overall, the claims on 57 to 93% of the items per publication were confirmed in the item-by-item analysis, with a mean and standard deviation of 81% and 10%, respectively. Conclusion Only a small proportion of the publications used CLAIM as checklist and supplied filled-out documentation; however, the self-reported checklists may contain errors and should be approached cautiously. We hope that this systematic citation analysis would motivate artificial intelligence community about the importance of proper self-reporting, and encourage researchers, journals, editors, and reviewers to take action to ensure the proper usage of checklists. Clinical relevance statement Only a small percentage of the publications used CLAIM for self-reporting with proof (i.e., filled-out checklist). However, the filled-out checklist proofs may contain errors, e.g., false claims of adherence, and should be approached cautiously. These may indicate inappropriate usage of checklists and necessitate further action by authorities. Key Points • Of 118 eligible papers, only 12 (10%) followed the CLAIM checklist for self-reporting with proof (i.e., filled-out checklist). More than half (70; 59%) only mentioned some kind of adherence without providing any proof. • Overall, claims on 57 to 93% of the items were valid in item-by-item confirmation analysis, with a mean and standard deviation of 81% and 10%, respectively. • Even with the checklist proof, the items declared may contain errors and should be approached cautiously.