A systematic review of radiomics in osteosarcoma: utilizing radiomics quality score as a tool promoting clinical translation
- 2 September 2020
- journal article
- review article
- Published by Springer Nature in European Radiology
- Vol. 31 (3) , 1526-1535
Abstract
Objectives To assess the methodological quality and risk of bias in radiomics studies investigating diagnosis, therapy response, and survival of patients with osteosarcoma. Methods In this systematic review, literatures on radiomics in osteosarcoma were included and assessed for methodological quality through the radiomics quality score (RQS). The risk of bias and concern of application was assessed using the Quality Assessment of Diagnostic Accuracy Studies tool. A meta-analysis of studies focusing on predicting osteosarcoma response to neoadjuvant chemotherapy was performed. Results Twelve radiomics studies exploring osteosarcoma were identified, and five were included in meta-analysis. The RQS reached an average of 20.4% (6.92 of 36) with good inter-rater agreement (ICC 0.95, 95% CI 0.85-0.99). Four studies validated results with an internal dataset, none of which used external dataset; one study was prospectively designed, and another one shared part of the dataset. The risk of bias and concern of application were mainly related to index test aspect. The meta-analysis showed a diagnostic odds ratio of 43.68 (95%CI 13.5-141.31) for predicting response to neoadjuvant chemotherapy with high heterogeneity and low methodological quality. Conclusions The overall scientific quality of included studies is insufficient; however, radiomics remains a promising technology for predicting treatment response, which might guide therapeutic decision-making and related to prognosis. Improvements in study design, validation, and open science needs to be made to demonstrate the generalizability of findings and to achieve clinical applications. Widespread application of RQS, pre-trained RQS scoring procedure, and modification of RQS in response to clinical needs are necessary. Key Points • Limited radiomics studies were established in osteosarcoma with mean RQS of 20.4%, commonly due to unvalidated results, retrospective study design, and absence of open science. • Meta-analysis of radiomics studies predicting osteosarcoma response to neoadjuvant chemotherapy showed high diagnostic odds ratio 43.68, while high heterogeneity and low methodological quality were the main concerns. • A previously trained data extraction instrument allowed reaching moderate inter-rater agreement in RQS applications, while RQS still needs improvement to become a wide adaptive tool in reviews of radiomics studies, in routine self-check before manuscript submitting and in study design.Keywords
Funding Information
- National Natural Science Foundation of China (81771790)
- Shanghai Jiao Tong University (YG2019ZDB09)
This publication has 47 references indexed in Scilit:
- Guidelines for Developing and Reporting Machine Learning Predictive Models in Biomedical Research: A Multidisciplinary ViewJournal of Medical Internet Research, 2016
- Imaging biomarker roadmap for cancer studiesNature Reviews Clinical Oncology, 2016
- Radiomics: Images Are More than Pictures, They Are DataRadiology, 2016
- Metrology Standards for Quantitative Imaging BiomarkersRadiology, 2015
- Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statementBMJ, 2014
- Radiomics: Extracting more information from medical images using advanced feature analysisEuropean Journal of Cancer, 2012
- QUADAS-2: A Revised Tool for the Quality Assessment of Diagnostic Accuracy StudiesAnnals of Internal Medicine, 2011
- Treatment Effects in Pediatric Soft Tissue and Bone TumorsAmerican Journal of Clinical Pathology, 2005
- Texture analysis of medical imagesClinical Radiology, 2004
- The Effect of Adjuvant Chemotherapy on Relapse-Free Survival in Patients with Osteosarcoma of the ExtremityNew England Journal of Medicine, 1986