Utilization of five data mining algorithms combined with simplified preprocessing to establish reference intervals of thyroid-related hormones for non-elderly adults
Open Access
- 2 May 2023
- journal article
- research article
- Published by Springer Nature in BMC Medical Research Methodology
- Vol. 23 (1) , 1-13
Abstract
Background: Despite the extensive research on data mining algorithms, there is still a lack of a standard protocol to evaluate the performance of the existing algorithms. Therefore, the study aims to provide a novel procedure that combines data mining algorithms and simplified preprocessing to establish reference intervals (RIs), with the performance of five algorithms assessed objectively as well. Methods: Two data sets were derived from the population undergoing a physical examination. Hoffmann, Bhattacharya, Expectation Maximum (EM), kosmic, and refineR algorithms combined with two-step data preprocessing respectively were implemented in the Test data set to establish RIs for thyroid-related hormones. Algorithm-calculated RIs were compared with the standard RIs calculated from the Reference data set in which reference individuals were selected following strict inclusion and exclusion criteria. Objective assessment of the methods is implemented by the bias ratio (BR) matrix. Results: RIs of thyroid-related hormones are established. There is a high consistency between TSH RIs established by the EM algorithm and the standard TSH RIs (BR = 0.063), although EM algorithms seems to perform poor on other hormones. RIs calculated by Hoffmann, Bhattacharya, and refineR methods for free and total triiodo-thyronine, free and total thyroxine respectively are close and match the standard RIs. Conclusion: An effective approach for objectively evaluating the performance of the algorithm based on the BR matrix is established. EM algorithm combined with simplified preprocessing can handle data with significant skewness, but its performance is limited in other scenarios. The other four algorithms perform well for data with Gaussian or near-Gaussian distribution. Using the appropriate algorithm based on the data distribution characteristics is recommended.Keywords
Funding Information
- Capital’s Funds for Health Improvement and Research (CFH-2020-1-4014)
- Beijing Key Clinical Specialty for Laboratory Medicine - Excellent Project (No. ZK201000)
This publication has 30 references indexed in Scilit:
- Global epidemiology of hyperthyroidism and hypothyroidismNature Reviews Endocrinology, 2018
- HypothyroidismThe Lancet, 2017
- Critical comments to a recent EFLM recommendation for the review of reference intervalsClinical Chemistry and Laboratory Medicine (CCLM), 2017
- Hypothyroid Symptoms Fail to Predict Thyroid Insufficiency in Old People: A Population-Based Case-Control StudyThe American Journal of Medicine, 2016
- HyperthyroidismThe Lancet, 2016
- An appraisal of statistical procedures used in derivation of reference intervalsClinical Chemistry and Laboratory Medicine (CCLM), 2010
- A new approach for the determination of reference intervals from hospital-based dataClinica Chimica Acta, 2009
- Establishing age/sex related serum creatinine reference intervals from hospital laboratory data based on different statistical methodsClinica Chimica Acta, 2008
- A Simple Method of Resolution of a Distribution into Gaussian ComponentsBiometrics, 1967
- Statistics in the Practice of MedicineJAMA, 1963