Standardization with zlog values improves exploratory data analysis and machine learning for laboratory data
Open Access
- 15 May 2024
- journal article
- research article
- Published by Walter de Gruyter GmbH in Journal of Laboratory Medicine
- Vol. 48 (5) , 215-222
Abstract
Objectives: In the context of exploratory data analysis and machine learning, standardization of laboratory results is an important pre-processing step. Variable proportions of pathological results in routine datasets lead to changes of the mean (µ) and standard deviation (σ), and thus cause problems in the classical z-score transformation. Therefore, this study investigates whether the zlog transformation compensates these disadvantages and makes the results more meaningful from a medical perspective. Methods: The results presented here were obtained with the statistical software environment R, and the underlying data set was obtained from the UC Irvine Machine Learning Repository. We compare the differences of the zlog and z-score transformation for five different dimension reduction methods, hierarchical clustering and four supervised classification methods. Results: With the zlog transformation, we obtain better results in this study than with the z-score transformation for dimension reduction, clustering and classification methods. By compensating the disadvantages of the z-score transformation, the zlog transformation allows more meaningful medical conclusions. Conclusions: We recommend using the zlog transformation of laboratory results for pre-processing when exploratory data analysis and machine learning techniques are applied.Keywords
This publication has 20 references indexed in Scilit:
- A zlog-based algorithm and tool for plausibility checks of reference intervalsClinical Chemistry and Laboratory Medicine (CCLM), 2022
- Applications of machine learning in routine laboratory medicine: Current state and future directionsClinical Biochemistry, 2022
- Potential value and impact of data mining and machine learning in clinical diagnosticsCritical Reviews in Clinical Laboratory Sciences, 2021
- Indirect methods for reference interval determination – review and recommendationsClinical Chemistry and Laboratory Medicine (CCLM), 2018
- Der zlog-Wert als Basis für die Standardisierung von LaborwertenJournal of Laboratory Medicine, 2017
- Principal component analysis: a review and recent developmentsPhilosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, 2016
- Principal component analysisWIREs Computational Statistics, 2010
- Reducing the Dimensionality of Data with Neural NetworksScience, 2006
- Time Series Analysis2002
- A Nonlinear Mapping for Data Structure AnalysisIEEE Transactions on Computers, 1969