Traceable machine learning real-time quality control based on patient data
- 19 July 2022
- journal article
- research article
- Published by Walter de Gruyter GmbH in Clinical Chemistry and Laboratory Medicine (CCLM)
- Vol. 60 (12) , 1998-2004
Abstract
Objectives: Patient-based real-time quality control (PBRTQC) has gained attention as an alternative/integrative tool for internal quality control (iQC). However, it is still doubted for its performance and its application in real clinical settings. We aim to generate a newly and easy-to-access patient-based real-time QC by machine learning (ML) traceable to standard reference data with assigned values by National Institute of Metrology of China (NIM), and to compare it with PBRTQC for clinical validity evaluation. Methods: For five representative biochemistry analytes, 1,195 000 patient testing results each were collected. After data processing, independent training and test sets were divided. Machine learning internal quality control (MLiQC) was set up by Random Forest in ML and was validated by way of both metrology algorithm traceability and 4 PBRTQC methods recommended by IFCC analytical working group. Results: MLiQC were established. As an example of albumin (ALB) at the critical bias, the uncertainty of MLiQC was 0.14%, which was evaluated by standard reference data produced by NIM. Compared with four optimal PBRTQC methods at critical bias, the average of the number of patient samples from a bias introduced until detected (ANPed) of MLiQC averagely decreased from 600 to 20. The median and 95 quantiles of NPeds (MNPed and 95NPed) of MLiQC were superior to all optimal PBRTQCs above 90% for all test items. Conclusions: MLiQC is highly superior to PBRTQC and well-suited in real settings. The validation of the model from two aspects of algorithm traceability and clinical effectiveness confirms its satisfactory performance.Keywords
This publication has 20 references indexed in Scilit:
- Machine learning in laboratory medicine: waiting for the flood?Clinical Chemistry and Laboratory Medicine (CCLM), 2017
- Moving Average for Continuous Quality Control: Time to Move to Implementation in Daily Practice?Clinical Chemistry, 2017
- Implementation and application of moving average as continuous analytical quality control instrument demonstrated for 24 routine chemistry assaysClinical Chemistry and Laboratory Medicine (CCLM), 2017
- Optimization of a Moving Averages Program Using a Simulated Annealing Algorithm: The Goal is to Monitor the Process Not the PatientsClinical Chemistry, 2016
- Revision of the “Guideline of the German Medical Association on Quality Assurance in Medical Laboratory Examinations – Rili-BAEK” (unauthorized translation)Journal of Laboratory Medicine, 2015
- Big data meets public healthScience, 2014
- Assessment of “Average of Normals” Quality Control Procedures and Guidelines for ImplementationAmerican Journal of Clinical Pathology, 1984
- A Study of Various Estimators for the Derivation of Quality Control Procedures from Patient Erythrocyte IndicesAmerican Journal of Clinical Pathology, 1974
- The “Average of Normals” Method of Quality ControlAmerican Journal of Clinical Pathology, 1965
- Some Studies in Machine Learning Using the Game of CheckersIBM Journal of Research and Development, 1959