Multi-Dimensional Validation of the Integration of Syntactic and Semantic Distance Measures for Clustering Fibromyalgia Patients in the Rheumatic Monitor Big Data Study
Authors:
- Ayelet GoldsteinAGAyelet Goldstein
- Yuval ShaharYuval Shahar
- Michal Weisman RaymondMRMichal Weisman Raymond
- Hagit PelegHPHagit Peleg
- Eldad Ben-ChetritEBEldad Ben-Chetrit
- Arie Ben-YehudaABArie Ben-Yehuda
- Erez ShalomESErez Shalom
- Chen GoldsteinCGChen Goldstein
- Shmuel Shay ShilohSSShmuel Shay Shiloh
- Galit AlmozninoGalit Almoznino
Open Access
- 19 January 2024
- journal article
- research article
- Published by MDPI AG in Bioengineering
- Vol. 11 (1) , 97
Abstract
This study primarily aimed at developing a novel multi-dimensional methodology to discover and validate the optimal number of clusters. The secondary objective was to deploy it for the task of clustering fibromyalgia patients. We present a comprehensive methodology that includes the use of several different clustering algorithms, quality assessment using several syntactic distance measures (the Silhouette Index (SI), Calinski–Harabasz index (CHI), and Davies–Bouldin index (DBI)), stability assessment using the adjusted Rand index (ARI), and the validation of the internal semantic consistency of each clustering option via the performance of multiple clustering iterations after the repeated bagging of the data to select multiple partial data sets. Then, we perform a statistical analysis of the (clinical) semantics of the most stable clustering options using the full data set. Finally, the results are validated through a supervised machine learning (ML) model that classifies the patients back into the discovered clusters and is interpreted by calculating the Shapley additive explanations (SHAP) values of the model. Thus, we refer to our methodology as the clustering, distance measures and iterative statistical and semantic validation (CDI-SSV) methodology. We applied our method to the analysis of a comprehensive data set acquired from 1370 fibromyalgia patients. The results demonstrate that the K-means was highly robust in the syntactic and the internal consistent semantics analysis phases and was therefore followed by a semantic assessment to determine the optimal number of clusters (k), which suggested k = 3 as a more clinically meaningful solution, representing three distinct severity levels. the random forest model validated the results by classification into the discovered clusters with high accuracy (AUC: 0.994; accuracy: 0.946). SHAP analysis emphasized the clinical relevance of "functional problems" in distinguishing the most severe condition. In conclusion, the CDI-SSV methodology offers significant potential for improving the classification of complex patients. Our findings suggest a classification system for different profiles of fibromyalgia patients, which has the potential to improve clinical care, by providing clinical markers for the evidence-based personalized diagnosis, management, and prognosis of fibromyalgia patients.Keywords
Funding Information
- Israeli Ministry of Innovation, Science and Technology (3-15608)
This publication has 38 references indexed in Scilit:
- Cluster Analysis of Clinical Data Identifies Fibromyalgia SubgroupsPLOS ONE, 2013
- Prevalence of Fibromyalgia: A Population‐Based Study in Olmsted County, Minnesota, Utilizing the Rochester Epidemiology ProjectArthritis Care & Research, 2012
- Biology and therapy of fibromyalgia. Evidence-based biomarkers for fibromyalgia syndromeArthritis Research & Therapy, 2008
- Cluster-wise assessment of cluster stabilityComputational Statistics & Data Analysis, 2007
- Stability-Based Validation of Clustering SolutionsNeural Computation, 2004
- Gaussian parsimonious clustering modelsPattern Recognition, 1995
- A classification EM algorithm for clustering and two stochastic versionsComputational Statistics & Data Analysis, 1992
- Principal component analysis and exploratory factor analysisStatistical Methods in Medical Research, 1992
- Silhouettes: A graphical aid to the interpretation and validation of cluster analysisJournal of Computational and Applied Mathematics, 1987
- A General Coefficient of Similarity and Some of Its Properties1971