Investigating data-driven biological subtypes of psychiatric disorders using specification-curve analysis
Open Access
- 11 August 2020
- journal article
- research article
- Published by Cambridge University Press (CUP) in Psychological Medicine
- Vol. 52 (6) , 1089-1100
Abstract
Background: Cluster analyses have become popular tools for data-driven classification in biological psychiatric research. However, these analyses are known to be sensitive to the chosen methods and/or modelling options, which may hamper generalizability and replicability of findings. To gain more insight into this problem, we used Specification-Curve Analysis (SCA) to investigate the influence of methodological variation on biomarker-based cluster-analysis results.Methods: Proteomics data (31 biomarkers) were used from patients (n = 688) and healthy controls (n = 426) in the Netherlands Study of Depression and Anxiety. In SCAs, consistency of results was evaluated across 1200 k-means and hierarchical clustering analyses, each with a unique combination of the clustering algorithm, fit-index, and distance metric. Next, SCAs were run in simulated datasets with varying cluster numbers and noise/outlier levels to evaluate the effect of data properties on SCA outcomes.Results: The real data SCA showed no robust patterns of biological clustering in either the MDD or a combined MDD/healthy dataset. The simulation results showed that the correct number of clusters could be identified quite consistently across the 1200 model specifications, but that correct cluster identification became harder when the number of clusters and noise levels increased.Conclusion: SCA can provide useful insights into the presence of clusters in biomarker data. However, SCA is likely to show inconsistent results in real-world biomarker datasets that are complex and contain considerable levels of noise. Here, the number and nature of the observed clusters may depend strongly on the chosen model-specification, precluding conclusions about the existence of biological clusters among psychiatric patients.Keywords
This publication has 60 references indexed in Scilit:
- Personalized medicine in psychiatry: problems and promisesBMC Medicine, 2013
- Data-driven subtypes of major depressive disorder: a systematic reviewBMC Medicine, 2012
- Heterogeneity and symptom structure of schizophreniaPsychiatry Research, 2012
- Comparison of Clustering Methods for Investigation of Genome-Wide Methylation Array DataFrontiers in Genetics, 2011
- Grand Challenges and Opportunities in Deciphering the Role of Non-Coding RNAs in Human DiseasesFrontiers in Genetics, 2011
- Plasma Protein Biomarkers for Depression and Schizophrenia by Multi Analyte Profiling of Case-Control CollectionsPLOS ONE, 2010
- Interleukin-1 Receptor Antagonist and Incident Depressive Symptoms Over 6 Years in Older Persons: The InCHIANTI StudyBiological Psychiatry, 2009
- An historical framework for psychiatric nosologyPsychological Medicine, 2009
- Genetic predictors of depressive symptoms in cardiac patientsAmerican Journal of Medical Genetics Part B: Neuropsychiatric Genetics, 2008
- Latent Structure Models with Direct Effects between IndicatorsSociological Methods & Research, 1988