Unsupervised random forests
- 5 February 2021
- journal article
- research article
- Published by Wiley in Statistical Analysis and Data Mining: An ASA Data Science Journal
- Vol. 14 (2) , 144-167
Abstract
SidClustering is a new random forests unsupervised machine learning algorithm. The first step in sidClustering involves what is called sidification of the features: staggering the features to have mutually exclusive ranges (called the staggered interaction data [SID] main features) and then forming all pairwise interactions (called the SID interaction features). Then a multivariate random forest (able to handle both continuous and categorical variables) is used to predict the SID main features. We establish uniqueness of sidification and show how multivariate impurity splitting is able to identify clusters. The proposed sidClustering method is adept at finding clusters arising from categorical and continuous variables and retains all the important advantages of random forests. The method is illustrated using simulated and real data as well as two in depth case studies, one from a large multi‐institutional study of esophageal cancer, and the other involving hospital charges for cardiovascular patients.Keywords
Funding Information
- National Institute of General Medical Sciences (R01 GM125072)
This publication has 15 references indexed in Scilit:
- A Novel clustering method based on hybrid K-nearest-neighbor graphPattern Recognition, 2018
- Random forest missing data algorithmsStatistical Analysis and Data Mining: An ASA Data Science Journal, 2017
- Worldwide Esophageal Cancer Collaboration: clinical staging dataDiseases of the Esophagus, 2016
- Cluster ForestsComputational Statistics & Data Analysis, 2013
- On the limits of clustering in high dimensions via cost functionsStatistical Analysis and Data Mining: An ASA Data Science Journal, 2010
- Clustering Rules: A Comparison of Partitioning and Hierarchical Clustering AlgorithmsJournal of Mathematical Modelling and Algorithms, 2006
- Unsupervised Learning With Random Forest PredictorsJournal of Computational and Graphical Statistics, 2006
- Improving on Bagging with Input Smearing2006
- Geometric Representation of High Dimension, Low Sample Size DataJournal of the Royal Statistical Society Series B: Statistical Methodology, 2005
- Random ForestsMachine Learning, 2001