Robust Isolation Forest using Soft Sparse Random Projection and Valley Emphasis Method
Preprint
Abstract
Isolation Forest (iForest) is an unsupervised anomaly detection algorithm designed to effectively detect anomalies under the assumption that anomalies are ``few and different." Various studies have aimed to enhance iForest, but the resulting algorithms often exhibited significant performance disparities across datasets. Additionally, the challenge of isolating rare and widely distributed anomalies persisted in research focused on improving splits. To address these challenges, we introduce Robust iForest (RiForest). RiForest leverages both existing features and random hyperplanes obtained through soft sparse random projection to identify superior split features for anomaly detection, independent of datasets. It utilizes the underutilized valley emphasis method for optimal split point determination and incorporates sparsity randomization in soft sparse random projection for enhanced anomaly detection robustness. Across 24 benchmark datasets, experiments demonstrate RiForest's consistent outperformance of existing algorithms in anomaly detection, emphasizing stability and robustness to noise variables.Keywords
All Related Versions
This publication has 24 references indexed in Scilit:
- Enhancing early attack detection: novel hybrid density-based isolation forest for improved anomaly detectionInternational Journal of Machine Learning and Cybernetics, 2024
- Video anomaly detection based on multi-scale optical flow spatio-temporal enhancement and normality miningInternational Journal of Machine Learning and Cybernetics, 2024
- Layered isolation forest: A multi-level subspace algorithm for improving isolation forestNeurocomputing, 2024
- A survey of outlier detection in high dimensional data streamsComputer Science Review, 2022
- A probabilistic generalization of isolation forestInformation Sciences, 2022
- Fuzzy C-Means-based Isolation ForestApplied Soft Computing, 2021
- usfAD: a robust anomaly detector based on unsupervised stochastic forestInternational Journal of Machine Learning and Cybernetics, 2020
- Outlier trajectory detection through a context-aware distancePattern Analysis and Applications, 2018
- A comparative evaluation of outlier detection algorithms: Experiments and analysesPattern Recognition, 2018
- An enhanced variable selection and Isolation Forest based methodology for anomaly detection with OES dataEngineering Applications of Artificial Intelligence, 2018