Self-Supervised Random Forest on Transformed Distribution for Anomaly Detection
- 23 January 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 36 (2) , 2675-2689
Abstract
Anomaly detection, the task of differentiating abnormal data points from normal ones, presents a significant challenge in the realm of machine learning. Numerous strategies have been proposed to tackle this task, with classification-based methods, specifically those utilizing a self-supervised approach via random affine transformations (RATs), demonstrating remarkable performance on both image and non-image data. However, these methods encounter a notable bottleneck, the overlap of constructed labeled datasets across categories, which hampers the subsequent classifiers’ ability to detect anomalies. Consequently, the creation of an effective data distribution becomes the pivotal factor for success. In this article, we introduce a model called “self-supervised forest (sForest)”, which leverages the random Fourier transform (RFT) and random orthogonal rotations to craft a controlled data distribution. Our model utilizes the RFT to map input data into a new feature space. With this transformed data, we create a self-labeled training dataset using random orthogonal rotations. We theoretically prove that the data distribution formulated by our methodology is more stable compared to one derived from RATs. We then use the self-labeled dataset in a random forest (RF) classifier to distinguish between normal and anomalous data points. Comprehensive experiments conducted on both real and artificial datasets illustrate that sForest outperforms other anomaly detection methods, including distance-based, kernel-based, forest-based, and network-based benchmarks.Keywords
Funding Information
- National Natural Science Foundation of China (62306036, 62306159, 72231010, 71932008)
- Guangdong Provincial Key Laboratory of Interdisciplinary Research and Application for Data Science (2022B1212010006, R0400001-22)
- Guangdong Higher Education Upgrading Plan (UIC-R0400024-21)
- Beijing Normal University-Hong Kong Baptist University United International College (UICR0700019-22)
This publication has 32 references indexed in Scilit:
- SELF-LLP: Self-supervised learning from label proportions with self-ensemblePattern Recognition, 2022
- COPOD: Copula-Based Outlier Detection2020
- Progress in Outlier Detection Techniques: A SurveyIEEE Access, 2019
- Using generative adversarial networks for improving classification effectiveness in credit card fraud detectionInformation Sciences, 2019
- Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery2017
- Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles2016
- Colorful Image Colorization2016
- Learning Representations for Automatic Colorization2016
- Unsupervised Visual Representation Learning by Context Prediction2015
- Isolation Forest2008