Development of a Distributed Outlier Detection Method based on the Alternating Direction Method of Multipliers
Open Access
- 26 June 2025
- journal article
- Published by PIAP - Industrial Research Institute for Automation and Measurements in Journal of Automation, Mobile Robotics and Intelligent Systems
- p. 1-7
Abstract
In data mining, one of the most studied problems is outlier detection, which involves identifying "unusual" data points within a dataset that are suspected to be generated by a different mechanism than the rest of the dataset. Outlier detection has applications in discovering novel information, detecting bank fraud, and identifying system intrusions, and others. However, handling large volumes of data, known as big data, poses a challenge to outlier detection algorithms because the resources of a single computer may not be sufficient to achieve efficient performance. Furthermore, datasets are often stored in distributed environments.The goal of this work is to develop a new distributed outlier detection algorithm based on the solution of the support vector data description using the alternating direction method of multipliers. Mathematical optimization methods and Python language libraries are mainly used for the implementation. As a result, the design and distributed implementation of the proposed algorithm are achieved, which are validated using several test datasets, yielding satisfactory and competitive results compared to existing methods.Keywords
This publication has 17 references indexed in Scilit:
- Sparx: Distributed Outlier Detection at Scale2022
- Anomaly Detection Based on Convex Analysis: A SurveyFrontiers in Physics, 2022
- Real Time Anomaly Detection Techniques Using PySpark Frame WorkJournal of Artificial Intelligence and Capsule Networks, 2020
- Robust and Sparse Linear Discriminant Analysis via an Alternating Direction Method of MultipliersIEEE Transactions on Neural Networks and Learning Systems, 2020
- Outlier Detection: Techniques and Applications2019
- Distributed Optimization and Statistical Learning via the Alternating Direction Method of MultipliersFoundations and Trends in Machine Learning, 2011
- Approximate Convex Hulls Family for One-Class ClassificationLecture Notes in Computer Science, 2011
- Correcting Sample Selection Bias by Unlabeled Data2007
- The quickhull algorithm for convex hullsACM Transactions on Mathematical Software, 1996
- Application of the alternating direction method of multipliers to separable convex programming problemsComputational Optimization and Applications, 1992