Cost-Aware Network Traffic Anomaly Detection with Histogram-Based Gradient Boosting
Open Access
- 3 April 2026
- journal article
- research article
- Published by MDPI AG in Applied Sciences
- Vol. 16 (7) , 3496
Abstract
Intrusion Detection Systems (IDSs) operate under asymmetric misclassification costs: false alarms (FP) consume analysts’ time and erode trust, whereas missed attacks (FN) carry business risks. This paper presents a complete pipeline for network anomaly detection on the CIC-IDS2017 dataset using Histogram-Based Gradient Boosting (HGB), with a particular focus on cost-aware threshold selection on a validation split for representative operating regimes —treated as scenario-based proxies for varying risk posture, attack severity, and analyst workload rather than as universally fixed costs—and on the role of isotonic calibration. The results indicate that (i) under 1:1, the cost-optimal operating point aligns with the F1/MCC optimum; (ii) for 1:k cost regimes, the optimum shifts to lower thresholds, reducing FN at the expense of FP and increasing the alert rate; and (iii) isotonic calibration improves PR/ROC (ranking separation), but in the reported 1:5 experiment it did not reduce the final TEST-set operational cost relative to the uncalibrated run, despite using a separately selected post-calibration threshold. The evaluation includes PR/ROC curves, Cost–Threshold and Alert–Threshold sweeps, per-class recall, and permutation importance. In addition, the proposed approach is compared with unsupervised baselines (Isolation Forest, LOF). The results provide practical guidance for SOC decisions on how to choose thresholds consistent with alert budgets and risk profiles. In deployment, these operating points can be indexed to context (e.g., user type, service class, or time of day), yielding a small library of adaptive thresholds rather than one immutable global threshold.
Keywords
This publication has 23 references indexed in Scilit:
- Towards the development of realistic botnet dataset in the Internet of Things for network forensic analytics: Bot-IoT datasetFuture Generation Computer Systems, 2019
- A survey of network-based intrusion detection data setsComputers & Security, 2019
- A survey of network anomaly detection techniquesJournal of Network and Computer Applications, 2016
- A survey on concept drift adaptationACM Computing Surveys, 2014
- Anomaly detectionACM Computing Surveys, 2009
- Measuring classifier performance: a coherent alternative to the area under the ROC curveMachine Learning, 2009
- An introduction to ROC analysisPattern Recognition Letters, 2006
- Cost curves: An improved method for visualizing classifier performanceMachine Learning, 2006
- Robust Classification for Imprecise EnvironmentsMachine Learning, 2001
- LOFACM SIGMOD Record, 2000