Mohsen S. Alsaadi

Adversarial evaluation of machine-learning-based network intrusion detection systems (NIDSs) requires an explicit bound on attacker perturbations, yet fixed bounds are often reused across datasets without verifying scale comparability. We evaluate two differentiable detectors on CICIDS2017, TON_IoT, and UNSW-NB15 using a constrained, control-surface-aware evasion procedure in which perturbation cost is measured in interquartile-range units. The measured constrained feature-space evasion cost differs by more than two orders of magnitude across benchmarks. On UNSW-NB15, changing only the perturbation bound from a fixed reference value of 50 to a dataset-calibrated $P_{95}$ value changes measured evasion success from 2.6% to 84.0%, with the conclusion remaining stable across $P_{90}$, $P_{95}$, and $P_{99}$ calibration. We therefore propose a dataset-specific quantile calibration procedure and a monotonicity-based internal validity test exploiting nested attacker action spaces. Calibration removes the severe fixed-bound monotonicity violations observed on the two most poorly scaled datasets, although the test remains diagnostic rather than certifying. A secondary attribution-based robustness estimator does not generalise consistently across the three benchmarks. These results show that perturbation-budget calibration is an essential component of credible cross-dataset adversarial NIDS evaluation.