Adversarial Training for Probabilistic Robustness
Authors:
- 19 October 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1675-1685
Abstract
Deep learning (DL) has shown transformative potential across industries, yet its sensitivity to adversarial examples (AEs) limits its reliability and broader deployment. Research on $D L$ robustness has developed various techniques, with adversarial training (AT) established as a leading approach to counter AEs. Traditional AT focuses on worstcase robustness (WCR), but recent work has introduced probabilistic robustness (PR), which evaluates the likelihood of AEs within a local perturbation range, providing an overall assessment of the model's robustness and acknowledging residual risks that are more practical to manage. However, existing AT methods are fundamentally designed to improve WCR, and no dedicated methods currently target PR. To bridge this gap, we formulate a new min-max optimization as the theoretical foundation for PR-focused $A T$, and introduce an AT-PR training scheme with numerical algorithms to solve the new optimization problem. Our experiments, based on 70 DL models trained on common datasets and diverse architectures, demonstrate that: i) $A T-P R$ achieves higher improvements in PR than AT-WCR methods; ii) it shows more consistent effectiveness across varying local inputs; iii) it exhibits a reduced trade-off in model's generalization.
Keywords
This publication has 46 references indexed in Scilit:
- Trustworthy text-to-image diffusion models: A timely and focused surveyInformation Fusion, 2026
- Probabilistic Robustness in Deep Learning: A Concise Yet Comprehensive Guide2026
- ProTIP: Probabilistic Robustness Verification on Text-to-Image Diffusion Models Against Stochastic Perturbation2024
- A survey of safety and trustworthiness of large language models through the lens of verification and validationArtificial Intelligence Review, 2024
- PRoA: A Probabilistic Robustness Assessment Against Functional Perturbations2023
- A survey of safety and trustworthiness of deep neural networks: Verification, testing, adversarial attack and defence, and interpretabilityComputer Science Review, 2020
- Understanding adversarial training: Increasing local stability of supervised models through robust optimizationNeurocomputing, 2018
- Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networks2017
- Safety Verification of Deep Neural Networks2017
- Rademacher Complexity2011