RWRuxin Wang
Ruxin Wang
*This is an algorithmically generated author record based on publicly available information.
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Ruxin Wang has a total of 3 co-authors. Here are the top co-authors by number of shared publications:
- Bingbing Song
National Pilot School of Software, Yunnan University, Kunming, 650504, Yunnan, China; School of Information Science and Engineering, Yunnan University, Kunming, 650504, Yunnan, China
1 shared publication - Wei He
Piolet School of Software, Yunnan University, Kunming 650091, China
1 shared publication - Wei Zhou
School of Software, Yunnan University, Kunming, China
1 shared publication
Latest Publications
- Open Access
- 10 October 2022
- Published by MDPI AG in Mathematics
- Vol. 10 (19) , 3716
Robustness Learning via Inference-Softmax Cross Entropy in Misaligned Distribution of Image
Adversarial examples easily mislead vision systems based on deep neural networks (DNNs) trained with softmax cross entropy (SCE) loss. The vulnerability of DNN comes from the fact that SCE drives DNNs to fit on the training examples, whereas the resultant feature distributions between the training and adversarial examples are unfortunately misaligned. Several state-of-the-art methods start from improving the inter-class separability of training examples by modifying loss functions, where we argue that the adversarial examples are ignored, thus resulting in a limited robustness to adversarial attacks. In this paper, we exploited the inference region, which inspired us to apply margin-like inference information to SCE, resulting in a novel inference-softmax cross entropy (I-SCE) loss, which is intuitively appealing and interpretable. The inference information guarantees that it is difficult for neural networks to cross the decision boundary under an adversarial attack, and guarantees both the inter-class separability and the improved generalization to adversarial examples, which was further demonstrated and proved under the min-max framework. Extensive experiments show that the DNN models trained with the proposed I-SCE loss achieve a superior performance and robustness over the state-of-the-arts under different prevalent adversarial attacks; for example, the accuracy of I-SCE is higher than SCE under the attack on the MNIST dataset. These experiments also show that the inference region can effectively solve the misaligned distribution.- 10 October 2022
- Published by MDPI AG in Mathematics
- Vol. 10 (19) , 3716
Open AccessRobustness Learning via Inference-Softmax Cross Entropy in Misaligned Distribution of Image
Adversarial examples easily mislead vision systems based on deep neural networks (DNNs) trained with softmax cross entropy (SCE) loss. The vulnerability of DNN comes from the fact that SCE drives DNNs to fit on the training examples, whereas the resultant feature distributions between the training and adversarial examples are unfortunately misaligned. Several state-of-the-art methods start from improving the inter-class separability of training examples by modifying loss functions, where we argue that the adversarial examples are ignored, thus resulting in a limited robustness to adversarial attacks. In this paper, we exploited the inference region, which inspired us to apply margin-like inference information to SCE, resulting in a novel inference-softmax cross entropy (I-SCE) loss, which is intuitively appealing and interpretable. The inference information guarantees that it is difficult for neural networks to cross the decision boundary under an adversarial attack, and guarantees both the inter-class separability and the improved generalization to adversarial examples, which was further demonstrated and proved under the min-max framework. Extensive experiments show that the DNN models trained with the proposed I-SCE loss achieve a superior performance and robustness over the state-of-the-arts under different prevalent adversarial attacks; for example, the accuracy of I-SCE is higher than SCE under the attack on the MNIST dataset. These experiments also show that the inference region can effectively solve the misaligned distribution.