Ao Ma
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Ao Ma has a total of 4 co-authors. Here are the top co-authors by number of shared publications:
- Peng Li
College of Intelligence Science and Technology, National University of Defense Technology, Changsha, China
2 shared publications - Xiaolong Su
College of Intelligence Science and Technology, National University of Defense Technology, Changsha, China
2 shared publications - Jiaxing Chen
Academy of Military Sciences, Beijing, China
1 shared publication - Shaofei Chen
College of Intelligence Science and Technology, National University of Defense Technology, Changsha, China
1 shared publication
Latest Publications
- Open Access
- 8 May 2026
- Published by Springer Nature in Complex & Intelligent Systems
- Vol. 12 (8)
Mia-grl: mutual information aligned generative reinforcement learning with missing data
- 8 May 2026
- Published by Springer Nature in Complex & Intelligent Systems
- Vol. 12 (8)
Open AccessMia-grl: mutual information aligned generative reinforcement learning with missing data
- Open Access
- 16 October 2025
- Published by MDPI AG in Electronics
- Vol. 14 (20) , 4064
Robust Offline Reinforcement Learning Through Causal Feature Disentanglement
Offline reinforcement learning suffers from critical vulnerability to data corruption from sensor noise or adversarial attacks. Recent research has achieved a lot by downweighting corrupted samples and fixing the corrupted data, while data corruption induces feature entanglement that undermines policy robustness. Existing methods fail to identify causal features behind performance degradation caused by corruption. To analyze causal relationships in corrupted data, we propose a method, Robust Causal Feature Disentanglement(RCFD). Our method introduces a learnable causal feature disentanglement mechanism specifically designed for reinforcement learning scenarios, integrating the CausalVAE framework to disentangle causal features governing environmental dynamics from corruption-sensitive non-causal features. Theoretically, this disentanglement confers a robustness advantage under data corruption conditions. Concurrently, causality-preserving perturbation training injects Gaussian noise solely into non-causal features to generate counterfactual samples and is enhanced by dual-path feature alignment and contrastive learning for representation invariance. A dynamic graph diagnostic module further employs graph convolutional attention networks to model spatiotemporal relationships and identify corrupted edges through structural consistency analysis, enabling precise data repair. The results exhibit highly robust performance across D4rl benchmarks under diverse data corruption conditions. This confirms that causal feature invariance helps bridge distributional gaps, promoting reliable deployment in complex real-world settings.
- 16 October 2025
- Published by MDPI AG in Electronics
- Vol. 14 (20) , 4064
Open AccessRobust Offline Reinforcement Learning Through Causal Feature Disentanglement
Offline reinforcement learning suffers from critical vulnerability to data corruption from sensor noise or adversarial attacks. Recent research has achieved a lot by downweighting corrupted samples and fixing the corrupted data, while data corruption induces feature entanglement that undermines policy robustness. Existing methods fail to identify causal features behind performance degradation caused by corruption. To analyze causal relationships in corrupted data, we propose a method, Robust Causal Feature Disentanglement(RCFD). Our method introduces a learnable causal feature disentanglement mechanism specifically designed for reinforcement learning scenarios, integrating the CausalVAE framework to disentangle causal features governing environmental dynamics from corruption-sensitive non-causal features. Theoretically, this disentanglement confers a robustness advantage under data corruption conditions. Concurrently, causality-preserving perturbation training injects Gaussian noise solely into non-causal features to generate counterfactual samples and is enhanced by dual-path feature alignment and contrastive learning for representation invariance. A dynamic graph diagnostic module further employs graph convolutional attention networks to model spatiotemporal relationships and identify corrupted edges through structural consistency analysis, enabling precise data repair. The results exhibit highly robust performance across D4rl benchmarks under diverse data corruption conditions. This confirms that causal feature invariance helps bridge distributional gaps, promoting reliable deployment in complex real-world settings.