YLYushuai Li

Yushuai Li

*This is an algorithmically generated author record based on publicly available information.

Yushuai Li has a total of 9 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    TCRL: Temporal-Coupled Adversarial Training for Robust Constrained Reinforcement Learning in Worst-Case Scenarios

    by Wentao Xu, Zhongming Yao, Weihao Li, Zhenghang Song, Yumeng Song, Tianyi Li, Yushuai Li

    Constrained Reinforcement Learning (CRL) aims to optimize decision-making policies under constraint conditions, making it highly applicable to safety-critical domains such as autonomous driving, robotics, and power grid management. However, existing robust CRL approaches predominantly focus on single-step perturbations and temporally independent adversarial models, lacking explicit modeling of robustness against temporally coupled perturbations. To tackle these challenges, we propose TCRL, a novel temporal-coupled adversarial training framework for robust constrained reinforcement learning (TCRL) in worst-case scenarios. First, TCRL introduces a worst-case-perceived cost constraint function that estimates safety costs under temporally coupled perturbations without the need to explicitly model adversarial attackers. Second, TCRL establishes a dual-constraint defense mechanism on the reward to counter temporally coupled adversaries while maintaining reward unpredictability. Experimental results demonstrate that TCRL consistently outperforms existing methods in terms of robustness against temporally coupled perturbation attacks across a variety of CRL tasks.

  • Open Access

    Distributed Energy Dispatch for Geo-Data Centers Port Microgrid

    by Qi Qu, Fei Teng, Qi Xu, Yushuai Li

    With the development of port automation and artificial intelligence, coordination with multi-geographic data centers (Geo-DCs) has become a viable solution to address the issue of limited port computing resources. This study proposes a distributed energy dispatch method for the port microgrid coordinated with Geo-DCs (Geo-DCPM), aimed at reducing port carbon emissions and operational costs. Consider the single point of failure problem and high construction costs of centralized data centers. Geo-DCs are first introduced to solve the problem of insufficient computing resources in ports. An energy consumption calculation model for Geo-DCs is established, considering the data load delay constraint and the data space transfer constraint caused by specific delay-sensitive loads in the port microgrid. Then, an energy dispatch model (EDM) is constructed for the Geo-DCPM, taking into account carbon capture costs. Moreover, based on mixed-integer linear programming, a distributed algorithm is proposed to solve the EDM problem. Finally, the simulation results verify the effectiveness of the proposed method. Compared with the centralized algorithm, the packet loss rate of the distributed algorithm combined with Geo-DCs is significantly lower, reduced by about 70%.