LYLinfang Yan

Linfang Yan

*This is an algorithmically generated author record based on publicly available information.

Linfang Yan has a total of 20 co-authors. Here are the top co-authors by number of shared publications:

  • Jinyu Wen

    Huazhong University of Science and Technology

    6 shared publications
  • Xia Chen

    College of Electrical and Electronic Engineering, Huazhong University of Science and Technology, Wuhan, China

    6 shared publications
  • Yin Chen

    College of Electrical and Electronic Engineering, Huazhong University of Science and Technology, Wuhan, China

    6 shared publications
  • Jianyu Zhou

    College of Electrical Engineering, Sichuan University, Chengdu, China

    2 shared publications
  • Yujun Lin

    State Key Laboratory of Advanced Electromagnetic Engineering and Technology, and School of Electrical and Electronic Engineering, Huazhong University of Science and Technology, Wuhan, China

    2 shared publications
  • Dan Liu

    State Key Laboratory of Advanced Electromagnetic Engineering and Technology, School of Electrical and Electronic Engineering, Huazhong University of Science and Technology, Wuhan, China

    1 shared publication

Latest Publications

  • Distributed Power Tracking Control of Energy Storage Systems With Aggregated Capacity Estimation

    by Yin Chen, Jianyu Zhou, LinFang Yan, Yujun Lin, Xia Chen, Jinyu Wen

    Numerous small-scale energy storage systems (ESSs) are distributed throughout the power system and have the potential to be aggregated for power regulation. In this context, distributed power tracking control with aggregated capacity estimation is proposed for distributed ESSs. The proposed distributed control is free of the measure for total power while achieving accurate total power tracking. In addition, power allocation is performed among ESSs considering their types, SoC levels, and power/energy capacities. To estimate the dispatched power ranges of ESSs, an event-triggered distributed power capacity estimator is proposed with a relatively low communication burden. The power reference for the power tracking control is limited and therefore the reliable operation of the control is ensured. The proposed control and estimator are implemented in a discrete-time fashion and only rely on the sparse communication requirement. A detailed theoretical analysis is conducted to verify the equilibrium and convergence of the proposed approaches. Simulations based on the IEEE 33-bus system demonstrate the effectiveness of the proposed distributed power tracking control and the capacity estimator.


  • Optimal Energy Management for Residential House Aggregators with Uncertain User Behaviors Using Deep Reinforcement Learning

    by Yujun Lin, Linfang Yan, Hongxun Hui, Qiufan Yang, Jianyu Zhou, Yin Chen, Xia Chen, Jinyu Wen

    This paper addresses the home energy management (HEM) problem for a large number of residential houses, which can be regarded as a high-dimensional optimization problem. To cope with the high-dimensional issue, the concept of the aggregator is utilized to reduce the state and action space. And a two-stage deep reinforcement learning (DRL) based approach is proposed for the aggregators to track the schedule from the superior grid and guarantee the operation constraints. In the first stage, a DRL control agent is set to learn the optimal scheduling strategy interacting with the environment based on the soft-actor-critic (SAC) framework and generate the aggregate control actions. In the second stage, the aggregate control actions are disaggregated to individual appliances considering the users’ behaviors. The uncertainty of the EV charging demand is quantitatively described by the driver’s experience. An aggregate anxiety concept is introduced to characterize both the driver’s anxiety on the EV’s range and uncertain events. Finally, simulation studies verify the effectiveness of the proposed approach under dynamic user behaviors, and the comparisons also show the superiority of the proposed approach over the method mentioned in benchmarks.


  • An On-Board Control Scheme for Consumer-Level Autonomous Underwater Vehicle in the Intelligent Cyber–Physical Transportation Systems

    by Jingyi He, Jiabao Wen, Linfang Yan, Meng Xi, Shuai Xiao, Desheng Chen, Jiachen Yang

    In recent years, with the expanding scope of the Intelligent Cyber-Physical Transportation Systems (ICTS), Autonomous Underwater Vehicle (AUV) has also become a hot product in this field that consumers are paying attention to. Consumer-level AUVs have a broad consumer market for underwater detection and search and rescue due to their small size, autonomy, flexibility, and long endurance. The formation of multiple AUVs can complete more diverse and complex tasks. However, consumers can only communicate with AUVs when they float to the surface, which poses a tough challenge to AUV’s formation control. This paper proposes an AUV On-board Control Scheme (AUV-OCS) based on multi-agent reinforcement learning and cloud computing technology to serve consumer-level AUVs, in which the local perception information preprocessed by each AUV is uploaded to the cloud center for data fusion in real-time and a centralized value function is designed to optimize the global decision. The experimental results show that the proposed AUV-OCS can effectively control the AUV cluster to complete underwater task in a predetermined formation for consumers with an average task success rate of 97.4%, and has a certain collision avoidance ability.


  • A Distributed Dynamic Inertia-Droop Control Strategy Based on Multi-Agent Deep Reinforcement Learning for Multiple Paralleled VSGs

    by Qiufan Yang, Linfang Yan, Xia Chen, Yin Chen, Jinyu Wen

    The virtual synchronous generator (VSG) control method for energy storage is a promising way to improve the frequency stability of the power system with large-scale renewable energy. However, due to the mismatch parameters, power oscillations may occur when multiple VSGs are connected in parallel to the grid. In this paper, the relationship between oscillation and the inertia-droop parameters distribution of multiple paralleled VSGs is derived by the simplified frequency response model. Furthermore, to coordinate the inertia-droop parameters of paralleled VSGs for oscillation damping, this paper formulates the parameter tuning problem as a Markov game with an unknown transition function and proposes a distributed dynamic inertia-droop control strategy based on multi-agent deep reinforcement learning (MADRL). Based on the local and adjacent VSG information, each agent learns the optimal inertia-droop control parameters independently by interacting with the environment. The soft-actor-critic (SAC) framework is introduced to train each agent. The well-trained agent can modify the parameters of VSG dynamically to suppress the power oscillation under different operating conditions. Finally, several time-domain results demonstrate the effectiveness and robustness of the proposed approach.


  • Open Access

    A Fully Distributed Economic Dispatch Method in DC Microgrid Based on Consensus Algorithm

    by Dan Liu, Kezheng Jiang, Linfang Yan, Xiaotong Ji, Kan Cao, Ping Xiong

    Uncertainties of intermittent renewables and complexities of load demands bring challenges to the optimal operation of the microgrid. This paper proposes a fully distributed method based on consensus algorithm for solving the economic dispatch problem (EDP) of DC microgrid. The proposed distributed method is performed using multiagent system. It only needs information from neighboring agents and does not need a central controller. A two-level control structure is adopted to realize the economic dispatch and voltage regulation simultaneously. The upper level obtains the optimal power reference of dispatchable agents and maintains the power balance of the system. The lower level performs an improved droop control to track the power reference and regulate the average bus voltage for the microgrid. The proposed method’s properties and convergence are analyzed using eigenvalue perturbation theory to obtain a faster convergence speed. By designing the adjacency matrix appropriately, the proposed method can ensure the system stable when the communication topology changes. Finally, several simulations are designed to verify the effectiveness of this novel control method.


  • A Hierarchical Deep Reinforcement Learning-Based Community Energy Trading Scheme for a Neighborhood of Smart Households

    by Linfang Yan, Xia Chen, Yin Chen, Jinyu Wen

    The uncertainties from the distributed energy resources (DERs) and the prosumer’s heterogeneous characteristics bring great challenges to the operation of the community energy market. In this paper, the real-time energy sharing and management in the community market are decomposed into two-layered sub-problems: the household appliance scheduling problem and the internal energy trading pricing problem. A hierarchical deep reinforcement learning (HDRL) based scheme is proposed for the community energy trading with multiple households, containing a two-stage learning process. In the inner stage, a multi-agent deep reinforcement learning (MADRL) based approach is developed to learn the real-time appliances scheduling policy based on the local observations and given internal electricity price in a decentralized way. In the outer stage, a deep reinforcement learning (DRL) based pricing approach is proposed to determine the real-time internal electricity prices based on the participants’ historical net power and external energy supplier’s electricity prices. The scheduling policy and households’ state are not required in the pricing process. Finally, the simulations with real-world datasets demonstrate that the internal energy trading can significantly reduce the prosumers’ daily cost and the control performance of the proposed scheme is superior to the existing studies.


  • A Cooperative Charging Control Strategy for Electric Vehicles Based on Multiagent Deep Reinforcement Learning

    by Linfang Yan, Xia Chen, Yin Chen, Jinyu Wen

    The growth of electric vehicles (EVs) significantly increases the residential electricity demand and potentially leads to the overload of the transformer in the distribution grid. Aiming to coordinate the charging control of EVs, this article formulates the EVs charging problem as a Markov game with an unknown transition function and proposes a cooperative charging control strategy based on the multiagent deep reinforcement learning. The uncertainties from the dynamic electricity price, non-EV residential load consumption and drivers’ individual behaviors are considered to construct the dynamic charging environment. Each agent contains a collective-policy model and an independent learner. The collective-policy model is introduced to model other agent's behaviors by approximating their power consumption. The independent learner is used to learn the optimal charging strategy by interacting with the environment. The soft-actor-critic framework is adopted to train the independent learner, enabling the proposed method to address the continuous state and action. Agents are trained with only the local observation and approximation, indicating that the proposed approach is fully decentralized and scalable to the problem with multiple agents. Finally, several numerical studies constructed based on the real-world data demonstrate the effectiveness and scalability of the proposed approach.


  • Top Cited Papers

    Deep Reinforcement Learning for Continuous Electric Vehicles Charging Control With Dynamic User Behaviors

    by Linfang Yan, Xia Chen, Jianyu Zhou, Yin Chen, Jinyu Wen

    This paper aims to crack the individual EV charging scheduling problem considering the dynamic user behaviors and the electricity price. The uncertainty of the EV charging demand is described by several factors, including the driver’s experience, the charging preference and the charging locations for realistic scenarios. An aggregate anxiety concept is introduced to characterize both the driver’s anxiety on the EV’s range and uncertain events. A mathematical model is also provided to describe the anxiety quantitatively. The problem is formulated as a Markov Decision Process (MDP) with an unknown state transition function. The objective is to find the optimal sequential charging decisions that can balance the charging cost and driver’s anxiety. A model-free deep reinforcement learning (DRL) based approach is developed to learn the optimal charging control strategy by interacting with the dynamic environment. The continuous soft actor-critic (SAC) framework is applied to design the learning method, which contains a supervised learning (SL) stage and a reinforcement learning (RL) stage. Finally, simulation studies verify the effectiveness of the proposed approach under dynamic user behaviors at different charging locations.