Yaofei Ma
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Yaofei Ma has a total of 21 co-authors. Here are the top co-authors by number of shared publications:
- Xiao Song
Beihang University
3 shared publications Da Teng
Science and Technology on Aircraft Control Laboratory, School of Automation Science, Beihang University, Beijing 100191, China
1 shared publicationGang Zhai
Beihang University
1 shared publicationGuanghong Gong
School of Automation Science and Electrical Engineering, Beihang University, Beijing, China
1 shared publicationHaipeng Kong
School of Automation Science and Electrical Engineering, Beihang University, Beijing, China
1 shared publicationJiangyun Wang
Science and Technology on Aircraft Control Laboratory, School of Automation Science, Beihang University, Beijing 100191, China
1 shared publication
Latest Publications
- Open Access
- 1 August 2024
- Published by Springer Nature in Research Square
Scalable multi-agent reinforcement learning based on battlefield situation transfer and curriculum learning
Due to its potential application value, multi-UAV air combat missions have become a hot topic in the current military research field at home and abroad. With the rise of artificial intelligence and intelligent warfare, a series of UAV air combat decision-making methods based on deep reinforcement learning have been proposed by various countries. However, when the number of agents increases and the type of aircraft changes, the action space and state space of reinforcement learning will change, which will face the problem of poor stability of the training process and is extremely sensitive to hyperparameters (such as learning rate). Therefore, based on the traditional multi-agent reinforcement learning based on AC decision network, this paper improves the decision network, introduces curriculum learning and transfer learning, and proposes a multi-agent reinforcement learning decision framework that can converge quickly and improve training robustness.
- 1 August 2024
- Published by Springer Nature in Research Square
Open AccessScalable multi-agent reinforcement learning based on battlefield situation transfer and curriculum learning
Due to its potential application value, multi-UAV air combat missions have become a hot topic in the current military research field at home and abroad. With the rise of artificial intelligence and intelligent warfare, a series of UAV air combat decision-making methods based on deep reinforcement learning have been proposed by various countries. However, when the number of agents increases and the type of aircraft changes, the action space and state space of reinforcement learning will change, which will face the problem of poor stability of the training process and is extremely sensitive to hyperparameters (such as learning rate). Therefore, based on the traditional multi-agent reinforcement learning based on AC decision network, this paper improves the decision network, introduces curriculum learning and transfer learning, and proposes a multi-agent reinforcement learning decision framework that can converge quickly and improve training robustness.
- 23 December 2022
- Published by Springer Nature
- p. 583-594
A 3D Reconstruction Network Based on Multi-sensor
- 23 December 2022
- Published by Springer Nature
- p. 583-594
A 3D Reconstruction Network Based on Multi-sensor
- 27 September 2022
- Published by Springer Nature
- p. 563-572
Graph Influence Maximization Algorithm Based on Reinforcement Learning-PPO Algorithm
- 27 September 2022
- Published by Springer Nature
- p. 563-572
Graph Influence Maximization Algorithm Based on Reinforcement Learning-PPO Algorithm
- Open Access
- 19 July 2018
- Published by IOP Publishing in Journal of Physics: Conference Series
- Vol. 1061 (1) , 012018
Simulation and Design of Solar Power System for Ocean Buoy
Promoting maritime power and improving the ability of planning ocean is considered to be an important issue of nation security and development in China, also a pivotal to implement 'The Belt and Road' strategy. As an automatic observation station on the sea, ocean buoys play a vital part in this strategy. The majority of ocean buoys, powered by accumulator, work far away from the shore. Thus, solar photovoltaic system is a valid supply power for ocean buoys, which can greatly improve the battery life and make ocean buoys more economical. This essay contraposes the problem of continuous power supply for ocean buoys working on the sea and design a solar photovoltaic system for ocean buoys that works on the South China Sea providing power of 1kW and voltage of 36V and also a protection of 72 hours supply on extreme occasions. In the end, there will be some expansion about other cities on their solar energy resources and solar photovoltaic system parameters.
- 19 July 2018
- Published by IOP Publishing in Journal of Physics: Conference Series
- Vol. 1061 (1) , 012018
Open AccessSimulation and Design of Solar Power System for Ocean Buoy
Promoting maritime power and improving the ability of planning ocean is considered to be an important issue of nation security and development in China, also a pivotal to implement 'The Belt and Road' strategy. As an automatic observation station on the sea, ocean buoys play a vital part in this strategy. The majority of ocean buoys, powered by accumulator, work far away from the shore. Thus, solar photovoltaic system is a valid supply power for ocean buoys, which can greatly improve the battery life and make ocean buoys more economical. This essay contraposes the problem of continuous power supply for ocean buoys working on the sea and design a solar photovoltaic system for ocean buoys that works on the South China Sea providing power of 1kW and voltage of 36V and also a protection of 72 hours supply on extreme occasions. In the end, there will be some expansion about other cities on their solar energy resources and solar photovoltaic system parameters.
- 5 February 2016
- Published by Springer Nature in The International Journal of Advanced Manufacturing Technology
- Vol. 84 (1-4) , 473-483
Human performance modeling for manufacturing based on an improved KNN algorithm
- 5 February 2016
- Published by Springer Nature in The International Journal of Advanced Manufacturing Technology
- Vol. 84 (1-4) , 473-483
Human performance modeling for manufacturing based on an improved KNN algorithm
- Open Access
- 16 September 2015
- Published by Wiley in Mathematical Problems in Engineering
- Vol. 2015, 1-10
A Simulation Perspective: Error Analysis in the Distributed Simulation of Continuous System
To construct a corresponding distributed system from a continuous system, the most convenient way is to partition the system into parts according to its topology and deploy the parts on separated nodes directly. However, system error will be introduced during this process because the computing pattern is changed from the sequential to the parallel. In this paper, the mathematical expression of the introduced error is studied. A theorem is proposed to prove that a distributed system preserving the stability property of the continuous system can be found if the system error is limited to be small enough. Then, the compositions of the system error are analyzed one by one and the complete expression is deduced, where the advancing stepTin distributed environment is one of the key factors associated. At last, the general steps to determine the stepTare given. The significance of this study lies in the fact that the maximumTcan be calculated without exceeding the expected error threshold, and a largerTcan reduce the simulation cost effectively without causing too much performance degradation compared to the original continuous system.
- 16 September 2015
- Published by Wiley in Mathematical Problems in Engineering
- Vol. 2015, 1-10
Open AccessA Simulation Perspective: Error Analysis in the Distributed Simulation of Continuous System
To construct a corresponding distributed system from a continuous system, the most convenient way is to partition the system into parts according to its topology and deploy the parts on separated nodes directly. However, system error will be introduced during this process because the computing pattern is changed from the sequential to the parallel. In this paper, the mathematical expression of the introduced error is studied. A theorem is proposed to prove that a distributed system preserving the stability property of the continuous system can be found if the system error is limited to be small enough. Then, the compositions of the system error are analyzed one by one and the complete expression is deduced, where the advancing stepTin distributed environment is one of the key factors associated. At last, the general steps to determine the stepTare given. The significance of this study lies in the fact that the maximumTcan be calculated without exceeding the expected error threshold, and a largerTcan reduce the simulation cost effectively without causing too much performance degradation compared to the original continuous system.
- Open Access
- 4 May 2015
- Published by Wiley in Mathematical Problems in Engineering
- Vol. 2015, 1-5
Quantized State Based Simulation of Time Invariant and Time Varying Continuous Systems
Continuous system can be discretized for computer simulation. Quantized state systems (QSS) method has been used to discretize time invariant systems based on the discretization of the state space. A HLA based QSS method is proposed in this paper to address issues of real-time advancements in simulation and an aircraft control example was introduced to illustrate our method. Moreover, to simulate time varying systems, a novel approach is also proposed and exemplified with a practical case.
- 4 May 2015
- Published by Wiley in Mathematical Problems in Engineering
- Vol. 2015, 1-5
Open AccessQuantized State Based Simulation of Time Invariant and Time Varying Continuous Systems
Continuous system can be discretized for computer simulation. Quantized state systems (QSS) method has been used to discretize time invariant systems based on the discretization of the state space. A HLA based QSS method is proposed in this paper to address issues of real-time advancements in simulation and an aircraft control example was introduced to illustrate our method. Moreover, to simulate time varying systems, a novel approach is also proposed and exemplified with a practical case.
- Open Access
- 22 March 2015
- Published by Wiley in Mathematical Problems in Engineering
- Vol. 2015, 1-11
A Load Balancing Scheme Using Federate Migration Based on Virtual Machines for Cloud Simulations
A maturing and promising technology, Cloud computing can benefit large-scale simulations by providing on-demand, anywhere simulation services to users. In order to enable multitask and multiuser simulation systems with Cloud computing, Cloud simulation platform (CSP) was proposed and developed. To use key techniques of Cloud computing such as virtualization to promote the running efficiency of large-scale military HLA systems, this paper proposes a new type of federate container, virtual machine (VM), and its dynamic migration algorithm considering both computation and communication cost. Experiments show that the migration scheme effectively improves the running efficiency of HLA system when the distributed system is not saturated.
- 22 March 2015
- Published by Wiley in Mathematical Problems in Engineering
- Vol. 2015, 1-11
Open AccessA Load Balancing Scheme Using Federate Migration Based on Virtual Machines for Cloud Simulations
A maturing and promising technology, Cloud computing can benefit large-scale simulations by providing on-demand, anywhere simulation services to users. In order to enable multitask and multiuser simulation systems with Cloud computing, Cloud simulation platform (CSP) was proposed and developed. To use key techniques of Cloud computing such as virtualization to promote the running efficiency of large-scale military HLA systems, this paper proposes a new type of federate container, virtual machine (VM), and its dynamic migration algorithm considering both computation and communication cost. Experiments show that the migration scheme effectively improves the running efficiency of HLA system when the distributed system is not saturated.