Fang Zhou
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Fang Zhou has a total of 3 co-authors. Here are the top co-authors by number of shared publications:
- Fen Ge
College of Electronic and Information Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China
1 shared publication - Guohui Zhang
College of Integrated Circuits, Nanjing University of Aeronautics and Astronautics, China
1 shared publication - Ziyu Li
College of Integrated Circuits, Nanjing University of Aeronautics and Astronautics, China
1 shared publication
Latest Publications
- Open Access
- 1 January 2024
- Published by Institution of Engineering and Technology (IET) in IET Computers & Digital Techniques
- Vol. 2024 (1)
A FPGA Accelerator of Distributed A3C Algorithm with Optimal Resource Deployment
The asynchronous advantage actor‐critic (A3C) algorithm is widely regarded as one of the most effective and powerful algorithms among various deep reinforcement learning algorithms. However, the distributed and asynchronous nature of the A3C algorithm brings increased algorithm complexity and computational requirements, which not only leads to an increased training cost but also amplifies the difficulty of deploying the algorithm on resource‐limited field programmable gate array (FPGA) platforms. In addition, the resource wastage problem caused by the distributed training characteristics of A3C algorithms and the resource allocation problem affected by the imbalance between the computational amount of inference and training need to be carefully considered when designing accelerators. In this paper, we introduce a deployment strategy designed for distributed algorithms aimed at enhancing the resource utilization of hardware devices. Subsequently, a FPGA architecture is constructed specifically for accelerating the inference and training processes of the A3C algorithm. The experimental results show that our proposed deployment strategy reduces resource consumption by 62.5% and decreases the number of agents waiting for training by 32.2%, and the proposed A3C accelerator achieves 1.83× and 2.39× improvements in speedup compared to CPU (Intel i9‐13900K) and GPU (NVIDIA RTX 4090) with less power consumption respectively. Furthermore, our design shows superior resource efficiency compared to existing works.
- 1 January 2024
- Published by Institution of Engineering and Technology (IET) in IET Computers & Digital Techniques
- Vol. 2024 (1)
Open AccessA FPGA Accelerator of Distributed A3C Algorithm with Optimal Resource Deployment
The asynchronous advantage actor‐critic (A3C) algorithm is widely regarded as one of the most effective and powerful algorithms among various deep reinforcement learning algorithms. However, the distributed and asynchronous nature of the A3C algorithm brings increased algorithm complexity and computational requirements, which not only leads to an increased training cost but also amplifies the difficulty of deploying the algorithm on resource‐limited field programmable gate array (FPGA) platforms. In addition, the resource wastage problem caused by the distributed training characteristics of A3C algorithms and the resource allocation problem affected by the imbalance between the computational amount of inference and training need to be carefully considered when designing accelerators. In this paper, we introduce a deployment strategy designed for distributed algorithms aimed at enhancing the resource utilization of hardware devices. Subsequently, a FPGA architecture is constructed specifically for accelerating the inference and training processes of the A3C algorithm. The experimental results show that our proposed deployment strategy reduces resource consumption by 62.5% and decreases the number of agents waiting for training by 32.2%, and the proposed A3C accelerator achieves 1.83× and 2.39× improvements in speedup compared to CPU (Intel i9‐13900K) and GPU (NVIDIA RTX 4090) with less power consumption respectively. Furthermore, our design shows superior resource efficiency compared to existing works.