Pengcheng Li
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Pengcheng Li has a total of 20 co-authors. Here are the top co-authors by number of shared publications:
- Fei Feng
Alibaba Group, Hangzhou, Zhejiang, China
1 shared publication - Guohui Wang
Alibaba Group, Hangzhou, Zhejiang, China
1 shared publication - Hao Li
Alibaba Group, Hangzhou, Zhejiang, China
1 shared publication - Heng Pan
Alibaba Group, Hangzhou, Zhejiang, China
1 shared publication - Jianbo Dong
Alibaba Cloud, Beijing, China
1 shared publication - Jie Zhang
Alibaba Group, Hangzhou, Zhejiang, China
1 shared publication
Latest Publications
- 22 June 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Micro
- Vol. 41 (5) , 85-92
ACCL: Architecting Highly Scalable Distributed Training Systems With Highly Efficient Collective Communication Library
Distributed systems have been widely adopted for Deep Neural Networks (DNNs) model training. However, the scalability of distributed training systems is largely bounded by the communication cost. We design a highly-efficient collective communication library, namely Alibaba Collective Communication Library(ACCL), to build distributed training systems with linear scalability. ACCL provides optimized algorithms to fully make use of heterogeneous interconnects simultaneously. And the experimental results show significant performance improvement.decoupling the algorithm and communication operations. By leveraging ACCL, we propose a hybrid algorithm to fully make use of the intra- and inter-node interconnects simultaneously. The experimental results show that the communication performance of ACCL is about 3x over NCCL. And the end-to-end performance of applications can be improved by 12.6% to 25.2%, with respect to the ratio of communication time.
- 22 June 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Micro
- Vol. 41 (5) , 85-92
ACCL: Architecting Highly Scalable Distributed Training Systems With Highly Efficient Collective Communication Library
Distributed systems have been widely adopted for Deep Neural Networks (DNNs) model training. However, the scalability of distributed training systems is largely bounded by the communication cost. We design a highly-efficient collective communication library, namely Alibaba Collective Communication Library(ACCL), to build distributed training systems with linear scalability. ACCL provides optimized algorithms to fully make use of heterogeneous interconnects simultaneously. And the experimental results show significant performance improvement.decoupling the algorithm and communication operations. By leveraging ACCL, we propose a hybrid algorithm to fully make use of the intra- and inter-node interconnects simultaneously. The experimental results show that the communication performance of ACCL is about 3x over NCCL. And the end-to-end performance of applications can be improved by 12.6% to 25.2%, with respect to the ratio of communication time.
- Open Access
Phoebe: Reuse-Aware Online Caching with Reinforcement Learning for Emerging Storage Models
With data durability, high access speed, low power efficiency and byte addressability, NVMe and SSD, which are acknowledged representatives of emerging storage technologies, have been applied broadly in many areas. However, one key issue with high-performance adoption of these technologies is how to properly define intelligent cache layers such that the performance gap between emerging technologies and main memory can be well bridged. To this end, we propose Phoebe, a reuse-aware reinforcement learning framework for the optimal online caching that is applicable for a wide range of emerging storage models. By continuous interacting with the cache environment and the data stream, Phoebe is capable to extract critical temporal data dependency and relative positional information from a single trace, becoming ever smarter over time. To reduce training overhead during online learning, we utilize periodical training to amortize costs. Phoebe is evaluated on a set of Microsoft cloud storage workloads. Experiment results show that Phoebe is able to close the gap of cache miss rate from LRU and a state-of-the-art online learning based cache policy to the Belady's optimal policy by 70.3% and 52.6%, respectively.
Open AccessPhoebe: Reuse-Aware Online Caching with Reinforcement Learning for Emerging Storage Models
With data durability, high access speed, low power efficiency and byte addressability, NVMe and SSD, which are acknowledged representatives of emerging storage technologies, have been applied broadly in many areas. However, one key issue with high-performance adoption of these technologies is how to properly define intelligent cache layers such that the performance gap between emerging technologies and main memory can be well bridged. To this end, we propose Phoebe, a reuse-aware reinforcement learning framework for the optimal online caching that is applicable for a wide range of emerging storage models. By continuous interacting with the cache environment and the data stream, Phoebe is capable to extract critical temporal data dependency and relative positional information from a single trace, becoming ever smarter over time. To reduce training overhead during online learning, we utilize periodical training to amortize costs. Phoebe is evaluated on a set of Microsoft cloud storage workloads. Experiment results show that Phoebe is able to close the gap of cache miss rate from LRU and a state-of-the-art online learning based cache policy to the Belady's optimal policy by 70.3% and 52.6%, respectively.