HLHailiang Li
Hailiang Li
*This is an algorithmically generated author record based on publicly available information.
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Hailiang Li has a total of 5 co-authors. Here are the top co-authors by number of shared publications:
- Cong Zhao
National Engineering Laboratory for Big Data Analytics (NEL-BDA), Xian Jiaotong University, Shaanxi, China
1 shared publication - Shusen Yang
Xi’an Jiaotong University
1 shared publication - Siyan Guo
School of Mathematics and Statistics, Xi’an Jiaotong University, Xi’an 710049, China
1 shared publication Xin Song
National Engineering Laboratory for Big Data Analytics (NEL-BDA), Xian Jiaotong University, Xian, China
1 shared publication- Zhanhua Zhang
Zhejiang University, Hangzhou, China and Geely Automotive Research Institute, Ningbo, China
1 shared publication
Latest Publications
- 26 May 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Parallel and Distributed Systems
- Vol. 33 (12) , 4039-4056
CNNPC: End-Edge-Cloud Collaborative CNN Inference With Joint Model Partition and Compression
Edge Intelligence (EI) aims at addressing concerns like response latency risen by the conflict between predominating Cloud-based deployments of computationally intensive AI applications and the expensive uploading of explosive end data. Convolutional Neural Networks (CNNs) leading the latest flourish of AI inevitably suffer from the aforementioned conflict. There emerge increasing EI-driven attempts on fast CNN inference with high accuracy in the End-Edge-Cloud (EEC) collaborative computing paradigm, where, however, neither model compression approaches for on-device inference nor collaborative inference methods across devices can effectively achieve the trade-off between latency and accuracy of End-to-End (E2E) inference. In this article, we present CNNPC that jointly partitions and compresses CNNs for fast inference with high accuracy in collaborative EEC systems. We implemented CNNPC (source code available at https://github.com/IoTDATALab/CNNPC ) and evaluated its performance within extensive real-world EEC scenarios. Experimental results demonstrate that, compared with state-of-the-art single-end and collaborative approaches, without obvious accuracy loss, collaborative inference based on CNNPC is up to$1.6\times$ and$5.6\times$ faster, and requires as low as$4.30\%$ and$6.48\%$ communications, respectively. Besides, when determines the optimal strategy, CNNPC requires as low as$0.1\%$ actual compression operations that the traversal method (the only viable method providing the theoretically optimal strategy) requires.- 26 May 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Parallel and Distributed Systems
- Vol. 33 (12) , 4039-4056
CNNPC: End-Edge-Cloud Collaborative CNN Inference With Joint Model Partition and Compression
Edge Intelligence (EI) aims at addressing concerns like response latency risen by the conflict between predominating Cloud-based deployments of computationally intensive AI applications and the expensive uploading of explosive end data. Convolutional Neural Networks (CNNs) leading the latest flourish of AI inevitably suffer from the aforementioned conflict. There emerge increasing EI-driven attempts on fast CNN inference with high accuracy in the End-Edge-Cloud (EEC) collaborative computing paradigm, where, however, neither model compression approaches for on-device inference nor collaborative inference methods across devices can effectively achieve the trade-off between latency and accuracy of End-to-End (E2E) inference. In this article, we present CNNPC that jointly partitions and compresses CNNs for fast inference with high accuracy in collaborative EEC systems. We implemented CNNPC (source code available at https://github.com/IoTDATALab/CNNPC ) and evaluated its performance within extensive real-world EEC scenarios. Experimental results demonstrate that, compared with state-of-the-art single-end and collaborative approaches, without obvious accuracy loss, collaborative inference based on CNNPC is up to$1.6\times$ and$5.6\times$ faster, and requires as low as$4.30\%$ and$6.48\%$ communications, respectively. Besides, when determines the optimal strategy, CNNPC requires as low as$0.1\%$ actual compression operations that the traversal method (the only viable method providing the theoretically optimal strategy) requires.