Mengni Fan
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Mengni Fan has a total of 3 co-authors. Here are the top co-authors by number of shared publications:
- Bo Li
China Railway Siyuan Survey and Design Group Co., Ltd., Wuhan 430063, China
1 shared publication - Huiyu Liu
School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, China
1 shared publication - Jin Cao
China Railway Siyuan Survey and Design Group Co., Ltd., Wuhan 430063, China
1 shared publication
Latest Publications
- Open Access
- 13 July 2022
- Published by MDPI AG in Algorithms
- Vol. 15 (7) , 244
Inference Acceleration with Adaptive Distributed DNN Partition over Dynamic Video Stream
Deep neural network-based computer vision applications have exploded and are widely used in intelligent services for IoT devices. Due to the computationally intensive nature of DNNs, the deployment and execution of intelligent applications in smart scenarios face the challenge of limited device resources. Existing job scheduling strategies are single-focused and have limited support for large-scale end-device scenarios. In this paper, we present ADDP, an adaptive distributed DNN partition method that supports video analysis on large-scale smart cameras. ADDP applies to the commonly used DNN models for computer vision and contains a feature-map layer partition module (FLP) supporting edge-to-end collaborative model partition and a feature-map size partition (FSP) module supporting multidevice parallel inference. Based on the inference delay minimization objective, FLP and FSP achieve a tradeoff between the arithmetic and communication resources of different devices. We validate ADDP on heterogeneous devices and show that both the FLP module and the FSP module outperform existing approaches and reduce single-frame response latency by 10–25% compared to the pure on-device processing.
- 13 July 2022
- Published by MDPI AG in Algorithms
- Vol. 15 (7) , 244
Open AccessInference Acceleration with Adaptive Distributed DNN Partition over Dynamic Video Stream
Deep neural network-based computer vision applications have exploded and are widely used in intelligent services for IoT devices. Due to the computationally intensive nature of DNNs, the deployment and execution of intelligent applications in smart scenarios face the challenge of limited device resources. Existing job scheduling strategies are single-focused and have limited support for large-scale end-device scenarios. In this paper, we present ADDP, an adaptive distributed DNN partition method that supports video analysis on large-scale smart cameras. ADDP applies to the commonly used DNN models for computer vision and contains a feature-map layer partition module (FLP) supporting edge-to-end collaborative model partition and a feature-map size partition (FSP) module supporting multidevice parallel inference. Based on the inference delay minimization objective, FLP and FSP achieve a tradeoff between the arithmetic and communication resources of different devices. We validate ADDP on heterogeneous devices and show that both the FLP module and the FSP module outperform existing approaches and reduce single-frame response latency by 10–25% compared to the pure on-device processing.