Joanna Stanisz
Research Subjects
Research Interests
Joanna Stanisz has a total of 24 co-authors. Here are the top co-authors by number of shared publications:
- Konrad Lis
AGH University of Krakow
2 shared publications - Marek Gorgon
AGH University of Krakow
2 shared publications - Adam Glowacz
Department of Automatic Control and Robotics, Faculty of Electrical Engineering, Automatics, Computer Science and Biomedical Engineering, AGH University of Science and Technology, Al. A. Mickiewicza 30, 30-059 Krakow, Poland
1 shared publication - Aleksander Kostuch
AGH University of Krakow
1 shared publication - Andrzej Brodzicki
Department of Automatic Control and Robotics, AGH University of Science and Technology, 30-059 Krakow, Poland
1 shared publication - Anna Wójcicka
AGH University of Krakow
1 shared publication
Latest Publications
- 1 January 2022
- Published by AGH University Press
- p. 17-31
Systemy wizyjne w zastosowaniach przemysłowych
- 1 January 2022
- Published by AGH University Press
- p. 17-31
Systemy wizyjne w zastosowaniach przemysłowych
- Open Access
- 27 December 2021
- Published by Springer Nature in Journal of Signal Processing Systems
- Vol. 94 (7) , 659-674
Implementation of the PointPillars Network for 3D Object Detection in Reprogrammable Heterogeneous Devices Using FINN
In this paper, we present a hardware-software implementation of a deep neural network for object detection based on a point cloud obtained by a LiDAR sensor. The PointPillars network was used in the research, as it is a reasonable compromise between detection accuracy and calculation complexity. The Brevitas / PyTorch tools were used for network quantisation (described in our previous paper) and the FINN tool for hardware implementation in the reprogrammable Zynq UltraScale+ MPSoC device. The obtained results show that quite a significant computation precision limitation along with a few network architecture simplifications allows the solution to be implemented on a heterogeneous embedded platform with maximum 19% AP loss in 3D, maximum 8% AP loss in BEV and execution time 375ms (the FPGA part takes 262ms). We have also compared our solution in terms of inference speed with a Vitis AI implementation proposed by Xilinx (19 Hz frame rate). Especially, we have thoroughly investigated the fundamental causes of differences in the frame rate of both solutions. The code is available at https://github.com/vision-agh/pp-finn.
- 27 December 2021
- Published by Springer Nature in Journal of Signal Processing Systems
- Vol. 94 (7) , 659-674
Open AccessImplementation of the PointPillars Network for 3D Object Detection in Reprogrammable Heterogeneous Devices Using FINN
In this paper, we present a hardware-software implementation of a deep neural network for object detection based on a point cloud obtained by a LiDAR sensor. The PointPillars network was used in the research, as it is a reasonable compromise between detection accuracy and calculation complexity. The Brevitas / PyTorch tools were used for network quantisation (described in our previous paper) and the FINN tool for hardware implementation in the reprogrammable Zynq UltraScale+ MPSoC device. The obtained results show that quite a significant computation precision limitation along with a few network architecture simplifications allows the solution to be implemented on a heterogeneous embedded platform with maximum 19% AP loss in 3D, maximum 8% AP loss in BEV and execution time 375ms (the FPGA part takes 262ms). We have also compared our solution in terms of inference speed with a Vitis AI implementation proposed by Xilinx (19 Hz frame rate). Especially, we have thoroughly investigated the fundamental causes of differences in the frame rate of both solutions. The code is available at https://github.com/vision-agh/pp-finn.