EdgePose: Real-Time Human Pose Estimation Scheme for Industrial Scenes
Open Access
- 19 August 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 12, 156702-156716
Abstract
Common human pose estimation methods rely on 2D heatmap regression, which requires expensive upsampling layers to maintain the resolution of the heatmap and additional post-processing for coordinate decoding. These components hinder the inference speed of human pose estimation tasks. To address this challenge, we propose a new real-time human pose estimation framework, EdgePose. First, we design the convolutional module EdgeBlock-C and the edge attention module EdgeBlock-T, and then build a hybrid network based on them to take advantage of both ConvNet and VIT. In addition, EdgePose simplifies the human pose estimation process by converting the output of the key point coordinates into a pixel classification task along the horizontal and vertical axes, thereby eliminating the upsampling and post-processing operations that may hinder inference speed, and speeding up the model’s inference speed while ensuring accuracy. The experimental results show that EdgePose-S achieved an AP score of 68.6 in the COCO validation test, and at the same time achieved an inference speed of 285.7 FPS on an Intel i9-10920X CPU. In the embedded Jetson Xavier NX environment, EdgePose-B achieved an AP score of 72.2 and an inference speed of 51.3 FPS, which is better than existing two-stage pose estimation methods.Keywords
Funding Information
- National Natural Science Foundation of China (62106083)
- Youth Program of Fujian Science Foundation (2022J05162)
- Xiamen Ocean and Fishery Development Special Fund Project (21CZB013HJ15)
- Xiamen Key Laboratory of Marine Intelligent Terminal Research and Development and Application (B2024008)
This publication has 46 references indexed in Scilit:
- Visual attention networkComputational Visual Media, 2023
- An improved lightweight high-resolution network based on multi-dimensional weighting for human pose estimationScientific Reports, 2023
- SimCC: A Simple Coordinate Classification Perspective for Human Pose Estimation2022
- HigherHRNet: Scale-Aware Representation Learning for Bottom-Up Human Pose Estimation2020
- The Devil Is in the Details: Delving Into Unbiased Data Processing for Human Pose Estimation2020
- Deep High-Resolution Representation Learning for Human Pose Estimation2019
- CrowdPose: Efficient Crowded Scenes Pose Estimation and a New Benchmark2019
- Simple Baselines for Human Pose Estimation and Tracking2018
- MobileNetV2: Inverted Residuals and Linear Bottlenecks2018
- 2D Human Pose Estimation: New Benchmark and State of the Art Analysis2014