An efficient and accurate 2D human pose estimation method using VTTransPose network
Authors:
Preprint
- 25 July 2023
- preprint
- Published by Springer Nature in Research Square
Abstract
Human pose estimation is an important research direction in the field of computer vision, and transformer-based pose estimation algorithms have been favored for their excellent performance and low parametric number. Nonetheless, the algorithms suffer from computational complexity and insensitivity to local details. To address these problems, the transpose model introduces the twin attention module to improve the model efficiency and reduce resource consumption. Additionally, to solve the drawback of insufficiently high-quality joint feature representation resulting in poor network recognition, the intra-level feature fusion module V block was used to replace the basic block in the third subnet of the CNN backbone in the TransPose model. Then, the improved TransPose pose estimation network named VTTransPose was set up. The VTTranspose network achieves AP evaluation index scores of 76.5 and 73.6 on COCO val2017 and COCO test-dev2017, which shows an improvement of 0.4 and 0.2 compared to the original TransPose network. Moreover, the FLOPs of VTTransPose are reduced by 4.8G, the number of parameters is decreased by 2M, and the memory usage during training is reduced by about 40%. All the experimental results demonstrate that the proposed VTTransPose is more accurate, efficient, and lightweight compared with the original TransPose model.Keywords
All Related Versions
- Version 1, 2023-07-25, Research Square
- Published version: Scientific Reports, 14 (1), 1.
This publication has 3 references indexed in Scilit:
- ViTAEv2: Vision Transformer Advanced by Exploring Inductive Bias for Image Recognition and BeyondInternational Journal of Computer Vision, 2023
- Human pose estimation and its application to action recognition: A surveyJournal of Visual Communication and Image Representation, 2021
- Deep High-Resolution Representation Learning for Visual RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2020