An efficient and accurate 2D human pose estimation method using VTTransPose network
Authors:
Open Access
- 31 March 2024
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 14 (1) , 1-12
Abstract
Human pose estimation is a crucial area of study in computer vision. Transformer-based pose estimation algorithms have gained popularity for their excellent performance and relatively compact parameterization. However, these algorithms often face challenges including high computational demands and insensitivity to local details. To address these problems, the Twin attention module was introduced in TransPose to improve model efficiency and reduce resource consumption. Additionally, to address issues related to insufficient joint feature representation and poor network recognition performance, the enhanced TransPose model, named VTTransPose, replaced the basic block in the third subnet with the intra-level feature fusion module V block. The performance of the proposed VTTransPose model was validated on the public datasets COCO val2017 and COCO test-dev2017. The experimental results on COCO val2017 and COCO test-dev2017 indicate that the AP evaluation index scores of the VTTransPose network proposed are 76.5 and 73.6 respectively, marking improvements of 0.4 and 0.2 over the original TransPose network. Additionally, VTTransPose exhibited a reduction of 4.8G FLOPs, 2M parameters, and approximately 40% lower memory usage during training compared to the original TransPose model. All the experimental results demonstrate that the proposed VTTransPose is more accurate, efficient, and lightweight compared to the original TransPose model.Keywords
All Related Versions
Funding Information
- Shaanxi Provincial Department of Education 2022 General Special Research Program Projects (No.22JK0471)
- Xi'an People's Hospital (Xi'an No. 4 Hospital) Research Incubation Fund Program (No.2022BSH01(BH-1))
This publication has 26 references indexed in Scilit:
- Human pose estimation and its application to action recognition: A surveyJournal of Visual Communication and Image Representation, 2021
- Learning Delicate Local Representations for Multi-person Pose Estimation2020
- Simple Baselines for Human Pose Estimation and Tracking2018
- Integral Human Pose Regression2018
- Jointly Optimize Data Augmentation and Network Training: Adversarial Data Augmentation in Human Pose Estimation2018
- Human Pose Estimation with Parsing Induced Learner2018
- Towards Accurate Multi-person Pose Estimation in the Wild2017
- Xception: Deep Learning with Depthwise Separable Convolutions2017
- 2D Human Pose Estimation: New Benchmark and State of the Art Analysis2014
- Microsoft COCO: Common Objects in Context2014