Attention-Based 2-D Hand Keypoints Localization
- 13 August 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Letters
- Vol. 8 (9) , 1-4
Abstract
Hand keypoint localization is used extensively in human–computer interaction, but accurate localization is challenging due to closeness between the fingers and the keypoints, occlusion, varied hand poses, complex backgrounds, and extreme lighting conditions. Despite much research, challenges persist. Therefore, we propose an encoder–decoder architecture aided by a novel attention module to precisely localize hand keypoints. The attention module captures keypoint-relevant features at two different scales that encompass local and global characteristics. Further, the loss function teaches the model to remove spurious detected keypoints in the initial learning phase. The proposed architecture outputs precise keypoint locations, as indicated by the qualitative and quantitative results. Evaluation of two benchmark RGB image datasets, comprising all the challenges encountered in keypoint localization, resulted in endpoint errors as low as 2.78 and 1.85 pixels and 98.50% and 99.77% correct keypoints, respectively. This shows the proposed model's effectiveness and ability to overcome challenges.Keywords
This publication has 19 references indexed in Scilit:
- Hand pose estimation based on regression method from monocular RGB cameras for handling occlusionMultimedia Tools and Applications, 2023
- AssemblyHands: Towards Egocentric Activity Understanding via 3D Hand Pose Estimation2023
- TriHorn-Net: A model for accurate depth-based 3D hand pose estimationExpert Systems with Applications, 2023
- A graph-based approach for absolute 3D hand pose estimation using a single RGB imageApplied Intelligence, 2022
- Cascaded hierarchical CNN for 2D hand pose estimation from a single color imageMultimedia Tools and Applications, 2022
- FastHand: Fast monocular hand pose estimation on embedded systemsJournal of Systems Architecture, 2022
- SA-Net: Shuffle Attention for Deep Convolutional Neural Networks2021
- Coordinate Attention for Efficient Mobile Network Design2021
- UniPose: Unified Human Pose Estimation in Single Images and Videos2020
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015