Learning Sparse Temporal Video Mapping for Action Quality Assessment in Floor Gymnastics
- 16 May 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Instrumentation and Measurement
- Vol. 73 (00189456) , 1-11
Abstract
Automated athlete performance measurement from sports videos can significantly enhance sports evaluation. It requires modeling extended sequences, as the intricate spatio-temporal progression significantly influences overall performance. However, the lack of comprehensive datasets with long-duration samples has hindered researchers from focusing on temporal aspects, leading them to primarily concentrate on spatial structures for assessing short-duration videos. Consequently, in-depth analysis of longer videos has received limited attention. This study aims to explore long-term videos and analyze local discriminative spatial dependencies and global semantics for sports action quality assessment (AQA). A new dataset, coined AGF-Olympics, is presented in this paper incorporating artistic gymnastic floor routines. It features highly challenging scenarios with extensive variations in background, viewpoint, and scale, with a duration of up to 2 min. Finally, a discriminative non-local attention (DNLA) is introduced for score regression that effectively maps dense feature space to a sparse representation by disentangling complex associations in long-duration sports videos. DNLA encodes crucial features by analyzing cross-space–time correlations and filtering out features with lower significance. Thus, it ensures that the model prioritizes significant joints in the spatial domain and frames in the temporal domain. Experimental results demonstrate that the proposed method achieves superior performances and provides a benchmark for the AGF-Olympics dataset. Overall, the proposed method achieves a 7% higher regression rate with a 65.14% reduction in FLOPS and 52.82% faster inference time compared to the current state-of-the-art method.Keywords
All Related Versions
Funding Information
- University Postgraduate Award and University of Western Australia International Fee Scholarship
- Australian Research Council Future Fellowship Award through the Australian Government (FT210100268)
This publication has 37 references indexed in Scilit:
- Impact and workload are dominating on-field data monitoring techniques to track health and well-being of team-sports athletesPhysiological Measurement, 2022
- On-field player workload exposure and knee injury risk monitoring via deep learningJournal of Biomechanics, 2019
- What and How Well You Performed? A Multitask Learning Approach to Action Quality Assessment2019
- End-To-End Learning for Action Quality Assessment2018
- Who's Better? Who's Best? Pairwise Deep Ranking for Skill Determination2018
- Non-local Neural Networks2018
- Predicting athlete ground reaction forces and moments from motion captureMedical & Biological Engineering & Computing, 2018
- Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset2017
- Assessing the Quality of Actions2014
- A Non-Local Algorithm for Image Denoising2005