Label-reconstruction-based pseudo-subscore learning for action quality assessment in sporting events
- 13 August 2022
- journal article
- research article
- Published by Springer Nature in Applied Intelligence
- Vol. 53 (9) , 10053-10067
Abstract
Most existing action quality assessment (AQA) methods provide only an overall quality score for the input video and lack an evaluation of each substage of the movement process; thus, these methods cannot provide detailed feedback for users. Moreover, the existing datasets do not provide labels for substage quality assessment. To address these problems, in this work, a new label-reconstruction-based pseudo-subscore learning (PSL) method is proposed for AQA in sporting events. In the proposed method, the overall score of an action is not only regarded as a quality label but also used as a feature of the training set. A label-reconstruction-based learning algorithm is built to generate pseudo-subscore labels for the training set. Moreover, based on the pseudo-subscore labels and overall score labels, a multi-substage AQA model is fine-tuned from the PSL model to predict the action quality score of each substage and the overall score for an athlete. Several ablation experiments are performed to verify the effectiveness of each module. The experimental results show that our approach achieves state-of-the-art performance.Keywords
Funding Information
- National Natural Science Foundation of China (61871196)
- National Natural Science Foundation of China (62001176)
This publication has 29 references indexed in Scilit:
- S3D: Stacking Segmental P3D for Action Quality Assessment2018
- Deep learning with convolutional neural network for objective skill evaluation in robot-assisted surgeryInternational Journal of Computer Assisted Radiology and Surgery, 2018
- End-To-End Learning for Action Quality Assessment2018
- Evaluating Surgical Skills from Kinematic Data Using Convolutional Neural Networks2018
- Who's Better? Who's Best? Pairwise Deep Ranking for Skill Determination2018
- Learning Spatio-Temporal Representation with Pseudo-3D Residual Networks2017
- Learning to Score Olympic Events2017
- Temporal Convolutional Networks for Action Segmentation and Detection2017
- Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset2017
- Automated robot‐assisted surgical skill evaluation: Predictive analytics approachThe International Journal of Medical Robotics and Computer Assisted Surgery, 2017