P2ANet: A Large-Scale Benchmark for Dense Action Detection from Table Tennis Match Broadcasting Videos
Open Access
- 11 January 2024
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Multimedia Computing, Communications, and Applications
- Vol. 20 (4) , 1-23
Abstract
While deep learning has been widely used for video analytics, such as video classification and action detection, dense action detection with fast-moving subjects from sports videos is still challenging. In this work, we release yet another sports video benchmarkP2ANetforPingPong-Action detection, which consists of 2,721 video clips collected from the broadcasting videos of professional table tennis matches in World Table Tennis Championships and Olympiads. We work with a crew of table tennis professionals and referees on a specially designed annotation toolbox to obtain fine-grained action labels (in 14 classes) for every ping-pong action that appeared in the dataset, and formulate two sets of action detection problems—action localizationandaction recognition. We evaluate a number of commonly seen action recognition (e.g., TSM, TSN, Video SwinTransformer, and Slowfast) and action localization models (e.g., BSN, BSN++, BMN, TCANet), usingP2ANetfor both problems, under various settings. These models can only achieve 48% area under the AR-AN curve for localization and 82% top-one accuracy for recognition since the ping-pong actions are dense with fast-moving subjects but broadcasting videos are with only 25 FPS. The results confirm thatP2ANetis still a challenging task and can be used as a special benchmark for dense action detection from videos. We invite readers to examine our dataset by visiting the following link:https://github.com/Fred1991/P2ANET.Keywords
All Related Versions
This publication has 60 references indexed in Scilit:
- Temporal Segment Networks: Towards Good Practices for Deep Action Recognition2016
- A Hierarchical Deep Temporal Model for Group Activity Recognition2016
- Temporal Action Localization with Pyramid of Score Distribution Features2016
- Temporal Action Localization in Untrimmed Videos via Multi-stage CNNs2016
- Learning Spatiotemporal Features with 3D Convolutional Networks2015
- ActivityNet: A large-scale video benchmark for human activity understanding2015
- Large-Scale Video Classification with Convolutional Neural Networks2014
- Action Recognition in Realistic Sports Videos2014
- Modeling Temporal Structure of Decomposable Motion Segments for Activity Classification2010
- Histograms of Oriented Gradients for Human Detection2005