TT3D: Table Tennis 3D Reconstruction
Authors:
Preprint
Abstract
Sports analysis requires processing large amounts of data, which is time-consuming and costly. Advancements in neural networks have significantly alleviated this burden, enabling highly accurate ball tracking in sports broadcasts. However, relying solely on 2D ball tracking is limiting, as it depends on the camera's viewpoint and falls short of supporting comprehensive game analysis. To address this limitation, we propose a novel approach for reconstructing precise 3D ball trajectories from online table tennis match recordings. Our method leverages the underlying physics of the ball's motion to identify the bounce state that minimizes the reprojection error of the ball's flying trajectory, hence ensuring an accurate and reliable 3D reconstruction. A key advantage of our approach is its ability to infer ball spin without relying on human pose estimation or racket tracking, which are often unreliable or unavailable in broadcast footage. We developed an automated camera calibration method capable of reliably tracking camera movements. Additionally, we adapted an existing 3D pose estimation model, which lacks depth motion capture, to accurately track player movements. Together, these contributions enable the full 3D reconstruction of a table tennis rally.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- TrackNetV4: Enhancing Fast Sports Object Tracking with Motion Attention Maps2025
- HOPS: A Fast Algorithm for Segmenting Piecewise Polynomials of Arbitrary OrdersIEEE Access, 2021
- Model trajectories for a spinning tennis ball: I. The service strokePhysica Scripta, 2018
- Object Detection and Tracking Based on Trajectory in Broadcast Tennis VideoProcedia Computer Science, 2015
- Learning strategies in table tennis using inverse reinforcement learningBiological Cybernetics, 2014
- Bouncing model for the table tennis trajectory prediction and the strategy of hitting the ball2012
- Ball tracking and 3D trajectory approximation with applications to tactics analysis from single-camera volleyball sequencesMultimedia Tools and Applications, 2011
- Automatic camera calibration of broadcast tennis video with applications to 3D virtual content insertion and ball detection and trackingComputer Vision and Image Understanding, 2009
- Physics-based ball tracking and 3D trajectory reconstruction with applications to shooting location estimation in basketball videoJournal of Visual Communication and Image Representation, 2009
- Robust Detection of Lines Using the Progressive Probabilistic Hough TransformComputer Vision and Image Understanding, 2000