TT3D: Table Tennis 3D Reconstruction
Authors:
- 11 June 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 5821-5831
Abstract
Sports analysis requires processing large amounts of data, which is time-consuming and costly. Advancements in neural networks have significantly alleviated this burden, enabling highly accurate ball tracking in sports broadcasts. However, relying solely on 2D ball tracking is limiting, as it depends on the camera's viewpoint and falls short of supporting comprehensive game analysis. To address this limitation, we propose a novel approach for reconstructing precise 3D ball trajectories from online table tennis match recordings. Our method leverages the underlying physics of the ball's motion to identify the bounce state that minimizes the reprojection error of the ball's flying trajectory, hence ensuring an accurate and reliable 3D reconstruction. A key advantage of our approach is its ability to infer ball spin without relying on human pose estimation or racket tracking, which are often unreliable or unavailable in broadcast footage. We developed an automated camera calibration method capable of reliably tracking camera movements. Additionally, we adapted an existing 3D pose estimation model, which lacks depth motion capture, to accurately track player movements. Together, these contributions enable the full 3D reconstruction of a table tennis rally. Project page: https://cogsystuebingen.github.io/tt3d/Keywords
All Related Versions
This publication has 43 references indexed in Scilit:
- A Table Tennis Robot System Using an Industrial KUKA Robot Arm2019
- UNet++: A Nested U-Net Architecture for Medical Image Segmentation2018
- CasADi: a software framework for nonlinear optimization and optimal controlMathematical Programming Computation, 2018
- Ball tracking in sports: a surveyArtificial Intelligence Review, 2017
- Generalised Dice Overlap as a Deep Learning Loss Function for Highly Unbalanced Segmentations2017
- 3D reconstruction of ball trajectory from a single camera in the ball game2015
- Learning strategies in table tennis using inverse reinforcement learningBiological Cybernetics, 2014
- Ball tracking and 3D trajectory approximation with applications to tactics analysis from single-camera volleyball sequencesMultimedia Tools and Applications, 2011
- On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programmingMathematical Programming, 2005
- Robust Detection of Lines Using the Progressive Probabilistic Hough TransformComputer Vision and Image Understanding, 2000