Table tennis ball spin estimation with an event camera
Authors:
- 17 June 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 3347-3356
Abstract
Spin plays a pivotal role in ball-based sports. Estimating spin becomes a key skill due to its impact on the ball’s trajectory and bouncing behavior. Spin cannot be observed directly, making it inherently challenging to estimate. In table tennis, the combination of high velocity and spin renders traditional low frame rate cameras inadequate for quickly and accurately observing the ball’s logo to estimate the spin due to the motion blur. Event cameras do not suffer as much from motion blur, thanks to their high temporal resolution. Moreover, the sparse nature of the event stream solves communication bandwidth limitations many frame cameras face. To the best of our knowledge, we present the first method for table tennis spin estimation using an event camera. We use ordinal time surfaces to track the ball and then isolate the events generated by the logo on the ball. Optical flow is then estimated from the extracted events to infer the ball’s spin. We achieved a spin magnitude mean error of 10.7 ± 17.3 rps and a spin axis mean error of 32.9 ± 38.2° in real time for a flying ball.Keywords
All Related Versions
Funding Information
- Sony
This publication has 31 references indexed in Scilit:
- Semi-supervised Learning of Optical Flow by Flow Supervisor2022
- Robust Stroke Recognition via Vision and IMU in Robotic Table Tennis2021
- Table Tennis Stroke Recognition Using Two-Dimensional Human Pose Estimation2021
- Detecting Stable Keypoints from Events through Image Gradient Prediction2021
- Feedback control of event cameras2021
- What Matters in Unsupervised Optical Flow2020
- RAFT: Recurrent All-Pairs Field Transforms for Optical Flow2020
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Tracking the spin on a ping pong ball with the quaternion Bingham filter2014
- Estimating the spin of a table tennis ball using Inverse Compositional Image Alignment2012