Slicing and dicing soccer: automatic detection ofcomplex events from spatio-temporal data
Authors:
- Lia MorraLMLia Morra
- Francesco ManigrassoFMFrancesco Manigrasso
- Giuseppe CantoGCGiuseppe Canto
- Claudio GianfrateCGClaudio Gianfrate
- Enrico GuarinoEGEnrico Guarino
- Fabrizio LambertiFLFabrizio Lamberti
Preprint
Abstract
The automatic detection of events in sport videos has im-portant applications for data analytics, as well as for broadcasting andmedia companies. This paper presents a comprehensive approach for de-tecting a wide range of complex events in soccer videos starting frompositional data. The event detector is designed as a two-tier system thatdetectsatomicandcomplex events. Atomic events are detected basedon temporal and logical combinations of the detected objects, their rel-ative distances, as well as spatio-temporal features such as velocity andacceleration. Complex events are defined as temporal and logical com-binations of atomic and complex events, and are expressed by meansof a declarative Interval Temporal Logic (ITL). The effectiveness of theproposed approach is demonstrated over 16 different events, includingcomplex situations such as tackles and filtering passes. By formalizingevents based on principled ITL, it is possible to easily perform reason-ing tasks, such as understanding which passes or crosses result in a goalbeing scored. To counterbalance the lack of suitable, annotated publicdatasets, we built on an open source soccer simulation engine to re-lease the synthetic SoccER (Soccer Event Recognition) dataset, whichincludes complete positional data and annotations for more than 1.6 mil-lion atomic events and 9,000 complex events. The dataset and code areavailable at https://gitlab.com/grains2/slicing-and-dicing-soccerKeywords
All Related Versions
This publication has 5 references indexed in Scilit:
- Google Research Football: A Novel Reinforcement Learning EnvironmentProceedings of the AAAI Conference on Artificial Intelligence, 2020
- Optimization of computer aided detection systems: An evolutionary approachExpert Systems with Applications, 2018
- A Survey of Content-Aware Video Analysis for SportsIEEE Transactions on Circuits and Systems for Video Technology, 2017
- Actom sequence models for efficient action detection2011
- A MULTI-OBJECTIVE GENETIC ALGORITHM FOR TUNING AND RULE SELECTION TO OBTAIN ACCURATE AND COMPACT LINGUISTIC FUZZY RULE-BASED SYSTEMSInternational Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 2007