(Quasi)Periodicity Quantification in Video Data, Using Topology
Authors:
- Christopher J. TralieCTChristopher J. Tralie
- Jose A. PereaJPJose A. Perea
- 1 January 2018
- journal article
- research article
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Imaging Sciences
- Vol. 11 (2) , 1049-1077
Abstract
This work introduces a novel framework for quantifying the presence and strength of recurrent dynamics in video data. Specifically, we provide continuous measures of periodicity (perfect repetition) and quasiperiodicity (superposition of periodic modes with noncommensurate periods), in a way which does not require segmentation, training, object tracking, or 1-dimensional surrogate signals. Our methodology operates directly on video data. The approach combines ideas from nonlinear time series analysis (delay embeddings) and computational topology (persistent homology) by translating the problem of finding recurrent dynamics in video data into the problem of determining the circularity or toroidality of an associated geometric space. Through extensive testing, we show the robustness of our scores with respect to several noise models/levels; we show that our periodicity score is superior to other methods when compared to human-generated periodicity rankings; and furthermore, we show that our quasiperiodicity...Keywords
All Related Versions
Funding Information
- Defense Advanced Research Projects Agency (HR0011-16-2-003)
- Division of Mathematical Sciences (DMS-1622301)
- National Science Foundation (DGF-1106401, DKA-1447491)
This publication has 42 references indexed in Scilit:
- Evaluating Amazon's Mechanical Turk as a Tool for Experimental Behavioral ResearchPLOS ONE, 2013
- Automated Measurement of Vocal Fold Vibratory Asymmetry From High-Speed Videoendoscopy RecordingsJournal of Speech, Language, and Hearing Research, 2011
- Statistical ranking and combinatorial Hodge theoryMathematical Programming, 2010
- Clinical Implementation of Laryngeal High-Speed Videoendoscopy: Challenges and EvolutionFolia Phoniatrica et Logopaedica, 2007
- Behavior classification by eigendecomposition of periodic motionsPattern Recognition, 2005
- Computing Persistent HomologyDiscrete & Computational Geometry, 2004
- An Automatic Method to Quantify the Vibration Properties of Human Vocal Folds via VideokymographyFolia Phoniatrica et Logopaedica, 2003
- SUBHARMONICS, BIPHONATION, AND DETERMINISTIC CHAOS IN MAMMAL VOCALIZATIONBioacoustics, 1998
- Recording, processing, and analysis of digital high-speed sequences in glottographyMachine Vision and Applications, 1995
- Determining embedding dimension for phase-space reconstruction using a geometrical constructionPhysical Review A, 1992