Querying large video datasets: a systematic literature review
Open Access
- 27 January 2025
- journal article
- Published by Sociedade Brasileira de Computação in Journal of Internet Services and Applications
- Vol. 16 (1) , 566-595
Abstract
Querying large-scale video datasets differs from querying short videos due to the inherent challenges in volume, velocity, and variety. In the last decade, this area has emerged thanks to the effectiveness of deep learning methods, new graphics processing units, new video databases, advances in distributed computing, among others. The main goal of querying video streams is to find the best balance between available hardware, software resources, and query latency, taking into account quality goals, constraints, and video configurations. Due to these challenges, many development methods, frameworks, and evaluation metrics have been proposed. As a result, this systematic literature review addresses a gap in the current body of knowledge. It covers ten years, from 2014 to 2024, and 4,248 papers, of which 99 were identified as relevant and used to answer the research questions on (i) processing methods, hardware architecture, and software, (ii) query languages, (iii) evaluation metrics, (iv) and available datasets. In addition, this review shows how this niche is promising and concerned with the rational use of available resources. Among the results, the following are highlighted: cheap detection models are very popular, smart IoT devices are very useful, distributed computing for video query applications is complex, system latency is essential, and there is no standard video query language. Current trends include the development of a standard video query language, in-memory computing, processing where data is produced, low-latency processing, and active learning for labeling objects. This original work shows a domain perspective, identifies problems and opportunities, and provides directions for future studies.Keywords
This publication has 117 references indexed in Scilit:
- A survey on deep learning and its applicationsComputer Science Review, 2021
- Deep metric learning for open-set human action recognition in videosNeural Computing and Applications, 2020
- Complex event recognition in the Big Data era: a surveyThe VLDB Journal, 2019
- Video Analytics for Visual Surveillance and Applications: An Overview and Survey2019
- SQL & NoSQL Databases2019
- Performance Measures and a Data Set for Multi-target, Multi-camera Tracking2016
- Introduction to Big Data2016
- SSD: Single Shot MultiBox Detector2016
- Methodi Ordinatio: a proposed methodology to select and rank relevant scientific papers encompassing the impact factor, number of citation, and year of publicationScientometrics, 2015
- An Overview of Contest on Semantic Description of Human Activities (SDHA) 20102010