Toward Mass Video Data Analysis: Interactive and Immersive 4D Scene Reconstruction
Authors:
Open Access
Abstract
The technical progress in the last decades makes photo and video recording devices omnipresent. This change has a significant impact, among others, on police work. It is no longer unusual that a myriad of digital data accumulates after a criminal act, which must be reviewed by criminal investigators to collect evidence or solve the crime. This paper presents the VICTORIA Interactive 4D Scene Reconstruction and Analysis Framework (“ISRA-4D” 1.0), an approach for the visual consolidation of heterogeneous video and image data in a 3D reconstruction of the corresponding environment. First, by reconstructing the environment in which the materials were created, a shared spatial context of all available materials is established. Second, all footage is spatially and temporally registered within this 3D reconstruction. Third, a visualization of the hereby created 4D reconstruction (3D scene + time) is provided, which can be analyzed interactively. Additional information on video and image content is also extracted and displayed and can be analyzed with supporting visualizations. The presented approach facilitates the process of filtering, annotating, analyzing, and getting an overview of large amounts of multimedia material. The framework is evaluated using four case studies which demonstrate its broad applicability. Furthermore, the framework allows the user to immerse themselves in the analysis by entering the scenario in virtual reality. This feature is qualitatively evaluated by means of interviews of criminal investigators and outlines potential benefits such as improved spatial understanding and the initiation of new fields of application.Keywords
Funding Information
- Horizon 2020 Framework Programme (740754)
This publication has 68 references indexed in Scilit:
- Knowledge Generation Model for Visual AnalyticsIEEE Transactions on Visualization and Computer Graphics, 2014
- 3-D Human Action Recognition by Shape Analysis of Motion Trajectories on Riemannian ManifoldIEEE Transactions on Cybernetics, 2014
- Effectiveness of virtual reality-based instruction on students' learning outcomes in K-12 and higher education: A meta-analysisComputers & Education, 2014
- The Effects of Hot Spots Policing on Crime: An Updated Systematic Review and Meta-AnalysisJustice Quarterly, 2012
- Performance analysis for automated gait extraction and recognition in multi-camera surveillanceMultimedia Tools and Applications, 2009
- Vision-Based SLAM: Stereo and Monocular ApproachesInternational Journal of Computer Vision, 2007
- Visual AnalyticsIEEE Computer Graphics and Applications, 2004
- Algorithms for cooperative multisensor surveillanceProceedings of the IEEE, 2001
- Monitoring activities from multiple video streams: establishing a common coordinate frameIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Navigating Large-Scale Virtual Environments: What Differences Occur Between Helmet-Mounted and Desk-Top Displays?PRESENCE: Virtual and Augmented Reality, 1999