Visual Attention Modeling for Stereoscopic Video: A Benchmark and Computational Model
- 28 June 2017
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 26 (10) , 4684-4696
Abstract
In this paper, we investigate the visual attention modeling for stereoscopic video from the following two aspects. First, we build one large-scale eye tracking database as the benchmark of visual attention modeling for stereoscopic video. The database includes 47 video sequences and their corresponding eye fixation data. Second, we propose a novel computational model of visual attention for stereoscopic video based on Gestalt theory. In the proposed model, we extract the low-level features, including luminance, color, texture, and depth, from discrete cosine transform coefficients, which are used to calculate feature contrast for the spatial saliency computation. The temporal saliency is calculated by the motion contrast from the planar and depth motion features in the stereoscopic video sequences. The final saliency is estimated by fusing the spatial and temporal saliency with uncertainty weighting, which is estimated by the laws of proximity, continuity, and common fate in Gestalt theory. Experimental results show that the proposed method outperforms the state-of-the-art stereoscopic video saliency detection models on our built large-scale eye tracking database and one other database (DML-ITRACK-3D).Keywords
Funding Information
- Natural Science Foundation of China (61571212)
- Natural Science Foundation of Jiangxi (20071BBE50068, 20171BCB23048, 20161ACB21014, GJJ160420)
This publication has 50 references indexed in Scilit:
- Evaluation and modeling of depth feature incorporated visual attention for salient object segmentationNeurocomputing, 2013
- A First-Order Primal-Dual Algorithm for Convex Problems with Applications to ImagingJournal of Mathematical Imaging and Vision, 2010
- Parallel implementation of a spatio-temporal visual saliency modelJournal of Real-Time Image Processing, 2010
- Static and space-time visual saliency detection by self-resemblanceJournal of Vision, 2009
- SUN: Top-down saliency using natural statisticsVisual Cognition, 2009
- Multivariate image similarity in the compressed domain using statistical graph matchingPattern Recognition, 2006
- Components of bottom-up gaze allocation in natural imagesVision Research, 2005
- Salience of Feature Contrast2005
- A model of saliency-based visual attention for rapid scene analysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998
- Abrupt visual onsets and selective attention: Evidence from visual search.Journal of Experimental Psychology: Human Perception and Performance, 1984