Encoding based saliency detection for videos and images
- 1 June 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 2494-2502
Abstract
We present a novel video saliency detection method to support human activity recognition and weakly supervised training of activity detection algorithms. Recent research has emphasized the need for analyzing salient information in videos to minimize dataset bias or to supervise weakly labeled training of activity detectors. In contrast to previous methods we do not rely on training information given by either eye-gaze or annotation data, but propose a fully unsupervised algorithm to find salient regions within videos. In general, we enforce the Gestalt principle of figure-ground segregation for both appearance and motion cues. We introduce an encoding approach that allows for efficient computation of saliency by approximating joint feature distributions. We evaluate our approach on several datasets, including challenging scenarios with cluttered background and camera motion, as well as salient object detection in images. Overall, we demonstrate favorable performance compared to state-of-the-art methods in estimating both ground-truth eye-gaze and activity annotations.Keywords
This publication has 23 references indexed in Scilit:
- The Secrets of Salient Object Segmentation2014
- Time-Mapping Using Space-Time Saliency2014
- Saliency Detection: A Boolean Map Approach2013
- Hierarchical Saliency Detection2013
- Visual Saliency Based on Scale-Space Analysis in the Frequency DomainIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- Automatic salient object segmentation based on context and shape prior2011
- Learning to predict where humans look2009
- Visual attention detection in video sequences using spatiotemporal cues2006
- A model of saliency-based visual attention for rapid scene analysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998
- Visual perception of biological motion and a model for its analysisPerception & Psychophysics, 1973