Boosting bottom-up and top-down visual features for saliency estimation
Author:
- 1 June 2012
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10636919,p. 438-445
Abstract
Despite significant recent progress, the best available visual saliency models still lag behind human performance in predicting eye fixations in free-viewing of natural scenes. Majority of models are based on low-level visual features and the importance of top-down factors has not yet been fully explored or modeled. Here, we combine low-level features such as orientation, color, intensity, saliency maps of previous best bottom-up models with top-down cognitive visual features (e.g., faces, humans, cars, etc.) and learn a direct mapping from those features to eye fixations using Regression, SVM, and AdaBoost classifiers. By extensive experimenting over three benchmark eye-tracking datasets using three popular evaluation scores, we show that our boosting model outperforms 27 state-of-the-art models and is so far the closest model to the accuracy of human model for fixation prediction. Furthermore, our model successfully detects the most salient object in a scene without sophisticated image processings such as region segmentation.Keywords
This publication has 36 references indexed in Scilit:
- Global contrast based salient region detection2011
- Context-aware saliency detection2010
- Static and space-time visual saliency detection by self-resemblanceJournal of Vision, 2009
- Bayesian surprise attracts human attentionVision Research, 2009
- Salient Region Detection and Segmentation2008
- SUN: A Bayesian framework for saliency using natural statisticsJournal of Vision, 2008
- The central fixation bias in scene viewing: Selecting an optimal viewing position independently of motor biases and image feature distributionsJournal of Vision, 2007
- Saliency Detection: A Spectral Residual Approach2007
- Modeling attention to salient proto-objectsNeural Networks, 2006
- A coherent computational approach to model bottom-up visual attentionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2006