Few-Shot Personalized Saliency Prediction Based on Adaptive Image Selection Considering Object and Visual Attention
Open Access
Abstract
A few-shot personalized saliency prediction based on adaptive image selection considering object and visual attention is presented in this paper. Since general methods predicting personalized saliency maps (PSMs) need a large number of training images, the establishment of a theory using a small number of training images is needed. To tackle this problem, although finding persons who have visual attention similar to that of a target person is effective, all persons have to commonly gaze at many images. Thus, it becomes difficult and unrealistic when considering their burden. On the other hand, this paper introduces a novel adaptive image selection (AIS) scheme that focuses on the relationship between human visual attention and objects in images. AIS focuses on both a diversity of objects in images and a variance of PSMs for the objects. Specifically, AIS selects images so that selected images have various kinds of objects to maintain their diversity. Moreover, AIS guarantees the high variance of PSMs for persons since it represents the regions that many persons commonly gaze at or do not gaze at. The proposed method enables selecting similar users from a small number of images by selecting images that have high diversities and variances. This is the technical contribution of this paper. Experimental results show the effectiveness of our personalized saliency prediction including the new image selection scheme.Keywords
Funding Information
- MIC/SCOPE (#18160100)
This publication has 25 references indexed in Scilit:
- Multi-Task Convolutional Neural Network for Pose-Invariant Face RecognitionIEEE Transactions on Image Processing, 2017
- Closed-Form Optimization on Saliency-Guided Image Compression for HEVC-MSPIEEE Transactions on Multimedia, 2017
- Visual Attention Modeling for Stereoscopic Video: A Benchmark and Computational ModelIEEE Transactions on Image Processing, 2017
- Preference for Dynamic Human Images and Gaze‐Following Abilities in Preterm Infants at 6 and 12 Months of Age: An Eye‐Tracking StudyInfancy, 2016
- Eye Gaze for Consumer Electronics: Controlling and commanding intelligent systemsIEEE Consumer Electronics Magazine, 2015
- The Interestingness of Images2013
- Image Signature: Highlighting Sparse Salient RegionsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2011
- The gender difference in gaze-cueing: Associations with empathizing and systemizingPersonality and Individual Differences, 2010
- Low-quality image enhancement using visual attentionOptical Engineering, 2007
- A model of saliency-based visual attention for rapid scene analysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998