Query-Driven Approach to Face Clustering and Tagging
- 18 July 2016
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 25 (10) , 4504-4513
Abstract
In the era of big data, a traditional offline setting to processing image data is simply not tenable. We simply do not have the computational power to process every image with every possible tag; moreover, we will not have the manpower to clean up the potentially noisy results. In this paper, we introduce a query-driven approach to visual tagging, focusing on the application of face tagging and clustering. We integrate active learning with query-driven probabilistic databases. Rather than asking a user to provide manual labels so as to minimize the uncertainty of labels (face tags) across the entire data set, we ask the user to provide labels that minimize the uncertainty of his/her query result (e.g., “How many times did Bob and Jim appear together?”). We use a data-driven Gaussian process model of facial appearance to write the probabilistic estimates of facial identity into a probabilistic database, which can then support inference through query answering. Importantly, the database is augmented with contextual constraints (faces in the same image cannot be the same identity, while faces in the same track must be identical). Experiments on the real-world photo collections demonstrate the effectiveness of the proposed method.Keywords
Funding Information
- National Science Foundation (1118114, 1059436, 1063596, 1527536, 1545071)
- National Science Foundation of China (61572252)
- National Science Foundation of Jiangsu Province (BK20150755, BK20150754)
This publication has 29 references indexed in Scilit:
- Neighborhood Discriminant Hashing for Large-Scale Image RetrievalIEEE Transactions on Image Processing, 2015
- Robust Structured Subspace Learning for Data RepresentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- Reference Face Graph for Face RecognitionIEEE Transactions on Information Forensics and Security, 2014
- Context-assisted face clustering framework with human-in-the-loopInternational Journal of Multimedia Information Retrieval, 2014
- Dynamic Bayesian Network for Unconstrained Face Recognition in Surveillance Camera NetworksIEEE Journal on Emerging and Selected Topics in Circuits and Systems, 2013
- A unified framework for context assisted face clustering2013
- Describable Visual Attributes for Face Verification and Image SearchIEEE Transactions on Pattern Analysis and Machine Intelligence, 2011
- Clothing cosegmentation for recognizing people2008
- Clustering by Passing Messages Between Data PointsScience, 2007
- Face Description with Local Binary Patterns: Application to Face RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2006