An Iterative Framework for EEG-based Image Search: Robust Retrieval with Weak Classifiers
Open Access
- 20 August 2013
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 8 (8) , e72018
Abstract
We revisit the framework for brain-coupled image search, where the Electroencephalography (EEG) channel under rapid serial visual presentation protocol is used to detect user preferences. Extending previous works on the synergy between content-based image labeling and EEG-based brain-computer interface (BCI), we propose a different perspective on iterative coupling. Previously, the iterations were used to improve the set of EEG-based image labels before propagating them to the unseen images for the final retrieval. In our approach we accumulate the evidence of the true labels for each image in the database through iterations. This is done by propagating the EEG-based labels of the presented images at each iteration to the rest of images in the database. Our results demonstrate a continuous improvement of the labeling performance across iterations despite the moderate EEG-based labeling (AUC <75%). The overall analysis is done in terms of the single-trial EEG decoding performance and the image database reorganization quality. Furthermore, we discuss the EEG-based labeling performance with respect to a search task given the same image database.Keywords
This publication has 22 references indexed in Scilit:
- Closing the loop in cortically-coupled computer vision: a brain–computer interface for searching image databasesJournal of Neural Engineering, 2011
- The Time-Course of Visual Categorizations: You Spot the Animal Faster than the BirdPLOS ONE, 2009
- Toward enhanced P300 speller performanceJournal of Neuroscience Methods, 2008
- Updating P300: An integrative theory of P3a and P3bClinical Neurophysiology, 2007
- A fully automated correction method of EOG artifacts in EEG recordingsClinical Neurophysiology, 2007
- Cortically coupled computer vision for rapid image searchIEEE Transactions on Neural Systems and Rehabilitation Engineering, 2006
- Embedded colour image coding for content-based retrievalJournal of Visual Communication and Image Representation, 2004
- Noninvasive Brain-Actuated Control of a Mobile Robot by Human EEGIEEE Transactions on Biomedical Engineering, 2004
- P300 amplitude is determined by target‐to‐target intervalPsychophysiology, 2002
- Efficient Use of MPEG-7 Edge Histogram DescriptorETRI Journal, 2002