Brain State Decoding for Rapid Image Retrieval

  • Wang J
  • Pohlmeyer E
  • Hanna B
 et al. 
  • 82

    Readers

    Mendeley users who have this article in their library.
  • 43

    Citations

    Citations of this article.

Abstract

Human visual perception is able to recognize a wide range of targets under challenging conditions, but has limited through- put. Machine vision and automatic content analytics can process images at a high speed, but suffers from inadequate recognition accuracy for general target classes. In this pa- per, we propose a new paradigm to explore and combine the strengths of both systems. A single trial EEG-based brain machine interface (BCI) subsystem is used to detect objects of interest of arbitrary classes from an initial subset of im- ages. The EEG detection outcomes are used as input to a graph-based pattern mining subsystem to identify, refine, and propagate the labels to retrieve relevant images from a much larger pool. The combined strategy is unique in its generality, robustness, and high throughput. It has great potential for advancing the state of the art in media retrieval applications. We have evaluated and demonstrated signifi- cant performance gains of the proposed system withmultiple and diverse image classes over several data sets, including those from Internet (Caltech 101) and remote sensing im- ages. In this paper, we will also present insights learned from the experiments and discuss future research directions.

Author-supplied keywords

  • brain computer interface
  • eeg signal
  • image annotation and search
  • noisy label refinement
  • visual pattern mining

Get free article suggestions today

Mendeley saves you time finding and organizing research

Sign up here
Already have an account ?Sign in

Find this document

Get full text

Authors

  • Jun Wang

  • Eric Pohlmeyer

  • Barbara Hanna

  • Y.G. Jiang

  • Paul Sajda

  • S.F. Chang

Cite this document

Choose a citation style from the tabs below

Save time finding and organizing research with Mendeley

Sign up for free