Direct instrumental conditioning of neural activity using functional magnetic resonance imaging-derived reward feedback.

  • Bray S
  • Shimojo S
  • O'Doherty J
  • 60

    Readers

    Mendeley users who have this article in their library.
  • N/A

    Citations

    Citations of this article.

Abstract

Successful learning is often contingent on feedback. In instrumental conditioning, an animal or human learns to perform specific responses to obtain reward. Instrumental conditioning is often used by behavioral psychologists to train an animal (or human) to produce a desired behavior. Shaping involves reinforcing those behaviors, which in a stepwise manner are successively closer to the desired behavior until the desired behavior is reached. Here, we aimed to extend this traditional approach to directly shape neural activity instead of overt behavior. To achieve this, we scanned 22 human subjects with functional magnetic resonance imaging and performed image processing in parallel with acquisition. We delineated regions of interest (ROIs) in finger and toe motor/somatosensory regions and used an instrumental shaping procedure to induce a regionally specific increase in activity by providing an explicit monetary reward to reinforce neural activity in the target areas. After training, we found a significant and regionally specific increase in activity in the ROI being rewarded (finger or toe) and a decrease in activity in the nonrewarded region. This demonstrates that instrumental conditioning procedures can be used to directly shape neural activity, even without the production of an overt behavioral response. This procedure offers an important alternative to traditional biofeedback-based approaches and may be useful in the development of future therapies for stroke and other brain disorders.

Author-supplied keywords

  • Adult
  • Brain
  • Brain: physiology
  • Computer-Assisted
  • Conditioning
  • Cues
  • Feedback
  • Female
  • Fingers
  • Fingers: physiology
  • Humans
  • Image Processing
  • Magnetic Resonance Imaging
  • Male
  • Motor Cortex
  • Motor Cortex: physiology
  • Operant
  • Operant: physiology
  • Reaction Time
  • Reward
  • Somatosensory Cortex
  • Somatosensory Cortex: physiology
  • Toes
  • Toes: physiology

Get free article suggestions today

Mendeley saves you time finding and organizing research

Sign up here
Already have an account ?Sign in

Authors

  • Signe Bray

  • Shinsuke Shimojo

  • John P O'Doherty

Cite this document

Choose a citation style from the tabs below

Save time finding and organizing research with Mendeley

Sign up for free