Anatomy of a decision: Striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal

Michael J. Frank, Eric D. Claus

Research output: Contribution to journalArticlepeer-review

408 Scopus citations

Abstract

The authors explore the division of labor between the basal ganglia-dopamine (BG-DA) system and the orbitofrontal cortex (OFC) in decision making. They show that a primitive neural network model of the BG-DA system slowly learns to make decisions on the basis of the relative probability of rewards but is not as sensitive to (a) recency or (b) the value of specific rewards. An augmented model that explores BG-OFC interactions is more successful at estimating the true expected value of decisions and is faster at switching behavior when reinforcement contingencies change. In the augmented model, OFC areas exert top-down control on the BG and premoter areas by representing reinforcement magnitudes in working memory. The model successfully captures patterns of behavior resulting from OFC damage in decision making, reversal learning, and devaluation paradigms and makes additional predictions for the underlying source of these deficits.

Original languageEnglish (US)
Pages (from-to)300-326
Number of pages27
JournalPsychological Review
Volume113
Issue number2
DOIs
StatePublished - Apr 2006

All Science Journal Classification (ASJC) codes

  • Psychology(all)

Fingerprint

Dive into the research topics of 'Anatomy of a decision: Striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal'. Together they form a unique fingerprint.

Cite this