Abstract
We develop a theoretical framework that shows how mesencephalic dopamine systems could distribute to their targets a signal that represents information about future expectations. In particular, we show how activity in the cerebral cortex can make predictions about future receipt of reward and how fluctuations in the activity levels of neurons in diffuse dopamine systems above and below baseline levels would represent errors in these predictions that are delivered to cortical and subcortical targets. We present a model for how such errors could be constructed in a real brain that is consistent with physiological results for a subset of dopaminergic neurons located in the ventral tegmental area and surrounding dopaminergic neurons. The theory also makes testable predictions about human choice behavior on a simple decision-making task. Furthermore, we show that, through a simple influence on synaptic plasticity, fluctuations in dopamine release can act to change the predictions in an appropriate manner.
Keywords
NeuroscienceHebbian theoryDopamineVentral tegmental areaDopaminergicComputer sciencePsychologyMidbrainMachine learningCentral nervous systemArtificial neural network
Affiliated Institutions
Related Publications
The substantia nigra of the human brain
Parkinson's disease is characterized by massive degeneration of dopamine-containing neurons in the midbrain. However, the vulnerability of these neurons is heterogeneous both ac...
The substantia nigra of the human brain
To achieve accuracy in studying the patterns of loss of midbrain dopamine-containing neurons in Parkinson's disease, we used compartmental patterns of calbindin D(28K) immunosta...
Coherent spatiotemporal patterns of ongoing activity revealed by real-time optical imaging coupled with single-unit recording in the cat visual cortex
1. We examined the spatiotemporal organization of ongoing activity in cat visual areas 17 and 18, in relation to the spontaneous activity of individual neurons. To search for co...
Constructive episodic simulation: Temporal distance and detail of past and future events modulate hippocampal engagement
Abstract Behavioral, lesion and neuroimaging evidence show striking commonalities between remembering past events and imagining future events. In a recent event‐related fMRI stu...
Spontaneous Low-Frequency Fluctuations in the BOLD Signal in Schizophrenic Patients: Anomalies in the Default Network
Spontaneous low-frequency fluctuations in the blood oxygen level-dependent (BOLD) functional magnetic resonance imaging (MRI) signal have been shown to reflect neural synchrony ...
Publication Info
- Year
- 1996
- Type
- article
- Volume
- 16
- Issue
- 5
- Pages
- 1936-1947
- Citations
- 2067
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
2067
OpenAlex
Cite This
P. Read Montague,
Peter Dayan,
TJ Sejnowski
(1996).
A framework for mesencephalic dopamine systems based on predictive Hebbian learning.
Journal of Neuroscience
, 16
(5)
, 1936-1947.
https://doi.org/10.1523/jneurosci.16-05-01936.1996
Identifiers
- DOI
- 10.1523/jneurosci.16-05-01936.1996