Search

Learning of prediction error (PE), including reward PE and risk PE, is crucial for updating the prediction in reinforcement learning (RL). Neurobiological and computational models of RL have reported extensive brain activations related to PE. However, the occurrence of PE does not necessarily predict updating the prediction, e.g., in a probability-known event. Therefore, the brain regions specifically engaged in updating the prediction remain unknown. Here, we conducted two functional magnetic resonance imaging (fMRI) experiments, the probability-unknown Iowa Gambling Task (IGT) and the probability-known risk decision task (RDT). Behavioral analyses confirmed that PEs occurred in both tasks but were only used for updating the prediction in the IGT. By comparing PE-related brain activations between the two tasks, we found that the rostral anterior cingulate cortex/ventral medial prefrontal cortex (rACC/vmPFC) and the posterior cingulate cortex (PCC) activated only during the IGT and were related to both reward and risk PE. Moreover, the responses in the rACC/vmPFC and the PCC were modulated by uncertainty and were associated with reward prediction-related brain regions. Electric brain stimulation over these regions lowered the performance in the IGT but not in the RDT. Our findings of a distributed neural circuit of PE processing suggest that the rACC/vmPFC and the PCC play a key role in updating the prediction through PE processing during decision making.

Deficits in the computational processes of reinforcement learning have been suggested to underlie addiction. Additionally, environmental uncertainty, which is encoded in the anterior cingulate cortex (ACC), modulates reward prediction errors (RPEs) during reinforcement learning and exacerbates addiction. The present study tested whether and how the ACC would have an essential role in drug addiction by failing to use uncertainty to modulate the RPEs during reinforcement learning. In Experiment I, we found that the ACC/medial prefrontal cortex (MPFC) did not modulate RPE learning according to uncertainty in smokers. The effect of uncertainty × RPE in the ACC/MPFC was correlated with the learning rate of RPEs and the duration of nicotine use. Experiment II demonstrated that serotonin, but not dopamine, receptor mRNA expression significantly decreased in the ACC of the nicotine exposed compared to the control rats. Furthermore, there was a positive correlation between learning rate and serotonin receptor mRNA expression in the ACC. Therefore, all present results suggest that impairments in uncertainty modulation in the ACC disrupt reinforcement learning processes in chronic nicotine users and contribute to maladaptive decision-making. These findings support interventions for pathological decision-making in drug addiction that strongly focus on the serotonin system in ACC.