1. Value signals guide abstraction during learning
- Author
-
Asuka Yamamoto, Pradyumna Sepulveda, Mitsuo Kawato, Benedetto De Martino, Aurelio Cortese, and Maryam Hashemzadeh
- Subjects
0301 basic medicine ,Male ,Computer science ,abstraction ,0302 clinical medicine ,Parietal Lobe ,Feature (machine learning) ,Reinforcement learning ,Abstraction ,Biology (General) ,Brain Mapping ,General Neuroscience ,Brain ,General Medicine ,Magnetic Resonance Imaging ,Valuation (logic) ,medicine.anatomical_structure ,Medicine ,Female ,confidence ,Reinforcement, Psychology ,valuation ,Algorithms ,Research Article ,Human ,reinforcement learning ,QH301-705.5 ,Science ,Ventromedial prefrontal cortex ,Prefrontal Cortex ,Sensory system ,vmpfc ,General Biochemistry, Genetics and Molecular Biology ,03 medical and health sciences ,Young Adult ,Reward ,medicine ,Humans ,Learning ,Sensory cortex ,multivoxel neural reinforcement ,Behavior ,General Immunology and Microbiology ,business.industry ,030104 developmental biology ,Visual cortex ,Artificial intelligence ,business ,030217 neurology & neurosurgery ,Neuroscience - Abstract
The human brain excels at constructing and using abstractions, such as rules, or concepts. Here, in two fMRI experiments, we demonstrate a mechanism of abstraction built upon the valuation of sensory features. Human volunteers learned novel association rules based on simple visual features. Reinforcement-learning algorithms revealed that, with learning, high-value abstract representations increasingly guided participant behaviour, resulting in better choices and higher subjective confidence. We also found that the brain area computing value signals – the ventromedial prefrontal cortex – prioritised and selected latent task elements during abstraction, both locally and through its connection to the visual cortex. Such a coding scheme predicts a causal role for valuation. Hence, in a second experiment, we used multivoxel neural reinforcement to test for the causality of feature valuation in the sensory cortex, as a mechanism of abstraction. Tagging the neural representation of a task feature with rewards evoked abstraction-based decisions. Together, these findings provide a novel interpretation of value as a goal-dependent, key factor in forging abstract representations.
- Published
- 2021