Search

The successful pursuit of future rewards requires forming an internal goal, followed by planning, decision-making, and progress-tracking over multiple steps. The initial step—forming goals and the plans for obtaining them—involves the subjective valuation of an anticipated reward, considering both the reward's properties and associated delay and physical-effort costs. Recent findings indicate individuals similarly evaluate cognitive effort over time (Johnson and Most, 2023). Success and failure in these processes have been linked to differential life outcomes and psychiatric conditions. Here we review evidence from single-neuron recordings and neuroimaging studies that implicate the amygdala—a brain structure long associated with cue-reactivity and emotion—in decision-making and the planned pursuit of future rewards (Grabenhorst et al., 2012, 2016, 2019, 2023;Hernadi et al., 2015;Zangemeister et al., 2016). The main findings are that, in behavioral tasks in which future rewards can be pursued through planning and stepwise decision-making, amygdala neurons prospectively encode the value of anticipated rewards and related behavioral plans. Moreover, amygdala neurons predict the stepwise choices to pursue these rewards, signal progress toward goals, and distinguish internally generated (i.e., self-determined) choices from externally imposed actions. Importantly, amygdala neurons integrate the subjective value of a future reward with delay and effort costs inherent in pursuing it. This neural evidence identifies three key computations of the primate amygdala that underlie the pursuit of future rewards: (1) forming a self-determined internal goal based on subjective reward-cost valuations, (2) defining a behavioral plan for obtaining the goal, (3) executing this plan through stepwise decision-making and progress-tracking. Based on this framework, we suggest that amygdala neurons constitute vulnerabilities for dysfunction that contribute to maladaptive reward pursuit in psychiatric and behavioral conditions. Consequently, amygdala neurons may also represent potential targets for behavioral-change interventions that aim to improve individual decision-making. [ABSTRACT FROM AUTHOR]

Risk is a fundamental factor affecting individual and social economic decisions, but its neural correlates are largely unexplored in the social domain. The amygdala, together with the dorsal anterior cingulate cortex (dACC), is thought to play a central role in risk-taking. Here, we investigated in human volunteers (n=20; 11 females) howrisk (defined as the variance of reward probability distributions) in a social situation affects decisions and concomitant neural activity as measured with fMRI. We found separate variance-risk signals for social and nonsocial outcomes in the amygdala. Specifically, amygdala activity increased parametrically with social reward variance of presented choice options and on separate trials with nonsocial reward variance. Behaviorally, 75% of participants were averse to social risk as estimated in a Becker-DeGroot-Marschak auction-like procedure. The stronger this aversion, the more negative the coupling between risk-related amygdala regions and dACC. This negative relation was significant for social risk attitude but not for the attitude toward variance-risk in juice outcomes. Our results indicate that the amygdala and its coupling with dACC process objective and subjectively evaluated social risk. Moreover, while social risk can be captured with a framework originally established by finance theory for nonsocial risk, the amygdala appears to process social risk largely separately from nonsocial risk. [ABSTRACT FROM AUTHOR]

In reinforcement learning (RL), animals choose by assigning values to options and learn by updating these values from reward outcomes. This framework has been instrumental in identifying fundamental learning variables and their neuronal implementations. However, canonical RL models do not explain how reward values are constructed from biologically critical intrinsic reward components, such as nutrients. From an ecological perspective, animals should adapt their foraging choices in dynamic environments to acquire nutrients that are essential for survival. Here, to advance the biological and ecological validity of RL models, we investigated how (male) monkeys adapt their choices to obtain preferred nutrient rewards under varying reward probabilities. We found that the nutrient composition of rewards strongly influenced learning and choices. Preferences of the animals for specific nutrients (sugar, fat) affected how they adapted to changing reward probabilities; the history of recent rewards influenced choices of the monkeys more strongly if these rewards contained the their preferred nutrients (nutrient-specific reward history). The monkeys also chose preferred nutrients even when they were associated with lower reward probability. A nutrient-sensitive RL model captured these processes; it updated the values of individual sugar and fat components of expected rewards based on experience and integrated them into subjective values that explained the choices of the monkeys. Nutrient-specific reward prediction errors guided this value-updating process. Our results identify nutrients as important reward components that guide learning and choice by influencing the subjective value of choice options. Extending RL models with nutrient-value functions may enhance their biological validity and uncover nutrient-specific learning and decision variables. [ABSTRACT FROM AUTHOR]