Search

For >30 years, positron emission tomography (PET) has proven to be a powerful approach for measuring aspects of dopaminergic transmission in the living human brain; this technique has revealed important relationships between dopamine D2-like receptors and dimensions of normal behavior, such as human impulsivity, and psychopathology, particularly behavioral addictions. Nevertheless, PET is an indirect estimate that lacks cellular and functional resolution and, in some cases, is not entirely pharmacologically specific. To identify the relationships between PET estimates of D2-like receptor availability and direct in vitro measures of receptor number, affinity, and function, we conducted neuroimaging and behavioral and molecular pharmacological assessments in a group of adult male vervet monkeys. Data gathered from these studies indicate that variation in D2-like receptor PET measurements is related to reversal-learning performance and sensitivity to positive feedback and is associated with in vitro estimates of the density of functional dopamine D2-like receptors. Furthermore, we report that a simple behavioral measure, eyeblink rate, reveals novel and crucial links between neuroimaging assessments and in vitro measures of dopamine D2 receptors.

The procurement and consumption of palatable, calorie-dense foods is influenced by the nutritional and hedonic value of foods. Although many factors can influence the control over behavior by foods rich in sugar and fat, emerging evidence indicates that biological sex may play a particularly crucial role in the types of foods individuals seek out, as well as the level of motivation individuals will exert to obtain those foods. However, a systematic investigation of food-seeking and consumption that disentangles the effects of the major sex-biasing factors, including sex chromosome complement and organizational and activational effects of sex hormones, has yet to be conducted. Using the four core genotypes mouse model system, we separated and quantified the effects of sex chromosome complement and gonadal sex on consumption of and motivation to obtain a highly palatable solution [sweetened condensed milk (SCM)]. Gonadectomized mice with an XY sex chromosome complement, compared with those with two X chromosomes, independent of gonadal sex, appeared to be more sensitive to the reward value of the SCM solution and were more motivated to expend effort to obtain it, as evidenced by their dramatically greater expended effort in an instrumental task with progressively larger response-to-reward ratios. Gonadal sex independently affected free consumption of the solution but not motivation to obtain it. These data indicate that gonadal and chromosomal sex effects independently influence reward-related behaviors, contributing to sexually dimorphic patterns of behavior related to the pursuit and consumption of rewards.

Model-free and model-based computations are argued to distinctly update action values that guide decision-making processes. It is not known, however, if these model-free and model-based reinforcement learning mechanisms recruited in operationally based instrumental tasks parallel those engaged by pavlovian-based behavioral procedures. Recently, computational work has suggested that individual differences in the attribution of incentive salience to reward predictive cues, that is, sign- and goaltracking behaviors, are also governed by variations in model-free and model-based value representations that guide behavior. Moreover, it is not appreciated if these systems that are characterized computationally using model-free and model-based algorithms are conserved across tasks for individual animals. In the current study, we used a within-subject design to assess sign-tracking and goal-tracking behaviors using a pavlovian conditioned approach task and then characterized behavior using an instrumental multistage decision-making (MSDM) task in male rats. We hypothesized that both pavlovian and instrumental learning processes may be driven by common reinforcement-learning mechanisms. Our data confirm that sign-tracking behavior was associated with greater reward-mediated, model-free reinforcement learning and that it was also linked to model-free reinforcement learning in the MSDM task. Computational analyses revealed that pavlovian model-free updating was correlated with model-free reinforcement learning in the MSDM task. These data provide key insights into the computational mechanisms mediating associative learning that could have important implications for normal and abnormal states. [ABSTRACT FROM AUTHOR]

Emerging data indicate that endocannabinoid signaling is critical to the formation of habitual behavior. Previous work demonstrated that antagonism of cannabinoid receptor type 1 (CB1R) with AM251 during operant training impairs habit formation, but it is not known if this behavioral effect is specific to disrupted signaling of the endocannabinoid ligands anandamide or 2‐arachidonoyl glycerol (2‐AG). Here, we used selective pharmacological compounds during operant training to determine the impact of fatty acid amide hydrolase (FAAH) inhibition to increase anandamide (and other n‐acylethanolamines) or monoacylglycerol lipase (MAGL) inhibition to increase 2‐AG levels on the formation of habitual behaviors in mice using a food‐reinforced contingency degradation procedure. We found, contrary to our hypothesis, that inhibition of FAAH and of MAGL disrupted the formation of habits. Next, AM251 was administered during training to verify that impaired habit formation could be assessed using contingency degradation. AM251‐exposed mice responded at lower rates during training and at higher rates in the test. To understand the inconsistency with published data, we performed a proof‐of‐principle dose–response experiment to compare AM251 in our vehicle‐solution to the published vehicle‐suspension on response rates. We found consistent reductions in response rate with increasing doses of AM251 in solution and an inconsistent dose–response relationship with AM251 in suspension. Together, our data suggest that further characterization of the role of CB1R signaling in the formation of habitual responding is warranted and that augmenting endocannabinoids may have clinical utility for prophylactically preventing aberrant habit formation such as that hypothesized to occur in substance use disorders. [ABSTRACT FROM AUTHOR]

The most dynamic period of postnatal brain development occurs during adolescence, the period between childhood and adulthood. Neuroimaging studies have observed morphologic and functional changes during adolescence, and it is believed that these changes serve to improve the functions of circuits that underlie decision-making. Direct evidence in support of this hypothesis, however, has been limited because most preclinical decision-making paradigms are not readily translated to humans. Here, we developed a reversal-learning protocol for the rapid assessment of adaptive choice behavior in dynamic environments in rats as young as postnatal day 30. A computational framework was used to elucidate the reinforcementlearning mechanisms that change in adolescence and into adulthood. Using a cross-sectional and longitudinal design, we provide the first evidence that value-based choice behavior in a reversal-learning task improves during adolescence in male and female Long-Evans rats and demonstrate that the increase in reversal performance is due to alterations in value updating for positive outcomes. Furthermore, we report that reversal-learning trajectories in adolescence reliably predicted reversal performance in adulthood. This novel behavioral protocol provides a unique platform for conducting biological and systems-level analyses of the neurodevelopmental mechanisms of decision-making. [ABSTRACT FROM AUTHOR]

Individuals with alcohol use disorder exhibit compulsive habitual behaviors that are thought to be, in part, a consequence of chronic and persistent use of alcohol. The endocannabinoid system plays a critical role in habit learning and in ethanol self-administration, but the role of this neuromodulatory system in the expression of habitual alcohol seeking is unknown. Here, we investigated the role of the endocannabinoid system in established alcohol habits using contingency degradation in male C57BL/6 mice. We found that administration of the novel diacyl glycerol lipase inhibitor DO34, which decreases the biosynthesis of the endocannabinoid 2-arachidonoyl glycerol (2-AG), reduced habitual responding for ethanol and ethanol approach behaviors. Moreover, administration of the endocannabinoid transport inhibitor AM404 or the cannabinoid receptor type 1 antagonist AM251 produced similar reductions in habitual responding for ethanol and ethanol approach behaviors. Notably, AM404 was also able to reduce ethanol seeking and consumption in mice that were insensitive to lithium chloride-induced devaluation of ethanol. Conversely, administration of JZL184, a monoacyl glycerol lipase inhibitor that increases levels of 2-AG, increased motivation to respond for ethanol on a progressive ratio schedule of reinforcement. These results demonstrate an important role for endocannabinoid signaling in the motivation to seek ethanol, in ethanol-motivated habits, and suggest that pharmacological manipulations of endocannabinoid signaling could be effective therapeutics for treating alcohol use disorder. [ABSTRACT FROM AUTHOR]

Flexible decision-making in dynamic environments requires both retrospective appraisal of reinforced actions and prospective reasoning about the consequences of actions. These complementary reinforcement-learning systems can be characterized computationally with model-free and model-based algorithms, but how these processes interact at a neurobehavioral level in normal and pathological states is unknown. Here, we developed a translationally analogous multistage decision-making (MSDM) task to independently quantify modelfree and model-based behavioral mechanisms in rats. We provide the first direct evidence that male rats, similar to humans, use both model-free and model-based learning when making value-based choices in the MSDM task and provide novel analytic approaches for independently quantifying these reinforcement-learning strategies. Furthermore, we report that ex vivo dopamine tone in the ventral striatum and orbitofrontal cortex correlate with model-based, but not model-free, strategies, indicating that the biological mechanisms mediating decision-making in the multistage task are conserved in rats and humans. This new multistage task provides a unique behavioral platform for conducting systems-level analyses of decision-making in normal and pathological states. [ABSTRACT FROM AUTHOR]