Search

Paradoxical choices in human and nonhuman animals represent substantial deviations from rational models of behavior; such deviations often demand models that incorporate multiple perspectives, including psychology, biology, and economics. The past couple of decades have seen an increased interest in the paradoxical choice of pigeons in 2-armed bandit tasks (2ABT) developed by Zentall and colleagues. In these 2ABTs, pigeons, but not rats, systematically choose an alternative that yields less reward over multiple trials but provides more information on events within a trial, over an alternative that yields more reward over trials but provides less information on events within a trial. Although current computational models account for much of the extant data generated in studies on 2ABT choice, they do not explain, in a trial-by-trial basis, how pigeons learn to ignore some stimuli and not others in 2ABTs. To address the provenance of this differential allocation of attention, a simple model composed of Bush-Mosteller linear operators and a Pearce-Hall-like associability mechanism is proposed. This model, referred to as the Associability Decay Model (ADM) of paradoxical choice, adequately accounts for the performance of pigeons and rats in 2ABTs. The ADM yields an untested prediction that is inconsistent with other computational models of 2ABT performance, and offers potential explanations for why differences in motivation, social enrichment, and impulsivity alter the degree to which pigeons systematically choose information despite earning fewer rewards. The success of the ADM shows that a relatively simple dynamic trial-by-trial model can account for much of the extant paradoxical-choice data while identifying opportunities for further study and refinement of models of 2ABT performance. (PsycINFO Database Record, ((c) 2018 APA, all rights reserved).)

Two experiments were conducted to assess the effect of lever height on lever pressing that was not explicitly reinforced - i.e., operant-level responding. Two rodent species were used as subjects, rats (Experiment 1) and hamsters (Experiment 2), aiming to compare the behavioral support offered by one lever at various heights relative to the subjects' body size. Results showed that lever height had a substantial effect on response rate. The rate of lever pressing varied similarly for rats and hamsters as a function of lever height, when lever height was re-scaled relative to body size. The distribution of inter-response times showed that lever pressing was organized in bouts separated by pauses. This pattern of responding was accurately described in both experiments by a mixture of two exponential distributions. These findings support an analysis of affordances in non-human species., (Copyright © 2012 Elsevier B.V. All rights reserved.)

The distribution of foraging strategies and associated activities of Wistar rats was examined, with food outcomes presented in small vs. large units. Groups of 4 rats foraged for food in a 4 x 3 array of covered holes, some containing 4 g of food. For some groups, food consisted of shelled sunflower seeds (small units); for other groups, food consisted of 3 pellets of chow (large units). Foraging strategies were classified as either production (seeking patches with food) or scrounging (tracking conspecifics). Production strategies were more common among groups that foraged for pellets instead of seeds. Producing food was highly correlated with contacting gates covering holes, whereas scrounging for food was highly correlated with following others in the group. The prevalence of activities associated with each foraging strategy was highly correlated with the proportion of time spent consuming food obtained from each activity (i.e., produced vs. scrounged food). Taken together, these findings suggest that, similar to other species, the finder’s advantage (low with small units, high with large units) modulates social foraging strategies in rats. A simple outcome-strategy feedback mechanism appears to mediate this modulation.

The distribution of foraging strategies and associated activities of Wistar rats was examined with food outcomes presented in small versus large units. Groups of 4 rats foraged for food in a 4 x 3 array of covered holes, some containing 4 g of food. For some groups, food consisted of shelled sunflower seeds (small units); for other groups, food consisted of 3 pellets of chow (large units). Foraging strategies were classified as either production (seeking patches with food) or scrounging (tracking conspecifics). Production strategies were more common among groups that foraged for pellets instead of seeds. Producing food was highly correlated with contacting gates covering holes, whereas scrounging for food was highly correlated with following others in the group. The prevalence of activities associated with each foraging strategy was highly correlated with the proportion of time spent consuming food obtained from each activity (i.e., produced vs. scrounged food). Taken together, these findings suggest that, similar to other species, the finder's advantage (low with small units, high with large units) modulates social foraging strategies in rats. A simple outcome-strategy feedback mechanism appears to mediate this modulation. [ABSTRACT FROM AUTHOR]

The effect of lever height on the temporal organization of reinforced lever pressing was examined. Lever pressing was reinforced on a variable-interval 30-s schedule in rats, with lever height manipulated across six successive conditions. Parameters of the organization of responses in bouts (bout length distribution, bout-initiation rate, within-bout rate, and sequential dependency) were estimated. These estimates revealed (1) a qualitative change in the distribution of IRTs and their sequential dependency when the lever was too high, (2) a mixture of geometrically-distributed bout lengths at all lever heights, and (3) longer bouts at lower and intermediate lever heights. In accordance with previous data, these findings suggest that lower and intermediate lever heights favored lever pressing with longer bout lengths, faster bout initiation, faster within-bout responding, and more sequentially dependent timing. These results underscore the disociability of motoric capacity in operant performance, and may reflect the influence of the body size on the temporal organization of the operant. [ABSTRACT FROM AUTHOR]

Response bouts are clusters of responses that occur in rapid succession and are punctuated by pauses during which the response does not occur. Under variable interval schedules of reinforcement, the number of responses in each bout (the bout length) varies among bouts. This experiment was aimed at determining whether the relative rate of reinforcement influenced the relative frequency of bouts of different lengths. Lever pressing in rats was reinforced under a tandem variable time (VT) 150-s fixed ratio (FR) X, where X could be 1 or 5 and varied randomly after each reinforcer. Two conditions were included: majority FR1 (mFR1) and majority FR5 (mFR5). In mFR1, 75% of reinforcers had a tandem FR requirement of 1 and 25% had a tandem FR requirement of 5; this distribution was reversed in mFR5. The dynamic bi-exponential refractory model of response bouts was fitted to the interresponse times (IRTs) in each condition. Model parameter estimates and IRTs were then used to simulate probable distributions of bout lengths. These distributions comprised a mixture of short geometrically-distributed bout lengths and long negative-binomially-distributed bout lengths. Long bouts were significantly longer in the mFR5 condition than in the mFR1 condition. In conjunction with previous data, the present study suggests that the prevalence of long bouts increases with the proportion of reinforcers with FR5 requirement. These results suggest that bouts of different lengths are sensitive to the rate at which they are reinforced. [ABSTRACT FROM AUTHOR]

We hypothesized that environmental enrichment in rats may reduce cocaine-seeking behaviour elicited by cocaine-priming injections and by cocaine-associated cues. Rats trained to self-administer cocaine while housed in isolated conditions were then assigned to live in isolation or an enriched environment for 21 d of forced abstinence. Subsequently, extinction and reinstatement of cocaine-seeking behaviour (operant responses without cocaine available) were assessed. Expt 1 showed that enrichment resulted in less cocaine-seeking behaviour during extinction and cue-elicited reinstatement compared to continued isolation housing, but had no effect on cocaine-primed reinstatement. A subsequent experiment, which included a pair-housed group to control for potential isolation stress, again demonstrated that enrichment attenuated cocaine seeking during extinction, but not cocaine-primed reinstatement, relative to both isolation and pair-housed conditions. The findings suggest that enrichment reduces the impact of cocaine-associated environmental stimuli, and hence it may be a useful intervention for attenuating cue-elicited craving in humans. [ABSTRACT FROM AUTHOR]

Abstract: The peak interval (PI) procedure is commonly used to evaluate animals’ ability to produce timed intervals. It consists of presenting fixed interval (FI) schedules in which some of the trials are replaced by extended non-reinforced trials. Responding will often resume (resurge) at the end of the non-reinforced trials unless precautions are taken to prevent it. Response resurgence was replicated in rats and pigeons. Variation of the durations of the FI and the non-reinforced probe trials showed it to be dependent on the time when reinforcement is expected. Timing of both the normal time to reinforcement, and the subsequent time to reinforcement during the probe trials followed Weber''s law. A quantitative model of resurgence is described, suggesting how animals respond to the signaling properties of reinforcement omission. Model results were simulated using a stochastic binary counter. [Copyright &y& Elsevier]

• Rats learn and use multiple timing cues simultaneously. • Behavioral control selectively shifts between timing and non-timing cues. • Performance might alternate between timing and non-timing strategies. • Non-timing in the midsession reversal involves a win-stay/lose-some-shift strategy. In a midsession reversal task, subjects choose between two stimuli on every trial; only responses to one stimulus are reinforced. Halfway throughout the session, contingencies are reversed: previously reinforced responses are now extinguished and vice versa. Both, the outcome of the previous trial and the time elapsed since the beginning of the session, may predict the availability of reinforcement and determine choice. Thus, this task has typically been used to study cognitive flexibility and the temporal organization of behavior. This study assessed how past outcomes and time interact for behavioral control when each cue predicts the availability of reinforcement to a different extent. Eight rats were trained in four variations of the midsession reversal task differing in the reliability of outcomes and time as predictors of the reinforced response. We manipulated the reliability of the outcomes by providing either continuous or partial reinforcement, and the reliability of time by fixing the moment of reversal (middle of the session) or making the reversal unpredictable (semi-random trial). Results suggest that behavioral control alternates between outcomes and time according to the relative reliability of each cue. Model simulations show that outcomes and time may jointly determine behavior, and that momentary reinforcement rate may determine their relative influence. [ABSTRACT FROM AUTHOR]

A common assumption in the study of fixed-interval (FI) timing is that FI performance is largely stable within sessions, once it is stable between sessions. Within-session changes in FI performance were examined in published data (Daniels and Sanabria, 2017), wherein some rats were trained on a FI 30-s schedule of food reinforcement (FI30) and others on a FI 90-s schedule (FI90). Following stability, FI90 rats were pre-fed for five sessions. Response rates declined as a function of trial, due more to latency lengthening than to run-rate reduction. Latencies were best described by a dynamic gamma-exponential mixture distribution, in which latency lengthening was driven by the growth of the criterion pulse count for a response and not by a reduction in the speed of an endogenous clock. The speed of the clock was selectively sensitive to the length of the FI; the prevalence and length of exponentially-distributed latencies were selectively sensitive to pre-feeding. These findings reveal (a) that parameters governing FI latencies are selectively sensitive to a range of manipulations, (b) a potential degradation of the criterion pulse count between consecutive sessions, and (c) a subsequent recovery of the criterion pulse count within sessions. [ABSTRACT FROM AUTHOR]

The present study examined how systemic low doses of nicotine affect the microstructure of reinforced food-seeking behavior in rats. Rats were first given an acute saline or nicotine treatment (0.1–0.6 mg/kg, with an inter-injection interval of at least 48 h), and then a chronic saline or nicotine treatment (0.3 mg/kg/day for 10 consecutive days). Immediately after each injection, rats were required to press a lever five times to obtain food that was available at unpredictable times (on average every 80 s) with constant probability. Acute nicotine dose-dependently suppressed behavior prior to the delivery of the first reinforcer, but enhanced food-reinforced behavior afterwards. These effects were primarily observed in the time it took rats to initiate food-seeking behavior. Enhancing effects were also observed in the microstructure of food-seeking behavior, with lower nicotine doses (0.1–0.3 mg/kg) increasing the rate at which response bouts were initiated, and higher doses (0.3–0.6 mg/kg) increasing within-bout response rates. A pre-feeding control suggests that changes in appetite alone cannot explain these effects. Over the course of chronic nicotine exposure, tolerance developed to the suppressive, but not to the enhancing effects of nicotine on food-seeking behavior. These results suggest that (a) lower doses of nicotine enhance the reward value of food and/or food-associated stimuli, (b) higher doses of nicotine enhance motoric activity, and (c) ostensive sensitization effects of nicotine on behavior partially reflect a tolerance to its transient suppressive motoric effects. [ABSTRACT FROM AUTHOR]

Models of interval timing typically include a response threshold to account for temporal production. The present study sought to evaluate the dependent concurrent fixed-interval fixed-interval schedule of reinforcement as a tool for selectively isolating the response threshold in rats, pigeons, and humans. In this task, reinforcement is available either at one location after a short delay or at another location at a longer delay. Because the reinforced location is not signaled, subjects normally respond on the first location and, if reinforcement is not delivered, then switch to the second location. The latency to switch between locations served as the primary dependent measure. After training rats, pigeons, and humans with equal reinforcement magnitudes in the short and long delays, the magnitude of reinforcement was increased threefold on the long-delay location. Consistent with model predictions, this biasing procedure decreased estimates of the response threshold of rats and pigeons, but also reduced temporal control in these species and increased response-threshold estimates in humans. Human and pigeon performance also suggested a magnitude-induced increase in the speed of the internal clock. Collectively, these results suggest that differences in reinforcement magnitude between response alternatives appear to modulate the response threshold, but not selectively, and may provide guidance for better isolating response-threshold effects in humans. [ABSTRACT FROM AUTHOR]

• The role of dorsal hippocampus (dHPC) on interval timing was assessed in rats. • Food was available alternately at one of two intervals in two locations. • dHPC lesions resulted in earlier visits to the longer-interval location. • This effect appears to last longer when interval is not familiar. • Results suggest dHPC involvement in encoding new response-initiation times. This study investigated the role of the dorsal hippocampus (dHPC) in the temporal entrainment of behavior, while addressing limitations of previous evidence from peak procedure experiments. Rats were first trained on a switch-timing task in which food was obtained from one of two concurrently available levers; one lever was effective after 8 s and the other after 16 s. After performance stabilized, rats underwent either bilateral NMDA lesions of the dHPC or sham lesions. After recovery, switch-timing training resumed. In a subsequent condition, the switch-timing task was modified such that food was available after either 8 or 32 s. Although dHPC lesions had subtle and complex effects on when rats stopped seeking for food at the 8-s lever (departures), it more systematically reduced the time when rats started seeking for food at the 16-s and 32-s lever (switches). No systematic effect of dHPC lesions were observed on the coefficient of quartile variation (normalized dispersion) of latencies to switch. Within the context of the pacemaker-accumulator framework of interval timing, these findings suggest that partially or wholly independent mechanisms control the initiation and termination of timed responses, and that the dHPC is primarily involved in encoding the time to start responding. [ABSTRACT FROM AUTHOR]