Search

Rats were given repeated choices between social and nonsocial outcomes, and between familiar and unfamiliar social outcomes. Lever presses on either of 2 levers in the middle chamber of a 3‐chamber apparatus opened a door adjacent to the lever, permitting 45‐s access to social interaction with the rat in the chosen side chamber. In Experiment 1, rats preferred (a) social over nonsocial options, choosing their cagemate rat over an empty chamber, and (b) an unfamiliar over a familiar rat, choosing a non‐cagemate over their cagemate. These findings were replicated in Experiment 2 with 2 different non‐cagemate rats. Rats preferred both non‐cagemate rats to a similar degree when pitted against their cagemate, but were indifferent when the 2 non‐cagemates were pitted against each other. Similar preference for social over nonsocial and non‐cagemate over cagemate was seen in Experiment 3, with new non‐cagemate rats introduced after every third session. Response rates (for both cagemate and non‐cagemate rats) were elevated under conditions of nonsocial (isolated) housing compared to conditions of social (paired) housing, demonstrating a social deprivation effect. Together, the experiments contribute to an experimental analysis of social preference within a social reinforcement framework, drawing on methods with proven efficacy in the analysis of reinforcement more generally. [ABSTRACT FROM AUTHOR]

The effects of response force on microstructure were evaluated. A strain‐gauge operandum permitted the manipulation of the force required to produce reinforcers (criterion responses) independently from the force defining response threshold. Thus, we could detect subcriterion forces that fell short of the force criterion. Eight rats earned food according to variable‐interval (VI) 30‐ and 120‐s schedules. The force requirements were set to 5.6 or 32.0 g; the response threshold was fixed at 5.6 g. Interresponse times were computed when subcriterion responses were both included and omitted from the analysis. Log‐survivor functions of interresponse times showed that increasing force requirements elevated the mean between‐bout interval of the VI 120‐s schedule, but only if subcriterion behavior was excluded. Omitting subcriterion responses thus leads to overestimation of intervals separating response bouts. Increasing force requirements also increased the skewness of the between‐bout distribution. A subsequent analysis found that subcriterion responses are most plentiful following reinforcer delivery, which helps to explain why their omission might inflate between‐bout intervals, as this period is an important transition from reinforcer consumption to engagement in operant activity. The data suggest caution interpreting the effects of force on microstructure when subcriterion behavior is not or cannot be measured. [ABSTRACT FROM AUTHOR]

We investigated the duration of lever pressing by rats when the delivery of appetitive reinforcers was contingent upon response duration. In the first experiment, response durations increased when duration requirements were imposed, and they decreased when duration requirements were removed. This effect occurred whether reinforcers were immediate or delayed by 8 s. In order to maintain the integrity of the delay intervals, reinforcer delivery was dependent upon both lever depression and release. In a second experiment, lever depression only and a response duration of at least 4 s were required for reinforcer delivery. Compared to immediate reinforcement conditions, delayed reinforcers increased both variability and the length of the maximum response durations. In a third experiment, immediate reinforcers were delivered contingent upon lever depression and release under a variety of duration requirements. Median lever‐press durations tracked the contingencies rapidly. Across all three experiments, rats emitted numerous response durations that were too short to satisfy the reinforcer requirements, and bimodal distributions similar to those produced by differential reinforcement of low rate schedules were evident for most rats. In many aspects, response duration responds to reinforcement parameters in a fashion similar to rate of discrete responding, but an examination of this continuous dimension of behavior may provide additional information about environment–behavior relationships. [ABSTRACT FROM AUTHOR]

The present study examined punishment of responding with histamine injection, and its potential to generate avoidance of punishment. Sprague–Dawley rats were trained under concurrent schedules in which responses on one lever (the punishment lever) produced food under a variable‐interval schedule, and under some conditions intermittent injections of histamine, which suppressed behavior. Responses on a second (avoidance) lever prevented histamine injections scheduled on the punishment lever. After stabilization of punished responding, a variable‐interval 15‐s schedule of cancellation of histamine (avoidance) was added for responding on the second/avoidance lever, without subsequent acquisition of responding on that lever. Progressive decreases in the length of the punishment variable‐interval schedule increased suppression on the punishment lever without increases in response rates on the avoidance lever. Exchanging contingencies on the levers ensured that response rates on the avoidance lever were sufficiently high to decrease the histamine injection frequency; nonetheless response rates on the avoidance lever decreased over subsequent sessions. Under no condition was responding maintained on the avoidance lever despite continued punishing effectiveness of histamine throughout. The present results suggest that avoidance conditioning is not a necessary condition for effective punishment, and confirm the importance of empirical rather than presumed categorization of behavioral effects of stimulus events. [ABSTRACT FROM AUTHOR]

The effects of the response–reinforcer dependency on resistance to change were studied in three experiments with rats. In Experiment 1, lever pressing produced reinforcers at similar rates after variable interreinforcer intervals in each component of a two‐component multiple schedule. Across conditions, in the fixed component, all reinforcers were response‐dependent; in the alternative component, the percentage of response‐dependent reinforcers was 100, 50 (i.e., 50% response‐dependent and 50% response‐independent) or 10% (i.e., 10% response‐dependent and 90% response‐independent). Resistance to extinction was greater in the alternative than in the fixed component when the dependency in the former was 10%, but was similar between components when this dependency was 100 or 50%. In Experiment 2, a three‐component multiple schedule was used. The dependency was 100% in one component and 10% in the other two. The 10% components differed on how reinforcers were programmed. In one component, as in Experiment 1, a reinforcer had to be collected before the scheduling of other response‐dependent or independent reinforcers. In the other component, response‐dependent and ‐independent reinforcers were programmed by superimposing a variable‐time schedule on an independent variable‐interval schedule. Regardless of the procedure used to program the dependency, resistance to extinction was greater in the 10% components than in the 100% component. These results were replicated in Experiment 3 in which, instead of extinction, VT schedules replaced the baseline schedules in each multiple‐schedule component during the test. We argue that the relative change in dependency from Baseline to Test, which is greater when baseline dependencies are high rather than low, could account for the differential resistance to change in the present experiments. The inconsistencies in results across the present and previous experiments suggest that the effects of dependency on resistance to change are not well understood. Additional systematic analyses are important to further understand the effects of the response–reinforcer relation on resistance to change and to the development of a more comprehensive theory of behavioral persistence. [ABSTRACT FROM AUTHOR]

This study aimed to investigate whether variable patterns of responses can be acquired and maintained by negative reinforcement under an avoidance contingency. Six male Wistar rats were exposed to sessions in which behavioral variability was reinforced according to a Lag contingency: Sequences of three responses on two levers had to differ from one, two or three previous sequences for shocks to be avoided (Lag 1, Lag 2 and Lag 3, respectively). Performance under the Lag conditions was compared with performance on a Yoke condition in which the animals received the same reinforcement frequency and distribution as in the Lag condition but behavioral variability was not required. The results showed that most of the subjects varied their sequences under the Lag contingencies, avoiding shocks with relatively high probability (≥ 0.7). Under the Yoke procedure, responding continued to occur with high probability, but the behavioral variability decreased. These results suggest that behavioral variability can be negatively reinforced. [ABSTRACT FROM AUTHOR]

Timeouts are sometimes used in applied settings to reduce target responses, and in some circumstances delays are unavoidably imposed between the onset of a timeout and the offset of the response that produces it. The present study examined the effects of signaled and unsignaled timeouts in rats exposed to concurrent fixed-ratio 1 fixed-ratio 1 schedules of food delivery, where each response on one lever, the location of which changed across conditions, produced both food and a delayed 10-s timeout. Delays of 0 to 38 s were examined. Delayed timeouts often, but not always, substantially reduced the number of responses emitted on the lever that produced timeouts relative to the number emitted on the lever that did not produce timeouts. In general, greater sensitivity was observed to delayed timeouts when they were signaled. These results demonstrate that delayed timeouts, like other delayed consequences, can affect behavior, albeit less strongly than immediate consequences. [ABSTRACT FROM AUTHOR]

Two groups of six rats each were trained to respond to two levers for a food reinforcer. One group was trained on concurrent variable-ratio 20 extinction schedules of reinforcement. The second group was trained on a concurrent variable-interval 27-s extinction schedule. In both groups, lever-schedule assignments changed randomly following reinforcement; a light cued the lever providing the next reinforcer. In the next condition, the light cue was removed and reinforcer assignment strictly alternated between levers. The next two conditions redetermined, in order, the first two conditions. Preference pulses, defined as a tendency for relative response rate to decline to the just-reinforced alternative with time since reinforcement, only appeared during the extinction schedule. Although the pulse's functional form was well described by a reinforcer-induction equation, there was a large residual between actual data and a pulse-as-artifact simulation (McLean, Grace, Pitts, & Hughes, 2014) used to discern reinforcer-dependent contributions to pulsing. However, if that simulation was modified to include a win-stay tendency (a propensity to stay on the just-reinforced alternative), the residual was greatly reduced. Additional modifications of the parameter values of the pulse-as-artifact simulation enabled it to accommodate the present results as well as those it originally accommodated. In its revised form, this simulation was used to create a model that describes response runs to the preferred alternative as terminating probabilistically, and runs to the unpreferred alternative as punctate with occasional perseverative response runs. After reinforcement, choices are modeled as returning briefly to the lever location that had been just reinforced. This win-stay propensity is hypothesized as due to reinforcer induction. [ABSTRACT FROM AUTHOR]

Response bouts are clusters of responses that occur in rapid succession and are punctuated by pauses during which the response does not occur. Under variable interval schedules of reinforcement, the number of responses in each bout (the bout length) varies among bouts. This experiment was aimed at determining whether the relative rate of reinforcement influenced the relative frequency of bouts of different lengths. Lever pressing in rats was reinforced under a tandem variable time (VT) 150-s fixed ratio (FR) X, where X could be 1 or 5 and varied randomly after each reinforcer. Two conditions were included: majority FR1 (mFR1) and majority FR5 (mFR5). In mFR1, 75% of reinforcers had a tandem FR requirement of 1 and 25% had a tandem FR requirement of 5; this distribution was reversed in mFR5. The dynamic bi-exponential refractory model of response bouts was fitted to the interresponse times (IRTs) in each condition. Model parameter estimates and IRTs were then used to simulate probable distributions of bout lengths. These distributions comprised a mixture of short geometrically-distributed bout lengths and long negative-binomially-distributed bout lengths. Long bouts were significantly longer in the mFR5 condition than in the mFR1 condition. In conjunction with previous data, the present study suggests that the prevalence of long bouts increases with the proportion of reinforcers with FR5 requirement. These results suggest that bouts of different lengths are sensitive to the rate at which they are reinforced. [ABSTRACT FROM AUTHOR]

Delay discounting describes the devaluation of a reward as the delay to the receipt of the reward increases. Because steep delay discounting is robustly correlated with a number of behavioral problems (e.g., substance dependence, gambling) and some evidence suggests steep discounting precedes and predicts drug-taking in humans and rats, this study sought to experimentally reduce rats' delay discounting. Human stimulant-dependent participants given working-memory training reportedly decreased their rates of discounting relative to a sham-training group (Bickel, Yi, Landes, Hill, & Baxter, 2011). To evaluate the cross-species generality of this effect, 38 male Long-Evans rats, matched on pretraining delay-discounting rates, were randomly assigned to receive 140 sessions of working-memory training or sham training (which required no memory of the sample stimulus). Large between-group differences in working memory were observed after training; however, posttraining delay-discounting rates were undifferentiated across groups. Potential explanations for these findings are discussed. [ABSTRACT FROM AUTHOR]

Eight rats responded on concurrent Variable-Ratio 20 Extinction schedules for food reinforcement. The assignment of variable-ratio reinforcement to a left or right lever varied randomly following each reinforcer, and was cued by illumination of a stimulus light above that lever. Postreinforcement preference levels decreased substantially and reliably over time when the lever that just delivered reinforcement was now in extinction; however, if that lever was once again associated with variable ratio, this decrease in same-lever preference tended to be small, and for some subjects, not in evidence. The changes in preference level to the extinction lever were well described by a modified version of Killeen, Hanson and Osborne's (1978) induction model. Consistent with this model's attribution of preference change to induction, we attribute preference change in this report to a brief period of reinforcer-induced arousal that energizes responding to the lever that delivered the last reinforcer. After a few seconds, this induced responding diminishes, and the operant responding that remains comes under the control of the stimulus light cuing the lever providing variable-ratio reinforcement. [ABSTRACT FROM AUTHOR]

Four rats responded on concurrent variable-interval schedules that delivered token stimuli (stimulus lights arranged vertically above each of two side levers). During exchange periods, each token could be exchanged for one food pellet by responding on a center lever, with one response required for each pellet delivery. In different conditions, the exchange requirements (number of tokens that had to be earned before they could be exchanged for food) varied between one and four for the two response levers. The experiments were closely patterned after research with pigeons by Mazur and Biondi (), and the results from the rats in the present experiment were similar. Response percentages on the two levers changed as each additional token was earned, and these patterns indicated that choice was controlled by both the time to the exchange periods and the number of food pellets that were delivered in the exchange period. In some conditions, the exchange requirement was three tokens for each lever, but the token lights were not turned on as they were earned for one of the two keys. The rats showed a slight preference for the lever without the token lights, which may indicate that the token lights were not serving as conditioned reinforcers (a result also found by Mazur and Biondi with pigeons). Overall, these results suggest that, in this choice procedure, the token stimuli served primarily as discriminative stimuli that signaled the temporal proximity and quantity of the primary reinforcer, food. [ABSTRACT FROM AUTHOR]

Although drugs may serve as reinforcers or punishers of operant behavior, the punishing function has received much less experimental attention than the reinforcing function. A sensitive method for studying drug-induced punishment is to assess choice for a punished response over an unpunished response. In these experiments, rats chose between pressing one lever and receiving a sucrose pellet or pressing another lever and receiving a sucrose pellet plus an intravenous injection of histamine. When sucrose was delivered equally frequently for either the punished or the unpunished response, rats selected the unpunished lever consistently, but decreases in the punished response did not differ as a function of intravenous histamine dose (0.1-1 mg/kg/inj). Changing the procedure so that sucrose was delivered on the unpunished lever with p = .5 increased the rats' responding on the punished lever with saline injections. In addition, the same range of histamine doses produced a much larger range of responses on the punished lever that was dose dependent. Using these procedures to assess the receptors mediating histamine's effects, the histamine H1-receptor antagonists, pyrilamine and ketotifen, antagonized the punishing effect of histamine, but the histamine H2-receptor antagonist ranitidine did not. However, ranitidine pretreatments reduced histamine-induced heart-rate increases to a greater extent than did the histamine H1-receptor antagonists when administered at the same doses examined under conditions of histamine punishment. Overall, the present findings extend the general hypothesis that activation of histamine H1-receptors mediates the punishing effects of histamine. They also introduce methods for rapidly assessing pharmacological mechanisms underlying drug-induced punishment. [ABSTRACT FROM AUTHOR]

In both humans and nonhumans, prior research demonstrates increased preference for larger-later over smaller-sooner rewards when rewards are bundled together in a series (i.e., when an operant choice produces multiple discrete reward deliveries, as opposed to only a single delivery). These findings can be predicted using a traditional hyperbolic delay-discounting model. The present study was designed to examine the parametric effects of the size of the reward bundle on larger-later reward preference in male rats. During a reward-bundling phase, rats were exposed to bundle-sizes of either 1 (i.e., no bundling), 3, or 9 rewards. Rats in the Bundle-size 9 group showed significantly greater larger-later reward preference across a range of delays (0-17.5 s) than rats in any other group, but no other significant differences in choice were observed between groups. In addition, when choice for unbundled rewards was assessed following the reward-bundling phase, rats in the Bundle-size 9 group showed a significant increase in larger-later reward preference (compared to a pre-test). Obtained data from the reward-bundling phase are compared to model-predicted data, and potential mechanisms of the observed increase in self-control for unbundled rewards are discussed. [ABSTRACT FROM AUTHOR]

The acquisition of lever pressing by rats was studied under intermittent immediate and delayed conditioned reinforcement. Rats were exposed to two schedules operating concomitantly. One was a random-time schedule that delivered reinforcers on average of once per min. Each such reinforcer was paired with a 1-s illumination of a cue light located above the lever. The other was a tandem random-interval (RI) t1- s fixed-time (FT) t2- s schedule that controlled the rate and the delay of the illumination of the cue-light after a given lever press. For the RI, t1 was 7.5, 15 or 30 s. For the FT, t2 was 0, 1, 2, 4, 8, 16 or 32 s. Three rats each were exposed to each combination of RI and FT values for 40 sessions. Response rates decreased with longer response-conditioned reinforcer (Sr) delays under the three different overall rates of Sr. At most response-Sr delays, absolute response rates were higher with RI 15 s than with RI 30 s but both were similar to those obtained with RI 7.5 s. The results were similar to those from previous research on response acquisition with delayed primary reinforcement. These findings suggest that a previously neutral stimulus that has been correlated with primary reinforcement can reinforce new responses even when the conditioned reinforcer is intermittent and delayed from the responses that produce it. [ABSTRACT FROM AUTHOR]

In Experiment 1, food-deprived rats responded to one of two schedules that were, with equal probability, associated with a sample lever. One schedule was always variable ratio, while the other schedule, depending on the trial within a session, was: (a) a variable-interval schedule; (b) a tandem variable-interval, differential-reinforcement-of-low-rate schedule; or (c) a tandem variable-interval, differential-reinforcement-of-high-rate schedule. Completion of a sample-lever schedule, which took approximately the same time regardless of schedule, presented two comparison levers, one associated with each sample-lever schedule. Pressing the comparison lever associated with the schedule just presented produced food, while pressing the other produced a blackout. Conditional-discrimination accuracy was related to the size of the difference in reinforced interresponse times and those that preceded it (predecessor interresponse times) between the variable-ratio and other comparison schedules. In Experiment 2, control by predecessor interresponse times was accentuated by requiring rats to discriminate between a variable-ratio schedule and a tandem schedule that required emission of a sequence of a long, then a short interresponse time in the tandem's terminal schedule. These discrimination data are compatible with the copyist model from Tanno and Silberberg (2012) in which response rates are determined by the succession of interresponse times between reinforcers weighted so that each interresponse time's role in rate determination diminishes exponentially as a function of its distance from reinforcement. [ABSTRACT FROM AUTHOR]

Although response-dependent shock often suppresses responding, response facilitation can occur. In two experiments, we examined the suppressive and facilitative effects of shock by manipulating shock intensity and the interresponse times that produced shock. Rats' lever presses were reinforced on a variable-interval 40-s schedule of food presentation. Shock followed either long or short interresponse times. Shock intensity was raised from 0.05 mA to 0.4 mA or 0.8 mA. Overall, shock contingent on long interresponse times punished long interresponse times and increased response rates. Shock contingent on short interresponse times punished short interresponse times and decreased response rates. In Experiment 1, raising the range of interresponse times that produced shock enhanced these effects. In Experiment 2, the effects of shock intensity depended on the interresponse times that produced shock. When long interresponse times produced shock, low intensities increased response rates. High intensities decreased response rates. When short interresponse times produced shock, high shock intensities punished short interresponse times and decreased response rates more than low intensities. The results may explain why punishment procedures occasionally facilitate responding and establish parameters for future studies of punishment. [ABSTRACT FROM AUTHOR]

Lewis rats have been shown to make more impulsive choices than Fischer 344 rats in discrete-trial choice procedures that arrange fixed (i.e., nontitrating) reinforcement parameters. However, nontitrating procedures yield only gross estimates of preference, as choice measures in animal subjects are rarely graded at the level of the individual subject. The present study was designed to examine potential strain differences in delay discounting using an adjusting-amount procedure, in which distributed (rather than exclusive) choice is observed due to dynamic titration of reinforcer magnitude across trials. Using a steady-state version of the adjusting-amount procedure in which delay was manipulated between experimental conditions, steeper delay discounting was observed in Lewis rats compared to Fischer 344 rats; further, delay discounting in both strains was well described by the traditional hyperbolic discounting model. However, upon partial completion of the present study, a study published elsewhere (Wilhelm & Mitchell, 2009) demonstrated no difference in delay discounting between these strains with the use of a more rapid version of the adjusting-amount procedure (i.e., in which delay is manipulated daily). Thus, following completion of the steady-state assessment in the present study, all surviving Lewis and Fischer 344 rats completed an approximation of this rapid-determination procedure in which no strain difference in delay discounting was observed [ABSTRACT FROM AUTHOR]

Parallel experiments with rats and pigeons examined whether the size of a pre-trial ratio requirement would affect choices in a self-control situation. In different conditions, either 1 response or 40 responses were required before each trial. In the first half of each experiment, an adjusting-ratio schedule was used, in which subjects could choose a fixed-ratio schedule leading to a small reinforcer, or an adjustingratio schedule leading to a larger reinforcer. The size of the adjusting ratio requirement was increased and decreased over trials based on the subject's responses, in order to estimate an indifference point-a ratio at which the two alternatives were chosen about equally often. The second half of each experiment used an adjusting-delay procedure-fixed and adjusting delays to the small and large reinforcers were used instead of ratio requirements. In some conditions, particularly with the reinforcer delays, the rats had consistently longer adjusting delays with the larger pre-trial ratios, reflecting a greater tendency to choose the larger, delayed reinforcer when more responding was required to reach the choice point. No consistent effects of the pre-trial ratio were found for the pigeons in any of the conditions. These results may indicate that rats are more sensitive to the long-term reinforcement rates of the two alternatives, or they may result from a shallower temporal discounting rate for rats than for pigeons, a difference that has been observed in previous studies. [ABSTRACT FROM AUTHOR]

The exponential demand equation proposed by Hursh and Silberberg (2008) provides an estimate of the essential value of a good as a function of price. The model predicts that essential value should remain constant across changes in the magnitude of a reinforcer, but may change as a function of motivational operations. In Experiment 1, rats' demand for food across a sequence of fixed-ratio schedules was assessed during open and closed economy conditions and across one- and two-pellet per reinforcer delivery conditions. The exponential equation was fitted to the relation between fixed-ratio size and the logarithm of the absolute number of reinforcers. Estimates of the rate of change in elasticity of food, the proposed measure of essential value, were compared across conditions. Essential value was equivalent across magnitudes during the closed economy, but showed a slight decrease across magnitudes during the open economy. Experiment 2 explored the behavioral mechanisms of nicotine's effects on consumption with the results from Experiment 1 serving as a within-subject frame of reference. The same subjects were administered nicotine via subcutaneously implanted osmotic minipumps at a dose of 3 mg/kg/day and exposed to both the one- and two-pellet conditions under a closed economy. Although nicotine produced large decreases in demand, essential value was not significantly changed. The data from the present experiments provide further evidence for the adequacy of the exponential demand equation as a tool for quantifying the rate of change in elasticity of a good and for assessing behavioral mechanisms of drug action. [ABSTRACT FROM AUTHOR]

We investigated changes in bias (preference for one response alternative) in signal detection when relative reinforcer frequency for correct responses varied across sessions. In Experiment 1, 4 rats responded in a two-stimulus, two-response identification procedure employing temporal stimuli (short vs. long houselight presentations). Relative reinforcer frequency varied according to a 31-step pseudorandom binary sequence and stimulus duration difference varied over two values across conditions. In Experiment 2, 3 rats responded in a five-stimulus, two-response classification procedure employing temporal stimuli. Relative reinforcer frequency was varied according to a 36-step pseudorandom ternary sequence. Results of both experiments were analyzed according to a behavioral model of detection. The model was extended to incorporate the effects of current and previous session reinforcer frequency ratios on current-session performance. Similar to findings with concurrent schedules, effects on bias of relative reinforcer frequency were highest for the current session. However, carryover from reinforcer ratios of previous sessions was evident. Generally, the results indicate that bias can come under control of frequent changes in relative reinforcer frequency in both identification and classification procedures. [ABSTRACT FROM AUTHOR]

Parallel experiments with rats and pigeons examined reasons for previous findings that in choices with probabilistic delayed reinforcers, rats' choices were affected by the time between trials whereas pigeons' choices were not. In both experiments, the animals chose between a standard alternative and an adjusting alternative. A choice of the standard alternative led to a short delay (1 s or 3 s), and then food might or might not be delivered. If food was not delivered, there was an ''interlink interval,'' and then the animal was forced to continue to select the standard alternative until food was delivered. A choice of the adjusting alternative always led to food after a delay that was systematically increased and decreased over trials to estimate an indifference point-a delay at which the two alternatives were chosen about equally often. Under these conditions, the indifference points for both rats and pigeons increased as the interlink interval increased from 0 s to 20 s, indicating decreased preference for the probabilistic reinforcer with longer time between trials. The indifference points from both rats and pigeons were well described by the hyperbolic-decay model. In the last phase of each experiment, the animals were not forced to continue selecting the standard alternative if food was not delivered. Under these conditions, rats' choices were affected by the time between trials whereas pigeons' choices were not, replicating results of previous studies. The differences between the behavior of rats and pigeons appears to be the result of procedural details, not a fundamental difference in how these two species make choices with probabilistic delayed reinforcers. [ABSTRACT FROM AUTHOR]

The present study used within-session transitions between two concurrent schedules to evaluate choice in transition. Eight female Long-Evans rats were trained to respond under concurrent schedules of reinforcement during experimental sessions that lasted 22 hr. The generalized matching equation was used to model steady-state behavior at the end of each session, while transitional behavior that emerged following the change in reinforcement schedules was modeled using a logistic equation. The generalized matching and logistic equations were appropriate models for behavior generated during single-session transitions. A local analysis of behavior on the two response alternatives during acquisition was used to determine the source of preference as revealed in response ratios. The number of "low- response" visits, those containing three to five responses, remained stable. Preference ratios largely reflected a sharp increase in the number of visits with long response bouts on the rich alternative and a decrease in the number of such visits to the leaner alternative. [ABSTRACT FROM AUTHOR]

The article presents a research on isolating the delay effect from the delay discounting and amount sensitivity effects of nicotine. It is reported that, titrating delay procedure is used for the isolation and, the experiment is done on rats. The experiment concludes that, nicotine-induced changes in impulsive choice are likely to be due to differences in smallerÐsooner reinforcer amount rather than, differences in reinforcer delay.

The article discusses an experiment to analyze behavior of human species. For the experiment, an adjusting delay procedure was used to study the choices of pigeons and rats when both delay and number of reinforcements were varied. Under different conditions, the choice alternatives were altered. The objective of the experiments were to test the prediction of a hyperbolic decay equation that the slopes of the indifference functions should increase as the ratio of the two reinforcer increases.

The article discusses two experiments on food deprived rats. It is found that the rats in experiment one responded to one of two tandem schedules that were associated with a sample lever. These schedules were different random interval schedules. In experiment two, tandem schedule was replaced by a tandem ratio. In the first experiment, pressing the lever associated with the sample-lever tandem schedule produced a food pellet while pressing the other produced a blackout.

Previous research has shown that Lewis rats make more impulsive choices than Fischer 344 rats. Such strain-related differences in choice are important as they may provide an avenue for exploring genetic and neurochemical contributions to impulsive choice. The present systematic replication was designed to determine if these findings could be reproduced using a procedure less susceptible to within- or between-session carry-over effects that may have affected previous findings. Specifically, delays to the larger-later food reinforcer were manipulated between conditions following steady-state assessments of choice, and the order of delays across conditions was mixed. The results confirmed previous findings that Lewis rats made significantly more impulsive choices than Fischer 344 rats. Fischer 344 rats' preference for the larger-later reinforcer, on the other hand, was less extreme than reported in prior research, which may be due to carry-over effects inherent to the commonly used technique of systematically increasing delays within session. Previously reported across-strain motor differences were reproduced as Lewis rats had shorter latencies than Fischer 344 rats, although these latencies were not correlated with impulsive choice. Parallels between reduced dopamine function in Lewis rats and clinical reports of impulse-control disorders following treatment of Parkinson patients with selective D2/D3 dopamine agonists are discussed. [ABSTRACT FROM AUTHOR]

Resistance to change is often studied by measuring response rate in various components of a multiple schedule. Response rate in each component is normalized (that is, divided by its baseline level) and then log-transformed. Differential resistance to change is demonstrated if the normalized, log-transformed response rate in one component decreases more slowly than in another component. A problem with normalization, however, is that it can produce artifactual results if the relation between baseline level and disruption is not multiplicative. One way to address this issue is to fit specific models of disruption to untransformed response rates and evaluate whether or not a multiplicative model accounts for the data. Here we present such a test of resistance to change, using within-session response patterns in rats as a data base for fitting models of disruption. By analyzing response rate at a within-session level, we were able to confirm a central prediction of the resistance-to-change framework while discarding normalization artifacts as a plausible explanation of our results. [ABSTRACT FROM AUTHOR]

The generality of the molar view of behavior was extended to the study of choice with rats, showing tile usefulness of studying order at rations levels of extendedness. Rats' presses on two levers produced food according to concurrent variable-interval variable-interval schedules. Seven different reinforcer ratios were arranged within each session, without cues identifying them, and separated by blackouts. To alternate between levers, rats pressed on a third changeover lever. Choice changed rapidly with changes in component reinforcer ratio, and more presses occurred on the lever with the higher reinforcer rate. With continuing reinforcers, choice shifted progressively in the direction of the reinforced lever, but shifted more slowly with each new reinforcer. Sensitivity to reinforcer ratio, as estimated by the generalized matching law, reached an average of 0.9 and exceeded that documented in previous studies with pigeons. Visits to the more-reinforced lever preceded by a reinforcer from that lever increased in duration, while all visits to the less-reinforced lever decreased in duration. Thus, the rats' performances moved faster toward fix and sample than did pigeons' performances in previous studies. Analysis of the effects of sequences of reinforcer sources indicated that sequences of five to seven reinforcers might have sufficed for studying local effects of reinforcers with rats. This study supports the idea that reinforcer sequences control choice between reinforcers, pulses in preference, and visits following reinforcers. [ABSTRACT FROM AUTHOR]

Children who have Status epilepticus have continuous or rapidly repeating seizures that may be life- threatening and may cause life-long changes in brain and behavior. The extent to which status epilepticus causes deficits in auditory discrimination is unknown. A naturalistic auditory location discrimination method was used to evaluate this question using an animal model of status epilepticus. Male Sprague-Dawley rats were injected with saline on postnatal day (P) 20, or a convulsant dose of pilocarpine on P20 or P45. Pilocarpine on either day induced status epilepticus; status epilepticus at P45 resulted in CA3 cell loss and spontaneous seizures, whereas P20 rats had no cell loss or spontaneous seizures. Mature rats were trained with sound-source location and sound-silence discriminations. Control (saline P20) rats acquired both discriminations immediately. In status epilepticus (P20) rats, acquisition of the sound-source location discrimination was moderately impaired. Status epilepticus (P45) rats failed to acquire either sound-source location or sound-silence discriminations. Status epilepticus in rat causes an age-dependent, long-term impairment in auditory discrimination. This impairment may explain one cause of impaired auditory location discrimination in humans. [ABSTRACT FROM AUTHOR]

Contingencies of reinforcement specify how reinforcers are earned and how they are obtained. Ratio contingencies specify the number of responses that earn a reinforcer, and the response satisfying the ratio requirement obtains the earned reinforcer. Simple interval schedules specify that a certain time earns a reinforcer, which is obtained by the first response after the interval. The earning of reinforcers has been overlooked, perhaps because simple schedules confound the rates of earning reinforcers with the rates of obtaining reinforcers. In concurrent variable-interval schedules, however, spending time at one alternative earns reinforcers not only at that alternative, but at the other alternative as well. Reinforcers earned for delivery at the other alternative are obtained after changing over. Thus the rates of earning reinforcers are not confounded with the rate of obtaining reinforcers, but the rates of earning reinforcers are the same at both alternatives, which masks their possibly differing effects on preference. Two experiments examined the separate effects of earning reinforcers and of obtaining reinforcers on preference by using concurrent interval schedules composed of two pairs of stay and switch schedules (MacDonall, 2000). In both experiments, the generalized matching law, which is based on rates of obtaining reinforcers, described responding only when rates of earning reinforcers were the same at each alternative. An equation that included both the ratio of the rates of obtaining reinforcers and the ratio of the rates of earning reinforcers described the results from all conditions from each experiment. [ABSTRACT FROM AUTHOR]

In Experiment 1 with rats, a left lever press led to a 5-s delay and then a possible reinforcer. A right lever press led to an adjusting delay and then a certain reinforcer. This delay was adjusted over trims m estimate an indifference point, or a delay at which the two alternatives were chosen about equally often. Indifference points increased as the probability of reinforcement for the left lever decreased. In some conditions with a 20% chance of food, a light above the left lever was lit during the 5-s delay on all trials, hut in other conditions, the light was only lit on those trials that ended with food. Unlike previous results with pigeons, the presence or absence of the delay light on no-food trials had no effect on the rats' indifference points. In other conditions, the rats showed less preference for the 20% alternative when the time between trials was longer. In Experiment 2 with rats, fixed-interval schedules were used instead of simple delays, and the presence or absence of the fixed-interval requirement on no-food trials had no effect on the indifference points. In Experiment 3 with rats and Experiment 4 with pigeons, the animals chose between a fixed-ratio 8 schedule that led to food on 33% of the trials and an adjusting- ratio schedule with food on 100% of the trials. Surprisingly, the rats showed less preference for the 33% alternative in conditions in which the ratio requirement was omitted on no-food trials. For the pigeons, the presence or absence of the ratio requirement on no-food trials had little effect. The results suggest that there may be differences between rats and pigeons in how they respond in choice situations involving delayed and probabilistic reinforcers. [ABSTRACT FROM AUTHOR]

Four rats responded under a “self-control” procedure designed to obtain delay-discount functions within sessions. Each session consisted of seven blocks, with seven trials within each block. Each block consisted of two initial forced-choice trials followed by five free-choice trials. On choice trials, the rats could press either Of two retractable levers. A press on one lever was followed by presentation of a smaller reinforcer (a tingle dipper presentation of a sucrose solution); a press on the other lever was followed by presentation of a larger reinforcer (four consecutive dipper presentations). The delay associated with the smaller reinforcer always was 0 s, whereas the signaled delay associated with the larger reinforcer increased across blocks (from 0 to 50 s). Under these conditions, the percentage of choices of the larger reinforcer decreased across blocks, and relatively reliable delay-discount functions were obtained within sessions. Doses of methylphenidate (1.0 to 17.0 mg/kg) and morphine (0.3 to 17.0 mg/kg) were then administered prior to selected sessions. Typically, intermediate doses of methylphenidate shifted the discount functions to the right (increased choices of the larger reinforcer). For 2 of the rats, this effect was pronounced; for the other 2 rats, this effect occurred after the range of delays for the larger reinforcer was decreased (0 to 20 s). On the other hand, in most cases morphine produced a slight leftward shift in the discount function (decreased choices of the larger reinforcer). The present procedure appears to be a useful and efficient method to characterize drug effects on an entire delay-discount function. As with many procedures used to study self-control choices, however, sources of control other than reinforcement delay and amount may have been operating in the present study, and these sources must be considered when interpreting drug effects. [ABSTRACT FROM AUTHOR]

Several researchers have suggested that conditioning history may have long-term effects on fixed- interval performances of rats. To test this idea and to identify possible factors involved in temporal control development, groups of rats initially were exposed to different reinforcement schedules: continuous, fixed-time, and random-interval. Afterwards, half of the rats in each group were studied on a fixed-interval 30-s schedule of reinforcement and the other half on a fixed-interval 90-s schedule of reinforcement. No evidence of long-term effects attributable to conditioning history on either response output or response patterning was found; history effects were transitory. Different tendencies in trajectory across sessions were observed for measures of early and late responding within the interreinforcer interval, suggesting that temporal control is the result of two separate processes: one involved in response output and the other in time allocation of responding and not responding. [ABSTRACT FROM AUTHOR]

The present experiment investigated whether rats formed emergent, untrained stimulus relations in many-to-one matching-to-sample discriminations. In Phase 1, rats were trained to match two samples (triangle and horizontal stripes) to a common comparison (horizontal stripes) and two additional samples (circle or vertical stripes) to another comparison (vertical stripes). Then, in Phase 2, the rats were trained to match the one sample (triangle) to a new comparison (black) and the other sample (circle) to another comparison (white). In the Phase 3 test, half the rats (consistent group) were given two new tasks in which the sample-correct comparison relation was consistent with any emergent stimulus relations that previously may have been learned. The remaining 6 rats (inconsistent group) were given two new tasks in which the sample-correct comparison relation was not consistent with any previously learned emergent stimulus relations. Rats in the consistent group showed more accurate performance at the start of Phase 3, and faster learning to criterion in this phase, as compared with rats in the inconsistent group. This finding suggests that rats may form emergent, untrained stimulus relations between the discriminative stimuli in many-to-one matching-to-sample discriminations. [ABSTRACT FROM AUTHOR]

The effects of two anorectic drugs, dexfenfluramine and phentermine, on food intake under different food-access conditions were examined. Experiment 1 compared the effects of these drugs on food intake under a progressive-ratio (PR) schedule and free-access conditions. Dexfenfluramine decreased food intake under both conditions, but the doses required to decrease intake under free-access conditions were higher than those required to reduce intake trader the PR condition. Inter mediate doses of phentermine sometimes increased breaking points, and higher doses decreased them. Phentermine decreased food intake at the same doses under both access conditions. Thus the potency of dexfenfluramine, but not phentermine, to decrease food-maintained behavior depended upon the food access condition. Experiment 2 used a novel mixed progressive-ratio schedule of food delivery to study the duration of drug effects. Sessions consisted of five components separated by 3-hr timeouts. The ratio requirement reset at the beginning of each component and a new breaking point was obtained. Both dexfenfluramine and phentermine dose-dependently decreased breaking points early in the session. In some rats, compensatory increases in breaking point were observed. That is, breaking points later in the session increased over control levels, resulting in no change in the total number of food pellets earned for the session compared to control. The present findings suggest that the effects of some anorectic drugs depend upon the access conditions for food; increasing the effort to obtain food may enhance their ability to decrease food-maintained behavior. [ABSTRACT FROM AUTHOR]

Effects of prior exposure to the experimental chamber with levers present or absent and variabletime (VT) 60-s water deliveries arranged during one, five, or no 1-hr sessions were examined in rats during a 6-hr response-acquisition session in which presses on one lever produced water delivery immediately or after a 15-s resetting delay, and presses on the other lever canceled scheduled water deliveries. Response acquisition was (a) slower to occur when water deliveries were delayed, (b) most consistent in groups that had received five VT sessions, and (c) impaired by the presence of levers only when there had been five VT sessions and water deliveries were delayed during the acquisition session. [ABSTRACT FROM AUTHOR]

An abstract of the article "The stay/switch model of concurrent choice," by J.S. MacRandall, is presented.

In three experiments, a rat's lever presses could postpone timeouts from food pellets delivered on response-independent schedules. In Experiment 1, the pellets were delivered at variable-time (VT) rates ranging from VT 0.5 to VT 8 min. Experiment 2 replicated the VT 1 min and VT 8 min conditions of Experiment 1 with new subjects. Finally, subjects in Experiment 3 could postpone timeouts from delivery of pellets that differed in quality rather than quantity (unsweetened versus sweetened pellets). In general, response rates and success in avoiding increased as a function of the rate and quality of the pellets. Also, performance efficiency increased as the experiments progressed that is, the avoidance response occurred later and later in the response-timeout interval. The results support the conclusion that timeout from reinforcement has functional properties similar to those of more commonly studied aversive stimuli (e.g., shock) [ABSTRACT FROM AUTHOR]

This study focused on variables that may account for response-rate differences under variable-ratio (VR) and variable-interval (VI) schedules of reinforcement. Four rats were exposed to VR, VI, tandem VI differential- reinforcement-of-high-rate, regulated-probability-interval, and negative-feedback schedules of reinforcement that provided the same rate of reinforcement. Response rates were higher under the VR schedule than the VI schedule, and the rates on all other schedules approximated those under the VR schedule. The median reinforced interresponse time (IRT) under the VI schedule was longer than for the other schedules. Thus, differences in reinforced IRTs correlated with differences in response rate, an outcome suggestive of the molecular control of response rate. This conclusion was complemented by the additional finding that the differences in molar reinforcement-feedback functions had little discernible impact on responding. [ABSTRACT FROM AUTHOR]

Three experiments were conducted with rats in which responses on one lever (labeled the functional lever) produced reinforcers after an unsignaled delay period that reset with each response during the delay. Responses on a second, nonfunctional, lever did not initiate delays, but, in the first and third experiments, such responses during the last 10 s of a delay did postpone food delivery another 10 s. In the first experiment, the location of the two levers was reversed several times. Responding generally was higher on the functional lever, though the magnitude of the difference diminished with successive reversals. In the second experiment, once a delay was initiated by a response on the functional lever, in different conditions responses on the nonfunctional lever either had no effect or postponed food delivery by 30 s. The latter contingency typically lowered response rates on the nonfunctional lever. In the first two experiments, both the functional and nonfunctional levers were identical except for their location; in the third experiment, initially, a vertically mounted, pole-push lever defined the functional response and a horizontally mounted lever defined the nonfunctional response. When the roles of the two responses were reversed, vertical-lever response rates were higher. These results taken together suggest that responding generally tracked the response-reinforcer contingency. The results further show how nonfunctional-operanda responses are controlled by a prior history of direct reinforcement of such responses, by the temporal delay between such responses and food delivery, and as simple generalization between the two operanda. [ABSTRACT FROM AUTHOR]

Two experiments with rats examined the dynamics of well-learned response sequences when reinforcement sequence of lever presses until responding was stable. The contingencies then were shifted to a new reinforced sequence until responding was again stable. Extinction-induced resurgence of previously reinforced, and then extinguished, heterogeneous response sequences was observed in all subjects in both experiments. These sequences were demonstrated to be integrated behavioral units, controlled by processes acting at the level of the entire sequence. Response-level processes were also simultaneously operative. Errors in sequence production were strongly influenced by the terminal, not the initial, response in the currently reinforced sequence, but not by the previously reinforced sequence. These studies demonstrate that sequence-level and response-level processes can operate simultaneously in integrated behavioral units. Resurgence and the development of integrated behavioral units may be dissociated; thus the observation of one does not necessarily imply the other. [ABSTRACT FROM AUTHOR]