Search

We investigated the effects of differential and nondifferential reinforcers on divided control by compound-stimulus dimensions. Six pigeons responded in a delayed matching-to-sample procedure in which a blue or yellow sample stimulus flashed on/off at a fast or slow rate, and subjects reported its color or alternation frequency. The dimension to report was unsignaled (Phase 1) or signaled (Phase 2). Correct responses were reinforced with a probability of .70, and the probability of reinforcers for errors varied across conditions. Comparison choice depended on reinforcer ratios for correct and incorrect responding; as the frequency of error reinforcers according to a dimension increased, control (measured by log d) by that dimension decreased and control by the other dimension increased. Davison and Nevin's (1999) model described data when the dimension to report was unsignaled, whereas model fits were poorer when it was signaled, perhaps due to carryover between conditions. We are the first to test this quantitative model of divided control with reinforcers for errors and when the dimension to report is signaled; hence, further research is needed to establish the model's generality. We question whether divided stimulus control is dimensional and suggest it may instead reflect joint control by compound stimuli and reinforcer ratios., (© 2023 The Authors. Journal of the Experimental Analysis of Behavior published by Wiley Periodicals LLC on behalf of Society for the Experimental Analysis of Behavior.)

Organisms may sometimes behave as if a contingency exists between behavior and consequences, even if this is not actually the case. Killeen (1978) suggested that such superstition occurs because of factors that bias subjects to behave "superstitiously" rather than because of failures of discrimination. We systematically replicated Killeen's experiment and compared contingency discrimination between different consequences. Six pigeons responded in a matching-to-sample procedure in which a response-independent or response-dependent stimulus change, food delivery, or blackout occurred. The pigeons reported whether the consequence was response dependent or response independent by choosing between two side keys. Discrimination was strongest after stimulus changes, weaker after blackouts, and weakest after food deliveries. These differences persisted even after additional training, suggesting asymmetries that may reflect differences in the disruptive effects of different consequences on remembering and/or behavioral mnemonics. Importantly, the pigeons were not biased to report response-dependent consequences unless that response was consistent with locational biases; that is, they behaved "superstitiously" when there was a reason to be biased to do so. These findings corroborate Killeen's and demonstrate that behavior may deviate from contingencies not necessarily because subjects cannot discriminate those contingencies but because they are biased to behave otherwise., (© 2023 The Authors. Journal of the Experimental Analysis of Behavior published by Wiley Periodicals LLC on behalf of Society for the Experimental Analysis of Behavior.)

Stimulus overselectivity describes strong control by one stimulus element at the expense of other equally relevant elements. Research suggests that control by underselected stimuli emerges following extinction of the overselected stimulus ("revaluation") and the emergence is larger when overselectivity is greater. We compared such revaluation effects with a control compound or condition in two experiments. Human participants chose between compound S+ and S- stimuli. Then, to assess control by compound-stimulus elements, participants chose between individual elements in a testing phase without feedback. The S+ element chosen most often (the overselected element) underwent revaluation, during which choice of that element was extinguished and choice of a novel element reinforced. Thereafter, participants completed a retesting phase. Revaluation reduced choice of the overselected element. Choice of the underselected element decreased for participants with low overselectivity but increased for participants with high overselectivity. This was not the case for a control compound that did not undergo revaluation (Experiments 1 and 2) or in a control condition in which the overselected element continued to be reinforced during revaluation (Experiment 2). These findings suggest that overselectivity levels may modulate revaluation effects, and they also highlight the importance of the contingency change in postrevaluation changes in stimulus control., (© 2023 The Authors. Journal of the Experimental Analysis of Behavior published by Wiley Periodicals LLC on behalf of Society for the Experimental Analysis of Behavior.)

When short-term memory is assessed in the delayed matching-to-sample (DMTS) procedure, performance is better when cues signal larger reinforcer magnitudes or higher reinforcer probabilities for correct responding. Previous studies demonstrating signaled-magnitude or signaled-probability effects presented cues for a prolonged period during the sample stimulus and/or retention interval. The present study asked whether a signaled-probability effect would occur with brief post-sample cues that signaled the presence or absence of reinforcement. Five pigeons responded in a DMTS task in which sample stimuli were sometimes followed by a 0.5-s cue signaling that reinforcers would either be available or not available in the current trial, and the retention interval varied from 0.5 s to 20 s. A reliable signaled-probability effect was found when reinforcers were arranged independently and for all correct responses, whereas a smaller, less systematic effect was found when reinforcers were arranged dependently and probabilistically. These findings highlight the importance of reinforcement contingencies and contingency discriminability in remembering, and add to the evidence showing that cues signaling differential reinforcement in DMTS may affect processes during the retention interval and comparison phase, rather than attention to the sample stimulus., (Copyright © 2022 Elsevier B.V. All rights reserved.)

Indiscriminate voiding of excreta by cattle contributes to greenhouse gas (GHG) emissions and soil and water contamination 1 , 2 . Emissions are higher in animal-friendly husbandry offering cattle more space 2 - a trade-off we call the 'climate killer conundrum'. Voiding in a specific location (latrine) would help resolve this dilemma by allowing ready capture and treatment of excreta under more spacious farming conditions. For urination, toileting requires self-control and coordination of a complex chain of behaviors including awareness of bladder fullness, overriding of excretory reflexes, selection of a latrine and intentional relaxation of the external urethral sphincter 3 . Attempts to train toileting in cattle have so far been only partly successful 4-6 , even though their excretion and associated neurophysiological control are similar to those in species capable of toileting 3 . Similarly, very young infants have been considered incapable of self-initiated voiding, but they can be taught with extensive training 7 . Using a backward chaining, reward-based training procedure, we here show that cattle can control their micturition reflex and use a latrine for urination. Such self-control provides evidence that animals can learn to respond to and reveal internal experiences via appropriately trained operant behaviors, thereby providing another way to explore their subjective states., (Copyright © 2021 The Author(s). Published by Elsevier Inc. All rights reserved.)

Untrained cattle do not defecate or urinate in defined locations. The toilet training of cattle would allow urine and faeces to be separated and stored, reducing climate-damaging emissions and improving animal health. In a proof-of-concept study, we evaluated a novel protocol for toilet training in cattle. Five heifer calves (and yoked controls) were trained in the voluntary (operant) behaviours of a toileting chain. Then, reflexive urinating responses were incorporated into the chain, with toileting signalled by a tactile (vibratory) stimulus. On 95% of occasions, the calves inhibited/interrupted urination when receiving the stimulus, and on 65% of these occasions, reinitiated urination in the latrine. Furthermore, during 63% of urinations in the latrine, the calves oriented to the reward location before any food was delivered, providing additional evidence that calves can be successfully toilet trained with food rewards. Yoked controls failed to learn most of the operant elements and all the reflexive responses of toilet training. The results show that reflexive behaviours can be incorporated into voluntary toileting sequences with cattle and extend the range of species that can be toilet trained. Future refinement of the protocol to allow training under practical farm conditions offers the potential to mitigate climate damage and improve animal health.

Typically, cattle urinate and defecate with little or no control over time and place. The resulting excreta contributes to a range of adverse effects on the environment and the animals themselves. These adverse effects could be substantially ameliorated if livestock could be toilet trained. Toilet training requires an animal to suppress impending voiding (a reflexive-like behavior), move to a latrine (voluntary behavior) and reinitiate voiding. Here, we review the neurophysiological processes and learning mechanisms regulating toileting. The suppression and initiation of voiding occur primarily via the coordinated activity of smooth and striated anal and urinary sphincter muscles. The autonomic and somatic nervous systems, along with central processes, regulate these muscles. In several mammalian species, voluntary control of the sphincters has been demonstrated using classical and/or operant conditioning. In this review, we demonstrate that the neurophysiological and behavioral regulation of voiding in cattle is likely to be similarly conditionable. The management of excreta deposition in cattle could have major benefits for reducing livestock greenhouse gas emissions and improving animal health/welfare., (Copyright © 2020 The Author(s). Published by Elsevier Ltd.. All rights reserved.)

When reinforcer availability on one alternative of a concurrent schedule is signaled by a discriminative stimulus, responding on that alternative decreases. We investigated how the correlation between signal presentation and reinforcement (signal reliability) affects choice between signaled and unsignaled alternatives. Six pigeons responded in a concurrent schedule, in which reinforcers on one alternative were signaled by a key-color change. Across conditions, the probability of reinforcement following signal presentation varied (the probability in its absence was the complement). As signal reliability increased, response rates and latencies following signal onset on the signaled alternative decreased, whereas responding on the unsignaled alternative remained unchanged. Because the signal did not alter overall reinforcer rates, these findings are consistent with matching theories and research suggesting that responding on one alternative of a concurrent schedule depends on reinforcer, but not response, rates on other alternatives. However, these findings are inconsistent with others demonstrating concomitant changes in responding on signaled and unsignaled alternatives. We consider whether a response-competition account of concurrent performance can explain these discrepancies, and suggest avenues for future studies to investigate the mechanisms underlying effects of signaled reinforcement in concurrent schedules., (Copyright © 2020 Elsevier B.V. All rights reserved.)

Previous research suggests that when multiple stimuli signal the location of future reinforcers, the extent of control by each stimulus depends on the relative reinforcer probability associated with that stimulus. In this experiment, we asked whether relative reinforcer probabilities also divide control between stimuli that signal the time to future reinforcers. Six pigeons responded in a multiple peak procedure in which 2 dimensions of a compound stimulus-a color (red or green) and a frequency of on/off alternation (fast or slow)-signaled a fixed-interval 2- or 8-s schedule. Across conditions, we varied the probability of reinforcer deliveries associated with each dimension from .1 to .9. Relative reinforcer probabilities determined the degree of control by each stimulus dimension; as the probability of reinforcer deliveries associated with one dimension increased, a peak in response rates at the time signaled by that dimension became apparent while a peak at the time signaled by the other dimension diminished. However, these effects of relative reinforcers were smaller than in previous research, probably because elapsed time also competed for control over behavior. These findings extend the relation between relative reinforcers and divided stimulus control from spatial to temporal discriminations. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

It is widely assumed that reinforcers are biologically relevant stimuli, or stimuli that have been associated with biologically relevant stimuli. However, brief, arbitrary stimuli have also been reported to have reinforcement-like effects, despite being unrelated to biologically relevant stimuli like food. The present study explored the potential reinforcement-like effects of brief stimuli across 5 experiments. In Experiments 1 through 4, pigeon subjects responded for food reinforcement and brief stimulus presentations in a 2-component multiple schedule. Neither baseline response rates nor resistance to change during disruption tests were systematically greater in a component with versus without brief stimulus presentations. Increasing the rate and duration of brief stimulus presentations in Experiment 4 did not reveal reinforcement-like effects when compared directly with food. In Experiment 5, pigeons chose between independent terminal links in a concurrent-chains procedure. Across conditions, varying the location, duration, and rate of brief stimulus presentations in the terminal links had no systematic effects on preference. In contrast, varying rates of food reinforcers resulted in large and reliable shifts in preference. Therefore, the present study found no systematic evidence that brief stimuli unrelated to food reliably increase response rates, resistance to change, or preference. These data demonstrate the value of systematic replication, and a behavioral momentum approach to assessing potential reinforcement-like effects., (© 2020 Society for the Experimental Analysis of Behavior.)

Previous research suggests that organisms allocate more attention to stimuli associated with higher reinforcer rates. This finding has been replicated several times when stimuli are trained together as compounds, but not in other procedures. Thus, the generality of the relation between relative reinforcer rates and divided attention is not well established. Therefore, we investigated whether relative reinforcer rates determine attention allocation when stimuli are trained separately and then encountered together. Pigeons learned to associate two colors and two frequencies of key light on/off alternation with a left or right comparison key in a symbolic 0-s delayed matching-to-sample task. Across conditions, we varied the probability of reinforcement associated with each stimulus dimension during training. After training, we introduced test trials in which a color and flash-frequency stimulus were presented simultaneously. During sample-stimulus presentation in test trials, all pigeons preferred the stimulus associated with the higher reinforcer rate, suggesting that more attention was allocated to that stimulus. Interestingly, such attention allocation did not result in preference for the comparison that matched that stimulus. Instead, all pigeons preferred the comparison that was physically closer to the stimulus associated with the higher reinforcer rate, suggesting that comparison choice was controlled by the location of that stimulus. Nevertheless, overall, our results provide the first evidence that relative reinforcer rates determine divided attention between separately trained stimuli and thus demonstrate the generality of the relation between relative reinforcement and attention allocation. We suggest several avenues for future research to establish further the generality of this relation.

We present a systematic review and a meta-analysis comparing the differential outcomes procedure to a nondifferential outcomes procedure among clinical and nonclinical populations. Sixty distinct experiments were included in the systematic review, 43 of which were included in the meta-analysis. We calculated pooled effect sizes for accuracy (overall accuracy, test accuracy, transfer accuracy) and acquisition outcomes (latency, errors, and trials to mastery). The meta-analysis revealed significant medium-to-large effect sizes for all three accuracy measures (pooled effect size range, 0.57 to 1.30). We found relatively greater effect sizes among clinical populations (effect size = 1.04). The single-subject experimental literature included in the systematic review was consistent with the findings from the group studies, demonstrating improvements in accuracy and speed of learning for the majority of participants. Moderator and subgroup analyses suggest that discrimination difficulty may induce relatively larger differential outcomes effects. The results indicate that the differential outcomes procedure can be a valuable addition to reinforcement-based interventions., (© 2019 Society for the Experimental Analysis of Behavior.)

We advocate for rank-permutation tests as the best choice for null-hypothesis significance testing of behavioral data, because these tests require neither distributional assumptions about the populations from which our data were drawn nor the measurement assumption that our data are measured on an interval scale. We provide an algorithm that enables exact-probability versions of such tests without recourse to either large-sample approximation or resampling approaches. We particularly consider a rank-permutation test for monotonic trend, and provide an extension of this test that allows unequal number of data points, or observations, for each subject. We provide an extended table of critical values of the test statistic for this test, and both a spreadsheet implementation and an Oracle® Java Web Start application to generate other critical values at https://sites.google.com/a/eastbayspecialists.co.nz/rank-permutation/., (© 2019 Society for the Experimental Analysis of Behavior.)

We introduce to behavior analysis a way of analyzing choice behavior that exploits recent developments in nanoeconomics, financial economics, and econometrics. A response return, modeled on an economic return, is the log differenced count of responses allocated to each of two alternatives during a short time window, compared with that in the immediately preceding window. The response return is a new dependent variable which offers a novel and useful way of looking at operant behavior, especially at the molecular level of analysis. The response-return series is a near-instantaneous measure of an organism's dynamic preferences for each of two alternatives. Analyzing such a series requires time-analytic techniques, including Auto-Regressive Conditional Heteroskedastic (ARCH) models. We illustrate these techniques by analyzing choices between combinations of arithmetic and exponential variable-interval schedules with pigeon subjects. All response-return series were well-fitted by one of three ARCH-family models. The fitted models were differentially sensitive to transition versus steady-state data samples. The particular insights that the ARCH analyses offer are improved understanding of the effects of the instantaneous effects of reinforcers and their absence, of how the distribution of reinforcers in time affects choice, and of the differences between choice in transition and at steady state., (© 2019 Society for the Experimental Analysis of Behavior.)

Stimulus generalization is typically assessed by analyzing overall response rates. Studies of generalization of response-rate patterns across time are less common, despite the ubiquitous nature of time and the strong temporal control over behavior in the natural world. Thus, we investigated generalization of response-rate patterns across time using a multiple peak procedure in pigeons. The frequency (fast or slow) at which the color of a keylight changed signaled a fixed-interval (FI) 5-s or 20-s schedule, counterbalanced across subjects. In peak trials, the frequency of keylight-color changes was varied. For the fast and slow training stimuli, response rates in peak trials were controlled by the arranged FI schedule value; they increased as the arranged reinforcer time approached, and decreased thereafter. Response-rate patterns to all test stimuli were similar to response-rate patterns to the slow training stimulus for all subjects. Thus, overall, strong generalization from the slow training stimulus to all test stimuli was evident, whereas there was little to no generalization from the fast training stimulus. These findings extend past research examining generalization of temporally controlled response-rate patterns, and provide a useful starting point for future investigations of generalization of fixed-interval responding. A thorough understanding of generalization processes requires analysis of dependent variables other than overall response rates, especially when responding is likely to be temporally controlled., (Copyright © 2018 Elsevier B.V. All rights reserved.)

Several studies suggest that the degree of control by reinforcer ratios (environment tracking) and by exteroceptive stimuli that signal future reinforcer availability (signal following) depends on environmental certainty: As reinforcers become more likely at one location, environmental contingencies exert stronger control and exteroceptive stimuli exert weaker control. This research has not yet been extended to environments in which reinforcer availability changes across time, even though such changes are present in most natural environments. Thus, in the present experiment, we examined environment tracking and signal following in a concurrent schedule in which the reinforcer ratio reversed to its reciprocal 30 s after a reinforcer delivery and keylight-color stimuli signaled the likely or definite time or location of the next reinforcer. Across conditions, we manipulated environmental certainty by varying the probability of reinforcer deliveries on the locally richer key. This made the location of future reinforcers at a particular time more or less certain, but did not change the overall reinforcer ratio. Changes in local environmental certainty had little to no effect on environment tracking and signal following; in all conditions, keylight-color stimuli strongly controlled choice and reinforcer ratios exerted weak control. The present findings suggest that the extent of environment tracking and signal following is primarily determined by global, not local, environmental certainty., (Copyright © 2018 Elsevier B.V. All rights reserved.)

From a model that generates event records, we may generate predictions for any dependent variable computable from those event records. In the present paper, we examined an implementation of Shimp's (1978) Associative Learner for two-alternative concurrent variable-interval variable-interval schedules in transition. In general, our Associative Learner implementation had difficulty accounting for the inter-response times as a function of the reinforcer ratio, the general frequency of inter-response times, the acquisition of consecutive reinforcers from the same alternative, and the response rates to the not-just-reinforced alternative after a reinforcer. An extended Associative Learner implementation was designed with provisions for increasing responding to the just-reinforced alternative after a reinforcer and organising bout-like responses. The extended implementation rectified many of the weaknesses of the base implementation., (Copyright © 2018 Elsevier B.V. All rights reserved.)

A multivariate analysis is concerned with more than one dependent variable simultaneously. Models that generate event records have a privileged status in a multivariate analysis. From a model that generates event records, we may compute predictions for any dependent variable associated with those event records. However, because of the generality that is afforded to us by these kinds of models, we must carefully consider the selection of dependent variables. Thus, we present a conditional compromise heuristic for the selection of dependent variables from a large group of variables. The heuristic is applied to McDowell's Evolutionary Theory of Behavior Dynamics (ETBD) for fitting to a concurrent variable-interval schedule in-transition dataset. From the parameters obtained from fitting ETBD, we generated predictions for a wide range of dependent variables. Overall, we found that our ETBD implementation accounted well for various flavors of the log response ratio, but had difficulty accounting for the overall response rates and cumulative reinforcer effects. Based on these results, we argue that the predictions of our ETBD implementation could be improved by decreasing the base response probabilities, either by increasing the response latencies or by decreasing the sizes of the operant classes., (© 2018 Society for the Experimental Analysis of Behavior.)

The study and use of punishment in behavioral treatments has been constrained by ethical concerns. However, there remains a need to reduce harmful behavior unable to be reduced by differential-reinforcement procedures. We investigated whether response-contingent presentation of a negative discriminative stimulus previously correlated with an absence of reinforcers would punish behavior maintained by positive reinforcers. Across four conditions, pigeons were trained to discriminate between a positive discriminative stimulus (S+) signaling the presence of food, and a negative discriminative stimulus (S-) signaling the absence of food. Once learned, every five responses on average to the S+ produced S- for a duration of 1.5 s. S+ response rate decreased for a majority of pigeons when responses produced S-, compared to when they did not, or when a neutral control stimulus was presented. In Condition 5, choice between two concurrently presented S+ alternatives shifted away from the alternative producing S-, despite a 1:1 reinforcer ratio. Therefore, presenting contingent S- stimuli punishes operant behavior maintained on simple schedules and in choice situations. Development of negative discriminative stimuli as punishers of operant behavior could provide an effective approach to behavioral treatments for problem behavior and subverting suboptimal choices involved in addictions., (© 2018 Society for the Experimental Analysis of Behavior.)

Organisms that behave so as to forfeit a relatively higher overall rate of reinforcement in favor of a relatively lower rate are said to engage in suboptimal choice. Suboptimal choice has been linked with maladaptive behavior in humans. Melioration theory offers one explanatory framework for suboptimal choice. Melioration theory suggests behavior is controlled by differences in local reinforcer rates between alternatives. Vaughan (1981) arranged two experimental conditions in which maximizing the overall rate of reinforcement required behavior that was compatible, or incompatible, with melioration. Vaughan found pigeons allocated more time to a locally richer alternative even when doing so resulted in suboptimal choice. However, Vaughan did not show whether these effects could systematically reverse and did not provide within-session data to show that choice across short time spans remains under the control of differences in local reinforcer rates. The present study used pigeons to replicate and extend Vaughan's findings. We investigated shifts in overall- and within-session choice across repeated conditions, according to arranged local contingencies. Behavior systematically followed changes in local contingencies for most pigeons. Within-session data suggests that, providing differences in local reinforcer rates are discriminated, pigeons will allocate more time to a locally richer alternative, even if this leads to suboptimal choice. These findings facilitate the more confident use of similar procedures that investigate how melioration contributes to suboptimal choice., (© 2018 Society for the Experimental Analysis of Behavior.)

In concurrent schedules with a changeover delay (COD), choice often strongly favours the just-reinforced alternative immediately after a reinforcer delivery. These 'preference pulses' may be caused by a change in reinforcer availability created by the COD, and/or because the COD decreases the overall probability of switching. We investigated which explanation better accounts for preference pulses by arranging concurrent schedules that allowed us to separate the COD's effects on reinforcer availability from its effects on the probability of switching. When the reinforcer ratio was 1:1, pulses were inconsistently accompanied by changes in reinforcer availability, but consistently accompanied by longer visits. These pulses appeared to be related only to the decreased probability of switching caused by the COD, providing the first evidence of pulses after reinforcers caused by the probability of switching alone. When the reinforcer ratio was 1:5 or 5:1; preference pulses were accompanied by changes in reinforcer availability and by longer visits. These pulses appeared to be related to the COD's effects on reinforcer availability, although a small portion appeared to be related to low probability of switching. These findings suggest that the COD affects preference pulses by both decreasing the probability of switching and creating a change in reinforcer availability., (Copyright © 2018 Elsevier B.V. All rights reserved.)

Models that generate event records have very general scope regarding the dimensions of the target behavior that we measure. From a set of predicted event records, we can generate predictions for any dependent variable that we could compute from the event records of our subjects. In this sense, models that generate event records permit us a freely multivariate analysis. To explore this proposition, we conducted a multivariate examination of Catania's Operant Reserve on single VI schedules in transition using a Markov Chain Monte Carlo scheme for Approximate Bayesian Computation. Although we found systematic deviations between our implementation of Catania's Operant Reserve and our observed data (e.g., mismatches in the shape of the interresponse time distributions), the general approach that we have demonstrated represents an avenue for modelling behavior that transcends the typical constraints of algebraic models., (© 2018 Society for the Experimental Analysis of Behavior.)

Choosing the appropriate response given the circumstance is integral to all aspects of human behavior. One way of elucidating the mechanisms of choice is to relate behavior to neural correlates. Electrophysiological evidence implicates the ERP feedback-negativity (FN) and the P300 as promising neural correlates of reward processing, an integral component of learning. However, prior research has not adequately addressed how the development of a preference to select one option over another (choice preference) relates to the FN and the P300. We assessed whether variation in choice preference predicted the FN and P300 amplitude within subjects. We used a discrete-trials two-alternative choice procedure, where the reinforcer rate for each option was dependently scheduled by a concurrent variable interval. The reinforcer ratio for selecting each option was varied between sessions. Choice was quantified using both the generalized matching law sensitivity and the log odds of staying on the same versus switching to the other alternative (stay preference). The relationship between stay preference, FN, and P300 amplitudes was assessed using the innovative application of hierarchical Bayesian linear regression. The results demonstrate that stay preference was controlled by the reinforcer ratios and credibly predicted the FN amplitude but not P300 amplitude. The findings are consistent with the view that reinforcers may guide behavior by what they signal about future reinforcement, with the FN related to such a process., (© 2017 Society for Psychophysiological Research.)

The extent to which a stimulus exerts control over behavior depends largely on its informativeness. However, when reinforcers have discriminative properties, they often exert less control over behavior than do other less reliable stimuli such as elapsed time. We investigated why less reliable cues in the present often overshadow stimulus control by more reliable cues presented in the recent past, by manipulating the reliability and duration of stimulus presentations. Five pigeons worked on a modified concurrent schedule in which the location of the response that produced the last reinforcer was a discriminative stimulus for the likely time and location of the next reinforcer. In some conditions, either the location of the previous reinforcer, or the location of the next reinforcer, was signaled by a red key light. This stimulus was either Brief, occurring for 10 s starting a fixed time after the most recent reinforcer, or Extended, being present at all times between food deliveries. Brief and Extended stimuli that signaled the same information had a similar effect on choice when they were present, but control by Brief stimuli weakened as time since stimulus offset elapsed. Control was divided among stimuli in the present and recent past according to the apparent reliability of the information signaled about the next reinforcer. More reliable stimuli in the present degraded, but did not erase, control by less reliable stimuli presented in the recent past. Thus, we conclude that less reliable stimuli in the present control behavior to a greater degree than do more reliable stimuli in the recent past because these more reliable stimuli are forgotten, and hence their relation to the likely availability of food cannot be discriminated., (© 2017 Society for the Experimental Analysis of Behavior.)

In concurrent schedules, reinforcers are often followed by a brief period of heightened preference for the just-productive alternative. Such 'preference pulses' may reflect local effects of reinforcers on choice. However, similar pulses may occur after nonreinforced responses, suggesting that pulses after reinforcers are partly unrelated to reinforcer effects. McLean, Grace, Pitts, and Hughes (2014) recommended subtracting preference pulses after responses from preference pulses after reinforcers, to construct residual pulses that represent only reinforcer effects. Thus, a reanalysis of existing choice data is necessary to determine whether changes in choice after reinforcers in previous experiments were actually related to reinforcers. In the present paper, we reanalyzed data from choice experiments in which reinforcers served different functions. We compared local choice, mean visit length, and visit-length distributions after reinforcers and after nonreinforced responses. Our reanalysis demonstrated the utility of McLean et al.'s preference-pulse correction for determining the effects of reinforcers on choice. However, visit analyses revealed that residual pulses may not accurately represent reinforcer effects, and reinforcer effects were clearer in visit analyses than in local-choice analyses. The best way to determine the effects of reinforcers on choice may be to conduct visit analyses in addition to local-choice analyses., (© 2017 Society for the Experimental Analysis of Behavior.)

Catania's Operant Reserve (COR; Catania, 2005) is a computational model of operant behaviour. In COR, responding depletes the reserve while reinforcement replenishes the reserve. The replenishment to the reserve depends on the location of responses within the most recent inter-reinforcement interval. The rule that maps replenishment to the responses within an inter-reinforcement interval is given by a delay-of-reinforcement gradient (DOR). Previous research (Berg and McDowell, 2011) found that non-linear DORs produce sigmoidal response rates on single variable-interval schedules while a linear DOR produces hyperbolic response rates. Berg and McDowell took these sigmoidal response rates as evidence against the viability of COR for modelling variable-interval performance. However, Berg and McDowell did not consider the effect of the slope of each DOR. The present conjecture is that the response rates from COR can be made hyperbolic by manipulating the area under the DOR. Our results show that the manipulation of the area under the DOR allows COR to produce hyperbolic response rates regardless of the parametric form of the DOR. Hence, if COR is to be used to model single variable-interval performance, the reinforcement effect over time should be taken into consideration through the manipulation of the area under the DOR., (Copyright © 2017 Elsevier B.V. All rights reserved.)

The baseline rate of a reinforced target response decreases with the availability of response-independent sources of alternative reinforcement; however, resistance to disruption and relapse increases. Because many behavioral treatments for problem behavior include response-dependent reinforcement of alternative behavior, the present study assessed whether response-dependent alternative reinforcement also decreases baseline response rates but increases resistance to extinction and relapse. We reinforced target responding at equal rates across two components of a multiple schedule with pigeons. We compared resistance to extinction and relapse via reinstatement of (1) a target response trained concurrently with a reinforced alternative response in one component with (2) a target response trained either concurrently or in separate components from the alternative response across conditions. Target response rates trained alone in baseline were higher but resistance to extinction and relapse via reinstatement tests were greater after training concurrently with the alternative response. In another assessment, training target and alternative responding together, but separating them during extinction and reinstatement tests, produced equal resistance to extinction and relapse. Together, these findings are consistent with behavioral momentum theory-operant response-reinforcer relations determined baseline response rates but Pavlovian stimulus-reinforcer relations established during training determined resistance to extinction and relapse. These findings imply that reinforcing alternative behavior to treat problem behavior could initially reduce rates but increase persistence., (© 2016 Society for the Experimental Analysis of Behavior.)

Both the response-reinforcer and stimulus-reinforcer relation are important in discrimination learning; differential responding requires a minimum of two discriminably-different stimuli and two discriminably-different associated contingencies of reinforcement. When elapsed time is a discriminative stimulus for the likely availability of a reinforcer, choice over time may be modeled by an extension of the Davison and Nevin (1999) model that assumes that local choice strictly matches the effective local reinforcer ratio. The effective local reinforcer ratio may differ from the obtained local reinforcer ratio for two reasons: Because the animal inaccurately estimates times associated with obtained reinforcers, and thus incorrectly discriminates the stimulus-reinforcer relation across time; and because of error in discriminating the response-reinforcer relation. In choice-based timing tasks, the two responses are usually highly discriminable, and so the larger contributor to differences between the effective and obtained reinforcer ratio is error in discriminating the stimulus-reinforcer relation. Such error may be modeled either by redistributing the numbers of reinforcers obtained at each time across surrounding times, or by redistributing the ratio of reinforcers obtained at each time in the same way. We assessed the extent to which these two approaches to modeling discrimination of the stimulus-reinforcer relation could account for choice in a range of temporal-discrimination procedures. The version of the model that redistributed numbers of reinforcers accounted for more variance in the data. Further, this version provides an explanation for shifts in the point of subjective equality that occur as a result of changes in the local reinforcer rate. The inclusion of a parameter reflecting error in discriminating the response-reinforcer relation enhanced the ability of each version of the model to describe data. The ability of this class of model to account for a range of data suggests that timing, like other conditional discriminations, is choice under the joint discriminative control of elapsed time and differential reinforcement. Understanding the role of differential reinforcement is therefore critical to understanding control by elapsed time., (Copyright © 2016 Elsevier B.V. All rights reserved.)

Overall reinforcer rate appears to affect choice. The mechanism for such an effect is uncertain, but may relate to reinforcer rate changing the discrimination of the relation between stimuli and reinforcers. We assessed whether a quantitative model based on a stimulus-control approach could be used to account for the effects of overall reinforcer rate on choice under changing time-based contingencies. On a two-key concurrent schedule, the likely availability of a reinforcer reversed when a fixed time had elapsed since the last reinforcer, and the overall reinforcer rate was varied across conditions. Changes in the overall reinforcer rate produced a change in response bias, and some indication of a change in discrimination. These changes in bias and discrimination always occurred quickly, usually within the first session of a condition. The stimulus-control approach provided an excellent account of the data, suggesting that changes in overall reinforcer rate affect choice because they alter the frequency of reinforcers obtained at different times, or in different stimulus contexts, and thus change the discriminated relation between stimuli and reinforcers. These findings support the notion that temporal and spatial discriminations can be understood in terms of discrimination of reinforcers across time and space., (© 2016 Society for the Experimental Analysis of Behavior.)

We investigated why violations to the constant-ratio rule, an assumption of the generalized matching law, occur in procedures that arrange frequent changes to reinforcer ratios. Our investigation produced steady-state data and compared them with data from equivalent, frequently changing procedures. Six pigeons responded in a four-alternative concurrent-schedule experiment with an arranged reinforcer-rate ratio of 27:9:3:1. The same four variable-interval schedules were used in every condition, for 50 sessions, and the physical location of each schedule was changed across conditions. The experiment was a steady-state version of a frequently changing procedure in which the locations of four VI schedules were changed every 10 reinforcers. We found that subjects' responding was consistent with the constant-ratio rule in the steady-state procedure. Additionally, local analyses showed that preference after reinforcement was towards the alternative that was likely to produce the next reinforcer, instead of being towards the just-reinforced alternative as in frequently changing procedures. This suggests that the effect of a reinforcer on preference is fundamentally different in rapidly changing and steady-state environments. Comparing this finding to the existing literature suggests that choice is more influenced by reinforcer-generated signals when the reinforcement contingencies often change., (© Society for the Experimental Analysis of Behavior.)

Deciding on appropriate sampling to obtain representative samples of behavior is important but not straightforward, because the relative duration of the target behavior may affect its observation in a given sampling interval. Work-sampling methods, which offer a way to adjust the frequency of sampling according to a priori or ongoing estimates of the behavior to achieve a preselected level of representativeness, may provide a solution. Full-week observations of 7 behaviors were conducted for 3 students with autism spectrum disorder and intellectual disabilities. Work-sampling methods were used to select momentary time samples from the full time-of-interest, which produced representative samples. However, work sampling required impractically high numbers of time samples to obtain representative samples. More practical momentary time samples produced less representative samples, particularly for low-duration behaviors. The utility and limits of work-sampling methods for applied behavior analysis are discussed., (© Society for the Experimental Analysis of Behavior.)

Objectives: The socio-economic impact from age-related mental decline is escalating. Supplementation of functional foods for sustaining mental health is desirable. We examined the effect of long-term supplementation of complex milk lipid concentrate (CMLc), mixed dairy phospholipids, on memory and associated vascular and neuronal changes in aged rats., Methods: Fisher/Norway Brown rats were used. Two groups of aged rats (24 months) were fed with either gelatin-formulated CMLc or blank gelatin as the control, for 4 months. To determine age-related changes, a young group (5 months) was also fed with blank gelatin. Morris water maze tests were carried out after the supplementation and brain tissues were collected for biological analysis., Results: The aged control rats learnt to locate the platform slower than the young control rats during acquisition trials (*P < 0.05), and made fewer entries to and more initial heading errors from the platform zone during testing trials (*P < 0.05). The CMLc supplementation improved memory by showing the reduced initial heading errors in a delayed probe trial ((#)P < 0.05). We also found that the aged rats with CMLc supplementation improved vascular density, dopamine output, and neuroplasticity ((#)P < 0.05) in the brain regions involved in memory compared with that of the aged control rats., Discussion: The data suggested that the supplementation of CMLc during the early stage of brain aging may prevent memory decline possibly through improving vascular and neuronal function.

When the availability of reinforcers depends on time since an event, time functions as a discriminative stimulus. Behavioral control by elapsed time is generally weak, but may be enhanced by added stimuli that act as additional time markers. The present paper assessed the effect of brief and continuous added stimuli on control by time-based changes in the reinforcer differential, using a procedure in which the local reinforcer ratio reversed at a fixed time after the most recent reinforcer delivery. Local choice was enhanced by the presentation of the brief stimuli, even when the stimulus change signalled only elapsed time, but not the local reinforcer ratio. The effect of the brief stimulus presentations on choice decreased as a function of time since the most recent stimulus change. We compared the ability of several versions of a model of local choice to describe these data. The data were best described by a model which assumed that error in discriminating the local reinforcer ratio arose from imprecise discrimination of reinforcers in both time and space, suggesting that timing behavior is controlled not only by discrimination elapsed time, but by discrimination of the reinforcer differential in time., (© Society for the Experimental Analysis of Behavior.)

The current experiment examined the degree to which locally varying food probabilities on two keys across time since food presentations can continue to control choice until the next food delivery. In two sets of conditions, the probability of food delivery being made available on one key relative to the other key varied sinusoidally across a 1-min period following each food delivery. In Set 1, food-probability changes were unsignaled and the number of cycles per min was varied across conditions. In Set 2, there were always two complete cycles of the sinusoid in the 1-min period, and brief key-color changes were arranged at a selection of fixed times since food delivery to signal portions of the sinusoid. In Set 1, control of choice by local probability of food on each key decreased over time since food delivery. Control by local food probabilities was greater in conditions that arranged fewer cycles per min. The onset of stimulus changes in Set 2 led to a transient reinstatement of local control by food probabilities regardless of the portion of the sinusoidal variation in food probabilities signaled by the stimuli. However, in conditions where the same colored stimuli signaled different portions of the sinusoidal variation in food-delivery probabilities, stimulus changes attenuated joint control by elapsed time and food-probability values. These results suggest that, changing relative food probabilities and stimuli can direct preference toward the likely location of the next food delivery across time since a food presentation, although the degree to which control over choice will be maintained across elapsed time depends on how experimenter-arranged contingencies are mapped onto elapsed time., (© Society for the Experimental Analysis of Behavior.)

Six pigeons worked on concurrent exponential variable-interval schedules in which the relative frequency of food deliveries for responding on the two alternatives reversed at a fixed time after each food delivery. Across conditions, the point of food-ratio reversal was varied from 10 s to 30 s, and the overall reinforcer rate was varied from 1.33 to 4 per minute. The effect of rate of food delivery and food-ratio-reversal time on choice and response rates was small. In all conditions, postfood choice was toward the locally richer key, regardless of the last-food location. Unlike the local food ratio which changed in a stepwise fashion, local choice changed according to a decelerating monotonic function, becoming substantially less extreme than the local food ratio soon after food delivery. This deviation in choice appeared to result from the birds' inaccurate discrimination of the time of food deliveries; local choice was described well by a model that assumed that log response ratios matched food ratios that were redistributed across surrounding time bins with mean time t and a constant coefficient of variation. We suggest that local choice is controlled by the likely availability of food in time, and that choice matches the discriminated log of the ratio of food rates across time since the last food delivery., (© Society for the Experimental Analysis of Behavior.)

Data from five experiments on choice between more than two variable-interval schedules were modeled with different equations for the Law of Effect. Navakatikyan's (2007) component-functions models with three, four and five free parameters were compared with Stevens' (1957), Herrnstein's (1970) and Davison and Hunter's (1976) equations. These latter models are consistent with the generalized-matching principle, whereas Navakatikyan's models are not. Navakatikyan's models performed better or on par with their competitors, especially in predicting residence-time data and generalized-matching sensitivities for time allocation. The models described well an observed decrease, in several of these data sets, in generalized-matching sensitivity between two alternatives when reinforcer rate increased on the other alternatives. Models built on the generalized-matching principle cannot do this. Navakatikyan's models also performed better, though to a lesser extent, than their competitors for data sets that are not obviously inconsistent with generalized matching., (© Society for the Experimental Analysis of Behavior.)

Four pigeons performed a simultaneous matching-to-sample (MTS) task involving two samples and two comparisons that differed in their pixel density and luminance. After a long history of reinforcers for correct responses after both samples, 15 conditions arranged either continuous reinforcement of correct responses after Sample 1 and extinction for all responses after Sample 2, or vice versa. The sample after which correct responses were reinforced alternated across successive conditions. The disparity between the samples and the disparity between the comparisons were varied independently across conditions in a quasifactorial design. Contrary to predictions of extant quantitative models, which assume that MTS tasks involve two 3-term contingencies of reinforcement, matching accuracies were not at chance levels in these conditions, comparison-selection ratios differed after the two samples, and effects on matching accuracies of both sample disparity and comparison disparity were observed. These results were, however, consistent with ordinal and sometimes quantitative predictions of Jones' (2003) theory of stimulus and reinforcement effects in MTS tasks. This theory asserts that MTS tasks involve four-term contingencies of reinforcement and that any tendency to select one comparison more often than the other over a set of trials reflects meaningful differences between comparison-discrimination accuracies after the two samples., (© Society for the Experimental Analysis of Behavior.)

Five pigeons were trained in a procedure in which, with a specified probability, food was either available on a fixed-interval schedule on the left key, or on a variable-interval schedule on the right key. In Phase 1, we arranged, with a probability of 0.5, either a left-key fixed-interval schedule or a right-key variable-interval 30s, and varied the value of the fixed-interval schedule from 5s to 50s across 5 conditions. In Phase 2, we arranged either a left-key fixed-interval 20-s schedule or a right-key variable-interval 30-s schedule, and varied the probability of the fixed-interval schedule from 0.05 to 1.0 across 8 conditions. Phase 3 always arranged a fixed-interval schedule on the left key, and its value was varied over the same range as in Phase 1. In Phase 1, overall preference was generally toward the variable-interval schedule, preference following reinforcers was initially toward the variable-interval schedule, and maximum preference for the fixed-interval schedule generally occurred close to the arranged fixed-interval time, becoming relatively constant thereafter. In Phase 2, overall left-key preference followed the probability of the fixed-interval schedule, and maximum fixed-interval choice again occurred close to the fixed-interval time, except when the fixed-interval probability was 0.1 or less. The pattern of choice following reinforcers was similar to that in Phase 1, but the peak fixed-interval choice became more peaked with higher probabilities of the fixed interval. Phase 3 produced typical fixed-interval schedule responding. The results are discussed in terms of reinforcement effects, timing in the context of alternative reinforcers, and generalized matching. These results can be described by a quantitative model in which reinforcer rates obtained at times since the last reinforcer are distributed across time according to a Gaussian distribution with constant coefficient of variation before the fixed-interval schedule time, changing to extended choice controlled by extended reinforcer ratios beyond the fixed-interval time. The same model provides a good description of response rates on single fixed-interval schedules., (Copyright © 2013 Elsevier B.V. All rights reserved.)

Reinforcing an alternative response in the same context as a target response reduces the rate of occurrence but increases the persistence of that target response. Applied researchers who use such techniques to decrease the rate of a target problem behavior risk inadvertently increasing the persistence of the same problem behavior. Behavioral momentum theory asserts that the increased persistence is a function of the alternative reinforcement enhancing the Pavlovian relation between the target stimulus context and reinforcement. A method showing promise for reducing the persistence-enhancing effects of alternative reinforcement is to train the alternative response in a separate stimulus context before combining with the target stimulus in extinction. The present study replicated previous findings using pigeons by showing that combining an "alternative" richer VI schedule (96 reinforcers/hr) with a "target" leaner VI schedule (24 reinforcers/hr) reduced resistance to extinction of target responding compared with concurrent training of the alternative and target responses (totaling 120 reinforcers/hr). We also found less relapse with a reinstatement procedure following extinction with separate-context training, supporting previous findings that training conditions similarly influence both resistance to extinction and relapse. Finally, combining the alternative stimulus context was less disruptive to target responding previously trained in the concurrent schedule, relative to combining with the target response trained alone. Overall, the present findings suggest the technique of combining stimulus contexts associated with alternative responses with those associated with target responses disrupts target responding. Furthermore, the effectiveness of this disruption is a function of training context of reinforcement for target responding, consistent with assertions of behavioral momentum theory.

The aim of our study was to investigate whether citronella-spray collars offer a humane alternative to electric-shock collars to reduce the barking of domestic dogs. The Aboistop collar was applied to seven dogs with problematic barking behaviour by the dogs' owners in a series of case studies concurrently run. Vocalisation of the dogs was recorded in the problem context under baseline conditions, inactive collar conditions, and active collar conditions. The Aboistop collar was effective at reducing problem vocalization for only three of seven dogs and appeared to be most effective for dogs whose problem barking had developed more recently. The collar may be more humane than other punishment methods, but it did produce stress reactions which varied in severity across the dogs. Clinical Relevance. In our study, the collar was applied by the dogs' owners in order to test whether the collar would be effective when used by members of the public. While the results here are preliminary, they suggest that the collar may be effective for some dogs, but not for others, when applied by dog owners for the treatment of problem vocalisation. Further research is required to determine whether the collar could be effective when administered by a trained professional.

Reinforcers may increase operant responding via a response-strengthening mechanism whereby the probability of the preceding response increases, or via some discriminative process whereby the response more likely to provide subsequent reinforcement becomes, itself, more likely. We tested these two accounts. Six pigeons responded for food reinforcers in a two-alternative switching-key concurrent schedule. Within a session, equal numbers of reinforcers were arranged for responses to each alternative. Those reinforcers strictly alternated between the two alternatives in half the conditions, and were randomly allocated to the alternatives in half the conditions. We also varied, across conditions, the alternative that became available immediately after a reinforcer. Preference after a single reinforcer always favored the immediately available alternative, regardless of the local probability of a reinforcer on that alternative (0 or 1 in the strictly alternating conditions, .5 in the random conditions). Choice then reflected the local reinforcer probabilities, suggesting some discriminative properties of reinforcement. At a more extended level, successive same-alternative reinforcers from an alternative systematically shifted preference towards that alternative, regardless of which alternative was available immediately after a reinforcer. There was no similar shift when successive reinforcers came from alternating sources. These more temporally extended results may suggest a strengthening function of reinforcement, or an enhanced ability to respond appropriately to "win-stay" contingencies over "win-shift" contingencies.

It has long been understood that food deliveries may act as signals of future food location, and not only as strengtheners of prefood responding as the law of effect suggests. Recent research has taken this idea further--the main effect of food deliveries, or other "reinforcers", may be signaling rather than strengthening. The present experiment investigated the ability of food deliveries to signal food contingencies across time after food. In Phase 1, the next food delivery was always equally likely to be arranged for a left- or a right-key response. Conditions were arranged such that the next food delivery was likely to occur either sooner on the left (or right) key, or sooner on the just-productive (or not-just-productive) key. In Phase 2, similar contingencies were arranged, but the last-food location was signaled by a red keylight. Preference, measured in 2-s bins across interfood intervals, was jointly controlled by the likely time and location of the next food delivery. In Phase 1, when any food delivery signaled a likely sooner next food delivery on a particular key, postfood preference was strongly toward that key, and moved toward the other key across the interreinforcer interval. In other conditions in which food delivery on the two keys signaled different subsequent contingencies, postfood preference was less extreme, and quickly moved toward indifference. In Phase 2, in all three conditions, initial preference was strongly toward the likely-sooner food key, and moved to the other key across the interfood interval. In both phases, at a more extended level of analysis, sequences of same-key food deliveries caused a small increase in preference for the just-productive key, suggesting the presence of a "reinforcement effect", albeit one that was very small.

Conditioned reinforcer effects may be due to the stimulus' discriminative rather than its strengthening properties. While this was demonstrated in a frequently-changing choice procedure, a single attempt to replicate in a relatively static choice environment failed. We contend that this was because the information provided by the stimuli was nonredundant in the frequently-changing preparation, and redundant in the steady-state arrangement. In the present experiments, 6 pigeons worked in a steady-state concurrent schedule procedure with nonredundant informative stimuli (red keylight illuminations). When a response-contingent red keylight signaled that the next food delivery was more likely on one of the two alternatives, postkeylight choice responding was reliably for that alternative. This effect was enhanced after a history of extended informative red keylight presentation (Experiment 2). These results lend support to recent characterizations of conditioned reinforcer effects as reflective of a discriminative, rather than a reinforcing, property of the stimulus.

We aimed to investigate whether novel stimulus relations would emerge from stimulus correlations when those relations explicitly conflicted with reinforced relations. In a symbolic matching-to-sample task using kanji characters as stimuli, we arranged class-specific incorrect comparison stimuli in each of three classes. After presenting either Ax or Cx stimuli as samples, choices of Bx were reinforced and choices of Gx or Hx were not. Tests for symmetry, and combined symmetry and transitivity, showed the emergence of three 3-member (AxBxCx) stimulus classes in 5 of 5 human participants. Subsequent tests for all possible emergent relations between Ax, Bx, Cx and the class-specific incorrect comparisons Gx and Hx showed that these relations emerged for 4 of 5 the participants after extended overtraining of the baseline relations. These emergent relations must have been based on stimulus-stimulus correlations, and were not properties of the trained discriminated operants, because they required control by relations explicitly extinguished during training. This result supports theoretical accounts of emergent relations that emphasize stimulus correlation over operant contingencies.

New Caledonian crows were presented with Bird and Emery's (2009a) Aesop's fable paradigm, which requires stones to be dropped into a water-filled tube to bring floating food within reach. The crows did not spontaneously use stones as tools, but quickly learned to do so, and to choose objects and materials with functional properties. Some crows discarded both inefficient and non-functional objects before observing their effects on the water level. Interestingly, the crows did not learn to discriminate between functional and non-functional objects and materials when there was an arbitrary, rather than causal, link between object and reward. This finding suggests that the crows' performances were not based on associative learning alone. That is, learning was not guided solely by the covariation rate between stimuli and outcomes or the conditioned reinforcement properties acquired by functional objects. Our results, therefore, show that New Caledonian crows can process causal information not only when it is linked to sticks and stick-like tools but also when it concerns the functional properties of novel types of tool.

Apes, corvids and parrots all show high rates of behavioural innovation in the wild. However, it is unclear whether this innovative behaviour is underpinned by cognition more complex than simple learning mechanisms. To investigate this question we presented New Caledonian crows with a novel three-stage metatool problem. The task involved three distinct stages: (i) obtaining a short stick by pulling up a string, (ii) using the short stick as a metatool to extract a long stick from a toolbox, and finally (iii) using the long stick to extract food from a hole. Crows with previous experience of the behaviours in stages 1-3 linked them into a novel sequence to solve the problem on the first trial. Crows with experience of only using string and tools to access food also successfully solved the problem. This innovative use of established behaviours in novel contexts was not based on resurgence, chaining and conditional reinforcement. Instead, the performance was consistent with the transfer of an abstract, causal rule: 'out-of-reach objects can be accessed using a tool'. This suggests that high innovation rates in the wild may reflect complex cognitive abilities that supplement basic learning mechanisms.

Four pigeons were trained on two-key concurrent variable-interval schedules with no changeover delay. In Phase 1, relative reinforcers on the two alternatives were varied over five conditions from .1 to .9. In Phases 2 and 3, we instituted a molar feedback function between relative choice in an interreinforcer interval and the probability of reinforcers on the two keys ending the next interreinforcer interval. The feedback function was linear, and was negatively sloped so that more extreme choice in an interreinforcer interval made it more likely that a reinforcer would be available on the other key at the end of the next interval. The slope of the feedback function was -1 in Phase 2 and -3 in Phase 3. We varied relative reinforcers in each of these phases by changing the intercept of the feedback function. Little effect of the feedback functions was discernible at the local (interreinforcer interval) level, but choice measured at an extended level across sessions was strongly and significantly decreased by increasing the negative slope of the feedback function.

Four pigeons were trained on a conditional discrimination. The conditional stimuli were compounds of pairs of stimuli from two different dimensions, fast versus slow cycles of red or green stimuli, and short- versus long-duration presentations of these cycles. Across conditions, the probability of reinforcers for correctly responding to each dimension was varied from 0 to 1. Discriminability, measured by log d, for stimuli on a dimension increased as the relative frequency of reinforcers for that dimension increased, replicating the results of Shahan and Podlesnik (2006). Two further conditions showed that discriminability between stimuli on each dimension was unaffected by whether the stimuli on the other dimension varied or were constant. Finally, maximal discriminability was unchanged in a redundant-relevant cues condition in which either of the stimuli comprising a compound signaled the same correct response. Davison and Nevin's (1999) model provided an excellent quantitative account of the effect of relative reinforcer frequency on discriminability, and thus of the way in which divided stimulus control is itself controlled by relative reinforcement.