Search

Pairing discriminative stimuli with unique reinforcers provides an additional cue to correct responding. In the current study, we evaluated the effectiveness of the differential outcomes procedure in teaching novel tacts and facilitating transfer of tacts to novel discriminative stimuli. Four children diagnosed with developmental or intellectual disability were taught a unique pair of related tacts both under a differential outcomes condition and under a nondifferential outcomes condition where the reinforcers were uncorrelated with the sample stimuli. In the former, the different outcomes were two forms of the same reinforcer. Three out of four participants met the mastery criterion sooner under the differential outcomes condition. Two participants also generalized to novel stimuli under the differential outcomes condition. When we tested for the inclusion of the reinforcers in the stimulus class, three participants demonstrated the acquisition of emergent stimulus–outcomes and response–outcomes relations. The study provides support for the use of the differential outcomes procedure as a cost-effective means of enhancing the acquisition of discriminated responses in an applied setting. [ABSTRACT FROM AUTHOR]

Previous research suggests that organisms allocate more attention to stimuli associated with higher reinforcer rates. This finding has been replicated several times when stimuli are trained together as compounds, but not in other procedures. Thus, the generality of the relation between relative reinforcer rates and divided attention is not well established. Therefore, we investigated whether relative reinforcer rates determine attention allocation when stimuli are trained separately and then encountered together. Pigeons learned to associate two colors and two frequencies of key light on/off alternation with a left or right comparison key in a symbolic 0-s delayed matching-to-sample task. Across conditions, we varied the probability of reinforcement associated with each stimulus dimension during training. After training, we introduced test trials in which a color and flash-frequency stimulus were presented simultaneously. During sample-stimulus presentation in test trials, all pigeons preferred the stimulus associated with the higher reinforcer rate, suggesting that more attention was allocated to that stimulus. Interestingly, such attention allocation did not result in preference for the comparison that matched that stimulus. Instead, all pigeons preferred the comparison that was physically closer to the stimulus associated with the higher reinforcer rate, suggesting that comparison choice was controlled by the location of that stimulus. Nevertheless, overall, our results provide the first evidence that relative reinforcer rates determine divided attention between separately trained stimuli and thus demonstrate the generality of the relation between relative reinforcement and attention allocation. We suggest several avenues for future research to establish further the generality of this relation. [ABSTRACT FROM AUTHOR]

We present a systematic review and a meta‐analysis comparing the differential outcomes procedure to a nondifferential outcomes procedure among clinical and nonclinical populations. Sixty distinct experiments were included in the systematic review, 43 of which were included in the meta‐analysis. We calculated pooled effect sizes for accuracy (overall accuracy, test accuracy, transfer accuracy) and acquisition outcomes (latency, errors, and trials to mastery). The meta‐analysis revealed significant medium‐to‐large effect sizes for all three accuracy measures (pooled effect size range, 0.57 to 1.30). We found relatively greater effect sizes among clinical populations (effect size = 1.04). The single‐subject experimental literature included in the systematic review was consistent with the findings from the group studies, demonstrating improvements in accuracy and speed of learning for the majority of participants. Moderator and subgroup analyses suggest that discrimination difficulty may induce relatively larger differential outcomes effects. The results indicate that the differential outcomes procedure can be a valuable addition to reinforcement‐based interventions. [ABSTRACT FROM AUTHOR]

We introduce to behavior analysis a way of analyzing choice behavior that exploits recent developments in nanoeconomics, financial economics, and econometrics. A response return, modeled on an economic return, is the log differenced count of responses allocated to each of two alternatives during a short time window, compared with that in the immediately preceding window. The response return is a new dependent variable which offers a novel and useful way of looking at operant behavior, especially at the molecular level of analysis. The response–return series is a near‐instantaneous measure of an organism's dynamic preferences for each of two alternatives. Analyzing such a series requires time‐analytic techniques, including Auto‐Regressive Conditional Heteroskedastic (ARCH) models. We illustrate these techniques by analyzing choices between combinations of arithmetic and exponential variable‐interval schedules with pigeon subjects. All response–return series were well‐fitted by one of three ARCH‐family models. The fitted models were differentially sensitive to transition versus steady‐state data samples. The particular insights that the ARCH analyses offer are improved understanding of the effects of the instantaneous effects of reinforcers and their absence, of how the distribution of reinforcers in time affects choice, and of the differences between choice in transition and at steady state. [ABSTRACT FROM AUTHOR]

We advocate for rank‐permutation tests as the best choice for null‐hypothesis significance testing of behavioral data, because these tests require neither distributional assumptions about the populations from which our data were drawn nor the measurement assumption that our data are measured on an interval scale. We provide an algorithm that enables exact‐probability versions of such tests without recourse to either large‐sample approximation or resampling approaches. We particularly consider a rank‐permutation test for monotonic trend, and provide an extension of this test that allows unequal number of data points, or observations, for each subject. We provide an extended table of critical values of the test statistic for this test, and both a spreadsheet implementation and an Oracle® Java Web Start application to generate other critical values at https://sites.google.com/a/eastbayspecialists.co.nz/rank-permutation/. [ABSTRACT FROM AUTHOR]

Highlights • Control by stimuli signaling future reinforcer availability is often weaker in more certain environments. • We examined whether this was the case when reinforcer availability changed over time. • Across conditions, we varied the certainty of the next-reinforcer location at a particular time. • Stimuli strongly controlled behavior and environmental contingencies exerted weak control. • Control by stimuli and by the environment may depend on global, not local, environmental certainty. Abstract Several studies suggest that the degree of control by reinforcer ratios (environment tracking) and by exteroceptive stimuli that signal future reinforcer availability (signal following) depends on environmental certainty: As reinforcers become more likely at one location, environmental contingencies exert stronger control and exteroceptive stimuli exert weaker control. This research has not yet been extended to environments in which reinforcer availability changes across time, even though such changes are present in most natural environments. Thus, in the present experiment, we examined environment tracking and signal following in a concurrent schedule in which the reinforcer ratio reversed to its reciprocal 30 s after a reinforcer delivery and keylight-color stimuli signaled the likely or definite time or location of the next reinforcer. Across conditions, we manipulated environmental certainty by varying the probability of reinforcer deliveries on the locally richer key. This made the location of future reinforcers at a particular time more or less certain, but did not change the overall reinforcer ratio. Changes in local environmental certainty had little to no effect on environment tracking and signal following; in all conditions, keylight-color stimuli strongly controlled choice and reinforcer ratios exerted weak control. The present findings suggest that the extent of environment tracking and signal following is primarily determined by global, not local, environmental certainty. [ABSTRACT FROM AUTHOR]

Highlights • We studied stimulus generalization of response patterns in a multiple peak procedure. • Two training stimuli differentially signaled an FI 5-s and FI 20-s schedule. • Response-rate patterns to one training stimulus generalized nearly exclusively. • This research provides a strong starting point for future studies of generalization under FI schedules. • A thorough understanding of generalization under FI schedules requires analyzing a range of dependent variables. Abstract Stimulus generalization is typically assessed by analyzing overall response rates. Studies of generalization of response-rate patterns across time are less common, despite the ubiquitous nature of time and the strong temporal control over behavior in the natural world. Thus, we investigated generalization of response-rate patterns across time using a multiple peak procedure in pigeons. The frequency (fast or slow) at which the color of a keylight changed signaled a fixed-interval (FI) 5-s or 20-s schedule, counterbalanced across subjects. In peak trials, the frequency of keylight-color changes was varied. For the fast and slow training stimuli, response rates in peak trials were controlled by the arranged FI schedule value; they increased as the arranged reinforcer time approached, and decreased thereafter. Response-rate patterns to all test stimuli were similar to response-rate patterns to the slow training stimulus for all subjects. Thus, overall, strong generalization from the slow training stimulus to all test stimuli was evident, whereas there was little to no generalization from the fast training stimulus. These findings extend past research examining generalization of temporally controlled response-rate patterns, and provide a useful starting point for future investigations of generalization of fixed-interval responding. A thorough understanding of generalization processes requires analysis of dependent variables other than overall response rates, especially when responding is likely to be temporally controlled. [ABSTRACT FROM AUTHOR]

A multivariate analysis is concerned with more than one dependent variable simultaneously. Models that generate event records have a privileged status in a multivariate analysis. From a model that generates event records, we may compute predictions for any dependent variable associated with those event records. However, because of the generality that is afforded to us by these kinds of models, we must carefully consider the selection of dependent variables. Thus, we present a conditional compromise heuristic for the selection of dependent variables from a large group of variables. The heuristic is applied to McDowell's Evolutionary Theory of Behavior Dynamics (ETBD) for fitting to a concurrent variable‐interval schedule in‐transition dataset. From the parameters obtained from fitting ETBD, we generated predictions for a wide range of dependent variables. Overall, we found that our ETBD implementation accounted well for various flavors of the log response ratio, but had difficulty accounting for the overall response rates and cumulative reinforcer effects. Based on these results, we argue that the predictions of our ETBD implementation could be improved by decreasing the base response probabilities, either by increasing the response latencies or by decreasing the sizes of the operant classes. [ABSTRACT FROM AUTHOR]

This introduction to a special issue of Learning and Motivation on the topic of nonhuman animal social behavior briefly describes each of the research and review articles comprising it as they relate to several considerations broadly relevant to the study of nonhuman animal social behavior: its definition, the controlling variables of such behavior, methodological issues, and the relation of social behavior principles to general learning principles. The authors of these articles examine such questions as the reinforcement and stimulus control of animal social behavior, behavioral economics of animal social behavior, imitation learning, the nature of social reinforcement and its relation to other types of reinforcement, self-awareness, and neurogenetic variables related to social behavior. Species include rats, mice, monkeys, pigeons, dogs, and primates, and the methods vary from visual observation in natural and laboratory settings to computer-managed contingencies on social behavior of animals in highly controlled laboratory settings. [ABSTRACT FROM AUTHOR]

Treatment integrity is the extent to which interventionists implement treatment procedures as prescribed. The majority of treatment integrity research involving discrete-trial teaching (DTT) reports an overall score summarizing integrity across procedural components. Because DTT is a procedure consisting of multiple steps, practitioners may find it helpful to report integrity data separately for each component (i.e., component integrity). Recent research has found that high levels of overall integrity are not always representative of high integrity for individual treatment components. The purpose of this study was to assess component integrity of DTT programs occurring in the natural environment with a specific emphasis on identifying integrity errors for an error-correction procedure consisting of remedial trials. The results showed that high overall levels of integrity did not correspond to high levels of integrity for the remedial trial portion of the error-correction procedures. We discuss the implications of the results for research and practice. [ABSTRACT FROM AUTHOR]

We investigated the effects of differential and nondifferential reinforcers on divided control by compound‐stimulus dimensions. Six pigeons responded in a delayed matching‐to‐sample procedure in which a blue or yellow sample stimulus flashed on/off at a fast or slow rate, and subjects reported its color or alternation frequency. The dimension to report was unsignaled (Phase 1) or signaled (Phase 2). Correct responses were reinforced with a probability of.70, and the probability of reinforcers for errors varied across conditions. Comparison choice depended on reinforcer ratios for correct and incorrect responding; as the frequency of error reinforcers according to a dimension increased, control (measured by log d) by that dimension decreased and control by the other dimension increased. Davison and Nevin's (1999) model described data when the dimension to report was unsignaled, whereas model fits were poorer when it was signaled, perhaps due to carryover between conditions. We are the first to test this quantitative model of divided control with reinforcers for errors and when the dimension to report is signaled; hence, further research is needed to establish the model's generality. We question whether divided stimulus control is dimensional and suggest it may instead reflect joint control by compound stimuli and reinforcer ratios. [ABSTRACT FROM AUTHOR]

In concurrent schedules, reinforcers are often followed by a brief period of heightened preference for the just-productive alternative. Such 'preference pulses' may reflect local effects of reinforcers on choice. However, similar pulses may occur after nonreinforced responses, suggesting that pulses after reinforcers are partly unrelated to reinforcer effects. McLean, Grace, Pitts, and Hughes (2014) recommended subtracting preference pulses after responses from preference pulses after reinforcers, to construct residual pulses that represent only reinforcer effects. Thus, a reanalysis of existing choice data is necessary to determine whether changes in choice after reinforcers in previous experiments were actually related to reinforcers. In the present paper, we reanalyzed data from choice experiments in which reinforcers served different functions. We compared local choice, mean visit length, and visit-length distributions after reinforcers and after nonreinforced responses. Our reanalysis demonstrated the utility of McLean et al.'s preference-pulse correction for determining the effects of reinforcers on choice. However, visit analyses revealed that residual pulses may not accurately represent reinforcer effects, and reinforcer effects were clearer in visit analyses than in local-choice analyses. The best way to determine the effects of reinforcers on choice may be to conduct visit analyses in addition to local-choice analyses. [ABSTRACT FROM AUTHOR]

Catania’s Operant Reserve (COR; Catania, 2005) is a computational model of operant behaviour. In COR, responding depletes the reserve while reinforcement replenishes the reserve. The replenishment to the reserve depends on the location of responses within the most recent inter-reinforcement interval. The rule that maps replenishment to the responses within an inter-reinforcement interval is given by a delay-of-reinforcement gradient (DOR). Previous research (Berg and McDowell, 2011) found that non-linear DORs produce sigmoidal response rates on single variable-interval schedules while a linear DOR produces hyperbolic response rates. Berg and McDowell took these sigmoidal response rates as evidence against the viability of COR for modelling variable-interval performance. However, Berg and McDowell did not consider the effect of the slope of each DOR. The present conjecture is that the response rates from COR can be made hyperbolic by manipulating the area under the DOR. Our results show that the manipulation of the area under the DOR allows COR to produce hyperbolic response rates regardless of the parametric form of the DOR. Hence, if COR is to be used to model single variable-interval performance, the reinforcement effect over time should be taken into consideration through the manipulation of the area under the DOR. [ABSTRACT FROM AUTHOR]

Organisms may sometimes behave as if a contingency exists between behavior and consequences, even if this is not actually the case. Killeen (1978) suggested that such superstition occurs because of factors that bias subjects to behave "superstitiously" rather than because of failures of discrimination. We systematically replicated Killeen's experiment and compared contingency discrimination between different consequences. Six pigeons responded in a matching‐to‐sample procedure in which a response‐independent or response‐dependent stimulus change, food delivery, or blackout occurred. The pigeons reported whether the consequence was response dependent or response independent by choosing between two side keys. Discrimination was strongest after stimulus changes, weaker after blackouts, and weakest after food deliveries. These differences persisted even after additional training, suggesting asymmetries that may reflect differences in the disruptive effects of different consequences on remembering and/or behavioral mnemonics. Importantly, the pigeons were not biased to report response‐dependent consequences unless that response was consistent with locational biases; that is, they behaved "superstitiously" when there was a reason to be biased to do so. These findings corroborate Killeen's and demonstrate that behavior may deviate from contingencies not necessarily because subjects cannot discriminate those contingencies but because they are biased to behave otherwise. [ABSTRACT FROM AUTHOR]

Six pigeons worked on concurrent exponential variable-interval schedules in which the relative frequency of food deliveries for responding on the two alternatives reversed at a fixed time after each food delivery. Across conditions, the point of food-ratio reversal was varied from 10 s to 30 s, and the overall reinforcer rate was varied from 1.33 to 4 per minute. The effect of rate of food delivery and food-ratio-reversal time on choice and response rates was small. In all conditions, postfood choice was toward the locally richer key, regardless of the last-food location. Unlike the local food ratio which changed in a stepwise fashion, local choice changed according to a decelerating monotonic function, becoming substantially less extreme than the local food ratio soon after food delivery. This deviation in choice appeared to result from the birds' inaccurate discrimination of the time of food deliveries; local choice was described well by a model that assumed that log response ratios matched food ratios that were redistributed across surrounding time bins with mean time t and a constant coefficient of variation. We suggest that local choice is controlled by the likely availability of food in time, and that choice matches the discriminated log of the ratio of food rates across time since the last food delivery. [ABSTRACT FROM AUTHOR]

Four pigeons performed a simultaneous matching-to-sample (MTS) task involving two samples and two comparisons that differed in their pixel density and luminance. After a long history of reinforcers for correct responses after both samples, 15 conditions arranged either continuous reinforcement of correct responses after Sample 1 and extinction for all responses after Sample 2, or vice versa. The sample after which correct responses were reinforced alternated across successive conditions. The disparity between the samples and the disparity between the comparisons were varied independently across conditions in a quasifactorial design. Contrary to predictions of extant quantitative models, which assume that MTS tasks involve two 3-term contingencies of reinforcement, matching accuracies were not at chance levels in these conditions, comparison-selection ratios differed after the two samples, and effects on matching accuracies of both sample disparity and comparison disparity were observed. These results were, however, consistent with ordinal and sometimes quantitative predictions of Jones' (2003) theory of stimulus and reinforcement effects in MTS tasks. This theory asserts that MTS tasks involve four-term contingencies of reinforcement and that any tendency to select one comparison more often than the other over a set of trials reflects meaningful differences between comparison-discrimination accuracies after the two samples. [ABSTRACT FROM AUTHOR]

New Caledonian crows were presented with Bird and Emery's (2009a) Aesop's fable paradigm, which requires stones to be dropped into a water-filled tube to bring floating food within reach. The crows did not spontaneously use stones as tools, but quickly learned to do so, and to choose objects and materials with functional properties. Some crows discarded both inefficient and non-functional objects before observing their effects on the water level. Interestingly, the crows did not learn to discriminate between functional and non-functional objects and materials when there was an arbitrary, rather than causal, link between object and reward. This finding suggests that the crows' performances were not based on associative learning alone. That is, learning was not guided solely by the covariation rate between stimuli and outcomes or the conditioned reinforcement properties acquired by functional objects. Our results, therefore, show that New Caledonian crows can process causal information not only when it is linked to sticks and stick-like tools but also when it concerns the functional properties of novel types of tool. [ABSTRACT FROM AUTHOR]

Four pigeons were trained on two-key concurrent variable-interval schedules with no changeover delay. In Phase 1, relative reinforcers on the two alternatives were varied over five conditions from .1 to .9. In Phases 2 and 3, we instituted a molar feedback function between relative choice in an interreinforcer interval and the probability of reinforcers on the two keys ending the next interreinforcer interval. The feedback function was linear, and was negatively sloped so that more extreme choice in an interreinforcer interval made it more likely that a reinforcer would be available on the other key at the end of the next interval. The slope of the feedback function was 21 in Phase 2 and 23 in Phase 3. We varied relative reinforcers in each of these phases by changing the intercept of the feedback function. Little effect of the feedback functions was discernible at the local (interreinforcer interval) level, but choice measured at an extended level across sessions was strongly and significantly decreased by increasing the negative slope of the feedback function. [ABSTRACT FROM AUTHOR]

Abstract: Six pigeons responded on a four-key concurrent variable-interval schedule in which a 27:9:3:1 distribution of reinforcers between the keys changed every 10 reinforcers. Their behaviour quickly came under the control of this changing four-way reinforcer ratio. However, preference between a pair of keys depended not only on the relative reinforcer rates on those keys, but also on the absolute levels of those rates. This contradicts the constant-ratio rule that underpins the matching approach to choice, but is predicted by a contingency-discriminability model that assumes that organisms may occasionally misattribute reinforcers to a response that did not produce them. Reinforcers produced strong preference pulses, or transient increases in responding on the just-reinforced key. Despite accurate tracking of the reinforcer ratio, reinforcers obtained late in components and from leaner keys still produced strong pulses, suggesting both extended and local control of behaviour. Patterns of switching between keys were graded and similarly controlled by the reinforcer rates on each key. Whether considered in terms of switching, local preference pulses, or extended preference, behaviour was controlled by a rapidly changing four-way reinforcer ratio in a graduated, continuous manner that is unlikely to be explained by a simple heuristic such as fix-and-sample. [Copyright &y& Elsevier]

Abstract: Using data from two conditions of an experiment that arranged response-contingent foods and red keylight illuminations, we compared time-indexed and response-indexed preference pulses. The interpretation of red keylight effects (relative to food effects) differed according to whether time or behaviour was used to index choice in the post-event period: preference after a red keylight was more extreme than after a food in the response pulses while preference after a food was more extreme than after a keylight in the time pulses. This was due to different response latencies following the two events in combination with a tendency for initial preference to decrease as latency increased: responding began sooner after non-foods and responding that began later, after any event, tended towards indifference. Our finding suggests that preference pulses ought to be indexed according to time since the last event delivery, particularly if the response-contingent events may result in systematically different response latencies. [Copyright &y& Elsevier]

Abstract: In the quantitative analysis of behaviour, choice data are most often plotted and analyzed as logarithmic transforms of ratios of responses and of ratios of reinforcers according to the generalized-matching relation, or its derivatives such as conditional-discrimination models. The relation between log choice ratios and log reinforcer ratios has normally been found using ordinary linear regression, which minimizes the sums of the squares of the y deviations from the fitted line. However, linear regression of this type requires that the log choice data be normally distributed, of equal variance for each log reinforcer ratio, and that the x (log reinforcer ratio) measures be fixed with no variance. We argue that, while log transformed choice data may be normally distributed, log reinforcer ratios do have variance, and because these measures derive from a binomial process, log reinforcer ratio distributions will be non-normal and skewed to more extreme values. These effects result in ordinary linear regression systematically underestimating generalized-matching sensitivity values, and in faulty parameter estimates from non-linear regression to assume hyperbolic and exponential decay processes. They also lead to model comparisons, which assume equal normally distributed error around every data point, being incorrect. We describe an alternative approach that can be used if the variance in choice is measured. [Copyright &y& Elsevier]

We investigated the effects of discriminative stimuli on choice in a highly variable environment using a procedure in which multiple two-key concurrent VI VI components changed every 10 reinforcers and were signaled by differential flashes of red and yellow keylights. Across conditions, five pigeons were exposed to a number of different combinations of the following component reinforcer ratios: 27:1, 9:1, 3:1, 1:1, 1:3, 1:9, 1:27. Overall, there was clear control by the component signals in that preference, early in components and particularly before any reinforcers had been delivered, was ordinally related to the signaled reinforcer ratios. In conditions in which only two components arranged unequal reinforcer ratios (e.g., 27:1 and 1:27) with the remaining components arranging 1:1 reinforcer ratios, preference before the first reinforcer in a component showed peak shift in that the most extreme preference did not occur in the unequal reinforcer-ratio components, but in 1:1 components further towards the ends of the stimulus dimension. The contingency-discriminability model (Davison & Nevin, 1999) was fitted to the data and provided an excellent description of the interactions between stimulus and reinforcer effects in a highly variable environment. [ABSTRACT FROM AUTHOR]

Six pigeons responded on pairs of concurrent variable-interval schedules with, in different parts, four different arrangements of alternation between schedules. Following a single switching-key response, alternation was either strict or random, and the alternative presented after a switch (the postswitch alternative) was either signaled by the location of the switching key or unsignaled. Generalized-matching analyses showed little difference in behavior among the different alternation arrangements, except the usual finding of lower sensitivity of response allocation than time allocation was eliminated by arranging random alternation. Patterns of interchangeover times were similar for all arrangements except signaled random alternation. Differences in behavior preceding the different postswitch alternatives were found in the signaled random alternation procedure. Preference was biased towards the color of the signaled postswitch alternative and showed increased sensitivity when the postswitch alternative was to be the one with the higher reinforcer rate. Interchangeover times were substantially shorter when the postswitch alternative was signaled to be different from the current alternative than when it was signaled to be the same. However, when separate reinforcer ratios were calculated for the different postswitch alternatives, those effects were eliminated or greatly reduced. We suggest that, although behavior is indeed influenced by the postswitch alternative, the mechanism is indirect. That is, the distributions of reinforcers between alternatives obtained before each postswitch alternative differ when those alternatives are signaled, and those distributions are discriminated, but the same relations between choice and relative reinforcement hold irrespective of which postswitch alternative is signaled. [ABSTRACT FROM AUTHOR]

Presents a study in which six pigeons were trained on their choice of concurrent variable-interval schedules in which two different travel times between alternatives, 4.5 and 0.5 seconds, were randomly arranged. Finding that dwell times on the alternatives were consistently longer in the presence of the stimulus that signaled the shorter travel time.

Compares the effect of arranging the some-patches-are-empty animal foraging paradigm in a closed economy with the well-established results obtained in open economies. Results indicating increase in patch residence time when travel time increases but is longer than optimal; Consequence of any variance or error in residence times.

Examines the effects of overall reinforcer rate and temporal distribution of reinforcers on concurrent choices of pigeons. Experimental procedure and conditions; Response and time allocation; Sensitivity of bird to reinforcer.

Discusses the results of a study on the effects of food deprivation and session duration in pigeons. Response to food reinforcement on multiple variable-interval schedules in which the total consumption of food was entirely determined by the pigeons' interaction with the schedules.

Highlights • An implementation of Shimp's Associative Learner (AL) was fit to multiple dependent variables from a concurrent VI VI schedule in-transition dataset. • AL also had difficulty accounting for the acquisition of consecutive reinforcers from the same alternative. • AL had difficulty accounting for the inter-response times and responding to the not-just-reinforced alternative. • An extended implementation of AL was proposed, which rectified many of the weaknesses of the previous implementation. Abstract From a model that generates event records, we may generate predictions for any dependent variable computable from those event records. In the present paper, we examined an implementation of Shimp's (1978) Associative Learner for two-alternative concurrent variable-interval variable-interval schedules in transition. In general, our Associative Learner implementation had difficulty accounting for the inter-response times as a function of the reinforcer ratio, the general frequency of inter-response times, the acquisition of consecutive reinforcers from the same alternative, and the response rates to the not-just-reinforced alternative after a reinforcer. An extended Associative Learner implementation was designed with provisions for increasing responding to the just-reinforced alternative after a reinforcer and organising bout-like responses. The extended implementation rectified many of the weaknesses of the base implementation. [ABSTRACT FROM AUTHOR]

Stimulus overselectivity describes strong control by one stimulus element at the expense of other equally relevant elements. Research suggests that control by underselected stimuli emerges following extinction of the overselected stimulus ("revaluation") and the emergence is larger when overselectivity is greater. We compared such revaluation effects with a control compound or condition in two experiments. Human participants chose between compound S+ and S‐ stimuli. Then, to assess control by compound‐stimulus elements, participants chose between individual elements in a testing phase without feedback. The S+ element chosen most often (the overselected element) underwent revaluation, during which choice of that element was extinguished and choice of a novel element reinforced. Thereafter, participants completed a retesting phase. Revaluation reduced choice of the overselected element. Choice of the underselected element decreased for participants with low overselectivity but increased for participants with high overselectivity. This was not the case for a control compound that did not undergo revaluation (Experiments 1 and 2) or in a control condition in which the overselected element continued to be reinforced during revaluation (Experiment 2). These findings suggest that overselectivity levels may modulate revaluation effects, and they also highlight the importance of the contingency change in postrevaluation changes in stimulus control. [ABSTRACT FROM AUTHOR]

The study and use of punishment in behavioral treatments has been constrained by ethical concerns. However, there remains a need to reduce harmful behavior unable to be reduced by differential‐reinforcement procedures. We investigated whether response‐contingent presentation of a negative discriminative stimulus previously correlated with an absence of reinforcers would punish behavior maintained by positive reinforcers. Across four conditions, pigeons were trained to discriminate between a positive discriminative stimulus (S+) signaling the presence of food, and a negative discriminative stimulus (S‐) signaling the absence of food. Once learned, every five responses on average to the S+ produced S‐ for a duration of 1.5 s. S+ response rate decreased for a majority of pigeons when responses produced S‐, compared to when they did not, or when a neutral control stimulus was presented. In Condition 5, choice between two concurrently presented S+ alternatives shifted away from the alternative producing S‐, despite a 1:1 reinforcer ratio. Therefore, presenting contingent S‐ stimuli punishes operant behavior maintained on simple schedules and in choice situations. Development of negative discriminative stimuli as punishers of operant behavior could provide an effective approach to behavioral treatments for problem behavior and subverting suboptimal choices involved in addictions. [ABSTRACT FROM AUTHOR]

Models that generate event records have very general scope regarding the dimensions of the target behavior that we measure. From a set of predicted event records, we can generate predictions for any dependent variable that we could compute from the event records of our subjects. In this sense, models that generate event records permit us a freely multivariate analysis. To explore this proposition, we conducted a multivariate examination of Catania's Operant Reserve on single VI schedules in transition using a Markov Chain Monte Carlo scheme for Approximate Bayesian Computation. Although we found systematic deviations between our implementation of Catania's Operant Reserve and our observed data (e.g., mismatches in the shape of the interresponse time distributions), the general approach that we have demonstrated represents an avenue for modelling behavior that transcends the typical constraints of algebraic models. [ABSTRACT FROM AUTHOR]

Organisms that behave so as to forfeit a relatively higher overall rate of reinforcement in favor of a relatively lower rate are said to engage in suboptimal choice. Suboptimal choice has been linked with maladaptive behavior in humans. Melioration theory offers one explanatory framework for suboptimal choice. Melioration theory suggests behavior is controlled by differences in local reinforcer rates between alternatives. Vaughan (1981) arranged two experimental conditions in which maximizing the overall rate of reinforcement required behavior that was compatible, or incompatible, with melioration. Vaughan found pigeons allocated more time to a locally richer alternative even when doing so resulted in suboptimal choice. However, Vaughan did not show whether these effects could systematically reverse and did not provide within-session data to show that choice across short time spans remains under the control of differences in local reinforcer rates. The present study used pigeons to replicate and extend Vaughan's findings. We investigated shifts in overall- and within-session choice across repeated conditions, according to arranged local contingencies. Behavior systematically followed changes in local contingencies for most pigeons. Within-session data suggests that, providing differences in local reinforcer rates are discriminated, pigeons will allocate more time to a locally richer alternative, even if this leads to suboptimal choice. These findings facilitate the more confident use of similar procedures that investigate how melioration contributes to suboptimal choice. [ABSTRACT FROM AUTHOR]

In concurrent schedules with a changeover delay (COD), choice often strongly favours the just-reinforced alternative immediately after a reinforcer delivery. These ‘preference pulses’ may be caused by a change in reinforcer availability created by the COD, and/or because the COD decreases the overall probability of switching. We investigated which explanation better accounts for preference pulses by arranging concurrent schedules that allowed us to separate the COD’s effects on reinforcer availability from its effects on the probability of switching. When the reinforcer ratio was 1:1, pulses were inconsistently accompanied by changes in reinforcer availability, but consistently accompanied by longer visits. These pulses appeared to be related only to the decreased probability of switching caused by the COD, providing the first evidence of pulses after reinforcers caused by the probability of switching alone. When the reinforcer ratio was 1:5 or 5:1; preference pulses were accompanied by changes in reinforcer availability and by longer visits. These pulses appeared to be related to the COD’s effects on reinforcer availability, although a small portion appeared to be related to low probability of switching. These findings suggest that the COD affects preference pulses by both decreasing the probability of switching and creating a change in reinforcer availability. [ABSTRACT FROM AUTHOR]

Choosing the appropriate response given the circumstance is integral to all aspects of human behavior. One way of elucidating the mechanisms of choice is to relate behavior to neural correlates. Electrophysiological evidence implicates the ERP feedback-negativity (FN) and the P300 as promising neural correlates of reward processing, an integral component of learning. However, prior research has not adequately addressed how the development of a preference to select one option over another (choice preference) relates to the FN and the P300. We assessed whether variation in choice preference predicted the FN and P300 amplitude within subjects. We used a discrete-trials two-alternative choice procedure, where the reinforcer rate for each option was dependently scheduled by a concurrent variable interval. The reinforcer ratio for selecting each option was varied between sessions. Choice was quantified using both the generalized matching law sensitivity and the log odds of staying on the same versus switching to the other alternative (stay preference). The relationship between stay preference, FN, and P300 amplitudes was assessed using the innovative application of hierarchical Bayesian linear regression. The results demonstrate that stay preference was controlled by the reinforcer ratios and credibly predicted the FN amplitude but not P300 amplitude. The findings are consistent with the view that reinforcers may guide behavior by what they signal about future reinforcement, with the FN related to such a process. [ABSTRACT FROM AUTHOR]

The differential outcomes procedure uses reinforcement unique to each alternative in a conditional discrimination, leading to faster and more accurate learning relative to non-differential outcomes procedures. In this study, the differential outcomes procedure was used to teach novel tacts of musical instrument sounds to children with autism. For one set of instruments, response-specific reinforcers were used in combination with social reinforcement. For the other set, reinforcers were provided non-differentially. Two out of three participants showed enhanced learning in the differential outcomes condition, providing some support of the differential outcomes procedures as a useful tool for teaching individuals with autism. Future research into the differential outcomes effect is warranted to identify the procedural and individual factors that predict its effectiveness. [ABSTRACT FROM AUTHOR]

The extent to which a stimulus exerts control over behavior depends largely on its informativeness. However, when reinforcers have discriminative properties, they often exert less control over behavior than do other less reliable stimuli such as elapsed time. We investigated why less reliable cues in the present often overshadow stimulus control by more reliable cues presented in the recent past, by manipulating the reliability and duration of stimulus presentations. Five pigeons worked on a modified concurrent schedule in which the location of the response that produced the last reinforcer was a discriminative stimulus for the likely time and location of the next reinforcer. In some conditions, either the location of the previous reinforcer, or the location of the next reinforcer, was signaled by a red key light. This stimulus was either Brief, occurring for 10 s starting a fixed time after the most recent reinforcer, or Extended, being present at all times between food deliveries. Brief and Extended stimuli that signaled the same information had a similar effect on choice when they were present, but control by Brief stimuli weakened as time since stimulus offset elapsed. Control was divided among stimuli in the present and recent past according to the apparent reliability of the information signaled about the next reinforcer. More reliable stimuli in the present degraded, but did not erase, control by less reliable stimuli presented in the recent past. Thus, we conclude that less reliable stimuli in the present control behavior to a greater degree than do more reliable stimuli in the recent past because these more reliable stimuli are forgotten, and hence their relation to the likely availability of food cannot be discriminated. [ABSTRACT FROM AUTHOR]

The aim of this study was to quantify 1647 aversion training sessions involving 1156 dogs conducted between 1998 and 2007 at Coromandel sites (North Island, New Zealand). The effects of gender, age, social group size, function of dog, breed, number of training sessions and responses to training were explored for evidence of learning differences. The behaviour of dogs presented for up to five further training sessions was analysed for change with repeated exposure. The effect of one-, two- or three-year gaps between training sessions was also investigated. All 1156 dogs displayed avoidance to the training stimuli after the first training session. When presented with the training stimuli at the second training session, 69% of the dogs displayed avoidance, 88% did so at their third training session, 86% at the fourth session and 100% at their fifth session. Where avoidance was not displayed at a repeated training session, the dog underwent aversion training again. Lower levels of avoidance to the training stimuli were seen in older dogs being trained for the first time, dogs from single-dog households, dogs used to hunt pigs, non-sporting breed dogs and dogs that have a three-year gap or longer between sessions. While the majority of dogs avoided the kiwi training stimuli, it is recommended that the ecological translation of the training stimuli be investigated. [ABSTRACT FROM AUTHOR]

New Caledonian crows have demonstrated flexible behaviour when using tools and solving novel problems. However, we do not know whether this flexibility extends to tool manufacture. Here, we show that these crows respond to different tool-using problems by altering the length of the tools that they manufacture; on average, crows made shorter tools for tasks requiring short tools and longer tools for tasks requiring long tools. They continued to do so when they could not simultaneously see the tool-manufacturing material and the apparatus requiring the use of a tool. Despite altering the length of their tools, the crows frequently did not make tools short or long enough to reliably extract the bait, though this may have been due to shortcomings in the task presented to them. Our results demonstrate that these crows have a degree of behavioural flexibility when making tools, which may be used in the wild during foraging. [ABSTRACT FROM AUTHOR]

The baseline rate of a reinforced target response decreases with the availability of response-independent sources of alternative reinforcement; however, resistance to disruption and relapse increases. Because many behavioral treatments for problem behavior include response-dependent reinforcement of alternative behavior, the present study assessed whether response-dependent alternative reinforcement also decreases baseline response rates but increases resistance to extinction and relapse. We reinforced target responding at equal rates across two components of a multiple schedule with pigeons. We compared resistance to extinction and relapse via reinstatement of (1) a target response trained concurrently with a reinforced alternative response in one component with (2) a target response trained either concurrently or in separate components from the alternative response across conditions. Target response rates trained alone in baseline were higher but resistance to extinction and relapse via reinstatement tests were greater after training concurrently with the alternative response. In another assessment, training target and alternative responding together, but separating them during extinction and reinstatement tests, produced equal resistance to extinction and relapse. Together, these findings are consistent with behavioral momentum theory-operant response-reinforcer relations determined baseline response rates but Pavlovian stimulus-reinforcer relations established during training determined resistance to extinction and relapse. These findings imply that reinforcing alternative behavior to treat problem behavior could initially reduce rates but increase persistence. [ABSTRACT FROM AUTHOR]

Both the response-reinforcer and stimulus-reinforcer relation are important in discrimination learning; differential responding requires a minimum of two discriminably-different stimuli and two discriminably-different associated contingencies of reinforcement. When elapsed time is a discriminative stimulus for the likely availability of a reinforcer, choice over time may be modeled by an extension of the Davison and Nevin (1999) model that assumes that local choice strictly matches the effective local reinforcer ratio. The effective local reinforcer ratio may differ from the obtained local reinforcer ratio for two reasons: Because the animal inaccurately estimates times associated with obtained reinforcers, and thus incorrectly discriminates the stimulus-reinforcer relation across time; and because of error in discriminating the response-reinforcer relation. In choice-based timing tasks, the two responses are usually highly discriminable, and so the larger contributor to differences between the effective and obtained reinforcer ratio is error in discriminating the stimulus-reinforcer relation. Such error may be modeled either by redistributing the numbers of reinforcers obtained at each time across surrounding times, or by redistributing the ratio of reinforcers obtained at each time in the same way. We assessed the extent to which these two approaches to modeling discrimination of the stimulus-reinforcer relation could account for choice in a range of temporal-discrimination procedures. The version of the model that redistributed numbers of reinforcers accounted for more variance in the data. Further, this version provides an explanation for shifts in the point of subjective equality that occur as a result of changes in the local reinforcer rate. The inclusion of a parameter reflecting error in discriminating the response-reinforcer relation enhanced the ability of each version of the model to describe data. The ability of this class of model to account for a range of data suggests that timing, like other conditional discriminations, is choice under the joint discriminative control of elapsed time and differential reinforcement. Understanding the role of differential reinforcement is therefore critical to understanding control by elapsed time. [ABSTRACT FROM AUTHOR]

Deciding on appropriate sampling to obtain representative samples of behavior is important but not straightforward, because the relative duration of the target behavior may affect its observation in a given sampling interval. Work-sampling methods, which offer a way to adjust the frequency of sampling according to a priori or ongoing estimates of the behavior to achieve a preselected level of representativeness, may provide a solution. Full-week observations of 7 behaviors were conducted for 3 students with autism spectrum disorder and intellectual disabilities. Work-sampling methods were used to select momentary time samples from the full time-of-interest, which produced representative samples. However, work sampling required impractically high numbers of time samples to obtain representative samples. More practical momentary time samples produced less representative samples, particularly for low-duration behaviors. The utility and limits of worksampling methods for applied behavior analysis are discussed. [ABSTRACT FROM AUTHOR]

When the availability of reinforcers depends on time since an event, time functions as a discriminative stimulus. Behavioral control by elapsed time is generally weak, but may be enhanced by added stimuli that act as additional time markers. The present paper assessed the effect of brief and continuous added stimuli on control by time-based changes in the reinforcer differential, using a procedure in which the local reinforcer ratio reversed at a fixed time after the most recent reinforcer delivery. Local choice was enhanced by the presentation of the brief stimuli, even when the stimulus change signalled only elapsed time, but not the local reinforcer ratio. The effect of the brief stimulus presentations on choice decreased as a function of time since the most recent stimulus change. We compared the ability of several versions of a model of local choice to describe these data. The data were best described by a model which assumed that error in discriminating the local reinforcer ratio arose from imprecise discrimination of reinforcers in both time and space, suggesting that timing behavior is controlled not only by discrimination elapsed time, but by discrimination of the reinforcer differential in time. [ABSTRACT FROM AUTHOR]

The current experiment examined the degree to which locally varying food probabilities on two keys across time since food presentations can continue to control choice until the next food delivery. In two sets of conditions, the probability of food delivery being made available on one key relative to the other key varied sinusoidally across a 1-min period following each food delivery. In Set 1, food-probability changes were unsignaled and the number of cycles per min was varied across conditions. In Set 2, there were always two complete cycles of the sinusoid in the 1-min period, and brief key-color changes were arranged at a selection of fixed times since food delivery to signal portions of the sinusoid. In Set 1, control of choice by local probability of food on each key decreased over time since food delivery. Control by local food probabilities was greater in conditions that arranged fewer cycles per min. The onset of stimulus changes in Set 2 led to a transient reinstatement of local control by food probabilities regardless of the portion of the sinusoidal variation in food probabilities signaled by the stimuli. However, in conditions where the same colored stimuli signaled different portions of the sinusoidal variation in food-delivery probabilities, stimulus changes attenuated joint control by elapsed time and food-probability values. These results suggest that, changing relative food probabilities and stimuli can direct preference toward the likely location of the next food delivery across time since a food presentation, although the degree to which control over choice will be maintained across elapsed time depends on how experimenter-arranged contingencies are mapped onto elapsed time. [ABSTRACT FROM AUTHOR]

Abstract: Five pigeons were trained in a procedure in which, with a specified probability, food was either available on a fixed-interval schedule on the left key, or on a variable-interval schedule on the right key. In Phase 1, we arranged, with a probability of 0.5, either a left-key fixed-interval schedule or a right-key variable-interval 30s, and varied the value of the fixed-interval schedule from 5s to 50s across 5 conditions. In Phase 2, we arranged either a left-key fixed-interval 20-s schedule or a right-key variable-interval 30-s schedule, and varied the probability of the fixed-interval schedule from 0.05 to 1.0 across 8 conditions. Phase 3 always arranged a fixed-interval schedule on the left key, and its value was varied over the same range as in Phase 1. In Phase 1, overall preference was generally toward the variable-interval schedule, preference following reinforcers was initially toward the variable-interval schedule, and maximum preference for the fixed-interval schedule generally occurred close to the arranged fixed-interval time, becoming relatively constant thereafter. In Phase 2, overall left-key preference followed the probability of the fixed-interval schedule, and maximum fixed-interval choice again occurred close to the fixed-interval time, except when the fixed-interval probability was 0.1 or less. The pattern of choice following reinforcers was similar to that in Phase 1, but the peak fixed-interval choice became more peaked with higher probabilities of the fixed interval. Phase 3 produced typical fixed-interval schedule responding. The results are discussed in terms of reinforcement effects, timing in the context of alternative reinforcers, and generalized matching. These results can be described by a quantitative model in which reinforcer rates obtained at times since the last reinforcer are distributed across time according to a Gaussian distribution with constant coefficient of variation before the fixed-interval schedule time, changing to extended choice controlled by extended reinforcer ratios beyond the fixed-interval time. The same model provides a good description of response rates on single fixed-interval schedules. This article is part of a Special Issue entitled: SQAB 2012. [Copyright &y& Elsevier]

Abstract: The evaluation of systematic desensitization to treat separation-related problem behaviours, such as destruction of property, excessive barking, or house-soiling, has tended to rely on single case-studies. Eight dogs exhibiting separation-related behaviour, and their owners, participated in a controlled experiment using a within-subjects design to evaluate the efficacy of a combination of systematic desensitization and counter-conditioning. Treatment produced significant reductions in both the frequency (T(9))=0.0, P =0.008) and the severity (T(9))=0.0, P =0.008) of separation-related behaviours compared to baseline. Six dogs, for which follow-up data were obtained three months after treatment ended, showed almost complete elimination of the problem behaviour. The use of counter-conditioning, and other behavioural advice, did not appear to be related to the success of the treatment, suggesting that systematic desensitization was the critical element. Speed of progress and final success was not related to the consistency with which the owners applied systematic desensitization, indicating that even when owners apply systematic desensitization haphazardly, it can still be successful in treating separation-related behaviour in dogs. [Copyright &y& Elsevier]

Abstract: We describe neuronal density, neuroplasticity and vascular remodelling and their association with spatial memory in young (4–6 months), middle-aged (9–11 months) and aged (18–20 months) rats of both genders. The neuronal density was reduced in the hippocampus of middle-aged and aged rats, particularly in male rats. However the loss of spatial memory investigated using the Morris water maze, T-maze and 8-radial arm maze tests was found only in the aged groups. The data suggested a pre-symptomatic period of pathological brain aging. Surprisingly, the middle-aged groups showed an elevation of glutamate-decarboxylase immunoreactive neurons in the hippocampus and the striatum, an increase of dopamine output in the striatum and enhanced vascular remodelling in the hippocampus when compared with the young and, in some cases, aged groups. Together, the data suggest that the loss of neurons during midlife may stimulate and enhance neuronal plasticity and vascular remodelling. These compensatory responses to initial neuronal degeneration may play a role in delaying impending memory loss during the pre-symptomatic period of pathological brain aging. [Copyright &y& Elsevier]

Sidman's (2000) theory regarding the origin of equivalence relations predicts that a reinforcing stimulus common to distinct equivalence classes must drop out of the equivalence relations. This prediction was tested in the present study by arranging class-specific reinforcers, R1 and R2, following correct responding on the prerequisite conditional discriminations (Ax-Bx, Cx-Bx) for two stimulus classes, A1B1C1 and A2B2C2. A class-common reinforcer, R3, was presented following correct responding on the prerequisite conditional discriminations for a further two stimulus classes, A3B3C3 and A4B4C4. Sidman's theory predicts reinforcer inclusion within Classes 1 and 2 only, given this training arrangement. Experiment 1 tested for the emergence of four equivalence classes and of stimulus-reinforcer and reinforcer-stimulus relations in each class. Four of the 6 subjects demonstrated the reinforcer-based relations in all four equivalence classes, rather than in only those classes with a class-specific reinforcer, as Sidman's theory predicts. One of the remaining 2 subjects showed the reinforcer-based relations in three of the four classes. Experiment 2 extended these findings to document the emergence of interclass matching relations based on the common reinforcer R3, in 5 of 6 subjects, such that a Class 3 sample-occasioned the selection of a Class 4 sample when the Class 3 comparison was absent, and similarly, a Class 4 sample occasioned the selection of a Class 3 comparison when the Class 4 comparison was absent. These interclass relations emerged despite the simultaneous maintenance of Class 3 and 4 baseline conditional discriminations, so that the Class 3 and 4 stimuli and reinforcer simultaneously were, and were not, part of a single larger equivalence class. These data are irreconcilable with Sidman's theory, and question the utility of the application of the equivalence relation in describing derived stimulus relations. [ABSTRACT FROM AUTHOR]

We investigated the effects that sequences of reinforcers obtained from the same response key have on local preference in concurrent variable-interval schedules with pigeons as subjects. With an overall reinforcer rate of one every 27 s, on average, reinforcers were scheduled dependently, and the probability that a reinforcer would be arranged on the same alternative as the previous reinforcer was manipulated. Throughout the experiment, the overall reinforcer ratio was 1:1, but across conditions we varied the average lengths of same-key reinforcer sequences by varying this conditional probability from 0 to 1. Thus, in some conditions, reinforcer locations changed frequently, whereas in others there tended to be very long sequences of same-key reinforcers. Although there was a general tendency to stay at the just-reinforced alternative, this tendency was considerably decreased in conditions where same-key reinforcer sequences were short. Some effects of reinforcers are at least partly to be accounted for by their signaling subsequent reinforcer locations. [ABSTRACT FROM AUTHOR]

Six pigeons were trained in a procedure in which sessions included seven unsignaled components, each offering two pecking keys, and each providing a potentially different reinforcer ratio between the two keys. Across conditions, various combinations of reinforcer ratios and reinforcer-magnitude ratios were used to create unequal reinforcer distributions between the two alternatives when averaged across a session. The results extended previous research using the same basic procedure that had included only reinforcer distributions symmetrical around 1:1. Data analyses suggested that the variables controlling choice operated at a number of levels: First, individual reinforcers had local effects on choice; second, sequences of successive reinforcers obtained at the same alternative (continuations) had cumulative effects; and, third, when these sequences themselves occurred with greater frequency, their effects further cumulated. A reinforcer obtained at the other alternative following a sequence of continuations (a discontinuation) had a large effect and apparently reset choice to levels approximating the sessional reinforcer ratio. [ABSTRACT FROM AUTHOR]