Search

Resurgence is defined as an increase in a previously extinguished target response (B 1 ) resulting from the worsening of conditions for a more recently reinforced alternative response (B 2 ). Worsening includes extinction or reductions in rate, amount, and immediacy of delivery of food or some other phylogenetically important event (PIE). In the first part of the article, we apply the laws of allocation, induction, and covariance to understand not only resurgence of operant activity previously covarying with the PIE (B 1 ) but also a constellation of ontogenetic and phylogenetic activities both related to the PIE (B 0 ) and unrelated to the PIE (B N ). In the second part, we discuss how induction might be incorporated into and provide alternative processes within an existing matching-based framework, resurgence as choice (RaC). We begin to identify how this range of activities could depend on changes in the relative competitive weight (V) of all available activities (B 1 , B 2 , B 0 , B N ) in addition to only those receiving explicit training (B 1 , B 2 ). Future empirical and theoretical research is needed within this framework to provide a more complete understanding of resurgence and behavior more generally., (© 2024 Society for the Experimental Analysis of Behavior.)

Resurgence can be defined as increases in previously reinforced and subsequently extinguished target responding when conditions for an alternative response worsen. Worsening of alternative conditions, such as extinction, has been linked to relapse of clinically relevant behavior. Preclinical researchers have evaluated whether punishing target responses while differentially reinforcing an alternative response could reduce resurgence when conditions are worsened with extinction, with mixed results. In the present investigation, we systematically replicated this line of research with human participants recruited via crowdsourcing, using response cost as punishment. During Phase 1, we reinforced target responses with 100 points per delivery, exchangeable for money. During Phase 2, we reinforced alternative responses, discontinued point reinforcement for target responses, and parametrically manipulated across groups the magnitude of point loss (1, 100, 320, or 1,000 points) contingent on target responses. During Phase 3, we tested for resurgence by extinguishing target and alternative responses. Added punishment systematically decreased target responding during Phase 2 but did not influence resurgence during Phase 3. With a meta-analysis, we compared our findings with existing research examining a range of punishers and species. The results of the meta-analysis comport with the present findings, suggesting that the inclusion of punishment reduces target responding during DRA but, overall, has no systematic effects on resurgence., (© 2024 Society for the Experimental Analysis of Behavior.)

Competing Interests: Conflicts of InterestNo funding was received to assist with the preparation of this article.

We assessed whether novel praise statements could be used to (a) maintain and increase responses with existing reinforcement histories and (b) teach a previously untaught response among children diagnosed with autism spectrum disorder across two experiments. During response-stimulus pairing, two responses resulted in preferred edibles but only one also produced a praise statement. In the absence of edibles, the response continuing to produce praise tended to persist more. Next, reversing the praise contingency tended to increase the other response. However, in no case did contingent delivery of those same praise statements result in the acquisition of untaught responses. These findings suggest that conditioning praise statements could serve different functions (antecedent or consequence) depending on the reinforcement history for particular responses., (© 2024 Society for the Experimental Analysis of Behavior (SEAB).)

Functional communication training (FCT) is an evidence-based treatment for behavior targeted for reduction that often combines extinction for target responses and arranges functionally equivalent reinforcement for alternative behavior. Long-term effectiveness of FCT can become compromised when transitioning from clinic to nonclinic contexts or thinning reinforcement schedules for appropriate behavior. Such increases in targeted behavior have been conceptualized as renewal and resurgence, respectively. The relation between resurgence and renewal has yet to be reported. Therefore, the present report retrospectively analyzed the relation between renewal and resurgence in data collected when implementing FCT with children diagnosed with developmental disabilities. We found no relation when evaluating all 34 individuals assessed for resurgence and renewal or a subset of individuals exhibiting both resurgence and renewal. These findings suggest that one form of relapse may not be predictive of another form of relapse., (© 2024 Society for the Experimental Analysis of Behavior (SEAB).)

Researchers in social sciences increasingly rely on crowdsourcing marketplaces such as Amazon Mechanical Turk (MTurk) and Prolific to facilitate rapid, low-cost data collection from large samples. However, crowdsourcing suffers from high attrition, threatening the validity of crowdsourced studies. Separate studies have demonstrated that (1) higher pay rates and (2) additional instructions-i.e., informing participants about task requirements, asking for personal information, and describing the negative impact of attrition on research quality-can reduce attrition rates with MTurk participants. The present study extended research on these possible remedies for attrition to Prolific, another crowdsourcing marketplace with strict requirements for participant pay. We randomly assigned 225 participants to one of four groups. Across groups, we evaluated effects of pay rates commensurate with or double the US minimum wage, expanding the upper range of this independent variable; two groups also received additional instructions. Higher pay reduced attrition and correlated with more accurate performance on experimental tasks but we observed no effect of additional instructions. Overall, our findings suggest that effects of increased pay on attrition generalize to higher minimum pay rates and across crowdsourcing platforms. In contrast, effects of additional instructions might not generalize across task durations, task types, or crowdsourcing platforms., Competing Interests: The authors have declared that no competing interests exist., (Copyright: © 2023 Ritchey et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.)

Zebrafish show social behavior such as shoaling and schooling, which is a result of complex and interdependent interactions among conspecifics. Zebrafish social behavior is interdependent in the sense that one fish's behavior affects both conspecific behavior and, as a result, their own behavior. Previous research examined effects of the interdependent interactions on the preference for social stimulus but lacked clear evidence that specific conspecific movements were reinforcing. The present research examined whether dependency between individual experimental fish's motion and a social-stimulus fish's motions contributes to preference for the social stimulus. In Experiment 1, a 3D animated stimulus fish either chased individual experimental fish or was motionless, serving as dependent and independent motions, respectively. In Experiment 2, the stimulus fish either chased experimental fish, moved away, or moved independently of the experimental fish. In both experiments, experimental fish spent more time near the stimulus fish showing dependent and interactive movements, indicating preference for dependent motion over independent motion, and chasing over other motions. Implications of these results are discussed including a potential role of operant conditioning in the preference for social stimuli., (© 2023. The Author(s).)

Resurgence is the increase in a previously reinforced and then extinguished target response due to changes in reinforcement conditions for an alternative response, including reductions in the rate or magnitude of reinforcement for the alternative response. Research with nonhumans suggests that reductions in both alternative-reinforcer rate and magnitude produce resurgence, but the present study was the first to examine effects of downshifts in alternative-reinforcer magnitude on humans' resurgence. Moreover, it was the first to evaluate whether the quantitative framework, resurgence as choice in context (RaC 2 ), could account for those effects. Consistent with predictions of RaC 2 , resurgence of a target button press occurred with reductions in point gain for an alternative response, with greater reductions producing higher levels of resurgence. However, the model consistently underpredicted and then overpredicted resurgence during tests with low-magnitude reinforcement and extinction. Systematic deviations in model predictions of alternative responding were also evident and consistent with previous fits of RaC 2 to nonhuman data. Overall, our findings suggest that RaC 2 could be a useful quantitative theoretical framework for understanding processes contributing to resurgence in humans, but further theoretical development is needed to account for the apparent divergent effects of extinction versus downshifts in reinforcer magnitude., (© 2023 Society for the Experimental Analysis of Behavior.)

Serial reversal-learning procedures are simple preparations that allow for a better understanding of how animals learn about environmental changes, including flexibly shifting responding to adapt to changing reinforcement contingencies. The present study examined serial reversal learning with humans by arranging both midsession and variable contingency reversals across two experiments. We also examined the effects of extinction by adding nonreinforced trials at the end of later sessions and provided the first evaluation of effects of win-stay/lose-shift versus counting strategies on accuracy and response latency of humans' reversal-learning performance. In each experiment, responding tracked contingency reversals, primarily with participants using either win-stay/lose-shift or counting strategies. Introducing variable reversal points in the second experiment resulted in near-exclusive win-stay/lose-shift responding among participants and eliminated counting of trials. Each experiment also revealed an immediate shift from S2 to S1 after experiencing extinction during the initial test trial, indicating resurgence of the initial response through a win-stay/lose-shift response pattern. Therefore, the present study replicates and extends prior findings of a win-stay/lose shift response pattern in situations of greater uncertainty. These findings suggest that differences in environmental certainty induce qualitatively different decision-making strategies., (© 2022. The Psychonomic Society, Inc.)

Resurgence is the return of a previously reinforced response as conditions worsen for an alternative response, such as the introduction of extinction, reductions in reinforcement, or punishment. As a procedure, resurgence has been used to model behavioral treatments and understand behavioral processes contributing both to relapse of problem behavior and flexibility during problem-solving. Identifying existing procedural and analytic methods arranged in basic/preclinical research could be used by basic and preclinical researchers to develop novel approaches to study resurgence, whereas translational and clinical researchers could identify potential approaches to combating relapse during behavioral interventions. Despite the study of resurgence for over half a century, there have been no systematic reviews of the basic/preclinical research on resurgence. To characterize the procedural and analytic methods used in basic/preclinical research on resurgence, we performed a systematic review consistent with PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses). We identified 120 articles consisting of 200 experiments that presented novel empirical research, examined operant behavior, and included standard elements of a resurgence procedure. We reported prevalence and trends in over 60 categories, including participant characteristics (e.g., species, sample size, disability), designs (e.g., single subject, group), procedural characteristics (e.g., responses, reinforcer types, control conditions), criteria defining resurgence (e.g., single test, multiple tests, relative to control), and analytic strategies (e.g., inferential statistics, quantitative analysis, visual inspection). We make some recommendations for future basic, preclinical, and clinical research based on our findings of this expanding literature., Supplementary Information: The online version contains supplementary material available at 10.1007/s40614-022-00361-y., Competing Interests: Conflict of InterestThe authors have no conflicts of interest to declare., (© Association for Behavior Analysis International 2022, Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.)

Resurgence occurs when a previously reinforced and then extinguished target response increases due to a worsening of reinforcement conditions for an alternative response. We conducted four crowdsourcing experiments to evaluate effects of alternative-reinforcer rate and magnitude on resurgence with humans. Contingent on an alternative response, we manipulated across groups either the rate of point delivery (Experiment 1) or number of points delivered per reinforcer (Experiments 2-3). Experiment 4 arranged combinations of high- or low-rate and high- or low-magnitude alternative reinforcement across four groups. When extinguishing alternative responding across experiments, we observed resurgence of target responding with relatively high rates of alternative reinforcement but differences in reinforcer magnitude did not influence resurgence. A quantitative model based on the concatenated matching law, Resurgence as Choice in Context (RaC 2 ), provided a poor fit to the data, generally underpredicted target responding, and could not account for data from control groups experiencing extinction of target responding in the absence of alternative reinforcement. We then fit a modified version of RaC 2 borrowing an assumption from theories of choice that suggest some proportion of reinforcers are misallocated between responses - this modified version of RaC 2 provided a better account of these findings., (Copyright © 2022 Elsevier B.V. All rights reserved.)

Resurgence occurs when a worsening of conditions for an alternative response (e.g., extinction) increases a previously reinforced and subsequently extinguished target response. In contrast, renewal is an increase in a response previously eliminated by extinction following a contextual change. Moreover, arranging contextual changes during resurgence tests has enhanced relapse compared with the absence of contextual changes. Several laboratory studies evaluating resurgence in humans have included interruptions of operant tasks by presenting instructions or "blackouts" immediately prior to phase changes in which reinforcement contingencies change. Such interruptions could enhance relapse during testing similarly to changes in contextual stimuli. We tested this possibility in the present study with human participants recruited via Amazon Mechanical Turk by interrupting the task across groups with 1-s blackouts every 12 s, 60 s, between phases, or by arranging no blackouts in a control group. We found that blackouts prior to phase changes increased resurgence effects relative to no blackouts, suggesting that blackouts between phases are a type of contextual manipulation serving to increase the salience of contingency changes., (Copyright © 2022 Elsevier B.V. All rights reserved.)

Increases in behavior due to context changes are common and are known as instances of renewal. Clinically relevant examples from the literature highlighting renewal often include socially mediated problem behaviors. This report retrospectively analyzed data during context changes for individuals who engaged in problem behavior maintained by automatic reinforcement, to evaluate the prevalence of relapse. Problem behavior reemerged during changes both in the person implementing treatment (e.g., introducing a caregiver; 36%) and in the setting (e.g., introducing treatment in the home; 26%). Most prevalence studies report greatest relapse immediately following context changes but the highest level of relapse was observed after 5 sessions following person changes and no systematic pattern with setting changes. These patterns of relapse likely reflect differences in the function of settings and people relative to automatically reinforced behavior in the present study. Implications of relapse for treatments of problem behavior maintained by automatic reinforcement are discussed., (© 2021 Society for the Experimental Analysis of Behavior (SEAB).)

Laboratory models of relapse provide methods for evaluating challenges to behavioral treatments with differential reinforcement of an alternative response (DRA). Resurgence occurs with the worsening of conditions of reinforcement for appropriate behavior and renewal occurs when transitioning out of a treatment context. Across five experiments, participants recruited via online crowdsourcing pressed onscreen buttons to earn points exchangeable for money and contexts sometimes changed through changes in the background image. Returning to the training context (ABA, Experiment 1) and transitioning to a novel context (ABC, Experiment 2) produced greater resurgence when removing alternative reinforcement in comparison with remaining in the treatment context (ABB). In contrast, we observed little difference in resurgence among AAA, ABB, and AAC context manipulations (Experiment 3) and ABA, ABC, and AAC context manipulations (Experiment 4). In Experiment 5, we evaluated relative contributions of the presence versus absence of context changes (ABA vs. ABB) in combination with or without the removal of alternative reinforcement. Both changing context and removing alternative reinforcement increased responding in isolation and the combination produced greater-than-additive effects. Overall, the present findings demonstrate a consistent effect of removing alternative reinforcement on relapse that, under certain conditions, can be enhanced by context change., (Copyright © 2021 Elsevier B.V. All rights reserved.)

Resurgence occurs when a previously reinforced and then extinguished target response increases due to reducing/eliminating an alternative source of reinforcement or punishing an alternative response. We evaluated whether duration of reinforcement history for a target response (1) affects the degree to which resurgence is observed in humans and (2) produces different gradients of response generalization around target responding during extinction testing. We arranged a novel touchscreen interface in which university students could swipe a 3D soccer ball to spin any direction. In Phase 1, the first direction swiped became the target and produced points exchangeable for money for 3 or 1 min across 2 groups. The first swipe was recorded but had no programmed consequence in a third group. In Phase 2, swipes 180-degrees from the target resulted in points for 3 min in all groups. Point deliveries ceased for 2 min to test for resurgence in Phase 3. Target responses resurged during testing to a relatively greater extent with longer Phase-1 training but gradients of response generalization did not differ among groups. These findings extend prior research on the role of training duration on resurgence. We discuss methodological and conceptual issues surrounding the assessment of response generalization in resurgence., (© 2021 Society for the Experimental Analysis of Behavior.)

Behavioral flexibility has, in part, been defined by choice behavior changing as a function of changes in reinforcer payoffs. We examined whether the generalized matching law quantitatively described changes in choice behavior in zebrafish when relative reinforcer rates, delays/immediacy, and magnitudes changed between two alternatives across conditions. Choice was sensitive to each of the three reinforcer properties. Sensitivity estimates to changes in relative reinforcer rates were greater when 2 variable-interval schedules were arranged independently between alternatives (Experiment 1a) than when a single schedule pseudorandomly arranged reinforcers between alternatives (Experiment 1b). Sensitivity estimates for changes in relative reinforcer immediacy (Experiment 2) and magnitude (Experiment 3) were similar but lower than estimates for reinforcer rates. These differences in sensitivity estimates are consistent with studies examining other species, suggesting flexibility in zebrafish choice behavior in the face of changes in payoff as described by the generalized matching law., (© 2021 Society for the Experimental Analysis of Behavior.)

Nonhuman animal models show that reinforcers control behavior through what they signal about the likelihood of future events, but such control is generally imperfect. Imperfect control by the relation between past and likely future events may result from imperfect detection of those events as they occur, which result in imperfect detection of the relation between events. Such an approach would suggest the involvement of more complex psychological processes like memory in simple operant learning. We extended a research paradigm previously examined with nonhuman animals to test the ability of a quantitative model that assumes imperfect control by the relation between events arises because of (a) occasional misallocation of reinforcers to the wrong response, causing imperfect control by the relation between events; and (b) a tendency to explore or exploit which is independent of the relation between events. Children played a game in which one of two different responses could produce a reinforcer. The likelihood of a reinforcer for the same response that produced the last one varied across three conditions (.1, .5, .9). As with nonhuman animal models, children's choices followed these probabilities closely but not perfectly, suggesting strong control by what one reinforcer signals about subsequent reinforcers. Choice was well described by the quantitative model. This same model also provides a good description of nonhuman animal-model data, suggesting fundamentally similar mechanisms of control across species. These findings suggest reinforcers control behavior to the extent the relation between reinforcers can be detected-that is, simple operant learning may be more complex than is typically assumed. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Amazon Mechanical Turk (MTurk) is a crowdsourcing marketplace providing researchers with the opportunity to collect behavioral data from remote participants at a low cost. Recent research demonstrated reliable extinction effects, as well as renewal and resurgence of button pressing with MTurk participants. To further examine the generality of these findings, we replicated and extended these methods across six experiments arranging reinforcement and extinction of a target button press. In contrast to previous findings, we did not observe as reliable of decreases in button pressing during extinction (1) after training with VR or VI schedules of reinforcement, (2) in the presence or absence of context changes, or (3) with an added response cost for button pressing. However, we found that that a 1-point response cost for all button presses facilitated extinction to a greater extent than the absence of response cost. Nevertheless, we observed ABA renewal of button pressing when changing background contexts across phases and resurgence when extinguishing presses on an alternative button. Our findings suggest that MTurk could be a viable platform from which to ask and address questions about extinction and relapse processes, but further procedural refinements will be necessary to improve the replicability of control by experimental contingencies., Competing Interests: Conflicts of Interest/Competing Interests The authors have no conflicts of interest to declare that are relevant to the content of this article.

We examined the effects of the presence and absence of punishment on the resurgence and renewal of extinguished operant behavior with zebrafish. With resurgence, food deliveries reinforced target responding in Phase 1 was exposed to shock punishment plus extinction (PUN + EXT) versus extinction alone (EXT) while introducing alternative reinforcement in Phase 2. All contingencies were discontinued in Phase 3. With renewal, target reinforcement during Phase 1 occurred in Context A and then during Phase 2 was exposed to either PUN + EXT or EXT in Context B. All contingencies were discontinued in Context A during Phase 3. During Phase 2 for both resurgence and renewal, decreases in target responding were more rapid with PUN + EXT than EXT. During testing in Phase 3, resurgence was less following PUN + EXT than EXT. In contrast, renewal was greater following PUN + EXT than EXT but differences in response rates at the end of Phase 2 complicated the interpretation. We discuss these differences between resurgence and renewal as due to differences in learning about alternative reinforcement (resurgence) versus more general contextual changes (renewal)., Competing Interests: Declaration of Competing Interest None., (Copyright © 2020 Elsevier B.V. All rights reserved.)

Differential reinforcement of other behavior (DRO) is commonly used to decrease problem behavior by presenting reinforcers contingent upon the absence of a target response. Although it is well demonstrated that DROs decrease response rates, the processes producing these decreases are not well understood. The present study systematically replicated previous research assessing whether adventitious reinforcement of alternative behavior contributes to the effectiveness of DRO. We presented university students with two options on a computer and reinforced target responding on a variable-ratio schedule. Next, we compared decreases in target-response rates and any increases in alternative responding during DRO schedules versus yoked variable-time schedules or extinction probes. DRO schedules resulted in the lowest target-response rate and highest alternative-response rate. These findings generally provide some support for the adventitious reinforcement of "other" behavior., (© 2020 Society for the Experimental Analysis of Behavior.)

Differential reinforcement of other behavior (DRO) is a procedure often used to decrease problem behavior, but the processes responsible for behavior reduction are not well understood. This study assessed whether adventitious reinforcement of other behavior contributes to DRO effectiveness when, relative to previous research, DRO exposure is prolonged. Two response options were presented on a computer and target responding was reinforced on a variable-ratio schedule. Response rates were then compared during DRO versus yoked variable-time or extinction probes. Across 2 experiments, DRO decreased target responding and increased other responding more than control conditions. However, increases in other responding did not usually maintain despite target responding remaining at low levels. DRO might adventitiously reinforce other responses transiently but the decreases in target behavior could not be entirely explained by adventitious reinforcement of the other response. Instead, reductions in target responding likely depend on the discriminability of the DRO contingency., (© 2020 Society for the Experimental Analysis of Behavior.)

Resurgence is the reoccurrence of a target response when reinforcement for a more recently reinforced alternative response is eliminated or reduced. The present study arranged two successive three-phase procedures to assess whether resurgence decreases with repeated assessments. Moreover, we arranged a contextual change from the first to second assessment for some groups. Phase 1 reinforced a target response on a touchscreen computer with typically developing adults as participants according to either variable-ratio or variable-interval schedules of reinforcement. Phase 2 extinguished target responding and reinforced alternative responding. Phase 3 tested for resurgence by extinguishing alternative responding. Resurgence reliably occurred in all tests and decreased from the first to second exposure to the procedures but there were no effects of context change. Therefore, repeated exposures to resurgence tests reduced those effects but contextual changes had no effect., (Copyright © 2020 Elsevier B.V. All rights reserved.)

It is widely assumed that reinforcers are biologically relevant stimuli, or stimuli that have been associated with biologically relevant stimuli. However, brief, arbitrary stimuli have also been reported to have reinforcement-like effects, despite being unrelated to biologically relevant stimuli like food. The present study explored the potential reinforcement-like effects of brief stimuli across 5 experiments. In Experiments 1 through 4, pigeon subjects responded for food reinforcement and brief stimulus presentations in a 2-component multiple schedule. Neither baseline response rates nor resistance to change during disruption tests were systematically greater in a component with versus without brief stimulus presentations. Increasing the rate and duration of brief stimulus presentations in Experiment 4 did not reveal reinforcement-like effects when compared directly with food. In Experiment 5, pigeons chose between independent terminal links in a concurrent-chains procedure. Across conditions, varying the location, duration, and rate of brief stimulus presentations in the terminal links had no systematic effects on preference. In contrast, varying rates of food reinforcers resulted in large and reliable shifts in preference. Therefore, the present study found no systematic evidence that brief stimuli unrelated to food reliably increase response rates, resistance to change, or preference. These data demonstrate the value of systematic replication, and a behavioral momentum approach to assessing potential reinforcement-like effects., (© 2020 Society for the Experimental Analysis of Behavior.)

In two laboratory experiments, we examined whether stimuli paired with alternative reinforcers could mitigate resurgence of a previously reinforced target response with pigeons (Experiment 1) and children diagnosed with Autism Spectrum Disorder (Experiment 2). In Phase 1, we arranged food reinforcement according to a variable-ratio schedule for engaging in a target response. In Phase 2, we arranged extinction for target responding and differentially reinforced alternative responding according to a fixed-ratio schedule, with every alternative-reinforcer delivery paired with a change in keylight color (Experiment 1) or automated verbal (praise) statement (Experiment 2). In Phase 3, we assessed resurgence during extinction of target and alternative responding in the presence versus absence of continued presentation of the paired stimulus. Despite variation across sessions, resurgence on average was lower when continuing to present the paired stimuli in all pigeons and children while maintenance of alternative responding did not differ between assessments. These findings indicate that stimuli paired with alternative reinforcement can modestly decrease resurgence, but further examination of their efficacy and a better understanding of the underlying processes are necessary before they can be recommended for clinical use in reducing resurgence of clinically relevant problem behavior., (© 2019 Society for the Experimental Analysis of Behavior.)

Treatments based on differential reinforcement may inadvertently increase the recurrence of problem behavior in the face of challenges because reinforcers for appropriate behavior occur in the same context as problem behavior. The current study evaluated one potential approach to mitigating these problems with differential reinforcement treatments based on behavioral momentum theory. Specifically, appropriate behavior was trained in contexts without a history of reinforcement prior to intervening with problem behavior. Participants were 4 children with autism spectrum disorder. Treatment used telehealth to implement functional communication training (FCT) in three alternative contexts with minimal or no history of reinforcement for problem behavior before initiating FCT in the treatment context. Evaluations of the effects of treatment and tests of resurgence were conducted intermittently during treatment to evaluate maintenance. When FCT treatment was initiated in alternative contexts, initial results were comparable to more typical implementations of FCT. Resurgence was reduced to similar levels during tests of resurgence for all participants when compared to more typical previously published implementations of FCT, but clinically significant reductions in resurgence occurred more quickly in the present study. These findings support training appropriate behavior in an alternative context to mitigate the resurgence of problem behavior during differential reinforcement treatments., (© 2019 Society for the Experimental Analysis of Behavior.)

The present study examined whether resurgence of a previously reinforced target response upon removing alternative reinforcement would be greater when (1) returning to the original training context (ABA context changes) versus (2) remaining in the analogue treatment context in which the alternative response was differentially reinforced (ABB context changes). Experiment 1 arranged reinforcement of button pressing with points exchangeable for money in university students. Experiment 2 arranged reinforcement of lever pressing with food for rats. Experiment 3 arranged reinforcement of responses to a touchscreen with small bites of food with children diagnosed with ASD. Overall, resurgence of target responding tended to be greater when returning to the original training context (A) than when remaining in the analogue treatment context (B). These findings suggest context changes with differential reinforcement treatments could exacerbate the recurrence of problem behavior resulting from reductions in treatment integrity through failure to reinforce appropriate behavior., (© 2019 Society for the Experimental Analysis of Behavior.)

We introduce to behavior analysis a way of analyzing choice behavior that exploits recent developments in nanoeconomics, financial economics, and econometrics. A response return, modeled on an economic return, is the log differenced count of responses allocated to each of two alternatives during a short time window, compared with that in the immediately preceding window. The response return is a new dependent variable which offers a novel and useful way of looking at operant behavior, especially at the molecular level of analysis. The response-return series is a near-instantaneous measure of an organism's dynamic preferences for each of two alternatives. Analyzing such a series requires time-analytic techniques, including Auto-Regressive Conditional Heteroskedastic (ARCH) models. We illustrate these techniques by analyzing choices between combinations of arithmetic and exponential variable-interval schedules with pigeon subjects. All response-return series were well-fitted by one of three ARCH-family models. The fitted models were differentially sensitive to transition versus steady-state data samples. The particular insights that the ARCH analyses offer are improved understanding of the effects of the instantaneous effects of reinforcers and their absence, of how the distribution of reinforcers in time affects choice, and of the differences between choice in transition and at steady state., (© 2019 Society for the Experimental Analysis of Behavior.)

Zebrafish (Danio rerio) are a promising animal model for studying the effects of gene-environment interactions on behavior. Two experiments were conducted to assess punishment effects of presenting predator videos (Indian leaf fish; Nandus nandus) and electric shock on operant approach responses in zebrafish. In Experiment 1, the predator video and shock stimuli were presented upon a response maintained by a single variable-interval schedule of food reinforcement in different groups of fish. In Experiment 2, the predator video and shock stimuli were presented upon one of two response alternatives maintain by concurrently available variable-interval schedules of food reinforcement in different groups of fish. Responding decreased when the predator video and shock stimuli were presented relative to their absence in both experiments. Moreover, responding on an unpunished alternative did not reliably decrease in Experiment 2. These results indicate that the decrease in responding resulted from the punishment contingency rather than from elicited species-specific defense responses or conditioned avoidance. Thus, the predator video and electric shock functioned as punishers of operant behavior for zebrafish. Identifying punishers for this species could lead to research on how gene-environment interactions influence individual differences in sensitivity to punishment., (© 2018 Society for the Experimental Analysis of Behavior.)

Resurgence is defined as the recurrence of a previously reinforced and then extinguished target response when reducing or eliminating a more recently reinforced alternative response. In experiments with children and pigeons, we evaluated patterns of resurgence across and within sessions through decreases in reinforcer availability by challenging alternative responding with extinction and progressive-ratio schedules. In Phase 1, we reinforced only target responding. In Phase 2, we extinguished target responding while reinforcing an alternative response. Finally, Phase 3 assessed resurgence by (a) extinguishing alternative responding versus (b) introducing a progressive-ratio schedule of reinforcement for alternative responding. In both children and pigeons, resurgence of target responding occurred in both conditions but generally was greater when assessed during extinction than with progressive ratios. Importantly, within-session patterns of resurgence did not differ between testing with progressive ratios and extinction. Resurgence with progressive ratios tended to be greater with longer durations between reinforcers but we observed similar findings with only simulated reinforcers during extinction testing. Therefore, the present investigation reveals that the events contributing to instances of resurgence remain to be understood, and presents an approach from which to examine variables influencing within-session patterns of resurgence., (© 2018 Society for the Experimental Analysis of Behavior.)

Resurgence is the reemergence of a previously reinforced response that occurs after the elimination or reduction of reinforcement for an alternative response. Resurgence is problematic in the context of treatment because the reemergence of a previously reinforced destructive response could be detrimental to treatment gains. In the current translational study, we examined a modified resurgence procedure in which the alternative response was either present or absent during extinction. Four participants were exposed to three phases that consisted of (1) reinforcement of a target response, (2) extinction of the target response and differential reinforcement of an alternative response, and (3) extinction of both responses. Results for four out of five assessments showed greater resurgence when the alternative response was absent during Phase 3. Results suggest that more robust resurgence might occur if the alternative response is not available as opposed to the alternative response contacting extinction., (© 2018 Society for the Experimental Analysis of Behavior.)

The study and use of punishment in behavioral treatments has been constrained by ethical concerns. However, there remains a need to reduce harmful behavior unable to be reduced by differential-reinforcement procedures. We investigated whether response-contingent presentation of a negative discriminative stimulus previously correlated with an absence of reinforcers would punish behavior maintained by positive reinforcers. Across four conditions, pigeons were trained to discriminate between a positive discriminative stimulus (S+) signaling the presence of food, and a negative discriminative stimulus (S-) signaling the absence of food. Once learned, every five responses on average to the S+ produced S- for a duration of 1.5 s. S+ response rate decreased for a majority of pigeons when responses produced S-, compared to when they did not, or when a neutral control stimulus was presented. In Condition 5, choice between two concurrently presented S+ alternatives shifted away from the alternative producing S-, despite a 1:1 reinforcer ratio. Therefore, presenting contingent S- stimuli punishes operant behavior maintained on simple schedules and in choice situations. Development of negative discriminative stimuli as punishers of operant behavior could provide an effective approach to behavioral treatments for problem behavior and subverting suboptimal choices involved in addictions., (© 2018 Society for the Experimental Analysis of Behavior.)

Organisms that behave so as to forfeit a relatively higher overall rate of reinforcement in favor of a relatively lower rate are said to engage in suboptimal choice. Suboptimal choice has been linked with maladaptive behavior in humans. Melioration theory offers one explanatory framework for suboptimal choice. Melioration theory suggests behavior is controlled by differences in local reinforcer rates between alternatives. Vaughan (1981) arranged two experimental conditions in which maximizing the overall rate of reinforcement required behavior that was compatible, or incompatible, with melioration. Vaughan found pigeons allocated more time to a locally richer alternative even when doing so resulted in suboptimal choice. However, Vaughan did not show whether these effects could systematically reverse and did not provide within-session data to show that choice across short time spans remains under the control of differences in local reinforcer rates. The present study used pigeons to replicate and extend Vaughan's findings. We investigated shifts in overall- and within-session choice across repeated conditions, according to arranged local contingencies. Behavior systematically followed changes in local contingencies for most pigeons. Within-session data suggests that, providing differences in local reinforcer rates are discriminated, pigeons will allocate more time to a locally richer alternative, even if this leads to suboptimal choice. These findings facilitate the more confident use of similar procedures that investigate how melioration contributes to suboptimal choice., (© 2018 Society for the Experimental Analysis of Behavior.)

Resurgence and reinstatement are laboratory models of relapse following treatments for problem behavior that arrange alternative sources of reinforcement, such as differential reinforcement of alternative behavior and noncontingent reinforcement. Resurgence models the elimination or reduction of reinforcers during treatment and reinstatement models the re-presentation of reinforcers previously maintaining problem behavior. The present study examined individual and combined effects of resurgence and reinstatement in a translational model of treatment relapse with three children diagnosed with Autism Spectrum Disorder. We first reinforced and then extinguished an arbitrary response while providing access to a preferred toy to model a version of noncontingent reinforcement with extinction. In the following phases, we examined resurgence by removing the toy, reinstatement by presenting the training reinforcer response-independently, and a combination of resurgence and reinstatement. Overall, relapse of target responding reliably exceeded functionally similar responses never reinforced in the experimental situation. Most importantly, relapse tended to be greater when combining resurgence and reinstatement than when assessing either alone. These findings support previous studies showing that combinations of operations can increase treatment relapse. This translational model arranging simulated problem behavior with arbitrary tasks provides a platform from which to thoroughly and systematically assess methods for understanding and improving behavioral treatments., (© 2018 Society for the Experimental Analysis of Behavior.)

Spontaneous recovery occurs when a previously reinforced and recently extinguished response reemerges over the course of time, often at the beginning of a new session of extinction. Spontaneous recovery could underlie instances of treatment relapse that threaten otherwise effective behavioral interventions for problem behavior. In two experiments, we arranged multiple schedules with pigeons and a human child to assess the effects of different training reinforcer rates on spontaneous recovery. In both experiments, responding was both more resistant to extinction and more likely to relapse following training with greater reinforcement rates upon returning to extinction after time off from extinction testing. A quantitative model based on behavioral momentum theory accounted well for the data, which suggests reexposure to the extinction context following time off during extinction resulted in (1) the failure of extinction learning to generalize, and (2) greater generalization of original learning during training. The present model attempts to quantify theories attributing spontaneous recovery to changes in temporal context., (© 2018 Society for the Experimental Analysis of Behavior.)

Zebrafish are a widely used animal model in biomedical research, as an alternative to mammals, for having features such as a fully sequenced genome, high fecundity, and low-cost maintenance, but behavioral research with these fish remains scarce. The present study investigated whether zebrafish could be a new animal model for studies on the relapse of behavior (e.g., addiction and overeating) after the behavior has been extinguished. Specifically, we examined whether zebrafish would show three different types of relapse commonly studied with other species: resurgence, renewal, and reinstatement. For resurgence, a target response (i.e., approaching a sensor) was established by presenting a reinforcer (i.e., shrimp eggs) contingent upon the response in Phase 1; the target response was extinguished while introducing reinforcement for an alternative response in Phase 2; neither response produced the reinforcer in Phase 3. For renewal, a target response was established under Context A in Phase 1 and was extinguished under Context B in Phase 2; the fish were placed back in Context A in Phase 3, where extinction remained in effect. For reinstatement, a target response was established in Phase 1 and was extinguished in Phase 2; the reinforcer was presented independently of responding in Phase 3. Each type of relapse occurred in Phase 3. These results replicate and extend previous findings on relapse to a new species and suggest that zebrafish can be a useful animal model for studying the interactions of biological and environmental factors that lead to relapse., (Copyright © 2017 Elsevier B.V. All rights reserved.)

Differential-reinforcement treatments reduce target problem behavior in the short term but at the expense of making it more persistent long term. Basic and translational research based on behavioral momentum theory suggests that combining features of stimuli governing an alternative response with the stimuli governing target responding could make target responding less persistent. However, changes to the alternative stimulus context when combining alternative and target stimuli could diminish the effectiveness of the alternative stimulus in reducing target responding. In an animal model with pigeons, the present study reinforced responding in the presence of target and alternative stimuli. When combining the alternative and target stimuli during extinction, we altered the alternative stimulus through changes in line orientation. We found that (1) combining alternative and target stimuli in extinction more effectively decreased target responding than presenting the target stimulus on its own; (2) combining these stimuli was more effective in decreasing target responding trained with lower reinforcement rates; and (3) changing the alternative stimulus reduced its effectiveness when it was combined with the target stimulus. Therefore, changing alternative stimuli (e.g., therapist, clinical setting) during behavioral treatments that combine alternative and target stimuli could reduce the effectiveness of those treatments in disrupting problem behavior., (© 2017 Society for the Experimental Analysis of Behavior.)

Zebrafish are used extensively as vertebrate animal models in biomedical research for having such features as a fully sequenced genome and transparent embryo. Yet, operant-conditioning studies with this species are scarce. The present study investigated reversal learning and resurgence of operant behavior in zebrafish. A target response (approaching a sensor) was reinforced in Phase 1. In Phase 2, the target response was extinguished while reinforcing an alternative response (approaching a different sensor). In Phase 3, extinction was in effect for the target and alternative responses. Reversal learning was demonstrated when responding tracked contingency changes between Phases 1 and 2. Moreover, resurgence occurred in 10 of 13 fish in Phase 3: Target response rates increased transiently and exceeded rates of an unreinforced control response. The present study provides the first evidence with zebrafish supporting reversal learning between discrete operant responses and a laboratory model of relapse. These findings open the possibility to assessing genetic influences of operant behavior generally and in models of relapse (e.g., resurgence, renewal, reinstatement)., (Copyright © 2017 Elsevier B.V. All rights reserved.)

We review quantitative accounts of behavioral momentum theory (BMT), its application to clinical treatment, and its extension to post-intervention relapse of target behavior. We suggest that its extension can account for relapse using reinstatement and renewal models, but that its application to resurgence is flawed both conceptually and in its failure to account for recent data. We propose that the enhanced persistence of target behavior engendered by alternative reinforcers is limited to their concurrent availability within a distinctive stimulus context. However, a failure to find effects of stimulus-correlated reinforcer rates in a Pavlovian-to-Instrumental Transfer (PIT) paradigm challenges even a straightforward Pavlovian account of alternative reinforcer effects. BMT has been valuable in understanding basic research findings and in guiding clinical applications and accounting for their data, but alternatives are needed that can account more effectively for resurgence while encompassing basic data on resistance to change as well as other forms of relapse., (Copyright © 2017 Elsevier B.V. All rights reserved.)

Behavioral treatment gains established in one setting do not always maintain in other settings. The present review examines the relevance of basic and translational research to understanding failures to maintain treatment gains across settings. Specifically, studies of the renewal effect examine how transitioning away from a treatment setting could evoke a return of undesirable behavior, rather than newly trained appropriate behavior. Studies of renewal typically arrange three phases, with a response trained and reinforced under a particular set of contextual stimuli in the first phase. Next, that response is extinguished, often under a different set of contextual stimuli. Finally, that response returns despite extinction remaining in effect upon returning to the original training context or transitioning to a novel context. Thus, removing the extinction context is sufficient to produce a recurrence of the response. The findings suggest treatment effects can become specific to the context in which the treatment was delivered. This literature offers promising methods for systematically assessing the factors contributing to treatment maintenance and improving generalization of treatment gains across contexts. Therefore, the present review suggests basic and translational research on renewal provides an empirical literature to bring greater conceptual systematization to understanding generalization and maintenance of behavioral treatment., (© 2017 Society for the Experimental Analysis of Behavior.)

Greater rates of intermittent reinforcement in the presence of discriminative stimuli generally produce greater resistance to extinction, consistent with predictions of behavioral momentum theory. Other studies reveal more rapid extinction with higher rates of reinforcers - the partial reinforcement extinction effect. Further, repeated extinction often produces more rapid decreases in operant responding due to learning a discrimination between training and extinction contingencies. The present study examined extinction repeatedly with training with different rates of intermittent reinforcement in a multiple schedule. We assessed whether repeated extinction would reverse the pattern of greater resistance to extinction with greater reinforcer rates. Counter to this prediction, resistance to extinction was consistently greater across twelve assessments of training followed by six successive sessions of extinction. Moreover, patterns of responding during extinction resembled those observed during satiation tests, which should not alter discrimination processes with repeated testing. These findings join others suggesting operant responding in extinction can be durable across repeated tests., (Copyright © 2017 Elsevier B.V. All rights reserved.)

Noncontingent reinforcement is a commonly used procedure to decrease levels of problem behavior. Goals of this intervention are to decrease motivation, responding, and the functional relation between behavior and consequences, but it could also possibly compete with performance of alternative desirable responses. In the current study, we assessed the effects of noncontingent reinforcement arranged from 0% to 100% of sessions on performance of alternative responding across two experiments. Experiment 1 assessed manding (i.e., requests) maintained by attention and tangibles with a child with developmental disabilities and Experiment 2 assessed keypecking maintained by food with six pigeons. We extended previous research by (a) showing that noncontingent reinforcement competes with both the acquisition and maintenance (performance) of an alternative response, (b) extending the generality of the findings across nonhuman and human participants, and (c) eliminating influence of sequence effects through random manipulations of noncontingent value in pigeons. Overall, greater amounts of noncontingent reinforcement competed with both acquisition and maintenance of alternative responding., (© 2017 Society for the Experimental Analysis of Behavior.)

Resurgence is the recurrence of a previously reinforced and then extinguished behavior induced by the extinction of another more recently reinforced behavior. Resurgence provides insight into behavioral processes relevant to treatment relapse of a range of problem behaviors. Resurgence is typically studied across three phases: (1) reinforcement of a target response, (2) extinction of the target and concurrent reinforcement of an alternative response, and (3) extinction of the alternative response, resulting in the recurrence of target responding. Because each phase typically occurs successively and spans multiple sessions, extended time frames separate the training and resurgence of target responding. This study assessed resurgence more dynamically and throughout ongoing training in 6 pigeons. Baseline entailed 50-s trials of a free-operant psychophysical procedure, resembling Phases 1 and 2 of typical resurgence procedures. During the first 25 s, we reinforced target (left-key) responding but not alternative (right-key) responding; contingencies reversed during the second 25 s. Target and alternative responding followed the baseline reinforcement contingencies, with alternative responding replacing target responding across the 50 s. We observed resurgence of target responding during signaled and unsignaled probes that extended trial durations an additional 100 s in extinction. Furthermore, resurgence was greater and/or sooner when probes were signaled, suggesting an important role of discriminating transitions to extinction in resurgence. The data were well described by an extension of a stimulus-control model of discrimination that assumes resurgence is the result of generalization of obtained reinforcers across space and time. Therefore, the present findings introduce novel methods and quantitative analyses for assessing behavioral processes underlying resurgence.

The baseline rate of a reinforced target response decreases with the availability of response-independent sources of alternative reinforcement; however, resistance to disruption and relapse increases. Because many behavioral treatments for problem behavior include response-dependent reinforcement of alternative behavior, the present study assessed whether response-dependent alternative reinforcement also decreases baseline response rates but increases resistance to extinction and relapse. We reinforced target responding at equal rates across two components of a multiple schedule with pigeons. We compared resistance to extinction and relapse via reinstatement of (1) a target response trained concurrently with a reinforced alternative response in one component with (2) a target response trained either concurrently or in separate components from the alternative response across conditions. Target response rates trained alone in baseline were higher but resistance to extinction and relapse via reinstatement tests were greater after training concurrently with the alternative response. In another assessment, training target and alternative responding together, but separating them during extinction and reinstatement tests, produced equal resistance to extinction and relapse. Together, these findings are consistent with behavioral momentum theory-operant response-reinforcer relations determined baseline response rates but Pavlovian stimulus-reinforcer relations established during training determined resistance to extinction and relapse. These findings imply that reinforcing alternative behavior to treat problem behavior could initially reduce rates but increase persistence., (© 2016 Society for the Experimental Analysis of Behavior.)

Differential reinforcement of alternative behavior (DRA) is a treatment designed to eliminate problem behavior by reinforcing an alternative behavior at a higher rate. Availability of alternative reinforcement may be signaled, as with Functional Communication Training, or unsignaled. Whether or not alternative reinforcement is signaled could influence both the rate and persistence of problem behavior. The present study investigated whether signaling the availability of alternative reinforcement affects the rate and persistence of a concurrently available target response with pigeons. Three components of a multiple concurrent schedule arranged equal reinforcement rates for target responding. Two of the components also arranged equal reinforcement rates for an alternative response. In one DRA component, a discrete stimulus signaled the availability of response-contingent alternative reinforcement by changing the keylight color upon reinforcement availability. In the other DRA component, availability of alternative reinforcement was not signaled. Target responding was most persistent in the unsignaled DRA component when disrupted by satiation, free food presented between components, and extinction, relative to the signaled DRA and control components. These findings suggest the discrete stimulus functionally separated the availability of alternative reinforcement from the discriminative stimuli governing target responding. These findings provide a novel avenue to explore in translational research assessing whether signaling the availability of alternative reinforcement with DRA treatments reduces the persistence of problem behavior., (© 2016 Society for the Experimental Analysis of Behavior.)

Contrafreeloading involves organisms working for food when an identical source of food is freely available. The present study assessed whether training reinforcement rates influenced contrafreeloading by arranging a within-subject and within-session design using pigeons. Across different alternating discriminative stimuli, variable-interval schedules arranged leaner (30 per hour) and richer (120 per hour) rates of food reinforcement. Responding decreased but persisted in the presence of free food during the session (i.e., contrafreeloading). Further, responding tended to be similar between components initially but greater persistence emerged in the richer component with additional exposure. With pre-session feeding, responding did not change systematically across test sessions and tended to be more persistent in the richer component. Greater persistence with greater training reinforcement rates is generally consistent with an influential theory of response persistence, behavioral momentum theory. However, the different patterns of responding across test sessions between pre- and within-session feeding reveals multiple behavioral processes involved in contrafreeloading that have yet to be fully understood. Behavioral momentum theory could provide a useful theoretical framework for understanding and quantifying the behavioral processes underlying contrafreeloading., (Copyright © 2016 Elsevier B.V. All rights reserved.)