Search

Motor adaptation to perturbations is provided by learning mechanisms operating in the cerebellum and basal ganglia. The cerebellum normally performs motor adaptation through supervised learning using information about movement error provided by visual feedback. However, if visual feedback is critically distorted, the system may disengage cerebellar error-based learning and switch to reinforcement learning mechanisms mediated by basal ganglia. Yet, the exact conditions and mechanisms of cerebellum and basal ganglia involvement in motor adaptation remain unknown. We use mathematical modeling to simulate control of planar reaching movements that relies on both error-based and non-error-based learning mechanisms. We show that for learning to be efficient only one of these mechanisms should be active at a time. We suggest that switching between the mechanisms is provided by a special circuit that effectively suppresses the learning process in one structure and enables it in the other. To do so, this circuit modulates learning rate in the cerebellum and dopamine release in basal ganglia depending on error-based learning efficiency. We use the model to explain and interpret experimental data on error- and non-error-based motor adaptation under different conditions., Competing Interests: The authors have declared that no competing interests exist.

In this study, we explore the functional role of striatal cholinergic interneurons, hereinafter referred to as tonically active neurons (TANs), via computational modeling; specifically, we investigate the mechanistic relationship between TAN activity and dopamine variations and how changes in this relationship affect reinforcement learning in the striatum. TANs pause their tonic firing activity after excitatory stimuli from thalamic and cortical neurons in response to a sensory event or reward information. During the pause striatal dopamine concentration excursions are observed. However, functional interactions between the TAN pause and striatal dopamine release are poorly understood. Here we propose a TAN activity-dopamine relationship model and demonstrate that the TAN pause is likely a time window to gate phasic dopamine release and dopamine variations reciprocally modulate the TAN pause duration. Furthermore, this model is integrated into our previously published model of reward-based motor adaptation to demonstrate how phasic dopamine release is gated by the TAN pause to deliver reward information for reinforcement learning in a timely manner. We also show how TAN-dopamine interactions are affected by striatal dopamine deficiency to produce poor performance of motor adaptation.

Key Points: Coordination of neuronal activity between left and right sides of the mammalian spinal cord is provided by several sets of commissural interneurons (CINs) whose axons cross the midline. Genetically identified inhibitory V0D and excitatory V0V CINs and ipsilaterally projecting excitatory V2a interneurons were shown to secure left-right alternation at different locomotor speeds. We have developed computational models of neuronal circuits in the spinal cord that include left and right rhythm-generating centres interacting bilaterally via three parallel pathways mediated by V0D , V2a-V0V and V3 neuron populations. The models reproduce the experimentally observed speed-dependent left-right coordination in normal mice and the changes in coordination seen in mutants lacking specific neuron classes. The models propose an explanation for several experimental results and provide insights into the organization of the spinal locomotor network and parallel CIN pathways involved in gait control at different locomotor speeds., Abstract: Different locomotor gaits in mammals, such as walking or galloping, are produced by coordinated activity in neuronal circuits in the spinal cord. Coordination of neuronal activity between left and right sides of the cord is provided by commissural interneurons (CINs), whose axons cross the midline. In this study, we construct and analyse two computational models of spinal locomotor circuits consisting of left and right rhythm generators interacting bilaterally via several neuronal pathways mediated by different CINs. The CIN populations incorporated in the models include the genetically identified inhibitory (V0D ) and excitatory (V0V ) subtypes of V0 CINs and excitatory V3 CINs. The model also includes the ipsilaterally projecting excitatory V2a interneurons mediating excitatory drive to the V0V CINs. The proposed network architectures and CIN connectivity allow the models to closely reproduce and suggest mechanistic explanations for several experimental observations. These phenomena include: different speed-dependent contributions of V0D and V0V CINs and V2a interneurons to left-right alternation of neural activity, switching gaits between the left-right alternating walking-like activity and the left-right synchronous hopping-like pattern in mutants lacking specific neuron classes, and speed-dependent asymmetric changes of flexor and extensor phase durations. The models provide insights into the architecture of spinal network and the organization of parallel inhibitory and excitatory CIN pathways and suggest explanations for how these pathways maintain alternating and synchronous gaits at different locomotor speeds. The models propose testable predictions about the neural organization and operation of mammalian locomotor circuits., (© 2015 The Authors. The Journal of Physiology © 2015 The Physiological Society.)

Locomotion in mammals is controlled by a spinal central pattern generator (CPG) coupled to a biomechanical limb system, with afferent feedback to the spinal circuits and CPG closing the control loop. We have considered a simplified model of this system, in which the CPG establishes a rhythm when a supra-spinal activating drive is present and afferent signals from a single-joint limb feed back to affect CPG operation. Using dynamical system methods, in a series of two papers we analyze the mechanisms by which this model produces oscillations, and the characteristics of these oscillations, in the closed- and open-loop regimes. In this first paper, we analyze the phase transition mechanisms operating within the CPG and use the results to explain how afferent feedback allows oscillations to occur at a wider range of drive values to the CPG than the range over which oscillations occur in the CPG without feedback, and then to comment on why stronger feedback leads to faster oscillations. Linking these transitions to structures in the phase plane associated with the limb segment clarifies how increased weights of afferent feedback to the CPG can restore locomotion after removal of supra-spinal drive to simulate spinal cord injury.

In this paper we analyze a closed loop neuromechanical model of locomotor rhythm generation. The model is composed of a spinal central pattern generator (CPG) and a single-joint limb, with CPG outputs projecting via motoneurons to muscles that control the limb and afferent signals from the muscles feeding back to the CPG. In a preceding companion paper (Spardy et al 2011 J. Neural Eng. 8 065003), we analyzed how the model generates oscillations in the presence or absence of feedback, identified curves in a phase plane associated with the limb that signify where feedback levels induce phase transitions within the CPG, and explained how increasing feedback strength restores oscillations in a model representation of spinal cord injury; from these steps, we derived insights about features of locomotor rhythms in several scenarios and made predictions about rhythm responses to various perturbations. In this paper, we exploit our analytical observations to construct a reduced model that retains important characteristics from the original system. We prove the existence of an oscillatory solution to the reduced model using a novel version of a Melnikov function, adapted for discontinuous systems, and also comment on the uniqueness and stability of this solution. Our analysis yields a deeper understanding of how the model must be tuned to generate oscillations and how the details of the limb dynamics shape overall model behavior. In particular, we explain how, due to the feedback signals in the model, changes in the strength of a tonic supra-spinal drive to the CPG yield asymmetric alterations in the durations of different locomotor phases, despite symmetry within the CPG itself.