Search

Abstract We present an overview of the Conference on Transformative Opportunities for Modeling in Neurorehabilitation held in March 2023. It was supported by the Disability and Rehabilitation Engineering (DARE) program from the National Science Foundation’s Engineering Biology and Health Cluster. The conference brought together experts and trainees from around the world to discuss critical questions, challenges, and opportunities at the intersection of computational modeling and neurorehabilitation to understand, optimize, and improve clinical translation of neurorehabilitation. We organized the conference around four key, relevant, and promising Focus Areas for modeling: Adaptation & Plasticity, Personalization, Human-Device Interactions, and Modeling ‘In-the-Wild’. We identified four common threads across the Focus Areas that, if addressed, can catalyze progress in the short, medium, and long terms. These were: (i) the need to capture and curate appropriate and useful data necessary to develop, validate, and deploy useful computational models (ii) the need to create multi-scale models that span the personalization spectrum from individuals to populations, and from cellular to behavioral levels (iii) the need for algorithms that extract as much information from available data, while requiring as little data as possible from each client (iv) the insistence on leveraging readily available sensors and data systems to push model-driven treatments from the lab, and into the clinic, home, workplace, and community. The conference archive can be found at (dare2023.usc.edu). These topics are also extended by three perspective papers prepared by trainees and junior faculty, clinician researchers, and federal funding agency representatives who attended the conference.

Neuromotor impairments resulting from natural aging and aging-related diseases are often accompanied by a heightened prevalence of falls and fall-related injuries. Conventionally, the study of factors contributing to falls focuses on intrinsic characteristics, such as sensorimotor processing delays and weakness, and extrinsic factors, such as environmental obstacles. However, the impact of these factors only becomes evident in response to people’s decisions about how and where they will move in their environment. This decision-making process can be considered a behavioral risk factor, and it influences the extent to which a person engages in activities that place them near the limits of their capacity. While there are readily available tools for assessing intrinsic and extrinsic fall risk, our understanding of how to assess behavioral risk is limited. Measuring behavioral risk requires a systematic assessment of how people make decisions when walking in complex environments and how these decisions relate to their functional capacity. We propose that experimental methods and computational models derived from behavioral economics can stimulate the development of such assessments. Behavioral economics relies on theoretical models and empirical studies to characterize the factors that influence how people make decisions under risky conditions where a given decision can have variable outcomes. Applying a behavioral economic approach to walking can provide insight into how internal assessment of one’s fall risk influences the tasks that one is willing to perform. Ultimately, these assessments will allow us to identify people who make choices that increase their likelihood of fall-related injuries.

Abstract Riding a bicycle is considered a durable skill that cannot be forgotten. Here, novice participants practiced riding a reversed bicycle, in which a reversing gear inverted the handlebar’s rotation. Although learning to ride the reversed bicycle was possible, it was slow, highly variable, implicit, and followed an S-shape pattern. In the initial learning phase, failed attempts to ride the normal bicycle indicated strong interference between the two bicycle skills. While additional practice decreased this interference effect, a subset of learners could not ride either bicycle after eight sessions of practice. Experienced riders who performed extensive practice could switch bicycles without failed attempts and exhibited similar performance (i.e., similar handlebar oscillations) on both bicycles. However, their performance on the normal bicycle was worse than that of the novice bicycle riders at baseline. In conclusion, “unlearning” of the normal bicycle skill precedes the initial learning of the reversed bicycle skill, and a signature of such unlearning is still present following extensive practice.

Abstract Humans and animals develop learning-to-learn strategies throughout their lives to accelerate learning. One theory suggests that this is achieved by a metacognitive process of controlling and monitoring learning. Although such learning-to-learn is also observed in motor learning, the metacognitive aspect of learning regulation has not been considered in classical theories of motor learning. Here, we formulated a minimal mechanism of this process as reinforcement learning of motor learning properties, which regulates a policy for memory update in response to sensory prediction error while monitoring its performance. This theory was confirmed in human motor learning experiments, in which the subjective sense of learning-outcome association determined the direction of up- and down-regulation of both learning speed and memory retention. Thus, it provides a simple, unifying account for variations in learning speeds, where the reinforcement learning mechanism monitors and controls the motor learning process.

Abstract Background Given the heterogeneity of stroke, it is important to determine the best course of motor therapy for each patient, i.e., to personalize rehabilitation based on predictions of long-term outcomes. Here, we propose a hierarchical Bayesian dynamic (i.e., state-space) model (HBDM) to forecast long-term changes in a motor outcome due to rehabilitation in the chronic phase post-stroke. Methods The model incorporates the effects of clinician-supervised training, self-training, and forgetting. In addition, to improve forecasting early in rehabilitation, when data are sparse or unavailable, we use the Bayesian hierarchical modeling technique to incorporate prior information from similar patients. We use HBDM to re-analyze the Motor Activity Log (MAL) data of participants with chronic stroke included in two clinical trials: (1) the DOSE trial, in which participants were assigned to a 0, 15, 30, or 60-h dose condition (data of 40 participants analyzed), and (2) the EXCITE trial, in which participants were assigned a 60-h dose, in either an immediate or a delayed condition (95 participants analyzed). Results For both datasets, HBDM accounts well for individual dynamics in the MAL during and outside of training: mean RMSE = 0.28 for all 40 DOSE participants (participant-level RMSE 0.26 ± 0.19—95% CI) and mean RMSE = 0.325 for all 95 EXCITE participants (participant-level RMSE 0.32 ± 0.31), which are small compared to the 0-5 range of the MAL. Bayesian leave-one-out cross-validation shows that the model has better predictive accuracy than static regression models and simpler dynamic models that do not account for the effect of supervised training, self-training, or forgetting. We then showcase model’s ability to forecast the MAL of “new” participants up to 8 months ahead. The mean RMSE at 6 months post-training was 1.36 using only the baseline MAL and then decreased to 0.91, 0.79, and 0.69 (respectively) with the MAL following the 1st, 2nd, and 3rd bouts of training. In addition, hierarchical modeling improves prediction for a patient early in training. Finally, we verify that this model, despite its simplicity, can reproduce previous findings of the DOSE trial on the efficiency, efficacy, and retention of motor therapy. Conclusions In future work, such forecasting models can be used to simulate different stages of recovery, dosages, and training schedules to optimize rehabilitation for each person. Trial registration This study contains a re-analysis of data from the DOSE clinical trial ID NCT01749358 and the EXCITE clinical trial ID NCT00057018

Abstract Gait biofeedback is a well-studied strategy to reduce gait impairments such as propulsion deficits or asymmetric step lengths. With biofeedback, participants alter their walking to reach the desired magnitude of a specific parameter (the biofeedback target) with each step. Biofeedback of anterior ground reaction force and step length is commonly used in post-stroke gait training as these variables are associated with self-selected gait speed, fall risk, and the energy cost of walking. However, biofeedback targets are often set as a function of an individual’s baseline walking pattern, which may not reflect the ideal magnitude of that gait parameter. Here we developed prediction models based on speed, leg length, mass, sex, and age to predict anterior ground reaction force and step length of neurotypical adults as a possible method for personalized biofeedback. Prediction of these values on an independent dataset demonstrated strong agreement with actual values, indicating that neurotypical anterior ground reaction forces can be estimated from an individual’s leg length, mass, and gait speed, and step lengths can be estimated from individual’s leg length, mass, age, sex, and gait speed. Unlike approaches that rely on an individual’s baseline gait, this approach provides a standardized method to personalize gait biofeedback targets based on the walking patterns exhibited by neurotypical individuals with similar characteristics walking at similar speeds without the risk of over- or underestimating the ideal values that could limit feedback-mediated reductions in gait impairments.

Abstract Background Gait training at fast speeds is recommended to reduce walking activity limitations post-stroke. Fast walking may also reduce gait kinematic impairments post-stroke. However, it is unknown if differences in gait kinematics between people post-stroke and neurotypical adults decrease when walking at faster speeds. Objective To determine the effect of faster walking speeds on gait kinematics post-stroke relative to neurotypical adults walking at similar speeds. Methods We performed a secondary analysis with data from 28 people post-stroke and 50 neurotypical adults treadmill walking at multiple speeds. We evaluated the effects of speed and group on individual spatiotemporal and kinematic metrics and performed k-means clustering with all metrics at self-selected and fast speeds. Results People post-stroke decreased step length asymmetry and trailing limb angle impairment, reducing between-group differences at fast speeds. Speed-dependent changes in peak swing knee flexion, hip hiking, and temporal asymmetries exaggerated between-group differences. Our clustering analyses revealed two clusters. One represented neurotypical gait behavior, composed of neurotypical and post-stroke participants. The other characterized stroke gait behavior—comprised entirely of participants post-stroke with smaller lower extremity Fugl-Meyer scores than the post-stroke participants in the neurotypical gait behavior cluster. Cluster composition was largely consistent at both speeds, and the distance between clusters increased at fast speeds. Conclusions The biomechanical effect of fast walking post-stroke varied across individual gait metrics. For participants within the stroke gait behavior cluster, walking faster led to an overall gait pattern more different than neurotypical adults compared to the self-selected speed. This suggests that to potentiate the biomechanical benefits of walking at faster speeds and improve the overall gait pattern post-stroke, gait metrics with smaller speed-dependent changes may need to be specifically targeted within the context of fast walking.

Abstract Background Complex motor tasks in immersive virtual reality using a head-mounted display (HMD-VR) have been shown to increase cognitive load and decrease motor performance compared to conventional computer screens (CS). Separately, visuomotor adaptation in HMD-VR has been shown to recruit more explicit, cognitive strategies, resulting in decreased implicit mechanisms thought to contribute to motor memory formation. However, it is unclear whether visuomotor adaptation in HMD-VR increases cognitive load and whether cognitive load is related to explicit mechanisms and long-term motor memory formation. Methods We randomized 36 healthy participants into three equal groups. All groups completed an established visuomotor adaptation task measuring explicit and implicit mechanisms, combined with a dual-task probe measuring cognitive load. Then, all groups returned after 24-h to measure retention of the overall adaptation. One group completed both training and retention tasks in CS (measuring long-term retention in a CS environment), one group completed both training and retention tasks in HMD-VR (measuring long-term retention in an HMD-VR environment), and one group completed the training task in HMD-VR and the retention task in CS (measuring context transfer from an HMD-VR environment). A Generalized Linear Mixed-Effect Model (GLMM) was used to compare cognitive load between CS and HMD-VR during visuomotor adaptation, t-tests were used to compare overall adaptation and explicit and implicit mechanisms between CS and HMD-VR training environments, and ANOVAs were used to compare group differences in long-term retention and context transfer. Results Cognitive load was found to be greater in HMD-VR than in CS. This increased cognitive load was related to decreased use of explicit, cognitive mechanisms early in adaptation. Moreover, increased cognitive load was also related to decreased long-term motor memory formation. Finally, training in HMD-VR resulted in decreased long-term retention and context transfer. Conclusions Our findings show that cognitive load increases in HMD-VR and relates to explicit learning and long-term motor memory formation during motor learning. Future studies should examine what factors cause increased cognitive load in HMD-VR motor learning and whether this impacts HMD-VR training and long-term retention in clinical populations.

Muscle synergy analysis via surface electromyography (EMG) is useful to study muscle coordination in motor learning, clinical diagnosis, and neurorehabilitation. However, current methods to extract muscle synergies in the upper limb suffer from two major issues. First, the necessary normalization of EMG signals is performed via maximum voluntary contraction (MVC), which requires maximal isometric force production in each muscle. However, some individuals with motor impairments have difficulties producing maximal effort in the MVC task. In addition, the MVC is known to be highly unreliable, with widely different forces produced in repeated measures. Second, synergy extraction in the upper limb is typically performed with a multidirection reaching task. However, some participants with motor impairments cannot perform this task because it requires precise motor control. In this study, we proposed a new isometric rotating task that does not require precise motor control or large forces. In this task, participants maintain a cursor controlled by the arm end-point force on a target that rotates at a constant angular velocity at a designated force level. To relax constraints on motor control precision, the target is widened and blurred. To obtain a reference EMG value for normalization without requiring maximal effort, we estimated a linear relationship between joint torques and muscle activations. We assessed the reliability of joint torque normalization and synergy extraction in the rotating task in young neurotypical individuals. Compared with normalization with MVC, joint torque normalization allowed reliable EMG normalization at low force levels. In addition, the extraction of synergies was as reliable and more stable than with the multidirection reaching task. The proposed rotating task can, therefore, be used in future motor learning, clinical diagnosis, and neurorehabilitation studies.

Background Persistent sensorimotor impairments after stroke can negatively impact quality of life. The hippocampus is vulnerable to poststroke secondary degeneration and is involved in sensorimotor behavior but has not been widely studied within the context of poststroke upper‐limb sensorimotor impairment. We investigated associations between non‐lesioned hippocampal volume and upper limb sensorimotor impairment in people with chronic stroke, hypothesizing that smaller ipsilesional hippocampal volumes would be associated with greater sensorimotor impairment. Methods and Results Cross‐sectional T1‐weighted magnetic resonance images of the brain were pooled from 357 participants with chronic stroke from 18 research cohorts of the ENIGMA (Enhancing NeuoImaging Genetics through Meta‐Analysis) Stroke Recovery Working Group. Sensorimotor impairment was estimated from the FMA‐UE (Fugl‐Meyer Assessment of Upper Extremity). Robust mixed‐effects linear models were used to test associations between poststroke sensorimotor impairment and hippocampal volumes (ipsilesional and contralesional separately; Bonferroni‐corrected, P

Large doses of movement practice have been shown to restore upper extremities' motor function in a significant subset of individuals post-stroke. However, such large doses are both difficult to implement in the clinic and highly inefficient. In addition, an important reduction in upper extremity function and use is commonly seen following rehabilitation-induced gains, resulting in “rehabilitation in vain”. For those with mild to moderate sensorimotor impairment, the limited spontaneous use of the more affected limb during activities of daily living has been previously proposed to cause a decline of motor function, initiating a vicious cycle of recovery, in which non-use and poor performance reinforce each other. Here, we review computational, experimental, and clinical studies that support the view that if arm use is raised above an effective threshold, one enters a virtuous cycle in which arm use and function can reinforce each other via self-practice in the wild. If not, one enters a vicious cycle of declining arm use and function. In turn, and in line with best practice therapy recommendations, this virtuous/vicious cycle model advocates for a paradigm shift in neurorehabilitation whereby rehabilitation be embedded in activities of daily living such that self-practice with the aid of wearable technology that reminds and motivates can enhance paretic limb use of those who possess adequate residual sensorimotor capacity. Altogether, this model points to a user-centered approach to recovery post-stroke that is tailored to the participant's level of arm use and designed to motivate and engage in self-practice through progressive success in accomplishing meaningful activities in the wild.

It has been proposed that motor adaptation and subsequent savings (or faster relearning) of an adapted movement pattern are mediated by cognitive processes. Here, we evaluated the pattern of cognitive-motor interference that emerges when young and late middle-aged adults perform an executive working memory task during locomotor adaptation. We also asked if this interferes with savings of a newly learned walking pattern, as has been suggested by a study of reaching adaptation. We studied split-belt treadmill adaptation and savings in young (21 ± 2 y/o) and late middle-aged (56 ± 6 y/o) adults with or without a secondary 2-back task during adaptation. We found that young adults showed similar performance on the 2-back task during baseline and adaptation, suggesting no effect of the dual-task on cognitive performance; however, dual-tasking interfered with adaptation over the first few steps. Conversely, dual-tasking caused a decrement in cognitive performance in late middle-aged adults with no effect on adaptation. To determine if this effect was specific to adaptation, we also evaluated dual-task interference in late middle-aged adults that dual-tasked while walking in a complex environment that did not induce motor adaptation. This group exhibited less cognitive-motor interference than late middle-aged adults who dual-tasked during adaptation. Savings was unaffected by dual-tasking in both young and late middle-aged adults, which may indicate different underlying mechanisms for savings of reaching and walking. Collectively, our findings reveal an age-dependent effect of cognitive-motor interference during dual-task locomotor adaptation and no effect of dual-tasking on savings, regardless of age. Young adults maintain cognitive performance and show a mild decrement in locomotor adaptation, while late middle-aged adults adapt locomotion at the expense of cognitive performance.

Everyday decision-making is supported by a dual-system of control comprised of parallel goal-directed and habitual systems. Over the past decade, the two-stage Markov decision task has become popularized for its ability to dissociate between goal-directed and habitual decision-making. While a handful of studies have implemented decision-making tasks online, only one study has validated the task by comparing in-person and web-based performance on the two-stage task in children and young adults. To date, no study has validated the dissociation of goal-directed and habitual behaviors in older adults online. Here, we implemented and validated a web-based version of the two-stage Markov task using parameter simulation and recovery and compared behavioral results from online and in-person participation on the two-stage task in both young and healthy older adults. We found no differences in estimated free parameters between online and in-person participation on the two-stage task. Further, we replicate previous findings that young adults are more goal-directed than older adults both in-person and online. Overall, this work demonstrates that the implementation and use of the two-stage Markov decision task for remote participation is feasible in the older adult demographic, which would allow for the study of decision-making with larger and more diverse samples.

Human movements with or without vision exhibit timing (i.e. speed and duration) and variability characteristics which are not well captured by existing computational models. Here, we introduce a stochastic optimal feedforward-feedback control (SFFC) model that can predict the nominal timing and trial-by-trial variability of self-paced arm reaching movements carried out with or without online visual feedback of the hand. In SFFC, movement timing results from the minimization of the intrinsic factors of effort and variance due to constant and signal-dependent motor noise, and movement variability depends on the integration of visual feedback. Reaching arm movements data are used to examine the effect of online vision on movement timing and variability, and test the model. This modelling suggests that the central nervous system predicts the effects of sensorimotor noise to generate an optimal feedforward motor command, and triggers optimal feedback corrections to task-related errors based on the available limb state estimate.

Abstract The effectiveness of transcranial direct current stimulation (tDCS) placed over the motor hotspot (thought to represent the primary motor cortex (M1)) to modulate motor network excitability is highly variable. The premotor cortex—particularly the dorsal premotor cortex (PMd)—may be a promising alternative target to reliably modulate motor excitability, as it influences motor control across multiple pathways, one independent of M1 and one with direct connections to M1. This double-blind, placebo-controlled preliminary study aimed to differentially excite motor and premotor regions using high-definition tDCS (HD-tDCS) with concurrent functional magnetic resonance imaging (fMRI). HD-tDCS applied over either the motor hotspot or the premotor cortex demonstrated high inter-individual variability in changes on cortical motor excitability. However, HD-tDCS over the premotor cortex led to a higher number of responders and greater changes in local fMRI-based complexity than HD-tDCS over the motor hotspot. Furthermore, an analysis of individual motor hotspot anatomical locations revealed that, in more than half of the participants, the motor hotspot is not located over anatomical M1 boundaries, despite using a canonical definition of the motor hotspot. This heterogeneity in stimulation site may contribute to the variability of tDCS results. Altogether, these preliminary findings provide new considerations to enhance tDCS reliability.

Abstract Background Virtual reality (VR) is a potentially promising tool for enhancing real-world locomotion in individuals with mobility impairment through its ability to provide personalized performance feedback and simulate real-world challenges. However, it is unknown whether novel locomotor skills learned in VR show sustained transfer to the real world. Here, as an initial step towards developing a VR-based clinical intervention, we study how young adults learn and transfer a treadmill-based virtual obstacle negotiation skill to the real world. Methods On Day 1, participants crossed virtual obstacles while walking on a treadmill, with the instruction to minimize foot clearance during obstacle crossing. Gradual changes in performance during training were fit via non-linear mixed effect models. Immediate transfer was measured by foot clearance during physical obstacle crossing while walking over-ground. Retention of the obstacle negotiation skill in VR and retention of over-ground transfer were assessed after 24 h. Results On Day 1, participants systematically reduced foot clearance throughout practice by an average of 5 cm (SD 4 cm) and transferred 3 cm (SD 1 cm) of this reduction to over-ground walking. The acquired reduction in foot clearance was also retained after 24 h in VR and over-ground. There was only a small, but significant 0.8 cm increase in foot clearance in VR and no significant increase in clearance over-ground on Day 2. Moreover, individual differences in final performance at the end of practice on Day 1 predicted retention both in VR and in the real environment. Conclusions Overall, our results support the use of VR for locomotor training as skills learned in a virtual environment readily transfer to real-world locomotion. Future work is needed to determine if VR-based locomotor training leads to sustained transfer in clinical populations with mobility impairments, such as individuals with Parkinson’s disease and stroke survivors.

The quality of arm movements typically improves in the sub-acute phase of stroke affecting the upper extremity. Here, we used whole arm kinematic analysis during reaching movements to distinguish whether these improvements are due to true recovery or to compensation. Fifty-three participants with post-acute stroke performed ∼80 reaching movement tests during 4 weeks of training with the ArmeoSpring exoskeleton. All participants showed improvements in end-effector performance, as measured by movement smoothness. Four ArmeoSpring angles, shoulder horizontal (SH) rotation, shoulder elevation (SE), elbow rotation, and forearm rotation, were recorded and analyzed. We first characterized healthy joint coordination patterns by performing a sparse principal component analysis on these four joint velocities recorded during reaching tests performed by young control participants. We found that two dominant joint correlations [SH with elbow rotation and SE with forearm rotation] explained over 95% of variance of joint velocity data. We identified two clusters of stroke participants by comparing the evolution of these two correlations in all tests. In the “Recoverer” cluster (N = 19), both joint correlations converged toward the respective correlations for control participants. Thus, Recoverers relearned how to generate smooth end-effector movements while developing joint movement patterns similar to those of control participants. In the “Compensator” cluster (N = 34), at least one of the two joint correlations diverged from the corresponding correlation of control participants. Compensators relearned how to generate smooth end-effector movements by discovering various new compensatory movement patterns dissimilar to those of control participants. New compensatory patterns included atypical decoupling of the SE and forearm joints, and atypical coupling of the SH rotation and elbow joints. There was no difference in clinical impairment level between the two groups either at the onset or at the end of training as assessed with the Upper Extremity Fugl-Meyer scale. However, at the start of training, the Recoverers showed significantly faster improvements in end-effector movement smoothness than the Compensators. Our analysis can be used to inform neurorehabilitation clinicians on how to provide movement feedback during practice and suggest avenues for refining exoskeleton robot therapy to reduce compensatory patterns.

We previously proposed, on theoretical grounds, that the cerebellum must regulate the dimensionality of its neuronal activity during motor learning and control to cope with the low firing frequency of inferior olive neurons, which form one of two major inputs to the cerebellar cortex. Such dimensionality regulation is possible via modulation of electrical coupling through the gap junctions between inferior olive neurons by inhibitory GABAergic synapses. In addition, we previously showed in simulations that intermediate coupling strengths induce chaotic firing of inferior olive neurons and increase their information carrying capacity. However, there is no in vivo experimental data supporting these two theoretical predictions. Here, we computed the levels of synchrony, dimensionality, and chaos of the inferior olive code by analyzing in vivo recordings of Purkinje cell complex spike activity in three different coupling conditions: carbenoxolone (gap junctions blocker), control, and picrotoxin (GABA-A receptor antagonist). To examine the effect of electrical coupling on dimensionality and chaotic dynamics, we first determined the physiological range of effective coupling strengths between inferior olive neurons in the three conditions using a combination of a biophysical network model of the inferior olive and a novel Bayesian model averaging approach. We found that effective coupling co-varied with synchrony and was inversely related to the dimensionality of inferior olive firing dynamics, as measured via a principal component analysis of the spike trains in each condition. Furthermore, for both the model and the data, we found an inverted U-shaped relationship between coupling strengths and complexity entropy, a measure of chaos for spiking neural data. These results are consistent with our hypothesis according to which electrical coupling regulates the dimensionality and the complexity in the inferior olive neurons in order to optimize both motor learning and control of high dimensional motor systems by the cerebellum.

Abstract Background A large number of robotic or gravity-supporting devices have been developed for rehabilitation of upper extremity post-stroke. Because these devices continuously monitor performance data during training, they could potentially help to develop predictive models of the effects of motor training on recovery. However, during training with such devices, patients must become adept at using the new “tool” of the exoskeleton, including learning the new forces and visuomotor transformations associated with the device. We thus hypothesized that the changes in performance during extensive training with a passive, gravity-supporting, exoskeleton device (the Armeo Spring) will follow an initial fast phase, due to learning to use the device, and a slower phase that corresponds to reduction in overall arm impairment. Of interest was whether these fast and slow processes were related. Methods To test the two-process hypothesis, we used mixed-effect exponential models to identify putative fast and slow changes in smoothness of arm movements during 80 arm reaching tests performed during 20 days of exoskeleton training in 53 individuals with post-acute stroke. Results In line with our hypothesis, we found that double exponential models better fit the changes in smoothness of arm movements than single exponential models. In contrast, single exponential models better fit the data for a group of young healthy control subjects. In addition, in the stroke group, we showed that smoothness correlated with a measure of impairment (the upper extremity Fugl Meyer score - UEFM) at the end, but not at the beginning, of training. Furthermore, the improvement in movement smoothness due to the slow component, but not to the fast component, strongly correlated with the improvement in the UEFM between the beginning and end of training. There was no correlation between the change of peaks due to the fast process and the changes due to the slow process. Finally, the improvement in smoothness due to the slow, but not the fast, component correlated with the number of days since stroke at the onset of training – i.e. participants who started exoskeleton training sooner after stroke improved their smoothness more. Conclusions Our results therefore demonstrate that at least two processes are involved in in performance improvements measured during mechanized training post-stroke. The fast process is consistent with learning to use the exoskeleton, while the slow process independently reflects the reduction in upper extremity impairment.

Background: Spontaneous use of the more-affected arm is a meaningful indicator of stroke recovery. The Bilateral Arm Reaching Test (BART) was previously developed to quantify arm use by measuring arm choice to targets projected over a horizontal hemi-workspace. In order to improve clinical validity, we constrained the available movement time, thereby promoting more spontaneous decision making when selecting between the more-affected and less affected arm during the BART.Methods: Twenty-two individuals with mild to moderate hemiparesis were tested with the time-based BART in three time-constraint conditions: no-time constraint, medium, and fast conditions. Arm use was measured across three sessions with a 2-week interval in a spontaneous choice block, in which participants were instructed to use either the more-affected or the less-affected arm to reach targets. We tested the effect of time-constraint condition on the more-affected arm use, external validity of the BART with the Actual Amount of Use Test (AAUT), and test-retest reliability across the three test sessions.Results: The fast condition in the time-based BART showed reduced use of the more-affected arm compared to the no-time constraint condition P < 0.0001) and the medium condition P = 0.0006; Tukey post hoc analysis after mixed-effect linear regression). In addition, the fast condition showed strong correlation with the AAUT r = 0.829, P < 0.001), and excellent test-retest reliability (ICC = 0.960, P < 0.0001).Conclusion: The revised BART with a time-restricted fast condition provides an objective, accurate, and repeatable measure of spontaneous arm use in individuals with chronic stroke hemiparesis.

The original article [1] contained an error whereby the co-author, Karima Bakhti’s name was displayed incorrectly.

Recent computational and behavioral studies suggest that motor adaptation results from the update of multiple memories with different timescales. Here, we designed a model-based functional magnetic resonance imaging (fMRI) experiment in which subjects adapted to two opposing visuomotor rotations. A computational model of motor adaptation with multiple memories was fitted to the behavioral data to generate time-varying regressors of brain activity. We identified regional specificity to timescales: in particular, the activity in the inferior parietal region and in the anterior-medial cerebellum was associated with memories for intermediate and long timescales, respectively. A sparse singular value decomposition analysis of variability in specificities to timescales over the brain identified four components, two fast, one middle, and one slow, each associated with different brain networks. Finally, a multivariate decoding analysis showed that activity patterns in the anterior-medial cerebellum progressively represented the two rotations. Our results support the existence of brain regions associated with multiple timescales in adaptation and a role of the cerebellum in storing multiple internal models.

Learning a motor task with temporally spaced presentations or with other tasks intermixed between presentations reduces performance during training, but can enhance retention post training. These two effects are known as the spacing and contextual interference effect, respectively. Here, we aimed at testing a unifying hypothesis of the spacing and contextual interference effects in visuomotor adaptation, according to which forgetting between trials due to either spaced presentations or interference by another task will promote between-trial forgetting, which will depress performance during acquisition, but will promote retention. We first performed an experiment with three visuomotor adaptation conditions: a short inter-trial-interval (ITI) condition (SHORT-ITI); a long ITI condition (LONG-ITI); and an alternating condition with two alternated opposite tasks (ALT), with the same single-task ITI as in LONG-ITI. In the SHORT-ITI condition, there was fastest increase in performance during training and largest immediate forgetting in the retention tests. In contrast, in the ALT condition, there was slowest increase in performance during training and little immediate forgetting in the retention tests. Compared to these two conditions, in the LONG-ITI, we found intermediate increase in performance during training and intermediate immediate forgetting. To account for these results, we fitted to the data six possible adaptation models with one or two time scales, and with interference in the fast, or in the slow, or in both time scales. Model comparison confirmed that two time scales and some degree of interferences in either time scale are needed to account for our experimental results. In summary, our results suggest that retention following adaptation is modulated by the degree of between-trial forgetting, which is due to time-based decay in single adaptation task and interferences in multiple adaptation tasks.

A critical issue in the study of infant development is to identify the processes by which task-specific action emerges from spontaneous movement. Emergent leg action has been studied by providing contingent reinforcement to specific leg movements using an overhead infant-activated mobile, however, there is limited information on the strategies used by infants to support the emergence of task-specific leg action from spontaneous movement. The purpose of this study is to (1) determine the ability of 3 month old infants to learn, through discovery, the contingency between leg action and mobile activation using a virtual threshold, and (2) identify strategies, defined by variance of the end-effectors (feet) and hip-knee joint coordination, used by infants that learned the contingency. Fourteen 3 month old infants participated in 2 sessions of mobile reinforcement on consecutive days. As a group, infants increased the percentage of mobile activation to meet performance criteria on Day 2, but did not meet memory or learning criteria across days. However, five infants learned the contingency based on individual learning criteria. When interacting with the mobile on Day 2 as compared to spontaneous kicking on Day 1, infants who learned the contingency, but not infants who did not learn the contingency, increased variance of the end-effectors (feet) in the vertical, task-specific direction and demonstrated less in-phase hip-knee joint coordination. An important discovery is that infants can discover this very specific contingency, suggesting that this movement behavior (action) can be shaped in future work. This may have implications for the rehabilitation of infants with atypical leg action.

"Use it and improve it, or lose it" is one of the axioms of motor therapy after stroke. There is, however, little understanding of the interactions between arm function and use in humans post-stroke. Here, we explored putative non-linear interactions between upper extremity function and use by developing a first-order dynamical model of stroke recovery with longitudinal data from participants receiving constraint induced movement therapy (CIMT) in the EXCITE clinical trial. Using a Bayesian regression framework, we systematically compared this model with competitive models that included, or not, interactions between function and use. Model comparisons showed that the model with the predicted interactions between arm function and use was the best fitting model. Furthermore, by comparing the model parameters before and after CIMT intervention in participants receiving the intervention one year after randomization, we found that therapy increased the parameter that controls the effect of arm function on arm use. Increase in this parameter, which can be thought of as the confidence to use the arm for a given level of function, lead to increase in spontaneous use after therapy compared to before therapy.

Motor training with the upper limb affected by stroke partially reverses the loss of cortical representation after lesion and has been proposed to increase spontaneous arm use. Moreover, repeated attempts to use the affected hand in daily activities create a form of practice that can potentially lead to further improvement in motor performance. We thus hypothesized that if motor retraining after stroke increases spontaneous arm use sufficiently, then the patient will enter a virtuous circle in which spontaneous arm use and motor performance reinforce each other. In contrast, if the dose of therapy is not sufficient to bring spontaneous use above threshold, then performance will not increase and the patient will further develop compensatory strategies with the less affected hand. To refine this hypothesis, we developed a computational model of bilateral hand use in arm reaching to study the interactions between adaptive decision making and motor relearning after motor cortex lesion. The model contains a left and a right motor cortex, each controlling the opposite arm, and a single action choice module. The action choice module learns, via reinforcement learning, the value of using each arm for reaching in specific directions. Each motor cortex uses a neural population code to specify the initial direction along which the contralateral hand moves towards a target. The motor cortex learns to minimize directional errors and to maximize neuronal activity for each movement. The derived learning rule accounts for the reversal of the loss of cortical representation after rehabilitation and the increase of this loss after stroke with insufficient rehabilitation. Further, our model exhibits nonlinear and bistable behavior: if natural recovery, motor training, or both, brings performance above a certain threshold, then training can be stopped, as the repeated spontaneous arm use provides a form of motor learning that further bootstraps performance and spontaneous use. Below this threshold, motor training is "in vain": there is little spontaneous arm use after training, the model exhibits learned nonuse, and compensatory movements with the less affected hand are reinforced. By exploring the nonlinear dynamics of stroke recovery using a biologically plausible neural model that accounts for reversal of the loss of motor cortex representation following rehabilitation or the lack thereof, respectively, we can explain previously hard to reconcile data on spontaneous arm use in stroke recovery. Further, our threshold prediction could be tested with an adaptive train-wait-train paradigm: if spontaneous arm use has increased in the "wait" period, then the threshold has been reached, and rehabilitation can be stopped. If spontaneous arm use is still low or has decreased, then another bout of rehabilitation is to be provided.

BACKGROUND: The ability to select an action by considering both delays and amount of reward outcome is critical for maximizing long-term benefits. Although previous animal experiments on impulsivity have suggested a role of serotonin in behaviors requiring prediction of delayed rewards, the underlying neural mechanism is unclear. METHODOLOGY/PRINCIPAL FINDINGS: To elucidate the role of serotonin in the evaluation of delayed rewards, we performed a functional brain imaging experiment in which subjects chose small-immediate or large-delayed liquid rewards under dietary regulation of tryptophan, a precursor of serotonin. A model-based analysis revealed that the activity of the ventral part of the striatum was correlated with reward prediction at shorter time scales, and this correlated activity was stronger at low serotonin levels. By contrast, the activity of the dorsal part of the striatum was correlated with reward prediction at longer time scales, and this correlated activity was stronger at high serotonin levels. CONCLUSIONS/SIGNIFICANCE: Our results suggest that serotonin controls the time scale of reward prediction by differentially regulating activities within the striatum.