Search

Abstract Purpose Virtual Reality (VR) has proven to be an effective tool for motor (re)learning. Furthermore, with the current commercialization of low-cost head-mounted displays (HMDs), immersive virtual reality (IVR) has become a viable rehabilitation tool. Nonetheless, it is still an open question how immersive virtual environments should be designed to enhance motor learning, especially to support the learning of complex motor tasks. An example of such a complex task is triggering steps while wearing lower-limb exoskeletons as it requires the learning of several sub-tasks, e.g., shifting the weight from one leg to the other, keeping the trunk upright, and initiating steps. This study aims to find the necessary elements in VR to promote motor learning of complex virtual gait tasks. Methods In this study, we developed an HMD-IVR-based system for training to control wearable lower-limb exoskeletons for people with sensorimotor disorders. The system simulates a virtual walking task of an avatar resembling the sub-tasks needed to trigger steps with an exoskeleton. We ran an experiment with forty healthy participants to investigate the effects of first- (1PP) vs. third-person perspective (3PP) and the provision (or not) of concurrent visual feedback of participants’ movements on the walking performance – namely number of steps, trunk inclination, and stride length –, as well as the effects on embodiment, usability, cybersickness, and perceived workload. Results We found that all participants learned to execute the virtual walking task. However, no clear interaction of perspective and visual feedback improved the learning of all sub-tasks concurrently. Instead, the key seems to lie in selecting the appropriate perspective and visual feedback for each sub-task. Notably, participants embodied the avatar across all training modalities with low cybersickness levels. Still, participants’ cognitive load remained high, leading to marginally acceptable usability scores. Conclusions Our findings suggest that to maximize learning, users should train sub-tasks sequentially using the most suitable combination of person’s perspective and visual feedback for each sub-task. This research offers valuable insights for future developments in IVR to support individuals with sensorimotor disorders in improving the learning of walking with wearable exoskeletons

Abstract Introduction There is currently a lack of easy-to-use and effective robotic devices for upper-limb rehabilitation after stroke. Importantly, most current systems lack the provision of somatosensory information that is congruent with the virtual training task. This paper introduces a novel haptic robotic system designed for upper-limb rehabilitation, focusing on enhancing sensorimotor rehabilitation through comprehensive haptic rendering. Methods We developed a novel haptic rehabilitation device with a unique combination of degrees of freedom that allows the virtual training of functional reach and grasp tasks, where we use a physics engine-based haptic rendering method to render whole-hand interactions between the patients’ hands and virtual tangible objects. To evaluate the feasibility of our system, we performed a clinical mixed-method usability study with seven patients and seven therapists working in neurorehabilitation. We employed standardized questionnaires to gather quantitative data and performed semi-structured interviews with all participants to gain qualitative insights into the perceived usability and usefulness of our technological solution. Results The device demonstrated ease of use and adaptability to various hand sizes without extensive setup. Therapists and patients reported high satisfaction levels, with the system facilitating engaging and meaningful rehabilitation exercises. Participants provided notably positive feedback, particularly emphasizing the system’s available degrees of freedom and its haptic rendering capabilities. Therapists expressed confidence in the transferability of sensorimotor skills learned with our system to activities of daily living, although further investigation is needed to confirm this. Conclusion The novel haptic robotic system effectively supports upper-limb rehabilitation post-stroke, offering high-fidelity haptic feedback and engaging training tasks. Its clinical usability, combined with positive feedback from both therapists and patients, underscores its potential to enhance robotic neurorehabilitation.

Abstract A large proportion of stroke survivors suffer from sensory loss, negatively impacting their independence, quality of life, and neurorehabilitation prognosis. Despite the high prevalence of somatosensory impairments, our understanding of somatosensory interventions such as sensory electrical stimulation (SES) in neurorehabilitation is limited. We aimed to study the effectiveness of SES combined with a sensory discrimination task in a well-controlled virtual environment in healthy participants, setting a foundation for its potential application in stroke rehabilitation. We employed electroencephalography (EEG) to gain a better understanding of the underlying neural mechanisms and dynamics associated with sensory training and SES. We conducted a single-session experiment with 26 healthy participants who explored a set of three visually identical virtual textures—haptically rendered by a robotic device and that differed in their spatial period—while physically guided by the robot to identify the odd texture. The experiment consisted of three phases: pre-intervention, intervention, and post-intervention. Half the participants received subthreshold whole-hand SES during the intervention, while the other half received sham stimulation. We evaluated changes in task performance—assessed by the probability of correct responses—before and after intervention and between groups. We also evaluated differences in the exploration behavior, e.g., scanning speed. EEG was employed to examine the effects of the intervention on brain activity, particularly in the alpha frequency band (8–13 Hz) associated with sensory processing. We found that participants in the SES group improved their task performance after intervention and their scanning speed during and after intervention, while the sham group did not improve their task performance. However, the differences in task performance improvements between groups only approached significance. Furthermore, we found that alpha power was sensitive to the effects of SES; participants in the stimulation group exhibited enhanced brain signals associated with improved touch sensitivity likely due to the effects of SES on the central nervous system, while the increase in alpha power for the sham group was less pronounced. Our findings suggest that SES enhances texture discrimination after training and has a positive effect on sensory-related brain areas. Further research involving brain-injured patients is needed to confirm the potential benefit of our solution in neurorehabilitation.

In stroke rehabilitation, simple robotic devices hold the potential to increase the training dosage in group therapies and to enable continued therapy at home after hospital discharge. However, we identified a lack of portable and cost-effective devices that not only focus on improving motor functions but also address sensory deficits. Thus, we designed a minimally-actuated hand training device that incorporates active grasping movements and passive pronosupination, complemented by a rehabilitative game with meaningful haptic feedback. Following a human-centered design approach, we conducted a usability study with 13 healthy participants, including three therapists. In a simulated unsupervised environment, the naive participants had to set up and use the device based on written instructions. Our mixed-methods approach included quantitative data from performance metrics, standardized questionnaires, and eye tracking, alongside qualitative feedback from semi-structured interviews. The study results highlighted the device's overall ease of setup and use, as well as its realistic haptic feedback. The eye-tracking analysis further suggested that participants felt safe during usage. Moreover, the study provided crucial insights for future improvements such as a more intuitive and comfortable wrist fixation, more natural pronosupination movements, and easier-to-follow instructions. Our research underscores the importance of continuous testing in the development process and offers significant contributions to the design of user-friendly, unsupervised neurorehabilitation technologies to improve sensorimotor stroke rehabilitation.

In current virtual reality settings for motor skill training, only visual information is usually provided regarding the virtual objects the trainee interacts with. However, information gathered through cutaneous (tactile feedback) and muscle mechanoreceptors (kinesthetic feedback) regarding, e.g., object shape, is crucial to successfully interact with those objects. To provide this essential information, previous haptic interfaces have targeted to render either tactile or kinesthetic feedback while the effectiveness of multimodal tactile and kinesthetic feedback on the perception of the characteristics of virtual objects still remains largely unexplored. Here, we present the results from an experiment we conducted with sixteen participants to evaluate the effectiveness of multimodal tactile and kinesthetic feedback on shape perception. Using a within-subject design, participants were asked to reproduce virtual shapes after exploring them without visual feedback and with either congruent tactile and kinesthetic feedback or with only kinesthetic feedback. Tactile feedback was provided with a cable-driven platform mounted on the fingertip, while kinesthetic feedback was provided using a haptic glove. To measure the participants’ ability to perceive and reproduce the rendered shapes, we measured the time participants spent exploring and reproducing the shapes and the error between the rendered and reproduced shapes after exploration. Furthermore, we assessed the participants’ workload and motivation using well-established questionnaires. We found that concurrent tactile and kinesthetic feedback during shape exploration resulted in lower reproduction errors and longer reproduction times. The longer reproduction times for the combined condition may indicate that participants could learn the shapes better and, thus, were more careful when reproducing them. We did not find differences between conditions in the time spent exploring the shapes or the participants’ workload and motivation. The lack of differences in workload between conditions could be attributed to the reported minimal-to-intermediate workload levels, suggesting that there was little room to further reduce the workload. Our work highlights the potential advantages of multimodal congruent tactile and kinesthetic feedback when interacting with tangible virtual objects with applications in virtual simulators for hands-on training applications.

Abstract Background In the past decade, there has been substantial progress in the development of robotic controllers that specify how lower-limb exoskeletons should interact with brain-injured patients. However, it is still an open question which exoskeleton control strategies can more effectively stimulate motor function recovery. In this review, we aim to complement previous literature surveys on the topic of exoskeleton control for gait rehabilitation by: (1) providing an updated structured framework of current control strategies, (2) analyzing the methodology of clinical validations used in the robotic interventions, and (3) reporting the potential relation between control strategies and clinical outcomes. Methods Four databases were searched using database-specific search terms from January 2000 to September 2020. We identified 1648 articles, of which 159 were included and evaluated in full-text. We included studies that clinically evaluated the effectiveness of the exoskeleton on impaired participants, and which clearly explained or referenced the implemented control strategy. Results (1) We found that assistive control (100% of exoskeletons) that followed rule-based algorithms (72%) based on ground reaction force thresholds (63%) in conjunction with trajectory-tracking control (97%) were the most implemented control strategies. Only 14% of the exoskeletons implemented adaptive control strategies. (2) Regarding the clinical validations used in the robotic interventions, we found high variability on the experimental protocols and outcome metrics selected. (3) With high grade of evidence and a moderate number of participants (N = 19), assistive control strategies that implemented a combination of trajectory-tracking and compliant control showed the highest clinical effectiveness for acute stroke. However, they also required the longest training time. With high grade of evidence and low number of participants (N = 8), assistive control strategies that followed a threshold-based algorithm with EMG as gait detection metric and control signal provided the highest improvements with the lowest training intensities for subacute stroke. Finally, with high grade of evidence and a moderate number of participants (N = 19), assistive control strategies that implemented adaptive oscillator algorithms together with trajectory-tracking control resulted in the highest improvements with reduced training intensities for individuals with chronic stroke. Conclusions Despite the efforts to develop novel and more effective controllers for exoskeleton-based gait neurorehabilitation, the current level of evidence on the effectiveness of the different control strategies on clinical outcomes is still low. There is a clear lack of standardization in the experimental protocols leading to high levels of heterogeneity. Standardized comparisons among control strategies analyzing the relation between control parameters and biomechanical metrics will fill this gap to better guide future technical developments. It is still an open question whether controllers that provide an on-line adaptation of the control parameters based on key biomechanical descriptors associated to the patients’ specific pathology outperform current control strategies.

Abstract Background The relearning of movements after brain injury can be optimized by providing intensive, meaningful, and motivating training using virtual reality (VR). However, most current solutions use two-dimensional (2D) screens, where patients interact via symbolic representations of their limbs (e.g., a cursor). These 2D screens lack depth cues, potentially deteriorating movement quality and increasing cognitive load. Head-mounted displays (HMDs) have great potential to provide naturalistic movement visualization by incorporating improved depth cues, reduce visuospatial transformations by rendering movements in the space where they are performed, and preserve eye-hand coordination by showing an avatar—with immersive VR (IVR)—or the user’s real body—with augmented reality (AR). However, elderly populations might not find these novel technologies usable, hampering potential motor and cognitive benefits. Methods We compared movement quality, cognitive load, motivation, and system usability in twenty elderly participants (>59 years old) while performing a dual motor-cognitive task with different visualization technologies: IVR HMD, AR HMD, and a 2D screen. We evaluated participants’ self-reported cognitive load, motivation, and usability using questionnaires. We also conducted a pilot study with five brain-injured patients comparing the visualization technologies while using an assistive device. Results Elderly participants performed straighter, shorter duration, and smoother movements when the task was visualized with the HMDs than screen. The IVR HMD led to shorter duration movements than AR. Movement onsets were shorter with IVR than AR, and shorter for both HMDs than the screen, potentially indicating facilitated reaction times due to reduced cognitive load. No differences were found in the questionnaires regarding cognitive load, motivation, or usability between technologies in elderly participants. Both HMDs proved high usability in our small sample of patients. Conclusions HMDs are a promising technology to be incorporated into neurorehabilitation, as their more naturalistic movement visualization improves movement quality compared to conventional screens. HMDs demonstrate high usability, without decreasing participants’ motivation, and might potentially lower cognitive load. Our preliminary clinical results suggest that brain-injured patients may especially benefit from more immersive technologies. However, larger patient samples are needed to draw stronger conclusions.**

Immersive Virtual Reality (IVR) has gained popularity in neurorehabilitation for its potential to increase patients’ motivation and engagement. A crucial yet relatively unexplored aspect of IVR interfaces is the patients’ representation in the virtual world, such as with an avatar. A higher level of embodiment over avatars has been shown to enhance motor performance during upper limb training and has the potential to be employed to enhance neurorehabilitation. However, the relationship between avatar embodiment and gait performance remains unexplored. In this work, we present the results of a pilot study with 12 healthy young participants that evaluates the effect of different virtual lower limb representations on foot placement accuracy while stepping over a trail of 16 virtual targets. We compared three levels of virtual representation: i) a full-body avatar, ii) only feet, and iii) no representation. Full-body tracking is computed using standard VR trackers to synchronize the avatar with the participants’ motions. Foot placement accuracy is measured as the distance between the foot’s center of mass and the center of the selected virtual target. Additionally, we evaluated the level of embodiment over each virtual representation through a questionnaire. Our findings indicate that foot placement accuracy increases with some form of virtual representation, either full-body or foot, compared to having no virtual representation. However, the foot and full-body representations do not show significant differences in accuracy. Importantly, we found a negative correlation between the level of embodiment of the foot representation and the distance between the placed foot and the target. However, no such correlation was found for the full-body representation. Our results highlight the importance of embodying a virtual representation of the foot when performing a task that requires accurate foot placement. However, showing a full-body avatar does not appear to further enhance accuracy. Moreover, our results suggest that the level of embodiment of the virtual feet might modulate motor performance in this stepping task. This work motivates future research on the effect of embodiment over virtual representations on motor control to be exploited for IVR gait rehabilitation.

Abstract Background Current robot-aided training allows for high-intensity training but might hamper the transfer of learned skills to real daily tasks. Many of these tasks, e.g., carrying a cup of coffee, require manipulating objects with complex dynamics. Thus, the absence of somatosensory information regarding the interaction with virtual objects during robot-aided training might be limiting the potential benefits of robotic training on motor (re)learning. We hypothesize that providing somatosensory information through the haptic rendering of virtual environments might enhance motor learning and skill transfer. Furthermore, the inclusion of haptic rendering might increase the task realism, enhancing participants’ agency and motivation. Providing arm weight support during training might also enhance learning by limiting participants’ fatigue. Methods We conducted a study with 40 healthy participants to evaluate how haptic rendering and arm weight support affect motor learning and skill transfer of a dynamic task. The task consisted of inverting a virtual pendulum whose dynamics were haptically rendered on an exoskeleton robot designed for upper limb neurorehabilitation. Participants trained with or without haptic rendering and with or without weight support. Participants’ task performance, movement strategy, effort, motivation, and agency were evaluated during baseline, short- and long-term retention. We also evaluated if the skills acquired during training transferred to a similar task with a shorter pendulum. Results We found that haptic rendering significantly increases participants’ movement variability during training and the ability to synchronize their movements with the pendulum, which is correlated with better performance. Weight support also enhances participants’ movement variability during training and reduces participants’ physical effort. Importantly, we found that training with haptic rendering enhances motor learning and skill transfer, while training with weight support hampers learning compared to training without weight support. We did not observe any significant differences between training modalities regarding agency and motivation during training and retention tests. Conclusion Haptic rendering is a promising tool to boost robot-aided motor learning and skill transfer to tasks with similar dynamics. However, further work is needed to find how to simultaneously provide robotic assistance and haptic rendering without hampering motor learning, especially in brain-injured patients. Trial registration https://clinicaltrials.gov/show/NCT04759976

To promote motor learning, robotic devices have been used to improve subjects' performance by guiding desired movements (haptic guidance-HG) or by artificially increasing movement errors to foster a more rapid learning (error amplification-EA). To better understand the neurophysiological basis of motor learning, a few studies have evaluated brain regions activated during EA/HG, but none has compared both approaches. The goal of this study was to investigate using fMRI which brain networks were activated during a single training session of HG/EA in healthy adults learning to play a computerized pinball-like timing task. Subjects had to trigger a robotic device by flexing their wrist at the correct timing to activate a virtual flipper and hit a falling ball towards randomly positioned targets. During training with HG/EA, subjects' timing errors were decreased/increased, respectively, by the robotic device to delay or accelerate their wrist movement. The results showed that at the beginning of the training period with HG/EA, an error-detection network, including cerebellum and angular gyrus, was activated, consistent with subjects recognizing discrepancies between their intended actions and the actual movement timing. At the end of the training period, an error-detection network was still present for EA, while a memory consolidation/automatization network (caudate head and parahippocampal gyrus) was activated for HG. The results indicate that training movement with various kinds of robotic input relies on different brain networks. Better understanding the neurophysiological underpinnings of brain processes during HG/EA could prove useful for optimizing rehabilitative movement training for people with different patterns of brain damage.

Combining immersive virtual reality (VR) using head-mounted displays (HMDs) with assisting robotic devices might be a promising procedure to enhance neurorehabilitation. However, it is still an open question how immersive virtual environments (VE) should be designed when interacting with rehabilitation robots. In conventional training, the robot is usually not visually represented in the VE, resulting in a visuo-haptic sensory conflict between what users see and feel. This study aimed to investigate how motivation, embodiment, and presence are affected by this visuo-haptic sensory conflict. Using an HMD and a rehabilitation robot, 28 healthy participants performed a path-tracing task, while the robot was either visually reproduced in the VE or not and while the robot either assisted the movements or not. Participants’ performance and visual attention were measured during the tasks, and after each visibility/assistance condition, they reported their motivation, presence, and embodiment with questionnaires. We found that, independently of the assistance, the robot visibility did not affect participants’ motivation, presence, embodiment, nor task performance. We only found a greater effort/importance reported when the robot was visible. The visual attention was also slightly affected by the robot’s visibility. Importantly, we found that the robotic assistance hampered presence and embodiment, but improved motivation. Our results indicate no disadvantage of not reproducing robotic devices in VEs when using HMDs. However, caution must be put when developing assisting controllers, as they might hamper users’ affect.

Stroke survivors are commonly affected by somatosensory impairment, hampering their ability to interpret somatosensory information. Somatosensory information has been shown to critically support movement execution in healthy individuals and stroke survivors. Despite the detrimental effect of somatosensory impairments on performing activities of daily living, somatosensory training—in stark contrast to motor training—does not represent standard care in neurorehabilitation. Reasons for the neglected somatosensory treatment are the lack of high-quality research demonstrating the benefits of somatosensory interventions on stroke recovery, the unavailability of reliable quantitative assessments of sensorimotor deficits, and the labor-intensive nature of somatosensory training that relies on therapists guiding the hands of patients with motor impairments. To address this clinical need, we developed a virtual reality-based robotic texture discrimination task to assess and train touch sensibility. Our system incorporates the possibility to robotically guide the participants' hands during texture exploration (i.e., passive touch) and no-guided free texture exploration (i.e., active touch). We ran a 3-day experiment with thirty-six healthy participants who were asked to discriminate the odd texture among three visually identical textures –haptically rendered with the robotic device– following the method of constant stimuli. All participants trained with the passive and active conditions in randomized order on different days. We investigated the reliability of our system using the Intraclass Correlation Coefficient (ICC). We also evaluated the enhancement of participants' touch sensibility via somatosensory retraining and compared whether this enhancement differed between training with active vs. passive conditions. Our results showed that participants significantly improved their task performance after training. Moreover, we found that training effects were not significantly different between active and passive conditions, yet, passive exploration seemed to increase participants' perceived competence. The reliability of our system ranged from poor (in active condition) to moderate and good (in passive condition), probably due to the dependence of the ICC on the between-subject variability, which in a healthy population is usually small. Together, our virtual reality-based robotic haptic system may be a key asset for evaluating and retraining sensory loss with minimal supervision, especially for brain-injured patients who require guidance to move their hands.