Search

Deep Brain Stimulation (DBS) is effective for movement disorders, particularly Parkinson’s disease (PD). However, a closed-loop DBS system using reinforcement learning (RL) for automatic parameter tuning, offering enhanced energy efficiency and the effect of thalamus restoration, is yet to be developed for clinical and commercial applications. In this research, we instantiate a basal ganglia-thalamic (BGT) model and design it as an interactive environment suitable for RL models. Four finely tuned RL agents based on different frameworks, namely Soft Actor-Critic (SAC), Twin Delayed Deep Deterministic Policy Gradient (TD3), Proximal Policy Optimization (PPO), and Advantage Actor-Critic (A2C), are established for further comparison. Within the implemented RL architectures, the optimized TD3 demonstrates a significant 67% reduction in average power dissipation when compared to the open-loop system while preserving the normal response of the simulated BGT circuitry. As a result, our method mitigates thalamic error responses under pathological conditions and prevents overstimulation. In summary, this study introduces a novel approach to implementing an adaptive parameter-tuning closed-loop DBS system. Leveraging the advantages of TD3, our proposed approach holds significant promise for advancing the integration of RL applications into DBS systems, ultimately optimizing therapeutic effects in future clinical trials.

Individuals with brachial plexus injury (BPI) require upper limb function restoration, but the treatment remains controversial. Vitamin B12 may aid in pain control and nerve regeneration. We present the technical aspects of ultrasound-guided perineural vitamin B12 injection for BPI. The demonstrative case is a 50-year-old man with BPI resulting from a traffic accident. Under ultrasound guidance, vitamin B12 was injected precisely into the brachial plexus compartment around the swollen neuroma of the C6 root. Motor and sensory functions of the left upper extremity improved over 6 months. Ultrasound-guided perineural vitamin B12 injection may be an efficient and personalized intervention in cases of post-ganglionic BPI that failed to improve in the first 3 months.