Search

It is crucial for robots to autonomously steer in complex environments safely without colliding with any obstacles. Compared to conventional methods, deep reinforcement learning-based methods are able to learn from past experiences automatically and enhance the generalization capability to cope with unseen circumstances. Therefore, we propose an end-to-end deep reinforcement learning algorithm in this paper to improve the performance of autonomous steering in complex environments. By embedding a branching noisy dueling architecture, the proposed model is capable of deriving steering commands directly from raw depth images with high efficiency. Specifically, our learning-based approach extracts the feature representation from depth inputs through convolutional neural networks and maps it to both linear and angular velocity commands simultaneously through different streams of the network. Moreover, the training framework is also meticulously designed to improve the learning efficiency and effectiveness. It is worth noting that the developed system is readily transferable from virtual training scenarios to real-world deployment without any fine-tuning by utilizing depth images. The proposed method is evaluated and compared with a series of baseline methods in various virtual environments. Experimental results demonstrate the superiority of the proposed model in terms of average reward, learning efficiency, success rate as well as computational time. Moreover, a variety of real-world experiments are also conducted which reveal the high adaptability of our model to both static and dynamic obstacle-cluttered environments. [ABSTRACT FROM AUTHOR]

Throughout the last decade, a whole new generation of powered transtibial prostheses and exoskeletons has been developed. However, these technologies are limited by a gait phase detection which controls the wearable device as a function of the activities of the wearer. Consequently, gait phase detection is considered to be of great importance, as achieving high detection accuracy will produce a more precise, stable, and safe rehabilitation device. In this paper, we propose a novel gait percent detection algorithm that can predict a full gait cycle discretised within a 1% interval. We called this algorithm an exponentially delayed fully connected neural network (ED-FNN). A dataset was obtained from seven healthy subjects that performed daily walking activities on the flat ground and a 15-degree slope. The signals were taken from only one inertial measurement unit (IMU) attached to the lower shank. The dataset was divided into training and validation datasets for every subject, and the mean square error (MSE) error between the model prediction and the real percentage of the gait was computed. An average MSE of 0.00522 was obtained for every subject in both training and validation sets, and an average MSE of 0.006 for the training set and 0.0116 for the validation set was obtained when combining all subjects’ signals together. Although our experiments were conducted in an offline setting, due to the forecasting capabilities of the ED-FNN, our system provides an opportunity to eliminate detection delays for real-time applications. [ABSTRACT FROM AUTHOR]

Recently, short-term traffic prediction under conditions with corrupted or missing data has become a popular topic. Since a road section has predictive power regarding the adjacent roads at a specific location, this paper proposes a novel hybrid convolutional long short-term memory neural network model based on critical road sections (CRS-ConvLSTM NN) to predict the traffic evolution of global networks. The critical road sections that have the most powerful impact on the subnetwork are identified by a spatiotemporal correlation algorithm. Subsequently, the traffic speed of the critical road sections is used as the input to the ConvLSTM to predict the future traffic states of the entire network. The experimental results from a Beijing traffic network indicate that the CRS-ConvLSTM outperforms prevailing deep learning (DL) approaches for cases that consider critical road sections and the results validate the capability and generalizability of the model when predicting with different numbers of critical road sections. [ABSTRACT FROM AUTHOR]