Search

Freezing of gait (FOG) severely incapacitates the mobility of patients with advanced Parkinson’s disease (PD). An accurate prediction of the onset of FOG could improve the quality of life for PD patients. However, it is imperative to distinguish the possibility of the onset of FOG from that of voluntary stopping. Our previous work demonstrated the neurological differences between the transition to FOG and voluntary stopping using electroencephalogram (EEG) signals. We employed a timed up-and-go (TUG) task to elicit FOG in PD patients. Some of these TUG tasks had an additional voluntary stopping component, where participants stopped walking based on verbal instruction to “stop”. The performance of the convolutional neural network (CNN) in identifying the transition to FOG from normal walking and the transition to voluntary stopping was explored. To the best of our knowledge, this work is the first study to propose a deep learning method to distinguish the transition to FOG from the transition to voluntary stop in PD patients. The models, trained on the EEG data from 17 PD patients who manifested FOG episodes, considering a short two-second transition window for FOG occurrence or voluntary stopping, achieved close to 75% classification accuracy in distinguishing transition to FOG from the transition to voluntary stopping or normal walking. Our results represent an important step toward advanced EEG-based cueing systems for smart FOG intervention, excluding the potential confounding of voluntary stopping.

The modelling of trust values on agents is broadly considered fundamental for decision-making in human-autonomous teaming (HAT) systems. Compared to the evaluation of trust values for robotic agents, estimating human trust is more challenging due to trust miscalibration issues, including undertrust and overtrust problems. From a subjective perception, human trust could be altered along with dynamic human cognitive states, which makes trust values hard to calibrate properly. Thus, in an attempt to capture the dynamics of human trust, the present study evaluated the dynamic nature of trust for human agents through real-time multievidence measures, including human states of attention, stress and perception abilities. The proposed multievidence human trust model applied an adaptive fusion method based on fuzzy reinforcement learning to fuse multievidence from eye trackers, heart rate monitors and human awareness. In addition, fuzzy reinforcement learning was applied to generate rewards via a fuzzy logic inference process that has tolerance for uncertainty in human physiological signals. The results of robot simulation suggest that the proposed trust model can generate reliable human trust values based on real-time cognitive states in the process of ongoing tasks. Moreover, the human-autonomous team with the proposed trust model improved the system efficiency by over 50% compared to the team with only autonomous agents. These results may demonstrate that the proposed model could provide insight into the real-time adaptation of HAT systems based on human states and, thus, might help develop new ways to enhance future HAT systems better.

Organised attacks on a computer system to test existing defences, i.e., penetration testing, have been used extensively to evaluate network security. However, penetration testing is a time-consuming process. Additionally, establishing a strategy that resembles a real cyber-attack typically requires in-depth knowledge of the cybersecurity domain. This paper presents a novel architecture, named deep cascaded reinforcement learning agents, or CRLA, that addresses large discrete action spaces in an autonomous penetration testing simulator, where the number of actions exponentially increases with the complexity of the designed cybersecurity network. Employing an algebraic action decomposition strategy, CRLA is shown to find the optimal attack policy in scenarios with large action spaces faster and more stably than a conventional deep Q-learning agent, which is commonly used as a method for applying artificial intelligence to autonomous penetration testing.

This paper discusses a novel approach to an EEG (electroencephalogram)-based driver distraction classification by using brain connectivity estimators as features. Ten healthy volunteers with more than one year of driving experience and an average age of 24.3 participated in a virtual reality environment with two conditions, a simple math problem-solving task and a lane-keeping task to mimic the distracted driving task and a non-distracted driving task, respectively. Independent component analysis (ICA) was conducted on the selected epochs of six selected components relevant to the frontal, central, parietal, occipital, left motor, and right motor areas. Granger–Geweke causality (GGC), directed transfer function (DTF), partial directed coherence (PDC), and generalized partial directed coherence (GPDC) brain connectivity estimators were used to calculate the connectivity matrixes. These connectivity matrixes were used as features to train the support vector machine (SVM) with the radial basis function (RBF) and classify the distracted and non-distracted driving tasks. GGC, DTF, PDC, and GPDC connectivity estimators yielded the classification accuracies of 82.27%, 70.02%, 86.19%, and 80.95%, respectively. Further analysis of the PDC connectivity estimator was conducted to determine the best window to differentiate between the distracted and non-distracted driving tasks. This study suggests that the PDC connectivity estimator can yield better classification accuracy for driver distractions.

Stress is an inherent part of the normal human experience. Although, for the most part, this stress response is advantageous, chronic, heightened, or inappropriate stress responses can have deleterious effects on the human body. It has been suggested that individuals who experience repeated or prolonged stress exhibit blunted biological stress responses when compared to the general population. Thus, when assessing whether a ubiquitous stress response exists, it is important to stratify based on resting levels in the absence of stress. Research has shown that stress that causes symptomatic responses requires early intervention in order to mitigate possible associated mental health decline and personal risks. Given this, real-time monitoring of stress may provide immediate biofeedback to the individual and allow for early self-intervention. This study aimed to determine if the change in heart rate variability could predict, in two different cohorts, the quality of response to acute stress when exposed to an acute stressor and, in turn, contribute to the development of a physiological algorithm for stress which could be utilized in future smartwatch technologies. This study also aimed to assess whether baseline stress levels may affect the changes seen in heart rate variability at baseline and following stress tasks. A total of 30 student doctor participants and 30 participants from the general population were recruited for the study. The Trier Stress Test was utilized to induce stress, with resting and stress phase ECGs recorded, as well as inter-second heart rate (recorded using a FitBit). Although the present study failed to identify ubiquitous patterns of HRV and HR changes during stress, it did identify novel changes in these parameters between resting and stress states. This study has shown that the utilization of HRV as a measure of stress should be calculated with consideration of resting (baseline) anxiety and stress states in order to ensure an accurate measure of the effects of additive acute stress.

A new online multi-class learning algorithm is proposed with three main characteristics. First, in order to make the feature pool fitter for the pattern pool, the adaptive feature pool is proposed to dynamically combine the three general features, Haar-like, Histogram of Oriented Gradient (HOG), and Local Binary Patterns (LBP). Second, the external model is integrated into the proposed model without re-training to enhance the efficacy of the model. Third, a new multi-class learning and updating mechanism are proposed that help to find unsuitable decisions and adjust them automatically. The performance of the proposed model is validated with multi-class detection and online learning system. The proposed model achieves a better score than other non-deep learning algorithms used in public pedestrian and multi-class databases. The multi-class databases contain data for pedestrians, faces, vehicles, motorcycles, bicycles, and aircraft.

In the assistive research area, human–computer interface (HCI) technology is used to help people with disabilities by conveying their intentions and thoughts to the outside world. Many HCI systems based on eye movement have been proposed to assist people with disabilities. However, due to the complexity of the necessary algorithms and the difficulty of hardware implementation, there are few general-purpose designs that consider practicality and stability in real life. Therefore, to solve these limitations and problems, an HCI system based on electrooculography (EOG) is proposed in this study. The proposed classification algorithm provides eye-state detection, including the fixation, saccade, and blinking states. Moreover, this algorithm can distinguish among ten kinds of saccade movements (i.e., up, down, left, right, farther left, farther right, up-left, down-left, up-right, and down-right). In addition, we developed an HCI system based on an eye-movement classification algorithm. This system provides an eye-dialing interface that can be used to improve the lives of people with disabilities. The results illustrate the good performance of the proposed classification algorithm. Moreover, the EOG-based system, which can detect ten different eye-movement features, can be utilized in real-life applications.

Subgroup label ranking aims to rank groups of labels using a single ranking model, is a new problem faced in preference learning. This paper introduces the Subgroup Preference Neural Network (SGPNN) that combines multiple networks have different activation function, learning rate, and output layer into one artificial neural network (ANN) to discover the hidden relation between the subgroups’ multi-labels. The SGPNN is a feedforward (FF), partially connected network that has a single middle layer and uses stairstep (SS) multi-valued activation function to enhance the prediction’s probability and accelerate the ranking convergence. The novel structure of the proposed SGPNN consists of a multi-activation function neuron (MAFN) in the middle layer to rank each subgroup independently. The SGPNN uses gradient ascent to maximize the Spearman ranking correlation between the groups of labels. Each label is represented by an output neuron that has a single SS function. The proposed SGPNN using conjoint dataset outperforms the other label ranking methods which uses each dataset individually. The proposed SGPNN achieves an average accuracy of 91.4% using the conjoint dataset compared to supervised clustering, decision tree, multilayer perceptron label ranking and label ranking forests that achieve an average accuracy of 60%, 84.8%, 69.2% and 73%, respectively, using the individual dataset.

Recently, there has been an increase in the production of devices to monitor mental health and stress as means for expediting detection, and subsequent management of these conditions. The objective of this review is to identify and critically appraise the most recent smart devices and wearable technologies used to identify depression, anxiety, and stress, and the physiological process(es) linked to their detection. The MEDLINE, CINAHL, Cochrane Central, and PsycINFO databases were used to identify studies which utilised smart devices and wearable technologies to detect or monitor anxiety, depression, or stress. The included articles that assessed stress and anxiety unanimously used heart rate variability (HRV) parameters for detection of anxiety and stress, with the latter better detected by HRV and electroencephalogram (EGG) together. Electrodermal activity was used in recent studies, with high accuracy for stress detection; however, with questionable reliability. Depression was found to be largely detected using specific EEG signatures; however, devices detecting depression using EEG are not currently available on the market. This systematic review highlights that average heart rate used by many commercially available smart devices is not as accurate in the detection of stress and anxiety compared with heart rate variability, electrodermal activity, and possibly respiratory rate.

This paper proposes a novel approach for selecting a subset of features in semi-supervised datasets where only some of the patterns are labeled. The whole process is completed in two phases. In the first phase, i.e., Phase-I, the whole dataset is divided into two parts: The first part, which contains labeled patterns, and the second part, which contains unlabeled patterns. In the first part, a small number of features are identified using well-known maximum relevance (from first part) and minimum redundancy (whole dataset) based feature selection approaches using the correlation coefficient. The subset of features from the identified set of features, which produces a high classification accuracy using any supervised classifier from labeled patterns, is selected for later processing. In the second phase, i.e., Phase-II, the patterns belonging to the first and second part are clustered separately into the available number of classes of the dataset. In the clusters of the first part, take the majority of patterns belonging to a cluster as the class for that cluster, which is given already. Form the pairs of cluster centroids made in the first and second part. The centroid of the second part nearest to a centroid of the first part will be paired. As the class of the first centroid is known, the same class can be assigned to the centroid of the cluster of the second part, which is unknown. The actual class of the patterns if known for the second part of the dataset can be used to test the classification accuracy of patterns in the second part. The proposed two-phase approach performs well in terms of classification accuracy and number of features selected on the given benchmarked datasets.

A brain−computer interface (BCI) is a type of interface/communication system that can help users interact with their environments. Electroencephalography (EEG) has become the most common application of BCIs and provides a way for disabled individuals to communicate. While wet sensors are the most commonly used sensors for traditional EEG measurements, they require considerable preparation time, including the time needed to prepare the skin and to use the conductive gel. Additionally, the conductive gel dries over time, leading to degraded performance. Furthermore, requiring patients to wear wet sensors to record EEG signals is considered highly inconvenient. Here, we report a wireless 8-channel digital active-circuit EEG signal acquisition system that uses dry sensors. Active-circuit systems for EEG measurement allow people to engage in daily life while using these systems, and the advantages of these systems can be further improved by utilizing dry sensors. Moreover, the use of dry sensors can help both disabled and healthy people enjoy the convenience of BCIs in daily life. To verify the reliability of the proposed system, we designed three experiments in which we evaluated eye blinking and teeth gritting, measured alpha waves, and recorded event-related potentials (ERPs) to compare our developed system with a standard Neuroscan EEG system.

In the present study, novel dry-contact sensors for measuring electro-encephalography (EEG) signals without any skin preparation are designed, fabricated by an injection molding manufacturing process and experimentally validated. Conventional wet electrodes are commonly used to measure EEG signals; they provide excellent EEG signals subject to proper skin preparation and conductive gel application. However, a series of skin preparation procedures for applying the wet electrodes is always required and usually creates trouble for users. To overcome these drawbacks, novel dry-contact EEG sensors were proposed for potential operation in the presence or absence of hair and without any skin preparation or conductive gel usage. The dry EEG sensors were designed to contact the scalp surface with 17 spring contact probes. Each probe was designed to include a probe head, plunger, spring, and barrel. The 17 probes were inserted into a flexible substrate using a one-time forming process via an established injection molding procedure. With these 17 spring contact probes, the flexible substrate allows for high geometric conformity between the sensor and the irregular scalp surface to maintain low skin-sensor interface impedance. Additionally, the flexible substrate also initiates a sensor buffer effect, eliminating pain when force is applied. The proposed dry EEG sensor was reliable in measuring EEG signals without any skin preparation or conductive gel usage, as compared with the conventional wet electrodes.

This study investigates alternative material compositions for flexible silicone-based dry electroencephalography (EEG) electrodes to improve the performance lifespan while maintaining high-fidelity transmission of EEG signals. Electrode materials were fabricated with varying concentrations of silver-coated silica and silver flakes to evaluate their electrical, mechanical, and EEG transmission performance. Scanning electron microscope (SEM) analysis of the initial electrode development identified some weak points in the sensors’ construction, including particle pull-out and ablation of the silver coating on the silica filler. The newly-developed sensor materials achieved significant improvement in EEG measurements while maintaining the advantages of previous silicone-based electrodes, including flexibility and non-toxicity. The experimental results indicated that the proposed electrodes maintained suitable performance even after exposure to temperature fluctuations, 85% relative humidity, and enhanced corrosion conditions demonstrating improvements in the environmental stability. Fabricated flat (forehead) and acicular (hairy sites) electrodes composed of the optimum identified formulation exhibited low impedance and reliable EEG measurement; some initial human experiments demonstrate the feasibility of using these silicone-based electrodes for typical lab data collection applications.

At present, traditional visual-based surveillance systems are becoming impractical, inefficient, and time-consuming. Automation-based surveillance systems appeared to overcome these limitations. However, the automatic systems have some challenges such as occlusion and retaining images smoothly and continuously. This research proposes a weighted resampling particle filter approach for human tracking to handle these challenges. The primary functions of the proposed system are human detection, human monitoring, and camera control. We used the codebook matching algorithm to define the human region as a target and track it, and we used the practical filter algorithm to follow and extract the target information. Consequently, the obtained information was used to configure the camera control. The experiments were tested in various environments to prove the stability and performance of the proposed system based on the active camera.