Search

Objective. The quality of electroencephalogram (EEG) signals directly impacts the performance of brain-computer interface (BCI) tasks. Many methods have been proposed to eliminate noise from EEG signals, but most of these methods focus solely on signal denoising itself, disregarding the impact on subsequent tasks, which deviates from the original intention of EEG denoising. The main objective of this study is to optimize EEG denoising models with a purpose of improving the performance of BCI tasks. Approach. To this end, we proposed an innovative task-oriented EEG denoising generative adversarial network (TOED-GAN) method. This network utilizes the generator of GAN to decompose and reconstruct clean signals from the raw EEG signals, and the discriminator to learn to distinguish the generated signals from the true clean signals, resulting in a remarkable increase of the signal-to-noise ratio by simultaneously enhancing task-related components and removing task-irrelevant noise from the original contaminated signals. Main results. We evaluated the performance of the model on a public dataset and a self-collected dataset respectively, with canonical correlation analysis classification tasks of the steady-state visual evoked potential (SSVEP) based BCI. Experimental results demonstrate that TOED-GAN exhibits excellent performance in removing EEG noise and improving performance for SSVEP-BCI, with accuracy improvement rates reaching 18.47% and 21.33% in contrast to the baseline methods of convolutional neural networks, respectively. Significance. This work proves that the proposed TOED-GAN, as an EEG denoising method tailored for SSVEP tasks, contributes to enhancing the performance of BCIs in practical application scenarios., (© 2024 IOP Publishing Ltd. All rights, including for text and data mining, AI training, and similar technologies, are reserved.)

Vigilance state is crucial for the effective performance of users in brain-computer interface (BCI) systems. Most vigilance estimation methods rely on a large amount of labeled data to train a satisfactory model for the specific subject, which limits the practical application of the methods. This study aimed to build a reliable vigilance estimation method using a small amount of unlabeled calibration data. We conducted a vigilance experiment in the designed BCI-based cursor-control task. Electroencephalogram (EEG) signals of eighteen participants were recorded in two sessions on two different days. And, we proposed a contrastive fine-grained domain adaptation network (CFGDAN) for vigilance estimation. Here, an adaptive graph convolution network (GCN) was built to project the EEG data of different domains into a common space. The fine-grained feature alignment mechanism was designed to weight and align the feature distributions across domains at the EEG channel level, and the contrastive information preservation module was developed to preserve the useful target-specific information during the feature alignment. The experimental results show that the proposed CFGDAN outperforms the compared methods in our BCI vigilance dataset and SEED-VIG dataset. Moreover, the visualization results demonstrate the efficacy of the designed feature alignment mechanisms. These results indicate the effectiveness of our method for vigilance estimation. Our study is helpful for reducing calibration efforts and promoting the practical application potential of vigilance estimation methods., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 Elsevier Ltd. All rights reserved.)

Objective. Serving as a channel for communication with locked-in patients or control of prostheses, sensorimotor brain-computer interfaces (BCIs) decode imaginary movements from the recorded activity of the user's brain. However, many individuals remain unable to control the BCI, and the underlying mechanisms are unclear. The user's BCI performance was previously shown to correlate with the resting-state signal-to-noise ratio (SNR) of the mu rhythm and the phase synchronization (PS) of the mu rhythm between sensorimotor areas. Yet, these predictors of performance were primarily evaluated in a single BCI session, while the longitudinal aspect remains rather uninvestigated. In addition, different analysis pipelines were used to estimate PS in source space, potentially hindering the reproducibility of the results. Approach. To systematically address these issues, we performed an extensive validation of the relationship between pre-stimulus SNR, PS, and session-wise BCI performance using a publicly available dataset of 62 human participants performing up to 11 sessions of BCI training. We performed the analysis in sensor space using the surface Laplacian and in source space by combining 24 processing pipelines in a multiverse analysis. This way, we could investigate how robust the observed effects were to the selection of the pipeline. Main results. Our results show that SNR had both between- and within-subject effects on BCI performance for the majority of the pipelines. In contrast, the effect of PS on BCI performance was less robust to the selection of the pipeline and became non-significant after controlling for SNR. Significance. Taken together, our results demonstrate that changes in neuronal connectivity within the sensorimotor system are not critical for learning to control a BCI, and interventions that increase the SNR of the mu rhythm might lead to improvements in the user's BCI performance., (Creative Commons Attribution license.)

Brain-computer interfaces (BCIs), representing a transformative form of human-computer interaction, empower users to interact directly with external environments through brain signals. In response to the demands for high accuracy, robustness, and end-to-end capabilities within BCIs based on motor imagery (MI), this paper introduces STaRNet, a novel model that integrates multi-scale spatio-temporal convolutional neural networks (CNNs) with Riemannian geometry. Initially, STaRNet integrates a multi-scale spatio-temporal feature extraction module that captures both global and local features, facilitating the construction of Riemannian manifolds from these comprehensive spatio-temporal features. Subsequently, a matrix logarithm operation transforms the manifold-based features into the tangent space, followed by a dense layer for classification. Without preprocessing, STaRNet surpasses state-of-the-art (SOTA) models by achieving an average decoding accuracy of 83.29% and a kappa value of 0.777 on the BCI Competition IV 2a dataset, and 95.45% accuracy with a kappa value of 0.939 on the High Gamma Dataset. Additionally, a comparative analysis between STaRNet and several SOTA models, focusing on the most challenging subjects from both datasets, highlights exceptional robustness of STaRNet. Finally, the visualizations of learned frequency bands demonstrate that temporal convolutions have learned MI-related frequency bands, and the t-SNE analyses of features across multiple layers of STaRNet exhibit strong feature extraction capabilities. We believe that the accurate, robust, and end-to-end capabilities of the STaRNet will facilitate the advancement of BCIs., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 Elsevier Ltd. All rights reserved.)

Affective brain-computer interface is an important part of realizing emotional human-computer interaction. However, existing objective individual differences among subjects significantly hinder the application of electroencephalography (EEG) emotion recognition. Existing methods still lack the complete extraction of subject-invariant representations for EEG and the ability to fuse valuable information from multiple subjects to facilitate the emotion recognition of the target subject. To address the above challenges, we propose a Multi-source Selective Graph Domain Adaptation Network (MSGDAN), which can better utilize data from different source subjects and perform more robust emotion recognition on the target subject. The proposed network extracts and selects the individual information specific to each subject, where public information refers to subject-invariant components from multi-source subjects. Moreover, the graph domain adaptation network captures both functional connectivity and regional states of the brain via a dynamic graph network and then integrates graph domain adaptation to ensure the invariance of both functional connectivity and regional states. To evaluate our method, we conduct cross-subject emotion recognition experiments on the SEED, SEED-IV, and DEAP datasets. The results demonstrate that the MSGDAN has superior classification performance., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 Elsevier Ltd. All rights reserved.)

In brain-computer interface (BCI), building accurate electroencephalogram (EEG) classifiers for specific mental tasks is critical for BCI performance. The classifiers are developed by machine learning (ML) and deep learning (DL) techniques, requiring a large dataset for training to build reliable and accurate models. However, collecting large enough EEG datasets is difficult due to intra-/inter-subject variabilities and experimental costs. This leads to the data scarcity problem, which causes overfitting issues to training samples, resulting in reducing generalization performance. To solve the EEG data scarcity problem and improve the performance of the EEG classifiers, we propose a novel EEG data augmentation (DA) framework using conditional generative adversarial networks (cGANs). An experimental study is implemented with two public EEG datasets, including motor imagery (MI) tasks (BCI competition IV IIa and III IVa), to validate the effectiveness of the proposed EEG DA method for the EEG classifiers. To evaluate the proposed cGAN-based DA method, we tested eight EEG classifiers for the experiment, including traditional MLs and state-of-the-art DLs with three existing EEG DA methods. Experimental results showed that most DA methods with proper DA proportion in the training dataset had higher classification performances than without DA. Moreover, applying the proposed DA method showed superior classification performance improvement than the other DA methods. This shows that the proposed method is a promising EEG DA method for enhancing the performances of the EEG classifiers in MI-based BCIs., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 Elsevier Ltd. All rights reserved.)

Objective. Brain-computer interfaces (BCI) have been extensively researched in controlled lab settings where the P300 event-related potential (ERP), elicited in the rapid serial visual presentation (RSVP) paradigm, has shown promising potential. However, deploying BCIs outside of laboratory settings is challenging due to the presence of contaminating artifacts that often occur as a result of activities such as talking, head movements, and body movements. These artifacts can severely contaminate the measured EEG signals and consequently impede detection of the P300 ERP. Our goal is to assess the impact of these real-world noise factors on the performance of a RSVP-BCI, specifically focusing on single-trial P300 detection. Approach. In this study, we examine the impact of movement activity on the performance of a P300-based RSVP-BCI application designed to allow users to search images at high speed. Using machine learning, we assessed P300 detection performance using both EEG data captured in optimal recording conditions (e.g. where participants were instructed to refrain from moving) and a variety of conditions where the participant intentionally produced movements to contaminate the EEG recording. Main results. The results, presented as area under the receiver operating characteristic curve (ROC-AUC) scores, provide insight into the significant impact of noise on single-trial P300 detection. Notably, there is a reduction in classifier detection accuracy when intentionally contaminated RSVP trials are used for training and testing, when compared to using non-intentionally contaminated RSVP trials. Significance. Our findings underscore the necessity of addressing and mitigating noise in EEG recordings to facilitate the use of BCIs in real-world settings, thus extending the reach of EEG technology beyond the confines of the laboratory., (Creative Commons Attribution license.)

The widely adopted paradigm in brain-computer interfaces (BCIs) involves motor imagery (MI), enabling improved communication between humans and machines. EEG signals derived from MI present several challenges due to their inherent characteristics, which lead to a complex process of classifying and finding the potential tasks of a specific participant. Another issue is that BCI systems can result in noisy data and redundant channels, which in turn can lead to increased equipment and computational costs. To address these problems, the optimal channel selection of a multiclass MI classification based on a Fusion convolutional neural network with Attention blocks (FCNNA) is proposed. In this study, we developed a CNN model consisting of layers of convolutional blocks with multiple spatial and temporal filters. These filters are designed specifically to capture the distribution and relationships of signal features across different electrode locations, as well as to analyze the evolution of these features over time. Following these layers, a Convolutional Block Attention Module (CBAM) is used to, further, enhance EEG signal feature extraction. In the process of channel selection, the genetic algorithm is used to select the optimal set of channels using a new technique to deliver fixed as well as variable channels for all participants. The proposed methodology is validated showing 6.41% improvement in multiclass classification compared to most baseline models. Notably, we achieved the highest results of 93.09% for binary classes involving left-hand and right-hand movements. In addition, the cross-subject strategy for multiclass classification yielded an impressive accuracy of 68.87%. Following channel selection, multiclass classification accuracy was enhanced, reaching 84.53%. Overall, our experiments illustrated the efficiency of the proposed EEG MI model in both channel selection and classification, showing superior results with either a full channel set or a reduced number of channels.

Objective. Brain-computer interface (BCI) systems with large directly accessible instruction sets are one of the difficulties in BCI research. Research to achieve high target resolution (⩾100) has not yet entered a rapid development stage, which contradicts the application requirements. Steady-state visual evoked potential (SSVEP) based BCIs have an advantage in terms of the number of targets, but the competitive mechanism between the target stimulus and its neighboring stimuli is a key challenge that prevents the target resolution from being improved significantly. Approach. In this paper, we reverse the competitive mechanism and propose a frequency spatial multiplexing method to produce more targets with limited frequencies. In the proposed paradigm, we replicated each flicker stimulus as a 2 × 2 matrix and arrange the matrices of all frequencies in a tiled fashion to form the interaction interface. With different arrangements, we designed and tested three example paradigms with different layouts. Further we designed a graph neural network that distinguishes between targets of the same frequency by recognizing the different electroencephalography (EEG) response distribution patterns evoked by each target and its neighboring targets. Main results. Extensive experiment studies employing eleven subjects have been performed to verify the validity of the proposed method. The average classification accuracies in the offline validation experiments for the three paradigms are 89.16%, 91.38%, and 87.90%, with information transfer rates (ITR) of 51.66, 53.96, and 50.55 bits/min, respectively. Significance. This study utilized the positional relationship between stimuli and did not circumvent the competing response problem. Therefore, other state-of-the-art methods focusing on enhancing the efficiency of SSVEP detection can be used as a basis for the present method to achieve very promising improvements., (Creative Commons Attribution license.)

Transfer learning (TL) has demonstrated its efficacy in addressing the cross-subject domain adaptation challenges in affective brain-computer interfaces (aBCI). However, previous TL methods usually use a stationary distance, such as Euclidean distance, to quantify the distribution dissimilarity between two domains, overlooking the inherent links among similar samples, potentially leading to suboptimal feature mapping. In this study, we introduced a novel algorithm called multi-source manifold metric transfer learning (MSMMTL) to enhance the efficacy of conventional TL. Specifically, we first selected the source domain based on Mahalanobis distance to enhance the quality of the source domains and then used manifold feature mapping approach to map the source and target domains on the Grassmann manifold to mitigate data drift between domains. In this newly established shared space, we optimized the Mahalanobis metric by maximizing the inter-class distances while minimizing the intra-class distances in the target domain. Recognizing that significant distribution discrepancies might persist across different domains even on the manifold, to ensure similar distributions between the source and target domains, we further imposed constraints on both domains under the Mahalanobis metric. This approach aims to reduce distributional disparities and enhance the electroencephalogram (EEG) emotion recognition performance. In cross-subject experiments, the MSMMTL model exhibits average classification accuracies of 88.83 % and 65.04 % for SEED and DEAP, respectively, underscoring the superiority of our proposed MSMMTL over other state-of-the-art methods. MSMMTL can effectively solve the problem of individual differences in EEG-based affective computing., Competing Interests: Declaration of competing interest The authors declare that they have no conflict of interests regarding the publication of this article., (Copyright © 2024 Elsevier Ltd. All rights reserved.)

Objective . The extensive application of electroencephalography (EEG) in brain-computer interfaces (BCIs) can be attributed to its non-invasive nature and capability to offer high-resolution data. The acquisition of EEG signals is a straightforward process, but the datasets associated with these signals frequently exhibit data scarcity and require substantial resources for proper labeling. Furthermore, there is a significant limitation in the generalization performance of EEG models due to the substantial inter-individual variability observed in EEG signals. Approach . To address these issues, we propose a novel self-supervised contrastive learning framework for decoding motor imagery (MI) signals in cross-subject scenarios. Specifically, we design an encoder combining convolutional neural network and attention mechanism. In the contrastive learning training stage, the network undergoes training with the pretext task of data augmentation to minimize the distance between pairs of homologous transformations while simultaneously maximizing the distance between pairs of heterologous transformations. It enhances the amount of data utilized for training and improves the network's ability to extract deep features from original signals without relying on the true labels of the data. Main results . To evaluate our framework's efficacy, we conduct extensive experiments on three public MI datasets: BCI IV IIa, BCI IV IIb, and HGD datasets. The proposed method achieves cross-subject classification accuracies of 67.32%, 82.34%, and 81.13%on the three datasets, demonstrating superior performance compared to existing methods. Significance . Therefore, this method has great promise for improving the performance of cross-subject transfer learning in MI-based BCI systems., (© 2024 IOP Publishing Ltd.)

Objective. The extended infomax algorithm for independent component analysis (ICA) can separate sub- and super-Gaussian signals but converges slowly as it uses stochastic gradient optimization. In this paper, an improved extended infomax algorithm is presented that converges much faster. Approach. Accelerated convergence is achieved by replacing the natural gradient learning rule of extended infomax by a fully-multiplicative orthogonal-group based update scheme of the ICA unmixing matrix, leading to an orthogonal extended infomax algorithm (OgExtInf). The computational performance of OgExtInf was compared with original extended infomax and with two fast ICA algorithms: the popular FastICA and Picard, a preconditioned limited-memory Broyden-Fletcher-Goldfarb-Shanno (L-BFGS) algorithm belonging to the family of quasi-Newton methods. Main results. OgExtInf converges much faster than original extended infomax. For small-size electroencephalogram (EEG) data segments, as used for example in online EEG processing, OgExtInf is also faster than FastICA and Picard. Significance. OgExtInf may be useful for fast and reliable ICA, e.g. in online systems for epileptic spike and seizure detection or brain-computer interfaces., (© 2024 IOP Publishing Ltd.)

The SSVEP-based paradigm serves as a prevalent approach in the realm of brain-computer interface (BCI). However, the processing of multi-channel electroencephalogram (EEG) data introduces challenges due to its non-Euclidean characteristic, necessitating methodologies that account for inter-channel topological relations. In this paper, we introduce the Dynamic Decomposition Graph Convolutional Neural Network (DDGCNN) designed for the classification of SSVEP EEG signals. Our approach incorporates layerwise dynamic graphs to address the oversmoothing issue in Graph Convolutional Networks (GCNs), employing a dense connection mechanism to mitigate the gradient vanishing problem. Furthermore, we enhance the traditional linear transformation inherent in GCNs with graph dynamic fusion, thereby elevating feature extraction and adaptive aggregation capabilities. Our experimental results demonstrate the effectiveness of proposed approach in learning and extracting features from EEG topological structure. The results shown that DDGCNN outperforms other state-of-the-art (SOTA) algorithms reported on two datasets (Dataset 1: 54 subjects, 4 targets, 2 sessions; Dataset 2: 35 subjects, 40 targets). Additionally, we showcase the implementation of DDGCNN in the context of synchronized BCI robotic fish control. This work represents a significant advancement in the field of EEG signal processing for SSVEP-based BCIs. Our proposed method processes SSVEP time domain signals directly as an end-to-end system, making it easy to deploy. The code is available at https://github.com/zshubin/DDGCNN., Competing Interests: Declaration of competing interest We declared this work has not been submitted elsewhere for publication, in whole or in part, and all the authors listed have approved the manuscript that is enclosed. There is no conflict of interest in this work that we should disclose specifically., (Copyright © 2023 Elsevier Ltd. All rights reserved.)

Objective . The number of electrode channels in a motor imagery-based brain-computer interface (MI-BCI) system influences not only its decoding performance, but also its convenience for use in applications. Although many channel selection methods have been proposed in the literature, they are usually based on the univariate features of a single channel. This leads to a loss of the interaction between channels and the exchange of information between networks operating at different frequency bands. Approach . We integrate brain networks containing four frequency bands into a multilayer network framework and propose a multilayer network-based channel selection (MNCS) method for MI-BCI systems. A graph learning-based method is used to estimate the multilayer network from electroencephalogram (EEG) data that are filtered by multiple frequency bands. The multilayer participation coefficient of the multilayer network is then computed to select EEG channels that do not contain redundant information. Furthermore, the common spatial pattern (CSP) method is used to extract effective features. Finally, a support vector machine classifier with a linear kernel is trained to accurately identify MI tasks. Main results . We used three publicly available datasets from the BCI Competition containing data on 12 healthy subjects and one dataset containing data on 15 stroke patients to validate the effectiveness of our proposed method. The results showed that the proposed MNCS method outperforms all channels (85.8% vs. 93.1%, 84.4% vs. 89.0%, 71.7% vs. 79.4%, and 72.7% vs. 84.0%). Moreover, it achieved significantly higher decoding accuracies on MI-BCI systems than state-of-the-art methods (paired t -tests, p < 0.05). Significance . The experimental results showed that the proposed MNCS method can select appropriate channels to improve the decoding performance as well as the convenience of the application of MI-BCI systems., (© 2024 IOP Publishing Ltd.)

Brain-computer interfaces (BCIs) based on motor imagery (MI) enable the disabled to interact with the world through brain signals. To meet demands of real-time, stable, and diverse interactions, it is crucial to develop lightweight networks that can accurately and reliably decode multi-class MI tasks. In this paper, we introduce BrainGridNet, a convolutional neural network (CNN) framework that integrates two intersecting depthwise CNN branches with 3D electroencephalography (EEG) data to decode a five-class MI task. The BrainGridNet attains competitive results in both the time and frequency domains, with superior performance in the frequency domain. As a result, an accuracy of 80.26 percent and a kappa value of 0.753 are achieved by BrainGridNet, surpassing the state-of-the-art (SOTA) model. Additionally, BrainGridNet shows optimal computational efficiency, excels in decoding the most challenging subject, and maintains robust accuracy despite the random loss of 16 electrode signals. Finally, the visualizations demonstrate that BrainGridNet learns discriminative features and identifies critical brain regions and frequency bands corresponding to each MI class. The convergence of BrainGridNet's strong feature extraction capability, high decoding accuracy, steady decoding efficacy, and low computational costs renders it an appealing choice for facilitating the development of BCIs., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2023 Elsevier Ltd. All rights reserved.)

This study delves into the application of Brain-Computer Interfaces (BCIs), focusing on exploiting Steady-State Visual Evoked Potentials (SSVEPs) as communication tools for individuals facing mobility impairments. SSVEP-BCI systems can swiftly transmit substantial volumes of information, rendering them suitable for diverse applications. However, the efficacy of SSVEP responses can be influenced by variables such as the frequency and color of visual stimuli. Through experiments involving participants equipped with electrodes on the brain's visual cortex, visual stimuli were administered at 4, 17, 25, and 40Hz, using white, red, yellow, green, and blue light sources. The results reveal that white and green stimuli evoke higher SSVEP responses at lower frequencies, with color's impact diminishing at higher frequencies. At low light intensity (1W), white and green stimuli elicit significantly higher SSVEP responses, while at high intensity (3W), responses across colors tend to equalize. Notably, due to seizure risks, red and blue lights should be used cautiously, with white and green lights preferred for SSVEP-BCI systems. This underscores the critical consideration of color and frequency in the design of effective and safe SSVEP-BCI systems, necessitating further research to optimize designs for clinical applications., (Copyright © 2024 Elsevier B.V. All rights are reserved, including those for text and data mining, AI training, and similar technologies.)

Objective . The day-to-day variability of electroencephalogram (EEG) poses a significant challenge to decode human brain activity in EEG-based passive brain-computer interfaces (pBCIs). Conventionally, a time-consuming calibration process is required to collect data from users on a new day to ensure the performance of the machine learning-based decoding model, which hinders the application of pBCIs to monitor mental workload (MWL) states in real-world settings. Approach . This study investigated the day-to-day stability of the raw power spectral density (PSD) and their periodic and aperiodic components decomposed by the Fitting Oscillations and One-Over-F algorithm. In addition, we validated the feasibility of using periodic components to improve cross-day MWL classification performance. Main results . Compared to the raw PSD (69.9% ± 18.5%) and the aperiodic component (69.4% ± 19.2%), the periodic component had better day-to-day stability and significantly higher cross-day classification accuracy (84.2% ± 11.0%). Significance . These findings indicate that periodic components of EEG have the potential to be applied in decoding brain states for more robust pBCIs., (© 2023 IOP Publishing Ltd.)

Stroke patients are prone to fatigue during the EEG acquisition procedure, and experiments have high requirements on cognition and physical limitations of subjects. Therefore, how to learn effective feature representation is very important. Deep learning networks have been widely used in motor imagery (MI) based brain-computer interface (BCI). This paper proposes a contrast predictive coding (CPC) framework based on the modified s-transform (MST) to generate MST-CPC feature representations. MST is used to acquire the temporal-frequency feature to improve the decoding performance for MI task recognition. EEG2Image is used to convert multi-channel one-dimensional EEG into two-dimensional EEG topography. High-level feature representations are generated by CPC which consists of an encoder and autoregressive model. Finally, the effectiveness of generated features is verified by the k -means clustering algorithm. It can be found that our model generates features with high efficiency and a good clustering effect. After classification performance evaluation, the average classification accuracy of MI tasks is 89% based on 40 subjects. The proposed method can obtain effective feature representations and improve the performance of MI-BCI systems. By comparing several self-supervised methods on the public dataset, it can be concluded that the MST-CPC model has the highest average accuracy. This is a breakthrough in the combination of self-supervised learning and image processing of EEG signals. It is helpful to provide effective rehabilitation training for stroke patients to promote motor function recovery.

Learning distinguishable features from raw EEG signals is crucial for accurate classification of motor imagery (MI) tasks. To incorporate spatial relationships between EEG sources, we developed a feature set based on an EEG graph. In this graph, EEG channels represent the nodes, with power spectral density (PSD) features defining their properties, and the edges preserving the spatial information. We designed an EEG based graph self-attention network (EGSAN) to learn low-dimensional embedding vector for EEG graph, which can be used as distinguishable features for motor imagery task classification. We evaluated our EGSAN model on two publicly available MI EEG datasets, each containing different types of motor imagery tasks. Our experiments demonstrate that our proposed model effectively extracts distinguishable features from EEG graphs, achieving significantly higher classification accuracies than existing state-of-the-art methods., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2023 Elsevier B.V. All rights reserved.)

Motor imagery based brain-computer interfaces (MI-BCIs) have excellent application prospects in motor enhancement and rehabilitation. However, MI-induced electroencephalogram features applied to MI-BCI usually vary from person to person. This study aimed to investigate whether the motor ability of the individual upper limbs was associated with these features, which helps understand the causes of inter-subject variability. We focused on the behavioral and psychological factors reflecting motor abilities. We first obtained the behavioral scale scores from Edinburgh Handedness Questionnaire, Maximum Grip Strength Test, and Purdue Pegboard Test assessments to evaluate the motor execution ability. We also required the subjects to complete the psychological Movement Imagery Questionnaire-3 estimate, representing MI ability. Then we recorded EEG signals from all twenty-two subjects during MI tasks. Pearson correlation coefficient and stepwise regression were used to analyze the relationships between MI-induced relative event-related desynchronization (rERD) patterns and motor abilities. Both Purdue Pegboard Test and Movement Imagery Questionnaire-3 scores had significant correlations with MI-induced neural oscillation patterns. Notably, the Purdue Pegboard Test of the left hand had the most significant correlation with the alpha rERD. The results of stepwise multiple regression analysis showed that the Purdue Pegboard Test and Movement Imagery Questionnaire-3 could best predict the MI-induced rERD. The results demonstrate that hand dexterity and fine motor coordination are significantly related to MI-induced neural activities. In addition, the method of imagining is also relevant to MI features. Therefore, this study is meaningful for understanding individual differences and the design of user-centered MI-BCI., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2023 IBRO. Published by Elsevier Ltd. All rights reserved.)

Background: Motor imagery (MI) based brain-computer interfaces (BCIs) have promising potentials in the field of neuro-rehabilitation. However, due to individual variations in active brain regions during MI tasks, the challenge of decoding MI EEG signals necessitates improved classification performance for practical application., New Method: This study proposes a self-attention-based Convolutional Neural Network (CNN) in conjunction with a time-frequency common spatial pattern (TFCSP) for enhanced MI classification. Due to the limited availability of training data, a data augmentation strategy is employed to expand the scale of MI EEG datasets. The self-attention-based CNN is trained to automatically extract the temporal and spatial information from EEG signals, allowing the self-attention module to select active channels by calculating EEG channel weights. TFCSP is further implemented to extract multiscale time-frequency-space features from EEG data. Finally, the EEG features derived from TFCSP are concatenated with those from the self-attention-based CNN for MI classification., Results: The proposed method is evaluated on two publicly accessible datasets, BCI Competition IV IIa and BCI Competition III IIIa, yielding mean accuracies of 79.28 % and 86.39 %, respectively., Conclusions: Compared with state-of-the-art methods, our approach achieves superior classification results in accuracy. Self-attention-based CNN combining with TFCSP can make full use of the time-frequency-space information of EEG, and enhance the classification performance., Competing Interests: Declaration of Competing Interest The authors declared no potential conflicts of interest with respect to the research, author- ship, and/or publication of this article., (Copyright © 2023 Elsevier B.V. All rights reserved.)

EEG signals are valuable signals in clinical medicine, brain research, and the study of neurological illnesses. However, EEG signal attenuation may occur at any time from signal generation through BCI device acquisition due to defects in the brain-computer interface (BCI) devices, restrictions in the dynamic network, and individual variations across the subjects. The attenuation of EEG data will alter the data distribution and lead to information fuzziness, substantially influencing subsequent EEG research. A model based on one-dimensional residual convolutional neural networks (1D-ResCNN) and transfer learning is proposed in this article to reduce the negative impacts of EEG attenuation. An end-to-end manner maps an attenuated EEG signal to a normal EEG signal. The structure employs a multi-level residual connection structure with varying weight coefficients, transferring characteristics from the bottom to the top of the convolutional neural network, enhancing feature learning. In addition, we initialize the subsequent denoising model using the transfer learning method. The combination of these two networks can well solve the attenuation problem of EEG signals. Experiments are carried out using the EEG-denoisenet data set. According to the findings, the model can yield a clear waveform with a decent SNR and RRMSE value.

Objective . The state of vigilance is crucial for effective performance in brain-computer interface (BCI) tasks, and therefore, it is essential to investigate vigilance levels in BCI tasks. Despite this, most studies have focused on vigilance levels in driving tasks rather than on BCI tasks, and the electroencephalogram (EEG) patterns of vigilance states in different BCI tasks remain unclear. This study aimed to identify similarities and differences in EEG patterns and performances of vigilance estimation in different BCI tasks and sessions. Approach. To achieve this, we built a steady-state visual evoked potential-based BCI system and a rapid serial visual presentation-based BCI system and recruited 18 participants to carry out four BCI experimental sessions over four days. Main results . Our findings demonstrate that specific neural patterns for high and low vigilance levels are relatively stable across sessions. Differential entropy features significantly differ between different vigilance levels in all frequency bands and between BCI tasks in the delta and theta frequency bands, with the theta frequency band features playing a critical role in vigilance estimation. Additionally, prefrontal, temporal, and occipital regions are more relevant to the vigilance state in BCI tasks. Our results suggest that cross-session vigilance estimation is more accurate than cross-task estimation. Significance. Our study clarifies the underlying mechanisms of vigilance state in two BCI tasks and provides a foundation for further research in vigilance estimation in BCI applications., (© 2023 IOP Publishing Ltd.)

Motor imagery (MI) is a brain-computer interface (BCI) technique in which specific brain regions are activated when people imagine their limbs (or muscles) moving, even without actual movement. The technology converts electroencephalogram (EEG) signals generated by the brain into computer-readable commands by measuring neural activity. Classification of motor imagery is one of the tasks in BCI. Researchers have done a lot of work on motor imagery classification, and the existing literature has relatively mature decoding methods for two-class motor tasks. However, as the categories of EEG-based motor imagery tasks increase, further exploration is needed for decoding research on four-class motor imagery tasks. In this study, we designed a hybrid neural network that combines spatiotemporal convolution and attention mechanisms. Specifically, the data is first processed by spatiotemporal convolution to extract features and then processed by a Multi-branch Convolution block. Finally, the processed data is input into the encoder layer of the Transformer for a self-attention calculation to obtain the classification results. Our approach was tested on the well-known MI datasets BCI Competition IV 2a and 2b, and the results show that the 2a dataset has a global average classification accuracy of 83.3% and a kappa value of 0.78. Experimental results show that the proposed method outperforms most of the existing methods., (Copyright © 2023 IBRO. Published by Elsevier Ltd. All rights reserved.)

Motor imagery (MI) is a traditional paradigm of brain-computer interface (BCI) and can assist users in creating direct connections between their brains and external equipment. The common spatial patterns algorithm is the most popular spatial filtering technique for collecting EEG signal features in MI-based BCI systems. Due to the defect that it only considers the spatial information of EEG signals and is susceptible to noise interference and other issues, its performance is diminished. In this study, we developed a Riemannian transform feature extraction method based on filter bank fusion with a combination of multiple time windows. First, we proposed the multi-time window data segmentation and recombination method by combining it with a filter group to create new data samples. This approach could capture individual differences due to the variation in time-frequency patterns across different participants, thereby improving the model's generalization performance. Second, Riemannian geometry was used for feature extraction from non-Euclidean structured EEG data. Then, considering the non-Gaussian distribution of EEG signals, the neighborhood component analysis (NCA) algorithm was chosen for feature selection. Finally, to meet real-time requirements and a low complexity, we employed a Support Vector Machine (SVM) as the classification algorithm. The proposed model achieved improved accuracy and robustness. In this study, we proposed an algorithm with superior performance on the BCI Competition IV dataset 2a, achieving an accuracy of 89%, a kappa value of 0.73 and an AUC of 0.9, demonstrating advanced capabilities. Furthermore, we analyzed data collected in our laboratory, and the proposed method achieved an accuracy of 77.4%, surpassing other comparative models. This method not only significantly improved the classification accuracy of motor imagery EEG signals but also bore significant implications for applications in the fields of brain-computer interfaces and neural engineering.

The motor imagery brain-computer interface (MI-BCI) provides an interactive control channel for spinal cord injury patients. However, the limitations of feature extraction algorithms may lead to low accuracy and instability in decoding electroencephalogram (EEG) signals. In this study, we examined the classification performance of an MI-BCI system by focusing on the distinction of the left and right foot kinaesthetic motor imagery tasks in five subjects. Feature extraction was performed using the common space pattern (CSP) and the Tikhonov regularisation CSP (TRCSP) spatial filters. TRCSP overcomes the CSP problems of noise sensitivity and overfitting. Moreover, support vector machine (SVM) and linear discriminant analysis (LDA) were used for classification and recognition. We constructed four combined classification methods (TRCSP-SVM, TRCSP-LDA, CSP-SVM, and CSP-LDA) and evaluated them by comparing their accuracies, kappa coefficients, and receiver operating characteristic (ROC) curves. The results showed that the TRCSP-SVM method performed significantly better than others (average accuracy 97%, average kappa coefficient 0.91, and average area under ROC curve (AUC) 0.98). Using TRCSP instead of standard CSP improved accuracy by up to 10%. This study provides insights into the classification of EEG signals. The results of this study can aid lower limb MI-BCI systems in rehabilitation training., (© 2023. International Federation for Medical and Biological Engineering.)

Rapid Serial Visual Presentation (RSVP) based Brain-Computer Interface (BCI) facilities the high-throughput detection of rare target images by detecting evoked event-related potentials (ERPs). At present, the decoding accuracy of the RSVP-based BCI system limits its practical applications. This study introduces eye movements (gaze and pupil information), referred to as EYE modality, as another useful source of information to combine with EEG-based BCI and forms a novel target detection system to detect target images in RSVP tasks. We performed an RSVP experiment, recorded the EEG signals and eye movements simultaneously during a target detection task, and constructed a multi-modal dataset including 20 subjects. Also, we proposed a cross-modal guiding and fusion network to fully utilize EEG and EYE modalities and fuse them for better RSVP decoding performance. In this network, a two-branch backbone was built to extract features from these two modalities. A Cross-Modal Feature Guiding (CMFG) module was proposed to guide EYE modality features to complement the EEG modality for better feature extraction. A Multi-scale Multi-modal Reweighting (MMR) module was proposed to enhance the multi-modal features by exploring intra- and inter-modal interactions. And, a Dual Activation Fusion (DAF) was proposed to modulate the enhanced multi-modal features for effective fusion. Our proposed network achieved a balanced accuracy of 88.00% (±2.29) on the collected dataset. The ablation studies and visualizations revealed the effectiveness of the proposed modules. This work implies the effectiveness of introducing the EYE modality in RSVP tasks. And, our proposed network is a promising method for RSVP decoding and further improves the performance of RSVP-based target detection systems., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2023 Elsevier Ltd. All rights reserved.)

In recent decades, the automatic recognition and interpretation of brain waves acquired by electroencephalographic (EEG) technologies have undergone remarkable growth, leading to a consequent rapid development of brain-computer interfaces (BCIs). EEG-based BCIs are non-invasive systems that allow communication between a human being and an external device interpreting brain activity directly. Thanks to the advances in neurotechnologies, and especially in the field of wearable devices, BCIs are now also employed outside medical and clinical applications. Within this context, this paper proposes a systematic review of EEG-based BCIs, focusing on one of the most promising paradigms based on motor imagery (MI) and limiting the analysis to applications that adopt wearable devices. This review aims to evaluate the maturity levels of these systems, both from the technological and computational points of view. The selection of papers has been performed following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA), leading to 84 publications considered in the last ten years (from 2012 to 2022). Besides technological and computational aspects, this review also aims to systematically list experimental paradigms and available datasets in order to identify benchmarks and guidelines for the development of new applications and computational models.

The brain-computer interface (BCI), also known as a brain-machine interface (BMI), has attracted extensive attention in biomedical applications. More importantly, BCI technologies have substantially revolutionized early predictions, diagnostic techniques, and rehabilitation strategies addressing acute diseases because of BCI's innovations and clinical translations. Therefore, in this chapter, a comprehensive description of the basic concepts of BCI will be exhibited, and various visualization techniques employed in BCI's medical applications will be discussed., (© 2023. Springer Nature Singapore Pte Ltd.)

Background: Non-invasive Brain-Computer Interface (BCI) uses an electroencephalogram (EEG) to obtain information on brain neural activity. Because EEG can be contaminated by various artifacts during the collection process, it has primarily evolved into motor imagery (MI) with a low risk of contamination. However, MI has a disadvantage in that accurate data is difficult to obtain., Objective: The goal of this study was to determine which motor imagery and movement execution (ME) of the knee has the best classification performance., Methods: Ten subjects were selected to provide MI and ME data for four different types of knee exercise. The experiment was conducted to keep the left, right, and both knees extend or bend for five seconds, and there was a five seconds break between each movement. Each motion was performed 20 times and the MI was carried out in the same protocol. Motions were classified through a modified model of the Lenet-5 of CNN (Convolution Neural Network)., Results: The deep learning data was classified, and a study discovered that ME (98.91%) could be classified significantly more accurately than MI (98.37%) (p< 0.001)., Conclusion: If future studies on other body movements are conducted, we anticipate that BCI can be further developed to be more accurate. And such advancements in BCI can be used to facilitate the patient's communication by analyzing the user's movement intention. These results can also be used for various controls such as robots using a combination of MI and ME.

Objective. The brain-computer interface (BCI) system based on sensorimotor rhythm can convert the human spirit into instructions for machine control, and it is a new human-computer interaction system with broad applications. However, the spatial resolution of scalp electroencephalogram (EEG) is limited due to the presence of volume conduction effects. Therefore, it is very meaningful to explore intracranial activities in a noninvasive way and improve the spatial resolution of EEG. Meanwhile, low-delay decoding is an essential factor for the development of a real-time BCI system. Approach. In this paper, EEG conduction is modeled by using public head anatomical templates, and cortical EEG is obtained using dynamic parameter statistical mapping. To solve the problem of a large amount of computation caused by the increase in the number of channels, the filter bank common spatial pattern method is used to obtain a spatial filter kernel, which reduces the computational cost of feature extraction to a linear level. And the feature classification and selection of important features are completed using a neural network containing band-spatial-time domain self-attention mechanisms. Main results. The results show that the method proposed in this paper achieves high accuracy for the four types of motor imagery EEG classification tasks, with fairly low latency and high physiological interpretability. Significance. The proposed decoding framework facilitates the realization of low-latency human-computer interaction systems., (© 2022 IOP Publishing Ltd.)

Background: Filter bank canonical correlation analysis (FBCCA) has been widely applied to detect the frequency components of steady-state visual evoked potential (SSVEP). FBCCA with dynamic window (FBCCA-DW) is recently proposed to improve its performance. FBCCA-DW adaptively chooses a proper window length based on the signal-to-noise ratio (SNR) of SSVEP signals. It takes the output of FBCCA to evaluate the SNR of SSVEP signals, by using the softmax function and cost function. In practice, SSVEP signals always contain task-unrelated electroencephalogram (EEG), which degrades the SSVEP task. When the power of task-unrelated EEG changes, there would be an offset in the output of FBCCA. However, due to the insensitivity of softmax function to the offset, the SNR in FBCCA-DW ignores the interference of the task-unrelated EEG. Therefore, FBCCA-DW will analyze SSVEP signals at an inappropriate window length., New Method: To solve the issue, we replace the softmax function with the L1 normalization, which could respond a reasonable SNR to the offset. Since the proposed method takes task-unrelated EEG into account, it could choose a more appropriate window length., Results: We comprehensively validate the proposed method on three publicly available SSVEP datasets. The results indicate that the proposed method could improve the performance significantly., Comparison With Existing Methods: The proposed method outperforms FBCCA and FBCCA-DW in terms of information transfer rate (ITR)., Conclusions: The proposed method enhances the correlation between the window length and the credibility of the recognition result. It shows its potential for practical applications in complex environments., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2022 Elsevier B.V. All rights reserved.)

Objective . The challenge for motor imagery (MI) in brain-computer interface (BCI) systems is finding a reliable classification model that has high classification accuracy and excellent robustness. Currently, one of the main problems leading to degraded classification performance is the inaccuracy caused by nonstationarities and low signal-to-noise ratio in electroencephalogram (EEG) signals. Approach . This study proposes a novel attention-based 3D densely connected cross-stage-partial network (DCSPNet) model to achieve efficient EEG-based MI classification. This is an end-to-end classification model framework based on the convolutional neural network (CNN) architecture. In this framework, to fully utilize the complementary features in each dimension, the optimal features are extracted adaptively from the EEG signals through the spatial-spectral-temporal (SST) attention mechanism. The 3D DCSPNet is introduced to reduce the gradient loss by segmenting the extracted feature maps to strengthen the network learning capability. Additionally, the design of the densely connected structure increases the robustness of the network. Main results . The performance of the proposed method was evaluated using the BCI competition IV 2a and the high gamma dataset, achieving an average accuracy of 84.45% and 97.88%, respectively. Our method outperformed most state-of-the-art classification algorithms, demonstrating its effectiveness and strong generalization ability. Significance. The experimental results show that our method is promising for improving the performance of MI-BCI. As a general framework based on time-series classification, it can be applied to BCI-related fields., (© 2022 IOP Publishing Ltd.)

This work aims to improve EEG signal binary and multiclass classification for real-time BCI applications. Therefore, our paper discusses the results of a new real-time approach that was integrated into a complete prediction system, where we proposed a new trick to eliminate the effect of EEG's non-stationarity nature. This improvement can increase the accuracy from 50% using raw EEG to the order of 90% after preprocessing step in the binary case and from 28% to 78% in the multiclass case. Then, we chose to filter all signals by the proposed bandpass filter automatically optimized using the sine cosine algorithm (SCA) to find the optimal bandwidth that contains the entire EEG characteristics in beta waves. Moreover, we used a common spatial pattern (CSP) filter to eliminate the correlation between all extracted features. Then, the light gradient boosting machine (LGBM) classifier is also combined with SCA algorithm to build better prediction models. As a result, the outcome system was applied on UCI and PhysioNet datasets to get excellent accuracy values of higher than 99% and 95%, respectively, using the data acquired only from three channels. On the other hand, the related works used all the data acquired from 14 channels to find an accuracy value between 70% and 98.5%, which shows the robustness of our method to improve EEG signal prediction quality., (Copyright © 2022 Elsevier Ltd. All rights reserved.)

The motor imagery brain-computer interface (MI-BCI) system is currently one of the most advanced rehabilitation technologies, and it can be used to restore the motor function of stroke patients. The deep learning algorithms in the MI-BCI system require lots of training samples, but the electroencephalogram (EEG) data of stroke patients is quite scarce. Therefore, the expansion of EEG data has become an important part of stroke clinical rehabilitation research. In this paper, a deep convolution generative adversarial network (DCGAN) model is proposed to generate artificial EEG data and further expand the scale of the stroke dataset. First, multichannel one-dimensional EEG data is converted into a two-dimensional EEG spectrogram using EEG2Image based on the modified S-transform. Then, DCGAN is used to artificially generate EEG data based on MI. Finally, the validity of the generated artificial EEG data is proved. This paper preliminarily indicates that generating artificial stroke data is a promising strategy, which contributes to the further development of stroke clinical rehabilitation.

Electroencephalogram (EEG)-based brain-computer interfaces (BCIs) provide a novel approach for controlling external devices. BCI technologies can be important enabling technologies for people with severe mobility impairment. Endogenous paradigms, which depend on user-generated commands and do not need external stimuli, can provide intuitive control of external devices. This paper discusses BCIs to control various physical devices such as exoskeletons, wheelchairs, mobile robots, and robotic arms. These technologies must be able to navigate complex environments or execute fine motor movements. Brain control of these devices presents an intricate research problem that merges signal processing and classification techniques with control theory. In particular, obtaining strong classification performance for endogenous BCIs is challenging, and EEG decoder output signals can be unstable. These issues present myriad research questions that are discussed in this review paper. This review covers papers published until the end of 2021 that presented BCI-controlled dynamic devices. It discusses the devices controlled, EEG paradigms, shared control, stabilization of the EEG signal, traditional machine learning and deep learning techniques, and user experience. The paper concludes with a discussion of open questions and avenues for future work.

Objective. Steady-state visual evoked potential (SSVEP) training feature recognition algorithms utilize user training data to reduce the interference of spontaneous electroencephalogram activities on SSVEP response for improved recognition accuracy. The data collection process can be tedious, increasing the mental fatigue of users and also seriously affecting the practicality of SSVEP-based brain-computer interface (BCI) systems. Approach . As an alternative, a cross-subject spatial filter transfer (CSSFT) method to transfer an existing user data model with good SSVEP response to new user test data has been proposed. The CSSFT method uses superposition averages of data for multiple blocks of data as transfer data. However, the amplitude and pattern of brain signals are often significantly different across trials. The goal of this study was to improve superposition averaging for the CSSFT method and propose an Ensemble scheme based on ensemble learning, and an Expansion scheme based on matrix expansion. Main results . The feature recognition performance was compared for CSSFT and the proposed improved CSSFT method using two public datasets. The results demonstrated that the improved CSSFT method can significantly improve the recognition accuracy and information transmission rate of existing methods. Significance. This strategy avoids a tedious data collection process, and promotes the potential practical application of BCI systems., (© 2022 IOP Publishing Ltd.)

Objective. Steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) have attracted increasing attention due to their high information transfer rate. To improve the performance of SSVEP detection, we propose a bidirectional Siamese correlation analysis (bi-SiamCA) model. Approach . In this model, an long short-term memory-based Siamese architecture is designed to measure the similarity between the SSVEP signal and the template in each frequency and obtain the probability that the SSVEP signal belongs to each frequency. Additionally, a maximize agreement module with a designed contrastive loss is adopted in the Siamese architecture to increase the similarity between the SSVEP signal and the reference signal in the same frequency. Moreover, a two-way signal processing mechanism is built to effectively integrate complementary information from two temporal directions of the input signals. Our model uses raw SSVEPs as inputs and can be trained end-to-end. Main results. Experimental results on a 40-class dataset and a 12-class dataset indicate that bi-SiamCA can significantly improve the classification accuracy compared with the prominent traditional and deep learning methods, especially under short data lengths. Feature visualizations show that the similarity between the SSVEP signal and the reference signal in the same frequency gradually improved in our model. Conclusion. The proposed bi-SiamCA model enhances the performance of SSVEP detection and outperforms the compared methods. Significance. Due to its high decoding accuracy under short signals, our approach has great potential to implement a high-speed SSVEP-based BCI., (© 2022 IOP Publishing Ltd.)

Objective. Multi-channel electroencephalogram data containing redundant information and noise may result in low classification accuracy and high computational complexity, which limits the practicality of motor imagery (MI)-based brain-computer interface (BCI) systems. Therefore, channel selection can improve BCI performance and contribute to user convenience. Additionally, cross-subject generalization is a key topic in the channel selection of MI-based BCI. Approach. In this study, an adaptive binary multi-objective harmony search (ABMOHS) algorithm is proposed to select the optimal set of channels. Furthermore, a new adaptive cross-subject generalization model (ACGM) is proposed. Three public MI datasets were used to validate the effectiveness of the proposed method. Main results. The Wilcoxon signed-rank test was performed on the test accuracies, and the results indicated that the ABMOHS method significantly outperformed all channels ( p < 0.001), the C3-Cz-C4 channels ( p < 0.001), and 20 channels ( p < 0.001) in the sensorimotor cortex. The ABMOHS algorithm based on Fisher's linear discriminant analysis (FLDA) and support vector machine (SVM) classifiers greatly reduces the number of selected channels, especially for larger channel sizes (Dataset 2), and obtains a comparative classification performance. Although there was no significant difference in test classification performance between ABMOHS and non-dominated sorting genetic algorithm II (NSGA-II) when FLDA and SVM were used, ABMOHS required less computational time than NSGA-II. Furthermore, the number of channels obtained by ABMOHS algorithm were significantly smaller than those obtained by common spatial pattern-Rank and correlation-based channel selection algorithm. Additionally, the generalization of ACGM to untrained subjects shows that the mean test classification accuracy of ACGM created by a small sample of trained subjects is significantly better than that of Special-16 and Special-32. Significance. The proposed method can reduce the calibration time in the training phase and improve the practicability of MI-BCI., (Creative Commons Attribution license.)

Background: The design and implementation of high-performance motor imagery-based brain computer interface (MI-BCI) requires high-quality training samples. However, fluctuation in subjects' physiological and mental states as well as artifacts can produce the low-quality motor imagery electroencephalogram (EEG) signal, which will damage the performance of MI-BCI system., New Method: In order to select high-quality MI-EEG training data, this paper proposes a low-quality training data detection method combining independent component analysis (ICA) and weak classifier cluster. we also design and implement a new online BCI system based on motor imagery to verify the online processing performance of the proposed method., Result: In order to verify the effectiveness of the proposed method, we conducted offline experiments on the public dataset called BCI Competition IV Data Set 2b. Furthermore, in order to verify the processing performance of the online system, we designed 60 groups of online experiments on 12 subjects. The online experimental results show that the twelve subjects can complete the system task efficiently (the best experiment is 135.6 s with 9 trials of subject S1)., Conclusion: This paper demonstrated that the proposed low-quality training data detection method can effectively screen out low-quality training samples, so as to improve the performance of the MI-BCI system., (Copyright © 2022 Elsevier B.V. All rights reserved.)

Objective . This study analyzed detection (movement vs. non-movement) and classification (different types of movements) to decode upper-limb movement volitions in a pseudo-online fashion. Approach . Nine healthy subjects executed four self-initiated movements: left wrist extension, right wrist extension, left index finger extension, and right index finger extension. For detection, we investigated the performance of three individual classifiers (support vector machine (SVM), EEGNET, and Riemannian geometry featured SVM) on three frequency bands (0.05-5 Hz, 5-40 Hz, 0.05-40 Hz). The best frequency band and the best classifier combinations were constructed to realize an ensemble processing pipeline using majority voting. For classification, we used adaptive boosted Riemannian geometry model to differentiate contra-lateral and ipsilateral movements. Main results . The ensemble model achieved 79.6 ± 8.8% true positive rate and 3.1 ± 1.2 false positives per minute with 75.3 ± 112.6 ms latency on a pseudo-online detection task. The following classification gave around 67% accuracy to differentiate contralateral movements. Significance . The newly proposed ensemble method and pseudo-online testing procedure could provide a robust brain-computer interface design for movement decoding., (Creative Commons Attribution license.)

Objective. Processing strategies are analyzed with respect to the classification of electroencephalographic signals related to brain-computer interfaces (BCIs) based on motor imagery (MI). A review of literature is carried out to understand the achievements in MI classification, the most promising trends, and the challenges in replicating these results. Main focus is placed on performance by means of a rigorous metrological analysis carried out in compliance with the international vocabulary of metrology. Hence, classification accuracy and its uncertainty are considered, as well as repeatability and reproducibility. Approach. The paper works included in the review concern the classification of electroencephalographic signals in motor-imagery-based BCIs. Article search was carried out in accordance with the Preferred Reporting Items for Systematic reviews and Meta-Analyses standard and 89 studies were included. Main results. Statistically-based analyses show that brain-inspired approaches are increasingly proposed, and that these are particularly successful in discriminating against multiple classes. Notably, many proposals involve convolutional neural networks. Instead, classical machine learning approaches are still effective for binary classifications. Many proposals combine common spatial pattern, least absolute shrinkage and selection operator, and support vector machines. Regarding reported classification accuracies, performance above the upper quartile is in the 85%-100% range for the binary case and in the 83%-93% range for multi-class one. Associated uncertainties are up to 6% while repeatability for a predetermined dataset is up to 8%. Reproducibility assessment was instead prevented by lack of standardization in experiments. Significance. By relying on the analyzed studies, the reader is guided towards the development of a successful processing strategy as a crucial part of a BCI. Moreover, it is suggested that future studies should extend these approaches on data from more subjects and with custom experiments, even by investigating online operation. This would also enable the quantification of the results reproducibility., (© 2022 IOP Publishing Ltd.)

Background: In recent years, numerous studies on the brain-computer interface (BCI) have been published. However, the number of targets in most of the existing studies was not enough for many practical applications., New Method: To achieve highly efficient communications, this study proposed a 120-target BCI system based on code-modulated visual evoked potentials (c-VEPs). Four 31-bit pseudorandom codes were used, and each code generated 30 targets by cyclic shift with a lag of 1 bit., Results: In the online experiments, subjects could select one target in 1.04 s (0.52 s for stimulation and 0.52 s for gaze shifting) with an average information transfer rate (ITR) of 265.74 bits/min., Comparison With Existing Method: The proposed system achieved more targets and higher ITR than other recent c-VEP based studies. which attributes to the optimal code combination and the 1-bit lag., Conclusion: The results illustrate that the proposed BCI system can achieve a high ITR with a short stimulation time. In addition, the c-VEP paradigm can shorten the training time, which ensures practicality in real applications., (Copyright © 2022 Elsevier B.V. All rights reserved.)

Decoding asynchronous electroencephalogram (A-EEG) signals is a crucial challenge in the emerging field of EEG based brain-computer interface. In the case of A-EEG signals, the time markers of motor activity are absent. The paper proposes a method to decompose the A-EEG signals using gabor elementary function designed with Gabor frames. The scale-space analysis extracts Gabor dominant frequencies from A-EEG signals. Statistical and temporal moment dependent features are used to create the feature vector for each estimated gabor band. The statistical significance of the features is tested with the Kruskal-Wallis test. The deep neural network is implemented with bi-directional long short-term memory block to classify the upper limb movement. The EEG data of healthy volunteers have been collected using the Enobio-20 electrode system and ArmeoSpring rehabilitation device. The proposed methodology has achieved an average classification accuracy of 96.83%, precision 0.96, recall 0.96, and F1-score of 0.93 on the acquired data set. The designed framework for decoding upper limb movement outperforms the existing state-of-the-art methods. In the future, the proposed framework could increase classification performance by incorporating multiple types of biological inputs for investigating various brain functions., (© 2022. Australasian College of Physical Scientists and Engineers in Medicine.)

Objective. Steady-state visual evoked potential (SSVEP) is an important control method of the brain-computer interface (BCI) system. The development of an efficient SSVEP feature decoding algorithm is the core issue in SSVEP-BCI. It has been proposed to use user training data to reduce the spontaneous electroencephalogram activity interference on SSVEP response, thereby improving the feature recognition accuracy of the SSVEP signal. Nevertheless, the tedious data collection process increases the mental fatigue of the user and severely affects the applicability of the BCI system. Approach. A cross-subject spatial filter transfer (CSSFT) method that transfer the existing user model with good SSVEP response to the new user test data without collecting any training data from the new user is proposed. Main results. Experimental results demonstrate that the transfer model increases the distinction of the feature discriminant coefficient between the gaze following target and the non-gaze following target and accurately identifies the wrong target in the fundamental algorithm model. The public datasets show that the CSSFT method significantly increases the recognition performance of canonical correlation analysis (CCA) and filter bank CCA. Additionally, when the data used to calculate the transfer model contains one data block only, the CSSFT method retains its effective feature recognition capabilities. Significance. The proposed method requires no tedious data calibration process for new users, provides an effective technical solution for the transfer of the cross-subject model, and has potential application value for promoting the application of the BCI system., (© 2022 IOP Publishing Ltd.)

Steady-state visually evoked potentials (SSVEPs) are widely used to index top-down cognitive processing in human electroencephalogram (EEG) studies. Typically, two stimuli flickering at different temporal frequencies (TFs) are presented, each producing a distinct response in the EEG at its flicker frequency. However, how SSVEP responses in EEGs are modulated in the presence of a competing flickering stimulus just because of sensory interactions is not well understood. We have previously shown in local field potentials (LFPs) recorded from awake monkeys that when two overlapping full-screen gratings are counterphased at different TFs, there is an asymmetric SSVEP response suppression, with greater suppression from lower TFs, which further depends on the relative orientations of the gratings (stronger suppression and asymmetry for parallel compared with orthogonal gratings). Here, we first confirmed these effects in both male and female human EEG recordings. Then, we mapped the response suppression of one stimulus (target) by a competing stimulus (mask) over a much wider range than the previous study. Surprisingly, we found that the suppression was not stronger at low frequencies in general, but systematically varied depending on the target TF, indicating local interactions between the two competing stimuli. These results were confirmed in both human EEG and monkey LFP and electrocorticogram (ECoG) data. Our results show that sensory interactions between multiple SSVEPs are more complex than shown previously and are influenced by both local and global factors, underscoring the need to cautiously interpret the results of studies involving SSVEP paradigms. SIGNIFICANCE STATEMENT Steady-state visually evoked potentials (SSVEPs) are extensively used in human cognitive studies and brain-computer interfacing applications where multiple stimuli flickering at distinct frequencies are concurrently presented in the visual field. We recently characterized interactions between competing flickering stimuli in animal recordings and found that stimuli flickering slowly produce larger suppression. Here, we confirmed these in human EEGs, and further characterized the interactions by using a much wider range of target and competing (mask) frequencies in both human EEGs and invasive animal recordings. These revealed a new "local" component, whereby the suppression increased when competing stimuli flickered at nearby frequencies. Our results highlight the complexity of sensory interactions among multiple SSVEPs and underscore the need to cautiously interpret studies involving SSVEP paradigms., (Copyright © 2022 the authors.)

Electroencephalogram (EEG) based emotion classification reflects the actual and intrinsic emotional state, resulting in more reliable, natural, and meaningful human-computer interaction with applications in entertainment consumption behavior, interactive brain-computer interface, and monitoring of psychological health of patients in the domain of e-healthcare. Challenges of EEG-based emotion recognition in real-world applications are variations among experimental settings and cognitive health conditions. Parkinson's Disease (PD) is the second most common neurodegenerative disorder, resulting in impaired recognition and expression of emotions. The deficit of emotional expression poses challenges for the healthcare services provided to PD patients. This study proposes 1D-CRNN-ELM architecture, which combines one-dimensional Convolutional Recurrent Neural Network (1D-CRNN) with an Extreme Learning Machine (ELM), robust for the emotion detection of PD patients, also available for cross dataset learning with various emotions and experimental settings. In the proposed framework, after EEG preprocessing, the trained CRNN can use as a feature extractor with ELM as the classifier, and again this trained CRNN can be used for learning of new emotions set with fine-tuning of other datasets. This paper also applied cross dataset learning of emotions by training with PD patients datasets and fine-tuning with publicly available datasets of AMIGOS and SEED-IV, and vice versa. Random splitting of train and test data with 80 - 20 ratio resulted in an accuracy of 97.75% for AMIGOS, 83.20% for PD, and 86.00% for HC with six basic emotion classes. Fine-tuning of trained architecture with four emotions of the SEED-IV dataset results in 92.5% accuracy. To validate the generalization of our results, leave one subject (patient) out cross-validation is also incorporated with mean accuracies of 95.84% for AMIGOS, 75.09% for PD, 77.85% for HC, and 84.97% for SEED-IV is achieved. Only a 1 - sec segment of EEG signal from 14 channels is enough to detect emotions with this performance. The proposed method outperforms state-of-the-art studies to classify EEG-based emotions with publicly available datasets, provide cross dataset learning, and validate the robustness of the deep learning framework for real-world application of psychological healthcare monitoring of Parkinson's disease patients., (Copyright © 2022. Published by Elsevier Ltd.)

Objective Electroencephalogram (EEG)-based motor imagery (MI) brain-computer interface offers a promising way to improve the efficiency of motor rehabilitation and motor skill learning. In recent years, the power of dynamic network analysis for MI classification has been proved. In fact, its usability mainly depends on the accurate estimation of brain connection. However, traditional dynamic network estimation strategies such as adaptive directed transfer function (ADTF) are designed in the L2-norm. Usually, they estimate a series of pseudo connections caused by outliers, which results in biased features and further limits its online application. Thus, how to accurately infer dynamic causal relationship under outlier influence is urgent. . Electroencephalogram (EEG)-based motor imagery (MI) brain-computer interface offers a promising way to improve the efficiency of motor rehabilitation and motor skill learning. In recent years, the power of dynamic network analysis for MI classification has been proved. In fact, its usability mainly depends on the accurate estimation of brain connection. However, traditional dynamic network estimation strategies such as adaptive directed transfer function (ADTF) are designed in the L2-norm. Usually, they estimate a series of pseudo connections caused by outliers, which results in biased features and further limits its online application. Thus, how to accurately infer dynamic causal relationship under outlier influence is urgent. Approach . In this work, we proposed a novel ADTF, which solves the dynamic system in the L1-norm space (L1-ADTF), so as to restrict the outlier influence. To enhance its convergence, we designed an iteration strategy with the alternating direction method of multipliers, which could be used for the solution of the dynamic state-space model restricted in the L1-norm space. Furthermore, we compared L1-ADTF to traditional ADTF and its dual extension across both simulation and real EEG experiments. Main results . A quantitative comparison between L1-ADTF and other ADTFs in simulation studies demonstrates that fewer bias errors and more desirable dynamic state transformation patterns can be captured by the L1-ADTF. Application to real MI EEG datasets seriously noised by ocular artifacts also reveals the efficiency of the proposed L1-ADTF approach to extract the time-varying brain neural network patterns, even when more complex noises are involved. Significance . The L1-ADTF may not only be capable of tracking time-varying brain network state drifts robustly but may also be useful in solving a wide range of dynamic systems such as trajectory tracking problems and dynamic neural networks., (© 2022 IOP Publishing Ltd.)

The manipulation of remote agents such as robotic arms in remote surgery or in BCI-wheelchair control are prone to errors. Some of these are related to user intent misclassification or other interface system errors, which lead to an incorrect movement. Here we focused on errors originating from unpredicted interface movements violating user intent and producing sensory conflicts. In addition, we examined effects of incongruent/congruent sensory stimuli induced by interface errors, focusing on haptic and visual cues in the system. The overarching goal was to identify the prototypical patterns of electroencephalogram (EEG) error signals associated with two types of interface errors rising when the visual and proprioceptive feedback are congruent or incongruent. For purposes of comparison validity, both types of errors were recorded in the same 3D virtual game environment. The comparison of congruent and incongruent interface errors revealed significant and marginally significant differences in EEG potentials with respect to profile, latencies, scalp distribution and sources. Different EEG time-frequency combinations had high power content. Incongruence between visual and proprioceptive feedback in interface errors not only elicited distinct EEG signal characteristics, but also produced a marginally significant Stroop effect. Incongruency in visuo-haptic feedback modalities cause a delayed user response. This effect is of major importance for the design of controlling interfaces and can provide designers with crucial information when aiming to control human response time., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2021 IBRO. Published by Elsevier Ltd. All rights reserved.)

Recent engineering and neuroscience applications have led to the development of brain-computer interface (BCI) systems that improve the quality of life of people with motor disabilities. In the same area, a significant number of studies have been conducted in identifying or classifying upper-limb movement intentions. On the contrary, few works have been concerned with movement intention identification for lower limbs. Notwithstanding, lower-limb neurorehabilitation is a major topic in medical settings, as some people suffer from mobility problems in their lower limbs, such as those diagnosed with neurodegenerative disorders, such as multiple sclerosis, and people with hemiplegia or quadriplegia. Particularly, the conventional pattern recognition (PR) systems are one of the most suitable computational tools for electroencephalography (EEG) signal analysis as the explicit knowledge of the features involved in the PR process itself is crucial for both improving signal classification performance and providing more interpretability. In this regard, there is a real need for outline and comparative studies gathering benchmark and state-of-art PR techniques that allow for a deeper understanding thereof and a proper selection of a specific technique. This study conducted a topical overview of specialized papers covering lower-limb motor task identification through PR-based BCI/EEG signal analysis systems. To do so, we first established search terms and inclusion and exclusion criteria to find the most relevant papers on the subject. As a result, we identified the 22 most relevant papers. Next, we reviewed their experimental methodologies for recording EEG signals during the execution of lower limb tasks. In addition, we review the algorithms used in the preprocessing, feature extraction, and classification stages. Finally, we compared all the algorithms and determined which of them are the most suitable in terms of accuracy.