Search

Recognizing human emotions based on electroencephalogram (EEG) signals has received a great deal of attentions. Most of the existing studies focused on offline analysis, and real-time emotion recognition using a brain computer interface (BCI) approach remains to be further investigated. In this paper, we proposed an EEG-based BCI system for emotion recognition. Specifically, two classes of video clips that represented positive and negative emotions were presented to the subjects one by one, while the EEG data were collected and processed simultaneously, and instant feedback was provided after each clip. Ten healthy subjects participated in the experiment and achieved a high average online accuracy of 91.5 $\pm$ ± 6.34 percent. The experimental results demonstrated that the subjects emotions had been sufficiently evoked and efficiently recognized by our system. Clinically, patients with disorder of consciousness (DOC), such as coma, vegetative state, minimally conscious state and emergence minimally conscious state, suffer from motor impairment and generally cannot provide adequate emotion expressions. Consequently, doctors have difficulty in detecting the emotional states of these patients. Therefore, we applied our emotion recognition BCI system to patients with DOC. Eight DOC patients participated in our experiment, and three of them achieved significant online accuracy. The experimental results show that the proposed BCI system could be a promising tool to detect the emotional states of patients with DOC. [ABSTRACT FROM AUTHOR]

Cognitive motor dissociation describes a subset of patients with disorders of consciousness who show neuroimaging evidence of consciousness but no detectable command-following behaviours. Although essential for family counselling, decision-making, and the design of rehabilitation programmes, the prognosis for patients with cognitive motor dissociation remains under-investigated. The current study included 78 patients with disorders of consciousness who showed no detectable command-following behaviours. These patients included 45 patients with unresponsive wakefulness syndrome and 33 patients in a minimally conscious state, as diagnosed using the Coma Recovery Scale-Revised. Each patient underwent an EEG-based brain-computer interface experiment, in which he or she was instructed to perform an item-selection task (i.e. select a photograph or a number from two candidates). Patients who achieved statistically significant brain-computer interface accuracies were identified as cognitive motor dissociation. Two evaluations using the Coma Recovery Scale-Revised, one before the experiment and the other 3 months later, were carried out to measure the patients' behavioural improvements. Among the 78 patients with disorders of consciousness, our results showed that within the unresponsive wakefulness syndrome patient group, 15 of 18 patients with cognitive motor dissociation (83.33%) regained consciousness, while only five of the other 27 unresponsive wakefulness syndrome patients without significant brain-computer interface accuracies (18.52%) regained consciousness. Furthermore, within the minimally conscious state patient group, 14 of 16 patients with cognitive motor dissociation (87.5%) showed improvements in their Coma Recovery Scale-Revised scores, whereas only four of the other 17 minimally conscious state patients without significant brain-computer interface accuracies (23.53%) had improved Coma Recovery Scale-Revised scores. Our results suggest that patients with cognitive motor dissociation have a better outcome than other patients. Our findings extend current knowledge of the prognosis for patients with cognitive motor dissociation and have important implications for brain-computer interface-based clinical diagnosis and prognosis for patients with disorders of consciousness. [ABSTRACT FROM AUTHOR]

The coma recovery scale-revised (CRS-R) behavioral scale is commonly used for the clinical evaluation of patients with disorders of consciousness (DOC). However, since DOC patients generally cannot supply stable and efficient behavioral responses to external stimulation, evaluation results based on behavioral scales are not sufficiently accurate. In this paper, we proposed a novel brain–computer interface (BCI) based on 3D stereo audiovisual stimuli to supplement object recognition evaluation in the CRS-R. During the experiment, subjects needed to follow the instructions and to focus on the target object on the screen, whereas EEG data were recorded and analyzed in real time to determine the object of focus, and the detection result was output as feedback. Thirteen DOC patients participated in the object recognition assessments using the 3D audiovisual BCI and CRS-R. None of the patients showed object recognition function in the CRS-R assessment before the BCI experiment. However, six of these DOC patients achieved accuracies that were significantly higher than the chance level in the BCI-based assessment, indicating the successful detection of object recognition function in these six patients using our 3D audiovisual BCI system. These results suggest that the BCI method may provide a more sensitive object recognition evaluation compared with CRS-R and may be used to assist clinical CRS-R for DOC patients. [ABSTRACT FROM AUTHOR]

Visual pursuit assessment is extensively applied in the behavioral scale-based clinical examination of patients with disorders of consciousness (DOC). However, this assessment is challenging because it relies on behavioral markers, and these patients severely lack behavioral responses. Brain-computer interfaces (BCIs) may provide a potential solution to detect brain responses to external stimuli without requiring behavioral expressions. A BCI system was designed to simulate visual pursuit detection in the coma recovery scale-revised (CRS-R). The graphical user interface included four buttons, one that moved on the screen and three that did not. These buttons flashed in a random order. The patients were prompted to follow the moving button. Based on the collected electroencephalography data, the algorithm determined whether the patient focused on the moving target. Among the 14 DOC patients who participated in the assessments based on the BCI system and the CRS-R, four patients exhibited visual pursuit, and three were nonresponsive in both assessments. More importantly, seven patients who did not exhibit visual pursuit in CRS-R were detected to be responsive to the moving target stimuli in the BCI assessment. Furthermore, five out of seven recovered consciousness to some degree and showed visual pursuit in the second CRS-R assessment. The proposed BCI system is better able to detect visual pursuit than the behavioral scale-based assessment and thus can assist in clinically evaluating the challenging population of DOC patients. [ABSTRACT FROM AUTHOR]

Background: For patients with disorders of consciousness such as coma, a vegetative state or a minimally conscious state, one challenge is to detect and assess the residual cognitive functions in their brains. Number processing and mental calculation are important brain functions but are difficult to detect in patients with disorders of consciousness using motor response-based clinical assessment scales such as the Coma Recovery Scale-Revised due to the patients' motor impairments and inability to provide sufficient motor responses for number- and calculation-based communication.Methods: In this study, we presented a hybrid brain-computer interface that combines P300 and steady state visual evoked potentials to detect number processing and mental calculation in Han Chinese patients with disorders of consciousness. Eleven patients with disorders of consciousness who were in a vegetative state (n = 6) or in a minimally conscious state (n = 3) or who emerged from a minimally conscious state (n = 2) participated in the brain-computer interface-based experiment. During the experiment, the patients with disorders of consciousness were instructed to perform three tasks, i.e., number recognition, number comparison, and mental calculation, including addition and subtraction. In each experimental trial, an arithmetic problem was first presented. Next, two number buttons, only one of which was the correct answer to the problem, flickered at different frequencies to evoke steady state visual evoked potentials, while the frames of the two buttons flashed in a random order to evoke P300 potentials. The patients needed to focus on the target number button (the correct answer). Finally, the brain-computer interface system detected P300 and steady state visual evoked potentials to determine the button to which the patients attended, further presenting the results as feedback.Results: Two of the six patients who were in a vegetative state, one of the three patients who were in a minimally conscious state, and the two patients that emerged from a minimally conscious state achieved accuracies significantly greater than the chance level. Furthermore, P300 potentials and steady state visual evoked potentials were observed in the electroencephalography signals from the five patients.Conclusions: Number processing and arithmetic abilities as well as command following were demonstrated in the five patients. Furthermore, our results suggested that through brain-computer interface systems, many cognitive experiments may be conducted in patients with disorders of consciousness, although they cannot provide sufficient behavioral responses. [ABSTRACT FROM AUTHOR]

Existing evidence suggests that the default-mode network (DMN) and fronto-pariatal network (FPN) play an important role in altered states of consciousness. However, the brain mechanisms underlying impaired consciousness and the specific network interactions involved are not well understood. We studied the topological properties of brain functional networks using resting-state functional MRI data acquired from 18 patients (11 vegetative state/unresponsive wakefulness syndrome, VS/UWS, and 7 minimally conscious state, MCS) and compared these properties with those of healthy controls. We identified that the topological properties in DMN and FPN are anti-correlated which comes, in part, from the contribution of interactions between dorsolateral prefrontal cortex of the FPN and precuneus of the DMN. Notably, altered nodal connectivity strength was distance-dependent, with most disruptions appearing in long-distance connections within the FPN but in short-distance connections within the DMN. A multivariate pattern-classification analysis revealed that combination of topological patterns between the FPN and DMN could predict conscious state more effectively than connectivity within either network. Taken together, our results imply distinct interactions between the FPN and DMN, which may mediate conscious state. [ABSTRACT FROM AUTHOR]

Currently, detecting awareness in patients with disorders of consciousness (DOC) is a challenging task, which is commonly addressed through behavioral observation scales such as the JFK Coma Recovery Scale-Revised. Brain-computer interfaces (BCIs) provide an alternative approach to detect awareness in patients with DOC. However, these patients have a much lower capability of using BCIs compared to healthy individuals. This study proposed a novel BCI using temporally, spatially, and semantically congruent audiovisual stimuli involving numbers (i.e., visual and spoken numbers). Subjects were instructed to selectively attend to the target stimuli cued by instruction. Ten healthy subjects first participated in the experiment to evaluate the system. The results indicated that the audiovisual BCI system outperformed auditory-only and visual-only systems. Through event-related potential analysis, we observed audiovisual integration effects for target stimuli, which enhanced the discriminability between brain responses for target and nontarget stimuli and thus improved the performance of the audiovisual BCI. This system was then applied to detect the awareness of seven DOC patients, five of whom exhibited command following as well as number recognition. Thus, this audiovisual BCI system may be used as a supportive bedside tool for awareness detection in patients with DOC. [ABSTRACT FROM AUTHOR]

Disorders of consciousness are impaired states of consciousness caused by severe brain injuries. Previous resting-state functional magnetic resonance imaging studies have reported abnormal brain network properties at different topological scales in patients with disorders of consciousness by using graph theoretical analysis. However, it is still unclear how inter-regional directed propagation activities affect the topological organization of functional brain networks in patients with disorders of consciousness. To reveal the altered topological organization in patients with disorders of consciousness, we constructed whole-brain directed functional networks by combining functional connectivity analysis and time delay estimation. Then we performed graph theoretical analysis based on the directed functional brain networks at three topological scales, from the nodal scale, the resting-state network scale to the global scale. Finally, the canonical correlation analysis was used to determine the correlations between altered topological properties and clinical scores in patients with disorders of consciousness. At the nodal scale, we observed decreased in-degree and increased out-degree in the precuneus in patients with disorders of consciousness. At the resting-state network scale, the patients with disorders of consciousness showed reorganized motif patterns within the default mode network and between the default mode network and other resting-state networks. At the global scale, we found a lower global clustering coefficient in the patients with disorders of consciousness than in the controls. The results of the canonical correlation analysis showed that the abnormal degree and the disrupted motif were significantly correlated with the clinical scores of the patients with disorders of consciousness. Our findings showed that consciousness impairment can be revealed by abnormal directed connection patterns at multiple topological scales in the whole brain, and the disrupted directed connection patterns may serve as clinical biomarkers to assess the dysfunction of patients with disorders of consciousness., Competing Interests: On behalf of all authors, the corresponding author states that there are no competing interests., (© The Author(s) 2023. Published by Oxford University Press on behalf of the Guarantors of Brain.)

Background: The detection of intrinsic brain activity (iBA) could assist clinical assessment for disorder of consciousness (DOC) patients. Previous studies have revealed the altered iBA in thalamocortical, frontoparietal, and default mode network in DOC patients using functional connectivity (FC) analysis. However, due to the assumption of synchronized iBA in FC, these studied may be inadequate for understanding the effect of severe brain injury on the temporal organization of iBA and the relationship between temporal organization and clinical feature in DOC patients. Recently, the time delay estimation (TDE) and probabilistic flow estimation (PFE) were proposed to analyze temporal organization, which could provide propagation structure and propagation probability at whole-brain level., Methods: We applied voxel-wise TDE and PFE to assess propagation structure and propagation probability for the DOC patients and then applied the connectome-based predictive modeling (CPM) to predict clinical scores for patients based on the ROI-wise TDE and PFE., Results: We found that: 1) the DOC patients showed abnormal voxel-wise time delay (TD) and probabilistic flow (PF) in the precentral gyrus, precuneus, middle cingulate cortex, and postcentral gyrus, 2) the range of TD value in the patients was shorter than that in the controls, and 3) the ROI-wise TD had a better predictive performance for clinical scores of the patients compared with that based on ROI-wise PF., Conclusion: Our findings may suggest that the propagation structure of iBA could be used to predict clinical scores in DOC patients., (Copyright © 2021 The Author(s). Published by Elsevier Inc. All rights reserved.)

Cognitive motor dissociation describes a subset of patients with disorders of consciousness who show neuroimaging evidence of consciousness but no detectable command-following behaviours. Although essential for family counselling, decision-making, and the design of rehabilitation programmes, the prognosis for patients with cognitive motor dissociation remains under-investigated. The current study included 78 patients with disorders of consciousness who showed no detectable command-following behaviours. These patients included 45 patients with unresponsive wakefulness syndrome and 33 patients in a minimally conscious state, as diagnosed using the Coma Recovery Scale-Revised. Each patient underwent an EEG-based brain-computer interface experiment, in which he or she was instructed to perform an item-selection task (i.e. select a photograph or a number from two candidates). Patients who achieved statistically significant brain-computer interface accuracies were identified as cognitive motor dissociation. Two evaluations using the Coma Recovery Scale-Revised, one before the experiment and the other 3 months later, were carried out to measure the patients' behavioural improvements. Among the 78 patients with disorders of consciousness, our results showed that within the unresponsive wakefulness syndrome patient group, 15 of 18 patients with cognitive motor dissociation (83.33%) regained consciousness, while only five of the other 27 unresponsive wakefulness syndrome patients without significant brain-computer interface accuracies (18.52%) regained consciousness. Furthermore, within the minimally conscious state patient group, 14 of 16 patients with cognitive motor dissociation (87.5%) showed improvements in their Coma Recovery Scale-Revised scores, whereas only four of the other 17 minimally conscious state patients without significant brain-computer interface accuracies (23.53%) had improved Coma Recovery Scale-Revised scores. Our results suggest that patients with cognitive motor dissociation have a better outcome than other patients. Our findings extend current knowledge of the prognosis for patients with cognitive motor dissociation and have important implications for brain-computer interface-based clinical diagnosis and prognosis for patients with disorders of consciousness., (© The Author(s) (2020). Published by Oxford University Press on behalf of the Guarantors of Brain.)

Resting-state functional magnetic resonance imaging (rs-fMRI) is widely used to research abnormal functional connectivity (FC) in patients with disorders of consciousness (DOC). However, most studies assumed steady spatial-temporal signal interactions between distinct brain regions during the scan period. The aim of this study was to explore abnormal dynamic functional connectivity (dFC) in DOC patients. After excluding 26 patients' data that failed to meet the requirements of imaging quality, we retained 19 DOC patients (12 with unresponsive wakefulness syndrome and 7 in a minimally conscious state, diagnosed with the Coma Recovery Scale-Revised [CRS-R]) for the dFC analysis. We used the sliding windows approach to construct dFC matrices. Then these matrices were clustered into distinct states using the k-means clustering algorithm. We found that the DOC patients showed decreased dFC in the sensory and somatomotor networks compared with the healthy controls. There were also significant differences in temporal properties, the mean dwell time (MDT) and the number of transitions (NT), between the DOC patients and the healthy controls. In addition, we also used a hidden Markov model (HMM) to test the robustness of the results. With the connectome-based predictive modeling (CPM) approach, we found that the properties of abnormal dynamic network can be used to predict the CRS-R scores of the patients after severe brain injury. These findings may contribute to a better understanding of the abnormal brain networks in DOC patients., (Copyright © 2019 The Authors. Published by Elsevier Inc. All rights reserved.)

Disorders of consciousness are a heterogeneous mixture of different diseases or injuries. Although some indicators and models have been proposed for prognostication, any single method when used alone carries a high risk of false prediction. This study aimed to develop a multidomain prognostic model that combines resting state functional MRI with three clinical characteristics to predict one year-outcomes at the single-subject level. The model discriminated between patients who would later recover consciousness and those who would not with an accuracy of around 88% on three datasets from two medical centers. It was also able to identify the prognostic importance of different predictors, including brain functions and clinical characteristics. To our knowledge, this is the first reported implementation of a multidomain prognostic model that is based on resting state functional MRI and clinical characteristics in chronic disorders of consciousness, which we suggest is accurate, robust, and interpretable., Competing Interests: MS, YY, JH, ZY, SY, QX, XX, YD, QZ, XW, YC, BH, RY, RX, TJ No competing interests declared, (© 2018, Song et al.)

For patients with disorders of consciousness (DOC), such as vegetative state (VS) and minimally conscious state (MCS), detecting and assessing the residual cognitive functions of the brain remain challenging. Emotion-related cognitive functions are difficult to detect in patients with DOC using motor response-based clinical assessment scales such as the Coma Recovery Scale-Revised (CRS-R) because DOC patients have motor impairments and are unable to provide sufficient motor responses for emotion-related communication. In this study, we proposed an EEG-based brain-computer interface (BCI) system for emotion recognition in patients with DOC. Eight patients with DOC (5 VS and 3 MCS) and eight healthy controls participated in the BCI-based experiment. During the experiment, two movie clips flashed (appearing and disappearing) eight times with a random interstimulus interval between flashes to evoke P300 potentials. The subjects were instructed to focus on the crying or laughing movie clip and to count the flashes of the corresponding movie clip cued by instruction. The BCI system performed online P300 detection to determine which movie clip the patients responsed to and presented the result as feedback. Three of the eight patients and all eight healthy controls achieved online accuracies based on P300 detection that were significantly greater than chance level. P300 potentials were observed in the EEG signals from the three patients. These results indicated the three patients had abilities of emotion recognition and command following. Through spectral analysis, common spatial pattern (CSP) and differential entropy (DE) features in the delta, theta, alpha, beta, and gamma frequency bands were employed to classify the EEG signals during the crying and laughing movie clips. Two patients and all eight healthy controls achieved offline accuracies significantly greater than chance levels in the spectral analysis. Furthermore, stable topographic distribution patterns of CSP and DE features were observed in both the healthy subjects and these two patients. Our results suggest that cognitive experiments may be conducted using BCI systems in patients with DOC despite the inability of such patients to provide sufficient behavioral responses.

Objective: The JFK coma recovery scale-revised (JFK CRS-R), a behavioral observation scale, is widely used in the clinical diagnosis/assessment of patients with disorders of consciousness (DOC). However, the JFK CRS-R is associated with a high rate of misdiagnosis (approximately 40%) because DOC patients cannot provide sufficient behavioral responses. A brain-computer interface (BCI) that detects command/intention-specific changes in electroencephalography (EEG) signals without the need for behavioral expression may provide an alternative method., Approach: In this paper, we proposed an audiovisual BCI communication system based on audiovisual 'yes' and 'no' stimuli to supplement the JFK CRS-R for assessing the communication ability of DOC patients. Specifically, patients were given situation-orientation questions as in the JFK CRS-R and instructed to select the answers using the BCI., Main Results: Thirteen patients (eight vegetative state (VS) and five minimally conscious state (MCS)) participated in our experiments involving both the BCI- and JFK CRS-R-based assessments. One MCS patient who received a score of 1 in the JFK CRS-R achieved an accuracy of 86.5% in the BCI-based assessment. Seven patients (four VS and three MCS) obtained unresponsive results in the JFK CRS-R-based assessment but responsive results in the BCI-based assessment, and 4 of those later improved scores in the JFK CRS-R-based assessment. Five patients (four VS and one MCS) obtained usresponsive results in both assessments., Significance: The experimental results indicated that the audiovisual BCI could provide more sensitive results than the JFK CRS-R and therefore supplement the JFK CRS-R.

Over the last 20 years, studies have provided greater insight into disorders of consciousness (DOC), also known as altered state of consciousness. Increased brain residual functions have been identified in patients with DOC due to the successful application of novel next-generation imaging technologies. Many unconscious patients have now been confirmed to retain considerable cognitive functions. It is hoped that greater insight regarding the psychological state of patients may be achieved through the use of functional magnetic resonance imaging and brain-computer interfaces. However, issues surrounding the research and treatment of DOC remain problematic. These include differing opinions on the definition of consciousness, difficulties in diagnosis, assessment, prognosis and/or treatment, and newly emerging ethical, legal and social issues. To overcome these, appropriate care must be offered to patients with DOC by clinicians and families, as DOC patients may now be considered to live in more than just a vegetative state. The present article reviews the controversy surrounding the definition of consciousness and the reliability of novel technologies, prognostic prediction, communication with DOC patients and treatment methods. The ethical and social issues surrounding the treatment of DOC and future perspectives are also considered.

Background: For patients with disorders of consciousness such as coma, a vegetative state or a minimally conscious state, one challenge is to detect and assess the residual cognitive functions in their brains. Number processing and mental calculation are important brain functions but are difficult to detect in patients with disorders of consciousness using motor response-based clinical assessment scales such as the Coma Recovery Scale-Revised due to the patients' motor impairments and inability to provide sufficient motor responses for number- and calculation-based communication., Methods: In this study, we presented a hybrid brain-computer interface that combines P300 and steady state visual evoked potentials to detect number processing and mental calculation in Han Chinese patients with disorders of consciousness. Eleven patients with disorders of consciousness who were in a vegetative state (n = 6) or in a minimally conscious state (n = 3) or who emerged from a minimally conscious state (n = 2) participated in the brain-computer interface-based experiment. During the experiment, the patients with disorders of consciousness were instructed to perform three tasks, i.e., number recognition, number comparison, and mental calculation, including addition and subtraction. In each experimental trial, an arithmetic problem was first presented. Next, two number buttons, only one of which was the correct answer to the problem, flickered at different frequencies to evoke steady state visual evoked potentials, while the frames of the two buttons flashed in a random order to evoke P300 potentials. The patients needed to focus on the target number button (the correct answer). Finally, the brain-computer interface system detected P300 and steady state visual evoked potentials to determine the button to which the patients attended, further presenting the results as feedback., Results: Two of the six patients who were in a vegetative state, one of the three patients who were in a minimally conscious state, and the two patients that emerged from a minimally conscious state achieved accuracies significantly greater than the chance level. Furthermore, P300 potentials and steady state visual evoked potentials were observed in the electroencephalography signals from the five patients., Conclusions: Number processing and arithmetic abilities as well as command following were demonstrated in the five patients. Furthermore, our results suggested that through brain-computer interface systems, many cognitive experiments may be conducted in patients with disorders of consciousness, although they cannot provide sufficient behavioral responses.

Objective: The bedside detection of potential awareness in patients with disorders of consciousness (DOC) currently relies only on behavioral observations and tests; however, the misdiagnosis rates in this patient group are historically relatively high. In this study, we proposed a visual hybrid brain-computer interface (BCI) combining P300 and steady-state evoked potential (SSVEP) responses to detect awareness in severely brain injured patients., Approach: Four healthy subjects, seven DOC patients who were in a vegetative state (VS, n = 4) or minimally conscious state (MCS, n = 3), and one locked-in syndrome (LIS) patient attempted a command-following experiment. In each experimental trial, two photos were presented to each patient; one was the patient's own photo, and the other photo was unfamiliar. The patients were instructed to focus on their own or the unfamiliar photos. The BCI system determined which photo the patient focused on with both P300 and SSVEP detections., Main Results: Four healthy subjects, one of the 4 VS, one of the 3 MCS, and the LIS patient were able to selectively attend to their own or the unfamiliar photos (classification accuracy, 66-100%). Two additional patients (one VS and one MCS) failed to attend the unfamiliar photo (50-52%) but achieved significant accuracies for their own photo (64-68%). All other patients failed to show any significant response to commands (46-55%)., Significance: Through the hybrid BCI system, command following was detected in four healthy subjects, two of 7 DOC patients, and one LIS patient. We suggest that the hybrid BCI system could be used as a supportive bedside tool to detect awareness in patients with DOC.