Search

IntroductionRemoving motion artifacts (MAs) from functional near-infrared spectroscopy (fNIRS) signals is crucial in practical applications, but a standard procedure is not available yet. Artificial neural networks have found applications in diverse domains, such as voice and image processing, while their utility in signal processing remains limited.MethodIn this work, we introduce an innovative neural network-based approach for online fNIRS signals processing, tailored to individual subjects and requiring minimal prior experimental data. Specifically, this approach employs one-dimensional convolutional neural networks with a penalty network (1DCNNwP), incorporating a moving window and an input data augmentation procedure. In the training process, the neural network is fed with simulated data derived from the balloon model for simulation validation and semi-simulated data for experimental validation, respectively.ResultsVisual validation underscores 1DCNNwP’s capacity to effectively suppress MAs. Quantitative analysis reveals a remarkable improvement in signal-to-noise ratio by over 11.08 dB, surpassing the existing methods, including the spline-interpolation, wavelet-based, temporal derivative distribution repair with a 1 s moving window, and spline Savitzky-Goaly methods. Contrast-to-noise ratio (CNR) analysis further demonstrated 1DCNNwP’s ability to restore or enhance CNRs for motionless signals. In the experiments of eight subjects, our method significantly outperformed the other approaches (except offline TDDR, t

Transcranial electrical stimulation has demonstrated the potential to enhance cognitive functions such as working memory, learning capacity, and attentional allocation. Recently, it was shown that periodic stimulation within a specific duration could augment the human brain’s neuroplasticity. This study investigates the effects of repetitive transcranial alternating current stimulation (tACS; 1 mA, 5 Hz, 2 min duration) on cognitive function, functional connectivity, and topographic changes using both electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS). Fifteen healthy subjects were recruited to measure brain activity in the pre-, during-, and post-stimulation sessions under tACS and sham stimulation conditions. Fourteen trials of working memory tasks and eight repetitions of tACS/sham stimulation with a 1-minute intersession interval were applied to the frontal cortex of the participants. The working memory score, EEG band-wise powers, EEG topography, concentration changes of oxygenated hemoglobin, and functional connectivity (FC) were individually analyzed to quantify the behavioral and neurophysiological effects of tACS. Our results indicate that tACS increases: i) behavioral scores (i.e., 15.08, ${p} < 0.001$ ) and EEG band-wise powers (i.e., theta and beta bands) compared to the sham stimulation condition, ii) FC of both EEG-fNIRS signals, especially in the large-scale brain network communication and interhemispheric connections, and iii) the hemodynamic response in comparison to the pre-stimulation session and the sham condition. Conclusively, the repetitive theta-band tACS stimulation improves the working memory capacity regarding behavioral and neuroplasticity perspectives. Additionally, the proposed fNIRS biomarkers (mean, slope), EEG band-wise powers, and FC can be used as neuro-feedback indices for closed-loop brain stimulation.

For dealing with the energy consumption in multi-agent systems (MASs), an event-triggered (ET) methodology is promising, which relies on the activation of communication devices only when communication of data is needed. This paper explores the leaderless consensus for nonlinear MASs using an adaptive ET approach via an output feedback methodology. This adaptive ET scheme is preferred as it can adapt to the environment through setting a communication threshold. The proposed approach renders the observed states of agents by use of nonlinear observers in an output feedback control dilemma, making it more practical. Simple Luenberger observers are developed to avoid the problem of always measuring agents’ states. The strategy of adaptive ET-based control is employed to minimize resource use and information transmission. Design conditions for the observer-based adaptive ET consensus control of nonlinear MASs have been derived via a Lyapunov function, containing state estimation error, consensus error, adaptation term, and nonlinearity bounds. In contrast to the existing methods, the present approach applies a more practical output feedback schema, uses adaptive ET proficiency, and deals with nonlinear agents. An example of a formation of autonomous underwater vehicles achieving the basic consensus realization between displacement and velocity is included to illustrate the viability of the resultant approach.

Abstract This study develops a neural network control for a non‐linear two‐degree‐of‐freedom unmanned helicopter system satisfying prescribed performance constraints is developed. By introducing a prescribed performance function to express the system constraints, a constrained tracking control problem is transformed into an equivalent unconstrained stability problem through error transformations. The neural network controller is designed to ensure that the tracking error converges to a small neighborhood of zero and that the prescribed performance constraints are satisfied. Furthermore, the stability and error convergence of the system are analysed through the Lyapunov direct approach. The effectiveness of the proposed control scheme is verified by simulation and experimental results.

In recent times, significant progress has been achieved in the domain of intelligent and eco-friendly transportation. Electric mobility emerges as a viable and effective solution, offering cost-efficient means of transportation. However, the rise in fuel expenses, climate change, and unregulated charging of electric vehicles (EVs) have necessitated a transformative shift in the operation of smart grids. The exponential rise in EV charging requirements has the potential to adversely affect power grids, resulting in peak demand, grid overload, energy hub emissions, and possible infrastructure overburden. This study presents a predictive cost model that utilizes a hybrid search and rescue (SAR) and adaptive neuro-fuzzy interface system (ANFIS), denoted as the SAR-ANFIS approach. The model is designed to effectively model complex dynamic energy emission dispatch scenarios that are integrated with transient charging loads. These scenarios include peak, off-peak, electric power research institute (EPRI), and stochastic scenarios. The proposed methodology aims to minimize the cost of charging scenarios while providing policymakers with a tool to create financial budgets for forthcoming electric vehicle loads. This is achieved through the use of a fuzzy model that has the ability to predict costs. The ANFIS exhibits robust predictive capabilities owing to its aptitude for acquiring and representing intricate non-linear associations between input and output variables. The incorporation of ANFIS into a SAR algorithm results in improved predictive capacity through the optimization of the learning process, enhancement of model accuracy, and facilitation of efficient parameter tuning. The integration of ANFIS and SAR algorithms enhances predictive accuracy and robustness by leveraging the former’s adaptive and learning capabilities and the latter’s global search and optimization capabilities. The model considers various charging strategies and dispatch constraints within an energy hub. The attainment of the 24-hour pricing scheme is achieved by solving a minimum-cost optimization problem, which serves as the initial training data for the development of the proposed model using an adaptive neuro-fuzzy approach. The proposed approach effectively coordinates the various charging behaviours of electric vehicles, including those identified by the EPRI, as well as stochastic, peak, and off-peak charging, at the system level. The proposed methodology offers several advantages, including the facilitation of coordination among various charging scenarios for EVs and the creation of a cost prediction model that can assist policymakers in devising budgetary plans for future EV loads. One of the benefits of this technology is its capacity for autonomy, which enables vehicle owners to charge their electric vehicles in a cost-effective manner, regardless of the specific scenario they find themselves in. Furthermore, the suggested plan has the potential to mitigate the release of greenhouse gases from the power generation sector, thereby facilitating the establishment of a viable charging network that is environmentally sustainable. The present study examines the efficacy of the SAR-ANFIS approach and model on a standardized test system across a range of load profiles.

Green transportation has become our top priority due to the depletion of the earth’s natural resources and rising pollutant emission levels. Plug-in electric vehicles (PEVs) are seen as a solution to the problem because they are more cost and environment friendly. Due to rapid industrialization and government incentives for zero-emission transportation, a significant challenge is also constituted in power grids by the self-interested nature of PEVs, with the asymmetry of information between the charging power demand and supply sides. In this paper, we propose an optimal strategy in industrial energy management system, based on evolutionary computing, to characterize different charging situations. The proposed approach considers stochastic, off-peak, peak, and electric power research institute charging scenarios for attaining the vehicle-to-grid capacity in terms of optimal cost and demand. An extensive scheduling of charging cases is studied in order to avoid power outages or scenarios in which there is a significant supply-demand mismatch. Furthermore, the proposed scheme model also reduces the greenhouse gases emission from generation side to build a sustainable generation infrastructure, which maximizes the utility of fuel-based energy production in the presence of certain nonlinear constraints. The simulation analysis demonstrates that PEVs can be charged and discharged in a systematic manner. The participation of transferable load through the proposed methodology can significantly reduce the economic costs, pollutant impacts, efficiency, and security of power grid operation.

To a great extent, most of the power generation systems are dependent on fossil fuels, and their rapid usage is not only declining the reserves but also producing the greenhouse gasses that pollutes the ecology of planet and causes significant long haul harms to the earth habitats. The continuous dependency of hydrocarbon deposit will also cause shortage of fuel, causing excessively costly generation in future. In this article, a soft computing framework named as whale optimization algorithm (WOA) is proposed for the solution of multi-objective optimization problem known as economic/environmental dispatch problem (EEDP), which is among the most vibrant problem in the power system control area. Our designed architecture provides fast convergence rate, optimal generation cost, and reduction in environmental pollutants while handling the complex system constraints such as valve-point loading effect (VPLE) and prohibited zones. To demonstrate feasibility and effectiveness of the provided scheme, three highly nonlinear case studies are computed by while considering all system contingencies. The statistical results demonstrate significant reduction in fuel emission costs, and the superiority and performance of suggested technique is compared with the recently published approaches in the literature.

Abstract This paper addresses a control problem of a nonlinear cantilever beam with translating base in the three-dimensional space, wherein the coupled nonlinear dynamics of the transverse, lateral, and longitudinal vibrations of the beam and the base’s motions are considered. The control scheme employs two control inputs applied to the beam’s base to control the base’s position while simultaneously suppressing the beam’s transverse, lateral, and longitudinal vibrations. According to the Hamilton principle, a hybrid model describing the nonlinear coupling dynamics of the beam and the base is established: This model consists of three partial differential equations representing the beam’s dynamics and two ordinary differential equations representing the base’s dynamics. Subsequently, the control laws are designed to move the base to the desired position and attenuate the beam’s vibrations in all three directions. The asymptotic stability of the closed-loop system is proven via the Lyapunov method. Finally, the effectiveness of the designed control scheme is illustrated via the simulation results.

Abstract This research aims to contribute in developing a mathematical model for the composite probabilistic energy emissions dispatch (CPEED) with renewable energy systems, and it proposes a novel framework, based on an existing astute black widow optimization (ABWO) algorithm. Renewable energy power generation technology has contributed to pollution reduction and sustainable development. Therefore, this research aims to explore the CPEED problem in the context of renewable energy generation systems to enhance the energy and climate benefits of the power systems. Five benchmark test systems, combined with conventional thermal power plants and renewable energy sources such as wind and solar, are considered herein to obtain the optimum solution for cost and pollutant emission by using the ABWO approach. The ascendancy is not limited to environmental impacts, but it also provides the diversification of energy supply and reduction of reliance on imported fuels. As a result, the research findings contribute in lowering the cost of fuel and pollutant emissions, correlated with electricity generation systems, while increasing the renewable energy usage and penetration. Finally, the performance and efficacy of the designed scheme have been fully validated by comprehensive experimental results and statistical analyses.

Mild cognitive impairment (MCI) is a precursor to Alzheimer’s disease. It is imperative to develop a proper treatment for this neurological disease in the aging society. This observational study investigated the effects of acupuncture therapy on MCI patients. Eleven healthy individuals and eleven MCI patients were recruited for this study. Oxy- and deoxy-hemoglobin signals in the prefrontal cortex during working-memory tasks were monitored using functional near-infrared spectroscopy. Before acupuncture treatment, working-memory experiments were conducted for healthy control (HC) and MCI groups (MCI-0), followed by 24 sessions of acupuncture for the MCI group. The acupuncture sessions were initially carried out for 6 weeks (two sessions per week), after which experiments were performed again on the MCI group (MCI-1). This was followed by another set of acupuncture sessions that also lasted for 6 weeks, after which the experiments were repeated on the MCI group (MCI-2). Statistical analyses of the signals and classifications based on activation maps as well as temporal features were performed. The highest classification accuracies obtained using binary connectivity maps were 85.7% HC vs. MCI-0, 69.5% HC vs. MCI-1, and 61.69% HC vs. MCI-2. The classification accuracies using the temporal features mean from 5 seconds to 28 seconds and maximum (i.e, max(5:28 seconds)) values were 60.6% HC vs. MCI-0, 56.9% HC vs. MCI-1, and 56.4% HC vs. MCI-2. The results reveal that there was a change in the temporal characteristics of the hemodynamic response of MCI patients due to acupuncture. This was reflected by a reduction in the classification accuracy after the therapy, indicating that the patients’ brain responses improved and became comparable to those of healthy subjects. A similar trend was reflected in the classification using the image feature. These results indicate that acupuncture can be used for the treatment of MCI patients.

With the emergence of an increasing number of functional near-infrared spectroscopy (fNIRS) devices, the significant deterioration in measurement caused by motion artifacts has become an essential research topic for fNIRS applications. However, a high requirement for mathematics and programming limits the number of related researches. Therefore, here we provide the first comprehensive review for motion artifact removal in fNIRS aiming to (i) summarize the latest achievements, (ii) present the significant solutions and evaluation metrics from the perspective of application and reproduction, and (iii) predict future topics in the field. The present review synthesizes information from fifty-one journal articles (screened according to three criteria). Three hardware-based solutions and nine algorithmic solutions are summarized, and their application requirements (compatible signal types, the availability for online applications, and limitations) and extensions are discussed. Five metrics for noise suppression and two metrics for signal distortion were synthesized to evaluate the motion artifact removal methods. Moreover, we highlight three deficiencies in the existing research: (i) The balance between the use of auxiliary hardware and that of an algorithmic solution is not clarified; (ii) few studies mention the filtering delay of the solutions, and (iii) the robustness and stability of the solution under extreme application conditions are not discussed.

This work investigates the classification of finger-tapping task images constructed for the initial dip duration of hemodynamics (HR) associated with the small brain area of the left motor cortex using functional near-infrared spectroscopy (fNIRS). Different layers (i.e., 16-layers, 19-layers, 22-layers, and 25-layers) of isolated convolutional neural network (CNN) designed from scratch are tested to classify the right-hand thumb and little finger-tapping tasks. Functional t-maps of finger-tapping tasks (thumb, little) were constructed for various durations (0.5 to 4 s with a uniform interval of 0.5 s) for the initial dip duration using a three gamma functions-based designed HR function. The results show that the 22-layered isolated CNN model yielded the highest classification accuracy of 89.2% with less complexity in classifying the functional t-maps of thumb and little fingers associated with the same small brain area using the initial dip. The results further demonstrated that the active brain area of the two tapping tasks from the same small brain area are highly different and well classified using functional t-maps of the initial dip (0.5 to 4 s) compared to functional t-maps generated for delayed HR (14 s). This study shows that the images constructed for initial dip duration can be helpful in the future for fNIRS-based diagnosis or cortical analysis of abnormal cerebral oxygen exchange in patients.

Activated channels of functional near-infrared spectroscopy are typically identified using the desired hemodynamic response function (dHRF) generated by a trial period. However, this approach is not possible for an unknown trial period. In this paper, an innovative method not using the dHRF is proposed, which extracts fluctuating signals during the resting state using maximal overlap discrete wavelet transform, identifies low-frequency wavelets corresponding to physiological noise, trains them using long-short term memory networks, and predicts/subtracts them during the task session. The motivation for prediction is to maintain the phase information of physiological noise at the start time of a task, which is possible because the signal is extended from the resting state to the task session. This technique decomposes the resting state data into nine wavelets and uses the fifth to ninth wavelets for learning and prediction. In the eighth wavelet, the prediction error difference between the with and without dHRF from the 15-s prediction window appeared to be the largest. Considering the difficulty in removing physiological noise when the activation period is near the physiological noise, the proposed method can be an alternative solution when the conventional method is not applicable. In passive brain-computer interfaces, estimating the brain signal starting time is necessary.

The constantly evolving human–machine interaction and advancement in sociotechnical systems have made it essential to analyze vital human factors such as mental workload, vigilance, fatigue, and stress by monitoring brain states for optimum performance and human safety. Similarly, brain signals have become paramount for rehabilitation and assistive purposes in fields such as brain–computer interface (BCI) and closed-loop neuromodulation for neurological disorders and motor disabilities. The complexity, non-stationary nature, and low signal-to-noise ratio of brain signals pose significant challenges for researchers to design robust and reliable BCI systems to accurately detect meaningful changes in brain states outside the laboratory environment. Different neuroimaging modalities are used in hybrid settings to enhance accuracy, increase control commands, and decrease the time required for brain activity detection. Functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG) measure the hemodynamic and electrical activity of the brain with a good spatial and temporal resolution, respectively. However, in hybrid settings, where both modalities enhance the output performance of BCI, their data compatibility due to the huge discrepancy between their sampling rate and the number of channels remains a challenge for real-time BCI applications. Traditional methods, such as downsampling and channel selection, result in important information loss while making both modalities compatible. In this study, we present a novel recurrence plot (RP)-based time-distributed convolutional neural network and long short-term memory (CNN-LSTM) algorithm for the integrated classification of fNIRS EEG for hybrid BCI applications. The acquired brain signals are first projected into a non-linear dimension with RPs and fed into the CNN to extract essential features without performing any downsampling. Then, LSTM is used to learn the chronological features and time-dependence relation to detect brain activity. The average accuracies achieved with the proposed model were 78.44% for fNIRS, 86.24% for EEG, and 88.41% for hybrid EEG-fNIRS BCI. Moreover, the maximum accuracies achieved were 85.9, 88.1, and 92.4%, respectively. The results confirm the viability of the RP-based deep-learning algorithm for successful BCI systems.

Functional near-infrared spectroscopy (fNIRS) in brain imaging needs to be robust to subject-wise variability. The use of a fixed differential pathlength factor (DPF) per wavelength for the entire brain will degrade the accuracy of hemodynamic responses. Since the tissue composition varies within the brain, correct DPF values should be used for various emitter-detector distances and brain regions. In this article, a DPF estimation method combining a state-space model of the modified Beer-Lambert law (mBLL), a parameter model for estimating the reduced scattering coefficients, and dual square-root cubature Kalman filters (SCKFs) is proposed. To validate the proposed method, known light intensities (six channels, two wavelengths) and reference DPFs are generated using NIRFAST (a Matlab toolbox) using a presumed paradigm, known tissue properties, a Balloon model, and a finite element head model consisting of 58,818 mesh elements. Then, the DPF values are estimated using a Jacobian matrix from the head model and the mBLL. The results show that the estimated concentration changes correlate well with the reference data. Also, the estimated DPFs showed relative errors less than 1.33% maximum and 0.75% on average. A one-tailed $t$ -test revealed that the estimated DPFs matched the reference DPFs with more than 99.9% confidence. The developed method can efficiently access the actual DPFs even if emitter-detector distances vary significantly and the tissue properties are not uniform. With the developed state-space models for dual SCKFs, real-time estimation of the DPFs from one experiment to another has become plausible.

In this paper, the most effective stimulation durations in the visual, somatosensory, and motor cortices are investigated. To evoke hemodynamic responses (HRs) for the purpose of brain-computer interface (BCI) with functional near-infrared spectroscopy (fNIRS), the best and the minimal durations for three tasks (visual, tapping, and poking) are presented. The examined tasks include the checkerboard, right-hand-index-finger poking, and the right-hand-index-finger tapping tasks in association with the visual, somatosensory, and motor cortices. Upon stimulations, the peak value, time to peak, and the full width at half maximum of the HRs are examined. Six different stimuli durations (i.e., 1, 3, 5, 7, 10 and 15 sec) were tested. Ten male subjects participated in the experiment. Three types of stimulations having the same duration were presented to the subjects randomly. The stimulation durations that showed the maximum peak values in the checkerboard, poking, and tapping tasks were 7, 5, and 10 sec, respectively. The peak value increased with the increase of stimulation duration. But beyond a certain period of time, the peak value did not increase anymore and sometimes it decreased when the stimulation period is too long. It is noted that 1-sec stimulation (for all three tasks) can generate a noticeable peak value. Instead, the initial dip upon poking occurred only with 1-sec poking (i.e., initial dip did not occur in all other poking periods). Conclusively, this work reveals the possibility of a BCI command generation within 1 sec.

Advancements in functional near-infrared spectroscopy (fNIRS) neuroimaging have extended its usage from clinical settings to real-life applications. We developed a wearable and wireless fNIRS-based neuroimaging system that can be applied for brain disease diagnostics and during daily life activities. We utilized 128 compact dual-wavelength LEDs of 735 nm and 850 nm and a silicon photodiode (SiPD). The LEDs and SiPD were closely assembled in a 3D-printed flexible configuration holder fitted in a soft neoprene cap. The developed configuration has 128 channels in a 7 ×7 cm area with source-detector separations ranging from 5 mm to 38 mm, which intends to provide a high-density device. The system acquires data from multiple brain depths to generate a 3D activation image. Short-separation channels provide the physiological noise in the superficial layer, which can be used to enhance fNIRS signals. The experimental data are stored in a USB flash disk attached to the device. We developed software that is connected to the device using Wi-Fi to display the oxyhemoglobin (HbO) and deoxyhemoglobin (HbR) levels in real-time. The system architecture allows the selection of channels and the use of multiple devices simultaneously. The system was tested using a silicone phantom as well as human subjects. The LED intensity is dynamically calibrated within the safety range once the device is set up, so that every channel can acquire stable data. The system provided high-quality signals with a signal-to-noise ratio of more than 64 dB, high optical sensitivity, and dynamic optical range of 140 dB in the phantom test. A sampling rate of 30 Hz was achieved with all the channels used. The system exhibited valid HbO and HbR responses during the arterial occlusion test and a motor task. These results show that the developed system can provide precise, robust, and multi-depth measurements resulting in high-density images. With these novel characteristics, the system favors clinical usage and outdoor activities as well as brain-computer interface applications.

This research report investigates a novel optimization approach for the economic dispatch problem (EDP) based on the weighted sum of generators’ costs under supply-demand balance. Unlike conventional approaches, we present a distributed optimization approach that ensures optimality using weighted incremental cost (IC) consensus and sign-consensus error convergence. We can apply the optimization of a weighted sum of generators’ costs to address several constraints, such as capacity and environmental constraints, in addition to the supply-demand balance. The proposed distributed weighted incremental cost consensus approach has been applied to the IEEE-30 bus and IEEE-118 bus systems over a communication topology. The results indicate the efficacy of weights to address generation constraints and the convergence of weighted ICs under supply-demand balance.

The reformations of the electrical power sector have resulted in very dynamic and competitive market that has changed many elements of the power industry. Excessive demand of energy, depleting the fossil fuel reserves of planet and releasing the toxic air pollutant, has been causing harm to earth habitats. In this new situation, insufficiency of energy supplies, rising power generating costs, high capital cost of renewable energy equipment, environmental concerns of wind power turbines, and ever-increasing demand for electrical energy need efficient economic dispatch. The objective function in practical economic dispatch (ED) problem is nonlinear and non-convex, with restricted equality and inequality constraints, and traditional optimization methods are incapable of resolving such non-convex problems. Over the recent decade, meta-heuristic optimization approaches have acquired enormous reputation for obtaining a solution strategy for such types of ED issues. In this paper, a novel soft computing optimization technique is proposed for solving the dynamic economic dispatch problem (DEDP) of complex non-convex machines with several constraints. Our premeditated framework employs the genetic algorithm (GA) as an initial optimizer and sequential quadratic programming (SQP) for the fine tuning of the pre-optimized run of GA. The simulation analysis of GA-SQP performs well by acquiring less computational cost and finite time of execution, while providing optimal generation of powers according to the targeted power demand and load, whereas subject to valve point loading effect (VPLE) and multiple fueling option (MFO) constraints. The adequacy of the presented strategy concerning accuracy, convergence as well as reliability is verified by employing it on ten benchmark case studies, including non-convex IEEE bus system at the same time also considering VPLE of thermal power plants. The potency of designed optimization seems more robust with fast convergence rate while evaluating the hard bounded DEDP. Our suggested hybrid method GA-SQP converges to achieve the best optimal solution in a confined environment in a limited number of simulations. The simulation results demonstrate applicability and adequacy of the given hybrid schemes over conventional methods.

In this paper, a deep-learning-based driver-drowsiness detection for brain-computer interface (BCI) using functional near-infrared spectroscopy (fNIRS) is investigated. The passive brain signals from drowsiness were acquired from 13 healthy subjects while driving a car simulator. The brain activities were measured with a continuous-wave fNIRS system, in which the prefrontal and dorsolateral prefrontal cortices were focused. Deep neural networks (DNN) were pursued to classify the drowsy and alert states. For training and testing the models, the convolutional neural networks (CNN) were used on color map images to determine the best suitable channels for brain activity detection in 0~1, 0~3, 0~5, and 0~10 second time windows. The average accuracies (i.e., 82.7, 89.4, 93.7, and 97.2% in the 0~1, 0~3, 0~5, and 0~10 sec time windows, respectively) using DNNs from the right dorsolateral prefrontal cortex were obtained. The CNN architecture resulted in an average accuracy of 99.3%, showing the model to be capable of differentiating the images of drowsy/non-drowsy states. The proposed approach is promising for detecting drowsiness and in accessing the brain location for a passive BCI.

Electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) stand as state-of-the-art techniques for non-invasive functional neuroimaging. On a unimodal basis, EEG has poor spatial resolution while presenting high temporal resolution. In contrast, fNIRS offers better spatial resolution, though it is constrained by its poor temporal resolution. One important merit shared by the EEG and fNIRS is that both modalities have favorable portability and could be integrated into a compatible experimental setup, providing a compelling ground for the development of a multimodal fNIRS–EEG integration analysis approach. Despite a growing number of studies using concurrent fNIRS-EEG designs reported in recent years, the methodological reference of past studies remains unclear. To fill this knowledge gap, this review critically summarizes the status of analysis methods currently used in concurrent fNIRS–EEG studies, providing an up-to-date overview and guideline for future projects to conduct concurrent fNIRS–EEG studies. A literature search was conducted using PubMed and Web of Science through 31 August 2021. After screening and qualification assessment, 92 studies involving concurrent fNIRS–EEG data recordings and analyses were included in the final methodological review. Specifically, three methodological categories of concurrent fNIRS–EEG data analyses, including EEG-informed fNIRS analyses, fNIRS-informed EEG analyses, and parallel fNIRS–EEG analyses, were identified and explained with detailed description. Finally, we highlighted current challenges and potential directions in concurrent fNIRS–EEG data analyses in future research.

Abstract The study presents a recursive least-squares estimation method with an exponential forgetting factor for noise removal in functional near-infrared spectroscopy data and extraction of hemodynamic responses (HRs) from the measured data. The HR is modeled as a linear regression form in which the expected HR, the first and second derivatives of the expected HR, a short-separation measurement data, three physiological noises, and the baseline drift are included as components in the regression vector. The proposed method is applied to left-motor-cortex experiments on the right thumb and little finger movements in five healthy male participants. The algorithm is evaluated with respect to its performance improvement in terms of contrast-to-noise ratio in comparison with Kalman filter, low-pass filtering, and independent component method. The experimental results show that the proposed model achieves reductions of 77% and 99% in terms of the number of channels exhibiting higher contrast-to-noise ratios in oxy-hemoglobin and deoxy-hemoglobin, respectively. The approach is robust in obtaining consistent HR data. The proposed method is applied for both offline and online noise removal.

This study aims to decode the hemodynamic responses (HRs) evoked by multiple sound-categories using functional near-infrared spectroscopy (fNIRS). The six different sounds were given as stimuli (English, non-English, annoying, nature, music, and gunshot). The oxy-hemoglobin (HbO) concentration changes are measured in both hemispheres of the auditory cortex while 18 healthy subjects listen to 10-s blocks of six sound-categories. Long short-term memory (LSTM) networks were used as a classifier. The classification accuracy was 20.38 ± 4.63% with six class classification. Though LSTM networks’ performance was a little higher than chance levels, it is noteworthy that we could classify the data subject-wise without feature selections.

A passive brain–computer interface (BCI) based upon functional near-infrared spectroscopy (fNIRS) brain signals is used for earlier detection of human drowsiness during driving tasks. This BCI modality acquired hemodynamic signals of 13 healthy subjects from the right dorsolateral prefrontal cortex (DPFC) of the brain. Drowsiness activity is recorded using a continuous-wave fNIRS system and eight channels over the right DPFC. During the experiment, sleep-deprived subjects drove a vehicle in a driving simulator while their cerebral oxygen regulation (CORE) state was continuously measured. Vector phase analysis (VPA) was used as a classifier to detect drowsiness state along with sleep stage-based threshold criteria. Extensive training and testing with various feature sets and classifiers are done to justify the adaptation of threshold criteria for any subject without requiring recalibration. Three statistical features (mean oxyhemoglobin, signal peak, and the sum of peaks) along with six VPA features (trajectory slopes of VPA indices) were used. The average accuracies for the five classifiers are 90.9% for discriminant analysis, 92.5% for support vector machines, 92.3% for nearest neighbors, 92.4% for both decision trees, and ensembles over all subjects’ data. Trajectory slopes of CORE vector magnitude and angle: m(|R|) and m(∠R) are the best-performing features, along with ensemble classifier with the highest accuracy of 95.3% and minimum computation time of 40 ms. The statistical significance of the results is validated with a p-value of less than 0.05. The proposed passive BCI scheme demonstrates a promising technique for online drowsiness detection using VPA along with sleep stage classification.

BackgroundBrain disorders are gradually becoming the leading cause of death worldwide. However, the lack of knowledge of brain disease’s underlying mechanisms and ineffective neuropharmacological therapy have led to further exploration of optimal treatments and brain monitoring techniques.ObjectiveThis study aims to review the current state of brain disorders, which utilize transcranial electrical stimulation (tES) and daily usable noninvasive neuroimaging techniques. Furthermore, the second goal of this study is to highlight available gaps and provide a comprehensive guideline for further investigation.MethodA systematic search was conducted of the PubMed and Web of Science databases from January 2000 to October 2020 using relevant keywords. Electroencephalography (EEG) and functional near-infrared spectroscopy were selected as noninvasive neuroimaging modalities. Nine brain disorders were investigated in this study, including Alzheimer’s disease, depression, autism spectrum disorder, attention-deficit hyperactivity disorder, epilepsy, Parkinson’s disease, stroke, schizophrenia, and traumatic brain injury.ResultsSixty-seven studies (1,385 participants) were included for quantitative analysis. Most of the articles (82.6%) employed transcranial direct current stimulation as an intervention method with modulation parameters of 1 mA intensity (47.2%) for 16–20 min (69.0%) duration of stimulation in a single session (36.8%). The frontal cortex (46.4%) and the cerebral cortex (47.8%) were used as a neuroimaging modality, with the power spectrum (45.7%) commonly extracted as a quantitative EEG feature.ConclusionAn appropriate stimulation protocol applying tES as a therapy could be an effective treatment for cognitive and neurological brain disorders. However, the optimal tES criteria have not been defined; they vary across persons and disease types. Therefore, future work needs to investigate a closed-loop tES with monitoring by neuroimaging techniques to achieve personalized therapy for brain disorders.

This study decodes consumers' preference levels using a convolutional neural network (CNN) in neuromarketing. The classification accuracy in neuromarketing is a critical factor in evaluating the intentions of the consumers. Functional near-infrared spectroscopy (fNIRS) is utilized as a neuroimaging modality to measure the cerebral hemodynamic responses. In this study, a specific decoding structure, called CNN-based fNIRS-data analysis, was designed to achieve a high classification accuracy. Compared to other methods, the automated characteristics, constant training of the dataset, and learning efficiency of the proposed method are the main advantages. The experimental procedure required eight healthy participants (four female and four male) to view commercial advertisement videos of different durations (15, 30, and 60 s). The cerebral hemodynamic responses of the participants were measured. To compare the preference classification performances, CNN was utilized to extract the most common features, including the mean, peak, variance, kurtosis, and skewness. Considering three video durations, the average classification accuracies of 15, 30, and 60 s videos were 84.3, 87.9, and 86.4%, respectively. Among them, the classification accuracy of 87.9% for 30 s videos was the highest. The average classification accuracies of three preferences in females and males were 86.2 and 86.3%, respectively, showing no difference in each group. By comparing the classification performances in three different combinations (like vs. so-so, like vs. dislike, and so-so vs. dislike) between two groups, male participants were observed to have targeted preferences for commercial advertising, and the classification performance 88.4% between “like” vs. “dislike” out of three categories was the highest. Finally, pairwise classification performance are shown as follows: For female, 86.1% (like vs. so-so), 87.4% (like vs. dislike), 85.2% (so-so vs. dislike), and for male 85.7, 88.4, 85.1%, respectively.

Mild cognitive impairment (MCI) is the clinical precursor of Alzheimer's disease (AD), which is considered the most common neurodegenerative disease in the elderly. Some MCI patients tend to remain stable over time and do not evolve to AD. It is essential to diagnose MCI in its early stages and provide timely treatment to the patient. In this study, we propose a neuroimaging approach to identify MCI using a deep learning method and functional near-infrared spectroscopy (fNIRS). For this purpose, fifteen MCI subjects and nine healthy controls (HCs) were asked to perform three mental tasks: N-back, Stroop, and verbal fluency (VF) tasks. Besides examining the oxygenated hemoglobin changes (ΔHbO) in the region of interest, ΔHbO maps at 13 specific time points (i.e., 5, 10, 15, 20, 25, 30, 35, 40, 45, 50, 55, 60, and 65 s) during the tasks and seven temporal feature maps (i.e., two types of mean, three types of slope, kurtosis, and skewness) in the prefrontal cortex were investigated. A four-layer convolutional neural network (CNN) was applied to identify the subjects into either MCI or HC, individually, after training the CNN model with ΔHbO maps and temporal feature maps above. Finally, we used the 5-fold cross-validation approach to evaluate the performance of the CNN. The results of temporal feature maps exhibited high classification accuracies: The average accuracies for the N-back task, Stroop task, and VFT, respectively, were 89.46, 87.80, and 90.37%. Notably, the highest accuracy of 98.61% was achieved from the ΔHbO slope map during 20–60 s interval of N-back tasks. Our results indicate that the fNIRS imaging approach based on temporal feature maps is a promising diagnostic method for early detection of MCI and can be used as a tool for clinical doctors to identify MCI from their patients.

An intrinsic problem when using hemodynamic responses for the brain-machine interface is the slow nature of the physiological process. In this paper, a novel method that estimates the oxyhemoglobin changes caused by neuronal activations is proposed and validated. In monitoring the time responses of blood-oxygen-level-dependent signals with functional near-infrared spectroscopy (fNIRS), the early trajectories of both oxy- and deoxy-hemoglobins in their phase space are scrutinized. Furthermore, to reduce the detection time, a prediction method based upon a kernel-based recursive least squares (KRLS) algorithm is implemented. In validating the proposed approach, the fNIRS signals of finger tapping tasks measured from the left motor cortex are examined. The results show that the KRLS algorithm using the Gaussian kernel yields the best fitting for both ΔHbO (i.e., 87.5%) and ΔHbR (i.e., 85.2%) at q = 15 steps ahead (i.e., 1.63 s ahead at a sampling frequency of 9.19 Hz). This concludes that a neuronal activation can be concluded in about 0.1 s with fNIRS using prediction, which enables an almost real-time practice if combined with EEG.

Functional near-infrared spectroscopy (fNIRS), a growing neuroimaging modality, has been utilized over the past few decades to understand the neuronal behavior in the brain. The technique has been used to assess the brain hemodynamics of impaired cohorts as well as able-bodied. Neuroimaging is a critical technique for patients with impaired cognitive or motor behaviors. The portable nature of the fNIRS system is suitable for frequent monitoring of the patients who exhibit impaired brain activity. This study comprehensively reviews brain-impaired patients: The studies involving patient populations and the diseases discussed in more than 10 works are included. Eleven diseases examined in this paper include autism spectrum disorder, attention-deficit hyperactivity disorder, epilepsy, depressive disorders, anxiety and panic disorder, schizophrenia, mild cognitive impairment, Alzheimer’s disease, Parkinson’s disease, stroke, and traumatic brain injury. For each disease, the tasks used for examination, fNIRS variables, and significant findings on the impairment are discussed. The channel configurations and the regions of interest are also outlined. Detecting the occurrence of symptoms at an earlier stage is vital for better rehabilitation and faster recovery. This paper illustrates the usability of fNIRS for early detection of impairment and the usefulness in monitoring the rehabilitation process. Finally, the limitations of the current fNIRS systems (i.e., nonexistence of a standard method and the lack of well-established features for classification) and future research directions are discussed. The authors hope that the findings in this paper would lead to advanced breakthrough discoveries in the fNIRS field in the future.

Mild cognitive impairment (MCI), a condition characterizing poor cognition, is associated with aging and depicts early symptoms of severe cognitive impairment, known as Alzheimer’s disease (AD). Meanwhile, early detection of MCI can prevent progression to AD. A great deal of research has been performed in the past decade on MCI detection. However, availability of biomarkers for MCI detection requires greater attention. In our study, we evaluated putative and reliable biomarkers for diagnosing MCI by performing different mental tasks (i.e., N-back task, Stroop task, and verbal fluency task) using functional near-infrared spectroscopy (fNIRS) signals on a group of 15 MCI patients and 9 healthy control (HC). The 15 digital biomarkers (i.e., five means, seven slopes, peak, skewness, and kurtosis) and two image biomarkers (t-map, correlation map) in the prefrontal cortex (PFC) (i.e., left PFC, middle PFC, and right PFC) between the MCI and HC groups were investigated by the statistical analysis, linear discriminant analysis (LDA), and convolutional neural network (CNN) individually. The results reveal that the statistical analysis using digital biomarkers (with a p-value < 0.05) could not distinguish the MCI patients from the HC over 60% accuracy. Therefore, the current statistical analysis needs to be improved to be used for diagnosing the MCI patients. The best accuracy with LDA was 76.67% with the N-back and Stroop tasks. However, the CNN classification results trained by image biomarkers showed a high accuracy. In particular, the CNN results trained via t-maps revealed the best accuracy (90.62%) with the N-back task, whereas the CNN result trained by the correlation maps was 85.58% with the N-back task. Also, the results illustrated that investigating the sub-regions (i.e., right, middle, left) of the PFC for detecting MCI would be better than examining the whole PFC. The t-map (or/and the correlation map) is conclusively recommended as an image biomarker for early detection of AD. The combination of CNN and image biomarkers can provide a reliable clinical tool for diagnosing MCI patients.

Acupuncture therapy (AT) is a non-pharmacological method of treatment that has been applied to various neurological diseases. However, studies on its longitudinal effect on the neural mechanisms of patients with mild cognitive impairment (MCI) for treatment purposes are still lacking in the literature. In this clinical study, we assess the longitudinal effects of ATs on MCI patients using two methods: (i) Montreal Cognitive Assessment test (MoCA-K, Korean version), and (ii) the hemodynamic response (HR) analyses using functional near-infrared spectroscopy (fNIRS). fNIRS signals of a working memory (WM) task were acquired from the prefrontal cortex. Twelve elderly MCI patients and 12 healthy people were recruited as target and healthy control (HC) groups, respectively. Each group went through an fNIRS scanning procedure three times: The initial data were obtained without any ATs, and subsequently a total of 24 AT sessions were conducted for MCI patients (i.e., MCI-0: the data prior to ATs, MCI-1: after 12 sessions of ATs for 6 weeks, MCI-2: another 12 sessions of ATs for 6 weeks). The mean HR responses of all MCI-0–2 cases were lower than those of HCs. To compare the effects of AT on MCI patients, MoCA-K results, temporal HR data, and spatial activation patterns (i.e., t-maps) were examined. In addition, analyses of functional connectivity (FC) and graph theory upon WM tasks were conducted. With ATs, (i) the averaged MoCA-K test scores were improved (MCI-1, p = 0.002; MCI-2, p = 2.9e–4); (ii) the mean HR response of WM tasks was increased (p < 0.001); and (iii) the t-maps of MCI-1 and MCI-2 were enhanced. Furthermore, an increased FC in the prefrontal cortex in both MCI-1/MCI-2 cases in comparison to MCI-0 was obtained (p < 0.01), and an increasing trend in the graph theory parameters was observed. All these findings reveal that ATs have a positive impact on improving the cognitive function of MCI patients. In conclusion, ATs can be used as a therapeutic tool for MCI patients as a non-pharmacological method (Clinical trial registration number: KCT 0002451 https://cris.nih.go.kr/cris/en/).

Enhanced classification accuracy and a sufficient number of commands are highly demanding in brain computer interfaces (BCIs). For a successful BCI, early detection of brain commands in time is essential. In this paper, we propose a novel classifier using a modified vector phase diagram and the power of electroencephalography (EEG) signal for early prediction of hemodynamic responses. EEG and functional near-infrared spectroscopy (fNIRS) signals for a motor task (thumb tapping) were obtained concurrently. Upon the resting state threshold circle in the vector phase diagram that uses the maximum values of oxy- and deoxy-hemoglobin (ΔHbO and ΔHbR) during the resting state, we introduce a secondary (inner) threshold circle using the ΔHbO and ΔHbR magnitudes during the time window of 1 s where an EEG activity is noticeable. If the trajectory of ΔHbO and ΔHbR touches the resting state threshold circle after passing through the inner circle, this indicates that ΔHbO was increasing and ΔHbR was decreasing (i.e., the start of a hemodynamic response). It takes about 0.5 s for an fNIRS signal to cross the resting state threshold circle after crossing the EEG-based circle. Thus, an fNIRS-based BCI command can be generated in 1.5 s. We achieved an improved accuracy of 86.0% using the proposed method in comparison with the 63.8% accuracy obtained using linear discriminant analysis in a window of 0~1.5 s. Moreover, the active brain locations (identified using the proposed scheme) were spatially specific when a t-map was made after 10 s of stimulation. These results demonstrate the possibility of enhancing the classification accuracy for a brain-computer interface with a time window of 1.5 s using the proposed method.

A tight coupling between the neuronal activity and the cerebral blood flow (CBF) is the motivation of many hemodynamic response (HR)-based neuroimaging modalities. The increase in neuronal activity causes the increase in CBF that is indirectly measured by HR modalities. Upon functional stimulation, the HR is mainly categorized in three durations: (i) initial dip, (ii) conventional HR (i.e., positive increase in HR caused by an increase in the CBF), and (iii) undershoot. The initial dip is a change in oxygenation prior to any subsequent increase in CBF and spatially more specific to the site of neuronal activity. Despite additional evidence from various HR modalities on the presence of initial dip in human and animal species (i.e., cat, rat, and monkey); the existence/occurrence of an initial dip in HR is still under debate. This article reviews the existence and elusive nature of the initial dip duration of HR in intrinsic signal optical imaging (ISOI), functional magnetic resonance imaging (fMRI), and functional near-infrared spectroscopy (fNIRS). The advent of initial dip and its elusiveness factors in ISOI and fMRI studies are briefly discussed. Furthermore, the detection of initial dip and its role in brain-computer interface using fNIRS is examined in detail. The best possible application for the initial dip utilization and its future implications using fNIRS are provided.

In this study, a brain-computer interface (BCI) framework for hybrid functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG) for locked-in syndrome (LIS) patients is investigated. Brain tasks, channel selection methods, and feature extraction and classification algorithms available in the literature are reviewed. First, we categorize various types of patients with cognitive and motor impairments to assess the suitability of BCI for each of them. The prefrontal cortex is identified as a suitable brain region for imaging. Second, the brain activity that contributes to the generation of hemodynamic signals is reviewed. Mental arithmetic and word formation tasks are found to be suitable for use with LIS patients. Third, since a specific targeted brain region is needed for BCI, methods for determining the region of interest are reviewed. The combination of a bundled-optode configuration and threshold-integrated vector phase analysis turns out to be a promising solution. Fourth, the usable fNIRS features and EEG features are reviewed. For hybrid BCI, a combination of the signal peak and mean fNIRS signals and the highest band powers of EEG signals is promising. For classification, linear discriminant analysis has been most widely used. However, further research on vector phase analysis as a classifier for multiple commands is desirable. Overall, proper brain region identification and proper selection of features will improve classification accuracy. In conclusion, five future research issues are identified, and a new BCI scheme, including brain therapy for LIS patients and using the framework of hybrid fNIRS-EEG BCI, is provided.

This paper exploits the dynamical modeling, behavior analysis, and synchronization of a network of four different FitzHugh–Nagumo (FHN) neurons with unknown parameters linked in a ring configuration under direction-dependent coupling. The main purpose is to investigate a robust adaptive control law for the synchronization of uncertain and perturbed neurons, communicating in a medium of bidirectional coupling. The neurons are assumed to be different and interconnected in a ring structure. The strength of the gap junctions is taken to be different for each link in the network, owing to the inter-neuronal coupling medium properties. Robust adaptive control mechanism based on Lyapunov stability analysis is employed and theoretical criteria are derived to realize the synchronization of the network of four FHN neurons in a ring form with unknown parameters under direction-dependent coupling and disturbances. The proposed scheme for synchronization of dissimilar neurons, under external electrical stimuli, coupled in a ring communication topology, having all parameters unknown, and subject to directional coupling medium and perturbations, is addressed for the first time as per our knowledge. To demonstrate the efficacy of the proposed strategy, simulation results are provided.

This paper investigates a brain-based approach for visual merchandising display (VMD) in fashion stores. In marketing, VMD has become a research topic of interest. However, VMD research using brain activation information is rare. We examine the hemodynamic responses (HRs) in the prefrontal cortex (PFC) using functional near-infrared spectroscopy (fNIRS) while positive/negative displays of four stores (menswear, womenswear, underwear, and sportswear) are shown to 20 subjects. As features for classifying the HRs, the mean, variance, peak, skewness, kurtosis, t-value, and slope of the signals for a 20-sec time window for the activated channels are analyzed. Linear discriminant analysis is used for classifying two-class (positive and negative displays) and four-class (four fashion stores) models. PFC brain activation maps based on t-values depicting the data from the 16 channels are provided. In the two-class classification, the underwear store had the highest average classification result of 67.04%, whereas the menswear store had the lowest value of 64.15%. Men's classification accuracy for the underwear stores with positive and negative displays was 71.38%, whereas the highest classification accuracy obtained by women for womenswear stores was 73%. The average accuracy over the 20 subjects for positive displays was 50.68%, while that of negative displays was 51.07%. Therefore, these findings suggest that human brain activation is involved in the evaluation of the fashion store displays. It is concluded that fNIRS can be used as a brain-based tool in the evaluation of fashion stores in a daily life environment.

Functional connectivity is linked to several degenerative brain diseases prevalent in our aging society. Electrical stimulation is used for the clinical treatment and rehabilitation of patients with many cognitive disorders. In this study, the effects of high-definition transcranial direct current stimulation (HD-tDCS) on resting-state brain networks in the human prefrontal cortex were investigated by using functional near-infrared spectroscopy (fNIRS). The intrahemispheric as well as interhemispheric connectivity changes induced by 1 mA HD-tDCS were examined in 15 healthy subjects. Pearson correlation coefficient-based correlation matrices were generated from filtered time series oxyhemoglobin (ΔHbO) signals and converted into binary matrices. Common graph theory metrics were computed to evaluate the network changes. Systematic interhemispheric, intrahemispheric, and intraregional connectivity analyses demonstrated that the stimulation positively affected the resting-state connectivity in the prefrontal cortex. The poststimulation connectivity was increased throughout the prefrontal region, while focal HD-tDCS effects induced an increased rate of connectivity in the stimulated hemisphere. The graph theory metrics clearly distinguished the prestimulation and poststimulation networks for a range of thresholds. The results of this study suggest that HD-tDCS can be used to increase functional connectivity in the prefrontal cortex. The increase in functional connectivity can be explored clinically for neurorehabilitation of patients with degenerative brain diseases.

For those individuals with upper-extremity amputation, a daily normal living activity is no longer possible or it requires additional effort and time. With the aim of restoring their sensory and motor functions, theoretical and technological investigations have been carried out in the field of neuroprosthetic systems. For transmission of sensory feedback, several interfacing modalities including indirect (non-invasive), direct-to-peripheral-nerve (invasive), and cortical stimulation have been applied. Peripheral nerve interfaces demonstrate an edge over the cortical interfaces due to the sensitivity in attaining cortical brain signals. The peripheral nerve interfaces are highly dependent on interface designs and are required to be biocompatible with the nerves to achieve prolonged stability and longevity. Another criterion is the selection of nerves that allows minimal invasiveness and damages as well as high selectivity for a large number of nerve fascicles. In this paper, we review the nerve-machine interface modalities noted above with more focus on peripheral nerve interfaces, which are responsible for provision of sensory feedback. The invasive interfaces for recording and stimulation of electro-neurographic signals include intra-fascicular, regenerative-type interfaces that provide multiple contact channels to a group of axons inside the nerve and the extra-neural-cuff-type interfaces that enable interaction with many axons around the periphery of the nerve. Section Current Prosthetic Technology summarizes the advancements made to date in the field of neuroprosthetics toward the achievement of a bidirectional nerve-machine interface with more focus on sensory feedback. In the Discussion section, the authors propose a hybrid interface technique for achieving better selectivity and long-term stability using the available nerve interfacing techniques.

In this article, non-invasive hybrid brain–computer interface (hBCI) technologies for improving classification accuracy and increasing the number of commands are reviewed. Hybridization combining more than two modalities is a new trend in brain imaging and prosthesis control. Electroencephalography (EEG), due to its easy use and fast temporal resolution, is most widely utilized in combination with other brain/non-brain signal acquisition modalities, for instance, functional near infrared spectroscopy (fNIRS), electromyography (EMG), electrooculography (EOG), and eye tracker. Three main purposes of hybridization are to increase the number of control commands, improve classification accuracy and reduce the signal detection time. Currently, such combinations of EEG + fNIRS and EEG + EOG are most commonly employed. Four principal components (i.e., hardware, paradigm, classifiers, and features) relevant to accuracy improvement are discussed. In the case of brain signals, motor imagination/movement tasks are combined with cognitive tasks to increase active brain–computer interface (BCI) accuracy. Active and reactive tasks sometimes are combined: motor imagination with steady-state evoked visual potentials (SSVEP) and motor imagination with P300. In the case of reactive tasks, SSVEP is most widely combined with P300 to increase the number of commands. Passive BCIs, however, are rare. After discussing the hardware and strategies involved in the development of hBCI, the second part examines the approaches used to increase the number of control commands and to enhance classification accuracy. The future prospects and the extension of hBCI in real-time applications for daily life scenarios are provided.

In this study, functional near-infrared spectroscopy (fNIRS) is utilized to measure the hemodynamic responses (HRs) in the visual cortex of 14 subjects (aged 22–34 years) viewing the primary red, green, and blue (RGB) colors displayed on a white screen by a beam projector. The spatiotemporal characteristics of their oxygenated and deoxygenated hemoglobins (HbO and HbR) in the visual cortex are measured using a 15-source and 15-detector optode configuration. To see whether the activation maps upon RGB-color stimuli can be distinguished or not, the t-values of individual channels are averaged over 14 subjects. To find the best combination of two features for classification, the HRs of activated channels are averaged over nine trials. The HbO mean, peak, slope, skewness and kurtosis values during 2–7s window for a given 10s stimulation period are analyzed. Finally, the linear discriminant analysis (LDA) for classifying three classes is applied. Individually, the best classification accuracy obtained with slope-skewness features was 74.07% (Subject 1), whereas the best overall over 14 subjects was 55.29% with peak-skewness combination. Noting that the chance level of 3-class classification is 33.33%, it can be said that RGB colors can be distinguished. The overall results reveal that fNIRS can be used for monitoring purposes of the HR patterns in the human visual cortex.

In this paper, modeling of the coupling medium between two neurons, the effects of the model parameters on the synchronization of those neurons, and compensation of coupling strength deficiency in synchronization are studied. Our study exploits the inter-neuronal coupling medium and investigates its intrinsic properties in order to get insight into neuronal-information transmittance and, there from, brain-information processing. A novel electrical model of the coupling medium that represents a well-known RLC circuit attributable to the coupling medium's intrinsic resistive, inductive, and capacitive properties is derived. Surprisingly, the integration of such properties reveals the existence of a natural three-term control strategy, referred to in the literature as the proportional integral derivative (PID) controller, which can be responsible for synchronization between two neurons. Consequently, brain-information processing can rely on a large number of PID controllers based on the coupling medium properties responsible for the coherent behavior of neurons in a neural network. Herein, the effects of the coupling model (or natural PID controller) parameters are studied and, further, a supervisory mechanism is proposed that follows a learning and adaptation policy based on the particle swarm optimization algorithm for compensation of the coupling strength deficiency.

In this paper, a theory for detection of the absolute concentrations of oxy-hemoglobin (HbO) and deoxy-hemoglobin (HbR) from hemodynamic responses using a bundled-optode configuration in functional near-infrared spectroscopy (fNIRS) is proposed. The proposed method is then applied to the identification of two fingers (i.e., little and thumb) during their flexion and extension. This experiment involves a continuous-wave-type dual-wavelength (760 and 830 nm) fNIRS and five healthy male subjects. The active brain locations of two finger movements are identified based on the analysis of the t- and p-values of the averaged HbOs, which are quite distinctive. Our experimental results, furthermore, revealed that the hemodynamic responses of two-finger movements are different: The mean, peak, and time-to-peak of little finger movements are higher than those of thumb movements. It is noteworthy that the developed method can be extended to 3-dimensional fNIRS imaging.

Diffuse optical tomography (DOT) has been studied for use in the detection of breast cancer, cerebral oxygenation, and cognitive brain signals. As optical imaging studies have increased significantly, acquiring imaging data in real time has become increasingly important. We have developed frequency-division multiplexing (FDM) DOT systems to analyze their performance with respect to acquisition time and imaging quality, in comparison with the conventional time-division multiplexing (TDM) DOT. A large tomographic area of a cylindrical phantom 60 mm in diameter could be successfully reconstructed using both TDM DOT and FDM DOT systems. In our experiment with 6 source-detector (S-D) pairs, the TDM DOT and FDM DOT systems required 6.18 and 1 s, respectively, to obtain a single tomographic data set. While the absorption coefficient of the reconstruction image was underestimated in the case of the FDM DOT, we experimentally confirmed that the abnormal region can be clearly distinguished from the background phantom using both methods.

The first objective of this paper is to prove the existence and uniqueness of global solutions for a Kirchhoff-type wave equation with nonlinear dissipation of the form under suitable assumptions on . Next, we derive decay estimates of the energy under some growth conditions on the nonlinear dissipation g. Lastly, numerical simulations in order to verify the analytical results are given.

This paper discusses modeling and automatic feedback control of (postural and rest) tremor for adaptive-control-methodology-based estimation of deep brain stimulation (DBS) parameters. The simplest linear oscillator-based tremor model, between stimulation amplitude and tremor, is investigated by utilizing input-output knowledge. Further, a nonlinear generalization of the oscillator-based tremor model, useful for derivation of a control strategy involving incorporation of parametric-bound knowledge, is provided. Using the Lyapunov method, a robust adaptive output feedback control law, based on measurement of the tremor signal from the fingers of a patient, is formulated to estimate the stimulation amplitude required to control the tremor. By means of the proposed control strategy, an algorithm is developed for estimation of DBS parameters such as amplitude, frequency and pulse width, which provides a framework for development of an automatic clinical device for control of motor symptoms. The DBS parameter estimation results for the proposed control scheme are verified through numerical simulations.