Search

Introduction: Inadequate exposure to real-life operating can impede timely acquisition of technical competence among surgical residents, and is a major challenge faced in the current training climate. Mental rehearsal (MR)—the cognitive rehearsal of a motor task without overt physical movement—has been shown to accelerate surgical skills learning. However, the neuroplastic effect of MR of a complex bimanual surgical task is unknown. The aim of this study is to use functional near-infrared spectroscopy (fNIRS) to assess the impact of MR on prefrontal and motor cortical activation during a laparoscopic knot tying task. Methods: Twelve surgical residents performed a laparoscopic knot tying task before and after either mental rehearsal (MR, intervention group) or textbook reading (TR, control group). In both groups, fNIRS was used to measure changes in oxygenated hemoglobin concentration (HbO2) in the prefrontal (24 channels) and motor cortices (22 channels). Technical performance was measured using leak volume, objective performance score and task progression score. Results: MR led to a decrease in HbO2 (reduced activation) in the bilateral prefrontal cortex (PFC), and an increase in HbO2 (increased activation) in the left middle frontal gyrus, left precentral gyrus, and left postcentral gyrus. No discernible changes in activation were observed after TR in either the PFC or motor cortex. Moreover, smaller ΔHbO2 responses in the right PFC and greater ΔHbO2 responses in the left motor cortex were observed in the MR group compared with the TR group. Leak volume was significantly less following MR (p = 0.019), but not after TR (p = 0.347). Mean objective performance score was significantly higher following MR compared with TR (p = 0.043). Conclusion: Mental rehearsal may enhance surgical skill acquisition and technical proficiency by reducing utilization of attentional resources in the prefrontal cortex and improving neural efficiency in motor areas during a laparoscopic surgical task. [ABSTRACT FROM AUTHOR]

The present study investigated whether trait self-control impacted operators' behavior and associated neural resource strategies during a temporally irregular vigilance task. Functional near-infrared spectroscopy (fNIRS) readings of oxygenated hemoglobin (HbO2) and deoxygenated hemoglobin (HbR) from 29 participants were recorded fromthe prefrontal and parietal cortices. Self-control was associated with better perceptual sensitivity (A') in the task with the irregular event schedule. A left-lateralized effect of HbO2 was found for temporal irregularity within the dorsomedial prefrontal cortex, in accordance with functional transcranial doppler (fTCD) studies. Self-control increased HbR (decreasing activation) at right superior parietal lobule (rSPL; supporting vigilance utilization) and right inferior parietal lobule (rIPL; supporting resource reallocation). However, only rSPL was associated with the vigilance decrement--where decreases in activation led to better perceptual sensitivity in the temporally irregular task. Additionally, short stress-state measures suggest decreases in task engagement in individuals with higher self-control in the irregular task. The authors suggest a trait-state-brain-behavior relationship for self-control during difficult vigilance tasks. Implications for the study include steps toward rectifying the resource utilization vs. allocation debate in vigilance--as well as validating HbO2 and HbR as effective constructs for predicting operators'mental resources through fNIRS. [ABSTRACT FROM AUTHOR]

Background/Objectives: This study addresses the gap in methodological guidelines for neuroergonomic attention assessment in safety-critical tasks, focusing on validating EEG indices, including the engagement index (EI) and beta/alpha ratio, alongside subjective ratings. Methods: A novel task-embedded reaction time paradigm was developed to evaluate the sensitivity of these metrics to dynamic attentional demands in a more naturalistic multitasking context. By manipulating attention levels through varying secondary tasks in the NASA MATB-II task while maintaining a consistent primary reaction-time task, this study successfully demonstrated the effectiveness of the paradigm. Results: Results indicate that both the beta/alpha ratio and EI are sensitive to changes in attentional demands, with beta/alpha being more responsive to dynamic variations in attention, and EI reflecting more the overall effort required to sustain performance, especially in conditions where maintaining attention is challenging. Conclusions: The potential for predicting the attention lapses through integration of performance metrics, EEG measures, and subjective assessments was demonstrated, providing a more nuanced understanding of dynamic fluctuations of attention in multitasking scenarios, mimicking those in real-world safety-critical tasks. These findings provide a foundation for advancing methods to monitor attention fluctuations accurately and mitigate risks in critical scenarios, such as train-driving or automated vehicle operation, where maintaining a high attention level is crucial. [ABSTRACT FROM AUTHOR]

The investigation of gait and its neuronal correlates under more ecologically valid conditions as well as real-time feedback visualization is becoming increasingly important in neuro-motor rehabilitation research. The Gait Real-time Analysis Interactive Lab (GRAIL) offers advanced opportunities for gait and gait-related research by creating more naturalistic yet controlled environments through immersive virtual reality. Investigating the neuronal aspects of gait requires parallel recording of brain activity, such as through mobile electroencephalography (EEG) and/or mobile functional near-infrared spectroscopy (fNIRS), which must be synchronized with the kinetic and /or kinematic data recorded while walking. This proof-of-concept study outlines the required setup by use of the lab streaming layer (LSL) ecosystem for real-time, simultaneous data collection of two independently operating multi-channel EEG and fNIRS measurement devices and gait kinetics. In this context, a customized approach using a photodiode to synchronize the systems is described. This study demonstrates the achievable temporal accuracy of synchronous data acquisition of neurophysiological and kinematic and kinetic data collection in the GRAIL. By using event-related cerebral hemodynamic activity and visually evoked potentials during a start-to-go task and a checkerboard test, we were able to confirm that our measurement system can replicate known physiological phenomena with latencies in the millisecond range and relate neurophysiological and kinetic data to each other with sufficient accuracy. [ABSTRACT FROM AUTHOR]

IntroductionInadequate exposure to real-life operating can impede timely acquisition of technical competence among surgical residents, and is a major challenge faced in the current training climate. Mental rehearsal (MR)—the cognitive rehearsal of a motor task without overt physical movement—has been shown to accelerate surgical skills learning. However, the neuroplastic effect of MR of a complex bimanual surgical task is unknown. The aim of this study is to use functional near-infrared spectroscopy (fNIRS) to assess the impact of MR on prefrontal and motor cortical activation during a laparoscopic knot tying task.MethodsTwelve surgical residents performed a laparoscopic knot tying task before and after either mental rehearsal (MR, intervention group) or textbook reading (TR, control group). In both groups, fNIRS was used to measure changes in oxygenated hemoglobin concentration (HbO2) in the prefrontal (24 channels) and motor cortices (22 channels). Technical performance was measured using leak volume, objective performance score and task progression score.ResultsMR led to a decrease in HbO2 (reduced activation) in the bilateral prefrontal cortex (PFC), and an increase in HbO2 (increased activation) in the left middle frontal gyrus, left precentral gyrus, and left postcentral gyrus. No discernible changes in activation were observed after TR in either the PFC or motor cortex. Moreover, smaller ΔHbO2 responses in the right PFC and greater ΔHbO2 responses in the left motor cortex were observed in the MR group compared with the TR group. Leak volume was significantly less following MR (p = 0.019), but not after TR (p = 0.347). Mean objective performance score was significantly higher following MR compared with TR (p = 0.043).ConclusionMental rehearsal may enhance surgical skill acquisition and technical proficiency by reducing utilization of attentional resources in the prefrontal cortex and improving neural efficiency in motor areas during a laparoscopic surgical task.

This protocol paper outlines an innovative multimodal and multilevel approach to studying the emergence and evolution of how children build social bonds with their peers, and its potential application to improving social artificial intelligence (AI). We detail a unique hyperscanning experimental framework utilizing functional near-infrared spectroscopy (fNIRS) to observe inter-brain synchrony in child dyads during collaborative tasks and social interactions. Our proposed longitudinal study spans middle childhood, aiming to capture the dynamic development of social connections and cognitive engagement in naturalistic settings. To do so we bring together four kinds of data: the multimodal conversational behaviors that dyads of children engage in, evidence of their state of interpersonal rapport, collaborative performance on educational tasks, and inter-brain synchrony. Preliminary pilot data provide foundational support for our approach, indicating promising directions for identifying neural patterns associated with productive social interactions. The planned research will explore the neural correlates of social bond formation, informing the creation of a virtual peer learning partner in the field of Social Neuroergonomics. This protocol promises significant contributions to understanding the neural basis of social connectivity in children, while also offering a blueprint for designing empathetic and effective social AI tools, particularly for educational contexts. [ABSTRACT FROM AUTHOR]

Background: Historical biases in ergonomics-related studies have been attributed to lack of participant diversity and sensitivity of measurements to capture variability between diverse groups. We posit that a neuroergonomics approach, that is, study of brain-behavior relationships during fatiguing work, allows for unique insights on sex differences in fatigue mechanisms that are not available via traditional "neck down" measurement approaches. Objective: This study examined the supraspinal mechanisms of exercise performance under fatigue and determined if there were any sex differences in these mechanisms. Methods: Fifty-nine older adults performed submaximal handgrip contractions until voluntary fatigue. Traditional ergonomics measures, namely, force variability, electromyography (EMG) of arm muscles, and strength and endurance times, and prefrontal and motor cortex hemodynamic responses were recorded. Results: There were no significant differences observed between older males and females in fatigability outcomes (i.e., endurance times, strength loss, and EMG activity) and brain activation. Effective connectivity from prefrontal to motor areas was significant for both sexes throughout the task, but during fatigue, males had higher interregional connectivity than females. Discussion: While traditional metrics of fatigue were comparable between the sexes, we observed distinct sex-specific neuromotor strategies (i.e., information flow between frontal-motor regions) that were adopted by older adults to maintain motor performance. Application: The findings from this study offer insights into the capabilities and adaptation strategies of older men and women under fatiguing conditions. This knowledge can facilitate in the development of effective and targeted ergonomic strategies that accommodate for the varying physical capacities of diverse worker demographics. [ABSTRACT FROM AUTHOR]

The main contribution of this study was the concurrent application of EEG and eye tracking techniques during n-back tasks as part of the methodology for addressing the problem of mental workload classification through machine learning algorithms. The experiments involved 15 university students, consisting of 7 women and 8 men. Throughout the experiments, the researchers utilized the n-back memory task and the NASA-Task Load Index (TLX) subjective rating scale to assess various levels of mental workload. The results indicating the relationship between EEG and eye tracking measures and mental workload are consistent with previous research. Regarding the four-class classification task, mental workload level could be predicted with 76.59% accuracy using 34 selected features. This study makes a significant contribution to the literature by presenting a four-class mental workload estimation model that utilizes different machine learning algorithms. [ABSTRACT FROM AUTHOR]

This study addresses concerns about reproducibility in scientific research, focusing on the use of electroencephalography (EEG) and machine learning to estimate mental workload. We established guidelines for reproducible machine learning research using EEG and used these to assess the current state of reproducibility in mental workload modeling. We first started by summarizing the current state of reproducibility efforts in machine learning and in EEG. Next, we performed a systematic literature review on Scopus, Web of Science, ACM Digital Library, and Pubmed databases to find studies about reproducibility in mental workload prediction using EEG. All of this previous work was used to formulate guidelines, which we structured along the widely recognized Cross-Industry Standard Process for Data Mining (CRISP-DM) framework. By using these guidelines, researchers can ensure transparency and comprehensiveness of their methodologies, therewith enhancing collaboration and knowledge-sharing within the scientific community, and enhancing the reliability, usability and significance of EEG and machine learning techniques in general. A second systematic literature review extracted machine learning studies that used EEG to estimate mental workload. We evaluated the reproducibility status of these studies using our guidelines. We highlight areas studied and overlooked and identify current challenges for reproducibility. Our main findings include limitations on reporting performance on unseen test data, open sharing of data and code, and reporting of resources essential for training and inference processes.

IntroductionThe efficiency and safety of complex high precision human-machine systems such as in aerospace and robotic surgery are closely related to the cognitive readiness, ability to manage workload, and situational awareness of their operators. Accurate assessment of mental workload could help in preventing operator error and allow for pertinent intervention by predicting performance declines that can arise from either work overload or under stimulation. Neuroergonomic approaches based on measures of human body and brain activity collectively can provide sensitive and reliable assessment of human mental workload in complex training and work environments.MethodsIn this study, we developed a new six-cognitive-domain task protocol, coupling it with six biomedical monitoring modalities to concurrently capture performance and cognitive workload correlates across a longitudinal multi-day investigation. Utilizing two distinct modalities for each aspect of cardiac activity (ECG and PPG), ocular activity (EOG and eye-tracking), and brain activity (EEG and fNIRS), 23 participants engaged in four sessions over 4 weeks, performing tasks associated with working memory, vigilance, risk assessment, shifting attention, situation awareness, and inhibitory control.ResultsThe results revealed varying levels of sensitivity to workload within each modality. While certain measures exhibited consistency across tasks, neuroimaging modalities, in particular, unveiled meaningful differences between task conditions and cognitive domains.DiscussionThis is the first comprehensive comparison of these six brain-body measures across multiple days and cognitive domains. The findings underscore the potential of wearable brain and body sensing methods for evaluating mental workload. Such comprehensive neuroergonomic assessment can inform development of next generation neuroadaptive interfaces and training approaches for more efficient human-machine interaction and operator skill acquisition.

Background: There is a significant need to monitor human cognitive performance in complex environments, with one example being pilot performance. However, existing assessments largely focus on subjective experiences (e.g., questionnaires) and the evaluation of behavior (e.g., aircraft handling) as surrogates for cognition or utilize brainwave measures which require artificial setups (e.g., simultaneous auditory stimuli) that intrude on the primary tasks. Blink-related oscillations (BROs) are a recently discovered neural phenomenon associated with spontaneous blinking that can be captured without artificial setups and are also modulated by cognitive loading and the external sensory environment—making them ideal for brain function assessment within complex operational settings. Methods: Electroencephalography (EEG) data were recorded from eight adult participants (five F, M = 21.1 years) while they completed the Multi-Attribute Task Battery under three different cognitive loading conditions. BRO responses in time and frequency domains were derived from the EEG data, and comparisons of BRO responses across cognitive loading conditions were undertaken. Simultaneously, assessments of blink behavior were also undertaken. Results: Blink behavior assessments revealed decreasing blink rate with increasing cognitive load (p < 0.001). Prototypical BRO responses were successfully captured in all participants (p < 0.001). BRO responses reflected differences in task-induced cognitive loading in both time and frequency domains (p < 0.05). Additionally, reduced pre-blink theta band desynchronization with increasing cognitive load was also observed (p < 0.05). Conclusion: This study confirms the ability of BRO responses to capture cognitive loading effects as well as preparatory pre-blink cognitive processes in anticipation of the upcoming blink during a complex multitasking situation. These successful results suggest that blink-related neural processing could be a potential avenue for cognitive state evaluation in operational settings—both specialized environments such as cockpits, space exploration, military units, etc. and everyday situations such as driving, athletics, human-machine interactions, etc.—where human cognition needs to be seamlessly monitored and optimized. [ABSTRACT FROM AUTHOR]

Objective: We examine the spatiotemporal dynamics of neural activity and its correlates in heart rate and its variability (HR/HRV) during a fatiguing visuospatial working memory task. Background: The neural and physiological drivers of fatigue are complex, coupled, and poorly understood. Investigations that combine the fidelity of neural indices and the field-readiness of physiological measures can facilitate measurements of fatigue states in operational settings. Method: Sixteen healthy adults, balanced by sex, completed a 60-minute fatiguing visuospatial working memory task. Changes in task performance, subjective measures of effort and fatigue, cerebral hemodynamics, and HR/HRV were analyzed. Peak brain activation, functional and effective connections within relevant brain networks were contrasted against spectral and temporal features of HR/HRV. Results: Task performance elicited increased neural activation in regions responsible for maintaining working memory capacity. With the onset of time-on-task effects, resource utilization was seen to increase beyond task-relevant networks. Over time, functional connections in the prefrontal cortex were seen to weaken, with changes in the causal relationships between key regions known to drive working memory. HR/HRV indices were seen to closely follow activity in the prefrontal cortex. Conclusion: This investigation provided a window into the neurophysiological underpinnings of working memory under the time-on-task effect. HR/HRV was largely shown to mirror changes in cortical networks responsible for working memory, therefore supporting the possibility of unobtrusive state recognition under ecologically valid conditions. Applications: Findings here can inform the development of a fieldable index for cognitive fatigue. [ABSTRACT FROM AUTHOR]

Spatial cognition plays a crucial role in academic achievement, particularly in science, technology, engineering, and mathematics (STEM) domains. Immersive virtual environments (VRs) have the growing potential to reduce cognitive load and improve spatial reasoning. However, traditional methods struggle to assess the mental effort required for visuospatial processes due to the difficulty in verbalizing actions and other limitations in self-reported evaluations. In this neuroergonomics study, we aimed to capture the neural activity associated with cognitive workload during visuospatial tasks and evaluate the impact of the visualization medium on visuospatial task performance. We utilized functional near-infrared spectroscopy (fNIRS) wearable neuroimaging to assess cognitive effort during spatial-reasoning-based problem-solving and compared a VR, a computer screen, and a physical real-world task presentation. Our results reveal a higher neural efficiency in the prefrontal cortex (PFC) during 3D geometry puzzles in VR settings compared to the settings in the physical world and on the computer screen. VR appears to reduce the visuospatial task load by facilitating spatial visualization and providing visual cues. This makes it a valuable tool for spatial cognition training, especially for beginners. Additionally, our multimodal approach allows for progressively increasing task complexity, maintaining a challenge throughout training. This study underscores the potential of VR in developing spatial skills and highlights the value of comparing brain data and human interaction across different training settings. [ABSTRACT FROM AUTHOR]

Blink-related oscillations (BRO) are newly discovered neurophysiological phenomena associated with spontaneous blinking and represent cascading neural mechanisms including visual sensory, episodic memory, and information processing responses. These phenomena have been shown to be present at rest and during tasks and are modulated by cognitive load, creating the possibility for brain function assessments that can be integrated seamlessly into real-world settings. Prior works have largely examined the BRO phenomenon within controlled laboratory environments using magnetoencephalography and high-density electroencephalography (EEG) that are ill-suited for real-world deployment. Investigating BROs using lowdensity EEG within complex environments reflective of the real-world would further our understanding of how BRO responses can be utilized in realworld settings. We evaluated whether the BRO response could be captured in a high-fidelity flight simulation environment using a portable, low-density wireless EEG system. The effects of age and task demands on BRO responses were also examined. EEG data from 30 licensed pilots (age 43.37 +/- 17.86, 2 females) were collected during simulated flights at two cognitive workload levels. Comparisons of signal amplitudes were undertaken to confirm the presence of BRO responses and mixed model ANOVAs quantified the effects of workload and age group on BRO amplitudes. Significant increases in neural activity were observed post-blink compared to the baseline period (p < 0.05), confirming the presence of BRO responses. In line with prior studies, results showed BRO time-domain responses from the delta band (0.5-4 Hz) consisting of an early negative peak followed by a positive peak post-blink in temporal and parietal electrodes. Additionally, task workload and age-related effects were also found, with observations of the enhancement of BRO amplitudes with older age and attenuation of BRO responses in high workloads (p < 0.05). These findings demonstrate that it is possible to capture BRO responses within simulated flight environments using portable, low-cost, easy-to-use EEG systems. Furthermore, biological and task salience were reflected in these BRO responses. The successful detection and demonstration of both task-and age-related modulation of BRO responses in this study open the possibility of assessing human brain function across the lifespan with BRO responses in complex and realistic environments. [ABSTRACT FROM AUTHOR]

Background: Car driving is more and more automated, to such an extent that driving without active steering control is becoming a reality. Although active driving requires the use of visual information to guide actions (i.e., steering the vehicle), passive driving only requires looking at the driving scene without any need to act (i.e., the human is passively driven). Materials & Methods: After a careful search of the scientific literature, 11 different studies, providing 17 contrasts, were used to run a comprehensive meta‐analysis contrasting active driving with passive driving. Results: Two brain regions were recruited more consistently for active driving compared to passive driving, the left precentral gyrus (BA3 and BA4) and the left postcentral gyrus (BA4 and BA3/40), whereas a set of brain regions was recruited more consistently in passive driving compared to active driving: the left middle frontal gyrus (BA6), the right anterior lobe and the left posterior lobe of the cerebellum, the right sub‐lobar thalamus, the right anterior prefrontal cortex (BA10), the right inferior occipital gyrus (BA17/18/19), the right inferior temporal gyrus (BA37), and the left cuneus (BA17). Discussion: From a theoretical perspective, these findings support the idea that the output requirement of the visual scanning process engaged for the same activity can trigger different cerebral pathways, associated with different cognitive processes. A dorsal stream dominance was found during active driving, whereas a ventral stream dominance was obtained during passive driving. From a practical perspective, and contrary to the dominant position in the Human Factors community, our findings support the idea that a transition from passive to active driving would remain challenging as passive and active driving engage distinct neural networks. [ABSTRACT FROM AUTHOR]

Background: Stress affects learning during training, and virtual reality (VR) based training systems that manipulate stress can improve retention and retrieval performance for firefighters. Brain imaging using functional Near Infrared Spectroscopy (fNIRS) can facilitate development of VR-based adaptive training systems that can continuously assess the trainee's states of learning and cognition. Objective: The aim of this study was to model the neural dynamics associated with learning and retrieval under stress in a VR-based emergency response training exercise. Methods: Forty firefighters underwent an emergency shutdown training in VR and were randomly assigned to either a control or a stress group. The stress group experienced stressors including smoke, fire, and explosions during the familiarization and training phase. Both groups underwent a stress memory retrieval and no-stress memory retrieval condition. Participant's performance scores, fNIRS-based neural activity, and functional connectivity between the prefrontal cortex (PFC) and motor regions were obtained for the training and retrieval phases. Results: The performance scores indicate that the rate of learning was slower in the stress group compared to the control group, but both groups performed similarly during each retrieval condition. Compared to the control group, the stress group exhibited suppressed PFC activation. However, they showed stronger connectivity within the PFC regions during the training and between PFC and motor regions during the retrieval phases. Discussion: While stress impaired performance during training, adoption of stress-adaptive neural strategies (i.e., stronger brain connectivity) were associated with comparable performance between the stress and the control groups during the retrieval phase. [ABSTRACT FROM AUTHOR]

Lab-confined electroencephalogram experiments generally impel the subject's mobility. Hence, we provide a wearable solution enabling human brain activity while monitoring during everyday activities, especially for neuroergonomics. This paper introduces CameraEEG, a new Android application that allows for synchronized smartphone acquisition of electroencephalogram (EEG) and camera data. Using a button on the app, the subject can record the witnessed audio-visual events of interest. Android SDK version 28 and mBrainTrain's Smarting Mobi SDK were used to develop the app. The app can be used across all Android smartphones that have Android OS–Lollipop at least. In this paper, we used the app to record synchronized video and EEG data from four subjects during two tasks (namely, closed and open eyes), each under sitting conditions. We used the POz electrode data for analysis. There was a visible difference between the power spectrums of both the tasks, with the eyes-closed task reflecting an alpha band peak. Also, the obtained video and EEG data showed accurate synchronization. A download weblink for the.apk file along with a detailed help document for the developed app is provided for further testing. [ABSTRACT FROM AUTHOR]

The disruptive deployment of collaborative robots, named cobots, in Industry 5.0 has brought attention to the safety and ergonomic aspects of industrial human–robot interaction (HRI) tasks. In particular, the study of the operator's mental workload in HRI activities has been the research object of a new branch of ergonomics, called neuroergonomics, to improve the operator's wellbeing and the efficiency of the system. This study shows the development of a combinative assessment for the evaluation of mental workload in a comparative analysis of two assembly task scenarios, without and with robot interaction. The evaluation of mental workload is achieved through a combination of subjective (NASA TLX) and real-time objective measurements. This latter measurement is found using an innovative electroencephalogram (EEG) device and the characterization of the cognitive workload through the brainwave power ratio β/α, defined after the pre-processing phase of EEG data. Finally, observational analyses are considered regarding the task performance of the two scenarios. The statistical analyses show how significantly the mental workload diminution and a higher level of performance, as the number of components assembled correctly by the participants, are achieved in the scenario with the robot. [ABSTRACT FROM AUTHOR]

When assessing trainees' progresses during a driving training program, instructors can only rely on the evaluation of a trainee's explicit behavior and their performance, without having any insight about the training effects at a cognitive level. However, being able to drive does not imply knowing how to drive safely in a complex scenario such as the road traffic. Indeed, the latter point involves mental aspects, such as the ability to manage and allocate one's mental effort appropriately, which are difficult to assess objectively. In this scenario, this study investigates the validity of deploying an electroencephalographic neurometric of mental effort, obtained through a wearable electroencephalographic device, to improve the assessment of the trainee. The study engaged 22 young people, without or with limited driving experience. They were asked to drive along five different but similar urban routes, while their brain activity was recorded through electroencephalography. Moreover, driving performance, subjective and reaction times measures were collected for a multimodal analysis. In terms of subjective and performance measures, no driving improvement could be detected either through the driver's subjective measures or through their driving performance. On the other side, through the electroencephalographic neurometric of mental effort, it was possible to catch their improvement in terms of mental performance, with a decrease in experienced mental demand after three repetitions of the driving training tasks. These results were confirmed by the analysis of reaction times, that significantly improved from the third repetition as well. Therefore, being able to measure when a task is less mentally demanding, and so more automatic, allows to deduce the degree of users training, becoming capable of handling additional tasks and reacting to unexpected events. [ABSTRACT FROM AUTHOR]

Humans' performance varies due to the mental resources that are available to successfully pursue a task. To monitor users' current cognitive resources in naturalistic scenarios, it is essential to not only measure demands induced by the task itself but also consider situational and environmental influences. We conducted a multimodal study with 18 participants (nine female, M = 25.9 with SD = 3.8 years). In this study, we recorded respiratory, ocular, cardiac, and brain activity using functional near-infrared spectroscopy (fNIRS) while participants performed an adapted version of the warship commander task with concurrent emotional speech distraction. We tested the feasibility of decoding the experienced mental effort with a multimodal machine learning architecture. The architecture comprised feature engineering, model optimisation, and model selection to combine multimodal measurements in a cross-subject classification. Our approach reduces possible overfitting and reliably distinguishes two different levels of mental effort. These findings contribute to the prediction of different states of mental effort and pave the way toward generalised state monitoring across individuals in realistic applications. [ABSTRACT FROM AUTHOR]

There is a gap in our understanding of how best to apply transcranial direct-current stimulation (tDCS) to enhance learning in complex, realistic, and multifocus tasks such as aviation. Our goal is to assess the effects of tDCS and feedback training on task performance, brain activity, and connectivity using functional magnetic resonance imaging (fMRI). Experienced glider pilots were recruited to perform a one-day, three-run flight-simulator task involving varying difficulty conditions and a secondary auditory task, mimicking real flight requirements. The stimulation group (versus sham) received 1.5 mA high-definition HD-tDCS to the right dorsolateral prefrontal cortex (DLPFC) for 30 min during the training. Whole-brain fMRI was collected before, during, and after stimulation. Active stimulation improved piloting performance both during and post-training, particularly in novice pilots. The fMRI revealed a number of tDCS-induced effects on brain activation, including an increase in the left cerebellum and bilateral basal ganglia for the most difficult conditions, an increase in DLPFC activation and connectivity to the cerebellum during stimulation, and an inhibition in the secondary task-related auditory cortex and Broca's area. Here, we show that stimulation increases activity and connectivity in flight-related brain areas, particularly in novices, and increases the brain's ability to focus on flying and ignore distractors. These findings can guide applied neurostimulation in real pilot training to enhance skill acquisition and can be applied widely in other complex perceptual-motor real-world tasks. [ABSTRACT FROM AUTHOR]

Introduction: The processes involved in how the attention system selectively focuses on perceptual and motor aspects related to a specific task, while suppressing features of other tasks and/or objects in the environment, are of considerable interest for cognitive neuroscience. The goal of this experiment was to investigate neural processes involved in selective attention and performance under multi-task situations. Several studies have suggested that attention-related gamma-band activity facilitates processing in task-specific modalities, while alpha-band activity inhibits processing in non-task-related modalities. However, investigations into the phenomenon of inattentional deafness/blindness (inability to observe stimuli in non-dominant task when primary task is demanding) have yet to observe gamma-band activity. Methods: This EEG experiment utilizes an engaging whole-body perceptual motor task while carrying out a secondary auditory detection task to investigate neural correlates of inattentional deafness in natural immersive high workload conditions. Differences between hits and misses on the auditory detection task in the gamma (30-50Hz) and alpha frequency (8-12Hz) range were carried out at the cortical source level using LORETA. Results: Participant auditory task performance correlated with an increase in gamma-band activity for hits over misses pre- and post-stimulus in left auditory processing regions. Alpha-band activity was greater for misses relative to hits in right auditory processing regions pre- and post-stimulus onset. These results are consistent with the facilitatory/inhibitory role of gamma/alpha-band activity for neural processing. Additional gamma- and alpha-band activity was found in frontal and parietal brain regions which are thought to reflect various attentional monitoring, selection, and switching processes. Discussion: The results of this study help to elucidate the role of gamma and alpha frequency bands in frontal and modality-specific regions involved with selective attention in multi-task immersive situations. [ABSTRACT FROM AUTHOR]

The main contribution of this study was the concurrent application of EEG and eye tracking techniques during n-back tasks as part of the methodology for addressing the problem of mental workload classification through machine learning algorithms. The experiments involved 15 university students, consisting of 7 women and 8 men. Throughout the experiments, the researchers utilized the n-back memory task and the NASA-Task Load Index (TLX) subjective rating scale to assess various levels of mental workload. The results indicating the relationship between EEG and eye tracking measures and mental workload are consistent with previous research. Regarding the four-class classification task, mental workload level could be predicted with 76.59% accuracy using 34 selected features. This study makes a significant contribution to the literature by presenting a four-class mental workload estimation model that utilizes different machine learning algorithms.

In cyber threat situations, the establishment of a shared situational awareness as a basis for cyber defense decision-making results from adequate communication of a Recognized Cyber Picture (RCP). RCPs consist of actively selected information and have the goal of accurately presenting the severity and potential consequences of the situation. RCPs must be communicated between individuals, but also between organizations, and often from technical to non−/less technical personnel. The communication of RCPs is subject to many challenges that may affect the transfer of critical information between individuals. There are currently no common best practices for training communication for shared situational awareness among cyber defense personnel. The Orient, Locate, Bridge (OLB) model is a pedagogic tool to improve communication between individuals during a cyber threat situation. According to the model, an individual must apply meta-cognitive awareness (O), perspective taking (L), and communication skills (B) to successfully communicate the RCP. Gamification (applying game elements to non-game contexts) has shown promise as an approach to learning. We propose a novel OLB-based Gamification design to improve dyadic communication for shared situational awareness among (technical and non-technical) individuals during a cyber threat situation. The design includes the Gamification elements of narrative, scoring, feedback, and judgment of self. The proposed concept contributes to the educational development of cyber operators from both military and civilian organizations responsible for defending and securing digital infrastructure. This is achieved by combining the elements of a novel communication model with Gamification in a context in urgent need for educational input.

Background: Neuroergonomics is an emerging science that focuses on the human brain’s performance during physical work. The advent of portable neurophysiological methods, including electroencephalography (EEG), has enabled measurements of real-time brain activity during physical tasks without restricting body movements. However, the EEG signatures of different levels of physical exertion activity involving the musculoskeletal system remain poorly understood. Objective: This study investigated the EEG source localization activity induced by predefined force exertion levels during an isometric arm force exertion task in healthy female participants for the alpha and beta frequency bands. Methods: Exact low-resolution electromagnetic tomography (eLORETA) was used to localize the current source densities (CSDs) in 84 anatomical brain regions of interest. Results: The maximum CSDs for extremely hard force exertion levels for the alpha frequency were localized in Brodmann area (BA) 6, whereas CSDs associated with other exertion levels were localized in BA 8. The maximum CSDs for extremely hard force exertion levels for beta were localized in BA 5, whereas CSDs associated with other exertion levels were localized in BA 7. Conclusions: These findings extend the current understanding of the neurophysiological basis of physical exertion with various force levels and suggest that specific brain regions are involved in generating the sensation of force exertion. To our knowledge, this is the first study localizing EEG activity among various predefined force exertion levels during an isometric arm exertion task in healthy female participants. [ABSTRACT FROM AUTHOR]

Objective: To explore vigilance task performance, cerebral blood flow velocity (CBFV), workload, and stress in a within-subjects, two-session experiment. Background: Vigilance, or sustained attention, tasks are often characterized by a decline in operator performance and CBFV with time on task, and high workload and stress. Though performance is known to improve with practice, past research has not included measures of CBFV, stress, and workload in a within-subjects multi-session design, which may also provide insight into ongoing theoretical debate. Method: Participants performed a vigilance task on two separate occasions. Performance, CBFV, workload, and self-reported stress were measured. Results: Within each session, results were consistent with the vigilance profile found in prior research. Across sessions, performance improved but the time on task decrement remained. Mean CBFV and workload ratings did not differ between sessions, but participants reported significantly less distress, worry, and engagement after session two compared to one. Conclusion: Though practice may not disrupt the standard vigilance profile, it may serve to improve overall performance and reduce stress. However, repeated exposure may have negative implications for engagement and mind-wandering. Application: It is important to better understand the relationship between experience, performance, physiological response, and self-reported stress and workload in vigilance because real-world environments often require operators to do the same task over many occasions. While performance improvement and reduced distress is an encouraging result, the decline in engagement requires further research. Results across sessions fail to provide support to the mind-wandering theory of vigilance. [ABSTRACT FROM AUTHOR]

Lab-confined electroencephalogram experiments generally impel the subject’s mobility. Hence, we provide a wearable solution enabling human brain activity while monitoring during everyday activities, especially for neuroergonomics. This paper introduces CameraEEG, a new Android application that allows for synchronized smartphone acquisition of electroencephalogram (EEG) and camera data. Using a button on the app, the subject can record the witnessed audio-visual events of interest. Android SDK version 28 and mBrainTrain’s Smarting Mobi SDK were used to develop the app. The app can be used across all Android smartphones that have Android OS–Lollipop at least. In this paper, we used the app to record synchronized video and EEG data from four subjects during two tasks (namely, closed and open eyes), each under sitting conditions. We used the POz electrode data for analysis. There was a visible difference between the power spectrums of both the tasks, with the eyes-closed task reflecting an alpha band peak. Also, the obtained video and EEG data showed accurate synchronization. A download weblink for the .apk file along with a detailed help document for the developed app is provided for further testing.

IntroductionThe processes involved in how the attention system selectively focuses on perceptual and motor aspects related to a specific task, while suppressing features of other tasks and/or objects in the environment, are of considerable interest for cognitive neuroscience. The goal of this experiment was to investigate neural processes involved in selective attention and performance under multi-task situations. Several studies have suggested that attention-related gamma-band activity facilitates processing in task-specific modalities, while alpha-band activity inhibits processing in non-task-related modalities. However, investigations into the phenomenon of inattentional deafness/blindness (inability to observe stimuli in non-dominant task when primary task is demanding) have yet to observe gamma-band activity.MethodsThis EEG experiment utilizes an engaging whole-body perceptual motor task while carrying out a secondary auditory detection task to investigate neural correlates of inattentional deafness in natural immersive high workload conditions. Differences between hits and misses on the auditory detection task in the gamma (30–50 Hz) and alpha frequency (8–12 Hz) range were carried out at the cortical source level using LORETA.ResultsParticipant auditory task performance correlated with an increase in gamma-band activity for hits over misses pre- and post-stimulus in left auditory processing regions. Alpha-band activity was greater for misses relative to hits in right auditory processing regions pre- and post-stimulus onset. These results are consistent with the facilitatory/inhibitory role of gamma/alpha-band activity for neural processing. Additional gamma- and alpha-band activity was found in frontal and parietal brain regions which are thought to reflect various attentional monitoring, selection, and switching processes.DiscussionThe results of this study help to elucidate the role of gamma and alpha frequency bands in frontal and modality-specific regions involved with selective attention in multi-task immersive situations.

Objective: We demonstrate and discuss the use of mobile electroencephalogram (EEG) for neuroergonomics. Both technical state of the art as well as measures and cognitive concepts are systematically addressed. Background: Modern work is increasingly characterized by information processing. Therefore, the examination of mental states, mental load, or cognitive processing during work is becoming increasingly important for ergonomics. Results: Mobile EEG allows to measure mental states and processes under real live conditions. It can be used for various research questions in cognitive neuroergonomics. Besides measures in the frequency domain that have a long tradition in the investigation of mental fatigue, task load, and task engagement, new approaches—like blink-evoked potentials—render event-related analyses of the EEG possible also during unrestricted behavior. Conclusion: Mobile EEG has become a valuable tool for evaluating mental states and mental processes on a highly objective level during work. The main advantage of this technique is that working environments don't have to be changed while systematically measuring brain functions at work. Moreover, the workflow is unaffected by such neuroergonomic approaches. [ABSTRACT FROM AUTHOR]

Background: Cyber operations unfold at superhuman speeds where cyber defense decisions are based on human-to-human communication aiming to achieve a shared cyber situational awareness. The recently proposed Orient, Locate, Bridge (OLB) model suggests a three-phase metacognitive approach for successful communication of cyber situational awareness for good cyber defense decision-making. Successful OLB execution implies applying cognitive control to coordinate self-referential and externally directed cognitive processes. In the brain, this is dependent on the frontoparietal control network and its connectivity to the default mode network. Emotional reactions may increase default mode network activity and reduce attention allocation to analytical processes resulting in sub-optimal decision-making. Vagal tone is an indicator of activity in the dorsolateral prefrontal node of the frontoparietal control network and is associated with functional connectivity between the frontoparietal control network and the default mode network. Aim: The aim of the present study was to assess whether indicators of neural activity relevant to the processes outlined by the OLB model were related to outcomes hypothesized by the model. Methods: Cyber cadets (N = 36) enrolled in a 3-day cyber engineering exercise organized by the Norwegian Defense Cyber Academy participated in the study. Differences in prospective metacognitive judgments of cyber situational awareness, communication demands, and mood were compared between cyber cadets with high and low vagal tone. Vagal tone was measured at rest prior to the exercise. Affective states, communication demands, cyber situational awareness, and metacognitive accuracy were measured on each day of the exercise. Results: We found that cyber cadets with higher vagal tone had better metacognitive judgments of cyber situational awareness, imposed fewer communication demands on their teams, and had more neutral moods compared to cyber cadets with lower vagal tone. Conclusion: These findings provide neuroergonomic support for the OLB model and suggest that it may be useful in education and training. Future studies should assess the effect of OLB-ing as an intervention on communication and performance. [ABSTRACT FROM AUTHOR]

Background: Cyber operations unfold at superhuman speeds where cyber defense decisions are based on human-to-human communication aiming to achieve a shared cyber situational awareness. The recently proposed Orient, Locate, Bridge (OLB) model suggests a three-phase metacognitive approach for successful communication of cyber situational awareness for good cyber defense decision-making. Successful OLB execution implies applying cognitive control to coordinate self-referential and externally directed cognitive processes. In the brain, this is dependent on the frontoparietal control network and its connectivity to the default mode network. Emotional reactions may increase default mode network activity and reduce attention allocation to analytical processes resulting in sub-optimal decision-making. Vagal tone is an indicator of activity in the dorsolateral prefrontal node of the frontoparietal control network and is associated with functional connectivity between the frontoparietal control network and the default mode network.Aim: The aim of the present study was to assess whether indicators of neural activity relevant to the processes outlined by the OLB model were related to outcomes hypothesized by the model.Methods: Cyber cadets (N = 36) enrolled in a 3-day cyber engineering exercise organized by the Norwegian Defense Cyber Academy participated in the study. Differences in prospective metacognitive judgments of cyber situational awareness, communication demands, and mood were compared between cyber cadets with high and low vagal tone. Vagal tone was measured at rest prior to the exercise. Affective states, communication demands, cyber situational awareness, and metacognitive accuracy were measured on each day of the exercise.Results: We found that cyber cadets with higher vagal tone had better metacognitive judgments of cyber situational awareness, imposed fewer communication demands on their teams, and had more neutral moods compared to cyber cadets with lower vagal tone.Conclusion: These findings provide neuroergonomic support for the OLB model and suggest that it may be useful in education and training. Future studies should assess the effect of OLB-ing as an intervention on communication and performance.

The disruptive deployment of collaborative robots, named cobots, in Industry 5.0 has brought attention to the safety and ergonomic aspects of industrial human–robot interaction (HRI) tasks. In particular, the study of the operator’s mental workload in HRI activities has been the research object of a new branch of ergonomics, called neuroergonomics, to improve the operator’s wellbeing and the efficiency of the system. This study shows the development of a combinative assessment for the evaluation of mental workload in a comparative analysis of two assembly task scenarios, without and with robot interaction. The evaluation of mental workload is achieved through a combination of subjective (NASA TLX) and real-time objective measurements. This latter measurement is found using an innovative electroencephalogram (EEG) device and the characterization of the cognitive workload through the brainwave power ratio β/α, defined after the pre-processing phase of EEG data. Finally, observational analyses are considered regarding the task performance of the two scenarios. The statistical analyses show how significantly the mental workload diminution and a higher level of performance, as the number of components assembled correctly by the participants, are achieved in the scenario with the robot.

Objective: Using dynamic causal modeling (DCM), we examined how credibility and reliability affected the way brain regions exert causal influence over each other—effective connectivity (EC)—in the context of trust in automation. Background: Multiple brain regions of the central executive network (CEN) and default mode network (DMN) have been implicated in trust judgment. However, the neural correlates of trust judgment are still relatively unexplored in terms of the directed information flow between brain regions. Method: Sixteen participants observed the performance of four computer algorithms, which differed in credibility and reliability, of the system monitoring subtask of the Air Force Multi-Attribute Task Battery (AF-MATB). Using six brain regions of the CEN and DMN commonly identified to be activated in human trust, a total of 30 (forward, backward, and lateral) connection models were developed. Bayesian model averaging (BMA) was used to quantify the connectivity strength among the brain regions. Results: Relative to the high trust condition, low trust showed unique presence of specific connections, greater connectivity strengths from the prefrontal cortex, and greater network complexity. High trust condition showed no backward connections. Conclusion: Results indicated that trust and distrust can be two distinctive neural processes in human–automation interaction—distrust being a more complex network than trust, possibly due to the increased cognitive load. Application: The causal architecture of distributed brain regions inferred using DCM can help not only in the design of a balanced human–automation interface design but also in the proper use of automation in real-life situations. [ABSTRACT FROM AUTHOR]

Operators experience complicated physiological and psychological states when exposed to extreme heat stress, which can impair cognitive function and decrease performance significantly, ultimately leading to severe secondary disasters. Therefore, there is an urgent need for a feasible technique to identify their abnormal states to enhance the reliability of human-cybernetics systems. With the advancement of deep learning in physiological modeling, a model for evaluating operators' performance driven by electrocardiogram (ECG) and functional near-infrared spectroscopy (fNIRS) was proposed, demonstrating high ecological validity. The model fused a convolutional neural network (CNN) backbone and a graph attention network (GAT) backbone to extract discriminative features from ECG time-frequency spectrums and fNIRS prefrontal cortex (PFC) network respectively with deeper neuroscience domain knowledge, and eventually achieved 0.90 AUC. Results supported that handcrafted features extracted by specialized neuroscience methods can alleviate overfitting. Inspired by the small-world nature of the brain network, the fNIRS PFC network was organized as an undirected graph and embedded by GAT. It is proven to perform better in information aggregation and delivery compared to a simple non-linear transformation. The model provides a potential neuroergonomics application to evaluate the human state in vital human-cybernetics systems under industry 5.0 scenarios. • A neuroergonomics model to evaluate operators' performance under heat stress. • Distinguishing representation from spatial, temporal and spectral physiological data. • Prefrontal cortex network embedded by GAT is better than nonlinear transformation. • Handcraft feature alleviate overfitting by introducing neuroscience domain knowledge. [ABSTRACT FROM AUTHOR]

Traffic situations like turning at intersections are destined for safety-critical situations and accidents. Human errors are one of the main reasons for accidents in these situations. A model that recognizes the driver's turning intent could help to reduce accidents by warning the driver or stopping the vehicle before a dangerous turning maneuver. Most models that aim at predicting the probability of a driver's turning intent use only contextual information, such as gap size or waiting time. The objective of this study is to investigate whether the combination of context information and brain activation measurements enhances the recognition of turning intent. We conducted a driving simulator study while simultaneously measuring brain activation using high-density fNIRS. A neural network model for turning intent recognition was trained on the fNIRS and contextual data. The input variables were analyzed using SHAP (SHapley Additive exPlanations) feature importance analysis to show the positive effect of the inclusion of brain activation data. Both the model's evaluation and the feature importance analysis suggest that the combination of context information and brain activation leads to an improved turning intent recognition. The fNIRS results showed increased brain activation differences during the “turn” decision-making phase before turning execution in parts of the left motor cortices, such as the primary motor cortex (PMC; putative BA 4), premotor area (PMA; putative BA 6), and supplementary motor area (SMA; putative BA 8). Furthermore, we also observed increased activation differences in the left prefrontal areas, potentially in the left middle frontal gyrus (putative BA 9), which has been associated with the control of executive functions, such as decision-making and action planning. We hypothesize that brain activation measurements could be a more direct indicator with potentially high specificity for the turning behavior and thus help to increase the recognition model's performance.

Neuroergonomics focuses on the brain signatures and associated mental states underlying behavior to design human-machine interfaces enhancing performance in the cognitive and physical domains. Brain imaging techniques such as functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG) have been considered key methods for achieving this goal. Recent research stresses the value of combining EEG and fNIRS in improving these interface systems' mental state decoding abilities, but little is known about whether these improvements generalize over different paradigms and methodologies, nor about the potentialities for using these systems in the real world. We review 33 studies comparing mental state decoding accuracy between bimodal EEG-fNIRS and unimodal EEG and fNIRS in several subdomains of neuroergonomics. In light of these studies, we also consider the challenges of exploiting wearable versions of these systems in real-world contexts. Overall the studies reviewed suggest that bimodal EEG-fNIRS outperforms unimodal EEG or fNIRS despite major differences in their conceptual and methodological aspects. Much work however remains to be done to reach practical applications of bimodal EEG-fNIRS in naturalistic conditions. We consider these points to identify aspects of bimodal EEG-fNIRS research in which progress is expected or desired.