Search

Having to survive in a continuously changing environment has driven the human brain to actively predict the future state of its surroundings. Oddball tasks are specific types of experiments in which this nature of the human brain is studied. Detailed mathematical models have been constructed to explain the brain's perception in these tasks. These models consider a subject as an ideal observer who abstracts a hypothesis from the previous stimuli, and estimates its hyper-parameters - in order to make the next prediction. The corresponding prediction error is assumed to manifest the subjective surprise of the brain. While the approach of earlier works to this problem has been to suggest an encoding model, we investigated the reverse model: if the stimuli's surprise is assumed as the cause of the observer's surprise, it must be possible to decode the surprise of each stimulus, for every single subject, given only their neural responses, i.e. to tell how unexpected a specific stimulus has been for them. Employing machine learning tools, we developed a surprise decoding model for binary oddball tasks. We constructed our model using the ideal observer proposed by Meyniel et al. in 2016, and applied it to three datasets, one with visual, one with auditory, and one with both visual and auditory stimuli. We demonstrated that our decoding model performs very well for both of the sensory modalities with or without the presence of the subject's motor response. • The brain's subjective surprise is decoded instead of stimulus types. • The P300 and MMN components are equally informative about the surprise of stimuli. • Perception of surprise is independent of the sensory modality. • All rare stimuli are not necessarily surprising stimuli. • Decoder's performance is equally good with or without motor response. [ABSTRACT FROM AUTHOR]

Abstract The majority of visual recognition studies have focused on the neural responses to repeated presentations of static stimuli with abrupt and well-defined onset and offset times. In contrast, natural vision involves unique renderings of visual inputs that are continuously changing without explicitly defined temporal transitions. Here we considered commercial movies as a coarse proxy to natural vision. We recorded intracranial field potential signals from 1,284 electrodes implanted in 15 patients with epilepsy while the subjects passively viewed commercial movies. We could rapidly detect large changes in the visual inputs within approximately 100 ms of their occurrence, using exclusively field potential signals from ventral visual cortical areas including the inferior temporal gyrus and inferior occipital gyrus. Furthermore, we could decode the content of those visual changes even in a single movie presentation, generalizing across the wide range of transformations present in a movie. These results present a methodological framework for studying cognition during dynamic and natural vision. Graphical abstract Image 1 Highlights • This study presents a methodology to examine intracranial field potential responses to continuous movie stimuli. • Intracranial field potentials from human ventral visual cortex show strong, selective and consistent responses to changes during a movie. • We can decode when visual changes happen and what content changes in the visual input in single events directly from physiological signals. [ABSTRACT FROM AUTHOR]

• Motion adaptation induces a reduction (compression) of perceived duration. • The N200 ERP component predicts the perceived duration of the stimuli. • Changes in Beta power predict the adaptation-induced distortion of perceived time. • These neural signatures emerge at electrodes contralateral to the stimuli. • Perceived duration emerges from early and local visual computations. Time is as pervasive as it is elusive to study, and how the brain keeps track of millisecond time is still unclear. Here we addressed the mechanisms underlying duration perception by looking for a neural signature of subjective time distortion induced by motion adaptation. We recorded electroencephalographic signals in human participants while they were asked to discriminate the duration of visual stimuli after different types of translational motion adaptation. Our results show that perceived duration can be predicted by the amplitude of the N200 event-related potential evoked by the adapted stimulus. Moreover, we show that the distortion of subjective time can be predicted by the activity in the Beta band frequency spectrum, at the offset of the adaptor and during the presentation of the subsequent adapted stimulus. Both effects were observed from posterior electrodes contralateral to the adapted stimulus. Overall, our findings suggest that local and low-level perceptual processes are involved in generating a subjective sense of time. [ABSTRACT FROM AUTHOR]

The involvement of the medial temporal lobe (MTL) in working memory is controversially discussed. Recent findings suggest that persistent neural firing in the hippocampus during maintenance in verbal working memory is associated with workload. Here, we recorded single neuron firing in 13 epilepsy patients (7 male) while they performed a visual working memory task. The number of colored squares in the stimulus set determined the workload of the trial. Performance was almost perfect for low workload (1 and 2 squares) and dropped at high workload (4 and 6 squares), suggesting that high workload exceeded working memory capacity. We identified maintenance neurons in MTL neurons that showed persistent firing during the maintenance period. More maintenance neurons were found in the hippocampus for trials with correct compared to incorrect performance. Maintenance neurons increased and decreased firing in the hippocampus and increased firing in the entorhinal cortex for high compared to low workload. Population firing predicted workload particularly during the maintenance period. Prediction accuracy of workload based on single-trial activity during maintenance was strongest for neurons in the entorhinal cortex and hippocampus. The data suggest that persistent neural firing in the MTL reflects a domain-general process of maintenance supporting performance and workload of multiple items in working memory below and beyond working memory capacity. Persistent neural firing during maintenance in the entorhinal cortex may be associated with its preference to process visual-spatial arrays. [ABSTRACT FROM AUTHOR]

Sensing enabled implantable devices and next-generation neurotechnology allow real-time adjustments of invasive neuromodulation. The identification of symptom and disease-specific biomarkers in invasive brain signal recordings has inspired the idea of demand dependent adaptive deep brain stimulation (aDBS). Expanding the clinical utility of aDBS with machine learning may hold the potential for the next breakthrough in the therapeutic success of clinical brain computer interfaces. To this end, sophisticated machine learning algorithms optimized for decoding of brain states from neural time-series must be developed. To support this venture, this review summarizes the current state of machine learning studies for invasive neurophysiology. After a brief introduction to the machine learning terminology, the transformation of brain recordings into meaningful features for decoding of symptoms and behavior is described. Commonly used machine learning models are explained and analyzed from the perspective of utility for aDBS. This is followed by a critical review on good practices for training and testing to ensure conceptual and practical generalizability for real-time adaptation in clinical settings. Finally, first studies combining machine learning with aDBS are highlighted. This review takes a glimpse into the promising future of intelligent adaptive DBS (iDBS) and concludes by identifying four key ingredients on the road for successful clinical adoption: i) multidisciplinary research teams, ii) publicly available datasets, iii) open-source algorithmic solutions and iv) strong world-wide research collaborations. • Brain signal decoding expands precision medicine approaches to neuromodulation. • Machine learning can facilitate intelligent adaptive deep brain stimulation (iDBS). • Complex classification and regression algorithms are being reviewed. • Future studies should adhere to real-time compatible methods. • Open science practices will accelerate therapeutic benefit for iDBS in patients. [ABSTRACT FROM AUTHOR]

Abstract: Group decisions and even aggregation of multiple opinions lead to greater decision accuracy, a phenomenon known as collective wisdom. Little is known about the neural basis of collective wisdom and whether its benefits arise in late decision stages or in early sensory coding. Here, we use electroencephalography and multi-brain computing with twenty humans making perceptual decisions to show that combining neural activity across brains increases decision accuracy paralleling the improvements shown by aggregating the observers'' opinions. Although the largest gains result from an optimal linear combination of neural decision variables across brains, a simpler neural majority decision rule, ubiquitous in human behavior, results in substantial benefits. In contrast, an extreme neural response rule, akin to a group following the most extreme opinion, results in the least improvement with group size. Analyses controlling for number of electrodes and time-points while increasing number of brains demonstrate unique benefits arising from integrating neural activity across different brains. The benefits of multi-brain integration are present in neural activity as early as 200ms after stimulus presentation in lateral occipital sites and no additional benefits arise in decision related neural activity. Sensory-related neural activity can predict collective choices reached by aggregating individual opinions, voting results, and decision confidence as accurately as neural activity related to decision components. Estimation of the potential for the collective to execute fast decisions by combining information across numerous brains, a strategy prevalent in many animals, shows large time-savings. Together, the findings suggest that for perceptual decisions the neural activity supporting collective wisdom and decisions arises in early sensory stages and that many properties of collective cognition are explainable by the neural coding of information across multiple brains. Finally, our methods highlight the potential of multi-brain computing as a technique to rapidly and in parallel gather increased information about the environment as well as to access collective perceptual/cognitive choices and mental states. [Copyright &y& Elsevier]

Successful categorization requires listeners to represent the incoming sensory information, resolve the "blooming, buzzing confusion" inherent to noisy sensory signals, and leverage the accumulated evidence towards making a decision. Despite decades of intense debate, the neural systems underlying speech categorization remain unresolved. Here we assessed the neural representation and categorization of lexical tones by native Mandarin speakers (N = 31) across a range of acoustic and contextual variabilities (talkers, perceptual saliences, and stimulus-contexts) using functional magnetic imaging (fMRI) and an evidence accumulation model of decision-making. Univariate activation and multivariate pattern analyses reveal that the acoustic-variability-tolerant representations of tone category are observed within the middle portion of the left superior temporal gyrus (STG). Activation patterns in the frontal and parietal regions also contained category-relevant information that was differentially sensitive to various forms of variability. The robustness of neural representations of tone category in a distributed fronto-temporoparietal network is associated with trial-by-trial decision-making parameters. These findings support a hybrid model involving a representational core within the STG that operates dynamically within an extensive frontoparietal network to support the representation and categorization of linguistic pitch patterns. [ABSTRACT FROM AUTHOR]

The brain activity of multiple subjects has been shown to synchronize during salient moments of natural stimuli, suggesting that correlation of neural responses indexes a brain state operationally termed 'engagement'. While past electroencephalography (EEG) studies have considered both auditory and visual stimuli, the extent to which these results generalize to music—a temporally structured stimulus for which the brain has evolved specialized circuitry—is less understood. Here we investigated neural correlation during natural music listening by recording EEG responses from N = 48 adult listeners as they heard real-world musical works, some of which were temporally disrupted through shuffling of short-term segments (measures), reversal, or randomization of phase spectra. We measured correlation between multiple neural responses (inter-subject correlation) and between neural responses and stimulus envelope fluctuations (stimulus-response correlation) in the time and frequency domains. Stimuli retaining basic musical features, such as rhythm and melody, elicited significantly higher behavioral ratings and neural correlation than did phase-scrambled controls. However, while unedited songs were self-reported as most pleasant, time-domain correlations were highest during measure-shuffled versions. Frequency-domain measures of correlation (coherence) peaked at frequencies related to the musical beat, although the magnitudes of these spectral peaks did not explain the observed temporal correlations. Our findings show that natural music evokes significant inter-subject and stimulus-response correlations, and suggest that the neural correlates of musical 'engagement' may be distinct from those of enjoyment. Image 1 • We recorded EEG from 48 adults as they heard intact and scrambled natural music. • Inter-subject and stimulus-response EEG correlation and coherence were computed. • Neural correlation was significant for all stimuli retaining musical features. • Time-domain correlation was highest for music shuffled in short time segments. • Coherence peaks implicated frequencies related to metrical pulse. [ABSTRACT FROM AUTHOR]