Search

Working memory (WM) reflects the transient maintenance of information in the absence of external input, which can be attained via multiple senses separately or simultaneously. Pertaining to WM, the prevailing literature suggests the dominance of vision over other sensory systems. However, this imbalance may be stemming from challenges in finding comparable stimuli across modalities. Here, we addressed this problem by using a balanced multisensory retro-cue WM design, which employed combinations of auditory (ripple sounds) and visuospatial (Gabor patches) patterns, adjusted relative to each participant's discrimination ability. In three separate experiments, the participant was asked to determine whether the (retro-cued) auditory and/or visual items maintained in WM matched or mismatched the subsequent probe stimulus. In Experiment 1, all stimuli were audiovisual, and the probes were either fully mismatching, only partially mismatching, or fully matching the memorized item. Experiment 2 was otherwise the same as Experiment 1, but the probes were unimodal. In Experiment 3, the participant was cued to maintain only the auditory or visual aspect of an audiovisual item pair. In Experiments 1 and 3, the participant's matching performance was significantly more accurate for the auditory than visual attributes of probes. When the perceptual and task demands are bimodally equated, auditory attributes can be matched to multisensory items in WM at least as accurately as, if not more precisely than, their visual counterparts., Competing Interests: Declarations. Competing interests: The authors declare no competing interests., (© 2024. The Author(s), under exclusive licence to Springer-Verlag GmbH Germany, part of Springer Nature.)

In graph theory, "multilayer networks" represent systems involving several interconnected topological levels. One example in neuroscience is the stratification of connections between different cortical depths or "laminae", which is becoming non-invasively accessible in humans using ultra-high-resolution functional MRI (fMRI). Here, we applied multilayer graph theory to examine functional connectivity across different cortical depths in humans, using 7T fMRI (1-mm 3 voxels; 30 participants). Blood oxygenation level dependent (BOLD) signals were derived from five depths between the white matter and pial surface. We compared networks where the inter-regional connections were limited to a single cortical depth only ("layer-by-layer matrices") to those considering all possible connections between areas and cortical depths ("multilayer matrix"). We utilized global and local graph theory features that quantitatively characterize network attributes including network composition, nodal centrality, path-based measures, and hub segregation. Detecting functional differences between cortical depths was improved using multilayer connectomics compared to the layer-by-layer versions. Superficial depths of the cortex dominated information transfer and deeper depths drove clustering. These differences were largest in frontotemporal and limbic regions. fMRI functional connectivity across different cortical depths may contain neurophysiologically relevant information; thus, multilayer connectomics could provide a methodological framework for studies on how information flows across this stratification.

Here, we report onset latencies for multisensory processing of letters in the primary auditory and visual sensory cortices. Healthy adults were presented with 300-ms visual and/or auditory letters (uppercase Roman alphabet and the corresponding auditory letter names in English). Magnetoencephalography (MEG) evoked response generators were extracted from the auditory and visual sensory cortices for both within-modality and cross-sensory activations; these locations were mainly consistent with functional magnetic resonance imaging (fMRI) results in the same subjects. In the primary auditory cortices (Heschl's gyri) activity to auditory stimuli commenced at 25 ms and to visual stimuli at 65 ms (median values). In the primary visual cortex (Calcarine fissure) the activations started at 48 ms to visual and at 62 ms to auditory stimuli. This timing pattern suggests that the origins of the cross-sensory activations may be in the primary sensory cortices of the opposite modality, with conduction delays (from one sensory cortex to another) of 17-37 ms. Audiovisual interactions for letters started at 125 ms in the auditory and at 133 ms in the visual cortex (60-71 ms after inputs from both modalities converged). Multivariate pattern analysis suggested similar latency differences between the sensory cortices. Combined with our earlier findings for simpler stimuli (noise bursts and checkerboards), these results suggest that primary sensory cortices participate in early cross-modal and interaction processes similarly for different stimulus materials, but previously learned audiovisual associations and stimulus complexity may delay the start of the audiovisual interaction stage., Competing Interests: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest. The author(s) declared that they were an editorial board member of Frontiers, at the time of submission. This had no impact on the peer review process and the final decision., (Copyright © 2024 Raij, Lin, Letham, Lankinen, Nayak, Witzel, Hämäläinen and Ahveninen.)

Previous studies have demonstrated that auditory cortex activity can be influenced by cross-sensory visual inputs. Intracortical laminar recordings in nonhuman primates have suggested a feedforward (FF) type profile for auditory evoked but feedback (FB) type for visual evoked activity in the auditory cortex. To test whether cross-sensory visual evoked activity in the auditory cortex is associated with FB inputs also in humans, we analyzed magnetoencephalography (MEG) responses from eight human subjects (six females) evoked by simple auditory or visual stimuli. In the estimated MEG source waveforms for auditory cortex regions of interest, auditory evoked response showed peaks at 37 and 90 ms and visual evoked response at 125 ms. The inputs to the auditory cortex were modeled through FF- and FB-type connections targeting different cortical layers using the Human Neocortical Neurosolver (HNN), which links cellular- and circuit-level mechanisms to MEG signals. HNN modeling suggested that the experimentally observed auditory response could be explained by an FF input followed by an FB input, whereas the cross-sensory visual response could be adequately explained by just an FB input. Thus, the combined MEG and HNN results support the hypothesis that cross-sensory visual input in the auditory cortex is of FB type. The results also illustrate how the dynamic patterns of the estimated MEG source activity can provide information about the characteristics of the input into a cortical area in terms of the hierarchical organization among areas., Competing Interests: The authors declare no competing financial interests., (Copyright © 2024 the authors.)

In current sensorimotor theories pertaining to speech perception, there is a notable emphasis on the involvement of the articulatory-motor system in the processing of speech sounds. Using ultra-high field diffusion-weighted imaging at 7 Tesla, we visualized the white matter tracts connected to areas activated during a simple speech-sound production task in 18 healthy right-handed adults. Regions of interest for white matter tractography were individually determined through 7T functional MRI (fMRI) analyses, based on activations during silent vocalization tasks. These precentral seed regions, activated during the silent production of a lip-vowel sound, demonstrated anatomical connectivity with posterior superior temporal gyrus areas linked to the auditory perception of phonetic sounds. Our study provides a macrostructural foundation for understanding connections in speech production and underscores the central role of the articulatory motor system in speech perception. These findings highlight the value of ultra-high field 7T MR acquisition in unraveling the neural underpinnings of speech., Competing Interests: Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 The Author(s). Published by Elsevier Inc. All rights reserved.)

Neuroimaging studies suggest cross-sensory visual influences in human auditory cortices (ACs). Whether these influences reflect active visual processing in human ACs, which drives neuronal firing and concurrent broadband high-frequency activity (BHFA; >70 Hz), or whether they merely modulate sound processing is still debatable. Here, we presented auditory, visual, and audiovisual stimuli to 16 participants (7 women, 9 men) with stereo-EEG depth electrodes implanted near ACs for presurgical monitoring. Anatomically normalized group analyses were facilitated by inverse modeling of intracranial source currents. Analyses of intracranial event-related potentials (iERPs) suggested cross-sensory responses to visual stimuli in ACs, which lagged the earliest auditory responses by several tens of milliseconds. Visual stimuli also modulated the phase of intrinsic low-frequency oscillations and triggered 15-30 Hz event-related desynchronization in ACs. However, BHFA, a putative correlate of neuronal firing, was not significantly increased in ACs after visual stimuli, not even when they coincided with auditory stimuli. Intracranial recordings demonstrate cross-sensory modulations, but no indication of active visual processing in human ACs., Competing Interests: The authors declare no competing financial interests., (Copyright © 2024 the authors.)

Speech and language processing involve complex interactions between cortical areas necessary for articulatory movements and auditory perception and a range of areas through which these are connected and interact. Despite their fundamental importance, the precise mechanisms underlying these processes are not fully elucidated. We measured BOLD signals from normal hearing participants using high-field 7 Tesla fMRI with 1-mm isotropic voxel resolution. The subjects performed 2 speech perception tasks (discrimination and classification) and a speech production task during the scan. By employing univariate and multivariate pattern analyses, we identified the neural signatures associated with speech production and perception. The left precentral, premotor, and inferior frontal cortex regions showed significant activations that correlated with phoneme category variability during perceptual discrimination tasks. In addition, the perceived sound categories could be decoded from signals in a region of interest defined based on activation related to production task. The results support the hypothesis that articulatory motor networks in the left hemisphere, typically associated with speech production, may also play a critical role in the perceptual categorization of syllables. The study provides valuable insights into the intricate neural mechanisms that underlie speech processing., (© The Author(s) 2023. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.)

Recent research suggests that working memory (WM), the mental sketchpad underlying thinking and communication, is maintained by multiple regions throughout the brain. Whether parts of a stable WM representation could be distributed across these brain regions is, however, an open question. We addressed this question by examining the content-specificity of connectivity-pattern matrices between subparts of cortical regions-of-interest (ROI). These connectivity patterns were calculated from functional MRI obtained during a ripple-sound auditory WM task. Statistical significance was assessed by comparing the decoding results to a null distribution derived from a permutation test considering all comparable two- to four-ROI connectivity patterns. Maintained WM items could be decoded from connectivity patterns across ROIs in frontal, parietal, and superior temporal cortices. All functional connectivity patterns that were specific to maintained sound content extended from early auditory to frontoparietal cortices. Our results demonstrate that WM maintenance is supported by content-specific patterns of functional connectivity across different levels of cortical hierarchy., (© 2023. The Author(s).)

Invasive neurophysiological studies in nonhuman primates have shown different laminar activation profiles to auditory vs. visual stimuli in auditory cortices and adjacent polymodal areas. Means to examine the underlying feedforward vs. feedback type influences noninvasively have been limited in humans. Here, using 1-mm isotropic resolution 3D echo-planar imaging at 7 T, we studied the intracortical depth profiles of functional magnetic resonance imaging (fMRI) blood oxygenation level dependent (BOLD) signals to brief auditory (noise bursts) and visual (checkerboard) stimuli. BOLD percent-signal-changes were estimated at 11 equally spaced intracortical depths, within regions-of-interest encompassing auditory (Heschl's gyrus, Heschl's sulcus, planum temporale, and posterior superior temporal gyrus) and polymodal (middle and posterior superior temporal sulcus) areas. Effects of differing BOLD signal strengths for auditory and visual stimuli were controlled via normalization and statistical modeling. The BOLD depth profile shapes, modeled with quadratic regression, were significantly different for auditory vs. visual stimuli in auditory cortices, but not in polymodal areas. The different depth profiles could reflect sensory-specific feedforward versus cross-sensory feedback influences, previously shown in laminar recordings in nonhuman primates. The results suggest that intracortical BOLD profiles can help distinguish between feedforward and feedback type influences in the human brain. Further experimental studies are still needed to clarify how underlying signal strength influences BOLD depth profiles under different stimulus conditions., (© 2022 The Authors. Human Brain Mapping published by Wiley Periodicals LLC.)

Accumulating multivariate pattern analysis (MVPA) results from fMRI studies suggest that information is represented in fingerprint patterns of activations and deactivations during perception, emotions, and cognition. We postulate that these fingerprint patterns might reflect neuronal-population level sparse code documented in two-photon calcium imaging studies in animal models, i.e., information represented in specific and reproducible ensembles of a few percent of active neurons amidst widespread inhibition in neural populations. We suggest that such representations constitute a fundamental organizational principle via interacting across multiple levels of brain hierarchy, thus giving rise to perception, emotions, and cognition., (Copyright © 2022. Published by Elsevier Inc.)

Major depression is associated with alterations in the auditory P3 event-related potential (ERP). However, the persistence of these abnormalities after recovery from depressive episodes, especially in young adults, is not well known. Furthermore, the potential influence of substance use on this association is poorly understood. Young adult twin pairs (N = 177) from the longitudinal FinnTwin16 study were studied with a psychiatric interview, and P3a and P3b ERPs elicited by task-irrelevant novel sounds and targets, respectively. Dyadic linear mixed-effect models were used to distinguish the effects of lifetime major depressive disorder from familial factors and effects of alcohol problem drinking and tobacco smoking. P3a amplitude was significantly increased and P3b latency decreased, in individuals with a history of lifetime major depression, when controlling the fixed effects of alcohol abuse, tobacco, gender, twins' birth order, and zygosity. These results suggest that past lifetime major depressive disorder may be associated with enhanced attentional sensitivity., (Copyright © 2022 The Authors. Published by Elsevier B.V. All rights reserved.)

The mismatch response (MMR) is thought to be a neurophysiological measure of novel auditory detection that could serve as a translational biomarker of various neurological diseases. When recorded with electroencephalography (EEG) or magnetoencephalography (MEG), the MMR is traditionally extracted by subtracting the event-related potential/field (ERP/ERF) elicited in response to "deviant" sounds that occur randomly within a train of repetitive "standard" sounds. However, there are several problems with such a subtraction, which include increased noise and the neural adaptation problem. On the basis of the original theory underlying MMR (i.e., the memory-comparison process), the MMR should be present only in deviant epochs. Therefore, we proposed a novel method called weighted- BSS T /k , which uses only the deviant response to derive the MMR. Deviant concatenation and weight assignment are the primary procedures of weighted- BSS T /k , which maximize the benefits of time-delayed correlation. We hypothesized that this novel weighted- BSS T /k method highlights responses related to the detection of the deviant stimulus and is more sensitive than independent component analysis (ICA). To test this hypothesis and the validity and efficacy of the weighted- BSS T /k in comparison with ICA (infomax), we evaluated the methods in 12 healthy adults. Auditory stimuli were presented at a constant rate of 2 Hz. Frequency MMRs at a sensor level were obtained from the bilateral temporal lobes with the subtraction approach at 96-276 ms (the MMR time range), defined based on spatio-temporal cluster permutation analysis. In the application of the weighted- BSS T /k , the deviant responses were given a constant weight using a rectangular window on the MMR time range. The ERF elicited by the weighted deviant responses demonstrated one or a few dominant components representing the MMR that fitted well with that of the sensor space analysis using the conventional subtraction approach. In contrast, infomax or weighted-infomax revealed many minor or pseudo components as constituents of the MMR. Our single-trial, contrast-free approach may assist in using the MMR in basic and clinical research, and it opens a new and potentially useful way to analyze event-related MEG/EEG data., Competing Interests: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2022 Matsubara, Stufflebeam, Khan, Ahveninen, Hämäläinen, Goto, Maekawa, Tobimatsu and Kishida.)

Movies and narratives are increasingly utilized as stimuli in functional magnetic resonance imaging (fMRI), magnetoencephalography (MEG), and electroencephalography (EEG) studies. Emotional reactions of subjects, what they pay attention to, what they memorize, and their cognitive interpretations are all examples of inner experiences that can differ between subjects during watching of movies and listening to narratives inside the scanner. Here, we review literature indicating that behavioral measures of inner experiences play an integral role in this new research paradigm via guiding neuroimaging analysis. We review behavioral methods that have been developed to sample inner experiences during watching of movies and listening to narratives. We also review approaches that allow for joint analyses of the behaviorally sampled inner experiences and neuroimaging data. We suggest that building neurophenomenological frameworks holds potential for solving the interrelationships between inner experiences and their neural underpinnings. Finally, we tentatively suggest that recent developments in machine learning approaches may pave way for inferring different classes of inner experiences directly from the neuroimaging data, thus potentially complementing the behavioral self-reports., Competing Interests: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2022 Jääskeläinen, Ahveninen, Klucharev, Shestakova and Levy.)

The mismatch response (MMR) is thought to be a neurophysiological measure of novel auditory detection that could serve as a translational biomarker of various neurological diseases. When recorded with electroencephalography (EEG) or magnetoencephalography (MEG), the MMR is traditionally extracted by subtracting the event-related potential/field (ERP/ERF) elicited in response to "deviant" sounds that occur randomly within a train of repetitive "standard" sounds. To overcome the limitations of this subtraction procedure, we propose a novel method which we call weighted-BSS T/k , which uses only the deviant response to derive the MMR. We hypothesized that this novel weighted-BSS T/k method highlights responses related to the detection of the deviant stimulus and is more sensitive than independent component analysis (ICA). To test this hypothesis and the validity and efficacy of the weighted-BSS T/k in comparison with ICA (infomax), we evaluated the methods in 12 healthy adults. Auditory stimuli were presented at a constant rate of 2 Hz. Frequency MMRs at a sensor level were obtained from the bilateral temporal lobes with the subtraction approach at 96-276 ms (the MMR time range), defined on the basis of spatio-temporal cluster permutation analysis. In the application of the weighted-BSS T/k , the deviant responses were given a constant weight on the MMR time range. The ERF elicited by the weighted deviant responses demonstrated one or a few dominant components representing the MMR with a high signal-to-noise ratio and similar topography to that of the sensor space analysis using the subtraction approach. In contrast, infomax or weighted-infomax revealed many minor or pseudo components as constituents of the MMR. Our new approach may assist in using the MMR in basic and clinical research.Clinical Relevance-Our proposed method opens a new and potentially useful way to analyze event-related MEG/EEG data.

Neuronal oscillations are suggested to play an important role in auditory working memory (WM), but their contribution to content-specific representations has remained unclear. Here, we measure magnetoencephalography during a retro-cueing task with parametric ripple-sound stimuli, which are spectrotemporally similar to speech but resist non-auditory memory strategies. Using machine learning analyses, with rigorous between-subject cross-validation and non-parametric permutation testing, we show that memorized sound content is strongly represented in phase-synchronization patterns between subregions of auditory and frontoparietal cortices. These phase-synchronization patterns predict the memorized sound content steadily across the studied maintenance period. In addition to connectivity-based representations, there are indices of more local, "activity silent" representations in auditory cortices, where the decoding accuracy of WM content significantly increases after task-irrelevant "impulse stimuli." Our results demonstrate that synchronization patterns across auditory sensory and association areas orchestrate neuronal coding of auditory WM content. This connectivity-based coding scheme could also extend beyond the auditory domain., Competing Interests: Declaration of interests The authors declare no competing interests., (Copyright © 2021 The Author(s). Published by Elsevier Inc. All rights reserved.)

Objective . To formulate, validate, and apply an alternative to the finite element method (FEM) high-resolution modeling technique for electrical brain stimulation-the boundary element fast multipole method (BEM-FMM). To include practical electrode models for both surface and embedded electrodes. Approach . Integral equations of the boundary element method in terms of surface charge density are combined with a general-purpose fast multipole method and are expanded for voltage, shunt, current, and floating electrodes. The solution of coupled and properly weighted/preconditioned integral equations is accompanied by enforcing global conservation laws: charge conservation law and Kirchhoff's current law. Main results. A sub-percent accuracy is reported as compared to the analytical solutions and simple validation geometries. Comparison to FEM considering realistic head models resulted in relative differences of the electric field magnitude in the range of 3%-6% or less. Quantities that contain higher order spatial derivatives, such as the activating function, are determined with a higher accuracy and a faster speed as compared to the FEM. The method can be easily combined with existing head modeling pipelines such as headreco or mri2mesh. Significance. The BEM-FMM does not rely on a volumetric mesh and is therefore particularly suitable for modeling some mesoscale problems with submillimeter (and possibly finer) resolution with high accuracy at moderate computational cost. Utilizing Helmholtz reciprocity principle makes it possible to expand the method to a solution of EEG forward problems with a very large number of cortical dipoles., (© 2021 IOP Publishing Ltd.)

Visual segregation of moving objects is a considerable computational challenge when the observer moves through space. Recent psychophysical studies suggest that directionally congruent, moving auditory cues can substantially improve parsing object motion in such settings, but the exact brain mechanisms and visual processing stages that mediate these effects are still incompletely known. Here, we utilized multivariate pattern analyses (MVPA) of MRI-informed magnetoencephalography (MEG) source estimates to examine how crossmodal auditory cues facilitate motion detection during the observer's self-motion. During MEG recordings, participants identified a target object that moved either forward or backward within a visual scene that included nine identically textured objects simulating forward observer translation. Auditory motion cues 1) improved the behavioral accuracy of target localization, 2) significantly modulated the MEG source activity in the areas V2 and human middle temporal complex (hMT+), and 3) increased the accuracy at which the target movement direction could be decoded from hMT+ activity using MVPA. The increase of decoding accuracy by auditory cues in hMT+ was significant also when superior temporal activations in or near auditory cortices were regressed out from the hMT+ source activity to control for source estimation biases caused by point spread. Taken together, these results suggest that parsing object motion from self-motion-induced optic flow in the human extrastriate visual cortex can be facilitated by crossmodal influences from auditory system., (Copyright © 2021 Elsevier B.V. All rights reserved.)

The processing of information conveyed by faces is a critical component of social communication. While the neurophysiology of processing upright faces has been studied extensively in autism spectrum disorder (ASD), less is known about the neurophysiological abnormalities associated with processing inverted faces in ASD. We used magnetoencephalography (MEG) to study both long-range and local functional connectivity, with the latter assessed using local cross-frequency coupling, in response to inverted faces stimuli, in 7-18 years old individuals with ASD and age and IQ matched typically developing (TD) individuals. We found abnormally reduced coupling between the phase of the alpha rhythm and the amplitude of the gamma rhythm in the fusiform face area (FFA) in response to inverted faces, as well as reduced long-range functional connectivity between the FFA and the inferior frontal gyrus (IFG) in response to inverted faces in the ASD group. These group differences were absent in response to upright faces. The magnitude of functional connectivity between the FFA and the IFG was significantly correlated with the severity of ASD, and FFA-IFG long-range functional connectivity increased with age in TD group, but not in the ASD group. Our findings suggest that both local and long-range functional connectivity are abnormally reduced in children with ASD when processing inverted faces, and that the pattern of abnormalities associated with the processing of inverted faces differs from the pattern of upright faces in ASD, likely due to the presumed greater reliance on top-down regulations necessary for efficient processing of inverted faces. LAY SUMMARY: We found alterations in the neurophysiological responses to inverted faces in children with ASD, that were not reflected in the evoked responses, and were not observed in the responses to upright faces. These alterations included reduced local functional connectivity in the fusiform face area (FFA), and decreased long-range alpha-band modulated functional connectivity between the FFA and the left IFG. The magnitude of long-range functional connectivity between the FFA and the inferior frontal gyrus was correlated with the severity of ASD., (© 2021 International Society for Autism Research, Wiley Periodicals LLC.)

The cerebellum, a structure historically associated with motor control, has more recently been implicated in several higher-order auditory-cognitive functions. However, the exact functional pathways that mediate cerebellar influences on auditory cortex (AC) remain unclear. Here, we sought to identify auditory cortico-cerebellar pathways based on intrinsic functional connectivity magnetic resonance imaging. In contrast to previous connectivity studies that principally consider the AC as a single functionally homogenous unit, we mapped the cerebellar connectivity across different parts of the AC. Our results reveal that auditory subareas demonstrating different levels of interindividual functional variability are functionally coupled with distinct cerebellar regions. Moreover, auditory and sensorimotor areas show divergent cortico-cerebellar connectivity patterns, although sensorimotor areas proximal to the AC are often functionally grouped with the AC in previous connectivity-based network analyses. Lastly, we found that the AC can be functionally segmented into highly similar subareas based on either cortico-cerebellar or cortico-cortical functional connectivity, suggesting the existence of multiple parallel auditory cortico-cerebellar circuits that involve different subareas of the AC. Overall, the present study revealed multiple auditory cortico-cerebellar pathways and provided a fine-grained map of AC subareas, indicative of the critical role of the cerebellum in auditory processing and multisensory integration., (© The Author(s) 2021. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permission@oup.com.)

Intracranial stereoelectroencephalography (sEEG) provides unsurpassed sensitivity and specificity for human neurophysiology. However, functional mapping of brain functions has been limited because the implantations have sparse coverage and differ greatly across individuals. Here, we developed a distributed, anatomically realistic sEEG source-modeling approach for within- and between-subject analyses. In addition to intracranial event-related potentials (iERP), we estimated the sources of high broadband gamma activity (HBBG), a putative correlate of local neural firing. Our novel approach accounted for a significant portion of the variance of the sEEG measurements in leave-one-out cross-validation. After logarithmic transformations, the sensitivity and signal-to-noise ratio were linearly inversely related to the minimal distance between the brain location and electrode contacts (slope≈-3.6). The signa-to-noise ratio and sensitivity in the thalamus and brain stem were comparable to those locations at the vicinity of electrode contact implantation. The HGGB source estimates were remarkably consistent with analyses of intracranial-contact data. In conclusion, distributed sEEG source modeling provides a powerful neuroimaging tool, which facilitates anatomically-normalized functional mapping of human brain using both iERP and HBBG data., Competing Interests: Declaration of Competing Interest None., (Copyright © 2021. Published by Elsevier Inc.)

Accumulating evidence shows that auditory cortex (AC) of humans, and other primates, is involved in more complex cognitive processes than feature segregation only, which are shaped by experience-dependent plasticity and thus likely show substantial individual variability. However, thus far, individual variability of ACs has been considered a methodological impediment rather than a phenomenon of theoretical importance. Here, we examined the variability of ACs using intrinsic functional connectivity patterns in humans and macaques. Our results demonstrate that in humans, interindividual variability is greater near the nonprimary than primary ACs, indicating that variability dramatically increases across the processing hierarchy. ACs are also more variable than comparable visual areas and show higher variability in the left than in the right hemisphere, which may be related to the left lateralization of auditory-related functions such as language. Intriguingly, remarkably similar modality differences and lateralization of variability were also observed in macaques. These connectivity-based findings are consistent with a confirmatory task-based functional magnetic resonance imaging analysis. The quantification of variability in auditory function, and the similar findings in both humans and macaques, will have strong implications for understanding the evolution of advanced auditory functions in humans., (© The Author(s) 2020. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permission@oup.com.)

Low spatial resolution is often cited as the most critical limitation of magneto- and electroencephalography (MEG and EEG), but a unifying framework for quantifying the spatial fidelity of M/EEG source estimates has yet to be established; previous studies have focused on linear estimation methods under ideal scenarios without noise. Here we present an approach that quantifies the spatial fidelity of M/EEG estimates from simulated patch activations over the entire neocortex superposed on measured resting-state data. This approach grants more generalizability in the evaluation process that allows for, e.g., comparing linear and non-linear estimates in the whole brain for different signal-to-noise ratios (SNR), number of active sources and activation waveforms. Using this framework, we evaluated the MNE, dSPM, sLORETA, eLORETA, and MxNE methods and found that the spatial fidelity varies significantly with SNR, following a largely sigmoidal curve whose shape varies depending on which aspect of spatial fidelity that is being quantified and the source estimation method. We believe that these methods and results will be useful when interpreting M/EEG source estimates as well as in methods development., (Copyright © 2020 The Authors. Published by Elsevier Inc. All rights reserved.)

The neurophysiology of face processing has been studied extensively in the context of social impairments associated with autism spectrum disorder (ASD), but the existing studies have concentrated mainly on univariate analyses of responses to upright faces, and, less frequently, inverted faces. The small number of existing studies on neurophysiological responses to inverted face in ASD have used univariate approaches, with divergent results. Here, we used a data-driven, classification-based, multivariate machine learning decoding approach to investigate the temporal and spatial properties of the neurophysiological evoked response for upright and inverted faces, relative to the neurophysiological evoked response for houses, a neutral stimulus. 21 (2 females) ASD and 29 (4 females) TD participants ages 7 to 19 took part in this study. Group level classification accuracies were obtained for each condition, using first the temporal domain of the evoked responses, and then the spatial distribution of the evoked responses on the cortical surface, each separately. We found that classification of responses to inverted neutral faces vs. houses was less accurate in ASD compared to TD, in both the temporal and spatial domains. In contrast, there were no group differences in the classification of evoked responses to upright neutral faces relative to houses. Using the classification in the temporal domain, lower decoding accuracies in ASD were found around 120 ms and 170 ms, corresponding the known components of the evoked responses to faces. Using the classification in the spatial domain, lower decoding accuracies in ASD were found in the right superior marginal gyrus (SMG), intra-parietal sulcus (IPS) and posterior superior temporal sulcus (pSTS), but not in core face processing areas. Importantly, individual classification accuracies from both the temporal and spatial classifiers correlated with ASD severity, confirming the relevance of the results to the ASD phenotype., (Copyright © 2020. Published by Elsevier Inc.)

Using movies and narratives as naturalistic stimuli in human neuroimaging studies has yielded significant advances in understanding of cognitive and emotional functions. The relevant literature was reviewed, with emphasis on how the use of naturalistic stimuli has helped advance scientific understanding of human memory, attention, language, emotions, and social cognition in ways that would have been difficult otherwise. These advances include discovering a cortical hierarchy of temporal receptive windows, which supports processing of dynamic information that accumulates over several time scales, such as immediate reactions vs. slowly emerging patterns in social interactions. Naturalistic stimuli have also helped elucidate how the hippocampus supports segmentation and memorization of events in day-to-day life and have afforded insights into attentional brain mechanisms underlying our ability to adopt specific perspectives during natural viewing. Further, neuroimaging studies with naturalistic stimuli have revealed the role of the default-mode network in narrative-processing and in social cognition. Finally, by robustly eliciting genuine emotions, these stimuli have helped elucidate the brain basis of both basic and social emotions apparently manifested as highly overlapping yet distinguishable patterns of brain activity., (Copyright © 2020. Published by Elsevier Inc.)

Objective: A new numerical modeling approach is proposed which provides forward-problem solutions for both noninvasive recordings (EEG/MEG) and higher-resolution intracranial recordings (iEEG)., Methods: The algorithm is our recently developed boundary element fast multipole method or BEM-FMM. It is based on the integration of the boundary element formulation in terms of surface charge density and the fast multipole method originating from its inventors. The algorithm still possesses the major advantage of the conventional BEM - high speed - but is simultaneously capable of processing a very large number of surface-based unknowns. As a result, an unprecedented spatial resolution could be achieved, which enables multiscale modeling., Results: For non-invasive EEG/MEG, we are able to accurately solve the forward problem with approximately 1 mm anatomical resolution in the cortex within 1-2 min given several thousand cortical dipoles. Targeting high-resolution iEEG, we are able to compute, for the first time, an integrated electromagnetic response for an ensemble (2,450) of tightly packed realistic pyramidal neocortical neurons in a full-head model with 0.6 mm anatomical cortical resolution. The neuronal arbor is comprised of 5.9 M elementary 1.2 μm long dipoles. On a standard server, the computations require about 5 min., Conclusion: Our results indicate that the BEM-FMM approach may be well suited to support numerical multiscale modeling pertinent to modern high-resolution and submillimeter iEEG., Significance: Based on the speed and ease of implementation, this new algorithm represents a method that will greatly facilitate simulations at multi-scale across a variety of applications.

Auditory attention allows us to focus on relevant target sounds in the acoustic environment while maintaining the capability to orient to unpredictable (novel) sound changes. An open question is whether orienting to expected vs. unexpected auditory events are governed by anatomically distinct attention pathways, respectively, or by differing communication patterns within a common system. To address this question, we applied a recently developed PeSCAR analysis method to evaluate spectrotemporal functional connectivity patterns across subregions of broader cortical regions of interest (ROIs) to analyze magnetoencephalography data obtained during a cued auditory attention task. Subjects were instructed to detect a predictable harmonic target sound embedded among standard tones in one ear and to ignore the standard tones and occasional unpredictable novel sounds presented in the opposite ear. Phase coherence of estimated source activity was calculated between subregions of superior temporal, frontal, inferior parietal, and superior parietal cortex ROIs. Functional connectivity was stronger in response to target than novel stimuli between left superior temporal and left parietal ROIs and between left frontal and right parietal ROIs, with the largest effects observed in the beta band (15-35 Hz). In contrast, functional connectivity was stronger in response to novel than target stimuli in inter-hemispheric connections between left and right frontal ROIs, observed in early time windows in the alpha band (8-12 Hz). Our findings suggest that auditory processing of expected target vs. unexpected novel sounds involves different spatially, temporally, and spectrally distributed oscillatory connectivity patterns across temporal, parietal, and frontal areas.

Auditory distance perception and its neuronal mechanisms are poorly understood, mainly because 1) it is difficult to separate distance processing from intensity processing, 2) multiple intensity-independent distance cues are often available, and 3) the cues are combined in a context-dependent way. A recent fMRI study identified human auditory cortical area representing intensity-independent distance for sources presented along the interaural axis (Kopco et al. PNAS, 109, 11019-11024). For these sources, two intensity-independent cues are available, interaural level difference (ILD) and direct-to-reverberant energy ratio (DRR). Thus, the observed activations may have been contributed by not only distance-related, but also direction-encoding neuron populations sensitive to ILD. Here, the paradigm from the previous study was used to examine DRR-based distance representation for sounds originating in front of the listener, where ILD is not available. In a virtual environment, we performed behavioral and fMRI experiments, combined with computational analyses to identify the neural representation of distance based on DRR. The stimuli varied in distance (15-100 ​cm) while their received intensity was varied randomly and independently of distance. Behavioral performance showed that intensity-independent distance discrimination is accurate for frontal stimuli, even though it is worse than for lateral stimuli. fMRI activations for sounds varying in frontal distance, as compared to varying only in intensity, increased bilaterally in the posterior banks of Heschl's gyri, the planum temporale, and posterior superior temporal gyrus regions. Taken together, these results suggest that posterior human auditory cortex areas contain neuron populations that are sensitive to distance independent of intensity and of binaural cues relevant for directional hearing., (Copyright © 2019. Published by Elsevier Inc.)

Global auditory-spatial orienting cues help the detection of weak visual stimuli, but it is not clear whether crossmodal attention cues also enhance the resolution of visuospatial discrimination. Here, we hypothesized that if anywhere, crossmodal modulations of visual localization should emerge in the periphery where the receptive fields are large. Subjects were presented with trials where a Visual Target, defined by a cluster of low-luminance dots, was shown for 220 ms at 25°-35° eccentricity in either the left or right hemifield. The Visual Target was either Uncued or it was presented 250 ms after a crossmodal Auditory Cue that was simulated either from the same or the opposite hemifield than the Visual Target location. After a whole-screen visual mask displayed for 800 ms, a pair of vertical Reference Bars was presented ipsilateral to the Visual Target. In a two-alternative forced choice task, subjects were asked to determine which of these two bars was closer to the center of the Visual Target. When the Auditory Cue and Visual Target were hemispatially incongruent, the speed and accuracy of visual localization performance was significantly impaired. However, hemispatially congruent Auditory Cues did not improve the localization of Visual Targets when compared to the Uncued condition. Further analyses suggested that the crossmodal Auditory Cues decreased the sensitivity (d') of the Visual Target localization without affecting post-perceptual decision biases. Our results suggest that in the visual periphery, the detrimental effect of hemispatially incongruent Auditory Cues is far greater than the benefit produced by hemispatially congruent cues. Our working hypothesis for future studies is that auditory-spatial attention cues suppress irrelevant visual locations in a global fashion, without modulating the local visual precision at relevant sites.

Connectivity estimates based on electroencephalography (EEG) and magnetoencephalography (MEG) are unique in their ability to provide neurophysiologically meaningful spectral and temporal information non-invasively. This multi-dimensional aspect of the MEG/EEG based connectivity increases the challenges of the analysis and interpretation of the data. Many MEG/EEG studies address this complexity by using a hypothesis-driven approach, which focuses on particular regions of interest (ROI). However, if an effect is distributed unevenly over a large ROI and variable across subjects, it may not be detectable using conventional methods. Here, we propose a novel approach, which enhances the statistical power for weak and spatially discontinuous effects. This results in the ability to identify statistically significant connectivity patterns with spectral, temporal, and spatial specificity while correcting for multiple comparisons using nonparametric permutation methods. We call this new approach the Permutation Statistics for Connectivity Analysis between ROI (PeSCAR). We demonstrate the processing steps with simulated and real human data. The open-source Matlab code implementing PeSCAR are provided online.

Subcortical structures play a critical role in brain function. However, options for assessing electrophysiological activity in these structures are limited. Electromagnetic fields generated by neuronal activity in subcortical structures can be recorded noninvasively, using magnetoencephalography (MEG) and electroencephalography (EEG). However, these subcortical signals are much weaker than those generated by cortical activity. In addition, we show here that it is difficult to resolve subcortical sources because distributed cortical activity can explain the MEG and EEG patterns generated by deep sources. We then demonstrate that if the cortical activity is spatially sparse, both cortical and subcortical sources can be resolved with M/EEG. Building on this insight, we develop a hierarchical sparse inverse solution for M/EEG. We assess the performance of this algorithm on realistic simulations and auditory evoked response data, and show that thalamic and brainstem sources can be correctly estimated in the presence of cortical activity. Our work provides alternative perspectives and tools for characterizing electrophysiological activity in subcortical structures in the human brain., Competing Interests: The authors declare no conflict of interest., (Copyright © 2017 the Author(s). Published by PNAS.)

Auditory working memory (WM) processing in everyday acoustic environments depends on our ability to maintain relevant information online in our minds, and to suppress interference caused by competing incoming stimuli. A challenge in communication settings is that the relevant content and irrelevant inputs may emanate from a common source, such as a talkative conversationalist. An open question is how the WM system deals with such interference. Will the distracters become inadvertently filtered before processing for meaning because the primary WM operations deplete all available processing resources? Or are they suppressed post perceptually, through an active control process? We tested these alternative hypotheses by measuring magnetoencephalography (MEG), EEG, and functional MRI (fMRI) during a phonetic auditory continuous performance task. Contextual WM maintenance load was manipulated by adjusting the number of "filler" letter sounds in-between cue and target letter sounds. Trial-to-trial variability of pre- and post-stimulus activations in fMRI-informed cortical MEG/EEG estimates was analyzed within and across 14 subjects using generalized linear mixed effect (GLME) models. High contextual WM maintenance load suppressed left auditory cortex (AC) activations around 250-300 ms after the onset of irrelevant phonetic sounds. This effect coincided with increased 10-14 Hz alpha-range oscillatory functional connectivity between the left dorsolateral prefrontal cortex (DLPFC) and left AC. Suppression of AC responses to irrelevant sounds during active maintenance of the task context also correlated with increased pre-stimulus 7-15 Hz alpha power. Our results suggest that under high auditory WM load, irrelevant sounds are suppressed through a "late" active suppression mechanism, which prevents short-term consolidation of irrelevant information without affecting the initial screening of potentially meaningful stimuli. The results also suggest that AC alpha oscillations play an inhibitory role during auditory WM processing., (Copyright © 2017 Elsevier Inc. All rights reserved.)

Despite recent advances in auditory neuroscience, the exact functional organization of human auditory cortex (AC) has been difficult to investigate. Here, using reversals of tonotopic gradients as the test case, we examined whether human ACs can be more precisely mapped by avoiding signals caused by large draining vessels near the pial surface, which bias blood-oxygen level dependent (BOLD) signals away from the actual sites of neuronal activity. Using ultra-high field (7T) fMRI and cortical depth analysis techniques previously applied in visual cortices, we sampled 1mm isotropic voxels from different depths of AC during narrow-band sound stimulation with biologically relevant temporal patterns. At the group level, analyses that considered voxels from all cortical depths, but excluded those intersecting the pial surface, showed (a) the greatest statistical sensitivity in contrasts between activations to high vs. low frequency sounds and (b) the highest inter-subject consistency of phase-encoded continuous tonotopy mapping. Analyses based solely on voxels intersecting the pial surface produced the least consistent group results, even when compared to analyses based solely on voxels intersecting the white-matter surface where both signal strength and within-subject statistical power are weakest. However, no evidence was found for reduced within-subject reliability in analyses considering the pial voxels only. Our group results could, thus, reflect improved inter-subject correspondence of high and low frequency gradients after the signals from voxels near the pial surface are excluded. Using tonotopy analyses as the test case, our results demonstrate that when the major physiological and anatomical biases imparted by the vasculature are controlled, functional mapping of human ACs becomes more consistent from subject to subject than previously thought., (Copyright © 2016 Elsevier Inc. All rights reserved.)

The ability to evaluate others' errors makes it possible to learn from their mistakes without the need for first-hand trial-and-error experiences. Here, we compared functional magnetic resonance imaging activation to self-committed errors during a computer game to a variety of errors committed by others during movie clips (e.g., figure skaters falling down and persons behaving inappropriately). While viewing errors by others there was activation in lateral and medial temporal lobe structures, posterior cingulate cortex, precuneus, and medial prefrontal cortex possibly reflecting simulation and storing for future use alternative action sequences that could have led to successful behaviors. During both self- and other-committed errors activation was seen in the striatum, temporoparietal junction, and inferior frontal gyrus. These areas may be components of a generic error processing mechanism. The ecological validity of the stimuli seemed to matter, since we largely failed to see activations when subjects observed errors by another player in the computer game, as opposed to observing errors in the rich real-life like human behaviors depicted in the movie clips.

Spatial and non-spatial information of sound events is presumably processed in parallel auditory cortex (AC) "what" and "where" streams, which are modulated by inputs from the respective visual-cortex subsystems. How these parallel processes are integrated to perceptual objects that remain stable across time and the source agent's movements is unknown. We recorded magneto- and electroencephalography (MEG/EEG) data while subjects viewed animated video clips featuring two audiovisual objects, a black cat and a gray cat. Adaptor-probe events were either linked to the same object (the black cat meowed twice in a row in the same location) or included a visually conveyed identity change (the black and then the gray cat meowed with identical voices in the same location). In addition to effects in visual (including fusiform, middle temporal or MT areas) and frontoparietal association areas, the visually conveyed object-identity change was associated with a release from adaptation of early (50-150ms) activity in posterior ACs, spreading to left anterior ACs at 250-450ms in our combined MEG/EEG source estimates. Repetition of events belonging to the same object resulted in increased theta-band (4-8Hz) synchronization within the "what" and "where" pathways (e.g., between anterior AC and fusiform areas). In contrast, the visually conveyed identity changes resulted in distributed synchronization at higher frequencies (alpha and beta bands, 8-32Hz) across different auditory, visual, and association areas. The results suggest that sound events become initially linked to perceptual objects in posterior AC, followed by modulations of representations in anterior AC. Hierarchical what and where pathways seem to operate in parallel after repeating audiovisual associations, whereas the resetting of such associations engages a distributed network across auditory, visual, and multisensory areas., (Copyright © 2015 Elsevier Inc. All rights reserved.)

Naturalistic stimuli such as movies are increasingly used to engage cognitive and emotional processes during fMRI of brain hemodynamic activity. However, movies have been little utilized during magnetoencephalography (MEG) and EEG that directly measure population-level neuronal activity at a millisecond resolution. Here, subjects watched a 17-min segment from the movie Crash (Lionsgate Films, 2004) twice during simultaneous MEG/EEG recordings. Physiological noise components, including ocular and cardiac artifacts, were removed using the DRIFTER algorithm. Dynamic estimates of cortical activity were calculated using MRI-informed minimum-norm estimation. To improve the signal-to-noise ratio (SNR), principal component analyses (PCA) were employed to extract the prevailing temporal characteristics within each anatomical parcel of the Freesurfer Desikan-Killiany cortical atlas. A variety of alternative inter-subject correlation (ISC) approaches were then utilized to investigate the reliability of inter-subject synchronization during natural viewing. In the first analysis, the ISCs of the time series of each anatomical region over the full time period across all subject pairs were calculated and averaged. In the second analysis, dynamic ISC (dISC) analysis, the correlation was calculated over a sliding window of 200 ms with 3.3 ms steps. Finally, in a between-run ISC analysis, the between-run correlation was calculated over the dynamic ISCs of the two different runs after the Fisher z-transformation. Overall, the most reliable activations occurred in occipital/inferior temporal visual and superior temporal auditory cortices as well as in the posterior cingulate, precuneus, pre- and post-central gyri, and right inferior and middle frontal gyri. Significant between-run ISCs were observed in superior temporal auditory cortices and inferior temporal visual cortices. Taken together, our results show that movies can be utilized as naturalistic stimuli in MEG/EEG similarly as in fMRI studies., (Copyright © 2015 Elsevier Inc. All rights reserved.)

Identifying inter-area communication in terms of the hierarchical organization of functional brain areas is of considerable interest in human neuroimaging. Previous studies have suggested that the direction of magneto- and electroencephalography (MEG, EEG) source currents depend on the layer-specific input patterns into a cortical area. We examined the direction in MEG source currents in a visual object recognition experiment in which there were specific expectations of activation in the fusiform region being driven by either feedforward or feedback inputs. The source for the early non-specific visual evoked response, presumably corresponding to feedforward driven activity, pointed outward, i.e., away from the white matter. In contrast, the source for the later, object-recognition related signals, expected to be driven by feedback inputs, pointed inward, toward the white matter. Associating specific features of the MEG/EEG source waveforms to feedforward and feedback inputs could provide unique information about the activation patterns within hierarchically organized cortical areas., (Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.)

When multiple persons speak simultaneously, it may be difficult for the listener to direct attention to correct sound objects among conflicting ones. This could occur, for example, in an emergency situation in which one hears conflicting instructions and the loudest, instead of the wisest, voice prevails. Here, we used cortically-constrained oscillatory MEG/EEG estimates to examine how different brain regions, including caudal anterior cingulate (cACC) and dorsolateral prefrontal cortices (DLPFC), work together to resolve these kinds of auditory conflicts. During an auditory flanker interference task, subjects were presented with sound patterns consisting of three different voices, from three different directions (45° left, straight ahead, 45° right), sounding out either the letters "A" or "O". They were asked to discriminate which sound was presented centrally and ignore the flanking distracters that were phonetically either congruent (50%) or incongruent (50%) with the target. Our cortical MEG/EEG oscillatory estimates demonstrated a direct relationship between performance and brain activity, showing that efficient conflict resolution, as measured with reduced conflict-induced RT lags, is predicted by theta/alpha phase coupling between cACC and right lateral frontal cortex regions intersecting the right frontal eye fields (FEF) and DLPFC, as well as by increased pre-stimulus gamma (60-110 Hz) power in the left inferior fontal cortex. Notably, cACC connectivity patterns that correlated with behavioral conflict-resolution measures were found during both the pre-stimulus and the pre-response periods. Our data provide evidence that, instead of being only transiently activated upon conflict detection, cACC is involved in sustained engagement of attentional resources required for effective sound object selection performance.

Our ability to refocus auditory attention is vital for even the most routine day-to-day activities. Shifts in auditory attention can be initiated "voluntarily," or triggered "involuntarily" by unexpected novel sound events. Here we employed psychophysiological interaction (PPI) analyses of auditory functional MRI data, to compare functional connectivity patterns of distinct frontoparietal cortex regions during cued voluntary vs. novelty-driven involuntary auditory attention shifting. Overall, our frontoparietal seed regions exhibited significant PPI increases with auditory cortex (AC) areas during both cued and novelty-driven orienting. However, significant positive PPI patterns associated with voluntary auditory attention (cue>novel task regressor), but mostly absent in analyses emphasizing involuntary orienting (novel>cue task regressor), were observed with seeds within the frontal eye fields (FEF), superior parietal lobule (SPL), and right supramarginal gyri (SMG). In contrast, significant positive PPIs associated selectively with involuntary orienting were observed between ACs and seeds within the bilateral anterior interior frontal gyri (IFG), left posterior IFG, SMG, and posterior cingulate cortices (PCC). We also found indices of lateralization of different attention networks: PPI increases selective to voluntary attention occurred primarily within right-hemispheric regions, whereas those related to involuntary orienting were more frequent with left-hemisphere seeds. In conclusion, despite certain similarities in PPI patterns across conditions, the more dorsal aspects of right frontoparietal cortex demonstrated wider connectivity during cued/voluntary attention shifting, whereas certain left ventral frontoparietal seeds were more widely connected during novelty-triggered/involuntary orienting. Our findings provide partial support for distinct attention networks for voluntary and involuntary auditory attention., (Copyright © 2014 Elsevier B.V. All rights reserved.)

Estimation of causal interactions between brain areas is necessary for elucidating large-scale functional brain networks underlying behavior and cognition. Granger causality analysis of time series data can quantitatively estimate directional information flow between brain regions. Here, we show that such estimates are significantly improved when the temporal sampling rate of functional magnetic resonance imaging (fMRI) is increased 20-fold. Specifically, healthy volunteers performed a simple visuomotor task during blood oxygenation level dependent (BOLD) contrast based whole-head inverse imaging (InI). Granger causality analysis based on raw InI BOLD data sampled at 100-ms resolution detected the expected causal relations, whereas when the data were downsampled to the temporal resolution of 2 s typically used in echo-planar fMRI, the causality could not be detected. An additional control analysis, in which we SINC interpolated additional data points to the downsampled time series at 0.1-s intervals, confirmed that the improvements achieved with the real InI data were not explainable by the increased time-series length alone. We therefore conclude that the high-temporal resolution of InI improves the Granger causality connectivity analysis of the human brain.

Using simultaneous acquisition from multiple channels of a radio-frequency (RF) coil array, magnetic resonance inverse imaging (InI) achieves functional MRI acquisitions at a rate of 100ms per whole-brain volume. InI accelerates the scan by leaving out partition encoding steps and reconstructs images by solving under-determined inverse problems using RF coil sensitivity information. Hence, the correlated spatial information available in the coil array causes spatial blurring in the InI reconstruction. Here, we propose a method that employs gradient blips in the partition encoding direction during the acquisition to provide extra spatial encoding in order to better differentiate signals from different partitions. According to our simulations, this blipped-InI (bInI) method can increase the average spatial resolution by 15.1% (1.3mm) across the whole brain and from 32.6% (4.2mm) in subcortical regions, as compared to the InI method. In a visual fMRI experiment, we demonstrate that, compared to InI, the spatial distribution of bInI BOLD response is more consistent with that of a conventional echo-planar imaging (EPI) at the level of individual subjects. With the improved spatial resolution, especially in subcortical regions, bInI can be a useful fMRI tool for obtaining high spatiotemporal information for clinical and cognitive neuroscience studies., (Copyright © 2013 Elsevier Inc. All rights reserved.)

Based on the infamous left-lateralized neglect syndrome, one might hypothesize that the dominating right parietal cortex has a bilateral representation of space, whereas the left parietal cortex represents only the contralateral right hemispace. Whether this principle applies to human auditory attention is not yet fully clear. Here, we explicitly tested the differences in cross-hemispheric functional coupling between the intraparietal sulcus (IPS) and auditory cortex (AC) using combined magnetoencephalography (MEG), EEG, and functional MRI (fMRI). Inter-regional pairwise phase consistency (PPC) was analyzed from data obtained during dichotic auditory selective attention task, where subjects were in 10-s trials cued to attend to sounds presented to one ear and to ignore sounds presented in the opposite ear. Using MEG/EEG/fMRI source modeling, parietotemporal PPC patterns were (a) mapped between all AC locations vs. IPS seeds and (b) analyzed between four anatomically defined AC regions-of-interest (ROI) vs. IPS seeds. Consistent with our hypothesis, stronger cross-hemispheric PPC was observed between the right IPS and left AC for attended right-ear sounds, as compared to PPC between the left IPS and right AC for attended left-ear sounds. In the mapping analyses, these differences emerged at 7-13Hz, i.e., at the theta to alpha frequency bands, and peaked in Heschl's gyrus and lateral posterior non-primary ACs. The ROI analysis revealed similarly lateralized differences also in the beta and lower theta bands. Taken together, our results support the view that the right parietal cortex dominates auditory spatial attention., (© 2013 Elsevier Inc. All rights reserved.)

Localization of sound sources is a considerable computational challenge for the human brain. Whereas the visual system can process basic spatial information in parallel, the auditory system lacks a straightforward correspondence between external spatial locations and sensory receptive fields. Consequently, the question how different acoustic features supporting spatial hearing are represented in the central nervous system is still open. Functional neuroimaging studies in humans have provided evidence for a posterior auditory "where" pathway that encompasses non-primary auditory cortex areas, including the planum temporale (PT) and posterior superior temporal gyrus (STG), which are strongly activated by horizontal sound direction changes, distance changes, and movement. However, these areas are also activated by a wide variety of other stimulus features, posing a challenge for the interpretation that the underlying areas are purely spatial. This review discusses behavioral and neuroimaging studies on sound localization, and some of the competing models of representation of auditory space in humans. This article is part of a Special Issue entitled Human Auditory Neuroimaging., (Copyright © 2013 Elsevier B.V. All rights reserved.)

The ability to concentrate on relevant sounds in the acoustic environment is crucial for everyday function and communication. Converging lines of evidence suggests that transient functional changes in auditory-cortex neurons, "short-term plasticity", might explain this fundamental function. Under conditions of strongly focused attention, enhanced processing of attended sounds can take place at very early latencies (~50 ms from sound onset) in primary auditory cortex and possibly even at earlier latencies in subcortical structures. More robust selective-attention short-term plasticity is manifested as modulation of responses peaking at ~100 ms from sound onset in functionally specialized nonprimary auditory-cortical areas by way of stimulus-specific reshaping of neuronal receptive fields that supports filtering of selectively attended sound features from task-irrelevant ones. Such effects have been shown to take effect in ~seconds following shifting of attentional focus. There are findings suggesting that the reshaping of neuronal receptive fields is even stronger at longer auditory-cortex response latencies (~300 ms from sound onset). These longer-latency short-term plasticity effects seem to build up more gradually, within tens of seconds after shifting the focus of attention. Importantly, some of the auditory-cortical short-term plasticity effects observed during selective attention predict enhancements in behaviorally measured sound discrimination performance.