Search

Deformable image registration is a fundamental procedure in medical imaging. Recently, deep learning-based deformable image registrations have achieved fast registration by learning the spatial correspondence from image pairs. However, it remains challenging in brain image registration due to the structural complexity of individual brains and the lack of ground truth for anatomical correspondences between the brain image pairs. This work devotes to achieving an end-to-end unsupervised brain deformable image registration method using the gyral-net map and 3D Res-Unet (BIRGU Net). Firstly, the gyral-net map was introduced to represent the 3D global cortex complex information of the brain image since it was considered as one of the anatomical landmarks, which can help to extract the salient structural feature of individual brains for registration. Secondly, the variant of 3D U-net architecture involving dual residual strategies was designed to map the image into the deformation field effectively and to prevent the gradient from vanishing as well. Finally, double regularized terms were imposed on the deformation field to guide the network training for leveraging the smoothness and the topology preservation of the deformation field. The registration procedure was trained in an unsupervised manner, which addressed the lack of ground truth for anatomical correspondences between the brain image pairs. The experimental results on four public data sets demonstrate that the extracted gyral-net can be an auxiliary feature for registration and the proposed network with the designed strategies can improve the registration performance since the Dice similarity coefficient (DSC) and normalized mutual information (NMI) are higher and the time consumption is comparable than the state-of-the-art. The code is available at https://github.com/mynameiswode/BIRGU-Net. [ABSTRACT FROM AUTHOR]

Motivation: Brain imaging genetics, which studies the linkage between genetic variations and structural or functional measures of the human brain, has become increasingly important in recent years. Discovering the bi-multivariate relationship between genetic markers such as single-nucleotide polymorphisms (SNPs) and neuroimaging quantitative traits (QTs) is one major task in imaging genetics. Sparse Canonical Correlation Analysis (SCCA) has been a popular technique in this area for its powerful capability in identifying bi-multivariate relationships coupled with feature selection. The existing SCCA methods impose either the ℓ1-norm or its variants to induce sparsity. The ℓ0-norm penalty is a perfect sparsity-inducing tool which, however, is an NP-hard problem. Results: In this paper, we propose the truncated ℓ1-norm penalized SCCA to improve the performance and effectiveness of the ℓ1-norm based SCCA methods. Besides, we propose an efficient optimization algorithms to solve this novel SCCA problem. The proposed method is an adaptive shrinkage method via tuning 𝝉. It can avoid the time intensive parameter tuning if given a reasonable small 𝝉. Furthermore, we extend it to the truncated group-lasso (TGL), and propose TGL-SCCA model to improve the group-lasso-based SCCA methods. The experimental results, compared with four benchmark methods, show that our SCCA methods identify better or similar correlation coefficients, and better canonical loading profiles than the competing methods. This demonstrates the effectiveness and efficiency of our methods in discovering interesting imaging genetic associations. [ABSTRACT FROM AUTHOR]

Establishment of structural and functional correspondences of human brain that can be quantitatively encoded and reproduced across different subjects and populations is one of the key issues in brain mapping. As an attempt to address this challenge, our recently developed Dense Individualized and Common Connectivity-based Cortical Landmarks (DICCCOL) system reported 358 connectional landmarks, each of which possesses consistent DTI-derived white matter fiber connection pattern that is reproducible in over 240 healthy brains. However, the DICCCOL system can be substantially improved by integrating anatomical and morphological information during landmark initialization and optimization procedures. In this paper, we present a novel anatomy-guided landmark discovery framework that defines and optimizes landmarks via integrating rich anatomical, morphological, and fiber connectional information for landmark initialization, group-wise optimization and prediction, which are formulated and solved as an energy minimization problem. The framework finally determined 555 consistent connectional landmarks. Validation studies demonstrated that the 555 landmarks are reproducible, predictable, and exhibited reasonably accurate anatomical, connectional, and functional correspondences across individuals and populations and thus are named anatomy-guided DICCCOL or A-DICCCOL. This A-DICCCOL system represents common cortical architectures with anatomical, connectional, and functional correspondences across different subjects and would potentially provide opportunities for various applications in brain science. [ABSTRACT FROM AUTHOR]

For decades, it has been largely unknown to what extent multiple functional networks spatially overlap/interact with each other and jointly realize the total cortical function. Here, by developing novel sparse representation of whole-brain fMRI signals and by using the recently publicly released large-scale Human Connectome Project high-quality fMRI data, we show that a number of reproducible and robust functional networks, including both task-evoked and resting state networks, are simultaneously distributed in distant neuroanatomic areas and substantially spatially overlapping with each other, thus forming an initial collection of holistic atlases of functional networks and interactions (HAFNIs). More interestingly, the HAFNIs revealed two distinct patterns of highly overlapped regions and highly specialized regions and exhibited that these two patterns of areas are reciprocally localized, revealing a novel organizational principle of cortical function. [ABSTRACT FROM AUTHOR]

The relationship between brain structure and function has been one of the centers of research in neuroimaging for decades. In recent years, diffusion tensor imaging (DTI) and functional magnetic resonance imaging (fMRI) techniques have been widely available and popular in cognitive and clinical neurosciences for examining the brain's white matter (WM) micro-structures and gray matter (GM) functions, respectively. Given the intrinsic integration of WM/GM and the complementary information embedded in DTI/fMRI data, it is natural and well-justified to combine these two neuroimaging modalities together to investigate brain structure and function and their relationships simultaneously. In the past decade, there have been remarkable achievements of DTI/fMRI fusion methods and applications in neuroimaging and human brain mapping community. This survey paper aims to review recent advancements on methodologies and applications in incorporating multimodal DTI and fMRI data, and offer our perspectives on future research directions. We envision that effective fusion of DTI/fMRI techniques will play increasingly important roles in neuroimaging and brain sciences in the years to come. [ABSTRACT FROM AUTHOR]

Diffusion tensor imaging (DTI) and high angular resolution diffusion imaging (HARDI) have been broadly used in the neuroimaging field to investigate the macro-scale fiber connection patterns in the cerebral cortex. Our recent analyses of DTI and HARDI data demonstrated that gyri are connected by denser, streamlined fibers than sulci are. Inspired by this finding and motivated by the fact that DTI-derived fibers provide the structural substrates for functional connectivity, we hypothesize that gyri are global functional connection centers and sulci are local functional units. To test this functional model of gyri and sulci, we examined the structural and functional connectivity among the landmarks on the selected gyral/sulcal areas in the frontal/parietal lobe and in the whole cerebral cortex via multimodal DTI and resting state fMRI (R-fMRI) datasets. Our results demonstrate that functional connectivity is strong among gyri, weak among sulci, and moderate between gyri and sulci. These results suggest that gyri are functional connection centers that exchange information among remote structurally connected gyri and neighboring sulci, while sulci communicate directly with their neighboring gyri and indirectly with other cortical regions through gyri. This functional model of gyri and sulci has been supported by a series of experiments, and provides novel perspectives on the functional architecture of the cerebral cortex. [ABSTRACT FROM AUTHOR]

Quantitative modeling and analysis of structural and functional brain networks based on diffusion tensor imaging (DTI) and functional magnetic resonance imaging (fMRI) data have received extensive interest recently. However, the regularity of these structural and functional brain networks across multiple neuroimaging modalities and also across different individuals is largely unknown. This paper presents a novel approach to inferring group-wise consistent brain subnetworks from multimodal DTI/resting-state fMRI datasets via multi-view spectral clustering of cortical networks, which were constructed upon our recently developed and validated large-scale cortical landmarks—DICCCOL (dense individualized and common connectivity-based cortical landmarks). We applied the algorithms on DTI data of 100 healthy young females and 50 healthy young males, obtained consistent multimodal brain networks within and across multiple groups, and further examined the functional roles of these networks. Our experimental results demonstrated that the derived brain networks have substantially improved inter-modality and inter-subject consistency. [ABSTRACT FROM PUBLISHER]

The highly convoluted cerebral cortex is characterized by two different topographic structures: convex gyri and concave sulci. Increasing studies have demonstrated that cortical gyri and sulci exhibit different structural connectivity patterns. Inspired by the intrinsic structural differences between gyri and sulci, in this paper, we present a data-driven framework based on sparse representation of fMRI data for functional network inferences, then examine the interactions within and across gyral and sulcal functional networks and finally elucidate possible functional differences using graph theory based properties. We apply the proposed framework to the high-resolution Human Connectome Project (HCP) grayordinate fMRI data. Extensive experimental results on both resting state fMRI data and task-based fMRI data consistently suggested that gyri are more functionally integrated, while sulci are more functionally segregated in the organizational architecture of cerebral cortex, offering novel understanding of the byzantine cerebral cortex. [ABSTRACT FROM AUTHOR]

• Holistic functional brain networks are modeled via the multi-head mechanism. • Both spatial and temporal patterns are modeled via the guided attention mechanism. • It has superior modeling ability and generalizability on different fMRI datasets. • The modeled brain networks can better predict individual cognitive measures. Mounting evidence has demonstrated that complex brain function processes are realized by the interaction of holistic functional brain networks which are spatially distributed across specific brain regions in a temporally dynamic fashion. Therefore, modeling spatio-temporal patterns of holistic functional brain networks plays an important role in understanding brain function. Compared to traditional modeling methods such as principal component analysis, independent component analysis, and sparse coding, superior performance has been achieved by recent deep learning methodologies. However, there are still two limitations of existing deep learning approaches for functional brain network modeling. They either (1) merely modeled a single targeted network and ignored holistic ones at one time, or (2) underutilized both spatial and temporal features of fMRI during network modeling, and the spatial/temporal accuracy was thus not warranted. To address these limitations, we proposed a novel Multi-Head Guided Attention Graph Neural Network (Multi-Head GAGNN) to simultaneously model both spatial and temporal patterns of holistic functional brain networks. Specifically, a spatial Multi-Head Attention Graph U-Net was first adopted to model the spatial patterns of multiple brain networks, and a temporal Multi-Head Guided Attention Network was then introduced to model the corresponding temporal patterns under the guidance of modeled spatial patterns. Based on seven task fMRI datasets from the public Human Connectome Project and resting state fMRI datasets from the public Autism Brain Imaging Data Exchange I of 1448 subjects, the proposed Multi-Head GAGNN showed superior ability and generalizability in modeling both spatial and temporal patterns of holistic functional brain networks in individual brains compared to other state-of-the-art (SOTA) models. Furthermore, the modeled spatio-temporal patterns of functional brain networks via the proposed Multi-Head GAGNN can better predict the individual cognitive behavioral measures compared to the other SOTA models. This study provided a novel and powerful tool for brain function modeling as well as for understanding the brain-cognitive behavior associations. [Display omitted] [ABSTRACT FROM AUTHOR]

Tractography based on diffusion tensor imaging (DTI) data has been used as a tool by a large number of recent studies to investigate structural connectome. Despite its great success in offering unique 3D neuroanatomy information, DTI is an indirect observation with limited resolution and accuracy and its reliability is still unclear. Thus, it is essential to answer this fundamental question: how reliable is DTI tractography in constructing large-scale connectome? To answer this question, we employed neuron tracing data of 1772 experiments on the mouse brain released by the Allen Mouse Brain Connectivity Atlas (AMCA) as the ground-truth to assess the performance of DTI tractography in inferring white matter fiber pathways and inter-regional connections. For the first time in the neuroimaging field, the performance of whole brain DTI tractography in constructing a large-scale connectome has been evaluated by comparison with tracing data. Our results suggested that only with the optimized tractography parameters and the appropriate scale of brain parcellation scheme, can DTI produce relatively reliable fiber pathways and a large-scale connectome. Meanwhile, a considerable amount of errors were also identified in optimized DTI tractography results, which we believe could be potentially alleviated by efforts in developing better DTI tractography approaches. In this scenario, our framework could serve as a reliable and quantitative test bed to identify errors in tractography results which will facilitate the development of such novel tractography algorithms and the selection of optimal parameters. [ABSTRACT FROM AUTHOR]

There have been several recent studies that used sparse representation for fMRI signal analysis and activation detection based on the assumption that each voxel’s fMRI signal is linearly composed of sparse components. Previous studies have employed sparse coding to model functional networks in various modalities and scales. These prior contributions inspired the exploration of whether/how sparse representation can be used to identify functional networks in a voxel-wise way and on the whole brain scale. This paper presents a novel, alternative methodology of identifying multiple functional networks via sparse representation of whole-brain task-based fMRI signals. Our basic idea is that all fMRI signals within the whole brain of one subject are aggregated into a big data matrix, which is then factorized into an over-complete dictionary basis matrix and a reference weight matrix via an effective online dictionary learning algorithm. Our extensive experimental results have shown that this novel methodology can uncover multiple functional networks that can be well characterized and interpreted in spatial, temporal and frequency domains based on current brain science knowledge. Importantly, these well-characterized functional network components are quite reproducible in different brains. In general, our methods offer a novel, effective and unified solution to multiple fMRI data analysis tasks including activation detection, de-activation detection, and functional network identification. [ABSTRACT FROM AUTHOR]

Highlights: [•] Representation of structural connectomes by DICCCOL based on DTI data. [•] Construction of whole-brain quasi-stable functional connectomes from fMRI data. [•] Learn atomic connectome patterns (ACPs) via effective sparse representations. [•] Characterization of task-performance and task-free states by ACPs. [•] Novel insights into the functional architectures of the brain. [Copyright &y& Elsevier]

Abstract: Identification of regions of interest (ROIs) is a fundamental issue in brain network construction and analysis. Recent studies demonstrate that multimodal neuroimaging approaches and joint analysis strategies are crucial for accurate, reliable and individualized identification of brain ROIs. In this paper, we present a novel approach of visual analytics and its open-source software for ROI definition and brain network construction. By combining neuroscience knowledge and computational intelligence capabilities, visual analytics can generate accurate, reliable and individualized ROIs for brain networks via joint modeling of multimodal neuroimaging data and an intuitive and real-time visual analytics interface. Furthermore, it can be used as a functional ROI optimization and prediction solution when fMRI data is unavailable or inadequate. We have applied this approach to an operation span working memory fMRI/DTI dataset, a schizophrenia DTI/resting state fMRI (R-fMRI) dataset, and a mild cognitive impairment DTI/R-fMRI dataset, in order to demonstrate the effectiveness of visual analytics. Our experimental results are encouraging. [Copyright &y& Elsevier]