Search

Going beyond correlations, the understanding and identification of causal relationships in observational time series, an important subfield of Causal Discovery, poses a major challenge. The lack of access to a well-defined ground truth for real-world data creates the need to rely on synthetic data for the evaluation of these methods. Existing benchmarks are limited in their scope, as they either are restricted to a "static" selection of data sets, or do not allow for a granular assessment of the methods' performance when commonly made assumptions are violated. We propose a flexible and simple to use framework for generating time series data, which is aimed at developing, evaluating, and benchmarking time series causal discovery methods. In particular, the framework can be used to fine tune novel methods on vast amounts of data, without "overfitting" them to a benchmark, but rather so they perform well in real-world use cases. Using our framework, we evaluate prominent time series causal discovery methods and demonstrate a notable degradation in performance when their assumptions are invalidated and their sensitivity to choice of hyperparameters. Finally, we propose future research directions and how our framework can support both researchers and practitioners., Comment: 17 pages, 9 figures, for associated code and data sets, see https://github.com/causalens/cdml-neurips2020

Causal Discovery methods aim to identify a DAG structure that represents causal relationships from observational data. In this article, we stress that it is important to test such methods for robustness in practical settings. As our main example, we analyze the NOTEARS method, for which we demonstrate a lack of scale-invariance. We show that NOTEARS is a method that aims to identify a parsimonious DAG from the data that explains the residual variance. We conclude that NOTEARS is not suitable for identifying truly causal relationships from the data., Comment: 6 pages, 4 figures

Motivation: Agent-based modeling is an indispensable tool for studying complex biological systems. However, existing simulators do not always take full advantage of modern hardware and often have a field-specific software design. Results: We present a novel simulation platform called BioDynaMo that alleviates both of these problems. BioDynaMo features a general-purpose and high-performance simulation engine. We demonstrate that BioDynaMo can be used to simulate use cases in: neuroscience, oncology, and epidemiology. For each use case we validate our findings with experimental data or an analytical solution. Our performance results show that BioDynaMo performs up to three orders of magnitude faster than the state-of-the-art baseline. This improvement makes it feasible to simulate each use case with one billion agents on a single server, showcasing the potential BioDynaMo has for computational biology research. Availability: BioDynaMo is an open-source project under the Apache 2.0 license and is available at www.biodynamo.org. Instructions to reproduce the results are available in supplementary information. Contact: lukas.breitwieser@inf.ethz.ch, a.s.hesam@tudelft.nl, omutlu@ethz.ch, r.bauer@surrey.ac.uk Supplementary information: Available at https://doi.org/10.5281/zenodo.4501515, Comment: 8 pages, 6 figures

In some cases, the function of a lesioned area can be compensated for by another area. However, it remains unpredictable if and by which other area a lesion can be compensated. We assume that similar incoming and outgoing connections are necessary to encode the same function as the damaged region. The similarity can be measured both locally using the matching index and looking at a more global scale by non-metric multidimensional scaling (NMDS). We tested how well both measures can predict the compensating area for the loss of the visual cortex in kittens. For this case study, the global comparison of connectivity turns out to be a better method for predicting functional compensation. In future studies, the extent of the similarity between the lesioned and compensating regions might be a measure of the extent to which function can be successfully recovered., Comment: Technical Report

We consider dynamic equilibria for flows over time under the fluid queuing model. In this model, queues on the links of a network take care of flow propagation. Flow enters the network at a single source and leaves at a single sink. In a dynamic equilibrium, every infinitesimally small flow particle reaches the sink as early as possible given the pattern of the rest of the flow. While this model has been examined for many decades, progress has been relatively recent. In particular, the derivatives of dynamic equilibria have been characterized as thin flows with resetting, which allowed for more structural results. Our two main results are based on the formulation of thin flows with resetting as linear complementarity problem and its analysis. We present a constructive proof of existence for dynamic equilibria if the inflow rate is right-monotone. The complexity of computing thin flows with resetting, which occurs as a subproblem in this method, is still open. We settle it for the class of two-terminal series-parallel networks by giving a recursive algorithm that solves the problem for all flow values simultaneously in polynomial time.

Neurostimulation using weak electric fields has generated excitement in recent years due to its potential as a medical intervention. However, study of this stimulation modality has been hampered by inconsistent results and large variability within and between studies. In order to begin addressing this variability we need to properly characterise the impact of the current on the underlying neuron populations. To develop and test a computational model capable of capturing the impact of electric field stimulation on networks of neurons. We construct a cortical tissue model with distinct layers and explicit neuron morphologies. We then apply a model of electrical stimulation and carry out multiple test case simulations. The cortical slice model is compared to experimental literature and shown to capture the main features of the electrophysiological response to stimulation. Namely, the model showed 1) a similar level of depolarisation in individual pyramidal neurons, 2) acceleration of intrinsic oscillations, and 3) retention of the spatial profile of oscillations in different layers. We then apply alternative electric fields to demonstrate how the model can capture differences in neuronal responses to the electric field. We demonstrate that the tissue response is dependent on layer depth, the angle of the apical dendrite relative to the field, and stimulation strength. We present publicly available computational modelling software that predicts the neuron network population response to electric field stimulation.

Structural covariance analysis is a widely used structural MRI analysis method which characterises the co-relations of morphology between brain regions over a group of subjects. To our knowledge, little has been investigated in terms of the comparability of results between different data sets or the reliability of results over the same subjects in different rescan sessions, image resolutions, or FreeSurfer versions. In terms of comparability, our results show substantial differences in the structural covariance matrix between data sets of age- and sex-matched healthy human adults. These differences persist after site correction, they are exacerbated by low sample sizes, and they are most pronounced when using average cortical thickness as a morphological measure. Down-stream graph theoretic analyses further show statistically significant differences. In terms of reliability, substantial differences were also found when comparing repeated scan sessions of the same subjects, and image resolutions and FreeSurfer versions of the same image. We could further estimate the relative measurement error and showed that it is largest when using thickness. With simulated data, we argue that cortical thickness is least reliable because of larger relative measurement errors. Practically, we make the following recommendations (1) pooling subjects across sites into one group should be avoided, particularly if sites differ in image resolutions, demographics, or preprocessing; (2) surface area and volume should be preferred as morphological measures over cortical thickness; (3) a large number of subjects should be used to estimate structural covariance; (4) measurement error should be assessed where repeated measurements are available; (5) if combining sites is critical, univariate site-correction is insufficient, but error covariance should be explicitly measured and modelled.

Population-based evolutionary algorithms have great potential to handle multiobjective optimisation problems. However, these algorithms depends largely on problem characteristics, and there is a need to improve their performance for a wider range of problems. References, which are often specified by the decision maker's preference in different forms, are a very effective method to improve the performance of algorithms but have not been fully explored in literature. This paper proposes a novel framework for effective use of references to strengthen algorithms. This framework considers references as search targets which can be adjusted based on the information collected during the search. The proposed framework is combined with new strategies, such as reference adaptation and adaptive local mating, to solve different types of problems. The proposed algorithm is compared with state of the arts on a wide range of problems with diverse characteristics. The comparison and extensive sensitivity analysis demonstrate that the proposed algorithm is competitive and robust across different types of problems studied in this paper.

Budget Minimization is a scheduling problem with precedence constraints, i.e., a scheduling problem on a partially ordered set of jobs $(N, \unlhd)$. A job $j \in N$ is available for scheduling, if all jobs $i \in N$ with $i \unlhd j$ are completed. Further, each job $j \in N$ is assigned real valued costs $c_{j}$, which can be negative or positive. A schedule is an ordering $j_{1}, \dots, j_{\vert N \vert}$ of all jobs in $N$. The budget of a schedule is the external investment needed to complete all jobs, i.e., it is $\max_{l \in \{0, \dots, \vert N \vert \} } \sum_{1 \le k \le l} c_{j_{k}}$. The goal is to find a schedule with minimum budget. Rafiey et al. (2015) showed that Budget Minimization is NP-hard following from a reduction from a molecular folding problem. We extend this result and prove that it is NP-hard to $\alpha(N)$-approximate the minimum budget even on bipartite partial orders. We present structural insights that lead to arguably simpler algorithms and extensions of the results by Rafiey et al. (2015). In particular, we show that there always exists an optimal solution that partitions the set of jobs and schedules each subset independently of the other jobs. We use this structural insight to derive polynomial-time algorithms that solve the problem to optimality on series-parallel and convex bipartite partial orders.

Dynamic multiobjective optimisation has gained increasing attention in recent years. Test problems are of great importance in order to facilitate the development of advanced algorithms that can handle dynamic environments well. However, many of existing dynamic multiobjective test problems have not been rigorously constructed and analysed, which may induce some unexpected bias when they are used for algorithmic analysis. In this paper, some of these biases are identified after a review of widely used test problems. These include poor scalability of objectives and, more importantly, problematic overemphasis of static properties rather than dynamics making it difficult to draw accurate conclusion about the strengths and weaknesses of the algorithms studied. A diverse set of dynamics and features is then highlighted that a good test suite should have. We further develop a scalable continuous test suite, which includes a number of dynamics or features that have been rarely considered in literature but frequently occur in real life. It is demonstrated with empirical studies that the proposed test suite is more challenging to the dynamic multiobjective optimisation algorithms found in the literature. The test suite can also test algorithms in ways that existing test suites can not., Comment: 19 pages, 22 figures and 7 tables

The $k$ disjoint shortest paths problem ($k$-DSPP) on a graph with $k$ source-sink pairs $(s_i, t_i)$ asks for the existence of $k$ pairwise edge- or vertex-disjoint shortest $s_i$-$t_i$-paths. It is known to be NP-complete if $k$ is part of the input. Restricting to $2$-DSPP with strictly positive lengths, it becomes solvable in polynomial time. We extend this result by allowing zero edge lengths and give a polynomial time algorithm based on dynamic programming for $2$-DSPP on undirected graphs with non-negative edge lengths., Comment: 6 pages, 4 figures

Patients with idiopathic generalised epilepsy (IGE) typically have normal conventional magnetic resonance imaging (MRI), hence MRI based diagnosis is challenging. Anatomical abnormalities underlying brain dysfunctions in IGE are unclear and their relation to the pathomechanisms of epileptogenesis is poorly understood. In this study, we applied connectometry, an advanced quantitative neuroimaging technique for investigating localised changes in white-matter tissue. Analysing white matter structures of 32 subjects we incorporated our findings in a computational model of seizure dynamics to suggest a plausible mechanism of epileptogenesis. Patients with IGE have significant bilateral alterations in major white-matter fascicles. In the cingulum, fornix, and superior longitudinal fasciculus, tract integrity is compromised, whereas in specific parts of tracts between thalamus and the precentral gyrus, tract integrity is enhanced in patients. Combining these alterations in a logistic regression model, we computed the decision boundary that discriminated patients and controls. The computational model, informed with the findings on the tract abnormalities, specifically highlighted the importance of enhanced cortico-reticular connections along with impaired cortico-cortical connections in inducing pathological seizure-like dynamics. We emphasise taking directionality of brain connectivity into consideration towards understanding the pathological mechanisms; this is possible by combining neuroimaging and computational modelling. Our imaging evidence of structural alterations suggest the loss of cortico-cortical and enhancement of cortico-thalamic fibre integrity in IGE. We further suggest that impaired connectivity from cortical regions to the thalamic reticular nucleus offers a therapeutic target for selectively modifying the brain circuit for reversing the mechanisms leading to epileptogenesis.

We consider hydrodynamic scaling limits for a class of reversible interacting particle systems, which includes the symmetric simple exclusion process and certain zero-range processes. We study a (non-quadratic) microscopic action functional for these systems. We analyse the behaviour of this functional in the hydrodynamic limit and we establish conditions under which it converges to the (quadratic) action functional of Macroscopic Fluctuation Theory. We discuss the implications of these results for rigorous analysis of hydrodynamic limits.

We describe some general results that constrain the dynamical fluctuations that can occur in non-equilibrium steady states, with a focus on molecular dynamics. That is, we consider Hamiltonian systems, coupled to external heat baths, and driven out of equilibrium by non-conservative forces. We focus on the probabilities of rare events (large deviations). First, we discuss a PT (parity-time) symmetry that appears in ensembles of trajectories where a current is constrained to have a large (non-typical) value. We analyse the heat flow in such ensembles, and compare it with non-equilibrium steady states. Second, we consider pathwise large deviations that are defined by considering many copies of a system. We show how the probability currents in such systems can be decomposed into orthogonal contributions, that are related to convergence to equilibrium and to dissipation. We discuss the implications of these results for modelling non-equilibrium steady states., Comment: final version, 21 pages

We discuss a canonical structure that provides a unifying description of dynamical large deviations for irreversible finite state Markov chains (continuous time), Onsager theory, and Macroscopic Fluctuation Theory. For Markov chains, this theory involves a non-linear relation between probability currents and their conjugate forces. Within this framework, we show how the forces can be split into two components, which are orthogonal to each other, in a generalised sense. This splitting allows a decomposition of the pathwise rate function into three terms, which have physical interpretations in terms of dissipation and convergence to equilibrium. Similar decompositions hold for rate functions at level 2 and level 2.5. These results clarify how bounds on entropy production and fluctuation theorems emerge from the underlying dynamical rules. We discuss how these results for Markov chains are related to similar structures within Macroscopic Fluctuation Theory, which describes hydrodynamic limits of such microscopic models.c Fluctuation Theory, which describes hydrodynamic limits of such microscopic models., Comment: 36 page, 1 figure

We analyse and interpret the effects of breaking detailed balance on the convergence to equilibrium of conservative interacting particle systems and their hydrodynamic scaling limits. For finite systems of interacting particles, we review existing results showing that irreversible processes converge faster to their steady state than reversible ones. We show how this behaviour appears in the hydrodynamic limit of such processes, as described by macroscopic fluctuation theory, and we provide a quantitative expression for the acceleration of convergence in this setting. We give a geometrical interpretation of this acceleration, in terms of currents that are \emph{antisymmetric} under time-reversal and orthogonal to the free energy gradient, which act to drive the system away from states where (reversible) gradient-descent dynamics result in slow convergence to equilibrium., Comment: 27 pages, 8 figures

Focal seizures are episodes of pathological brain activity that appear to arise from a localised area of the brain. The onset patterns of focal seizure activity have been studied intensively, and they have largely been distinguished into two types - low amplitude fast oscillations (LAF), or high amplitude spikes (HAS). Here we explore whether these two patterns arise from fundamentally different mechanisms. Here, we use a previously established computational model of neocortical tissue, and validate it as an adequate model using clinical recordings of focal seizures. We then reproduce the two onset patterns in their most defining properties and investigate the possible mechanisms underlying the different focal seizure onset patterns in the model. We show that the two patterns are associated with different mechanisms at the spatial scale of a single ECoG electrode. The LAF onset is initiated by independent patches of localised activity, which slowly invade the surrounding tissue and coalesce over time. In contrast, the HAS onset is a global, systemic transition to a coexisting seizure state triggered by a local event. We find that such a global transition is enabled by an increase in the excitability of the "healthy" surrounding tissue, which by itself does not generate seizures, but can support seizure activity when incited. In our simulations, the difference in surrounding tissue excitability also offers a simple explanation of the clinically reported difference in surgical outcomes. Finally, we demonstrate in the model how changes in tissue excitability could be elucidated, in principle, using active stimulation. Taken together, our modelling results suggest that the excitability of the tissue surrounding the seizure core may play a determining role in the seizure onset pattern, as well as in the surgical outcome.

Computer simulations have become a very powerful tool for scientific research. In order to facilitate research in computational biology, the BioDynaMo project aims at a general platform for biological computer simulations, which should be executable on hybrid cloud computing systems. This paper describes challenges and lessons learnt during the early stages of the software development process, in the context of implementation issues and the international nature of the collaboration., Comment: 4th Workshop on Sustainable Software for Science: Practice and Experiences (WSSSPE4), 2016

Computer simulations have become a very powerful tool for scientific research. Given the vast complexity that comes with many open scientific questions, a purely analytical or experimental approach is often not viable. For example, biological systems (such as the human brain) comprise an extremely complex organization and heterogeneous interactions across different spatial and temporal scales. In order to facilitate research on such problems, the BioDynaMo project (\url{https://biodynamo.web.cern.ch/}) aims at a general platform for computer simulations for biological research. Since the scientific investigations require extensive computer resources, this platform should be executable on hybrid cloud computing systems, allowing for the efficient use of state-of-the-art computing technology. This paper describes challenges during the early stages of the software development process. In particular, we describe issues regarding the implementation and the highly interdisciplinary as well as international nature of the collaboration. Moreover, we explain the methodologies, the approach, and the lessons learnt by the team during these first stages.

Glioma is the most common form of primary brain tumor. Demographically, the risk of occurrence increases until old age. Here we present a novel computational model to reproduce the probability of glioma incidence across the lifespan. Previous mathematical models explaining glioma incidence are framed in a rather abstract way, and do not directly relate to empirical findings. To decrease this gap between theory and experimental observations, we incorporate recent data on cellular and molecular factors underlying gliomagenesis. Since evidence implicates the adult neural stem cell as the likely cell-of-origin of glioma, we have incorporated empirically-determined estimates of neural stem cell number, cell division rate, mutation rate and oncogenic potential into our model. We demonstrate that our model yields results which match actual demographic data in the human population. In particular, this model accounts for the observed peak incidence of glioma at approximately 80 years of age, without the need to assert differential susceptibility throughout the population. Overall, our model supports the hypothesis that glioma is caused by randomly-occurring oncogenic mutations within the neural stem cell population. Based on this model, we assess the influence of the (experimentally indicated) decrease in the number of neural stem cells and increase of cell division rate during aging. Our model provides multiple testable predictions, and suggests that different temporal sequences of oncogenic mutations can lead to tumorigenesis. Finally, we conclude that four or five oncogenic mutations are sufficient for the formation of glioma.

Early brain connectivity development consists of multiple stages: birth of neurons, their migration and the subsequent growth of axons and dendrites. Each stage occurs within a certain period of time depending on types of neurons and cortical layers. Forming synapses between neurons either by growing axons starting at similar times for all neurons (much-overlapped time windows) or at different time points (less-overlapped) may affect the topological and spatial properties of neuronal networks. Here, we explore the extreme cases of axon formation especially concerning short-distance connectivity during early development, either starting at the same time for all neurons (parallel, i.e. maximally-overlapped time windows) or occurring for each neuron separately one neuron after another (serial, i.e. no overlaps in time windows). For both cases, the number of potential and established synapses remained comparable. Topological and spatial properties, however, differed: neurons that started axon growth early on in serial growth achieved higher out-degrees, higher local efficiency, and longer axon lengths while neurons demonstrated more homogeneous connectivity patterns for parallel growth. Second, connection probability decreased more rapidly with distance between neurons for parallel growth than for serial growth. Third, bidirectional connections were more numerous for parallel growth. Finally, we tested our predictions with C. elegans data. Together, this indicates that time windows for axon growth influence the topological and spatial properties of neuronal networks opening the possibility to a posteriori estimate developmental mechanisms based on network properties of a developed network., Comment: Biol Cybern. 2015 Jan 30. [Epub ahead of print]

The connectome, or the entire connectivity of a neural system represented by network, ranges various scales from synaptic connections between individual neurons to fibre tract connections between brain regions. Although the modularity they commonly show has been extensively studied, it is unclear whether connection specificity of such networks can already be fully explained by the modularity alone. To answer this question, we study two networks, the neuronal network of C. elegans and the fibre tract network of human brains yielded through diffusion spectrum imaging (DSI). We compare them to their respective benchmark networks with varying modularities, which are generated by link swapping to have desired modularity values but otherwise maximally random. We find several network properties that are specific to the neural networks and cannot be fully explained by the modularity alone. First, the clustering coefficient and the characteristic path length of C. elegans and human connectomes are both higher than those of the benchmark networks with similar modularity. High clustering coefficient indicates efficient local information distribution and high characteristic path length suggests reduced global integration. Second, the total wiring length is smaller than for the alternative configurations with similar modularity. This is due to lower dispersion of connections, which means each neuron in C. elegans connectome or each region of interest (ROI) in human connectome reaches fewer ganglia or cortical areas, respectively. Third, both neural networks show lower algorithmic entropy compared to the alternative arrangements. This implies that fewer rules are needed to encode for the organisation of neural systems.

Local field potentials (LFPs) sampled with extracellular electrodes are frequently used as a measure of population neuronal activity. However, relating such measurements to underlying neuronal behaviour and connectivity is non-trivial. To help study this link, we developed the Virtual Electrode Recording Tool for EXtracellular potentials (VERTEX). We first identified a reduced neuron model that retained the spatial and frequency filtering characteristics of extracellular potentials from neocortical neurons. We then developed VERTEX as an easy-to-use Matlab tool for simulating LFPs from large populations (>100 000 neurons). A VERTEX-based simulation successfully reproduced features of the LFPs from an in vitro multi-electrode array recording of macaque neocortical tissue. Our model, with virtual electrodes placed anywhere in 3D, allows direct comparisons with the in vitro recording setup. We envisage that VERTEX will stimulate experimentalists, clinicians, and computational neuroscientists to use models to understand the mechanisms underlying measured brain dynamics in health and disease., Comment: appears in Brain Struct Funct 2014

The understanding of neural activity patterns is fundamentally linked to an understanding of how the brain's network architecture shapes dynamical processes. Established approaches rely mostly on deviations of a given network from certain classes of random graphs. Hypotheses about the supposed role of prominent topological features (for instance, the roles of modularity, network motifs, or hierarchical network organization) are derived from these deviations. An alternative strategy could be to study deviations of network architectures from regular graphs (rings, lattices) and consider the implications of such deviations for self-organized dynamic patterns on the network. Following this strategy, we draw on the theory of spatiotemporal pattern formation and propose a novel perspective for analyzing dynamics on networks, by evaluating how the self-organized dynamics are confined by network architecture to a small set of permissible collective states. In particular, we discuss the role of prominent topological features of brain connectivity, such as hubs, modules and hierarchy, in shaping activity patterns. We illustrate the notion of network-guided pattern formation with numerical simulations and outline how it can facilitate the understanding of neural dynamics.

Predicting brain maturity using noninvasive magnetic resonance images (MRI) can distinguish different age groups and help to assess neurodevelopmental disorders. However, group-wise differences are often less informative for assessing features of individuals. Here, we propose a simple method to predict the age of an individual subject solely based on structural connectivity data from diffusion tensor imaging (DTI). Our simple predictor computed a weighted sum of the strength of all connections of an individual. The weight consists of the fiber strength, given by the number of streamlines following tract tracing, multiplied by the importance of that connection for an observed feature--age in this case. We tested this approach using DTI data from 121 healthy subjects aged 4 to 85 years. After determining importance in a training dataset, our predicted ages in the test dataset showed a strong correlation (rho = 0.77) with real age deviating by, on average, only 10 years., Comment: Dynamic Connectome Lab, Technical Report No. 1

Neural systems show a modular and typically also a hierarchical organisation across different levels and across different species. Topology relates to function, but it is also influences dynamics as earlier studies showed its effect on synchrony, oscillation, and activity propagation. Understanding the link between the hierarchical organisation and processing (e.g. does consciousness structurally correlate with the top level of the hierarchy and where is the 'top' in a network?) remains one of the main challenges of the field. In addition, although neuron nodes are often treated as uniform entities, they can differ in terms of function (e.g. inhibitory vs. excitatory), morphology, or gene expression pattern., Comment: Dynamic Connectome Lab, Technical Report No. 4

Activity in coupled systems is often oscillatory, for example, the firing pattern of neuronal populations. Whereas these oscillations have been studied predominantly in local circuits, here we show how the topology of large-scale networks, leading to large feedback loops, influences oscillations in the resting state. We find that the hierarchical modular organization of neuronal networks supports distinct spectral patterns of neural rhythms similar to those observed experimentally in different species such as rat and human. For individual neurons, multiple peak frequencies with non-integer ratios between subsequent peaks occurred. These ratios occurred both for models with the spatial size of the rat as well as for the human brain. We argue that the potential influence of longer connections, and thus longer delays, are balanced by a reduced number of long-distance connections in larger brain networks. In conclusion, we show that a hierarchical neuronal network provides a scalable backbone for multiple brain rhythms. This structural backbone could complement well-studied regional and cellular mechanisms for the generation or prevention of rhythms., Comment: Dynamic Connectome Lab, Technical Report No. 5

Real cortical tissue curves and folds according to experimental data. However, our current simulations only use unfolded cortical layers. This project extends the cortical slice model in order to be able to specify arbitrary curvatures to the cortical layers and investigate the effect of curvature and folding on neuron density and layer morphology., Comment: Dynamic Connectome Lab, Technical Report No. 3

Neural development represents not only an exciting and complex field of study, with ongoing progress, but it also became the epicentre of neuroscience and developmental biology, as it strives to describe the underlying cellular and molecular mechanisms by which the central nervous system emerges during the various levels of embryonic development phases. The nervous system is a dynamic entity, where the genetic information plays an important role in shaping the intra- and extracellular environments, which in turn offer a reliable foundation for the stem cell precursors to divide and form neurons. Throughout the embryonic development stages, the neurons undergo different processes: migration at an immature level from the initial place in the embryo to a predefined final position, axonal differentiation and guidance of the motile growth cone towards a postsynaptic target, synaptic formation between axons and target, and lastly long-term synaptic changes which underlie learning and memory. In order to gain a better understanding of how the nervous system develops, mathematical and computational models have been created and expanded in order to bridge the gap between system-level dynamics and lower level cellular and molecular processes. This research paper aims to illustrate the potential of theoretical mathematical and computational models for analysing one important stage of neural development - axonal growth and guidance mechanisms in the presence of diffusion cues, through a visual simulation which is optimized via the graphic processing unit and parallel programming techniques., Comment: Dynamic Connectome Lab, Technical Report 2

Human brain maturation is characterized by the prolonged development of structural and functional properties of large-scale networks that extends into adulthood. However, it is not clearly understood which features change and which remain stable over time. Here, we examined structural connectivity based on diffusion tensor imaging (DTI) in 121 participants between 4 and 40 years of age. DTI data were analyzed for small-world parameters, modularity, and the number of fiber tracts at the level of streamlines. First, our findings showed that the number of fiber tracts, small-world topology, and modular organization remained largely stable despite a substantial overall decrease in the number of streamlines with age. Second, this decrease mainly affected fiber tracts that had a large number of streamlines, were short, within modules and within hemispheres; such connections were affected significantly more often than would be expected given their number of occurrences in the network. Third, streamline loss occurred earlier in females than in males. In summary, our findings suggest that core properties of structural brain connectivity, such as the small-world and modular organization, remain stable during brain maturation by focusing streamline loss to specific types of fiber tracts., Comment: Cerebral Cortex Advance Access, December 2013

The human connectome at the level of fiber tracts between brain regions has been shown to differ in patients with brain disorders compared to healthy control groups. Nonetheless, there is a potentially large number of different network organizations for individual patients that could lead to cognitive deficits prohibiting correct diagnosis. Therefore changes that can distinguish groups might not be sufficient to diagnose the disease that an individual patient suffers from and to indicate the best treatment option for that patient. We describe the challenges introduced by the large variability of connectomes within healthy subjects and patients and outline three common strategies to use connectomes as biomarkers of brain diseases. Finally, we propose a fourth option in using models of simulated brain activity (the dynamic connectome) based on structural connectivity rather than the structure (connectome) itself as a biomarker of disease. Dynamic connectomes, in addition to currently used structural, functional, or effective connectivity, could be an important future biomarker for clinical applications., Comment: Perspective Article for special issue on Magnetic Resonance Imaging of Healthy and Diseased Brain Networks

The study of dynamical systems defined on complex networks provides a natural framework with which to investigate myriad features of neural dynamics, and has been widely undertaken. Typically, however, networks employed in theoretical studies bear little relation to the spatial embedding or connectivity of the neural networks that they attempt to replicate. Here, we employ detailed neuroimaging data to define a network whose spatial embedding represents accurately the folded structure of the cortical surface of a rat and investigate the propagation of activity over this network under simple spreading and connectivity rules. By comparison with standard network models with the same coarse statistics, we show that the cortical geometry influences profoundly the speed propagation of activation through the network. Our conclusions are of high relevance to the theoretical modelling of epileptic seizure events, and indicate that such studies which omit physiological network structure risk simplifying the dynamics in a potentially significant way.

Functional magnetic resonance imaging recordings in the resting-state (RS) from the human brain are characterized by spontaneous low-frequency fluctuations in the blood oxygenation level dependent signal that reveal functional connectivity (FC) via their spatial synchronicity. This RS study applied network analysis to compare FC between late-life depression (LLD) patients and control subjects. Raw cross-correlation matrices (CM) for LLD were characterized by higher FC. We analyzed the small-world (SW) and modular organization of these networks consisting of 110 nodes each as well as the connectivity patterns of individual nodes of the basal ganglia. Topological network measures showed no significant differences between groups. The composition of top hubs was similar between LLD and control subjects, however in the LLD group posterior medial-parietal regions were more highly connected compared to controls. In LLD, a number of brain regions showed connections with more distant neighbors leading to an increase of the average Euclidean distance between connected regions compared to controls. In addition, right caudate nucleus connectivity was more diffuse in LLD. In summary, LLD was associated with overall increased FC strength and changes in the average distance between connected nodes, but did not lead to global changes in SW or modular organization.

Disease spreading through human travel networks has been a topic of great interest in recent years, as witnessed during outbreaks of influenza A (H1N1) or SARS pandemics. One way to stop spreading over the airline network are travel restrictions for major airports or network hubs based on the total number of passengers of an airport. Here, we test alternative strategies using edge removal, cancelling targeted flight connections rather than restricting traffic for network hubs, for controlling spreading over the airline network. We employ a SEIR metapopulation model that takes into account the population of cities, simulates infection within cities and across the network of the top 500 airports, and tests different flight cancellation methods for limiting the course of infection. The time required to spread an infection globally, as simulated by a stochastic global spreading model was used to rank the candidate control strategies. The model includes both local spreading dynamics at the level of populations and long-range connectivity obtained from real global airline travel data. Simulated spreading in this network showed that spreading infected 37% less individuals after cancelling a quarter of flight connections between cities, as selected by betweenness centrality. The alternative strategy of closing down whole airports causing the same number of cancelled connections only reduced infections by 18%. In conclusion, selecting highly ranked single connections between cities for cancellation was more effective, resulting in fewer individuals infected with influenza, compared to shutting down whole airports. It is also a more efficient strategy, affecting fewer passengers while producing the same reduction in infections. The network of connections between the top 500 airports is available under the resources link on our website http://www.biological-networks.org., Comment: The network of connections between the top 500 airports is available under the resources link on our website http://www.biological-networks.org. Flight connections for the top 500 airports, based on total passenger volume, worldwide. The existence of flight connections between airports is based on flights within one year from 1 July 2007 to 30 June 2008

The effect of age at injury on outcome after acquired brain injury (ABI) has been the subject of much debate. Many argue that young brains are relatively tolerant of injury. A contrasting viewpoint due to Hebb argues that greater system integrity may be required for the initial establishment of a function than for preservation of an already-established function. A neuro-computational model of cortical map formation was adapted to examine effects of focal and distributed injury at various stages of development. This neural network model requires a period of training during which it self-organizes to establish cortical maps. Injuries were simulated by lesioning the model at various stages of this process and network function was monitored as "development" progressed to completion. Lesion effects are greater for larger, earlier, and distributed (multifocal) lesions. The mature system is relatively robust, particularly to focal injury. Activities in recovering systems injured at an early stage show changes that emerge after an asymptomatic interval. Early injuries cause qualitative changes in system behavior that emerge after a delay during which the effects of the injury are latent. Functions that are incompletely established at the time of injury may be vulnerable particularly to multifocal injury.

Neural networks show a progressive increase in complexity during the time course of evolution. From diffuse nerve nets in Cnidaria to modular, hierarchical systems in macaque and humans, there is a gradual shift from simple processes involving a limited amount of tasks and modalities to complex functional and behavioral processing integrating different kinds of information from highly specialized tissue. However, studies in a range of species suggest that fundamental similarities, in spatial and topological features as well as in developmental mechanisms for network formation, are retained across evolution. 'Small-world' topology and highly connected regions (hubs) are prevalent across the evolutionary scale, ensuring efficient processing and resilience to internal (e.g. lesions) and external (e.g. environment) changes. Furthermore, in most species, even the establishment of hubs, long-range connections linking distant components, and a modular organization, relies on similar mechanisms. In conclusion, evolutionary divergence leads to greater complexity while following essential developmental constraints.

Human brain networks can be characterized at different temporal or spatial scales given by the age of the subject or the spatial resolution of the neuroimaging method. Integration of data across scales can only be successful if the combined networks show a similar architecture. One way to compare networks is to look at spatial features, based on fibre length, and topological features of individual nodes where outlier nodes form single node motifs whose frequency yields a fingerprint of the network. Here, we observe how characteristic single node motifs change over age (12-23 years) and network size (414, 813, and 1615 nodes) for diffusion tensor imaging (DTI) structural connectivity in healthy human subjects. First, we find the number and diversity of motifs in a network to be strongly correlated. Second, comparing different scales, the number and diversity of motifs varied across the temporal (subject age) and spatial (network resolution) scale: certain motifs might only occur at one spatial scale or for a certain age range. Third, regions of interest which show one motif at a lower resolution may show a range of motifs at a higher resolution which may or may not include the original motif at the lower resolution. Therefore, both the type and localisation of motifs differ for different spatial resolutions. Our results also indicate that spatial resolution has a higher effect on topological measures whereas spatial measures, based on fibre lengths, remain more comparable between resolutions. Therefore, spatial resolution is crucial when comparing characteristic node fingerprints given by topological and spatial network features. As node motifs are based on topological and spatial properties of brain connectivity networks, these conclusions are also relevant to other studies using connectome analysis., Comment: 31 pages, 8 figures; Front. Neuroinform. 5:10 (2011)

High-throughput methods for yielding the set of connections in a neural system, the connectome, are now being developed. This tutorial describes ways to analyze the topological and spatial organization of the connectome at the macroscopic level of connectivity between brain regions as well as the microscopic level of connectivity between neurons. We will describe topological features at three different levels: the local scale of individual nodes, the regional scale of sets of nodes, and the global scale of the complete set of nodes in a network. Such features can be used to characterize components of a network and to compare different networks, e.g. the connectome of patients and control subjects for clinical studies. At the global scale, different types of networks can be distinguished and we will describe Erd\"os-R\'enyi random, scale-free, small-world, modular, and hierarchical archetypes of networks. Finally, the connectome also has a spatial organization and we describe methods for analyzing wiring lengths of neural systems. As an introduction for new researchers in the field of connectome analysis, we discuss the benefits and limitations of each analysis approach., Comment: Neuroimage, in press

Complex networks have been characterised by their specific connectivity patterns (network motifs), but their building blocks can also be identified and described by node-motifs---a combination of local network features. One technique to identify single node-motifs has been presented by Costa et al. (L. D. F. Costa, F. A. Rodrigues, C. C. Hilgetag, and M. Kaiser, Europhys. Lett., 87, 1, 2009). Here, we first suggest improvements to the method including how its parameters can be determined automatically. Such automatic routines make high-throughput studies of many networks feasible. Second, the new routines are validated in different network-series. Third, we provide an example of how the method can be used to analyse network time-series. In conclusion, we provide a robust method for systematically discovering and classifying characteristic nodes of a network. In contrast to classical motif analysis, our approach can identify individual components (here: nodes) that are specific to a network. Such special nodes, as hubs before, might be found to play critical roles in real-world networks., Comment: 16 pages (4 figures) plus supporting information 8 pages (5 figures)

The nematode Caenorhabditis elegans, with information on neural connectivity, three-dimensional position and cell linage provides a unique system for understanding the development of neural networks. Although C. elegans has been widely studied in the past, we present the first statistical study from a developmental perspective, with findings that raise interesting suggestions on the establishment of long-distance connections and network hubs. Here, we analyze the neuro-development for temporal and spatial features, using birth times of neurons and their three-dimensional positions. Comparisons of growth in C. elegans with random spatial network growth highlight two findings relevant to neural network development. First, most neurons which are linked by long-distance connections are born around the same time and early on, suggesting the possibility of early contact or interaction between connected neurons during development. Second, early-born neurons are more highly connected (tendency to form hubs) than later born neurons. This indicates that the longer time frame available to them might underlie high connectivity. Both outcomes are not observed for random connection formation. The study finds that around one-third of electrically coupled long-range connections are late forming, raising the question of what mechanisms are involved in ensuring their accuracy, particularly in light of the extremely invariant connectivity observed in C. elegans. In conclusion, the sequence of neural network development highlights the possibility of early contact or interaction in securing long-distance and high-degree connectivity.

Deviations from the average can provide valuable insights about the organization of natural systems. The present article extends this important principle to the systematic identification and analysis of singular motifs in complex networks. Six measurements quantifying different and complementary features of the connectivity around each node of a network were calculated, and multivariate statistical methods applied to identify singular nodes. The potential of the presented concepts and methodology was illustrated with respect to different types of complex real-world networks, namely the US air transportation network, the protein-protein interactions of the yeast Saccharomyces cerevisiae and the Roget thesaurus networks. The obtained singular motifs possessed unique functional roles in the networks. Three classic theoretical network models were also investigated, with the Barab\'asi-Albert model resulting in singular motifs corresponding to hubs, confirming the potential of the approach. Interestingly, the number of different types of singular node motifs as well as the number of their instances were found to be considerably higher in the real-world networks than in any of the benchmark networks.

An essential requirement for the representation of functional patterns in complex neural networks, such as the mammalian cerebral cortex, is the existence of stable regimes of network activation, typically arising from a limited parameter range. In this range of limited sustained activity (LSA), the activity of neural populations in the network persists between the extremes of either quickly dying out or activating the whole network. Hierarchical modular networks were previously found to show a wider parameter range for LSA than random or small-world networks not possessing hierarchical organization or multiple modules. Here we explored how variation in the number of hierarchical levels and modules per level influenced network dynamics and occurrence of LSA. We tested hierarchical configurations of different network sizes, approximating the large-scale networks linking cortical columns in one hemisphere of the rat, cat, or macaque monkey brain. Scaling of the network size affected the number of hierarchical levels and modules in the optimal networks, also depending on whether global edge density or the numbers of connections per node were kept constant. For constant edge density, only few network configurations, possessing an intermediate number of levels and a large number of modules, led to a large range of LSA independent of brain size. For a constant number of node connections, there was a trend for optimal configurations in larger-size networks to possess a larger number of hierarchical levels or more modules. These results may help to explain the trend to greater network complexity apparent in larger brains and may indicate that this complexity is required for maintaining stable levels of neural activation., Comment: Contribution to Frontiers in Neuroinformatics special issue on 'Hierarchy and dynamics in neural networks' (http://frontiersin.org/neuroscience/neuroinformatics/specialtopics/29/)

Neural connectivity at the cellular and mesoscopic level appears very specific and is presumed to arise from highly specific developmental mechanisms. However, there are general shared features of connectivity in systems as different as the networks formed by individual neurons in Caenorhabditis elegans or in rat visual cortex and the mesoscopic circuitry of cortical areas in the mouse, macaque, and human brain. In all these systems, connection length distributions have very similar shapes, with an initial large peak and a long flat tail representing the admixture of long-distance connections to mostly short-distance connections. Furthermore, not all potentially possible synapses are formed, and only a fraction of axons (called filling fraction) establish synapses with spatially neighboring neurons. We explored what aspects of these connectivity patterns can be explained simply by random axonal outgrowth. We found that random axonal growth away from the soma can already reproduce the known distance distribution of connections. We also observed that experimentally observed filling fractions can be generated by competition for available space at the target neurons--a model markedly different from previous explanations. These findings may serve as a baseline model for the development of connectivity that can be further refined by more specific mechanisms., Comment: 31 pages (incl. supplementary information); Cerebral Cortex Advance Access published online on May 12, 2009

Fifty years ago, John von Neumann compared the architecture of the brain with that of computers that he invented and which is still in use today. In those days, the organisation of computers was based on concepts of brain organisation. Here, we give an update on current results on the global organisation of neural systems. For neural systems, we outline how the spatial and topological architecture of neuronal and cortical networks facilitates robustness against failures, fast processing, and balanced network activation. Finally, we discuss mechanisms of self-organization for such architectures. After all, the organization of the brain might again inspire computer architecture.

Many networks exhibit the small-world property of the neighborhood connectivity being higher than in comparable random networks. However, the standard measure of local neighborhood clustering is typically not defined if a node has one or no neighbors. In such cases, local clustering has traditionally been set to zero and this value influenced the global clustering coefficient. Such a procedure leads to underestimation of the neighborhood clustering in sparse networks. We propose to include $\theta$ as the proportion of leafs and isolated nodes to estimate the contribution of these cases and provide a formula for estimating a clustering coefficient excluding these cases from the Watts and Strogatz (1998 Nature 393 440-2) definition of the clustering coefficient. Excluding leafs and isolated nodes leads to values which are up to 140% higher than the traditional values for the observed networks indicating that neighborhood connectivity is normally underestimated. We find that the definition of the clustering coefficient has a major effect when comparing different networks. For metabolic networks of 43 organisms, relations changed for 58% of the comparisons when a different definition was applied. We also show that the definition influences small-world features and that the classification can change from non-small-world to small-world network. We discuss the use of an alternative measure, disconnectedness D, which is less influenced by leafs and isolated nodes., Comment: final version of the manuscript

Many networks extent in space, may it be metric (e.g. geographic) or non-metric (ordinal). Spatial network growth, which depends on the distance between nodes, can generate a wide range of topologies from small-world to linear scale-free networks. However, networks often lacked multiple clusters or communities. Multiple clusters can be generated, however, if there are time windows during development. Time windows ensure that regions of the network develop connections at different points in time. This novel approach could generate small-world but not scale-free networks. The resulting topology depended critically on the overlap of time windows as well as on the position of pioneer nodes.

An essential requirement for the representation of functional patterns in complex neural networks, such as the mammalian cerebral cortex, is the existence of stable network activations within a limited critical range. In this range, the activity of neural populations in the network persists between the extremes of quickly dying out, or activating the whole network. The nerve fiber network of the mammalian cerebral cortex possesses a modular organization extending across several levels of organization. Using a basic spreading model without inhibition, we investigated how functional activations of nodes propagate through such a hierarchically clustered network. The simulations demonstrated that persistent and scalable activation could be produced in clustered networks, but not in random networks of the same size. Moreover, the parameter range yielding critical activations was substantially larger in hierarchical cluster networks than in small-world networks of the same size. These findings indicate that a hierarchical cluster architecture may provide the structural basis for the stable and diverse functional patterns observed in cortical networks.

The organization of the connectivity between mammalian cortical areas has become a major subject of study, because of its important role in scaffolding the macroscopic aspects of animal behavior and intelligence. In this study we present a computational reconstruction approach to the problem of network organization, by considering the topological and spatial features of each area in the primate cerebral cortex as subsidy for the reconstruction of the global cortical network connectivity. Starting with all areas being disconnected, pairs of areas with similar sets of features are linked together, in an attempt to recover the original network structure. Inferring primate cortical connectivity from the properties of the nodes, remarkably good reconstructions of the global network organization could be obtained, with the topological features allowing slightly superior accuracy to the spatial ones. Analogous reconstruction attempts for the C. elegans neuronal network resulted in substantially poorer recovery, indicating that cortical area interconnections are relatively stronger related to the considered topological and spatial properties than neuronal projections in the nematode. The close relationship between area-based features and global connectivity may hint on developmental rules and constraints for cortical networks. Particularly, differences between the predictions from topological and spatial properties, together with the poorer recovery resulting from spatial properties, indicate that the organization of cortical networks is not entirely determined by spatial constraints.

Structure entails function and thus a structural description of the brain will help to understand its function and may provide insights into many properties of brain systems, from their robustness and recovery from damage, to their dynamics and even their evolution. Advances in the analysis of complex networks provide useful new approaches to understanding structural and functional properties of brain networks. Structural properties of networks recently described allow their characterization as small-world, random (exponential) and scale-free. They complement the set of other properties that have been explored in the context of brain connectivity, such as topology, hodology, clustering, and hierarchical organization. Here we apply new network analysis methods to cortical inter-areal connectivity networks for the cat and macaque brains. We compare these corticocortical fibre networks to benchmark rewired, small-world, scale-free and random networks, using two analysis strategies, in which we measure the effects of the removal of nodes and connections on the structural properties of the cortical networks. The brain networks' structural decay is in most respects similar to that of scale-free networks. The results implicate highly connected hub-nodes and bottleneck connections as structural basis for some of the conditional robustness of brain systems. This informs the understanding of the development of brain networks' connectivity., Comment: submitted to European Journal of Neuroscience (under review)

Deviations from the average can provide valuable insights about the organization of natural systems. This article extends this important principle to the more systematic identification and analysis of singular local connectivity patterns in complex networks. Four measurements quantifying different and complementary features of the connectivity around each node are calculated and multivariate statistical methods are then applied in order to identify outliers. The potential of the presented concepts and methodology is illustrated with respect to a word association network., Comment: 1 figure, 1 table, 5 pages. A working manuscript. Comments very welcomed