Search

To understand how the neocortex underlies our ability to perceive, think, and act, it is important to study the relationship between circuit connectivity and function. Previous research has shown that excitatory neurons in layer 2/3 of the primary visual cortex of mice with similar response properties are more likely to form connections. However, technical challenges of combining synaptic connectivity and functional measurements have limited these studies to few, highly local connections. Utilizing the millimeter scale and nanometer resolution of the MICrONS dataset, we studied the connectivity-function relationship in excitatory neurons of the mouse visual cortex across interlaminar and interarea projections, assessing connection selectivity at the coarse axon trajectory and fine synaptic formation levels. A digital twin model of this mouse, that accurately predicted responses to arbitrary video stimuli, enabled a comprehensive characterization of the function of neurons. We found that neurons with highly correlated responses to natural videos tended to be connected with each other, not only within the same cortical area but also across multiple layers and visual areas, including feedforward and feedback connections, whereas we did not find that orientation preference predicted connectivity. The digital twin model separated each neuron’s tuning into a feature component (what the neuron responds to) and a spatial component (where the neuron’s receptive field is located). We show that the feature, but not the spatial component, predicted which neurons were connected at the fine synaptic scale. Together, our results demonstrate the “like-to-like” connectivity rule generalizes to multiple connection types, and the rich MICrONS dataset is suitable to further refine a mechanistic understanding of circuit structure and function.

International audience; Genetically encoded voltage indicators are emerging tools for monitoring voltage dynamics with cell-type specificity. However, current indicators enable a narrow range of applications due to poor performance under two-photon microscopy, a method of choice for deep-tissue recording. To improve indicators, we developed a multiparameter high-throughput platform to optimize voltage indicators for two-photon microscopy. Using this system, we identified JEDI-2P, an indicator that is faster, brighter, and more sensitive and photostable than its predecessors. We demonstrate that JEDI-2P can report light-evoked responses in axonal termini of Drosophila interneurons and the dendrites and somata of amacrine cells of isolated mouse retina. JEDI-2P can also optically record the voltage dynamics of individual cortical neurons in awake behaving mice for more than 30 min using both resonant-scanning and ULoVE random-access microscopy. Finally, ULoVE recording of JEDI-2P can robustly detect spikes at depths exceeding 400 μm and report voltage correlations in pairs of neurons.

Atypical sensory processing is now thought to be a core feature of the autism spectrum. Influential theories have proposed that both increased and decreased neural response reliability within sensory systems could underlie altered sensory processing in autism. Here, we report evidence for abnormally increased reliability of visual-evoked responses in layer 2/3 neurons of adult male and female primary visual cortex in the MECP2-duplication syndrome animal model of autism. Increased response reliability was due in part to decreased response amplitude, decreased fluctuations in endogenous activity, and an abnormal decoupling of visual-evoked activity from endogenous activity. Similar to what was observed neuronally, the optokinetic reflex occurred more reliably at low contrasts in mutant mice compared with controls. Retinal responses did not explain our observations. These data suggest that the circuit mechanisms for combining sensory-evoked and endogenous signal and noise processes may be altered in this form of syndromic autism. SIGNIFICANCE STATEMENT Atypical sensory processing is now thought to be a core feature of the autism spectrum. Influential theories have proposed that both increased and decreased neural response reliability within sensory systems could underlie altered sensory processing in autism. Here, we report evidence for abnormally increased reliability of visual-evoked responses in primary visual cortex of the animal model for MECP2-duplication syndrome, a high-penetrance single-gene cause of autism. Visual-evoked activity was abnormally decoupled from endogenous activity in mutant mice, suggesting in line with the influential “hypo-priors” theory of autism that sensory priors embedded in endogenous activity may have less influence on perception in autism.

The dentate gyrus (DG) controls information flow into the hippocampus and is critical for learning, memory, pattern separation, and spatial coding, while DG dysfunction is associated with neuropsychiatric disorders. Despite its importance, the molecular mechanisms regulating DG neural circuit assembly and function remain unclear. Here, we identify the Rac-GEF Tiam1 as an important regulator of DG development and associated memory processes. In the hippocampus, Tiam1 is predominantly expressed in the DG throughout life. Global deletion ofTiam1in male mice results in DG granule cells with simplified dendritic arbors, reduced dendritic spine density, and diminished excitatory synaptic transmission. Notably, DG granule cell dendrites and synapses develop normally inTiam1KO mice, resembling WT mice at postnatal day 21 (P21), but fail to stabilize, leading to dendrite and synapse loss by P42. These results indicate that Tiam1 promotes DG granule cell dendrite and synapse stabilization late in development. Tiam1 loss also increases the survival, but not the production, of adult-born DG granule cells, possibly because of greater circuit integration as a result of decreased competition with mature granule cells for synaptic inputs. Strikingly, both male and female mice lacking Tiam1 exhibit enhanced contextual fear memory and context discrimination. Together, these results suggest that Tiam1 is a key regulator of DG granule cell stabilization and function within hippocampal circuits. Moreover, based on the enhanced memory phenotype ofTiam1KO mice, Tiam1 may be a potential target for the treatment of disorders involving memory impairments.SIGNIFICANCE STATEMENTThe dentate gyrus (DG) is important for learning, memory, pattern separation, and spatial navigation, and its dysfunction is associated with neuropsychiatric disorders. However, the molecular mechanisms controlling DG formation and function remain elusive. By characterizing mice lacking the Rac-GEF Tiam1, we demonstrate that Tiam1 promotes the stabilization of DG granule cell dendritic arbors, spines, and synapses, whereas it restricts the survival of adult-born DG granule cells, which compete with mature granule cells for synaptic integration. Notably, mice lacking Tiam1 also exhibit enhanced contextual fear memory and context discrimination. These findings establish Tiam1 as an essential regulator of DG granule cell development, and identify it as a possible therapeutic target for memory enhancement.

More than a dozen excitatory cell types have been identified in the mouse primary visual cortex (V1) based on transcriptomic, morphological and in vitro electrophysiological features. However, the functional landscape of excitatory neurons with respect to their responses to visual stimuli is currently unknown. Here, we combined large-scale two-photon imaging and deep learning neural predictive models to study the functional organization of mouse V1 using digital twins. Digital twins enable exhaustive in silico functional characterization providing a bar code summarizing the input-output function of each neuron. Clustering the bar codes revealed a continuum of function with around 30 modes. Each mode represented a group of neurons that exhibited a specific combination of stimulus selectivity and nonlinear response properties such as cross-orientation inhibition, size-contrast tuning and surround suppression. These non-linear properties were expressed independently spanning all possible combinations across the population. This combinatorial code provides the first large-scale, data-driven characterization of the functional organization of V1. This powerful approach based on digital twins is applicable to other brain areas and to complex non-linear systems beyond the brain.

To increase computational flexibility, the processing of sensory inputs changes with behavioural context. In the visual system, active behavioural states characterized by motor activity and pupil dilation

Inhibitory neurons in mammalian cortex exhibit diverse physiological, morphological, molecular, and connectivity signatures. While considerable work has measured the average connectivity of several interneuron classes, there remains a fundamental lack of understanding of the connectivity distribution of distinct inhibitory cell types with synaptic resolution, how it relates to properties of target cells, and how it affects function. Here, we used large-scale electron microscopy and functional imaging to address these questions for chandelier cells in layer 2/3 of the mouse visual cortex. With dense reconstructions from electron microscopy, we mapped the complete chandelier input onto 153 pyramidal neurons. We found that synapse number is highly variable across the population and is correlated with several structural features of the target neuron. This variability in the number of axo-axonic ChC synapses is higher than the variability seen in perisomatic inhibition. Biophysical simulations show that the observed pattern of axo-axonic inhibition is particularly effective in controlling excitatory output when excitation and inhibition are co-active. Finally, we measured chandelier cell activity in awake animals using a cell-type-specific calcium imaging approach and saw highly correlated activity across chandelier cells. In the same experiments, in vivo chandelier population activity correlated with pupil dilation, a proxy for arousal. Together, these results suggest that chandelier cells provide a circuit-wide signal whose strength is adjusted relative to the properties of target neurons.

Across animal species, sensory processing dynamically adapts to behavioral context. In the mammalian visual system, sensory neural responses and behavioral performance increase during an active behavioral state characterized by locomotion activity and pupil dilation, whereas preferred stimuli of individual neurons typically remain unchanged. Here, we address how behavioral states modulate stimulus selectivity in the context of colored natural scenes using a combination of large-scale population imaging, behavior, pharmacology, and deep neural network modeling. In visual cortex of awake mice, we identified a consistent shift of individual neuron color preferences towards ultraviolet stimuli during active behavioral periods that was particularly pronounced in the upper visual field. We found that the spectral shift in neural tuning is mediated by pupil dilation, resulting in a dynamic switch from rod-to cone-driven visual responses for constant ambient light levels. We further showed that this shift selectively enhances the discriminability of ultraviolet objects and facilitates the detection of ethological stimuli, such as aerial predators against the ultraviolet background of the twilight sky. Our results suggest a novel functional role for pupil dilation during active behavioral states as a bottom-up mechanism that, together with top-down neuromodulatory mechanisms, dynamically tunes visual representations to different behavioral demands.

3D electron microscopy (EM) has been successful at mapping invertebrate nervous systems, but the approach has been limited to small chunks of mammalian brains. To scale up to larger volumes, we have built a computational pipeline for processing petascale image datasets acquired by serial section EM, a popular form of 3D EM. The pipeline employs convolutional nets to compute the nonsmooth transformations required to align images of serial sections containing numerous cracks and folds, detect neuronal boundaries, label voxels as axon, dendrite, soma, and other semantic categories, and detect synapses and assign them to presynaptic and postsynaptic segments. The output of neuronal boundary detection is segmented by mean affinity agglomeration with semantic and size constraints. Pipeline operations are implemented by leveraging distributed and cloud computing. Intermediate results of the pipeline are held in cloud storage, and can be effortlessly viewed as images, which aids debugging. We applied the pipeline to create an automated reconstruction of an EM image volume spanning four visual cortical areas of a mouse brain. Code for the pipeline is publicly available, as is the reconstructed volume.

In this article, we review the anatomical inputs and outputs to the mouse primary visual cortex, area V1. Our survey of data from the Allen Institute Mouse Connectivity project indicates that mouse V1 is highly interconnected with both cortical and subcortical brain areas. This pattern of innervation allows for computations that depend on the state of the animal and on behavioral goals, which contrasts with simple feedforward, hierarchical models of visual processing. Thus, to have an accurate description of the function of V1 during mouse behavior, its involvement with the rest of the brain circuitry has to be considered. Finally, it remains an open question whether the primary visual cortex of higher mammals displays the same degree of sensorimotor integration in the early visual system.

To understand the brain we must relate neurons’ functional responses to the circuit architecture that shapes them. Here, we present a large functional connectomics dataset with dense calcium imaging of a millimeter scale volume. We recorded activity from approximately 75,000 neurons in primary visual cortex (VISp) and three higher visual areas (VISrl, VISal and VISlm) in an awake mouse viewing natural movies and synthetic stimuli. The functional data were co-registered with a volumetric electron microscopy (EM) reconstruction containing more than 200,000 cells and 0.5 billion synapses. Subsequent proofreading of a subset of neurons in this volume yielded reconstructions that include complete dendritic trees as well the local and inter-areal axonal projections that map up to thousands of cell-to-cell connections per neuron. Here, we release this dataset as an open-access resource to the scientific community including a set of tools that facilitate data retrieval and downstream analysis. In accompanying papers we describe our findings using the dataset to provide a comprehensive structural characterization of cortical cell types1–3and the most detailed synaptic level connectivity diagram of a cortical column to date2, uncovering unique cell-type specific inhibitory motifs that can be linked to gene expression data4. Functionally, we identify new computational principles of how information is integrated across visual space5, characterize novel types of neuronal invariances6and bring structure and function together to decipher a general principle that wires excitatory neurons within and across areas7, 8.

SummaryWe present a semi-automated reconstruction of L2/3 mouse primary visual cortex from 3 million cubic microns of electron microscopic images, including pyramidal and inhibitory neurons, astrocytes, microglia, oligodendrocytes and precursors, pericytes, vasculature, mitochondria, and synapses. Visual responses of a subset of pyramidal cells are included. The data are being made publicly available, along with tools for programmatic and 3D interactive access. The density of synaptic inputs onto inhibitory neurons varies across cell classes and compartments. We uncover a compartment-specific correlation between mitochondrial coverage and synapse density. Frequencies of connectivity motifs in the graph of pyramidal cells are predicted quite accurately from node degrees using the configuration model of random graphs. Cells receiving more connections from nearby cells exhibit stronger and more reliable visual responses. These example findings illustrate the resource’s utility for relating structure and function of cortical circuits as well as for neuronal cell biology.

Despite variations in appearance we robustly recognize objects. Neuronal populations responding to objects presented under varying conditions form object manifolds and hierarchically organized visual areas untangle pixel intensities into linearly decodable object representations. However, the associated changes in the geometry of object manifolds along the cortex remain unknown. Using home cage training we showed that mice are capable of invariant object recognition. We simultaneously recorded the responses of thousands of neurons to measure the information about object identity across the visual cortex and found that lateral areas LM, LI and AL carry more linearly decodable object information compared to other visual areas. We applied the theory of linear separability of manifolds, and found that the increase in classification capacity is associated with a decrease in the dimension and radius of the object manifold, identifying the key features in the geometry of the population neural code that enable invariant object coding.

The activity and connectivity of inhibitory cells has a profound impact on the operation of neuronal networks. While the average connectivity of many inhibitory cell types has been characterized, we still lack an understanding of how individual interneurons distribute their synapses onto their targets and how heterogeneous the inhibition is onto different individual excitatory neurons. Here, we use large-scale volumetric electron microscopy (EM) and functional imaging to address this question for chandelier cells in layer 2/3 of mouse visual cortex. Using dense morphological reconstructions from EM, we mapped the complete chandelier input onto 153 pyramidal neurons. We find that the number of input synapses is highly variable across the population, but the variability is correlated with structural features of the target neuron: soma depth, soma size, and the number of perisomatic synapses received. Functionally, we found that chandelier cell activity in vivo was highly correlated and tracks pupil diameter, a proxy for arousal state. We propose that chandelier cells provide a global signal whose strength is individually adjusted for each target neuron. This approach, combining comprehensive structural analysis with functional recordings of identified cell types, will be a powerful tool to uncover the wiring rules across the diversity of cortical cell types.

Combining two-photon calcium imaging (2PCI) and electron microscopy (EM) provides arguably the most powerful current approach for connecting function to structure in neural circuits. Recent years have seen dramatic advances in obtaining and processing CI and EM data separately. In addition, several joint CI-EM datasets (with CI performed in vivo, followed by EM reconstruction of the same volume) have been collected. However, no automated analysis tools yet exist that can match each signal extracted from the CI data to a cell segment extracted from EM; previous efforts have been largely manual and focused on analyzing calcium activity in cell bodies, neglecting potentially rich functional information from axons and dendrites. There are two major roadblocks to solving this matching problem: first, dense EM reconstruction extracts orders of magnitude more segments than are visible in the corresponding CI field of view, and second, due to optical constraints and non-uniform brightness of the calcium indicator in each cell, direct matching of EM and CI spatial components is nontrivial.In this work we develop a pipeline for fusing CI and densely-reconstructed EM data. We model the observed CI data using a constrained nonnegative matrix factorization (CNMF) framework, in which segments extracted from the EM reconstruction serve to initialize and constrain the spatial components of the matrix factorization. We develop an efficient iterative procedure for solving the resulting combined matching and matrix factorization problem and apply this procedure to joint CI-EM data from mouse visual cortex. The method recovers hundreds of dendritic components from the CI data, visible across multiple functional scans at different depths, matched with densely-reconstructed three-dimensional neural segments recovered from the EM volume. We publicly release the output of this analysis as a new gold standard dataset that can be used to score algorithms for demixing signals from 2PCI data. Finally, we show that this database can be exploited to (1) learn a mapping from 3d EM segmentations to predict the corresponding 2d spatial components estimated from CI data, and (2) train a neural network to denoise these estimated spatial components. This neural network denoiser is a stand-alone module that can be dropped in to enhance any existing 2PCI analysis pipeline.

We assembled a semi-automated reconstruction of L2/3 mouse primary visual cortex from ~250×140×90 μm(3) of electron microscopic images, including pyramidal and non-pyramidal neurons, astrocytes, microglia, oligodendrocytes and precursors, pericytes, vasculature, nuclei, mitochondria, and synapses. Visual responses of a subset of pyramidal cells are included. The data are publicly available, along with tools for programmatic and three-dimensional interactive access. Brief vignettes illustrate the breadth of potential applications relating structure to function in cortical circuits and neuronal cell biology. Mitochondria and synapse organization are characterized as a function of path length from the soma. Pyramidal connectivity motif frequencies are predicted accurately using a configuration model of random graphs. Pyramidal cells receiving more connections from nearby cells exhibit stronger and more reliable visual responses. Sample code shows data access and analysis.

Learning from experience depends at least in part on changes in neuronal connections. We present the largest map of connectivity to date between cortical neurons of a defined type (L2/3 pyramidal cells), which was enabled by automated analysis of serial section electron microscopy images with improved handling of image defects. We used the map to identify constraints on the learning algorithms employed by the cortex. Previous cortical studies modeled a continuum of synapse sizes (Arellano et al. 2007) by a log-normal distribution (Loewenstein, Kuras, and Rumpel 2011; de Vivo et al. 2017; Santuy et al. 2018). A continuum is consistent with most neural network models of learning, in which synaptic strength is a continuously graded analog variable. Here we show that synapse size, when restricted to synapses between L2/3 pyramidal cells, is well-modeled by the sum of a binary variable and an analog variable drawn from a log-normal distribution. Two synapses sharing the same presynaptic and postsynaptic cells are known to be correlated in size (Sorra and Harris 1993; Koester and Johnston 2005; Bartol et al. 2015; Kasthuri et al. 2015; Dvorkin and Ziv 2016; Bloss et al. 2018; Motta et al. 2019). We show that the binary variables of the two synapses are highly correlated, while the analog variables are not. Binary variation could be the outcome of a Hebbian or other synaptic plasticity rule depending on activity signals that are relatively uniform across neuronal arbors, while analog variation may be dominated by other influences. We discuss the implications for the stability-plasticity dilemma.

An amendment to this paper has been published and can be accessed via a link at the top of the paper.

Layer 4 (L4) of mammalian neocortex plays a crucial role in cortical information processing, yet a complete census of its cell types and connectivity remains elusive. Using whole-cell recordings with morphological recovery, we identified one major excitatory and seven inhibitory types of neurons in L4 of adult mouse visual cortex (V1). Nearly all excitatory neurons were pyramidal and all somatostatin-positive (SOM+) non-fast-spiking interneurons were Martinotti cells. In contrast, in somatosensory cortex (S1), excitatory neurons were mostly stellate and SOM+ interneurons were non-Martinotti. These morphologically distinct SOM+ interneurons corresponded to different transcriptomic cell types and were differentially integrated into the local circuit with only S1 neurons receiving local excitatory input. We propose that cell type specific circuit motifs, such as the Martinotti/pyramidal and non-Martinotti/stellate pairs, are used across the cortex as building blocks to assemble cortical circuits., Layer 4 of the mammalian neocortex is important for cortical information processing but its cellular composition and local circuits remains elusive. The authors compared two primary sensory cortical areas of mice and found differences in cell composition and local connectivity.

In primates and most carnivores, neurons in primary visual cortex are spatially organized by their functional properties. For example, neurons with similar orientation preferences are grouped together in iso-orientation domains that smoothly vary over the cortical sheet. In rodents, on the other hand, neurons with different orientation preferences are thought to be spatially intermingled, a feature which has been termed “salt-and-pepper” organization. The apparent absence of any systematic structure in orientation tuning has been considered a defining feature of the rodent visual system for more than a decade, with broad implications for brain development, visual processing, and comparative neurophysiology. Here, we revisited this question using new techniques for wide-field two-photon calcium imaging that enabled us to collect nearly complete population tuning preferences in layers 2-4 across a large fraction of the mouse visual hierarchy. Examining the orientation tuning of these hundreds of thousands of neurons, we found a global map spanning multiple visual cortical areas in which orientation bias was organized around a single pinwheel centered in V1. This pattern was consistent across animals and cortical depth. The existence of this global organization in rodents has implications for our understanding of visual processing and the principles governing the ontogeny and phylogeny of the visual cortex of mammals.

Much of our knowledge about sensory processing in the brain is based on quasi-linear models and the stimuli that optimally drive them. However, sensory information processing is nonlinear, even in primary sensory areas, and optimizing sensory input is difficult due to the high-dimensional input space. We developed inception loops, a closed-loop experimental paradigm that combines in vivo recordings with in silico nonlinear response modeling to identify the Most Exciting Images (MEIs) for neurons in mouse V1. When presented back to the brain, MEIs indeed drove their target cells significantly better than the best stimuli identified by linear models. The MEIs exhibited complex spatial features that deviated from the textbook ideal of V1 as a bank of Gabor filters. Inception loops represent a widely applicable new approach to dissect the neural mechanisms of sensation.

Layer 4 (L4) of mammalian neocortex plays a crucial role in cortical information processing, yet a complete census of its cell types and connectivity remains elusive. Using whole-cell recordings with morphological recovery, we identified one major excitatory and seven inhibitory types of neurons in L4 of adult mouse visual cortex (V1). Nearly all excitatory neurons were pyramidal and all somatostatin-positive (SOM+) non-fast-spiking neurons were Martinotti cells. In contrast, in somatosensory cortex (S1), excitatory neurons were mostly stellate and SOM+ neurons were non-Martinotti. These morphologically distinct SOM+ interneurons corresponded to different transcriptomic cell types and were differentially integrated into the local circuit with only S1 neurons receiving local excitatory input. We propose that cell-type specific circuit motifs, such as the Martinotti/pyramidal and non-Martinotti/stellate pairs, are optionally used across the cortex as building blocks to assemble cortical circuits.

Inhibitory interneurons are integral to sensory processing, yet revealing their cell type-specific roles in sensory circuits remains an ongoing focus. To Investigate the mouse olfactory system, we selectively remove GABAergic transmission from a subset of olfactory bulb interneurons, EPL interneurons (EPL-INs), and assay odor responses from their downstream synaptic partners — tufted cells and mitral cells. Using a combination of in vivo electrophysiological and imaging analyses, we find that inactivating this single node of inhibition leads to differential effects in magnitude, reliability, tuning width, and temporal dynamics between the two principal neurons. Furthermore, tufted and not mitral cell responses to odor mixtures become more linearly predictable without EPL-IN inhibition. Our data suggest that olfactory bulb interneurons, through exerting distinct inhibitory functions onto their different synaptic partners, play a significant role in the processing of odor information., The precise cell-type specific role of inhibitory interneurons in regulating sensory responses in the olfactory bulb is not known. Here, the authors report that removing GABAergic inhibition from one layer differentially affects response dynamics of the two main output cell types and changes odor mixture processing.

A fundamental challenge in calcium imaging has been to infer spike rates of neurons from the measured noisy fluorescence traces. We systematically evaluate different spike inference algorithms on a large benchmark dataset (>100.000 spikes) recorded from varying neural tissue (V1 and retina) using different calcium indicators (OGB-1 and GCaMP6). In addition, we introduce a new algorithm based on supervised learning in flexible probabilistic models and find that it performs better than other published techniques. Importantly, it outperforms other algorithms even when applied to entirely new datasets for which no simultaneously recorded data is available. Future data acquired in new experimental conditions can be used to further improve the spike prediction accuracy and generalization performance of the model. Finally, we show that comparing algorithms on artificial data is not informative about performance on real data, suggesting that benchmarking different methods with real-world datasets may greatly facilitate future algorithmic developments in neuroscience.

Ambitious projects aim to record the activity of ever larger and denser neuronal populations in vivo. Correlations in neural activity measured in such recordings can reveal important aspects of neural circuit organization. However, estimating and interpreting large correlation matrices is statistically challenging. Estimation can be improved by regularization, i.e. by imposing a structure on the estimate. The amount of improvement depends on how closely the assumed structure represents dependencies in the data. Therefore, the selection of the most efficient correlation matrix estimator for a given neural circuit must be determined empirically. Importantly, the identity and structure of the most efficient estimator informs about the types of dominant dependencies governing the system. We sought statistically efficient estimators of neural correlation matrices in recordings from large, dense groups of cortical neurons. Using fast 3D random-access laser scanning microscopy of calcium signals, we recorded the activity of nearly every neuron in volumes 200 μm wide and 100 μm deep (150–350 cells) in mouse visual cortex. We hypothesized that in these densely sampled recordings, the correlation matrix should be best modeled as the combination of a sparse graph of pairwise partial correlations representing local interactions and a low-rank component representing common fluctuations and external inputs. Indeed, in cross-validation tests, the covariance matrix estimator with this structure consistently outperformed other regularized estimators. The sparse component of the estimate defined a graph of interactions. These interactions reflected the physical distances and orientation tuning properties of cells: The density of positive ‘excitatory’ interactions decreased rapidly with geometric distances and with differences in orientation preference whereas negative ‘inhibitory’ interactions were less selective. Because of its superior performance, this ‘sparse+latent’ estimator likely provides a more physiologically relevant representation of the functional connectivity in densely sampled recordings than the sample correlation matrix., Author Summary It is now possible to record the spiking activity of hundreds of neurons at the same time. A meaningful statistical description of the collective activity of these neural populations—their ‘functional connectivity’—is a forefront challenge in neuroscience. We addressed this problem by identifying statistically efficient estimators of correlation matrices of the spiking activity of neural populations. Various underlying processes may reflect differently on the structure of the correlation matrix: Correlations due to common network fluctuations or external inputs are well estimated by low-rank representations, whereas correlations arising from linear interactions between pairs of neurons are well approximated by their pairwise partial correlations. In our data obtained from fast 3D two-photon imaging of calcium signals of large and dense groups of neurons in mouse visual cortex, the best estimation performance was attained by decomposing the correlation matrix into a sparse network of partial correlations (‘interactions’) combined with a low-rank component. The inferred interactions were both positive (‘excitatory’) and negative (‘inhibitory’) and reflected the spatial organization and orientation preferences of the interacting cells. We propose that the most efficient among many estimators provides a more informative picture of the functional connectivity than previous analyses of neural correlations.

A fundamental challenge in calcium imaging has been to infer spike rates of neurons from the measured noisy calcium fluorescence traces. We systematically evaluate a range of spike inference algorithms on a large benchmark dataset (>100.000 spikes) recorded from varying neural tissue (V1 and retina) using different calcium indicators (OGB-1 and GCaMP6). We introduce a new algorithm based on supervised learning in flexible probabilistic models and show that it outperforms all previously published techniques. Importantly, it even performs better than other algorithms when applied to entirely new datasets for which no simultaneously recorded data is available. Future data acquired in new experimental conditions can easily be used to further improve its spike prediction accuracy and generalization performance. Finally, we show that comparing algorithms on artificial data is not informative about performance on real data, suggesting that benchmark datasets such as the one we provide may greatly facilitate future algorithmic developments

The neural code is believed to have adapted to the statistical properties of the natural environment. However, the principles that govern the organization of ensemble activity in the visual cortex during natural visual input are unknown. We recorded populations of up to 500 neurons in the mouse primary visual cortex and characterized the structure of their activity, comparing responses to natural movies with those to control stimuli. We found that higher-order correlations in natural scenes induce a sparser code, in which information is encoded by reliable activation of a smaller set of neurons and can be read-out more easily. This computationally advantageous encoding for natural scenes was state-dependent and apparent only in anesthetized and active awake animals, but not during quiet wakefulness. Our results argue for a functional benefit of sparsification that could be a general principle governing the structure of the population activity throughout cortical microcircuits.

Great progress has been made towards understanding the properties of single neurons, yet the principles underlying interactions between neurons remain poorly understood. Given that connectivity in the neocortex is locally dense through both horizontal and vertical con-nections, it is of particular importance to characterize the activity structure of local popula-tions of neurons arranged in three dimensions. However, techniques for simultaneously measuring microcircuit activity are lacking. We developed an in vivo 3D high-speed, ran-dom-access two-photon microscope that is capable of simultaneous 3D motion tracking. This allows imaging from hundreds of neurons at several hundred Hz, while monitoring tissue movement. Given that motion will induce common artifacts across the population, accurate motion tracking is absolutely necessary for studying population activity with ran-dom-access based imaging methods. We demonstrate the potential of this imaging tech-nique by measuring the correlation structure of large populations of nearby neurons in the mouse visual cortex, and find that the microcircuit correlation structure is stimulus-dependent. Three-dimensional random access multiphoton imaging with concurrent mo-tion tracking provides a novel powerful method to characterize the microcircuit activity in vivo.

The critique of Barth et al . centers on three points: (i) the completeness of our study is overstated; (ii) the connectivity matrix we describe is biased by technical limitations of our brain-slicing and multipatching methods; and (iii) our cell classification scheme is arbitrary and we have simply renamed previously identified interneuron types. We address these criticisms in our Response.