Search

We develop an automatic method for synaptic partner identification in insect brains and use it to predict synaptic partners in a whole-brain electron microscopy dataset of the fruit fly. The predictions can be used to infer a connectivity graph with high accuracy, thus allowing fast identification of neural pathways. To facilitate circuit reconstruction using our results, we develop CIRCUITMAP, a user interface add-on for the circuit annotation tool CATMAID. A deep-learning-based approach enables automatic identification of synaptically connected neurons in electron microscopy datasets of the fly brain.

To effectively control their bodies, animals rely on feedback from proprioceptive mechanosensory neurons. In the Drosophila leg, different proprioceptor subtypes monitor joint position, movement direction, and vibration. Here, we investigate how these diverse sensory signals are integrated by central proprioceptive circuits. We find that signals for leg joint position and directional movement converge in second-order neurons, revealing pathways for local feedback control of leg posture. Distinct populations of second-order neurons integrate tibia vibration signals across pairs of legs, suggesting a role in detecting external substrate vibration. In each pathway, the flow of sensory information is dynamically gated and sculpted by inhibition. Overall, our results reveal parallel pathways for processing of internal and external mechanosensory signals, which we propose mediate feedback control of leg movement and vibration sensing, respectively. The existence of a functional connectivity map also provides a resource for interpreting connectomic reconstruction of neural circuits for leg proprioception.

SUMMARYMany animals use coordinated limb movements to interact with and navigate through the environment. To investigate circuit mechanisms underlying locomotor behavior, we used serial-section electron microscopy (EM) to map synaptic connectivity within a neuronal network that controls limb movements. We present a synapse-resolution EM dataset containing the ventral nerve cord (VNC) of an adult femaleDrosophila melanogaster. To generate this dataset, we developed GridTape, a technology that combines automated serial-section collection with automated high-throughput transmission EM. Using this dataset, we reconstructed 507 motor neurons, including all those that control the legs and wings. We show that a specific class of leg sensory neurons directly synapse onto the largest-caliber motor neuron axons on both sides of the body, representing a unique feedback pathway for fast limb control. We provide open access to the dataset and reconstructions registered to a standard atlas to permit matching of cells between EM and light microscopy data. We also provide GridTape instrumentation designs and software to make large-scale EM data acquisition more accessible and affordable to the scientific community.

The study of neural circuits requires the reconstruction of neurons and the identification of synaptic connections between them. To scale the reconstruction to the size of whole-brain datasets, semi-automatic methods are needed to solve those tasks. Here, we present an automatic method for synaptic partner identification in insect brains, which uses convolutional neural networks to identify post-synaptic sites and their pre-synaptic partners. The networks can be trained from human generated point annotations alone and require only simple post-processing to obtain final predictions. We used our method to extract 244 million putative synaptic partners in the fifty-teravoxel full adult fly brain (FAFB) electron microscopy (EM) dataset and evaluated its accuracy on 146,643 synapses from 702 neurons with a total cable length of 312 mm in four different brain regions. The predicted synaptic connections can be used together with a neuron segmentation to infer a connectivity graph with high accuracy: between 92% and 96% of edges linking connected neurons are correctly classified as weakly connected (less than five synapses) and strongly connected (at least five synapses). Our synaptic partner predictions for the FAFB dataset are publicly available, together with a query library allowing automatic retrieval of up- and downstream neurons.

Serial-section electron microscopy is the method of choice for studying cellular structure and network connectivity in the brain. We have built a pipeline of parallel imaging using transmission electron automated microscopes (piTEAM) that scales this technology and enables the acquisition of petascale datasets containing local cortical microcircuits. The distributed platform is composed of multiple transmission electron microscopes that image, in parallel, different sections from the same block of tissue, all under control of a custom acquisition software (pyTEM) that implements 24/7 continuous autonomous imaging. The suitability of this architecture for large scale electron microscopy imaging was demonstrated by acquiring a volume of more than 1 mm3 of mouse neocortex spanning four different visual areas. Over 26,500 ultrathin tissue sections were imaged, yielding a dataset of more than 2 petabytes. Our current burst imaging rate is 500 Mpixel/s (image capture only) per microscope and net imaging rate is 100 Mpixel/s (including stage movement, image capture, quality control, and post processing). This brings the combined burst acquisition rate of the pipeline to 3 Gpixel/s and the net rate to 600 Mpixel/s with six microscopes running acquisition in parallel, which allowed imaging a cubic millimeter of mouse visual cortex at synaptic resolution in less than 6 months.

We propose an asymmetrically cyclic adversarial network that performs denoising tasks to improve electron microscopy (EM) image analysis. Deep learning-based denoising methods have typically been trained either with matching pairs of noise-free and noise-corrupted images or by leveraging prior knowledge of noise distributions. Neither of these options is feasible in high-throughput EM imaging pipelines. Our proposed denoising method employs independently acquired noise-free, noise pattern, and noise-corrupted images to automatically learn the underlying noise model and generate denoised outputs. This method is based on three-way cyclic constraints with adversarial training of a deep network to improve the quality of acquired images without paired training data. Its utility is demonstrated for cases where imaging substrates add noise and where acquisition conditions contribute noise. We show that our method, which builds on the concept of CycleGAN, outperforms the current state-of-the-art denoising approaches Noise2Noise and Noise2Void, as well as other learning-based techniques.

Transmission electron microscopy (TEM) is an essential tool for studying cells and molecules. We present a tape-based, reel-to-reel pipeline that combines automated serial sectioning with automated high-throughput TEM imaging. This acquisition platform provides nanometer-resolution imaging at fast rates for a fraction of the cost of alternative approaches. We demonstrate the utility of this imaging platform for generating datasets of biological tissues with a focus on examining brain circuits.

The alignment of serial-section electron microscopy (ssEM) images is critical for efforts in neuroscience that seek to reconstruct neuronal circuits. However, each ssEM plane contains densely packed structures that vary from one section to the next, which makes matching features across images a challenge. Advances in deep learning has resulted in unprecedented performance in similar computer vision problems, but to our knowledge, they have not been successfully applied to ssEM image co-registration. In this paper, we introduce a novel deep network model that combines a spatial transformer for image deformation and a convolutional autoencoder for unsupervised feature learning for robust ssEM image alignment. This results in improved accuracy and robustness while requiring substantially less user intervention than conventional methods. We evaluate our method by comparing registration quality across several datasets.