Search

In this paper we study synchronizability of two multiplex cortical networks: whole-cortex of hermaphrodite C. elegans and posterior cortex in male C. elegans . These networks are composed of two connection layers: network of chemical synapses and the one formed by gap junctions. This work studies the contribution of each layer on the phase synchronization of non-identical spiking Hindmarsh–Rose neurons. The network of male C. elegans shows higher phase synchronization than its randomized version, while it is not the case for hermaphrodite type. The random networks in each layer are constructed such that the nodes have the same degree as the original network, thus providing an unbiased comparison. In male C. elegans , although the gap junction network is sparser than the chemical network, it shows higher contribution in the synchronization phenomenon. This is not the case in hermaphrodite type, which is mainly due to significant less density of gap junction layer (0.013) as compared to chemical layer (0.028). Also, the gap junction network in this type has stronger community structure than the chemical network, and this is another driving factor for its weaker synchronizability. [ABSTRACT FROM AUTHOR]

With a similar capability of processing spikes as biological neural systems, networks of spiking neurons are expected to achieve a performance similar to that of living brains. Despite the achievement of spiking neuron based applications, most of them assume noise-free condition for learning and testing. This assumption, though fairly general, ignores the fact that noise widely exists in spiking neural networks (SNNs) and the neural response can be significantly disturbed by noise. Therefore, how to deal with noise is an important issue in the applications of SNNs. Here, by analyzing strategies employed to make spiking neurons robust to noise, also inspired by biological neurons, we propose a strategy that train spiking neurons with a dynamic firing threshold named noise-threshold. The noise-threshold can be applied by the existing supervised learning methods to improve the noise tolerance of them. Experimental results show that, with a combination of noise-threshold, the anti-noise capability of the existing supervised learning methods improves significantly, and the trained neuron can precisely and reliably reproduce target sequences of spikes even under highly noisy conditions. More importantly, the SNNs-based computational model equipped with a noise-threshold is more robust and can achieve a good performance even with different types of noise. Therefore, the noise-threshold is significant to practical applications and theoretical researches of SNNs. [ABSTRACT FROM AUTHOR]

In the context of the modeling and simulation of neural nets, we formulate definitions for the behavioral realization of memoryless functions. The definitions of realization are substantively different for deterministic and stochastic systems constructed of neuron-inspired components. In contrast to earlier generations of neural net models, third generation spiking neural nets exhibit important temporal and dynamic properties, and random neural nets provide alternative probabilistic approaches. Our definitions of realization are based on the Discrete Event System Specification (DEVS) formalism that fundamentally include temporal and probabilistic characteristics of neuron system inputs, state, and outputs. The realizations that we construct--in particular for the Exclusive Or (XOR) logic gate--provide insight into the temporal and probabilistic characteristics that real neural systems might display. Our results provide a solid system-theoretical foundation and simulation modeling framework for the high-performance computational support of such applications. [ABSTRACT FROM AUTHOR]

There is a growing requirement in computational neuroscience for tools that permit collaborative model building, model sharing, combining existing models into a larger system (multi-scale model integration), and are able to simulate models using a variety of simulation engines and hardware platforms. Layered XML model specification formats solve many of these problems, however they are difficult to write and visualise without tools. Here we describe a new graphical software tool, SpineCreator, which facilitates the creation and visualisation of layered models of point spiking neurons or rate coded neurons without requiring the need for programming. We demonstrate the tool through the reproduction and visualisation of published models and show simulation results using code generation interfaced directly into SpineCreator. As a unique application for the graphical creation of neural networks, SpineCreator represents an important step forward for neuronal modelling. [ABSTRACT FROM AUTHOR]

After decades of independent morphological and functional brain research, a key point in neuroscience nowadays is to understand the combined relationships between the structure of the brain and its components and their dynamics on multiple scales, ranging from circuits of neurons at micro or mesoscale to brain regions at macroscale. With such a goal in mind, there is a vast amount of research focusing on modeling and simulating activity within neuronal structures, and these simulations generate large and complex datasets which have to be analyzed in order to gain the desired insight. In such context, this paper presents ViSimpl, which integrates a set of visualization and interaction tools that provide a semantic view of brain data with the aim of improving its analysis procedures. ViSimpl provides 3D particle-based rendering that allows visualizing simulation data with their associated spatial and temporal information, enhancing the knowledge extraction process. It also provides abstract representations of the time-varying magnitudes supporting different data aggregation and disaggregation operations and giving also focus and context clues. In addition, ViSimpl tools provide synchronized playback control of the simulation being analyzed. Finally, ViSimpl allows performing selection and filtering operations relying on an application called NeuroScheme. All these views are loosely coupled and can be used independently, but they can also work together as linked views, both in centralized and distributed computing environments, enhancing the data exploration and analysis procedures. [ABSTRACT FROM AUTHOR]

Retinal image of surrounding objects varies tremendously due to the changes in position, size, pose, illumination condition, background context, occlusion, noise, and non-rigid deformations. But despite these huge variations, our visual system is able to invariantly recognize any object in just a fraction of a second. To date, various computational models have been proposed to mimic the hierarchical processing of the ventral visual pathway, with limited success. Here, we show that the association of both biologically inspired network architecture and learning rule significantly improves the models׳ performance when facing challenging invariant object recognition problems. Our model is an asynchronous feedforward spiking neural network. When the network is presented with natural images, the neurons in the entry layers detect edges, and the most activated ones fire first, while neurons in higher layers are equipped with spike timing-dependent plasticity. These neurons progressively become selective to intermediate complexity visual features appropriate for object categorization. The model is evaluated on 3D-Object and ETH -80 datasets which are two benchmarks for invariant object recognition, and is shown to outperform state-of-the-art models, including DeepConvNet and HMAX. This demonstrates its ability to accurately recognize different instances of multiple object classes even under various appearance conditions (different views, scales, tilts, and backgrounds). Several statistical analysis techniques are used to show that our model extracts class specific and highly informative features. [ABSTRACT FROM AUTHOR]

Classification and sequence learning are relevant capabilities used by living beings to extract complex information from the environment for behavioral control. The insect world is full of examples where the presentation time of specific stimuli shapes the behavioral response. On the basis of previously developed neural models, inspired by Drosophila melanogaster, a new architecture for classification and sequence learning is here presented under the perspective of the Neural Reuse theory. Classification of relevant input stimuli is performed through resonant neurons, activated by the complex dynamics generated in a lattice of recurrent spiking neurons modeling the insect Mushroom Bodies neuropile. The network devoted to context formation is able to reconstruct the learned sequence and also to trace the subsequences present in the provided input. A sensitivity analysis to parameter variation and noise is reported. Experiments on a roving robot are reported to show the capabilities of the architecture used as a neural controller. [ABSTRACT FROM AUTHOR]

A realization of the Mihalas-Niebur neuron model using the concept of the Sinh-Domain filtering is introduced in this Letter. This is achieved through the utilization of Sinh-Domain lossy integrator stages which offer the benefits of electronic tuning of the realized time-constants, while the inherent class-AB nature allows the handling of signals with amplitude greater than the dc bias current. The behavior of the proposed model for various patterns of stimuli is evaluated through the Analog Design Environment of the Cadence software and MOS transistor models provided by the AMS C35 0.35 µm process. [ABSTRACT FROM AUTHOR]

The article discusses the structural definition of common input to spinal motor neurons by using standard, well-established models in computational neuroscience. Topics discussed include the correlation between presynaptic activities and the correlation between the anatomical connections or structural links for motor neurons (MNs).

Gabor Wavelets (GW) have been extensively used for facial feature representation due to its inherent multi-resolution and multi-orientation characteristics. In this work we extend the work on Local Gabor Feature Vector (LGFV) and propose a new face recognition method called LGFV//LN//SNP, which employs local normalization filter in pre-processing stage. We propose a novel Spiking Neuron Patterns (SNP) as a dimensionality reduction method to reduce the dimensions of local Gabor features. SNP is acquired from projection of LGFV//LN features using Spike Response Model (SRM), a neuron model describing the spike behavior of a biological neuron. Results on AR, FERET, Yale B and FRGC 2.0 face datasets showed that SNP implementation delivered significant improvement in accuracy. Comparisons with several previously published results also suggested that LGFV//LN//SNP achieved better results in some tests. Additionally, LGFV//LN//SNP requires relatively smaller number of GW than LGFV//LN to produce optimal results. [ABSTRACT FROM AUTHOR]

This review evaluates the potential of optogenetic methods for the stimulation of the auditory nerve and assesses the feasability of optogenetic cochlear implants (CIs). It provides an overview of all critical steps like opsin targeting strategies, how opsins work, how their function can be modeled and included in neuronal models and the properties of light sources available for optical stimulation. From these foundations, quantitative estimates for the number of independent stimulation channels and the temporal precision of optogenetic stimulation of the auditory nerve are derived and compared with state-of-the-art electrical CIs. We conclude that optogenetic CIs have the potential to increase the number of independent stimulation channels by up to one order of magnitude to about 100, but only if light sources are able to deliver confined illumination patterns independently and parallelly. Already now, opsin variants like ChETA and Chronos enable driving of the auditory nerve up to rates of 200 spikes/s, close to the physiological value of their maximum sustained firing rate. Apart from requiring 10 times more energy than electrical stimulation, optical CIs still face major hurdles concerning the safety of gene transfection and optrode array implantation, for example, before becoming an option to replace electrical CIs. [ABSTRACT FROM PUBLISHER]

Auditory nerve fibers (ANFs) play a crucial role in hearing by encoding and transporting the synaptic input from inner hair cells into afferent spiking information for higher stages of the auditory system. If the inner hair cells are degenerated, cochlear implants may restore hearing by directly stimulating the ANFs. The response of an ANF is affected by several characteristics of the electrical stimulus and of the ANF, and neurophysiological measurements are needed to know how the ANF responds to a particular stimulus. However, recording from individual nerve fibers in humans is not feasible and obtaining compound neural or psychophysical responses is often time-consuming. This motivates the design and use of models to estimate the ANF response to the electrical stimulation. Phenomenological models reproduce the ANF response based on a simplified description of ANF functionality and on a limited parameter space by not directly describing detailed biophysical mechanisms. Here, we give an overview of phenomenological models published to date and demonstrate how different modeling approaches can account for the diverse phenomena affecting the ANF response. To highlight the success achieved in designing such models, we also describe a number of applications of phenomenological models to predict percepts of cochlear implant listeners. [ABSTRACT FROM PUBLISHER]

In the last few decades, biophysical models have emerged as a prominent tool in the study and improvement of cochlear implants, a neural prosthetic that restores a degree of sound perception to the profoundly deaf. Owing to the spatial phenomena associated with extracellular stimulation, these models have evolved to a relatively high degree of morphological and physiological detail: single-node models in the tradition of Hodgkin–Huxley are paired with cable descriptions of the auditory nerve fiber. No singular model has emerged as a frontrunner to the field; rather, parameter sets deriving from the channel kinetics and morphologies of numerous organisms (mammalian and otherwise) are combined and tuned to foster strong agreement with response properties observed in vivo, such as refractoriness, summation, and strength–duration relationships. Recently, biophysical models of the electrically stimulated auditory nerve have begun to incorporate adaptation and stochastic mechanisms, in order to better realize the goal of predicting realistic neural responses to a wide array of stimuli. [ABSTRACT FROM PUBLISHER]

Optogenetics has become a key tool for understanding the function of neural circuits and controlling their behavior. An array of directly light driven opsins have been genetically isolated from several families of organisms, with a wide range of temporal and spectral properties. In order to characterize, understand and apply these opsins, we present an integrated suite of open-source, multi-scale computational tools called PyRhO. The purpose of developing PyRhO is three-fold: (i) to characterize new (and existing) opsins by automatically fitting a minimal set of experimental data to three-, four-, or six-state kinetic models, (ii) to simulate these models at the channel, neuron and network levels, and (iii) provide functional insights through model selection and virtual experiments in silico. The module is written in Python with an additional IPython/Jupyter notebook based GUI, allowing models to be fit, simulations to be run and results to be shared through simply interacting with a webpage. The seamless integration of model fitting algorithms with simulation environments (including NEURON and Brian2) for these virtual opsins will enable neuroscientists to gain a comprehensive understanding of their behavior and rapidly identify the most suitable variant for application in a particular biological system. This process may thereby guide not only experimental design and opsin choice but also alterations of the opsin genetic code in a neuro-engineering feed-back loop. In this way, we expect PyRhO will help to significantly advance optogenetics as a tool for transforming biological sciences. [ABSTRACT FROM AUTHOR]

We present an example of an anthropomorphic approach, in which auditory-based cues are combined with temporal correlation to implement a source separation system. The auditory features are based on spectral amplitude modulation and energy information obtained through 256 cochlear filters. Segmentation and binding of auditory objects are performed with a two-layered spiking neural network. The first layer performs the segmentation of the auditory images into objects, while the second layer binds the auditory objects belonging to the same source. The binding is further used to generate a mask (binary gain) to suppress the undesired sources from the original signal. Results are presented for a double-voiced (2 speakers) speech segment and for sentences corrupted with different noise sources. Comparative results are also given using PESQ (perceptual evaluation of speech quality) scores. The spiking neural network is fully adaptive and unsupervised.

NEVESIM is a software package for event-driven simulation of networks of spiking neurons with a fast simulation core in C++, and a scripting user interface in the Python programming language. It supports simulation of heterogeneous networks with different types of neurons and synapses, and can be easily extended by the user with new neuron and synapse types. To enable heterogeneous networks and extensibility, NEVESIM is designed to decouple the simulation logic of communicating events (spikes) between the neurons at a network level from the implementation of the internal dynamics of individual neurons. In this paper we will present the simulation framework of NEVESIM, its concepts and features, as well as some aspects of the object-oriented design approaches and simulation strategies that were utilized to efficiently implement the concepts and functionalities of the framework. We will also give an overview of the Python user interface, its basic commands and constructs, and also discuss the benefits of integrating NEVESIM with Python. One of the valuable capabilities of the simulator is to simulate exactly and efficiently networks of stochastic spiking neurons from the recently developed theoretical framework of neural sampling. This functionality was implemented as an extension on top of the basic NEVESIM framework. Altogether, the intended purpose of the NEVESIM framework is to provide a basis for further extensions that support simulation of various neural network models incorporating different neuron and synapse types that can potentially also use different simulation strategies.

The ability to learn and perform statistical inference with biologically plausible recurrent network of spiking neurons is an important step towards understanding perception and reasoning. Here we derive and investigate a new learning rule for recurrent spiking networks with hidden neurons, combining principles from variational learning and reinforcement learning. Our network defines a generative model over spike train histories and the derived learning rule has the form of a local Spike Timing Dependent Plasticity rule modulated by global factors (neuromodulators) conveying information about ``novelty on a statistically rigorous ground.Simulations show that our model is able to learn bothstationary and non-stationary patterns of spike trains.We also propose one experiment that could potentially be performed with animals in order to test the dynamics of the predicted novelty signal.

Patterns of synaptic connectivity in various regions of the brain are characterized by the presence of synaptic motifs, defined as unidirectional and bidirectional synaptic contacts that follow a particular configuration and link together small groups of neurons. Recent computational work proposes that a relay network (two populations communicating via a third, relay population of neurons) can generate precise patterns of neural synchronization. Here, we employ two distinct models of neuronal dynamics and show that simulated neural circuits designed in this way are caught in a global attractor of activity that prevents neurons from modulating their response on the basis of incoming stimuli. To circumvent the emergence of a fixed global attractor, we propose a mechanism of selective gain inhibition that promotes flexible responses to external stimuli. We suggest that local neuronal circuits may employ this mechanism to generate precise patterns of neural synchronization whose transient nature delimits the occurrence of a brief stimulus.

Behavioral and neuroscientific data on reward-based decision making point to a fundamental distinction between habitual and goaldirected action selection. The formation of habits, which requires simple updating of cached values, has been studied in great detail, and the reward prediction error theory of dopamine function has enjoyed prominent success in accounting for its neural bases. In contrast, the neural circuit mechanisms of goal-directed decision making, requiring extended iterative computations to estimate values online, are still unknown. Here we present a spiking neural network that provably solves the difficult online value estimation problem underlying goal-directed decision making in a near-optimal way and reproduces behavioral as well as neurophysiological experimental data on tasks ranging from simple binary choice to sequential decision making. Our model uses local plasticity rules to learn the synaptic weights of a simple neural network to achieve optimal performance and solves one-step decision-making tasks, commonly considered in neuroeconomics, as well as more challenging sequential decision-making tasks within 1 s. These decision times, and their parametric dependence on task parameters, as well as the final choice probabilities match behavioral data, whereas the evolution of neural activities in the network closely mimics neural responses recorded in frontal cortices during the execution of such tasks. Our theory provides a principled framework to understand the neural underpinning of goal-directed decision making and makes novel predictions for sequential decision-making tasks with multiple rewards. [ABSTRACT FROM AUTHOR]

This review provides a high-level synthesis of significant recent advances in artificial neural network research, as well as multi-disciplinary concepts connected to the far-reaching goal of obtaining intelligent systems. We assume that a global outlook of these interconnected fields can benefit researchers by providing alternative viewpoints. Therefore, we present different network and neuron models, we discuss model parameters and the means to obtain them, and we draw a quick outline of information encoding, before proceeding to an overview of the relevant learning mechanisms, ranging from established approaches to novel ideas. We specifically focus on comparing the classical artificial model with the biologically-feasible spiking neuron, and we take this comparison further into a discussion on the biological plausibility of various learning approaches. [ABSTRACT FROM AUTHOR]

Learning and reproducing temporal sequences is a fundamental ability used by living beings to adapt behaviour repertoire to environmental constraints. This paper is focused on the description of a model based on spiking neurons, able to learn and autonomously generate a sequence of events. The neural architecture is inspired by the insect Mushroom Bodies (MBs) that are a crucial centre for multimodal sensory integration and behaviour modulation. The sequence learning capability coexists, within the insect brain computational model, with all the other features already addressed like attention, expectation, learning classification and others. This is a clear example that a unique neural structure is able to cope concurrently with a plethora of behaviours. Simulation results and robotic experiments are reported and discussed. [ABSTRACT FROM AUTHOR]

We introduce a spiking neural network of the basal ganglia capable of learning stimulus–action associations. We model learning in the three major basal ganglia pathways, direct, indirect and hyperdirect, by spike time dependent learning and considering the amount of dopamine available (reward). Moreover, we allow to learn a cortico-thalamic pathway that bypasses the basal ganglia. As a result the system develops new functionalities for the different basal ganglia pathways: The direct pathway selects actions by disinhibiting the thalamus, the hyperdirect one suppresses alternatives and the indirect pathway learns to inhibit common mistakes. Numerical experiments show that the system is capable of learning sets of either deterministic or stochastic rules. [ABSTRACT FROM AUTHOR]

Bio-inspired neural computation attracts a lot of attention as a possible solution for the future challenges in designing computational resources. Dynamic neural fields (DNF) provide cortically inspired models of neural populations to which computation can be applied for a wide variety of tasks, such as perception and sensorimotor control. DNFs are often derived from continuous neural field theory (CNFT). In spite of the parallel structure and regularity of CNFT models, few studies of hardware implementations have been carried out targeting embedded real-time processing. In this article, a hardware-friendly model adapted from the CNFT is introduced, namely the RSDNF model (randomly spiking dynamic neural fields). Thanks to their simplified 2D structure, RSDNFs achieve scalable parallel implementations on digital hardware while maintaining the behavioral properties of CNFT models. Spike-based computations within neurons in the field are introduced to reduce interneuron connection bandwidth. Additionally, local stochastic spike propagation ensures inhibition and excitation broadcast without a fully connected network. The behavioral soundness and robustness of the model in the presence of noise and distracters is fully validated through software and hardware. A field programmable gate array (FPGA) implementation shows how the RSDNF model ensures a level of density and scalability out of reach for previous hardware implementations of dynamic neural field models. [ABSTRACT FROM AUTHOR]

Spiking neuron models can accurately predict the response of neurons to somatically injected currents if the model parameters are carefully tuned. Predicting the response of in-vivo neurons responding to natural stimuli presents a far more challenging modeling problem. In this study, an algorithm is presented for parameter estimation of spiking neuron models. The algorithm is a hybrid evolutionary algorithm which uses a spike train metric as a fitness function. We apply this to parameter discovery in modeling two experimental data sets with spiking neurons; in-vitro current injection responses from a regular spiking pyramidal neuron are modeled using spiking neurons and in-vivo extracellular auditory data is modeled using a two stage model consisting of a stimulus filter and spiking neuron model. [ABSTRACT FROM AUTHOR]

Our eyes never remain still. Even when we stare at a fixed point, small involuntary movements take place in our eyes in an imperceptible manner. Researchers agree on the presence of three main contributions to eye movements when we fix the gaze: microsaccades , drifts and tremor . These small movements carry the image across the retina stimulating the photoreceptors and thus avoiding fading. Nowadays it is commonly accepted that these movements can improve the discrimination performance of the retina. In this paper, several retina models with and without fixational eye movements were implemented by mean of RetinaStudio tool to test the feasibility of these models to be incorporated in future neuroprostheses. For this purpose each retina model has been stimulated with natural scene images in two experiments. Results are discussed from the point of view of a neuroprosthesis development. [ABSTRACT FROM AUTHOR]

Pattern formation, i.e., the generation of an inhomogeneous spatial activity distribution in a dynamical system with translation invariant structure, is a well-studied phenomenon in neuronal network dynamics,specifically in neural field models. These are population models to describe the spatio-temporal dynamics of large groups of neurons in terms of macroscopic variables such as population firing rates. Though neural field models are often deduced from and equipped with biophysically meaningfulproperties, a direct mapping to simulations of individual spiking neuron populations is rarely considered. Neurons have a distinct identity defined by their action on their postsynaptic targets. In its simplest form they act either excitatorily or inhibitorily.When the distribution of neuron identities is assumed to be periodic, pattern formation can be observed, given the coupling strength is supercritical, i.e., larger than a critical weight. We find that this critical weight is strongly dependent on the characteristics of the neuronal input, i.e., depends on whether neurons are mean- orfluctuation driven, and different limits in linearizing the full non-linear system apply in order to assess stability.In particular, if neurons are mean-driven, the linearization has a very simple form and becomesindependent of both the fixed point firing rate and the variance of the input current, while in the very strongly fluctuation-driven regime the fixed point rate, as well as the input mean and variance areimportant parameters in the determination of the critical weight.We demonstrate that interestingly even in ``intermediate'' regimes, when the system is technically fluctuation-driven, the simple linearization neglecting the variance of the input can yield the better prediction of the critical couplingstrength. We moreover analyze the effects of structural randomness by rewiring individualsynapses or redistributing weights, as well as coarse-graining on pattern formation.

Emerging technologies are revealing the spiking activity in ever larger neural ensembles. Frequently, this spiking is far from independent, with correlations in the spike times of different cells. Understanding how such correlations impact the dynamics and function of neural ensembles remains an important open problem.Here we describe a new, generative model for correlated spike trains that can exhibit many of the features observed in data. Extending prior work in mathematical finance, this generalized thinning and shift (GTaS) model creates marginally Poisson spike trains with diverse temporal correlation structures.We give several examples which highlight the model's flexibility and utility. For instance, we use it to examine how a neural network responds to highly structured patterns of inputs.We then show that the GTaS model is analytically tractable, and derive cumulant densities of all orders in terms of model parameters. The GTaS framework can therefore be an important tool in the experimental and theoretical exploration of neural dynamics.

Efficient path planning and navigation is critical for animals, robotics, logistics and transportation. We study a model in which spatial navigation problems can rapidly be solved in the brain by parallel mental exploration of alternative routes using propagating waves of neural activity. A wave of spiking activity propagates through a hippocampus-like network, altering the synaptic connectivity. The resulting vector field of synaptic change then guides a simulated animal to the appropriate selected target locations. We demonstrate that the navigation problem can be solved using realistic, local synaptic plasticity rules during a single passage of a wavefront. Our model can find optimal solutions for competing possible targets or learn and navigate in multiple environments. The model provides a hypothesis on the possible computational mechanisms for optimal path planning in the brain, at the same time it is useful for neuromorphic implementations, where the parallelism of information processing proposed here can fully be harnessed in hardware.

In the context of the modeling and simulation of neural nets, we formulate definitions for the behavioral realization of memoryless functions. The definitions of realization are substantively different for deterministic and stochastic systems constructed of neuron-inspired components. In contrast to earlier generations of neural net models, third generation spiking neural nets exhibit important temporal and dynamic properties, and random neural nets provide alternative probabilistic approaches. Our definitions of realization are based on the Discrete Event System Specification (DEVS) formalism that fundamentally include temporal and probabilistic characteristics of neuron system inputs, state, and outputs. The realizations that we construct—in particular for the Exclusive Or (XOR) logic gate—provide insight into the temporal and probabilistic characteristics that real neural systems might display. Our results provide a solid system-theoretical foundation and simulation modeling framework for the high-performance computational support of such applications.

We present an FPGA implementation of a re-configurable, polychronous spiking neural network with a large capacity for spatial-temporal patterns. The proposed neural network generates delay paths de novo, so that only connections that actually appear in the training patterns will be created. This allows the proposed network to use all the axons (variables) to store information. Spike Timing Dependent Delay Plasticity is used to fine-tune and add dynamics to the network. We use a time-multiplexing approach allowing us to achieve 4096 (4k) neurons and up to 1.15 million programmable delay axons on a Virtex 6 FPGA. The testing results show that the proposed neural network is capable of successfully recalling more than 95% of all spikes for 96% of the stored patterns. The tests also show that the neural network is robust to noise from random input spikes.

The state space of a conventional Hopfield network typically exhibits many different attractors of which only a small subset satisfies constraints between neurons in a globally optimal fashion. It has recently been demonstrated that combining Hebbian learning with occasional alterations of normal neural states avoids this problem by means of self-organized enlargement of the best basins of attraction. However, so far it is not clear to what extent this process of self-optimization is also operative in real brains. Here we demonstrate that it can be transferred to more biologically plausible neural networks by implementing a self-optimizing spiking neural network model. In addition, by using this spiking neural network to emulate a Hopfield network with Hebbian learning, we attempt to make a connection between rate-based and temporal coding based neural systems. Although further work is required to make this model more realistic, it already suggests that the efficacy of the self-optimizing process is independent from the simplifying assumptions of a conventional Hopfield network. We also discuss natural and cultural processes that could be responsible for occasional alteration of neural firing patterns in actual brains. [ABSTRACT FROM AUTHOR]

In this paper, we study the optimal control of phase models for spiking neuron oscillators. We focus on the design of minimum-power current stimuli that elicit spikes of neurons at specified times, subject to the charge-balance constraint. Such charge-balanced controls, in practice, are used to suppress undesirable side effects occurred due to the accumulation of electric charge resulting from the applied external stimuli. We derive charge-balanced minimum-power controls for a general phase model using the maximum principle, where the cases with unbounded and bounded control amplitude are examined. The latter is of fundamental importance because phase models are valid under weak forcing. The developed optimal control strategies are applied to both mathematically ideal and experimentally observed phase models to demonstrate their applicability, including the widely studied Hodgkin–Huxley model. [ABSTRACT FROM AUTHOR]

In this work, we propose a new approximation method to perform error backpropagation in a quantron network while avoiding the silent neuron problem that usually affects networks of realistic neurons. In our experiments, we train quantron networks to solve the XOR problem and other nonlinear classification problems. We achieve this while using less parameters than the number necessary to solve the same problems with networks of perceptrons or spiking neurons. [ABSTRACT FROM AUTHOR]

Anaesthetic agents are known to affect extra-synaptic GABAergic receptors, which induce tonic inhibitory currents. Since these receptors are very sensitive to small concentrations of agents, they are supposed to play an important role in the underlying neural mechanism of general anaesthesia. Moreover anaesthetic agents modulate the encephalographic activity (EEG) of subjects and hence show an effect on neural populations. To understand better the tonic inhibition effect in single neurons on neural populations and hence how it affects the EEG, the work considers single neurons and neural populations in a steady-state and studies numerically and analytically the modulation of their firing rate and nonlinear gain with respect to different levels of tonic inhibition. We consider populations of both type-I (Leaky Integrate-and-Fire model) and type-II (Morris-Lecar model) neurons. To bridge the single neuron description to the population description analytically, a recently proposed statistical approach is employed which allows to derive new analytical expressions for the population firing rate for type-I neurons. In addition, the work shows the derivation of a novel transfer function for type-I neurons as considered in neural mass models and studies briefly the interaction of synaptic and extra-synaptic inhibition. We reveal a strong subtractive and divisive effect of tonic inhibition in type-I neurons, i.e. a shift of the firing rate to higher excitation levels accompanied by a change of the nonlinear gain. Tonic inhibition shortens the excitation window of type-II neurons and their populations while maintaining the nonlinear gain. The gained results are interpreted in the context of recent experimental findings under propofol-induced anaesthesia. [ABSTRACT FROM AUTHOR]

A novel online learning algorithm for Spiking Neural Networks (SNNs) with dynamically adaptive structure is presented. The main contribution of this work lies in the fact that the proposed adaptive SNN is able to classify spike-based spatio-temporal inputs after just one presentation of the training set, i.e. in one pass only, and does not require the entire training set to be available at once. Both the structure and weights of the SNN are learned dynamically through a combination of unsupervised and supervised learning paradigms. The proposed feed-forward SNN consists of three layers of spiking neurons: an input layer which temporally encodes real valued features into spike-based spatio-temporal patterns, a hidden layer of dynamically grown and pruned neurons which perform spatio-temporal clustering, and an output layer for classification. An unsupervised spiking-based clustering algorithm is implemented by the hidden layer whose spiking neurons are trained to compute a temporal Radial Basis Function (RBF) where incoming inputs will selectively activate hidden neurons based on how close the inputs are to the preferred inputs of the hidden neurons. The centre of each hidden RBF spiking neuron is represented by its time to first spike. In addition, a growing and pruning strategy is proposed to adjust the structure of the hidden layer 'on-the-fly' as inputs are presented to the SNN. Both the weights and the centres of the hidden RBF neurons are learned in an unsupervised way and classification at the output layer is achieved through supervised learning where the learning windows proposed for STDP and anti-STDP are used to adjust the weights of the output neurons afferent connections. Competition at both the hidden and the output layers is achieved through the use of lateral inhibitory connections between the neurons of each layer. The proposed online learning algorithm is validated on several benchmark datasets. The evaluation results demonstrate that SNNs trained with the proposed approach require only one pass through the training set in order to classify the inputs with comparable accuracies to existing SNN-based approaches as well as traditional representative classifiers. [ABSTRACT FROM AUTHOR]

This study presents energy and area‐efficient hardware architectures to map fully parallel cortical columns on reconfigurable platform – field programmable gate arrays (FPGAs). An area‐efficient architecture is proposed at the system level and benchmarked with a speech recognition application. Owing to the spatio‐temporal nature of spiking neurons it is more suitable to map such architectures on FPGAs where signals can be represented in binary form and communication can be performed through the use of spikes. The viability of implementing multiple recurrent neural reservoirs is demonstrated with a novel multiplier‐less reconfigurable architectures and a design strategy is devised for its implementation. [ABSTRACT FROM AUTHOR]

Information processing in the brain results from the spread and interaction of electrical and chemical signals among neurons. The Hodgkin-Huxley model, describes the spiking and refractory properties of real neurons and serves as a paradigm based on nonlinear conductance of ion channels. Activation of various ion channels establish the spiking behavior of a neuron which determines the communication and coding in nervous system. Firing rates, timing of spikes, and spiking threshold properties are major firing properties of neuronal sparking activities. The temperature influence on neuron spiking threshold regulates the neuronal activities as electrophysiological experiments on neural spiking actions are rarely conducted outside of room temperature in vitro or body temperature in vivo. Temperature changes affect the spiking dynamics of excitable neurons via maximum ion channel conductances and ion channel gating kinetics. The latter has a major impact on changing the shape and amplitude of action potential as well as the generation and propagation of spikes. The purpose of this research is to study, simulate and analyze how the temperature change influence spiking properties of a neuron, channel kinetics as well as activation and inactivation variables of the potassium and sodium channels which determine the dynamics of Hodgkin-Huxley model. [ABSTRACT FROM AUTHOR]