Showing 1–28 of 28 results for author: Koulakov, A

A normative theory of social conflict

Authors: Sergey Shuvaev, Evgeny Amelchenko, Dmitry Smagin, Natalia Kudryavtseva, Grigori Enikolopov, Alexei Koulakov

Abstract: Social hierarchy in animal groups carries a crucial adaptive function by reducing conflict and injury while protecting valuable group resources. Social hierarchy is dynamic and can be altered by social conflict, agonistic interactions, and aggression. Understanding social conflict and aggressive behavior is of profound importance to our society and welfare. In this study, we developed a quantitati… ▽ More Social hierarchy in animal groups carries a crucial adaptive function by reducing conflict and injury while protecting valuable group resources. Social hierarchy is dynamic and can be altered by social conflict, agonistic interactions, and aggression. Understanding social conflict and aggressive behavior is of profound importance to our society and welfare. In this study, we developed a quantitative theory of social conflict. We modeled individual agonistic interactions as a normal-form game between two agents. We assumed that the agents use Bayesian inference to update their beliefs about their strength or their opponent's strength and to derive optimal actions. We compared the results of our model to behavioral and whole-brain neural activity data obtained for a large (n=116) population of mice engaged in agonistic interactions. We find that both types of data are consistent with the first-level Theory of Mind model (1-ToM) in which mice form both "primary" beliefs about their and their opponent's strengths as well as the "secondary" beliefs about the beliefs of their opponents. Our model helps identify brain regions that carry information about these levels of beliefs. Overall, we both propose a model to describe agonistic interactions and support our quantitative results with behavioral and neural activity data. △ Less

Submitted 26 April, 2023; v1 submitted 7 March, 2023; originally announced March 2023.

Toward Next-Generation Artificial Intelligence: Catalyzing the NeuroAI Revolution

Authors: Anthony Zador, Sean Escola, Blake Richards, Bence Ölveczky, Yoshua Bengio, Kwabena Boahen, Matthew Botvinick, Dmitri Chklovskii, Anne Churchland, Claudia Clopath, James DiCarlo, Surya Ganguli, Jeff Hawkins, Konrad Koerding, Alexei Koulakov, Yann LeCun, Timothy Lillicrap, Adam Marblestone, Bruno Olshausen, Alexandre Pouget, Cristina Savin, Terrence Sejnowski, Eero Simoncelli, Sara Solla, David Sussillo , et al. (2 additional authors not shown)

Abstract: Neuroscience has long been an essential driver of progress in artificial intelligence (AI). We propose that to accelerate progress in AI, we must invest in fundamental research in NeuroAI. A core component of this is the embodied Turing test, which challenges AI animal models to interact with the sensorimotor world at skill levels akin to their living counterparts. The embodied Turing test shifts… ▽ More Neuroscience has long been an essential driver of progress in artificial intelligence (AI). We propose that to accelerate progress in AI, we must invest in fundamental research in NeuroAI. A core component of this is the embodied Turing test, which challenges AI animal models to interact with the sensorimotor world at skill levels akin to their living counterparts. The embodied Turing test shifts the focus from those capabilities like game playing and language that are especially well-developed or uniquely human to those capabilities, inherited from over 500 million years of evolution, that are shared with all animals. Building models that can pass the embodied Turing test will provide a roadmap for the next generation of AI. △ Less

Submitted 22 February, 2023; v1 submitted 15 October, 2022; originally announced October 2022.

Comments: White paper, 10 pages + 8 pages of references, 1 figures

Neural networks with motivation

Authors: Sergey A. Shuvaev, Ngoc B. Tran, Marcus Stephenson-Jones, Bo Li, Alexei A. Koulakov

Abstract: How can animals behave effectively in conditions involving different motivational contexts? Here, we propose how reinforcement learning neural networks can learn optimal behavior for dynamically changing motivational salience vectors. First, we show that Q-learning neural networks with motivation can navigate in environment with dynamic rewards. Second, we show that such networks can learn complex… ▽ More How can animals behave effectively in conditions involving different motivational contexts? Here, we propose how reinforcement learning neural networks can learn optimal behavior for dynamically changing motivational salience vectors. First, we show that Q-learning neural networks with motivation can navigate in environment with dynamic rewards. Second, we show that such networks can learn complex behaviors simultaneously directed towards several goals distributed in an environment. Finally, we show that in Pavlovian conditioning task, the responses of the neurons in our model resemble the firing patterns of neurons in the ventral pallidum (VP), a basal ganglia structure involved in motivated behaviors. We show that, similarly to real neurons, recurrent networks with motivation are composed of two oppositely-tuned classes of neurons, responding to positive and negative rewards. Our model generates predictions for the VP connectivity. We conclude that networks with motivation can rapidly adapt their behavior to varying conditions without changes in synaptic strength when expected reward is modulated by motivation. Such networks may also provide a mechanism for how hierarchical reinforcement learning is implemented in the brain. △ Less

Submitted 18 November, 2019; v1 submitted 22 June, 2019; originally announced June 2019.

Comments: Added the Methods section

Representations of Sound in Deep Learning of Audio Features from Music

Authors: Sergey Shuvaev, Hamza Giaffar, Alexei A. Koulakov

Abstract: The work of a single musician, group or composer can vary widely in terms of musical style. Indeed, different stylistic elements, from performance medium and rhythm to harmony and texture, are typically exploited and developed across an artist's lifetime. Yet, there is often a discernable character to the work of, for instance, individual composers at the perceptual level - an experienced listener… ▽ More The work of a single musician, group or composer can vary widely in terms of musical style. Indeed, different stylistic elements, from performance medium and rhythm to harmony and texture, are typically exploited and developed across an artist's lifetime. Yet, there is often a discernable character to the work of, for instance, individual composers at the perceptual level - an experienced listener can often pick up on subtle clues in the music to identify the composer or performer. Here we suggest that a convolutional network may learn these subtle clues or features given an appropriate representation of the music. In this paper, we apply a deep convolutional neural network to a large audio dataset and empirically evaluate its performance on audio classification tasks. Our trained network demonstrates accurate performance on such classification tasks when presented with 5 s examples of music obtained by simple transformations of the raw audio waveform. A particularly interesting example is the spectral representation of music obtained by application of a logarithmically spaced filter bank, mirroring the early stages of auditory signal transduction in mammals. The most successful representation of music to facilitate discrimination was obtained via a random matrix transform (RMT). Networks based on logarithmic filter banks and RMT were able to correctly guess the one composer out of 31 possibilities in 68 and 84 percent of cases respectively. △ Less

Submitted 7 December, 2017; originally announced December 2017.

Constructing an olfactory perceptual space and predicting percepts from molecular structure

Authors: Daniel Kepple, Alexei Koulakov

Abstract: Given the structure of a novel molecule, there is still no one who can reliably predict what odor percept that molecule will evoke. The challenge comes from both the difficulty in quantitatively characterizing molecular structure, and the inadequacy of language to fully characterize olfactory perception. Here, we present a novel approach to both problems. Given the structure of a novel molecule, there is still no one who can reliably predict what odor percept that molecule will evoke. The challenge comes from both the difficulty in quantitatively characterizing molecular structure, and the inadequacy of language to fully characterize olfactory perception. Here, we present a novel approach to both problems. △ Less

Submitted 6 June, 2018; v1 submitted 18 August, 2017; originally announced August 2017.

Network cloning using DNA barcodes

Authors: Sergey A. Shuvaev, Batuhan Başerdem, Anthony Zador, Alexei A. Koulakov

Abstract: The ability to measure or manipulate network connectivity is the main challenge in the field of connectomics. Recently, a set of approaches has been developed that takes advantage of next generation DNA sequencing to scan connections between neurons into a set of DNA barcodes. Individual DNA sequences called markers represent single neurons, while pairs of markers, called barcodes contain informat… ▽ More The ability to measure or manipulate network connectivity is the main challenge in the field of connectomics. Recently, a set of approaches has been developed that takes advantage of next generation DNA sequencing to scan connections between neurons into a set of DNA barcodes. Individual DNA sequences called markers represent single neurons, while pairs of markers, called barcodes contain information about connections. Here we propose a strategy for 'copying' or 'cloning' connectivity contained in barcodes into a clean slate tabula rasa network. We show that a one marker one cell (OMOC) rule, which forces all markers with the same sequence to condense into the same neuron, leads to fast and reliable formation of desired connectivity in a new network. We show that OMOC rule yields convergence in a number of steps given by a power law function of the network size. We thus propose that copying network connectivity from one network to another is theoretically possible. △ Less

Submitted 2 November, 2016; originally announced November 2016.

Comments: 5 pages, 3 figures

Deconstructing Odorant Identity via Primacy in Dual Networks

Authors: Daniel Kepple, Hamza Giaffar, Dmitry Rinberg, Alexei Koulakov

Abstract: In the olfactory system, odor percepts retain their identity despite substantial variations in concentration, timing, and background. We propose a novel strategy for encoding intensity-invariant stimuli identity that is based on representing relative rather than absolute values of the stimulus features. Because, in this scheme, stimulus identity depends on relative amplitudes of stimulus features,… ▽ More In the olfactory system, odor percepts retain their identity despite substantial variations in concentration, timing, and background. We propose a novel strategy for encoding intensity-invariant stimuli identity that is based on representing relative rather than absolute values of the stimulus features. Because, in this scheme, stimulus identity depends on relative amplitudes of stimulus features, identity becomes invariant with respect to variations in intensity and monotonous non-linearities of neuronal responses. In the olfactory system, stimulus identity can be represented by the identities of the p strongest responding odorant receptor types out of a species dependent complement. We show that this information is sufficient to recover sparse stimuli (odorants) via elastic net loss minimization. Such a minimization has to be performed under constraints imposed by the relationships between stimulus features. We map this problem onto the dual problem of minimizing a functional of Lagrange multipliers. The dual problem, in turn, can be solved by a neural network whose Lyapunov function represents the dual Lagrangian. We thus propose that networks in the piriform cortex compute odorant identity and implement dual computations with the sparse activities of individual neurons representing the Lagrange multipliers. △ Less

Submitted 7 September, 2016; originally announced September 2016.

Comments: 10 pages, 1 figure

Statistical model of evolution of brain parcellation

Authors: Daniel D. Ferrante, Yi Wei, Alexei A. Koulakov

Abstract: We study the distribution of brain and cortical area sizes [parcellation units (PUs)] obtained for three species: mouse, macaque, and human. We find that the distribution of PU sizes is close to lognormal. We analyze the mathematical model of evolution of brain parcellation based on iterative fragmentation and specialization. In this model, each existing PU has a probability to be split that depen… ▽ More We study the distribution of brain and cortical area sizes [parcellation units (PUs)] obtained for three species: mouse, macaque, and human. We find that the distribution of PU sizes is close to lognormal. We analyze the mathematical model of evolution of brain parcellation based on iterative fragmentation and specialization. In this model, each existing PU has a probability to be split that depends on PU size only. This model shows that the same evolutionary process may have led to brain parcellation in these three species. Our model suggests that region-to-region (macro) connectivity is given by the outer product form. We show that most experimental data on non-vanishing macaque cortex macroconnectivity (62% for area V1) can be explained by the outer product power-law form suggested by our model. We propose a multiplicative Hebbian learning rule for the macroconnectome that could yield the correct scaling of connection strengths between areas. We thus propose a universal evolutionary model that may have contributed to both brain parcellation and mesoscopic level connectivity in mammals. △ Less

Submitted 1 December, 2014; originally announced December 2014.

Comments: 9 pages, plenty of pictures

Odors in olfactory bulb are defined by a short discrete temporal sequence: recognition by brute-force conversion to a spatial pattern (chunking)

Authors: Honi Sanders, Brian Kolterman, Roman Shusterman, Dmitry Rinberg, Alexei A. Koulakov, John Lisman

Abstract: Mitral cells, the principal neurons in the olfactory bulb, respond to odorants by firing bursts of action potentials called sharp events. A given cell produces a sharp event at a fixed phase during the sniff cycle in response to a given odor; different cells have different phases. The olfactory bulb response to an odor is thus a sequence of sharp events. Here, we show that sharp event onset is bia… ▽ More Mitral cells, the principal neurons in the olfactory bulb, respond to odorants by firing bursts of action potentials called sharp events. A given cell produces a sharp event at a fixed phase during the sniff cycle in response to a given odor; different cells have different phases. The olfactory bulb response to an odor is thus a sequence of sharp events. Here, we show that sharp event onset is biased toward certain phases of the ongoing gamma frequency oscillation. Thus, the signature of an odor is a discrete sequence. The fact that this sequence is relatively short suggests a new class of "brute force" solutions to the problem of odor recognition: cortex may contain a small number of modules, each forming a persistent snapshot of what occurs in a certain gamma cycle. Towards the end of the sniff, the collection of these snapshots forms a spatial pattern that could be recognized by standard attractor-based network mechanisms. We demonstrate the feasibility of this solution with simulations of simple network architectures having modules that represent gamma-cycle specific information. Thus "brute force" solutions for converting a discrete temporal sequence into a spatial pattern (chunking) are neurally plausible. △ Less

Submitted 1 July, 2014; v1 submitted 21 May, 2014; originally announced May 2014.

Long-term memory stabilized by noise-induced rehearsal

Authors: Yi Wei, Alexei A. Koulakov

Abstract: Cortical networks can maintain memories for decades despite the short lifetime of synaptic strength. Can a neural network store long-lasting memories in unstable synapses? Here, we study the effects of random noise on the stability of memory stored in synapses of an attractor neural network. The model includes ongoing spike timing dependent plasticity (STDP). We show that certain classes of STDP r… ▽ More Cortical networks can maintain memories for decades despite the short lifetime of synaptic strength. Can a neural network store long-lasting memories in unstable synapses? Here, we study the effects of random noise on the stability of memory stored in synapses of an attractor neural network. The model includes ongoing spike timing dependent plasticity (STDP). We show that certain classes of STDP rules can lead to the stabilization of memory patterns stored in the network. The stabilization results from rehearsals induced by noise. We show that unstructured neural noise, after passing through the recurrent network weights, carries the imprint of all memory patterns in temporal correlations. Under certain conditions, STDP combined with these correlations, can lead to reinforcement of all existing patterns, even those that are never explicitly visited. Thus, unstructured neural noise can stabilize the existing structure of synaptic connectivity. Our findings may provide the functional reason for highly irregular spiking displayed by cortical neurons and provide justification for models of system memory consolidation. Therefore, we propose that irregular neural activity is the feature that helps cortical networks maintain stable connections. △ Less

Submitted 31 May, 2012; originally announced May 2012.

A race model for singular olfactory receptor expression

Authors: Brian E. Kolterman, Ivan Iossifov, Alexei A. Koulakov

Abstract: In vertebrates, olfactory sensory neurons choose only one olfactory receptor to produce out of ~2000 possibilities. The mechanism for how this singular receptor expression occurs is unknown. Here we propose a mechanism that can stochastically select a single gene out of a large number of possibilities. In this model, receptor genes compete for a limited pool of transcription factors (TFs). The gen… ▽ More In vertebrates, olfactory sensory neurons choose only one olfactory receptor to produce out of ~2000 possibilities. The mechanism for how this singular receptor expression occurs is unknown. Here we propose a mechanism that can stochastically select a single gene out of a large number of possibilities. In this model, receptor genes compete for a limited pool of transcription factors (TFs). The gene that recruits a target number of TFs is selected for expression. To support this mechanism, we have attempted to detect repeated motifs within known sequences of mouse olfactory receptor promoters. We find motifs that are significantly overrepresented in olfactory versus other gene promoters. We identify possible TFs that can target these motifs. Our model suggests that a small number of TFs can control the selection of a single gene out of ~2000 possibilities. △ Less

Submitted 13 January, 2012; originally announced January 2012.

The Problem of Colliding Networks and its Relation to Cancer

Authors: Alexei A. Koulakov, Yuri Lazebnik

Abstract: Complex systems, ranging from living cells to human societies, can be represented as attractor networks, whose basic property is to exist in one of allowed states, or attractors. We noted that merging two systems that are in distinct attractors creates uncertainty, as the hybrid system cannot assume two attractors at once. As a prototype of this problem, we explore cell fusion, whose ability to co… ▽ More Complex systems, ranging from living cells to human societies, can be represented as attractor networks, whose basic property is to exist in one of allowed states, or attractors. We noted that merging two systems that are in distinct attractors creates uncertainty, as the hybrid system cannot assume two attractors at once. As a prototype of this problem, we explore cell fusion, whose ability to combine distinct cells into hybrids was proposed to cause cancer. By simulating cell types as attractors, we find that hybrids are prone to assume spurious attractors, which are emergent and sporadic states of networks, and propose that cell fusion can make a cell cancerous by placing it into normally inaccessible spurious states. We define basic features of hybrid networks and suggest that the problem of colliding networks has general significance in processes represented by attractor networks, including biological, social, and political phenomena. △ Less

Submitted 13 January, 2012; originally announced January 2012.

An Exactly Solvable Model of Random Site-Specific Recombinations

Authors: Yi Wei, Alexei Koulakov

Abstract: Cre-lox and other systems are used as genetic tools to control site-specific recombination (SSR) events in genomic DNA. If multiple recombination sites are organized in a compact cluster within the same genome, a series of random recombination events may generate substantial cell specific genomic diversity. This diversity is used, for example, to distinguish neurons in the brain of the same multic… ▽ More Cre-lox and other systems are used as genetic tools to control site-specific recombination (SSR) events in genomic DNA. If multiple recombination sites are organized in a compact cluster within the same genome, a series of random recombination events may generate substantial cell specific genomic diversity. This diversity is used, for example, to distinguish neurons in the brain of the same multicellular mosaic organism, within the brainbow approach to neuronal connectome. In this paper we study an exactly solvable statistical model for SSR operating on a cluster of recombination sites. We consider two types of recombination events: inversions and excisions. Both of these events are available in the Cre-lox system. We derive three properties of the sequences generated by multiple recombination events. First, we describe the set of sequences that can in principle be generated by multiple inversions operating on the given initial sequence. We call this description the ergodicity theorem. On the basis of this description we calculate the number of sequences that can be generated from an initial sequence. This number of sequences is experimentally testable. Second, we demonstrate that after a large number of random inversions every sequence that can be generated is generated with equal probability. Lastly, we derive the equations for the probability to find a sequence as a function of time in the limit when excisions are much less frequent than inversions, such as in shufflon sequences. △ Less

Submitted 26 June, 2014; v1 submitted 23 December, 2011; originally announced December 2011.

Journal ref: Bulletin of Mathematical Biology, Volume 74, Issue 12, pp 2897-2916, December 2012

Sparse incomplete representations: A novel role for olfactory granule cells

Authors: Alexei A. Koulakov, Dmitry Rinberg

Abstract: Mitral cells of the olfactory bulb form sparse representations of the odorants and transmit this information to the cortex. The olfactory code carried by the mitral cells is sparser than the inputs that they receive. In this study we analyze the mechanisms and functional significance of sparse olfactory codes. We consider a model of olfactory bulb containing populations of excitatory mitral and… ▽ More Mitral cells of the olfactory bulb form sparse representations of the odorants and transmit this information to the cortex. The olfactory code carried by the mitral cells is sparser than the inputs that they receive. In this study we analyze the mechanisms and functional significance of sparse olfactory codes. We consider a model of olfactory bulb containing populations of excitatory mitral and inhibitory granule cells. We argue that sparse codes may emerge as a result of self organization in the network leading to the precise balance between mitral cells' excitatory inputs and inhibition provided by the granule cells. We propose a novel role for the olfactory granule cells. We show that these cells can build representations of odorant stimuli that are not fully accurate. Due to the incompleteness in the granule cell representation, the exact excitation-inhibition balance is established only for some mitral cells leading to sparse responses of the mitral cell. Our model suggests a functional significance to the dendrodendritic synapses that mediate interactions between mitral and granule cells. The model accounts for the sparse olfactory code in the steady state and predicts that transient dynamics may be less sparse. △ Less

Submitted 25 February, 2010; originally announced February 2010.

On the scaling law for cortical magnification factor

Authors: Alexei A. Koulakov

Abstract: Primate visual system samples different parts of the world unevenly. The part of the visual scene corresponding to the eye center is represented densely, while away from the center the sampling becomes progressively sparser. Such distribution allows a more effective use of the limited transfer rate of the optic nerve, since animals can aim area centralis (AC) at the relevant position in the scen… ▽ More Primate visual system samples different parts of the world unevenly. The part of the visual scene corresponding to the eye center is represented densely, while away from the center the sampling becomes progressively sparser. Such distribution allows a more effective use of the limited transfer rate of the optic nerve, since animals can aim area centralis (AC) at the relevant position in the scene by performing saccadic eye movements. To locate a new saccade target the animal has to sample the corresponding region of the visual scene, away from AC. In this work we derive the sampling density away from AC, which optimizes the trajectory of saccadic eye movements. We obtain the scaling law for the sampling density as a function of eccentricity, which results from the evolutionary pressure to locate the target in the shortest time under the constraint of limited transfer rate of the optic nerve. In case of very small AC the visual scene is optimally represented by logarithmic conformal mapping, in which geometrically similar circular bands around AC are equally represented by the visual system. We also obtain corrections to the logarithmic scaling for the case of a larger AC and compare them to experimental findings. △ Less

Submitted 23 February, 2010; originally announced February 2010.

The structure of human olfactory space

Authors: Alexei A. Koulakov, Armen G. Enikolopov, Dmitry Rinberg

Abstract: We analyze the psychophysical responses of human observers to an ensemble of monomolecular odorants. Each odorant is characterized by a set of 146 perceptual descriptors obtained from a database of odor character profiles. Each odorant is therefore represented by a point in highly multidimensional sensory space. In this work we study the arrangement of odorants in this perceptual space. We argue… ▽ More We analyze the psychophysical responses of human observers to an ensemble of monomolecular odorants. Each odorant is characterized by a set of 146 perceptual descriptors obtained from a database of odor character profiles. Each odorant is therefore represented by a point in highly multidimensional sensory space. In this work we study the arrangement of odorants in this perceptual space. We argue that odorants densely sample a two-dimensional curved surface embedded in the multidimensional sensory space. This surface can account for more than half of the variance of the psychophysical data. We also show that only 12 percent of experimental variance cannot be explained by curved surfaces of substantially small dimensionality (<10). We suggest that these curved manifolds represent the relevant spaces sampled by the human olfactory system, thereby providing surrogates for olfactory sensory space. For the case of 2D approximation, we relate the two parameters on the curved surface to the physico-chemical parameters of odorant molecules. We show that one of the dimensions is related to eigenvalues of the molecule connectivity matrix, while the other is correlated with measures of the molecule polarity. We discuss the behavioral significance of these findings. △ Less

Submitted 23 July, 2009; originally announced July 2009.

Comments: 7 pages, 4 figures, 1 table. Includes Supplementary Material

Correlated connectivity and the distribution of firing rates in the neocortex

Authors: Alexei Koulakov, Tomas Hromadka, Anthony M. Zador

Abstract: Two recent experimental observations pose a challenge to many cortical models. First, the activity in the auditory cortex is sparse, and firing rates can be described by a lognormal distribution. Second, the distribution of non-zero synaptic strengths between nearby cortical neurons can also be described by a lognormal distribution. Here we use a simple model of cortical activity to reconcile th… ▽ More Two recent experimental observations pose a challenge to many cortical models. First, the activity in the auditory cortex is sparse, and firing rates can be described by a lognormal distribution. Second, the distribution of non-zero synaptic strengths between nearby cortical neurons can also be described by a lognormal distribution. Here we use a simple model of cortical activity to reconcile these observations. The model makes the experimentally testable prediction that synaptic efficacies onto a given cortical neuron are statistically correlated, i.e. it predicts that some neurons receive many more strong connections than other neurons. We propose a simple Hebb-like learning rule which gives rise to both lognormal firing rates and synaptic efficacies. Our results represent a first step toward reconciling sparse activity and sparse connectivity in cortical networks. △ Less

Submitted 9 September, 2008; originally announced September 2008.

Optimal axonal and dendritic branching strategies during the development of neural circuitry

Authors: Dmitry Tsigankov, Alexei Koulakov

Abstract: In developing brain, axons and dendrites are capable of connecting to each other with high precision. Recent advances in imaging have allowed for the monitoring of axonal, dendritic, and synapse dynamics in vivo. It is observed that the majority of axonal and dendritic branches are formed 'in error', only to be retracted later. The functional significance of the overproduction of branches is not… ▽ More In developing brain, axons and dendrites are capable of connecting to each other with high precision. Recent advances in imaging have allowed for the monitoring of axonal, dendritic, and synapse dynamics in vivo. It is observed that the majority of axonal and dendritic branches are formed 'in error', only to be retracted later. The functional significance of the overproduction of branches is not clear. In this study, we use a computational model to investigate the speed and efficiency of different branching strategies. We show that branching itself allows for substantial acceleration in the identification of appropriate targets through the use of a parallel search. We also show that the formation of new branches in the vicinity of existing synapses leads to the formation of target connectivity with a decreased number of erroneous branches. This finding allows us to explain the high correlation between the branch points and synapses observed in the Xenopus laevis retinotectal system. We also suggest that the most efficient branching rule is different for axons and dendrites. The optimal axonal strategy is to form new branches in the vicinity of existing synapses, whereas the optimal rule for dendrites is to form new branches preferentially in the vicinity of synapses with correlated pre- and postsynaptic electric activity. Thus, our studies suggest that the developing neural system employs a set of sophisticated computational strategies that facilitate the formation of required circuitry, so that it may proceed in the fastest and most frugal way. △ Less

Submitted 5 April, 2008; originally announced April 2008.

Comments: 13 pages

Sperry versus Hebb: Topographic mapping in Isl2/EphA3 mutant mice

Authors: Dmitry Tsigankov, Alexei Koulakov

Abstract: In wild-type mice axons of retinal ganglion cells establish topographically precise projection to the superior colliculus of the midbrain. This implies that axons of neighboring retinal ganglion cells project to the proximal locations in the target. The precision of topographic projection is a result of combined effects of molecular labels, such as Eph receptors and ephrins, and correlated elect… ▽ More In wild-type mice axons of retinal ganglion cells establish topographically precise projection to the superior colliculus of the midbrain. This implies that axons of neighboring retinal ganglion cells project to the proximal locations in the target. The precision of topographic projection is a result of combined effects of molecular labels, such as Eph receptors and ephrins, and correlated electric activity. In the Isl2/EphA3 mutant mice the expression levels of molecular labels is changed. As a result the topographic projection is rewired so that the neighborhood relationships between retinal cell axons are disrupted. Here we argue that the effects of correlated activity presenting themselves in the form of Hebbian learning rules can facilitate the restoration of the topographic connectivity even when the molecular labels carry conflicting instructions. This occurs because the correlations in electric activity carry information about retinal cells' spatial location that is independent on molecular labels. We argue therefore that experiments in Isl2/EphA3 knock-in mice directly test the interaction between effects of molecular labels and correlated activity during the development of neural connectivity. △ Less

Submitted 13 February, 2008; originally announced February 2008.

Comments: 13 pages, 6 figures

Neural integrator - a sandpile model

Authors: Maxim Nikitchenko, Alexei Koulakov

Abstract: We investigated a model for the neural integrator based on hysteretic units connected by positive feedback. Hysteresis is assumed to emerge from the intrinsic properties of the cells. We consider the recurrent networks containing either bistable or multistable neurons. We apply our analysis to the oculomotor velocity-to-position neural integrator that calculates the eye positions from the inputs… ▽ More We investigated a model for the neural integrator based on hysteretic units connected by positive feedback. Hysteresis is assumed to emerge from the intrinsic properties of the cells. We consider the recurrent networks containing either bistable or multistable neurons. We apply our analysis to the oculomotor velocity-to-position neural integrator that calculates the eye positions from the inputs that carry information about eye angular velocity. Using the analysis of the system in the parameter space we show the following. The direction of hysteresis in the neuronal response may be reversed for the system with recurrent connections compared to the case of unconnected neurons. Thus, for the NMDA receptor based bistability the firing rates after ON saccades may be higher than after OFF saccades for the same eye position. We suggest that this is an emergent property due to the presence of global recurrent feedback. The reversal of hysteresis occurs only when the size of hysteresis differs from neuron to neuron. We also relate the macroscopic leak time-constant of the integrator to the rate of microscopic spontaneous noise-driven transitions in the hysteretic units. Finally, we argue that the presence of neurons with small hysteresis may remove the threshold for integration. △ Less

Submitted 23 May, 2006; originally announced May 2006.

Combinatorial on/off Model for Olfactory Coding

Authors: A. Koulakov, A. Gelperin, D. Rinberg

Abstract: We present a model for olfactory coding based on spatial representation of glomerular responses. In this model distinct odorants activate specific subsets of glomeruli, dependent upon the odorant's chemical identity and concentration. The glomerular response specificities are understood statistically, based on experimentally measured distributions of detection thresholds. A simple version of the… ▽ More We present a model for olfactory coding based on spatial representation of glomerular responses. In this model distinct odorants activate specific subsets of glomeruli, dependent upon the odorant's chemical identity and concentration. The glomerular response specificities are understood statistically, based on experimentally measured distributions of detection thresholds. A simple version of the model, in which glomerular responses are binary (the on/off model), allows us to account quantitatively for the following results of human/rodent olfactory psychophysics: 1) just noticeable differences in the perceived concentration of a single odor (Weber ratios) are dC/C ~ 0.04; 2) the number of simultaneously perceived odors can be as high as 12; 3) extensive lesions of the olfactory bulb do not lead to significant changes in detection or discrimination thresholds. We conclude that a combinatorial code based on a binary glomerular response is sufficient to account for the discrimination capacity of the mammalian olfactory system. △ Less

Submitted 19 April, 2006; originally announced April 2006.

Complete structure of topographic maps in ephrin-A deficient mice

Authors: D. N. Tsigankov, A. A. Koulakov

Abstract: Axons of retinal ganglion cells establish orderly projections to the superior colliculus of the midbrain. Axons of neighboring cells terminate proximally in the superior colliculus thus forming a topographically precise representation of the visual world. Coordinate axes are encoded in retina and in the target through graded expression of chemical labels. Mapping based on chemical labels alone d… ▽ More Axons of retinal ganglion cells establish orderly projections to the superior colliculus of the midbrain. Axons of neighboring cells terminate proximally in the superior colliculus thus forming a topographically precise representation of the visual world. Coordinate axes are encoded in retina and in the target through graded expression of chemical labels. Mapping based on chemical labels alone does not yield required specificity of connections. Additional sharpening is provided by electrical activity, which is correlated between neighboring axons. Here we propose a quantitative model which allows combining the effects of chemical labels and correlated activity in a single approach. Using this model we study a complete structure of two-dimensional topographic maps in mutant mice, in which one of the labels, encoding horizontal retinal coordinate (ephrin-A), is reduced/eliminated. We show that topographic maps in ephrin-A deficient mice display granular structure, with the regions of smooth mapping separated by linear discontinuities reminiscent of fractures observed in the maps of preferred orientation. We also demonstrate the presence of point singularities in topographic maps. △ Less

Submitted 1 March, 2005; v1 submitted 28 February, 2005; originally announced March 2005.

Comments: 8 pages 5 figures

Can repulsion be induced by attraction: a role of ephrin-B1 in retinotectal mapping?

Authors: Dmitry N. Tsigankov, Alexei A. Koulakov

Abstract: We study a role of EphB receptors and their ligand ephrin-B1 in dorsal-ventral retinotopic mapping. Earlier studies suggested that ephrin-B1 acts as an attractant for EphB expressing axons. We address the results of the recent experiment in chick tectum (McLaughlin et al., 2003b) in which axons of retinal ganglion cells were shown to be repelled by high ephrin-B1 density. Thus it was proposed th… ▽ More We study a role of EphB receptors and their ligand ephrin-B1 in dorsal-ventral retinotopic mapping. Earlier studies suggested that ephrin-B1 acts as an attractant for EphB expressing axons. We address the results of the recent experiment in chick tectum (McLaughlin et al., 2003b) in which axons of retinal ganglion cells were shown to be repelled by high ephrin-B1 density. Thus it was proposed that ephrin-B1 might act as both attractant and repellent. We show that the same axonal behavior may follow from attraction to ephrin-B1 density and axonal competition for space. Therefore, we show how apparent repulsive interaction can be induced by a combination of attraction to the target and competitive interactions between axons. We suggest an experimental test that may distinguish repulsive interaction with the target from repulsion induced by attraction and competition. △ Less

Submitted 11 March, 2004; originally announced March 2004.

Comments: 4 pages

How to find decision makers in neural circuits?

Authors: Alexei A. Koulakov, Dmitry Rinberg, Dmitry N. Tsigankov

Abstract: Neural circuits often face the problem of classifying stimuli into discrete groups and making decisions based on such classifications. Neurons of these circuits can be distinguished according to their correlations with different features of stimulus or response, which allows defining sensory or motor neuronal types. In this study we define the third class of neurons, which is responsible for mak… ▽ More Neural circuits often face the problem of classifying stimuli into discrete groups and making decisions based on such classifications. Neurons of these circuits can be distinguished according to their correlations with different features of stimulus or response, which allows defining sensory or motor neuronal types. In this study we define the third class of neurons, which is responsible for making decision. We suggest two descriptions for contribution of units to decision making: first, as a spatial derivative of correlations between neural activity and the decision; second, as an impact of variability in a given neuron on the response. These two definitions are shown to be equivalent, when they can be compared. We also suggest an experimental strategy for determining contributions to decision making, which uses electric stimulation with time- varying random current. △ Less

Submitted 5 January, 2004; originally announced January 2004.

Comments: 14 Figures

Ocular dominance patterns and the wire length minimization: a numerical study

Authors: Alexei A. Koulakov, Dmitri B. Chklovskii

Abstract: We study a mathematical model for ocular dominance patterns (ODPs) in primary visual cortex. This model is based on the premise that ODP is an adaptation to minimize the length of intra-cortical wiring. Thus we attempt to understand the existing ODPs by solving a wire length minimization problem. We divide all the neurons into two classes: left- and right-eye dominated. We find that segregation… ▽ More We study a mathematical model for ocular dominance patterns (ODPs) in primary visual cortex. This model is based on the premise that ODP is an adaptation to minimize the length of intra-cortical wiring. Thus we attempt to understand the existing ODPs by solving a wire length minimization problem. We divide all the neurons into two classes: left- and right-eye dominated. We find that segregation of neurons into monocular regions reduces wire length if the number of connections to the neurons of the same class (intraocular) differs from the number of interocular connections. The shape of the regions depends on the relative fraction of neurons in the two classes. We find that if both classes are almost equally represented, the optimal ODP consists of interdigitating stripes. If one class is less numerous than the other, the optimal ODP consists of patches of the less abundant class surrounded by the neurons of the other class. We predict that the transition from stripes to patches occurs when the fraction of neurons dominated by the underrepresented eye is about 40%. This prediction agrees with the data in macaque and Cebus monkeys. We also study the dependence of the periodicity of ODP on the parameters of our model. △ Less

Submitted 19 November, 2003; originally announced November 2003.

A stochastic model for retinocollicular map development

Authors: Alexei A. Koulakov, Dmitry N. Tsigankov

Abstract: We present a theoretical model for retinocollicular map development, which can account for intriguing behaviors observed in gain-of-function experiments in knock-in mice by Brown et al., including bifurcation in heterozygous Isl2/EphA3 knock-ins. The model is based on known chemical labels, axonal repulsion/competition, stochasticity and uses Markov chain description. Our model suggests that the… ▽ More We present a theoretical model for retinocollicular map development, which can account for intriguing behaviors observed in gain-of-function experiments in knock-in mice by Brown et al., including bifurcation in heterozygous Isl2/EphA3 knock-ins. The model is based on known chemical labels, axonal repulsion/competition, stochasticity and uses Markov chain description. Our model suggests that the map in heterozygotes is single-valued in the temporal region of retina due to reduced gradient of ephrin in the corresponding region of SC. The remaining map is double-valued since the gradient of ephrin is high there. We predict therefore that if gradient of ephrin is reduced by a genetic manipulation, the single-valued region of the map should occupy a larger portion of temporal retina, i.e. the point of transition between single- and doulble-valued maps should move to a more nasal position in Isl2-EphA3 heterozygotes. We also discuss the importance of inhomogeneous EphA gradient and mapping in Isl2/EphB knock-ins. △ Less

Submitted 22 July, 2003; originally announced July 2003.

Comments: 19 pages, 11 color figures

Instantons in the working memory: implications for schizophrenia

Authors: Alexei A. Koulakov

Abstract: The influence of the synaptic channel properties on the stability of delayed activity maintained by recurrent neural network is studied. The duration of excitatory post-synaptic current (EPSC) is shown to be essential for the global stability of the delayed response. NMDA receptor channel is a much more reliable mediator of the reverberating activity than AMPA receptor, due to a longer EPSC. Thi… ▽ More The influence of the synaptic channel properties on the stability of delayed activity maintained by recurrent neural network is studied. The duration of excitatory post-synaptic current (EPSC) is shown to be essential for the global stability of the delayed response. NMDA receptor channel is a much more reliable mediator of the reverberating activity than AMPA receptor, due to a longer EPSC. This allows to interpret the deterioration of working memory observed in the NMDA channel blockade experiments. The key mechanism leading to the decay of the delayed activity originates in the unreliability of the synaptic transmission. The optimum fluctuation of the synaptic conductances leading to the decay is identified. The decay time is calculated analytically and the result is confirmed computationally. △ Less

Submitted 2 November, 1999; originally announced November 1999.

Ocular dominance patterns in mammalian visual cortex: A wire length minimization approach

Authors: Dmitri B. Chklovskii, Alexei A. Koulakov

Abstract: We propose a theory for ocular dominance (OD) patterns in mammalian primary visual cortex. This theory is based on the premise that OD pattern is an adaptation to minimize the length of intra-cortical wiring. Thus we can understand the existing OD patterns by solving a wire length minimization problem. We divide all the neurons into two classes: left-eye dominated and right-eye dominated. We fin… ▽ More We propose a theory for ocular dominance (OD) patterns in mammalian primary visual cortex. This theory is based on the premise that OD pattern is an adaptation to minimize the length of intra-cortical wiring. Thus we can understand the existing OD patterns by solving a wire length minimization problem. We divide all the neurons into two classes: left-eye dominated and right-eye dominated. We find that segregation of neurons into monocular regions reduces wire length if the number of connections with the neurons of the same class differs from that with the other class. The shape of the regions depends on the relative fraction of neurons in the two classes. If the numbers are close we find that the optimal OD pattern consists of interdigitating stripes. If one class is less numerous than the other, the optimal OD pattern consists of patches of the first class neurons in the sea of the other class neurons. We predict the transition from stripes to patches when the fraction of neurons dominated by the ipsilateral eye is about 40%. This prediction agrees with the data in macaque and Cebus monkeys. This theory can be applied to other binary cortical systems. △ Less

Submitted 14 June, 1999; originally announced June 1999.

Comments: 9 pages, submitted to Journal of Neuroscience