-
Learning Nonlinear Brain Dynamics: van der Pol Meets LSTM
Authors:
German Abrevaya,
Irina Rish,
Aleksandr Y. Aravkin,
Guillermo Cecchi,
James Kozloski,
Pablo Polosecki,
Peng Zheng,
Silvina Ponce Dawson,
Juliana Rhee,
David Cox
Abstract:
Many real-world data sets, especially in biology, are produced by complex nonlinear dynamical systems. In this paper, we focus on brain calcium imaging (CaI) of different organisms (zebrafish and rat), aiming to build a model of joint activation dynamics in large neuronal populations, including the whole brain of zebrafish. We propose a new approach for capturing dynamics of temporal SVD component…
▽ More
Many real-world data sets, especially in biology, are produced by complex nonlinear dynamical systems. In this paper, we focus on brain calcium imaging (CaI) of different organisms (zebrafish and rat), aiming to build a model of joint activation dynamics in large neuronal populations, including the whole brain of zebrafish. We propose a new approach for capturing dynamics of temporal SVD components that uses the coupled (multivariate) van der Pol (VDP) oscillator, a nonlinear ordinary differential equation (ODE) model describing neural activity, with a new parameter estimation technique that combines variable projection optimization and stochastic search. We show that the approach successfully handles nonlinearities and hidden state variables in the coupled VDP. The approach is accurate, achieving 0.82 to 0.94 correlation between the actual and model-generated components, and interpretable, as VDP's coupling matrix reveals anatomically meaningful positive (excitatory) and negative (inhibitory) interactions across different brain subsystems corresponding to spatial SVD components. Moreover, VDP is comparable to (or sometimes better than) recurrent neural networks (LSTM) for (short-term) prediction of future brain activity; VDP needs less parameters to train, which was a plus on our small training data. Finally, the overall best predictive method, greatly outperforming both VDP and LSTM in short- and long-term predictive settings on both datasets, was the new hybrid VDP-LSTM approach that used VDP to simulate large domain-specific dataset for LSTM pretraining; note that simple LSTM data-augmentation via noisy versions of training data was much less effective.
△ Less
Submitted 20 July, 2019; v1 submitted 24 May, 2018;
originally announced May 2018.
-
Brain Model of Information Based Exchange
Authors:
James Kozloski
Abstract:
Here we describe an "information based exchange" model of brain function that ascribes to neocortex, basal ganglia, and thalamus distinct network functions. The model allows us to analyze whole brain system set point measures, such as the rate and heterogeneity of transitions in striatum and neocortex, in the context of disease perturbations. Our closed-loop model invokes different forms of plasti…
▽ More
Here we describe an "information based exchange" model of brain function that ascribes to neocortex, basal ganglia, and thalamus distinct network functions. The model allows us to analyze whole brain system set point measures, such as the rate and heterogeneity of transitions in striatum and neocortex, in the context of disease perturbations. Our closed-loop model invokes different forms of plasticity at specific tissue interfaces and their principle cell synapses to achieve these transitions. By modulating information based exchange of action potentials between modeled neocortical areas, we observe changes to these measures in simulation. We hypothesize that similar dynamic set points and modulations exist in the brain's resting state activity, and that germ line modifications of information based exchange may increase the risk of diseases such as Huntington's, Parkinson's, and Alzheimer's. Disturbances in synaptic plasticity at distinct tissue interfaces in the model may be used to estimate risks of system dysfunction and neuronal cell death from quantitative analyses of the global dynamics that maintain system set points. The model is targeted for further development using IBM's Neural Tissue Simulator, which allows scalable elaboration of networks, tissues, and their neural and synaptic components towards ever greater complexity and biological realism. Elaboration of these simulations within each modeled neural tissue allows in silico study of therapeutic interventions in living brain tissue.
△ Less
Submitted 15 September, 2015; v1 submitted 8 September, 2015;
originally announced September 2015.
-
Topological Effects of Synaptic Time Dependent Plasticity
Authors:
James R. Kozloski,
Guillermo A. Cecchi
Abstract:
We show that the local Spike Timing-Dependent Plasticity (STDP) rule has the effect of regulating the trans-synaptic weights of loops of any length within a simulated network of neurons. We show that depending on STDP's polarity, functional loops are formed or eliminated in networks driven to normal spiking conditions by random, partially correlated inputs, where functional loops comprise weights…
▽ More
We show that the local Spike Timing-Dependent Plasticity (STDP) rule has the effect of regulating the trans-synaptic weights of loops of any length within a simulated network of neurons. We show that depending on STDP's polarity, functional loops are formed or eliminated in networks driven to normal spiking conditions by random, partially correlated inputs, where functional loops comprise weights that exceed a non-zero threshold. We further prove that STDP is a form of loop-regulating plasticity for the case of a linear network comprising random weights drawn from certain distributions. Thus a notable local synaptic learning rule makes a specific prediction about synapses in the brain in which standard STDP is present: that under normal spiking conditions, they should participate in predominantly feed-forward connections at all scales. Our model implies that any deviations from this prediction would require a substantial modification to the hypothesized role for standard STDP. Given its widespread occurrence in the brain, we predict that STDP could also regulate long range synaptic loops among individual neurons across all brain scales, up to, and including, the scale of global brain network topology.
△ Less
Submitted 19 March, 2010; v1 submitted 30 September, 2008;
originally announced October 2008.
