-
Multitask Extension of Geometrically Aligned Transfer Encoder
Authors:
Sung Moon Ko,
Sumin Lee,
Dae-Woong Jeong,
Hyunseung Kim,
Chanhui Lee,
Soorin Yim,
Sehui Han
Abstract:
Molecular datasets often suffer from a lack of data. It is well-known that gathering data is difficult due to the complexity of experimentation or simulation involved. Here, we leverage mutual information across different tasks in molecular data to address this issue. We extend an algorithm that utilizes the geometric characteristics of the encoding space, known as the Geometrically Aligned Transf…
▽ More
Molecular datasets often suffer from a lack of data. It is well-known that gathering data is difficult due to the complexity of experimentation or simulation involved. Here, we leverage mutual information across different tasks in molecular data to address this issue. We extend an algorithm that utilizes the geometric characteristics of the encoding space, known as the Geometrically Aligned Transfer Encoder (GATE), to a multi-task setup. Thus, we connect multiple molecular tasks by aligning the curved coordinates onto locally flat coordinates, ensuring the flow of information from source tasks to support performance on target data.
△ Less
Submitted 3 May, 2024;
originally announced May 2024.
-
Simplified calcium signaling cascade for synaptic plasticity
Authors:
Vladimir Kornijcuk,
Dohun Kim,
Guhyun Kim,
Doo Seok Jeong
Abstract:
We propose a model for synaptic plasticity based on a calcium signaling cascade. The model simplifies the full signaling pathways from a calcium influx to the phosphorylation (potentiation) and dephosphorylation (depression) of glutamate receptors that are gated by fictive C1 and C2 catalysts, respectively. This model is based on tangible chemical reactions, including fictive catalysts, for long-t…
▽ More
We propose a model for synaptic plasticity based on a calcium signaling cascade. The model simplifies the full signaling pathways from a calcium influx to the phosphorylation (potentiation) and dephosphorylation (depression) of glutamate receptors that are gated by fictive C1 and C2 catalysts, respectively. This model is based on tangible chemical reactions, including fictive catalysts, for long-term plasticity rather than the conceptual theories commonplace in various models, such as preset thresholds of calcium concentration. Our simplified model successfully reproduced the experimental synaptic plasticity induced by different protocols such as (i) a synchronous pairing protocol and (ii) correlated presynaptic and postsynaptic action potentials (APs). Further, the ocular dominance plasticity (or the experimental verification of the celebrated Bienenstock--Cooper--Munro theory) was reproduced by two model synapses that compete by means of back-propagating APs (bAPs). The key to this competition is synapse-specific bAPs with reference to bAP-boosting on the physiological grounds.
△ Less
Submitted 25 November, 2019;
originally announced November 2019.
-
Accurate Protein Structure Prediction by Embeddings and Deep Learning Representations
Authors:
Iddo Drori,
Darshan Thaker,
Arjun Srivatsa,
Daniel Jeong,
Yueqi Wang,
Linyong Nan,
Fan Wu,
Dimitri Leggas,
Jinhao Lei,
Weiyi Lu,
Weilong Fu,
Yuan Gao,
Sashank Karri,
Anand Kannan,
Antonio Moretti,
Mohammed AlQuraishi,
Chen Keasar,
Itsik Pe'er
Abstract:
Proteins are the major building blocks of life, and actuators of almost all chemical and biophysical events in living organisms. Their native structures in turn enable their biological functions which have a fundamental role in drug design. This motivates predicting the structure of a protein from its sequence of amino acids, a fundamental problem in computational biology. In this work, we demonst…
▽ More
Proteins are the major building blocks of life, and actuators of almost all chemical and biophysical events in living organisms. Their native structures in turn enable their biological functions which have a fundamental role in drug design. This motivates predicting the structure of a protein from its sequence of amino acids, a fundamental problem in computational biology. In this work, we demonstrate state-of-the-art protein structure prediction (PSP) results using embeddings and deep learning models for prediction of backbone atom distance matrices and torsion angles. We recover 3D coordinates of backbone atoms and reconstruct full atom protein by optimization. We create a new gold standard dataset of proteins which is comprehensive and easy to use. Our dataset consists of amino acid sequences, Q8 secondary structures, position specific scoring matrices, multiple sequence alignment co-evolutionary features, backbone atom distance matrices, torsion angles, and 3D coordinates. We evaluate the quality of our structure prediction by RMSD on the latest Critical Assessment of Techniques for Protein Structure Prediction (CASP) test data and demonstrate competitive results with the winning teams and AlphaFold in CASP13 and supersede the results of the winning teams in CASP12. We make our data, models, and code publicly available.
△ Less
Submitted 8 November, 2019;
originally announced November 2019.
-
Tutorial: Neuromorphic spiking neural networks for temporal learning
Authors:
Doo Seok Jeong
Abstract:
Spiking neural networks (SNN) as time-dependent hypotheses consisting of spiking nodes (neurons) and directed edges (synapses) are believed to offer unique solutions to reward prediction tasks and the related feedback that are classified as reinforcement learning. Generally, temporal difference (TD) learning renders it possible to optimize a model network to predict the delayed reward in an ad hoc…
▽ More
Spiking neural networks (SNN) as time-dependent hypotheses consisting of spiking nodes (neurons) and directed edges (synapses) are believed to offer unique solutions to reward prediction tasks and the related feedback that are classified as reinforcement learning. Generally, temporal difference (TD) learning renders it possible to optimize a model network to predict the delayed reward in an ad hoc manner. Neuromorphic SNNs--networks built using dedicated hardware--particularly leverage such TD learning for not only reward prediction but also temporal sequence prediction in a physical time domain. In this tutorial, such learning in a physical time domain is referred to as temporal learning to distinguish it from conventional TD learning-based methods that generally involve algorithmic (rather than physical) time. This tutorial addresses neuromorphic SNNs for temporal learning from the scratch. It first concerns general characteristics of SNNs including spiking neurons and information coding schemes and then moves on to temporal learning including its general concept, feasible algorithms, and their association with neurophysiological learning rules that have intensively been enriched for the last few decades.
△ Less
Submitted 11 September, 2018;
originally announced September 2018.
