Showing 201–250 of 508 results for author: Wen, Z

Value distribution of exponential polynomials and their role in the theories of complex differential equations and oscillation theory

Authors: Janne Heittokangas, Katsuya Ishizaki, Kazuya Tohge, Zhi-Tao Wen

Abstract: An exponential polynomial is a finite linear sum of terms $P(z)e^{Q(z)}$, where $P(z)$ and $Q(z)$ are polynomials. The early results on the value distribution of exponential polynomials can be traced back to Georg Pólya's paper published in 1920, while the latest results have come out in 2021. Despite of over a century of research work, many intriguing problems on value distribution of exponential… ▽ More An exponential polynomial is a finite linear sum of terms $P(z)e^{Q(z)}$, where $P(z)$ and $Q(z)$ are polynomials. The early results on the value distribution of exponential polynomials can be traced back to Georg Pólya's paper published in 1920, while the latest results have come out in 2021. Despite of over a century of research work, many intriguing problems on value distribution of exponential polynomials still remain unsolved. The role of exponential polynomials and their quotients in the theories of linear/non-linear differential equations, oscillation theory and differential-difference equations will also be discussed. Thirteen open problems are given to motivate the readers for further research in these topics. △ Less

Submitted 11 July, 2022; v1 submitted 3 February, 2022; originally announced February 2022.

Comments: 74 pages, 5 figures

MSC Class: Primary 30D15; 34M03; Secondary 30D35; 34A34; 34M10

Enhanced Tunnel magnetoresistance in Fe/Mg4Al-Ox/Fe(001) Magnetic Tunnel Junctions

Authors: Thomas Scheike, Zhenchao Wen, Hiroaki Sukegawa, Seiji Mitani

Abstract: Spinel MgAl2O4 and family oxides are emerging barrier materials useful for magnetic tunnel junctions (MTJs). We report large tunnel magnetoresistance (TMR) ratios up to 429% at room temperature (RT) and 1,034% at 10 K in a Fe/MgAl2O4/Fe(001)-based MTJ prepared using electron-beam evaporation of Mg4Al-Ox. Resistance oscillations with a MTJ barrier thickness of 0.3-nm were significantly enhanced com… ▽ More Spinel MgAl2O4 and family oxides are emerging barrier materials useful for magnetic tunnel junctions (MTJs). We report large tunnel magnetoresistance (TMR) ratios up to 429% at room temperature (RT) and 1,034% at 10 K in a Fe/MgAl2O4/Fe(001)-based MTJ prepared using electron-beam evaporation of Mg4Al-Ox. Resistance oscillations with a MTJ barrier thickness of 0.3-nm were significantly enhanced compared to those of a Fe/MgO/Fe(001) MTJ, resulting in a large TMR oscillation peak-to-valley difference of 125% at RT. The differential conductance spectra were symmetric with bias polarity, and the spectrum in the parallel magnetization state at low temperature demonstrate significant peaks within broad local minima at |0.2-0.6| V, indicating improved barrier interfaces by the Mg4Al-Ox barrier. This study demonstrates that TMR ratios in Fe(001)-MTJs can still be improved. △ Less

Submitted 18 December, 2021; originally announced December 2021.

Comments: 14 pages, 1 table, 4 figures

On the 2-binomial complexity of the generalized Thue-Morse words

Authors: Xiao-Tao Lü, Jin Chen, Zhi-Xiong Wen, Wen Wu

Abstract: In this paper, we study the $2$-binomial complexity $b_{\mathbf{t}_{m},2}(n)$ of the generalized Thue-Morse words $\mathbf{t}_{m}$ for every integer $m\geq 3$. We obtain the exact value of $b_{\mathbf{t}_{m},2}(n)$ for every integer $n\geq m^{2}$. As a consequence, $b_{\mathbf{t}_{m},2}(n)$ is ultimately periodic with period $m^{2}$. This result partially answers a question of M. Lejeune, J. Leroy… ▽ More In this paper, we study the $2$-binomial complexity $b_{\mathbf{t}_{m},2}(n)$ of the generalized Thue-Morse words $\mathbf{t}_{m}$ for every integer $m\geq 3$. We obtain the exact value of $b_{\mathbf{t}_{m},2}(n)$ for every integer $n\geq m^{2}$. As a consequence, $b_{\mathbf{t}_{m},2}(n)$ is ultimately periodic with period $m^{2}$. This result partially answers a question of M. Lejeune, J. Leroy and M. Rigo [Computing the $k$-binomial complexity of the Thue-Morse word, J. Comb. Theory Ser. A, {\bf 176} (2020) 105284]. △ Less

Submitted 10 December, 2021; originally announced December 2021.

Comments: 18 pages

The In-Flight Realtime Trigger and Localization Software of GECAM

Authors: Xiao-Yun Zhao, Shao-Lin Xiong, Xiang-Yang Wen, Xin-Qiao Li, Ce Cai, Shuo Xiao, Qi Luo, Wen-Xi Peng, Dong-Ya Guo, Zheng-Hua An, Ke Gong, Jin-Yuan Liao, Yan-Qiu Zhang, Yue Huang, Lu Li, Xing Wen, Fei Zhang, Jing Duan, Chen-Wei Wang, Dong-Li Shi, Peng Zhang, Qi-Bin Yi, Chao-Yang Li, Yan-Bing Xu, Xiao-Hua Liang , et al. (64 additional authors not shown)

Abstract: Realtime trigger and localization of bursts are the key functions of GECAM, which is an all-sky gamma-ray monitor launched in Dec 10, 2020. We developed a multifunctional trigger and localization software operating on the CPU of the GECAM electronic box (EBOX). This onboard software has the following features: high trigger efficiency for real celestial bursts with a suppression of false triggers c… ▽ More Realtime trigger and localization of bursts are the key functions of GECAM, which is an all-sky gamma-ray monitor launched in Dec 10, 2020. We developed a multifunctional trigger and localization software operating on the CPU of the GECAM electronic box (EBOX). This onboard software has the following features: high trigger efficiency for real celestial bursts with a suppression of false triggers caused by charged particle bursts and background fluctuation, dedicated localization algorithm optimized for short and long bursts respetively, short time latency of the trigger information which is downlinked throught the BeiDou satellite navigation System (BDS). This paper presents the detailed design and deveopment of this trigger and localization software system of GECAM, including the main functions, general design, workflow and algorithms, as well as the verification and demonstration of this software, including the on-ground trigger tests with simulated gamma-ray bursts made by a dedicated X-ray tube and the in-flight performance to real gamma-ray bursts and magnetar bursts. △ Less

Submitted 9 December, 2021; originally announced December 2021.

Comments: Draft, comments welcome

CA-SSL: Class-Agnostic Semi-Supervised Learning for Detection and Segmentation

Authors: Lu Qi, Jason Kuen, Zhe Lin, Jiuxiang Gu, Fengyun Rao, Dian Li, Weidong Guo, Zhen Wen, Ming-Hsuan Yang, Jiaya Jia

Abstract: To improve instance-level detection/segmentation performance, existing self-supervised and semi-supervised methods extract either task-unrelated or task-specific training signals from unlabeled data. We show that these two approaches, at the two extreme ends of the task-specificity spectrum, are suboptimal for the task performance. Utilizing too little task-specific training signals causes underfi… ▽ More To improve instance-level detection/segmentation performance, existing self-supervised and semi-supervised methods extract either task-unrelated or task-specific training signals from unlabeled data. We show that these two approaches, at the two extreme ends of the task-specificity spectrum, are suboptimal for the task performance. Utilizing too little task-specific training signals causes underfitting to the ground-truth labels of downstream tasks, while the opposite causes overfitting to the ground-truth labels. To this end, we propose a novel Class-Agnostic Semi-Supervised Learning (CA-SSL) framework to achieve a more favorable task-specificity balance in extracting training signals from unlabeled data. CA-SSL has three training stages that act on either ground-truth labels (labeled data) or pseudo labels (unlabeled data). This decoupling strategy avoids the complicated scheme in traditional SSL methods that balances the contributions from both data types. Especially, we introduce a warmup training stage to achieve a more optimal balance in task specificity by ignoring class information in the pseudo labels, while preserving localization training signals. As a result, our warmup model can better avoid underfitting/overfitting when fine-tuned on the ground-truth labels in detection and segmentation tasks. Using 3.6M unlabeled data, we achieve a significant performance gain of 4.7% over ImageNet-pretrained baseline on FCOS object detection. In addition, our warmup model demonstrates excellent transferability to other detection and segmentation frameworks. △ Less

Submitted 19 July, 2022; v1 submitted 9 December, 2021; originally announced December 2021.

Comments: Appeared in ECCV2022

Finite state automata and homeomorphism of self-similar sets

Authors: Liangyi Huang, Zhiying Wen, Yamin Yang, Yunjie Zhu

Abstract: The topological and metrical equivalence of fractals is an important topic in analysis. In this paper, we use a class of finite state automata, called $Σ$-automaton, to construct psuedo-metric spaces, and then apply them to the study of classification of self-similar sets. We first introduce a notion of topology automaton of a fractal gasket, which is a simplified version of neighbor automaton; we… ▽ More The topological and metrical equivalence of fractals is an important topic in analysis. In this paper, we use a class of finite state automata, called $Σ$-automaton, to construct psuedo-metric spaces, and then apply them to the study of classification of self-similar sets. We first introduce a notion of topology automaton of a fractal gasket, which is a simplified version of neighbor automaton; we show that a fractal gasket is homeomorphic to the psuedo-metric space induced by the topology automaton. Then we construct a universal map to show that psuedo-metric spaces induced by different automata can be bi-Lipschitz equivalent. As an application, we obtain a rather general sufficient condition for two fractal gaskets to be homeomorphic or Lipschitz equivalent. △ Less

Submitted 4 December, 2021; originally announced December 2021.

A Scheme of Channel Prediction Based on Artificial Neural Network

Authors: Zirui Wen, Ruisi He, Bo Ai, Chen Huang, Mi Yang, Zhangdui Zhong

Abstract: Accurate channel modeling is the foundation of communication system design. However, the traditional measurement-based modeling approach has increasing challenges for the scenarios with insufficient measurement data. To obtain enough data for channel modeling, the Artificial Neural Network (ANN) is used in this paper to predict channel data. The high mobility railway channel is considered, which i… ▽ More Accurate channel modeling is the foundation of communication system design. However, the traditional measurement-based modeling approach has increasing challenges for the scenarios with insufficient measurement data. To obtain enough data for channel modeling, the Artificial Neural Network (ANN) is used in this paper to predict channel data. The high mobility railway channel is considered, which is a typical scenario where it is challenging to obtain enough data for modeling within a short sampling interval. Three types of ANNs, the Back Propagation Network, Radial Basis Function Neural Network and Extreme Learning Machine, are considered to predict channel path loss and shadow fading. The Root-Mean-Square error is used to evaluate prediction accuracy. The factors that may influence prediction accuracy are compared and discussed, including the type of network, number of neurons and proportion of training data. It is found that a larger number of neurons can significantly reduce prediction error, whereas the influence of proportion of training data is relatively small. The results can be used to improve modeling accuracy of path loss and shadow fading when measurement data is reduced. △ Less

Submitted 1 December, 2021; v1 submitted 30 November, 2021; originally announced November 2021.

Dynamic Analysis of Nonlinear Civil Engineering Structures using Artificial Neural Network with Adaptive Training

Authors: Xiao Pan, Zhizhao Wen, T. Y. Yang

Abstract: Dynamic analysis of structures subjected to earthquake excitation is a time-consuming process, particularly in the case of extremely small time step required, or in the presence of high geometric and material nonlinearity. Performing parametric studies in such cases is even more tedious. The advancement of computer graphics hardware in recent years enables efficient training of artificial neural n… ▽ More Dynamic analysis of structures subjected to earthquake excitation is a time-consuming process, particularly in the case of extremely small time step required, or in the presence of high geometric and material nonlinearity. Performing parametric studies in such cases is even more tedious. The advancement of computer graphics hardware in recent years enables efficient training of artificial neural networks that are well-known to be capable of learning highly nonlinear mappings. In this study, artificial neural networks are developed with adaptive training algorithms, which enables automatic nodes generation and layers addition. The hyperbolic tangent function is selected as the activation function. Stochastic Gradient Descent and Back Propagation algorithms are adopted to train the networks. The neural networks initiate with a small number of hidden layers and nodes. During training, the performance of the network is continuously tracked, and new nodes or layers are added to the hidden layers if the neural network reaches its capacity. At the end of the training process, the network with appropriate architecture is automatically formed. The performance of the networks has been validated for inelastic shear frames, as well as rocking structures, of which both are first built in finite element program for dynamic analysis to generate training data. Results have shown the developed networks can successfully predict the time-history response of the shear frame and the rock structure subjected to real ground motion records. The efficiency of the proposed neural networks is also examined, which shows the computational time can be reduced by 43% by the neural networks method than FE models. This indicates the trained networks can be utilized to generate rocking spectrums of structures more efficiently which demands a large number of time-history analyses. △ Less

Submitted 21 November, 2021; originally announced November 2021.

Comments: 12 pages, 10 figures, accepted in the 17th World Conference on Earthquake Engineering, 17WCEE, Sendai, Japan, 2021

Report number: Report-no:9c-0025, 17 WCEE Proceedings

Box-counting measure of metric spaces

Authors: Liang-yi Huang, Hui Rao, Zhiying Wen, Yan-li Xu

Abstract: In this paper, we introduce a new notion called the \emph{box-counting measure} of a metric space. We show that for a doubling metric space, an Ahlfors regular measure is always a box-counting measure; consequently, if $E$ is a self-similar set satisfying the open set condition, then the Hausdorff measure restricted to $E$ is a box-counting measure. We show two classes of self-affine sets, the gen… ▽ More In this paper, we introduce a new notion called the \emph{box-counting measure} of a metric space. We show that for a doubling metric space, an Ahlfors regular measure is always a box-counting measure; consequently, if $E$ is a self-similar set satisfying the open set condition, then the Hausdorff measure restricted to $E$ is a box-counting measure. We show two classes of self-affine sets, the generalized Lalley-Gatzouras type self-affine sponges and Barański carpets, always admit box-counting measures; this also provides a very simple method to calculate the box-dimension of these fractals. Moreover, among others, we show that if two doubling metric spaces admit box-counting measures, then the multi-fractal spectra of the box-counting measures coincide provided the two spaces are Lipschitz equivalent. △ Less

Submitted 29 November, 2022; v1 submitted 1 November, 2021; originally announced November 2021.

Nulling and subpulse drifting in PSR J1727-2739

Authors: Rukiye Rejep, N. Wang, W. M. Yan, Z. G. Wen

Abstract: In this paper, we investigate the emission properties of PSR J1727-2739, whose mean pulse profile has two main components, by analysing five single-pulse observations made using the Parkes 64-m radio telescope with a central frequency of 1369 MHz between 2014 April and October. The total observation time is about 6.1 hours which contains 16718 pulses after removal of radio frequency interference (… ▽ More In this paper, we investigate the emission properties of PSR J1727-2739, whose mean pulse profile has two main components, by analysing five single-pulse observations made using the Parkes 64-m radio telescope with a central frequency of 1369 MHz between 2014 April and October. The total observation time is about 6.1 hours which contains 16718 pulses after removal of radio frequency interference (RFI). Previous studies reveal that PSR J1727-2739 exhibits both nulling and subpulse drifting. We estimate the nulling fraction to be 66%, which is consistent with previously published results. In addition to the previously known subpulse drifting in the leading component, we also explore the drifting properties for the trailing component. We observe two distinct drift modes whose vertical drift band separations ($P_{3}$) are consistent with earlier studies. We find that both profile components share the same drift periodicity $P_{3}$ in a certain drift mode, but the measured horizontal separations ($P_{2}$) are quite different for them. That is, PSR J1727-2739 is a pulsar showing both changes of drift periodicity $P_{3}$ between different drift modes and drift rate variations between components in a given drift mode. Pulsars exhibiting nulling along with drift mode changing, such as PSR J1727-2739, give an unique opportunity to investigate the physical mechanism of these phenomena. △ Less

Submitted 21 October, 2021; originally announced October 2021.

Comments: 10 pages, 15 figures

On the pure state $v$-representability of density matrix embedding theory

Authors: Fabian M. Faulstich, Raehyun Kim, Zhi-Hao Cui, Zaiwen Wen, Garnet Kin-Lic Chan, Lin Lin

Abstract: Density matrix embedding theory (DMET) formally requires the matching of density matrix blocks obtained from high-level and low-level theories, but this is sometimes not achievable in practical calculations. In such a case, the global band gap of the low-level theory vanishes, and this can require additional numerical considerations. We find that both the violation of the exact matching condition… ▽ More Density matrix embedding theory (DMET) formally requires the matching of density matrix blocks obtained from high-level and low-level theories, but this is sometimes not achievable in practical calculations. In such a case, the global band gap of the low-level theory vanishes, and this can require additional numerical considerations. We find that both the violation of the exact matching condition and the vanishing low-level gap are related to the assumption that the high-level density matrix blocks are non-interacting pure-state $v$-representable (NI-PS-V), which assumes that the low-level density matrix is constructed following the Aufbau principle. In order to relax the NI-PS-V condition, we develop an augmented Lagrangian method to match the density matrix blocks without referring to the Aufbau principle. Numerical results for 2D Hubbard and hydrogen model systems indicate that in some challenging scenarios, the relaxation of the Aufbau principle directly leads to exact matching of the density matrix blocks, which also yields improved accuracy. △ Less

Submitted 13 January, 2022; v1 submitted 18 October, 2021; originally announced October 2021.

TAG: Toward Accurate Social Media Content Tagging with a Concept Graph

Authors: Jiuding Yang, Weidong Guo, Bang Liu, Yakun Yu, Chaoyue Wang, Jinwen Luo, Linglong Kong, Di Niu, Zhen Wen

Abstract: Although conceptualization has been widely studied in semantics and knowledge representation, it is still challenging to find the most accurate concept phrases to characterize the main idea of a text snippet on the fast-growing social media. This is partly attributed to the fact that most knowledge bases contain general terms of the world, such as trees and cars, which do not have the defining pow… ▽ More Although conceptualization has been widely studied in semantics and knowledge representation, it is still challenging to find the most accurate concept phrases to characterize the main idea of a text snippet on the fast-growing social media. This is partly attributed to the fact that most knowledge bases contain general terms of the world, such as trees and cars, which do not have the defining power or are not interesting enough to social media app users. Another reason is that the intricacy of natural language allows the use of tense, negation and grammar to change the logic or emphasis of language, thus conveying completely different meanings. In this paper, we present TAG, a high-quality concept matching dataset consisting of 10,000 labeled pairs of fine-grained concepts and web-styled natural language sentences, mined from the open-domain social media. The concepts we consider represent the trending interests of online users. Associated with TAG is a concept graph of these fine-grained concepts and entities to provide the structural context information. We evaluate a wide range of popular neural text matching models as well as pre-trained language models on TAG, and point out their insufficiency to tag social media content with the most appropriate concept. We further propose a novel graph-graph matching method that demonstrates superior abstraction and generalization performance by better utilizing both the structural context in the concept graph and logic interactions between semantic units in the sentence via syntactic dependency parsing. We open-source both the TAG dataset and the proposed methods to facilitate further research. △ Less

Submitted 15 June, 2022; v1 submitted 13 October, 2021; originally announced October 2021.

Comments: Accepted by ACM SIGKDD 2022

The Neural Testbed: Evaluating Joint Predictions

Authors: Ian Osband, Zheng Wen, Seyed Mohammad Asghari, Vikranth Dwaracherla, Botao Hao, Morteza Ibrahimi, Dieterich Lawson, Xiuyuan Lu, Brendan O'Donoghue, Benjamin Van Roy

Abstract: Predictive distributions quantify uncertainties ignored by point estimates. This paper introduces The Neural Testbed: an open-source benchmark for controlled and principled evaluation of agents that generate such predictions. Crucially, the testbed assesses agents not only on the quality of their marginal predictions per input, but also on their joint predictions across many inputs. We evaluate a… ▽ More Predictive distributions quantify uncertainties ignored by point estimates. This paper introduces The Neural Testbed: an open-source benchmark for controlled and principled evaluation of agents that generate such predictions. Crucially, the testbed assesses agents not only on the quality of their marginal predictions per input, but also on their joint predictions across many inputs. We evaluate a range of agents using a simple neural network data generating process. Our results indicate that some popular Bayesian deep learning agents do not fare well with joint predictions, even when they can produce accurate marginal predictions. We also show that the quality of joint predictions drives performance in downstream decision tasks. We find these results are robust across choice a wide range of generative models, and highlight the practical importance of joint predictions to the community. △ Less

Submitted 1 November, 2022; v1 submitted 9 October, 2021; originally announced October 2021.

A Decomposition Augmented Lagrangian Method for Low-rank Semidefinite Programming

Authors: Yifei Wang, Kangkang Deng, Haoyang Liu, Zaiwen Wen

Abstract: We develop a decomposition method based on the augmented Lagrangian framework to solve a broad family of semidefinite programming problems, possibly with nonlinear objective functions, nonsmooth regularization, and general linear equality/inequality constraints. In particular, the positive semidefinite variable along with a group of linear constraints can be transformed into a variable on a smooth… ▽ More We develop a decomposition method based on the augmented Lagrangian framework to solve a broad family of semidefinite programming problems, possibly with nonlinear objective functions, nonsmooth regularization, and general linear equality/inequality constraints. In particular, the positive semidefinite variable along with a group of linear constraints can be transformed into a variable on a smooth manifold via matrix factorization. The nonsmooth regularization and other general linear constraints are handled by the augmented Lagrangian method. Therefore, each subproblem can be solved by a semismooth Newton method on a manifold. Theoretically, we show that the first and second-order necessary optimality conditions for the factorized subproblem are also sufficient for the original subproblem under certain conditions. Convergence analysis is established for the Riemannian subproblem and the augmented Lagrangian method. Extensive numerical experiments on large-scale semidefinite programming problems such as max-cut, nearest correlation estimation, clustering, and sparse principal component analysis demonstrate the strength of our proposed method compared to other state-of-the-art methods. △ Less

Submitted 7 March, 2023; v1 submitted 23 September, 2021; originally announced September 2021.

Comments: 29 pages, 4 figures, 6 tables

MSC Class: 90C06; 90C22; 90C26; 90C56

Distract Your Attention: Multi-head Cross Attention Network for Facial Expression Recognition

Authors: Zhengyao Wen, Wenzhong Lin, Tao Wang, Ge Xu

Abstract: We present a novel facial expression recognition network, called Distract your Attention Network (DAN). Our method is based on two key observations. Firstly, multiple classes share inherently similar underlying facial appearance, and their differences could be subtle. Secondly, facial expressions exhibit themselves through multiple facial regions simultaneously, and the recognition requires a holi… ▽ More We present a novel facial expression recognition network, called Distract your Attention Network (DAN). Our method is based on two key observations. Firstly, multiple classes share inherently similar underlying facial appearance, and their differences could be subtle. Secondly, facial expressions exhibit themselves through multiple facial regions simultaneously, and the recognition requires a holistic approach by encoding high-order interactions among local features. To address these issues, we propose our DAN with three key components: Feature Clustering Network (FCN), Multi-head cross Attention Network (MAN), and Attention Fusion Network (AFN). The FCN extracts robust features by adopting a large-margin learning objective to maximize class separability. In addition, the MAN instantiates a number of attention heads to simultaneously attend to multiple facial areas and build attention maps on these regions. Further, the AFN distracts these attentions to multiple locations before fusing the attention maps to a comprehensive one. Extensive experiments on three public datasets (including AffectNet, RAF-DB, and SFEW 2.0) verified that the proposed method consistently achieves state-of-the-art facial expression recognition performance. Code will be made available at https://github.com/yaoing/DAN. △ Less

Submitted 21 May, 2023; v1 submitted 15 September, 2021; originally announced September 2021.

Comments: Paper appears in Biomimetics 2023, 8(2), 199

From Predictions to Decisions: The Importance of Joint Predictive Distributions

Authors: Zheng Wen, Ian Osband, Chao Qin, Xiuyuan Lu, Morteza Ibrahimi, Vikranth Dwaracherla, Mohammad Asghari, Benjamin Van Roy

Abstract: A fundamental challenge for any intelligent system is prediction: given some inputs, can you predict corresponding outcomes? Most work on supervised learning has focused on producing accurate marginal predictions for each input. However, we show that for a broad class of decision problems, accurate joint predictions are required to deliver good performance. In particular, we establish several resu… ▽ More A fundamental challenge for any intelligent system is prediction: given some inputs, can you predict corresponding outcomes? Most work on supervised learning has focused on producing accurate marginal predictions for each input. However, we show that for a broad class of decision problems, accurate joint predictions are required to deliver good performance. In particular, we establish several results pertaining to combinatorial decision problems, sequential predictions, and multi-armed bandits to elucidate the essential role of joint predictive distributions. Our treatment of multi-armed bandits introduces an approximate Thompson sampling algorithm and analytic techniques that lead to a new kind of regret bound. △ Less

Submitted 23 May, 2022; v1 submitted 19 July, 2021; originally announced July 2021.

Epistemic Neural Networks

Authors: Ian Osband, Zheng Wen, Seyed Mohammad Asghari, Vikranth Dwaracherla, Morteza Ibrahimi, Xiuyuan Lu, Benjamin Van Roy

Abstract: Intelligence relies on an agent's knowledge of what it does not know. This capability can be assessed based on the quality of joint predictions of labels across multiple inputs. In principle, ensemble-based approaches produce effective joint predictions, but the computational costs of training large ensembles can become prohibitive. We introduce the epinet: an architecture that can supplement any… ▽ More Intelligence relies on an agent's knowledge of what it does not know. This capability can be assessed based on the quality of joint predictions of labels across multiple inputs. In principle, ensemble-based approaches produce effective joint predictions, but the computational costs of training large ensembles can become prohibitive. We introduce the epinet: an architecture that can supplement any conventional neural network, including large pretrained models, and can be trained with modest incremental computation to estimate uncertainty. With an epinet, conventional neural networks outperform very large ensembles, consisting of hundreds or more particles, with orders of magnitude less computation. The epinet does not fit the traditional framework of Bayesian neural networks. To accommodate development of approaches beyond BNNs, such as the epinet, we introduce the epistemic neural network (ENN) as an interface for models that produce joint predictions. △ Less

Submitted 17 May, 2023; v1 submitted 19 July, 2021; originally announced July 2021.

A Dialogue-based Information Extraction System for Medical Insurance Assessment

Authors: Shuang Peng, Mengdi Zhou, Minghui Yang, Haitao Mi, Shaosheng Cao, Zujie Wen, Teng Xu, Hongbin Wang, Lei Liu

Abstract: In the Chinese medical insurance industry, the assessor's role is essential and requires significant efforts to converse with the claimant. This is a highly professional job that involves many parts, such as identifying personal information, collecting related evidence, and making a final insurance report. Due to the coronavirus (COVID-19) pandemic, the previous offline insurance assessment has to… ▽ More In the Chinese medical insurance industry, the assessor's role is essential and requires significant efforts to converse with the claimant. This is a highly professional job that involves many parts, such as identifying personal information, collecting related evidence, and making a final insurance report. Due to the coronavirus (COVID-19) pandemic, the previous offline insurance assessment has to be conducted online. However, for the junior assessor often lacking practical experience, it is not easy to quickly handle such a complex online procedure, yet this is important as the insurance company needs to decide how much compensation the claimant should receive based on the assessor's feedback. In order to promote assessors' work efficiency and speed up the overall procedure, in this paper, we propose a dialogue-based information extraction system that integrates advanced NLP technologies for medical insurance assessment. With the assistance of our system, the average time cost of the procedure is reduced from 55 minutes to 35 minutes, and the total human resources cost is saved 30% compared with the previous offline procedure. Until now, the system has already served thousands of online claim cases. △ Less

Submitted 13 July, 2021; originally announced July 2021.

Comments: To be published in the Findings of ACL 2021

R2D2: Recursive Transformer based on Differentiable Tree for Interpretable Hierarchical Language Modeling

Authors: Xiang Hu, Haitao Mi, Zujie Wen, Yafang Wang, Yi Su, Jing Zheng, Gerard de Melo

Abstract: Human language understanding operates at multiple levels of granularity (e.g., words, phrases, and sentences) with increasing levels of abstraction that can be hierarchically combined. However, existing deep models with stacked layers do not explicitly model any sort of hierarchical process. This paper proposes a recursive Transformer model based on differentiable CKY style binary trees to emulate… ▽ More Human language understanding operates at multiple levels of granularity (e.g., words, phrases, and sentences) with increasing levels of abstraction that can be hierarchically combined. However, existing deep models with stacked layers do not explicitly model any sort of hierarchical process. This paper proposes a recursive Transformer model based on differentiable CKY style binary trees to emulate the composition process. We extend the bidirectional language model pre-training objective to this architecture, attempting to predict each word given its left and right abstraction nodes. To scale up our approach, we also introduce an efficient pruned tree induction algorithm to enable encoding in just a linear number of composition steps. Experimental results on language modeling and unsupervised parsing show the effectiveness of our approach. △ Less

Submitted 3 March, 2022; v1 submitted 2 July, 2021; originally announced July 2021.

Comments: ACL-IJCNLP 2021

Spin Hall effect in a spin-1 chiral semimetal

Authors: Ke Tang, Yong-Chang Lau, Kenji Nawa, Zhenchao Wen, Qingyi Xiang, Hiroaki Sukegawa, Takeshi Seki, Yoshio Miura, Koki Takanashi, Seiji Mitani

Abstract: Spin-1 chiral semimetal is a new state of quantum matter hosting unconventional chiral fermions that extend beyond the common Dirac and Weyl fermions. B20-type CoSi is a prototypal material that accommodates such an exotic quasiparticle. To date, the spin transport properties in the spin-1 chiral semimetals, have not been explored yet. In this work, we fabricated B20-CoSi thin films on sapphire c-… ▽ More Spin-1 chiral semimetal is a new state of quantum matter hosting unconventional chiral fermions that extend beyond the common Dirac and Weyl fermions. B20-type CoSi is a prototypal material that accommodates such an exotic quasiparticle. To date, the spin transport properties in the spin-1 chiral semimetals, have not been explored yet. In this work, we fabricated B20-CoSi thin films on sapphire c-plane substrates by magnetron sputtering and studied the spin Hall effect (SHE) by combining experiments and first-principles calculations. The SHE of CoSi using CoSi/CoFeB/MgO heterostructures was investigated via spin Hall magnetoresistance and harmonic Hall measurements. First-principles calculations yield an intrinsic spin Hall conductivity (SHC) at the Fermi level that is consistent with the experiments and reveal its unique Fermi-energy dependence. Unlike the Dirac and Weyl fermion-mediated Hall conductivities that exhibit a peak-like structure centering around the topological node, SHC of B20-CoSi is odd and crosses zero at the node with two antisymmetric local extrema of opposite sign situated below and above in energy. Hybridization between Co d-Si p orbitals and spin-orbit coupling are essential for the SHC, despite the small (~1%) weight of Si p-orbital near the Fermi level. This work expands the horizon of topological spintronics and highlights the importance of Fermi-level tuning in order to fully exploit the topology of spin-1 chiral fermions for spin current generation. △ Less

Submitted 29 June, 2021; originally announced June 2021.

Comments: 24 pages, 6 figures

Journal ref: Phys. Rev. Research 3, 033101 (2021)

Role of line defect in the bandgap and transport properties of silicene nanoribbons

Authors: Fei Wan, Xinru Wang, Yawen Guo, Jiayan Zhang, ZhengCheng Wen, Yuan Li

Abstract: By using the tight-binding model and non-equilibrium Green's function method (NEGF), we study the band structures and transport properties of a silicene nanoribbon with a line defect where a bulk energy gap is opened due to the sublattice symmetry breaking. The flat subband bends downwards or upwards due to the effect of the line defect. The spin-orbit coupling induces quantum spin Hall states. Es… ▽ More By using the tight-binding model and non-equilibrium Green's function method (NEGF), we study the band structures and transport properties of a silicene nanoribbon with a line defect where a bulk energy gap is opened due to the sublattice symmetry breaking. The flat subband bends downwards or upwards due to the effect of the line defect. The spin-orbit coupling induces quantum spin Hall states. Especially, the energy band depends on the distance between the line defect and the edge of the nanoribbon. The effects of the on-site energies on the band spectra of the two defect configurations are different. There always exists one band gap for different on-site energies for the defect configuration of case 1. However, a gapless state and a band gap can be modulated by changing the on-site energy, the sublattice potential and spin-orbit couplings for the defect configuration of case 2. Accordingly, the variation trends of the conductance including zero conductance can be well understood in terms of the combined effect of the sublattice potential, the on-site energy and spin-orbit couplings on the band structures. Thus it is easy and effective to modulate the transport property of the silicene nanoribbon with the defect configuration of case 2 by utilizing the sublattice potential, the on-site energy and spin-orbit couplings. This study is of great significance for the fabrication and the modulation of the transport property of silicene-based devices. △ Less

Submitted 26 June, 2021; originally announced June 2021.

Comments: 7 pages, 10 figures

Journal ref: Physical Review B 104, 195413 (2021)

Improving Multi-Modal Learning with Uni-Modal Teachers

Authors: Chenzhuang Du, Tingle Li, Yichen Liu, Zixin Wen, Tianyu Hua, Yue Wang, Hang Zhao

Abstract: Learning multi-modal representations is an essential step towards real-world robotic applications, and various multi-modal fusion models have been developed for this purpose. However, we observe that existing models, whose objectives are mostly based on joint training, often suffer from learning inferior representations of each modality. We name this problem Modality Failure, and hypothesize that… ▽ More Learning multi-modal representations is an essential step towards real-world robotic applications, and various multi-modal fusion models have been developed for this purpose. However, we observe that existing models, whose objectives are mostly based on joint training, often suffer from learning inferior representations of each modality. We name this problem Modality Failure, and hypothesize that the imbalance of modalities and the implicit bias of common objectives in fusion method prevent encoders of each modality from sufficient feature learning. To this end, we propose a new multi-modal learning method, Uni-Modal Teacher, which combines the fusion objective and uni-modal distillation to tackle the modality failure problem. We show that our method not only drastically improves the representation of each modality, but also improves the overall multi-modal task performance. Our method can be effectively generalized to most multi-modal fusion approaches. We achieve more than 3% improvement on the VGGSound audio-visual classification task, as well as improving performance on the NYU depth V2 RGB-D image segmentation task. △ Less

Submitted 21 June, 2021; originally announced June 2021.

NG+ : A Multi-Step Matrix-Product Natural Gradient Method for Deep Learning

Authors: Minghan Yang, Dong Xu, Qiwen Cui, Zaiwen Wen, Pengxiang Xu

Abstract: In this paper, a novel second-order method called NG+ is proposed. By following the rule ``the shape of the gradient equals the shape of the parameter", we define a generalized fisher information matrix (GFIM) using the products of gradients in the matrix form rather than the traditional vectorization. Then, our generalized natural gradient direction is simply the inverse of the GFIM multiplies th… ▽ More In this paper, a novel second-order method called NG+ is proposed. By following the rule ``the shape of the gradient equals the shape of the parameter", we define a generalized fisher information matrix (GFIM) using the products of gradients in the matrix form rather than the traditional vectorization. Then, our generalized natural gradient direction is simply the inverse of the GFIM multiplies the gradient in the matrix form. Moreover, the GFIM and its inverse keeps the same for multiple steps so that the computational cost can be controlled and is comparable with the first-order methods. A global convergence is established under some mild conditions and a regret bound is also given for the online learning setting. Numerical results on image classification with ResNet50, quantum chemistry modeling with Schnet, neural machine translation with Transformer and recommendation system with DLRM illustrate that GN+ is competitive with the state-of-the-art methods. △ Less

Submitted 14 June, 2021; originally announced June 2021.

Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning

Authors: Zixin Wen, Yuanzhi Li

Abstract: How can neural networks trained by contrastive learning extract features from the unlabeled data? Why does contrastive learning usually need much stronger data augmentations than supervised learning to ensure good representations? These questions involve both the optimization and statistical aspects of deep learning, but can hardly be answered by analyzing supervised learning, where the target fun… ▽ More How can neural networks trained by contrastive learning extract features from the unlabeled data? Why does contrastive learning usually need much stronger data augmentations than supervised learning to ensure good representations? These questions involve both the optimization and statistical aspects of deep learning, but can hardly be answered by analyzing supervised learning, where the target functions are the highest pursuit. Indeed, in self-supervised learning, it is inevitable to relate to the optimization/generalization of neural networks to how they can encode the latent structures in the data, which we refer to as the feature learning process. In this work, we formally study how contrastive learning learns the feature representations for neural networks by analyzing its feature learning process. We consider the case where our data are comprised of two types of features: the more semantically aligned sparse features which we want to learn from, and the other dense features we want to avoid. Theoretically, we prove that contrastive learning using $\mathbf{ReLU}$ networks provably learns the desired sparse features if proper augmentations are adopted. We present an underlying principle called $\textbf{feature decoupling}$ to explain the effects of augmentations, where we theoretically characterize how augmentations can reduce the correlations of dense features between positive samples while keeping the correlations of sparse features intact, thereby forcing the neural networks to learn from the self-supervision of sparse features. Empirically, we verified that the feature decoupling principle matches the underlying mechanism of contrastive learning in practice. △ Less

Submitted 5 July, 2021; v1 submitted 31 May, 2021; originally announced May 2021.

Comments: V3 corrected related works. Accepted to ICML2021

Measurement of cross section for $e^{+}e^{-}\rightarrowΞ^{0}\barΞ^{0}$ near threshold

Authors: BESIII Collaboration, M. Ablikim, M. N. Achasov, P. Adlarson, S. Ahmed, M. Albrecht, R. Aliberti, A. Amoroso, M. R. An, Q. An, X. H. Bai, Y. Bai, O. Bakina, R. Baldini Ferroli, I. Balossino, Y. Ban, K. Begzsuren, N. Berger, M. Bertani, D. Bettoni, F. Bianchi, J. Bloms, A. Bortone, I. Boyko, R. A. Briere , et al. (497 additional authors not shown)

Abstract: Using $e^+e^-$ collision data at ten center-of-mass energies between 2.644 and 3.080 GeV collected with the BESIII detector at BEPCII and corresponding to an integrated luminosity of about 500 pb$^{-1}$, we measure the cross sections and effective form factors for the process $e^{+}e^{-}\rightarrowΞ^{0}\barΞ^{0}$ utilizing a single-tag method. A fit to the cross section of… ▽ More Using $e^+e^-$ collision data at ten center-of-mass energies between 2.644 and 3.080 GeV collected with the BESIII detector at BEPCII and corresponding to an integrated luminosity of about 500 pb$^{-1}$, we measure the cross sections and effective form factors for the process $e^{+}e^{-}\rightarrowΞ^{0}\barΞ^{0}$ utilizing a single-tag method. A fit to the cross section of $e^{+}e^{-}\rightarrowΞ^{0}\barΞ^{0}$ with a pQCD-driven power function is performed, from which no significant resonance or threshold enhancement is observed. In addition, the ratio of cross sections for the processes $e^{+}e^{-}\rightarrowΞ^{-}\barΞ^{+}$ and $Ξ^{0}\barΞ^{0}$ is calculated using recent BESIII measurement and is found to be compatible with expectation from isospin symmetry. △ Less

Submitted 6 August, 2021; v1 submitted 30 May, 2021; originally announced May 2021.

Comments: 11 pages, 5 figures. Consistent with paper published in Phys. Lett. B 820 (2021) 136557

Journal ref: Phys. Lett. B 820 (2021) 136557

A Stochastic Composite Augmented Lagrangian Method For Reinforcement Learning

Authors: Yongfeng Li, Mingming Zhao, Weijie Chen, Zaiwen Wen

Abstract: In this paper, we consider the linear programming (LP) formulation for deep reinforcement learning. The number of the constraints depends on the size of state and action spaces, which makes the problem intractable in large or continuous environments. The general augmented Lagrangian method suffers the double-sampling obstacle in solving the LP. Namely, the conditional expectations originated from… ▽ More In this paper, we consider the linear programming (LP) formulation for deep reinforcement learning. The number of the constraints depends on the size of state and action spaces, which makes the problem intractable in large or continuous environments. The general augmented Lagrangian method suffers the double-sampling obstacle in solving the LP. Namely, the conditional expectations originated from the constraint functions and the quadratic penalties in the augmented Lagrangian function impose difficulties in sampling and evaluation. Motivated from the updates of the multipliers, we overcome the obstacles in minimizing the augmented Lagrangian function by replacing the intractable conditional expectations with the multipliers. Therefore, a deep parameterized augment Lagrangian method is proposed. Furthermore, the replacement provides a promising breakthrough to integrate the two steps in the augmented Lagrangian method into a single constrained problem. A general theoretical analysis shows that the solutions generated from a sequence of the constrained optimizations converge to the optimal solution of the LP if the error is controlled properly. A theoretical analysis on the quadratic penalty algorithm under neural tangent kernel setting shows the residual can be arbitrarily small if the parameter in network and optimization algorithm is chosen suitably. Preliminary experiments illustrate that our method is competitive to other state-of-the-art algorithms. △ Less

Submitted 20 May, 2021; originally announced May 2021.

Comments: 29 pages, 6 figures

SeaD: End-to-end Text-to-SQL Generation with Schema-aware Denoising

Authors: Kuan Xu, Yongbo Wang, Yongliang Wang, Zujie Wen, Yang Dong

Abstract: In text-to-SQL task, seq-to-seq models often lead to sub-optimal performance due to limitations in their architecture. In this paper, we present a simple yet effective approach that adapts transformer-based seq-to-seq model to robust text-to-SQL generation. Instead of inducing constraint to decoder or reformat the task as slot-filling, we propose to train seq-to-seq model with Schema aware Denoisi… ▽ More In text-to-SQL task, seq-to-seq models often lead to sub-optimal performance due to limitations in their architecture. In this paper, we present a simple yet effective approach that adapts transformer-based seq-to-seq model to robust text-to-SQL generation. Instead of inducing constraint to decoder or reformat the task as slot-filling, we propose to train seq-to-seq model with Schema aware Denoising (SeaD), which consists of two denoising objectives that train model to either recover input or predict output from two novel erosion and shuffle noises. These denoising objectives acts as the auxiliary tasks for better modeling the structural data in S2S generation. In addition, we improve and propose a clause-sensitive execution guided (EG) decoding strategy to overcome the limitation of EG decoding for generative model. The experiments show that the proposed method improves the performance of seq-to-seq model in both schema linking and grammar correctness and establishes new state-of-the-art on WikiSQL benchmark. The results indicate that the capacity of vanilla seq-to-seq architecture for text-to-SQL may have been under-estimated. △ Less

Submitted 30 January, 2023; v1 submitted 17 May, 2021; originally announced May 2021.

Comments: 9 pages

Meta-Inductive Node Classification across Graphs

Authors: Zhihao Wen, Yuan Fang, Zemin Liu

Abstract: Semi-supervised node classification on graphs is an important research problem, with many real-world applications in information retrieval such as content classification on a social network and query intent classification on an e-commerce query graph. While traditional approaches are largely transductive, recent graph neural networks (GNNs) integrate node features with network structures, thus ena… ▽ More Semi-supervised node classification on graphs is an important research problem, with many real-world applications in information retrieval such as content classification on a social network and query intent classification on an e-commerce query graph. While traditional approaches are largely transductive, recent graph neural networks (GNNs) integrate node features with network structures, thus enabling inductive node classification models that can be applied to new nodes or even new graphs in the same feature space. However, inter-graph differences still exist across graphs within the same domain. Thus, training just one global model (e.g., a state-of-the-art GNN) to handle all new graphs, whilst ignoring the inter-graph differences, can lead to suboptimal performance. In this paper, we study the problem of inductive node classification across graphs. Unlike existing one-model-fits-all approaches, we propose a novel meta-inductive framework called MI-GNN to customize the inductive model to each graph under a meta-learning paradigm. That is, MI-GNN does not directly learn an inductive model; it learns the general knowledge of how to train a model for semi-supervised node classification on new graphs. To cope with the differences across graphs, MI-GNN employs a dual adaptation mechanism at both the graph and task levels. More specifically, we learn a graph prior to adapt for the graph-level differences, and a task prior to adapt for the task-level differences conditioned on a graph. Extensive experiments on five real-world graph collections demonstrate the effectiveness of our proposed model. △ Less

Submitted 27 March, 2022; v1 submitted 14 May, 2021; originally announced May 2021.

Comments: In proceedings of SIGIR 2021

Joint Online Learning and Decision-making via Dual Mirror Descent

Authors: Alfonso Lobos, Paul Grigas, Zheng Wen

Abstract: We consider an online revenue maximization problem over a finite time horizon subject to lower and upper bounds on cost. At each period, an agent receives a context vector sampled i.i.d. from an unknown distribution and needs to make a decision adaptively. The revenue and cost functions depend on the context vector as well as some fixed but possibly unknown parameter vector to be learned. We propo… ▽ More We consider an online revenue maximization problem over a finite time horizon subject to lower and upper bounds on cost. At each period, an agent receives a context vector sampled i.i.d. from an unknown distribution and needs to make a decision adaptively. The revenue and cost functions depend on the context vector as well as some fixed but possibly unknown parameter vector to be learned. We propose a novel offline benchmark and a new algorithm that mixes an online dual mirror descent scheme with a generic parameter learning process. When the parameter vector is known, we demonstrate an $O(\sqrt{T})$ regret result as well an $O(\sqrt{T})$ bound on the possible constraint violations. When the parameter is not known and must be learned, we demonstrate that the regret and constraint violations are the sums of the previous $O(\sqrt{T})$ terms plus terms that directly depend on the convergence of the learning process. △ Less

Submitted 20 April, 2021; originally announced April 2021.

FSR: Accelerating the Inference Process of Transducer-Based Models by Applying Fast-Skip Regularization

Authors: Zhengkun Tian, Jiangyan Yi, Ye Bai, Jianhua Tao, Shuai Zhang, Zhengqi Wen

Abstract: Transducer-based models, such as RNN-Transducer and transformer-transducer, have achieved great success in speech recognition. A typical transducer model decodes the output sequence conditioned on the current acoustic state and previously predicted tokens step by step. Statistically, The number of blank tokens in the prediction results accounts for nearly 90\% of all tokens. It takes a lot of comp… ▽ More Transducer-based models, such as RNN-Transducer and transformer-transducer, have achieved great success in speech recognition. A typical transducer model decodes the output sequence conditioned on the current acoustic state and previously predicted tokens step by step. Statistically, The number of blank tokens in the prediction results accounts for nearly 90\% of all tokens. It takes a lot of computation and time to predict the blank tokens, but only the non-blank tokens will appear in the final output sequence. Therefore, we propose a method named fast-skip regularization, which tries to align the blank position predicted by a transducer with that predicted by a CTC model. During the inference, the transducer model can predict the blank tokens in advance by a simple CTC project layer without many complicated forward calculations of the transducer decoder and then skip them, which will reduce the computation and improve the inference speed greatly. All experiments are conducted on a public Chinese mandarin dataset AISHELL-1. The results show that the fast-skip regularization can indeed help the transducer model learn the blank position alignments. Besides, the inference with fast-skip can be speeded up nearly 4 times with only a little performance degradation. △ Less

Submitted 6 April, 2021; originally announced April 2021.

Comments: Submitted to INTERSPEECH2021

TSNAT: Two-Step Non-Autoregressvie Transformer Models for Speech Recognition

Authors: Zhengkun Tian, Jiangyan Yi, Jianhua Tao, Ye Bai, Shuai Zhang, Zhengqi Wen, Xuefei Liu

Abstract: The autoregressive (AR) models, such as attention-based encoder-decoder models and RNN-Transducer, have achieved great success in speech recognition. They predict the output sequence conditioned on the previous tokens and acoustic encoded states, which is inefficient on GPUs. The non-autoregressive (NAR) models can get rid of the temporal dependency between the output tokens and predict the entire… ▽ More The autoregressive (AR) models, such as attention-based encoder-decoder models and RNN-Transducer, have achieved great success in speech recognition. They predict the output sequence conditioned on the previous tokens and acoustic encoded states, which is inefficient on GPUs. The non-autoregressive (NAR) models can get rid of the temporal dependency between the output tokens and predict the entire output tokens in at least one step. However, the NAR model still faces two major problems. On the one hand, there is still a great gap in performance between the NAR models and the advanced AR models. On the other hand, it's difficult for most of the NAR models to train and converge. To address these two problems, we propose a new model named the two-step non-autoregressive transformer(TSNAT), which improves the performance and accelerating the convergence of the NAR model by learning prior knowledge from a parameters-sharing AR model. Furthermore, we introduce the two-stage method into the inference process, which improves the model performance greatly. All the experiments are conducted on a public Chinese mandarin dataset ASIEHLL-1. The results show that the TSNAT can achieve a competitive performance with the AR model and outperform many complicated NAR models. △ Less

Submitted 3 April, 2021; originally announced April 2021.

Comments: Submitted to Interspeech2021

Novel tile segmentation scheme for omnidirectional video

Authors: Jisheng Li, Ziyu Wen, Sihan Li, Yikai Zhao, Bichuan Guo, Jiangtao Wen

Abstract: Regular omnidirectional video encoding technics use map projection to flatten a scene from a spherical shape into one or several 2D shapes. Common projection methods including equirectangular and cubic projection have varying levels of interpolation that create a large number of non-information-carrying pixels that lead to wasted bitrate. In this paper, we propose a tile based omnidirectional vide… ▽ More Regular omnidirectional video encoding technics use map projection to flatten a scene from a spherical shape into one or several 2D shapes. Common projection methods including equirectangular and cubic projection have varying levels of interpolation that create a large number of non-information-carrying pixels that lead to wasted bitrate. In this paper, we propose a tile based omnidirectional video segmentation scheme which can save up to 28% of pixel area and 20% of BD-rate averagely compared to the traditional equirectangular projection based approach. △ Less

Submitted 9 March, 2021; originally announced March 2021.

Comments: Published in 2016 IEEE International Conference on Image Processing (ICIP)

Anomalous reflection at the interface of binary synthetic photonic lattices

Authors: Zhiqing Zhang, Yanan Dai, Zengrun Wen, Zhenjuan Liu, Haohao Wang, Yuanmei Gao, Yanlong Shen, Xinyuan Qi

Abstract: We construct a binary synthetic photonic lattice theoretically with an effective magnetic field by projecting two fiber loops' light intensity and adjusting the phase distribution precisely. By tuning the phase modulator, wave vector, and propagation constant of an effective waveguide, the interface's transmittance could be manipulated. Further light dynamics show that the light pulse can achieve… ▽ More We construct a binary synthetic photonic lattice theoretically with an effective magnetic field by projecting two fiber loops' light intensity and adjusting the phase distribution precisely. By tuning the phase modulator, wave vector, and propagation constant of an effective waveguide, the interface's transmittance could be manipulated. Further light dynamics show that the light pulse can achieve total reflection without diffraction and exchanges the light energy in two optical fiber loops completely when phase distribution and wave vector meet certain conditions. Our study may provide a new way to realize optical switches in optical interconnection and optical communication. △ Less

Submitted 15 March, 2021; v1 submitted 9 March, 2021; originally announced March 2021.

Comments: 4 pages, 4 figures

Pose Discrepancy Spatial Transformer Based Feature Disentangling for Partial Aspect Angles SAR Target Recognition

Authors: Zaidao Wen, Jiaxiang Liu, Zhunga Liu, Quan Pan

Abstract: This letter presents a novel framework termed DistSTN for the task of synthetic aperture radar (SAR) automatic target recognition (ATR). In contrast to the conventional SAR ATR algorithms, DistSTN considers a more challenging practical scenario for non-cooperative targets whose aspect angles for training are incomplete and limited in a partial range while those of testing samples are unlimited. To… ▽ More This letter presents a novel framework termed DistSTN for the task of synthetic aperture radar (SAR) automatic target recognition (ATR). In contrast to the conventional SAR ATR algorithms, DistSTN considers a more challenging practical scenario for non-cooperative targets whose aspect angles for training are incomplete and limited in a partial range while those of testing samples are unlimited. To address this issue, instead of learning the pose invariant features, DistSTN newly involves an elaborated feature disentangling model to separate the learned pose factors of a SAR target from the identity ones so that they can independently control the representation process of the target image. To disentangle the explainable pose factors, we develop a pose discrepancy spatial transformer module in DistSTN to characterize the intrinsic transformation between the factors of two different targets with an explicit geometric model. Furthermore, DistSTN develops an amortized inference scheme that enables efficient feature extraction and recognition using an encoder-decoder mechanism. Experimental results with the moving and stationary target acquisition and recognition (MSTAR) benchmark demonstrate the effectiveness of our proposed approach. Compared with the other ATR algorithms, DistSTN can achieve higher recognition accuracy. △ Less

Submitted 7 March, 2021; originally announced March 2021.

Reinforcement Learning, Bit by Bit

Authors: Xiuyuan Lu, Benjamin Van Roy, Vikranth Dwaracherla, Morteza Ibrahimi, Ian Osband, Zheng Wen

Abstract: Reinforcement learning agents have demonstrated remarkable achievements in simulated environments. Data efficiency poses an impediment to carrying this success over to real environments. The design of data-efficient agents calls for a deeper understanding of information acquisition and representation. We discuss concepts and regret analysis that together offer principled guidance. This line of thi… ▽ More Reinforcement learning agents have demonstrated remarkable achievements in simulated environments. Data efficiency poses an impediment to carrying this success over to real environments. The design of data-efficient agents calls for a deeper understanding of information acquisition and representation. We discuss concepts and regret analysis that together offer principled guidance. This line of thinking sheds light on questions of what information to seek, how to seek that information, and what information to retain. To illustrate concepts, we design simple agents that build on them and present computational results that highlight data efficiency. △ Less

Submitted 4 May, 2023; v1 submitted 6 March, 2021; originally announced March 2021.

MixSearch: Searching for Domain Generalized Medical Image Segmentation Architectures

Authors: Luyan Liu, Zhiwei Wen, Songwei Liu, Hong-Yu Zhou, Hongwei Zhu, Weicheng Xie, Linlin Shen, Kai Ma, Yefeng Zheng

Abstract: Considering the scarcity of medical data, most datasets in medical image analysis are an order of magnitude smaller than those of natural images. However, most Network Architecture Search (NAS) approaches in medical images focused on specific datasets and did not take into account the generalization ability of the learned architectures on unseen datasets as well as different domains. In this paper… ▽ More Considering the scarcity of medical data, most datasets in medical image analysis are an order of magnitude smaller than those of natural images. However, most Network Architecture Search (NAS) approaches in medical images focused on specific datasets and did not take into account the generalization ability of the learned architectures on unseen datasets as well as different domains. In this paper, we address this point by proposing to search for generalizable U-shape architectures on a composited dataset that mixes medical images from multiple segmentation tasks and domains creatively, which is named MixSearch. Specifically, we propose a novel approach to mix multiple small-scale datasets from multiple domains and segmentation tasks to produce a large-scale dataset. Then, a novel weaved encoder-decoder structure is designed to search for a generalized segmentation network in both cell-level and network-level. The network produced by the proposed MixSearch framework achieves state-of-the-art results compared with advanced encoder-decoder networks across various datasets. △ Less

Submitted 25 February, 2021; originally announced February 2021.

Fast End-to-End Speech Recognition via Non-Autoregressive Models and Cross-Modal Knowledge Transferring from BERT

Authors: Ye Bai, Jiangyan Yi, Jianhua Tao, Zhengkun Tian, Zhengqi Wen, Shuai Zhang

Abstract: Attention-based encoder-decoder (AED) models have achieved promising performance in speech recognition. However, because the decoder predicts text tokens (such as characters or words) in an autoregressive manner, it is difficult for an AED model to predict all tokens in parallel. This makes the inference speed relatively slow. We believe that because the encoder already captures the whole speech u… ▽ More Attention-based encoder-decoder (AED) models have achieved promising performance in speech recognition. However, because the decoder predicts text tokens (such as characters or words) in an autoregressive manner, it is difficult for an AED model to predict all tokens in parallel. This makes the inference speed relatively slow. We believe that because the encoder already captures the whole speech utterance, which has the token-level relationship implicitly, we can predict a token without explicitly autoregressive language modeling. When the prediction of a token does not rely on other tokens, the parallel prediction of all tokens in the sequence is realizable. Based on this idea, we propose a non-autoregressive speech recognition model called LASO (Listen Attentively, and Spell Once). The model consists of an encoder, a decoder, and a position dependent summarizer (PDS). The three modules are based on basic attention blocks. The encoder extracts high-level representations from the speech. The PDS uses positional encodings corresponding to tokens to convert the acoustic representations into token-level representations. The decoder further captures token-level relationships with the self-attention mechanism. At last, the probability distribution on the vocabulary is computed for each token position. Therefore, speech recognition is re-formulated as a position-wise classification problem. Further, we propose a cross-modal transfer learning method to refine semantics from a large-scale pre-trained language model BERT for improving the performance. △ Less

Submitted 29 August, 2021; v1 submitted 15 February, 2021; originally announced February 2021.

Comments: 14 pages, 7 figures

Resonant Band Engineering of Ferroelectric Tunnel Junctions

Authors: Jing Su, Xingwen Zheng, Zheng Wen, Tao Li, Shijie Xie, Karin M. Rabe, Xiaohui Liu, Evgeny Y. Tsymbal

Abstract: We propose energy band engineering to enhance tunneling electroresistance (TER) in ferroelectric tunnel junctions (FTJs). We predict that an ultrathin dielectric layer with a smaller band gap, embedded into a ferroelectric barrier layer, acts as a switch controlling high and low conductance states of an FTJ depending on polarization orientation. Using first-principles modeling based on density fun… ▽ More We propose energy band engineering to enhance tunneling electroresistance (TER) in ferroelectric tunnel junctions (FTJs). We predict that an ultrathin dielectric layer with a smaller band gap, embedded into a ferroelectric barrier layer, acts as a switch controlling high and low conductance states of an FTJ depending on polarization orientation. Using first-principles modeling based on density functional theory, we investigate this phenomenon for a prototypical SrRuO3/BaTiO3/SrRuO3 FTJ with a BaSnO3 monolayer embedded in the BaTiO3 barrier. We show that in such a composite-barrier FTJ, ferroelectric polarization of BaTiO3 shifts the conduction band minimum of the BaSnO3 monolayer above or below the Fermi energy depending on polarization orientation. The resulting switching between direct and resonant tunneling leads to a TER effect with a giant ON/OFF conductance ratio. The proposed resonant band engineering of FTJs can serve as a viable tool to enhance their performance useful for device application. △ Less

Submitted 5 February, 2021; originally announced February 2021.

Journal ref: Phys. Rev. B 104, 060101 (2021)

Direct Fidelity Estimation of Quantum States using Machine Learning

Authors: Xiaoqian Zhang, Maolin Luo, Zhaodi Wen, Qin Feng, Shengshi Pang, Weiqi Luo, Xiaoqi Zhou

Abstract: In almost all quantum applications, one of the key steps is to verify that the fidelity of the prepared quantum state meets expectations. In this Letter, we propose a new approach solving this problem using machine-learning techniques. Compared to other fidelity estimation methods, our method is applicable to arbitrary quantum states, the number of required measurement settings is small, and this… ▽ More In almost all quantum applications, one of the key steps is to verify that the fidelity of the prepared quantum state meets expectations. In this Letter, we propose a new approach solving this problem using machine-learning techniques. Compared to other fidelity estimation methods, our method is applicable to arbitrary quantum states, the number of required measurement settings is small, and this number does not increase with the size of the system. For example, for a general five-qubit quantum state, only four measurement settings are required to predict its fidelity with $\pm1\%$ precision in a nonadversarial scenario. This machine-learning-based approach for estimating quantum state fidelity has the potential to be widely used in the field of quantum information. △ Less

Submitted 27 September, 2021; v1 submitted 3 February, 2021; originally announced February 2021.

Comments: 20 pages, 10 figures

MSC Class: 81S05 ACM Class: C.2

Journal ref: Phys. Rev. Lett. 127, 130503 (2021)

Dual exponential polynomials and a problem of Ozawa

Authors: Janne Heittokangas, Katsuya Ishizaki, Kazuya Tohge, Zhi-Tao Wen

Abstract: Complex linear differential equations with entire coefficients are studied in the situation where one of the coefficients is an exponential polynomial and dominates the growth of all the other coefficients. If such an equation has an exponential polynomial solution $f$, then the order of $f$ and of the dominant coefficient are equal, and the two functions possess a certain duality property. The re… ▽ More Complex linear differential equations with entire coefficients are studied in the situation where one of the coefficients is an exponential polynomial and dominates the growth of all the other coefficients. If such an equation has an exponential polynomial solution $f$, then the order of $f$ and of the dominant coefficient are equal, and the two functions possess a certain duality property. The results presented in this paper improve earlier results by some of the present authors, and the paper adjoins with two open problems. △ Less

Submitted 29 January, 2021; originally announced January 2021.

Comments: 17 pages

MSC Class: 30D15; 30D35

Meromorphic functions of finite $\varphi$-order and linear Askey-Wilson divided difference equations

Authors: Hui Yu, Janne Heittokangas, Jun Wang, Zhi-Tao Wen

Abstract: The growth of meromorphic solutions of linear difference equations containing Askey-Wilson divided difference operators is estimated. The $\varphi$-order is used as a general growth indicator, which covers the growth spectrum between the logarithmic order $ρ_{\log}(f)$ and the classical order $ρ(f)$ of a meromorphic function $f$. The growth of meromorphic solutions of linear difference equations containing Askey-Wilson divided difference operators is estimated. The $\varphi$-order is used as a general growth indicator, which covers the growth spectrum between the logarithmic order $ρ_{\log}(f)$ and the classical order $ρ(f)$ of a meromorphic function $f$. △ Less

Submitted 28 January, 2021; originally announced January 2021.

Comments: 14 pages

MSC Class: 39A13; 30D35

Magnetization switching induced by spin-orbit torque from Co2MnGa magnetic Weyl semimetal thin films

Authors: Ke Tang, Zhenchao Wen, Yong-Chang Lau, Hiroaki Sukegawa, Takeshi Seki, Seiji Mitani

Abstract: This study reports the magnetization switching induced by spin-orbit torque (SOT) from the spin current generated in Co2MnGa magnetic Weyl semimetal (WSM) thin films. We deposited epitaxial Co2MnGa thin films with highly B2-ordered structure on MgO(001) substrates. The SOT was characterized by harmonic Hall measurements in a Co2MnGa/Ti/CoFeB heterostructure and a relatively large spin Hall efficie… ▽ More This study reports the magnetization switching induced by spin-orbit torque (SOT) from the spin current generated in Co2MnGa magnetic Weyl semimetal (WSM) thin films. We deposited epitaxial Co2MnGa thin films with highly B2-ordered structure on MgO(001) substrates. The SOT was characterized by harmonic Hall measurements in a Co2MnGa/Ti/CoFeB heterostructure and a relatively large spin Hall efficiency of -7.8% was obtained.The SOT-induced magnetization switching of the perpendicularly magnetized CoFeB layer was further demonstrated using the structure. The symmetry of second harmonic signals, thickness dependence of spin Hall efficiency, and shift of anomalous Hall loops under applied currents were also investigated. This study not only contributes to the understanding of the mechanisms of spin-current generation from magnetic-WSM-based heterostructures, but also paves a way for the applications of magnetic WSMs in spintronic devices. △ Less

Submitted 18 January, 2021; originally announced January 2021.

Comments: 15 pages, 4 figures

Journal ref: Appl. Phys. Lett. 118, 062402 (2021)

Back-n White Neutron Source at CSNS and its Applications

Authors: The CSNS Back-n Collaboration, :, Jing-Yu Tang, Qi An, Jiang-Bo Bai, Jie Bao, Yu Bao, Ping Cao, Hao-Lei Chen, Qi-Ping Chen, Yong-Hao Chen, Zhen Chen, Zeng-Qi Cui, Rui-Rui Fan, Chang-Qing Feng, Ke-Qing Gao, Xiao-Long Gao, Min-Hao Gu, Chang-Cai Han, Zi-Jie Han, Guo-Zhu He, Yong-Cheng He, Yang Hong, Yi-Wei Hu, Han-Xiong Huang , et al. (52 additional authors not shown)

Abstract: Back-streaming neutrons from the spallation target of the China Spallation Neutron Source (CSNS) that emit through the incoming proton channel were exploited to build a white neutron beam facility (the so-called Back-n white neutron source), which was completed in March 2018. The Back-n neutron beam is very intense, at approximately 2*10^7 n/cm^2/s at 55 m from the target, and has a nominal proton… ▽ More Back-streaming neutrons from the spallation target of the China Spallation Neutron Source (CSNS) that emit through the incoming proton channel were exploited to build a white neutron beam facility (the so-called Back-n white neutron source), which was completed in March 2018. The Back-n neutron beam is very intense, at approximately 2*10^7 n/cm^2/s at 55 m from the target, and has a nominal proton beam with a power of 100 kW in the CSNS-I phase and a kinetic energy of 1.6 GeV and a thick tungsten target in multiple slices with modest moderation from the cooling water through the slices. In addition, the excellent energy spectrum spanning from 0.5 eV to 200 MeV, and a good time resolution related to the time-of-flight measurements make it a typical white neutron source for nuclear data measurements; its overall performance is among that of the best white neutron sources in the world. Equipped with advanced spectrometers, detectors, and application utilities, the Back-n facility can serve wide applications, with a focus on neutron-induced cross-section measurements. This article presents an overview of the neutron beam characteristics, the experimental setups, and the ongoing applications at Back-n. △ Less

Submitted 16 January, 2021; originally announced January 2021.

Comments: 11 pages, 9 figures

Difference radical in terms of shifting zero and applications to the Stothers-Mason theorem

Authors: Katsuya Ishizaki, Zhi-Tao Wen

Abstract: In this paper, we study the shifting zeros with its heights and an analogue to difference radical. We focus on the Stothers-Mason theorem by using falling factorials. As applications, we discuss the difference version of the Fermat type functional equations. Some examples are given. In this paper, we study the shifting zeros with its heights and an analogue to difference radical. We focus on the Stothers-Mason theorem by using falling factorials. As applications, we discuss the difference version of the Fermat type functional equations. Some examples are given. △ Less

Submitted 13 January, 2021; originally announced January 2021.

MSC Class: 39B10; 30D35

On the Approximation Relationship between Optimizing Ratio of Submodular (RS) and Difference of Submodular (DS) Functions

Authors: Pierre Perrault, Jennifer Healey, Zheng Wen, Michal Valko

Abstract: We demonstrate that from an algorithm guaranteeing an approximation factor for the ratio of submodular (RS) optimization problem, we can build another algorithm having a different kind of approximation guarantee -- weaker than the classical one -- for the difference of submodular (DS) optimization problem, and vice versa. We also illustrate the link between these two problems by analyzing a \texts… ▽ More We demonstrate that from an algorithm guaranteeing an approximation factor for the ratio of submodular (RS) optimization problem, we can build another algorithm having a different kind of approximation guarantee -- weaker than the classical one -- for the difference of submodular (DS) optimization problem, and vice versa. We also illustrate the link between these two problems by analyzing a \textsc{Greedy} algorithm which approximately maximizes objective functions of the form $Ψ(f,g)$, where $f,g$ are two non-negative, monotone, submodular functions and $Ψ$ is a {quasiconvex} 2-variables function, which is non decreasing with respect to the first variable. For the choice $Ψ(f,g)\triangleq f/g$, we recover RS, and for the choice $Ψ(f,g)\triangleq f-g$, we recover DS. To the best of our knowledge, this greedy approach is new for DS optimization. For RS optimization, it reduces to the standard \textsc{GreedRatio} algorithm that has already been analyzed previously. However, our analysis is novel for this case. △ Less

Submitted 9 September, 2022; v1 submitted 5 January, 2021; originally announced January 2021.

MeDAL: Medical Abbreviation Disambiguation Dataset for Natural Language Understanding Pretraining

Authors: Zhi Wen, Xing Han Lu, Siva Reddy

Abstract: One of the biggest challenges that prohibit the use of many current NLP methods in clinical settings is the availability of public datasets. In this work, we present MeDAL, a large medical text dataset curated for abbreviation disambiguation, designed for natural language understanding pre-training in the medical domain. We pre-trained several models of common architectures on this dataset and emp… ▽ More One of the biggest challenges that prohibit the use of many current NLP methods in clinical settings is the availability of public datasets. In this work, we present MeDAL, a large medical text dataset curated for abbreviation disambiguation, designed for natural language understanding pre-training in the medical domain. We pre-trained several models of common architectures on this dataset and empirically showed that such pre-training leads to improved performance and convergence speed when fine-tuning on downstream medical tasks. △ Less

Submitted 27 December, 2020; originally announced December 2020.

Comments: EMNLP 2020 Clinical NLP

Journal ref: In Proceedings of the 3rd Clinical Natural Language Processing Workshop, pp. 130-135. 2020

Interactive Question Clarification in Dialogue via Reinforcement Learning

Authors: Xiang Hu, Zujie Wen, Yafang Wang, Xiaolong Li, Gerard de Melo

Abstract: Coping with ambiguous questions has been a perennial problem in real-world dialogue systems. Although clarification by asking questions is a common form of human interaction, it is hard to define appropriate questions to elicit more specific intents from a user. In this work, we propose a reinforcement model to clarify ambiguous questions by suggesting refinements of the original query. We first f… ▽ More Coping with ambiguous questions has been a perennial problem in real-world dialogue systems. Although clarification by asking questions is a common form of human interaction, it is hard to define appropriate questions to elicit more specific intents from a user. In this work, we propose a reinforcement model to clarify ambiguous questions by suggesting refinements of the original query. We first formulate a collection partitioning problem to select a set of labels enabling us to distinguish potential unambiguous intents. We list the chosen labels as intent phrases to the user for further confirmation. The selected label along with the original user query then serves as a refined query, for which a suitable response can more easily be identified. The model is trained using reinforcement learning with a deep policy network. We evaluate our model based on real-world user clicks and demonstrate significant improvements across several different experiments. △ Less

Submitted 17 December, 2020; originally announced December 2020.

Comments: COLING industry track

Neural Contextual Bandits with Deep Representation and Shallow Exploration

Authors: Pan Xu, Zheng Wen, Handong Zhao, Quanquan Gu

Abstract: We study a general class of contextual bandits, where each context-action pair is associated with a raw feature vector, but the reward generating function is unknown. We propose a novel learning algorithm that transforms the raw feature vector using the last hidden layer of a deep ReLU neural network (deep representation learning), and uses an upper confidence bound (UCB) approach to explore in th… ▽ More We study a general class of contextual bandits, where each context-action pair is associated with a raw feature vector, but the reward generating function is unknown. We propose a novel learning algorithm that transforms the raw feature vector using the last hidden layer of a deep ReLU neural network (deep representation learning), and uses an upper confidence bound (UCB) approach to explore in the last linear layer (shallow exploration). We prove that under standard assumptions, our proposed algorithm achieves $\tilde{O}(\sqrt{T})$ finite-time regret, where $T$ is the learning time horizon. Compared with existing neural contextual bandit algorithms, our approach is computationally much more efficient since it only needs to explore in the last layer of the deep neural network. △ Less

Submitted 3 December, 2020; originally announced December 2020.

Comments: 28 pages, 1 figure, 1 table

Exceeding 400% tunnel magnetoresistance at room temperature in epitaxial Fe/MgO/Fe(001) spin-valve-type magnetic tunnel junctions

Authors: Thomas Scheike, Qingyi Xiang, Zhenchao Wen, Hiroaki Sukegawa, Tadakatsu Ohkubo, Kazuhiro Hono, Seiji Mitani

Abstract: Giant tunnel magnetoresistance (TMR) ratios of 417% at room temperature (RT) and 914% at 3 K were demonstrated in epitaxial Fe/MgO/Fe(001) exchanged-biased spin-valve magnetic tunnel junctions (MTJs) by tuning growth conditions for each layer, combining sputter deposition for the Fe layers, electron-beam evaporation of the MgO barrier, and barrier interface tuning. Clear TMR oscillation as a funct… ▽ More Giant tunnel magnetoresistance (TMR) ratios of 417% at room temperature (RT) and 914% at 3 K were demonstrated in epitaxial Fe/MgO/Fe(001) exchanged-biased spin-valve magnetic tunnel junctions (MTJs) by tuning growth conditions for each layer, combining sputter deposition for the Fe layers, electron-beam evaporation of the MgO barrier, and barrier interface tuning. Clear TMR oscillation as a function of the MgO thickness with a large peak-to-valley difference of ~80% was observed when the layers were grown on a highly (001)-oriented Cr buffer layer. Specific features of the observed MTJs are symmetric differential conductance (dI/dV) spectra for the bias polarity and plateau-like deep local minima in dI/dV (parallel configuration) at |V| = 0.2~0.5 V. At 3K, fine structures with two dips emerge in the plateau-like dI/dV, reflecting highly coherent tunneling through the Fe/MgO/Fe. We also observed a 496% TMR ratio at RT by a 2.24-nm-thick-CoFe insertion at the bottom-Fe/MgO interface. △ Less

Submitted 17 November, 2020; originally announced November 2020.

Comments: 21 pages, 7 figures

Temporal Dynamic Model for Resting State fMRI Data: A Neural Ordinary Differential Equation approach

Authors: Zheyu Wen

Abstract: The objective of this paper is to provide a temporal dynamic model for resting state functional Magnetic Resonance Imaging (fMRI) trajectory to predict future brain images based on the given sequence. To this end, we came up with the model that takes advantage of representation learning and Neural Ordinary Differential Equation (Neural ODE) to compress the fMRI image data into latent representatio… ▽ More The objective of this paper is to provide a temporal dynamic model for resting state functional Magnetic Resonance Imaging (fMRI) trajectory to predict future brain images based on the given sequence. To this end, we came up with the model that takes advantage of representation learning and Neural Ordinary Differential Equation (Neural ODE) to compress the fMRI image data into latent representation and learn to predict the trajectory following differential equation. Latent space was analyzed by Gaussian Mixture Model. The learned fMRI trajectory embedding can be used to explain the variance of the trajectory and predict human traits for each subject. This method achieves average 0.5 spatial correlation for the whole predicted trajectory, and provide trained ODE parameter for further analysis. △ Less

Submitted 16 November, 2020; originally announced November 2020.

Comments: 13 pages, 20 figures, preprint work