Showing 51–100 of 149 results for author: Zeng, K

Twisted Holography and Celestial Holography from Boundary Chiral Algebra

Authors: Keyou Zeng

Abstract: We study the Kaluza-Klein reduction of various $6d$ holomorphic theories. The KK reduction is analyzed in the BV formalism, resulting in theories that come from the holomorphic topological twist of $3d$ $\mathcal{N} = 2$ supersymmetric field theories. Effective interactions of the KK theories at the classical level can be obtained at all orders using homotopy transfer theorem. We also analyze a de… ▽ More We study the Kaluza-Klein reduction of various $6d$ holomorphic theories. The KK reduction is analyzed in the BV formalism, resulting in theories that come from the holomorphic topological twist of $3d$ $\mathcal{N} = 2$ supersymmetric field theories. Effective interactions of the KK theories at the classical level can be obtained at all orders using homotopy transfer theorem. We also analyze a deformation of the theories that comes from deforming the spacetime geometry to $SL_2(\mathbb{C})$ due to the brane back-reaction. We study the boundary chiral algebras for the various KK theories. Using Koszul duality, we argue that by properly choosing a boundary condition, the boundary chiral algebra coincides with the universal defect chiral algebra of the original theory. This perspective provides a unified framework for accessing the chiral algebras that arise from both twisted holography and celestial holography programs. △ Less

Submitted 13 February, 2023; originally announced February 2023.

Comments: 99 pages

Turbulence control in plane Couette flow using low-dimensional neural ODE-based models and deep reinforcement learning

Authors: Alec J. Linot, Kevin Zeng, Michael D. Graham

Abstract: The high dimensionality and complex dynamics of turbulent flows remain an obstacle to the discovery and implementation of control strategies. Deep reinforcement learning (RL) is a promising avenue for overcoming these obstacles, but requires a training phase in which the RL agent iteratively interacts with the flow environment to learn a control policy, which can be prohibitively expensive when th… ▽ More The high dimensionality and complex dynamics of turbulent flows remain an obstacle to the discovery and implementation of control strategies. Deep reinforcement learning (RL) is a promising avenue for overcoming these obstacles, but requires a training phase in which the RL agent iteratively interacts with the flow environment to learn a control policy, which can be prohibitively expensive when the environment involves slow experiments or large-scale simulations. We overcome this challenge using a framework we call "DManD-RL" (data-driven manifold dynamics-RL), which generates a data-driven low-dimensional model of our system that we use for RL training. With this approach, we seek to minimize drag in a direct numerical simulation (DNS) of a turbulent minimal flow unit of plane Couette flow at Re=400 using two slot jets on one wall. We obtain, from DNS data with $\mathcal{O}(10^5)$ degrees of freedom, a 25-dimensional DManD model of the dynamics by combining an autoencoder and neural ordinary differential equation. Using this model as the environment, we train an RL control agent, yielding a 440-fold speedup over training on the DNS, with equivalent control performance. The agent learns a policy that laminarizes 84% of unseen DNS test trajectories within 900 time units, significantly outperforming classical opposition control (58%), despite the actuation authority being much more restricted. The agent often achieves laminarization through a counterintuitive strategy that drives the formation of two low-speed streaks, with a spanwise wavelength that is too small to be self-sustaining. The agent demonstrates the same performance when we limit observations to wall shear rate. △ Less

Submitted 28 January, 2023; originally announced January 2023.

Khaos: The Impact of Inter-procedural Code Obfuscation on Binary Diffing Techniques

Authors: Peihua Zhang, Chenggang Wu, Mingfan Peng, Kai Zeng, Ding Yu, Yuanming Lai, Yan Kang, Wei Wang, Zhe Wang

Abstract: Software obfuscation techniques can prevent binary diffing techniques from locating vulnerable code by obfuscating the third-party code, to achieve the purpose of protecting embedded device software. With the rapid development of binary diffing techniques, they can achieve more and more accurate function matching and identification by extracting the features within the function. This makes existin… ▽ More Software obfuscation techniques can prevent binary diffing techniques from locating vulnerable code by obfuscating the third-party code, to achieve the purpose of protecting embedded device software. With the rapid development of binary diffing techniques, they can achieve more and more accurate function matching and identification by extracting the features within the function. This makes existing software obfuscation techniques, which mainly focus on the intra-procedural code obfuscation, no longer effective. In this paper, we propose a new inter-procedural code obfuscation mechanism Khaos, which moves the code across functions to obfuscate the function by using compilation optimizations. Two obfuscation primitives are proposed to separate and aggregate the function, which are called fission and fusion respectively. A prototype of Khaos is implemented based on the LLVM compiler and evaluated on a large number of real-world programs including SPEC CPU 2006 & 2017, CoreUtils, JavaScript engines, etc. Experimental results show that Khaos outperforms existing code obfuscations and can significantly reduce the accuracy rates of five state-of-the-art binary diffing techniques (less than 19%) with lower runtime overhead (less than 7%). △ Less

Submitted 27 January, 2023; originally announced January 2023.

Quadratic Duality for Chiral Algebras

Authors: Zhengping Gui, Si Li, Keyou Zeng

Abstract: We introduce a notion of quadratic duality for chiral algebras. This can be viewed as a chiral version of the usual quadratic duality for quadratic associative algebras. We study the relationship between this duality notion and the Maurer-Cartan equations for chiral algebras, which turns out to be parallel to the associative algebra case. We also present some explicit examples. We introduce a notion of quadratic duality for chiral algebras. This can be viewed as a chiral version of the usual quadratic duality for quadratic associative algebras. We study the relationship between this duality notion and the Maurer-Cartan equations for chiral algebras, which turns out to be parallel to the associative algebra case. We also present some explicit examples. △ Less

Submitted 21 December, 2022; originally announced December 2022.

Comments: 23 pages. Comments are welcome

Electronic nematicity without charge density waves in titanium-based kagome metal

Authors: Hong Li, Siyu Cheng, Brenden R. Ortiz, Hengxin Tan, Dominik Werhahn, Keyu Zeng, Dirk Johrendt, Binghai Yan, Ziqiang Wang, Stephen D. Wilson, Ilija Zeljkovic

Abstract: Layered crystalline materials that consist of transition metal atoms on a kagome network have emerged as a versatile platform to study unusual electronic phenomena. For example, in the vanadium-based kagome superconductors AV3Sb5 (where A can stand for K, Cs, or Rb) there is a parent charge density wave phase that appears to simultaneously break both the translational and the rotational symmetry o… ▽ More Layered crystalline materials that consist of transition metal atoms on a kagome network have emerged as a versatile platform to study unusual electronic phenomena. For example, in the vanadium-based kagome superconductors AV3Sb5 (where A can stand for K, Cs, or Rb) there is a parent charge density wave phase that appears to simultaneously break both the translational and the rotational symmetry of the lattice. Here, we show a contrasting situation where electronic nematic order - the breaking of rotational symmetry without the breaking of translational symmetry - can occur without a corresponding charge density wave. We use spectroscopic-imaging scanning tunneling microscopy to study the kagome metal CsTi3Bi5 that is isostructural to AV3Sb5 but with a titanium atom kagome network. CsTi3Bi5 does not exhibit any detectable charge density wave state, but comparison to density functional theory calculations reveals substantial electronic correlation effects at low energies. Comparing the amplitudes of scattering wave vectors along different directions, we discover an electronic anisotropy that breaks the six-fold symmetry of the lattice, arising from both in-plane and out-of-plane titanium-derived d orbitals. Our work uncovers the role of electronic orbitals in CsTi3Bi5, suggestive of a hexagonal analogue of the nematic bond order in Fe-based superconductors. △ Less

Submitted 27 July, 2023; v1 submitted 29 November, 2022; originally announced November 2022.

Comments: This is the submitted version. Final manuscript will appear in Nature Physics

Journal ref: Nature Physics 19, 1591 (2023)

Distributed Swarm Learning for Internet of Things at the Edge: Where Artificial Intelligence Meets Biological Intelligence

Authors: Yue Wang, Zhi Tian, Xin Fan, Yan Huo, Cameron Nowzari, Kai Zeng

Abstract: With the proliferation of versatile Internet of Things (IoT) services, smart IoT devices are increasingly deployed at the edge of wireless networks to perform collaborative machine learning tasks using locally collected data, giving rise to the edge learning paradigm. Due to device restrictions and resource constraints, edge learning among massive IoT devices faces major technical challenges cause… ▽ More With the proliferation of versatile Internet of Things (IoT) services, smart IoT devices are increasingly deployed at the edge of wireless networks to perform collaborative machine learning tasks using locally collected data, giving rise to the edge learning paradigm. Due to device restrictions and resource constraints, edge learning among massive IoT devices faces major technical challenges caused by the communication bottleneck, data and device heterogeneity, non-convex optimization, privacy and security concerns, and dynamic environments. To overcome these challenges, this article studies a new framework of distributed swarm learning (DSL) through a holistic integration of artificial intelligence and biological swarm intelligence. Leveraging efficient and robust signal processing and communication techniques, DSL contributes to novel tools for learning and optimization tailored for real-time operations of large-scale IoT in edge wireless environments, which will benefit a wide range of edge IoT applications. △ Less

Submitted 29 October, 2022; originally announced October 2022.

Step out of KG: Knowledge Graph Completion via Knowledgeable Retrieval and Reading Comprehension

Authors: Xin Lv, Yankai Lin, Zijun Yao, Kaisheng Zeng, Jiajie Zhang, Lei Hou, Juanzi Li

Abstract: Knowledge graphs, as the cornerstone of many AI applications, usually face serious incompleteness problems. In recent years, there have been many efforts to study automatic knowledge graph completion (KGC), most of which use existing knowledge to infer new knowledge. However, in our experiments, we find that not all relations can be obtained by inference, which constrains the performance of existi… ▽ More Knowledge graphs, as the cornerstone of many AI applications, usually face serious incompleteness problems. In recent years, there have been many efforts to study automatic knowledge graph completion (KGC), most of which use existing knowledge to infer new knowledge. However, in our experiments, we find that not all relations can be obtained by inference, which constrains the performance of existing models. To alleviate this problem, we propose a new model based on information retrieval and reading comprehension, namely IR4KGC. Specifically, we pre-train a knowledge-based information retrieval module that can retrieve documents related to the triples to be completed. Then, the retrieved documents are handed over to the reading comprehension module to generate the predicted answers. In experiments, we find that our model can well solve relations that cannot be inferred from existing knowledge, and achieve good results on KGC datasets. △ Less

Submitted 12 October, 2022; originally announced October 2022.

ConstGCN: Constrained Transmission-based Graph Convolutional Networks for Document-level Relation Extraction

Authors: Ji Qi, Bin Xu, Kaisheng Zeng, Jinxin Liu, Jifan Yu, Qi Gao, Juanzi Li, Lei Hou

Abstract: Document-level relation extraction with graph neural networks faces a fundamental graph construction gap between training and inference - the golden graph structure only available during training, which causes that most methods adopt heuristic or syntactic rules to construct a prior graph as a pseudo proxy. In this paper, we propose $\textbf{ConstGCN}$, a novel graph convolutional network which pe… ▽ More Document-level relation extraction with graph neural networks faces a fundamental graph construction gap between training and inference - the golden graph structure only available during training, which causes that most methods adopt heuristic or syntactic rules to construct a prior graph as a pseudo proxy. In this paper, we propose $\textbf{ConstGCN}$, a novel graph convolutional network which performs knowledge-based information propagation between entities along with all specific relation spaces without any prior graph construction. Specifically, it updates the entity representation by aggregating information from all other entities along with each relation space, thus modeling the relation-aware spatial information. To control the information flow passing through the indeterminate relation spaces, we propose to constrain the propagation using transmitting scores learned from the Noise Contrastive Estimation between fact triples. Experimental results show that our method outperforms the previous state-of-the-art (SOTA) approaches on the DocRE dataset. △ Less

Submitted 8 October, 2022; originally announced October 2022.

Flux Variations of Cosmic Ray Air Showers Detected by LHAASO-KM2A During a Thunderstorm on 10 June 2021

Authors: LHAASO Collaboration, F. Aharonian, Q. An, Axikegu, L. X. Bai, Y. X. Bai, Y. W. Bao, D. Bastieri, X. J. Bi, Y. J. Bi, J. T. Cai, Zhe Cao, Zhen Cao, J. Chang, J. F. Chang, E. S. Chen, Liang Chen, Liang Chen, Long Chen, M. J. Chen, M. L. Chen, S. H. Chen, S. Z. Chen, T. L. Chen, X. J. Chen , et al. (248 additional authors not shown)

Abstract: The Large High Altitude Air Shower Observatory (LHAASO) has three sub-arrays, KM2A, WCDA and WFCTA. The flux variations of cosmic ray air showers were studied by analyzing the KM2A data during the thunderstorm on 10 June 2021. The number of shower events that meet the trigger conditions increases significantly in atmospheric electric fields, with maximum fractional increase of 20%. The variations… ▽ More The Large High Altitude Air Shower Observatory (LHAASO) has three sub-arrays, KM2A, WCDA and WFCTA. The flux variations of cosmic ray air showers were studied by analyzing the KM2A data during the thunderstorm on 10 June 2021. The number of shower events that meet the trigger conditions increases significantly in atmospheric electric fields, with maximum fractional increase of 20%. The variations of trigger rates (increases or decreases) are found to be strongly dependent on the primary zenith angle. The flux of secondary particles increases significantly, following a similar trend with that of the shower events. To better understand the observed behavior, Monte Carlo simulations are performed with CORSIKA and G4KM2A (a code based on GEANT4). We find that the experimental data (in saturated negative fields) are in good agreement with simulations, assuming the presence of a uniform upward electric field of 700 V/cm with a thickness of 1500 m in the atmosphere above the observation level. Due to the acceleration/deceleration and deflection by the atmospheric electric field, the number of secondary particles with energy above the detector threshold is modified, resulting in the changes in shower detection rate. △ Less

Submitted 6 December, 2022; v1 submitted 25 July, 2022; originally announced July 2022.

Comments: 18 pages, 11 figures

Journal ref: Chinese Phys. C 47 015001 (2023)

Fine-Grained Modeling and Optimization for Intelligent Resource Management in Big Data Processing

Authors: Chenghao Lyu, Qi Fan, Fei Song, Arnab Sinha, Yanlei Diao, Wei Chen, Li Ma, Yihui Feng, Yaliang Li, Kai Zeng, Jingren Zhou

Abstract: Big data processing at the production scale presents a highly complex environment for resource optimization (RO), a problem crucial for meeting performance goals and budgetary constraints of analytical users. The RO problem is challenging because it involves a set of decisions (the partition count, placement of parallel instances on machines, and resource allocation to each instance), requires mul… ▽ More Big data processing at the production scale presents a highly complex environment for resource optimization (RO), a problem crucial for meeting performance goals and budgetary constraints of analytical users. The RO problem is challenging because it involves a set of decisions (the partition count, placement of parallel instances on machines, and resource allocation to each instance), requires multi-objective optimization (MOO), and is compounded by the scale and complexity of big data systems while having to meet stringent time constraints for scheduling. This paper presents a MaxCompute-based integrated system to support multi-objective resource optimization via fine-grained instance-level modeling and optimization. We propose a new architecture that breaks RO into a series of simpler problems, new fine-grained predictive models, and novel optimization methods that exploit these models to make effective instance-level recommendations in a hierarchical MOO framework. Evaluation using production workloads shows that our new RO system could reduce 37-72% latency and 43-78% cost at the same time, compared to the current optimizer and scheduler, while running in 0.02-0.23s. △ Less

Submitted 9 July, 2022; v1 submitted 5 July, 2022; originally announced July 2022.

NTIRE 2022 Challenge on Efficient Super-Resolution: Methods and Results

Authors: Yawei Li, Kai Zhang, Radu Timofte, Luc Van Gool, Fangyuan Kong, Mingxi Li, Songwei Liu, Zongcai Du, Ding Liu, Chenhui Zhou, Jingyi Chen, Qingrui Han, Zheyuan Li, Yingqi Liu, Xiangyu Chen, Haoming Cai, Yu Qiao, Chao Dong, Long Sun, Jinshan Pan, Yi Zhu, Zhikai Zong, Xiaoxiao Liu, Zheng Hui, Tao Yang , et al. (86 additional authors not shown)

Abstract: This paper reviews the NTIRE 2022 challenge on efficient single image super-resolution with focus on the proposed solutions and results. The task of the challenge was to super-resolve an input image with a magnification factor of $\times$4 based on pairs of low and corresponding high resolution images. The aim was to design a network for single image super-resolution that achieved improvement of e… ▽ More This paper reviews the NTIRE 2022 challenge on efficient single image super-resolution with focus on the proposed solutions and results. The task of the challenge was to super-resolve an input image with a magnification factor of $\times$4 based on pairs of low and corresponding high resolution images. The aim was to design a network for single image super-resolution that achieved improvement of efficiency measured according to several metrics including runtime, parameters, FLOPs, activations, and memory consumption while at least maintaining the PSNR of 29.00dB on DIV2K validation set. IMDN is set as the baseline for efficiency measurement. The challenge had 3 tracks including the main track (runtime), sub-track one (model complexity), and sub-track two (overall performance). In the main track, the practical runtime performance of the submissions was evaluated. The rank of the teams were determined directly by the absolute value of the average runtime on the validation set and test set. In sub-track one, the number of parameters and FLOPs were considered. And the individual rankings of the two metrics were summed up to determine a final ranking in this track. In sub-track two, all of the five metrics mentioned in the description of the challenge including runtime, parameter count, FLOPs, activations, and memory consumption were considered. Similar to sub-track one, the rankings of five metrics were summed up to determine a final ranking. The challenge had 303 registered participants, and 43 teams made valid submissions. They gauge the state-of-the-art in efficient single image super-resolution. △ Less

Submitted 11 May, 2022; originally announced May 2022.

Comments: Validation code of the baseline model is available at https://github.com/ofsoundof/IMDN. Validation of all submitted models is available at https://github.com/ofsoundof/NTIRE2022_ESR

Incommensurate magnetic order in Sm$_3$BWO$_9$ with the distorted kagome lattice

Authors: K. Y. Zeng, F. Y. Song, L. S. Ling, W. Tong, Shiliang Li, Z. M. Tian, Long Ma, Li Pi

Abstract: We investigate the magnetic ground state of Sm$_3$BWO$_9$ with the distorted kagome lattice. A magnetic phase transition is identified at $T_N=0.75$ K from the temperature dependence of specific heat. From $^{11}$B nuclear magnetic resonance (NMR) measurements, an incommensurate magnetic order is shown by the double-horn type spectra under a $c$-axis magnetic field. While, absence of line splittin… ▽ More We investigate the magnetic ground state of Sm$_3$BWO$_9$ with the distorted kagome lattice. A magnetic phase transition is identified at $T_N=0.75$ K from the temperature dependence of specific heat. From $^{11}$B nuclear magnetic resonance (NMR) measurements, an incommensurate magnetic order is shown by the double-horn type spectra under a $c$-axis magnetic field. While, absence of line splitting is observed for field oriented within the $ab$-plane, indicating the incommensurate modulation of the internal field strictly along $c$-axis. From the spin dynamics, the critical slowing down behavior is observed in the temperature dependence of $1/T_1$ with $μ_0H\perp c$-axis, which is completely absent in that with $μ_0H||c$-axis. Based on the local symmetry of $^{11}$B sites, we analyze the hyperfine coupling tensors and propose two constraints on the possible magnetic structure. The single ion anisotropy should play an important role in the determination of the contrasting ground states of Sm$_3$BWO$_9$ and Pr$_3$BWO$_9$. △ Less

Submitted 28 September, 2022; v1 submitted 5 May, 2022; originally announced May 2022.

Comments: 7 pages, 5 figures

Journal ref: Chin. Phys. Lett. 39, 107501 (2022)

Localized elasticity governs the nonlinear rheology of colloidal supercooled liquids

Authors: Dejia Kong, Wei-Ren Chen, Ke-Qi Zeng, Lionel Porcar, Zhe Wang

Abstract: We propose a microscopic picture for understanding the nonlinear rheology of supercooled liquids with soft-repulsive potentials. Based on Brownian dynamics simulations of supercooled charge-stabilized colloidal suspensions, our analysis shows that the shear thinning of viscosity (eta) at large enough shear rates (sr), expressed as eta~sr^(-lambda), originates from the evolution of the localized el… ▽ More We propose a microscopic picture for understanding the nonlinear rheology of supercooled liquids with soft-repulsive potentials. Based on Brownian dynamics simulations of supercooled charge-stabilized colloidal suspensions, our analysis shows that the shear thinning of viscosity (eta) at large enough shear rates (sr), expressed as eta~sr^(-lambda), originates from the evolution of the localized elastic region (LER). An LER is a transient region composed of the first several coordination shells of a reference particle. In response to the external shear, particles within LER undergo nearly affine displacement before the yielding of LER. The characteristic strain (gamma) and size (xi) of LER respectively depend on the shear rate by gamma~sr^epsilon and xi~sr^(-nu). Three exponents, lambda, epsilon, and nu, are related by lambda=1-epsilon=4*nu. This simple relation connects the nonlinear rheology to the elastic properties and the microscopic configurational distortion of the system. The relaxation of the LER is promoted by the large-step nonaffine particle displacement along the extensional direction of the shear geometry with the step length of 0.4 particle diameter. The elastic deformation and the relaxation of the LER are ubiquitous and succesive in the flow, which compose the fundamental process governing the bulk nonlinear viscoelasticity. We apply this model to analyze the Rheo-Small Angle Neutron Scattering data of sheared charge-stabilized colloidal suspensions. It is seen that our model well explains the neutron spectra and the rheological data. △ Less

Submitted 23 September, 2022; v1 submitted 2 May, 2022; originally announced May 2022.

Comments: 21 pages,15 figures

Journal ref: Physical Review X 12, 041006 (2022)

Data-driven control of spatiotemporal chaos with reduced-order neural ODE-based models and reinforcement learning

Authors: Kevin Zeng, Alec J. Linot, Michael D. Graham

Abstract: Deep reinforcement learning (RL) is a data-driven method capable of discovering complex control strategies for high-dimensional systems, making it promising for flow control applications. In particular, the present work is motivated by the goal of reducing energy dissipation in turbulent flows, and the example considered is the spatiotemporally chaotic dynamics of the Kuramoto-Sivashinsky equation… ▽ More Deep reinforcement learning (RL) is a data-driven method capable of discovering complex control strategies for high-dimensional systems, making it promising for flow control applications. In particular, the present work is motivated by the goal of reducing energy dissipation in turbulent flows, and the example considered is the spatiotemporally chaotic dynamics of the Kuramoto-Sivashinsky equation (KSE). A major challenge associated with RL is that substantial training data must be generated by repeatedly interacting with the target system, making it costly when the system is computationally or experimentally expensive. We mitigate this challenge in a data-driven manner by combining dimensionality reduction via an autoencoder with a neural ODE framework to obtain a low-dimensional dynamical model from just a limited data set. We substitute this data-driven reduced-order model (ROM) in place of the true system during RL training to efficiently estimate the optimal policy, which can then be deployed on the true system. For the KSE actuated with localized forcing ("jets") at four locations, we demonstrate that we are able to learn a ROM that accurately captures the actuated dynamics as well as the underlying natural dynamics just from snapshots of the KSE experiencing random actuations. Using this ROM and a control objective of minimizing dissipation and power cost, we extract a control policy from it using deep RL. We show that the ROM-based control strategy translates well to the true KSE and highlight that the RL agent discovers and stabilizes an underlying forced equilibrium solution of the KSE system. We show that this forced equilibrium captured in the ROM and discovered through RL is related to an existing known equilibrium solution of the natural KSE. △ Less

Submitted 1 May, 2022; originally announced May 2022.

Unsupervised Domain Adaptive Salient Object Detection Through Uncertainty-Aware Pseudo-Label Learning

Authors: Pengxiang Yan, Ziyi Wu, Mengmeng Liu, Kun Zeng, Liang Lin, Guanbin Li

Abstract: Recent advances in deep learning significantly boost the performance of salient object detection (SOD) at the expense of labeling larger-scale per-pixel annotations. To relieve the burden of labor-intensive labeling, deep unsupervised SOD methods have been proposed to exploit noisy labels generated by handcrafted saliency methods. However, it is still difficult to learn accurate saliency details f… ▽ More Recent advances in deep learning significantly boost the performance of salient object detection (SOD) at the expense of labeling larger-scale per-pixel annotations. To relieve the burden of labor-intensive labeling, deep unsupervised SOD methods have been proposed to exploit noisy labels generated by handcrafted saliency methods. However, it is still difficult to learn accurate saliency details from rough noisy labels. In this paper, we propose to learn saliency from synthetic but clean labels, which naturally has higher pixel-labeling quality without the effort of manual annotations. Specifically, we first construct a novel synthetic SOD dataset by a simple copy-paste strategy. Considering the large appearance differences between the synthetic and real-world scenarios, directly training with synthetic data will lead to performance degradation on real-world scenarios. To mitigate this problem, we propose a novel unsupervised domain adaptive SOD method to adapt between these two domains by uncertainty-aware self-training. Experimental results show that our proposed method outperforms the existing state-of-the-art deep unsupervised SOD methods on several benchmark datasets, and is even comparable to fully-supervised ones. △ Less

Submitted 26 February, 2022; originally announced February 2022.

Comments: Accepted by AAAI2022, code is available at https://github.com/Kinpzz/UDASOD-UPL

Banyan: A Scoped Dataflow Engine for Graph Query Service

Authors: Li Su, Xiaoming Qin, Zichao Zhang, Rui Yang, Le Xu, Indranil Gupta, Wenyuan Yu, Kai Zeng, Jingren Zhou

Abstract: Graph query services (GQS) are widely used today to interactively answer graph traversal queries on large-scale graph data. Existing graph query engines focus largely on optimizing the latency of a single query. This ignores significant challenges posed by GQS, including fine-grained control and scheduling during query execution, as well as performance isolation and load balancing in various level… ▽ More Graph query services (GQS) are widely used today to interactively answer graph traversal queries on large-scale graph data. Existing graph query engines focus largely on optimizing the latency of a single query. This ignores significant challenges posed by GQS, including fine-grained control and scheduling during query execution, as well as performance isolation and load balancing in various levels from across user to intra-query. To tackle these control and scheduling challenges, we propose a novel scoped dataflow for modeling graph traversal queries, which explicitly exposes concurrent execution and control of any subquery to the finest granularity. We implemented Banyan, an engine based on the scoped dataflow model for GQS. Banyan focuses on scaling up the performance on a single machine, and provides the ability to easily scale out. Extensive experiments on multiple benchmarks show that Banyan improves performance by up to three orders of magnitude over state-of-the-art graph query engines, while providing performance isolation and load balancing. △ Less

Submitted 25 February, 2022; originally announced February 2022.

Molecule Generation for Drug Design: a Graph Learning Perspective

Authors: Nianzu Yang, Huaijin Wu, Kaipeng Zeng, Yang Li, Junchi Yan

Abstract: Machine learning, particularly graph learning, is gaining increasing recognition for its transformative impact across various fields. One such promising application is in the realm of molecule design and discovery, notably within the pharmaceutical industry. Our survey offers a comprehensive overview of state-of-the-art methods in molecule design, particularly focusing on \emph{de novo} drug desig… ▽ More Machine learning, particularly graph learning, is gaining increasing recognition for its transformative impact across various fields. One such promising application is in the realm of molecule design and discovery, notably within the pharmaceutical industry. Our survey offers a comprehensive overview of state-of-the-art methods in molecule design, particularly focusing on \emph{de novo} drug design, which incorporates (deep) graph learning techniques. We categorize these methods into three distinct groups: \emph{i)} \emph{all-at-once}, \emph{ii)} \emph{fragment-based}, and \emph{iii)} \emph{node-by-node}. Additionally, we introduce some key public datasets and outline the commonly used evaluation metrics for both the generation and optimization of molecules. In the end, we discuss the existing challenges in this field and suggest potential directions for future research. △ Less

Submitted 8 January, 2024; v1 submitted 18 February, 2022; originally announced February 2022.

Interactive Contrastive Learning for Self-supervised Entity Alignment

Authors: Kaisheng Zeng, Zhenhao Dong, Lei Hou, Yixin Cao, Minghao Hu, Jifan Yu, Xin Lv, Juanzi Li, Ling Feng

Abstract: Self-supervised entity alignment (EA) aims to link equivalent entities across different knowledge graphs (KGs) without seed alignments. The current SOTA self-supervised EA method draws inspiration from contrastive learning, originally designed in computer vision based on instance discrimination and contrastive loss, and suffers from two shortcomings. Firstly, it puts unidirectional emphasis on pus… ▽ More Self-supervised entity alignment (EA) aims to link equivalent entities across different knowledge graphs (KGs) without seed alignments. The current SOTA self-supervised EA method draws inspiration from contrastive learning, originally designed in computer vision based on instance discrimination and contrastive loss, and suffers from two shortcomings. Firstly, it puts unidirectional emphasis on pushing sampled negative entities far away rather than pulling positively aligned pairs close, as is done in the well-established supervised EA. Secondly, KGs contain rich side information (e.g., entity description), and how to effectively leverage those information has not been adequately investigated in self-supervised EA. In this paper, we propose an interactive contrastive learning model for self-supervised EA. The model encodes not only structures and semantics of entities (including entity name, entity description, and entity neighborhood), but also conducts cross-KG contrastive learning by building pseudo-aligned entity pairs. Experimental results show that our approach outperforms previous best self-supervised results by a large margin (over 9% average improvement) and performs on par with previous SOTA supervised counterparts, demonstrating the effectiveness of the interactive contrastive learning for self-supervised EA. △ Less

Submitted 10 October, 2022; v1 submitted 17 January, 2022; originally announced January 2022.

Comments: Accepted by CIKM 2022

Performance Analysis and Power Allocation of Joint Communication and Sensing Towards Future Communication Networks

Authors: Meng Liu, Minglei Yang, Huifang Li, Kun Zeng, Zhaoming Zhang, Xiancheng Cheng, Arumugam Nallanathan, Derrick Wing Kwan Ng, Guangjian Wang

Abstract: To mitigate the radar and communication frequency overlapping caused by massive devices access, we propose a novel joint communication and sensing (JCS) system in this paper, where a micro base station (MiBS) can realize target sensing and cooperative communication simultaneously. Concretely, the MiBS, as the sensing equipment, can also serve as a full-duplex (FD) decode-and-forward (DF) relay to… ▽ More To mitigate the radar and communication frequency overlapping caused by massive devices access, we propose a novel joint communication and sensing (JCS) system in this paper, where a micro base station (MiBS) can realize target sensing and cooperative communication simultaneously. Concretely, the MiBS, as the sensing equipment, can also serve as a full-duplex (FD) decode-and-forward (DF) relay to assist the end-to-end communication. To further improve the spectrum utilization, non-orthogonal multiple access (NOMA) is adopted such that the communication between the macro base station (MaBS) and the Internet-of-Things (IoT) devices. To facilitate the performance evaluation, the exact and asymptotic outage probabilities, ergodic rates, sensing probability of the system are characterized. Subsequently, two optimal power allocation (OPA) problems of maximizing the received signal-to-interference-plus-noise ratio of sensing signal and maximizing the sum rate for communication are designed that are solved by means of the Lagrangian method and function monotonicity. The simulation results demonstrate that: 1) the proposed JCS NOMA system can accomplish both communication enhancement and sensing function under the premise of the same power consumption as non-cooperative NOMA; 2) the proposed OPA schemes manifest superiorities over a random power allocation scheme. △ Less

Submitted 9 January, 2022; originally announced January 2022.

Peta-electron volt gamma-ray emission from the Crab Nebula

Authors: The LHAASO Collaboration, Zhen Cao, F. Aharonian, Q. An, Axikegu, L. X. Bai, Y. X. Bai, Y. W. Bao, D. Bastieri, X. J. Bi, Y. J. Bi, H. Cai, J. T. Cai, Zhe Cao, J. Chang, J. F. Chang, B. M. Chen, E. S. Chen, J. Chen, Liang Chen, Liang Chen, Long Chen, M. J. Chen, M. L. Chen, Q. H. Chen , et al. (250 additional authors not shown)

Abstract: The Crab pulsar and the surrounding nebula powered by the pulsar's rotational energy through the formation and termination of a relativistic electron-positron wind is a bright source of gamma-rays carrying crucial information about this complex conglomerate. We report the detection of $γ$-rays with a spectrum showing gradual steepening over three energy decades, from $5\times 10^{-4}$ to $1.1$ pet… ▽ More The Crab pulsar and the surrounding nebula powered by the pulsar's rotational energy through the formation and termination of a relativistic electron-positron wind is a bright source of gamma-rays carrying crucial information about this complex conglomerate. We report the detection of $γ$-rays with a spectrum showing gradual steepening over three energy decades, from $5\times 10^{-4}$ to $1.1$ petaelectronvolt (PeV). The ultra-high-energy photons exhibit the presence of a PeV electron accelerator (a pevatron) with an acceleration rate exceeding 15% of the absolute theoretical limit. Assuming that unpulsed $γ$-rays are produced at the termination of the pulsar's wind, we constrain the pevatron's size, between $0.025$ and $0.1$ pc, and the magnetic field $\approx 110 μ$G. The production rate of PeV electrons, $2.5 \times 10^{36}$ erg $\rm s^{-1}$, constitutes 0.5% of the pulsar's spin-down luminosity, although we do not exclude a non-negligible contribution of PeV protons to the production of the highest energy $γ$-rays. △ Less

Submitted 11 November, 2021; originally announced November 2021.

Comments: 43 pages, 13 figures, 2 tables; Published in Science

Journal ref: Science, 2021, Vol 373, Issue 6553, pp. 425-430

Monopole Operators and Bulk-Boundary Relation in Holomorphic Topological Theories

Authors: Keyou Zeng

Abstract: We study the holomorphic twist of 3d N = 2 supersymmetric field theories, discuss the perturbative bulk local operators in general, and explicitly construct non perturbative bulk local operators for abelian gauge theories. Our construction is verified by matching the character of the algebra with the superconformal index. We test a conjectural relation between the derived center of boundary algebr… ▽ More We study the holomorphic twist of 3d N = 2 supersymmetric field theories, discuss the perturbative bulk local operators in general, and explicitly construct non perturbative bulk local operators for abelian gauge theories. Our construction is verified by matching the character of the algebra with the superconformal index. We test a conjectural relation between the derived center of boundary algebras and bulk algebras in various cases, including Landau-Ginzburg models with an arbitrary superpotential and some abelian gauge theories. In the latter cases, monopole operators appear in the derived center of a perturbative boundary algebra. We briefly discuss the higher structures in both boundary and bulk algebras. △ Less

Submitted 8 November, 2022; v1 submitted 1 November, 2021; originally announced November 2021.

Comments: 65 pages. Comments are welcome

Journal ref: SciPost Phys. 14, 153 (2023)

Improving Dither Modulation based Robust Steganography by Overflow Suppression

Authors: Kai Zeng, Kejiang Chen, Yaofei Wang, Weiming Zhang, Nenghai Yu

Abstract: Nowadays, people are sharing their pictures on online social networks (OSNs), so OSN is a good platform for Steganography. But OSNs usually perform JPEG compression on the uploaded image, which will invalidate most of the existing steganography algorithms. Recently, some works try to design robust steganography which can resist JPEG compression, such as Dither Modulation-based robust Adaptive Steg… ▽ More Nowadays, people are sharing their pictures on online social networks (OSNs), so OSN is a good platform for Steganography. But OSNs usually perform JPEG compression on the uploaded image, which will invalidate most of the existing steganography algorithms. Recently, some works try to design robust steganography which can resist JPEG compression, such as Dither Modulation-based robust Adaptive Steganography (DMAS) and Generalized dither Modulation-based robust Adaptive Steganography (GMAS). They relieve the problem that the receivers cannot extract the message correctly when the quality factor of channel JPEG compression is larger than that of cover images. However, they only can realize limited resistance to detection and compression due to robust domain selection. To overcome this problem, we meticulously explore three lossy operations in the JPEG recompression and discover that the key problem is spatial overflow. Then two preprocessing methods Overall Scaling (OS) and Specific Truncation (ST) are presented to remove overflow before message embedding as well as generate a reference image. The reference image is employed as the guidance to build asymmetric distortion for removing overflow during embedding. Experimental results show that the proposed methods significantly surpass GMAS in terms of security and achieve comparable robustness. △ Less

Submitted 16 October, 2021; originally announced October 2021.

Comments: submitted to IEEE TDSC on 18-Mar-2021

Soft gravitational radiation from multi-body collisions

Authors: Andrea Addazi, Kaiqiang Alan Zeng

Abstract: We derive a universal expression for the gravitational radiation energy spectrum $dE^{GW}/dω$ at sub-leading order emitted from a generic gravitational hard scattering of multi-particles or multi-bodies. Our result includes all $\mathcal{O}(ω)$ corrections to the gravitational radiation flux from a generic $2\rightarrow N$ collision, in both the cases of massless and massive particles/bodies. We a… ▽ More We derive a universal expression for the gravitational radiation energy spectrum $dE^{GW}/dω$ at sub-leading order emitted from a generic gravitational hard scattering of multi-particles or multi-bodies. Our result includes all $\mathcal{O}(ω)$ corrections to the gravitational radiation flux from a generic $2\rightarrow N$ collision, in both the cases of massless and massive particles/bodies. We also show the dependence of the radiation energy fluxby the quantum spin in case of particle collisions. Then, we consider the specific case of a gravitational elastic scattering of two massive bodies, i.e. $m+M\rightarrow m+M$ with $m,M$ the masses of the two bodies respectively. We demonstrate that in this case all $\mathcal{O}(ω)$ contributions to the energy flux exactly cancel each others. Nevertheless, we also show that, for a $2\rightarrow 2$ inelastic scattering, the inclusion of sub-leading soft gravitons leads to a not zero radiation flux, having a simple expression in certain asymptotic regimes. Our results can be applied to the case of Black Holes' collisions with possible testable implications in gravitational waves physics. △ Less

Submitted 9 November, 2021; v1 submitted 4 October, 2021; originally announced October 2021.

Comments: 22 pages, 2 figures

Journal ref: JHEP 11 (2021) 193

Cardinality Estimation in DBMS: A Comprehensive Benchmark Evaluation

Authors: Yuxing Han, Ziniu Wu, Peizhi Wu, Rong Zhu, Jingyi Yang, Liang Wei Tan, Kai Zeng, Gao Cong, Yanzhao Qin, Andreas Pfadler, Zhengping Qian, Jingren Zhou, Jiangneng Li, Bin Cui

Abstract: Cardinality estimation (CardEst) plays a significant role in generating high-quality query plans for a query optimizer in DBMS. In the last decade, an increasing number of advanced CardEst methods (especially ML-based) have been proposed with outstanding estimation accuracy and inference latency. However, there exists no study that systematically evaluates the quality of these methods and answer t… ▽ More Cardinality estimation (CardEst) plays a significant role in generating high-quality query plans for a query optimizer in DBMS. In the last decade, an increasing number of advanced CardEst methods (especially ML-based) have been proposed with outstanding estimation accuracy and inference latency. However, there exists no study that systematically evaluates the quality of these methods and answer the fundamental problem: to what extent can these methods improve the performance of query optimizer in real-world settings, which is the ultimate goal of a CardEst method. In this paper, we comprehensively and systematically compare the effectiveness of CardEst methods in a real DBMS. We establish a new benchmark for CardEst, which contains a new complex real-world dataset STATS and a diverse query workload STATS-CEB. We integrate multiple most representative CardEst methods into an open-source database system PostgreSQL, and comprehensively evaluate their true effectiveness in improving query plan quality, and other important aspects affecting their applicability, ranging from inference latency, model size, and training time, to update efficiency and accuracy. We obtain a number of key findings for the CardEst methods, under different data and query settings. Furthermore, we find that the widely used estimation accuracy metric(Q-Error) cannot distinguish the importance of different sub-plan queries during query optimization and thus cannot truly reflect the query plan quality generated by CardEst methods. Therefore, we propose a new metric P-Error to evaluate the performance of CardEst methods, which overcomes the limitation of Q-Error and is able to reflect the overall end-to-end performance of CardEst methods. We have made all of the benchmark data and evaluation code publicly available at https://github.com/Nathaniel-Han/End-to-End-CardEst-Benchmark. △ Less

Submitted 15 September, 2021; v1 submitted 13 September, 2021; originally announced September 2021.

Local evidence for collective spin excitations in the distorted kagome antiferromagnet Pr$_3$BWO$_9$

Authors: K. Y. Zeng, F. Y. Song, Z. M. Tian, Qiao Chen, Shun Wang, Bo Liu, Shiliang Li, L. S. Ling, W. Tong, Long Ma, Li Pi

Abstract: We report the local probe investigation of a frustrated antiferromagnet Pr$_3$BWO$_9$ with the distorted kagome lattice. Absence of magnetic order or spin freezing is indicated by the spectral analysis down to 0.3 K and specific heat measurements down to 0.09 K. The Knight shifts show an upturn behavior with the sample cooling down, which is further suppressed by external field. For the spin dynam… ▽ More We report the local probe investigation of a frustrated antiferromagnet Pr$_3$BWO$_9$ with the distorted kagome lattice. Absence of magnetic order or spin freezing is indicated by the spectral analysis down to 0.3 K and specific heat measurements down to 0.09 K. The Knight shifts show an upturn behavior with the sample cooling down, which is further suppressed by external field. For the spin dynamics, gapped spin excitation is observed from the temperature dependence of spin-lattice relaxation rates, with the gap size proportional to the applied magnetic field intensity. Comparatively, an unexpected sharp peak is observed in the nuclear spin-spin relaxation rate data at $T^*\sim 4-5$ K. These results indicate an unconventional persistent fluctuating paramagnetic ground state with antiferromagnetic collective spin excitations in the strongly frustrated spin system. △ Less

Submitted 1 November, 2021; v1 submitted 15 July, 2021; originally announced July 2021.

Comments: 6 pages, 4 figures

Journal ref: Phys. Rev. B 104, 155150 (2021)

Scaling transition from momentum stochastic gradient descent to plain stochastic gradient descent

Authors: Kun Zeng, Jinlan Liu, Zhixia Jiang, Dongpo Xu

Abstract: The plain stochastic gradient descent and momentum stochastic gradient descent have extremely wide applications in deep learning due to their simple settings and low computational complexity. The momentum stochastic gradient descent uses the accumulated gradient as the updated direction of the current parameters, which has a faster training speed. Because the direction of the plain stochastic grad… ▽ More The plain stochastic gradient descent and momentum stochastic gradient descent have extremely wide applications in deep learning due to their simple settings and low computational complexity. The momentum stochastic gradient descent uses the accumulated gradient as the updated direction of the current parameters, which has a faster training speed. Because the direction of the plain stochastic gradient descent has not been corrected by the accumulated gradient. For the parameters that currently need to be updated, it is the optimal direction, and its update is more accurate. We combine the advantages of the momentum stochastic gradient descent with fast training speed and the plain stochastic gradient descent with high accuracy, and propose a scaling transition from momentum stochastic gradient descent to plain stochastic gradient descent(TSGD) method. At the same time, a learning rate that decreases linearly with the iterations is used instead of a constant learning rate. The TSGD algorithm has a larger step size in the early stage to speed up the training, and training with a smaller step size in the later stage can steadily converge. Our experimental results show that the TSGD algorithm has faster training speed, higher accuracy and better stability. Our implementation is available at: https://github.com/kunzeng/TSGD. △ Less

Submitted 12 June, 2021; originally announced June 2021.

Comments: 16 pages, 18 figures

A decreasing scaling transition scheme from Adam to SGD

Authors: Kun Zeng, Jinlan Liu, Zhixia Jiang, Dongpo Xu

Abstract: Adaptive gradient algorithm (AdaGrad) and its variants, such as RMSProp, Adam, AMSGrad, etc, have been widely used in deep learning. Although these algorithms are faster in the early phase of training, their generalization performance is often not as good as stochastic gradient descent (SGD). Hence, a trade-off method of transforming Adam to SGD after a certain iteration to gain the merits of both… ▽ More Adaptive gradient algorithm (AdaGrad) and its variants, such as RMSProp, Adam, AMSGrad, etc, have been widely used in deep learning. Although these algorithms are faster in the early phase of training, their generalization performance is often not as good as stochastic gradient descent (SGD). Hence, a trade-off method of transforming Adam to SGD after a certain iteration to gain the merits of both algorithms is theoretically and practically significant. To that end, we propose a decreasing scaling transition scheme to achieve a smooth and stable transition from Adam to SGD, which is called DSTAdam. The convergence of the proposed DSTAdam is also proved in an online convex setting. Finally, the effectiveness of the DSTAdam is verified on the CIFAR-10/100 datasets. Our implementation is available at: https://github.com/kunzeng/DSTAdam. △ Less

Submitted 12 September, 2021; v1 submitted 12 June, 2021; originally announced June 2021.

QCD surprises: strong CP problem, neutrino mass, Dark Matter and Dark Energy

Authors: Andrea Addazi, Antonino Marciano, Roman Pasechnik, Kaiqiang Alan Zeng

Abstract: An unexpected explanation for neutrino mass, Dark Matter (DM) and Dark Energy (DE) from genuine Quantum Chromodynamics (QCD) of the Standard Model (SM) is proposed here, while the strong CP problem is resolved without any need to account for fundamental axions. We suggest that the neutrino sector can be in a double phase in the Universe: i) relativistic neutrinos, belonging to the SM; ii) non-rela… ▽ More An unexpected explanation for neutrino mass, Dark Matter (DM) and Dark Energy (DE) from genuine Quantum Chromodynamics (QCD) of the Standard Model (SM) is proposed here, while the strong CP problem is resolved without any need to account for fundamental axions. We suggest that the neutrino sector can be in a double phase in the Universe: i) relativistic neutrinos, belonging to the SM; ii) non-relativistic condensate of Majorana neutrinos. The condensate of neutrinos can provide an attractive alternative candidate for the DM, being in a cold coherent state. We will explain how neutrinos, combining into Cooper pairs, can form collective low-energy degrees of freedom, hence providing a strongly motivated candidate for the QCD (composite) axion. △ Less

Submitted 9 October, 2021; v1 submitted 4 June, 2021; originally announced June 2021.

Comments: 6 pages, 2 figures; a typo fixed; acknowledgments added; conclusions unchanged

Real-Time Quantized Image Super-Resolution on Mobile NPUs, Mobile AI 2021 Challenge: Report

Authors: Andrey Ignatov, Radu Timofte, Maurizio Denna, Abdel Younes, Andrew Lek, Mustafa Ayazoglu, Jie Liu, Zongcai Du, Jiaming Guo, Xueyi Zhou, Hao Jia, Youliang Yan, Zexin Zhang, Yixin Chen, Yunbo Peng, Yue Lin, Xindong Zhang, Hui Zeng, Kun Zeng, Peirong Li, Zhihuang Liu, Shiqi Xue, Shengpeng Wang

Abstract: Image super-resolution is one of the most popular computer vision problems with many important applications to mobile devices. While many solutions have been proposed for this task, they are usually not optimized even for common smartphone AI hardware, not to mention more constrained smart TV platforms that are often supporting INT8 inference only. To address this problem, we introduce the first M… ▽ More Image super-resolution is one of the most popular computer vision problems with many important applications to mobile devices. While many solutions have been proposed for this task, they are usually not optimized even for common smartphone AI hardware, not to mention more constrained smart TV platforms that are often supporting INT8 inference only. To address this problem, we introduce the first Mobile AI challenge, where the target is to develop an end-to-end deep learning-based image super-resolution solutions that can demonstrate a real-time performance on mobile or edge NPUs. For this, the participants were provided with the DIV2K dataset and trained quantized models to do an efficient 3X image upscaling. The runtime of all models was evaluated on the Synaptics VS680 Smart Home board with a dedicated NPU capable of accelerating quantized neural networks. The proposed solutions are fully compatible with all major mobile AI accelerators and are capable of reconstructing Full HD images under 40-60 ms while achieving high fidelity results. A detailed description of all models developed in the challenge is provided in this paper. △ Less

Submitted 17 May, 2021; originally announced May 2021.

Comments: Mobile AI 2021 Workshop and Challenges: https://ai-benchmark.com/workshops/mai/2021/

Nanoscale Non-Destructive Ferroelectric Characterization with Non-Contact Heterodyne Electrostrain Force Microscopy

Authors: Qibin Zeng, Qicheng Huang, Hongli Wang, Caiwen Li, Zhen Fan, Deyang Chen, Yuan Cheng, Kaiyang Zeng

Abstract: Perceiving nanoscale ferroelectric phenomena from real space is of great importance for elucidating underlying ferroelectric physics. During the past decades, nanoscale ferroelectric characterization has mainly relied on the Piezoresponse Force Microscopy (PFM), however, the fundamental limitations of PFM have made the nanoscale ferroelectric studies encounter significant bottlenecks. In this stud… ▽ More Perceiving nanoscale ferroelectric phenomena from real space is of great importance for elucidating underlying ferroelectric physics. During the past decades, nanoscale ferroelectric characterization has mainly relied on the Piezoresponse Force Microscopy (PFM), however, the fundamental limitations of PFM have made the nanoscale ferroelectric studies encounter significant bottlenecks. In this study, a high-resolution non-contact ferroelectric measurement, named Non-Contact Heterodyne Electrostrain Force Microscopy (NC-HEsFM), has been introduced firstly. It has been unambiguously demonstrated that NC-HEsFM can operate on multiple eigenmodes to perform ideal high-resolution ferroelectric domain mapping, standard ferroelectric hysteresis loop measurement and controllable domain manipulation. With using quartz tuning fork (QTF) sensor and heterodyne detection, NC-HEsFM shows an unprecedented capability in achieving real non-contact yet non-destructive ferroelectric characterization with negligible electrostatic force effect. It is believed that NC-HEsFM can be extensively used in various ferroelectric or piezoelectric studies with providing substantially improved characterization performance. Meanwhile, the QTF-based force detection makes NC-HEsFM highly compatible for high-vacuum and low-temperature environments, providing ideal conditions for achieving an ultra-high spatial resolution to investigate the most intrinsic ferroelectric phenomena. △ Less

Submitted 7 May, 2021; originally announced May 2021.

Comments: Main Text 30 pages, 5 figures; Supplemetary Materials:18 pages, 10 Figures and 1 Table

Journal ref: Small Methods 2021, 2100639

A Unified Transferable Model for ML-Enhanced DBMS

Authors: Ziniu Wu, Pei Yu, Peilun Yang, Rong Zhu, Yuxing Han, Yaliang Li, Defu Lian, Kai Zeng, Jingren Zhou

Abstract: Recently, the database management system (DBMS) community has witnessed the power of machine learning (ML) solutions for DBMS tasks. Despite their promising performance, these existing solutions can hardly be considered satisfactory. First, these ML-based methods in DBMS are not effective enough because they are optimized on each specific task, and cannot explore or understand the intrinsic connec… ▽ More Recently, the database management system (DBMS) community has witnessed the power of machine learning (ML) solutions for DBMS tasks. Despite their promising performance, these existing solutions can hardly be considered satisfactory. First, these ML-based methods in DBMS are not effective enough because they are optimized on each specific task, and cannot explore or understand the intrinsic connections between tasks. Second, the training process has serious limitations that hinder their practicality, because they need to retrain the entire model from scratch for a new DB. Moreover, for each retraining, they require an excessive amount of training data, which is very expensive to acquire and unavailable for a new DB. We propose to explore the transferabilities of the ML methods both across tasks and across DBs to tackle these fundamental drawbacks. In this paper, we propose a unified model MTMLF that uses a multi-task training procedure to capture the transferable knowledge across tasks and a pre-train fine-tune procedure to distill the transferable meta knowledge across DBs. We believe this paradigm is more suitable for cloud DB service, and has the potential to revolutionize the way how ML is used in DBMS. Furthermore, to demonstrate the predicting power and viability of MTMLF, we provide a concrete and very promising case study on query optimization tasks. Last but not least, we discuss several concrete research opportunities along this line of work. △ Less

Submitted 25 November, 2021; v1 submitted 5 May, 2021; originally announced May 2021.

Comments: 10 pages

Pushing it out of the Way: Interactive Visual Navigation

Authors: Kuo-Hao Zeng, Luca Weihs, Ali Farhadi, Roozbeh Mottaghi

Abstract: We have observed significant progress in visual navigation for embodied agents. A common assumption in studying visual navigation is that the environments are static; this is a limiting assumption. Intelligent navigation may involve interacting with the environment beyond just moving forward/backward and turning left/right. Sometimes, the best way to navigate is to push something out of the way. I… ▽ More We have observed significant progress in visual navigation for embodied agents. A common assumption in studying visual navigation is that the environments are static; this is a limiting assumption. Intelligent navigation may involve interacting with the environment beyond just moving forward/backward and turning left/right. Sometimes, the best way to navigate is to push something out of the way. In this paper, we study the problem of interactive navigation where agents learn to change the environment to navigate more efficiently to their goals. To this end, we introduce the Neural Interaction Engine (NIE) to explicitly predict the change in the environment caused by the agent's actions. By modeling the changes while planning, we find that agents exhibit significant improvements in their navigational capabilities. More specifically, we consider two downstream tasks in the physics-enabled, visually rich, AI2-THOR environment: (1) reaching a target while the path to the target is blocked (2) moving an object to a target location by pushing it. For both tasks, agents equipped with an NIE significantly outperform agents without the understanding of the effect of the actions indicating the benefits of our approach. △ Less

Submitted 1 May, 2021; v1 submitted 28 April, 2021; originally announced April 2021.

Comments: 14 pages, 13 figures, CVPR 2021, https://prior.allenai.org/projects/interactive-visual-navigation, https://youtu.be/GvTI5XCMvPw

Symmetry reduction for deep reinforcement learning active control of chaotic spatiotemporal dynamics

Authors: Kevin Zeng, Michael D. Graham

Abstract: Deep reinforcement learning (RL) is a data-driven, model-free method capable of discovering complex control strategies for macroscopic objectives in high-dimensional systems, making its application towards flow control promising. Many systems of flow control interest possess symmetries that, when neglected, can significantly inhibit the learning and performance of a naive deep RL approach. Using a… ▽ More Deep reinforcement learning (RL) is a data-driven, model-free method capable of discovering complex control strategies for macroscopic objectives in high-dimensional systems, making its application towards flow control promising. Many systems of flow control interest possess symmetries that, when neglected, can significantly inhibit the learning and performance of a naive deep RL approach. Using a test-bed consisting of the Kuramoto-Sivashinsky Equation (KSE), equally spaced actuators, and a goal of minimizing dissipation and power cost, we demonstrate that by moving the deep RL problem to a symmetry-reduced space, we can alleviate limitations inherent in the naive application of deep RL. We demonstrate that symmetry-reduced deep RL yields improved data efficiency as well as improved control policy efficacy compared to policies found by naive deep RL. Interestingly, the policy learned by the the symmetry aware control agent drives the system toward an equilibrium state of the forced KSE that is connected by continuation to an equilibrium of the unforced KSE, despite having been given no explicit information regarding its existence. I.e., to achieve its goal, the RL algorithm discovers and stabilizes an equilibrium state of the system. Finally, we demonstrate that the symmetry-reduced control policy is robust to observation and actuation signal noise, as well as to system parameters it has not observed before. △ Less

Submitted 9 April, 2021; originally announced April 2021.

Comments: Submitted to Physical Review E

Journal ref: Phys. Rev. E 104, 014210 (2021)

Calibration of the Air Shower Energy Scale of the Water and Air Cherenkov Techniques in the LHAASO experiment

Authors: F. Aharonian, Q. An, Axikegu, L. X. Bai, Y. X. Bai, Y. W. Bao, D. Bastieri, X. J. Bi, Y. J. Bi, H. Cai, J. T. Cai, Z. Cao Z. Cao, J. Chang, J. F. Chang, X. C. Chang, B. M. Chen, J. Chen, L. Chen, L. Chen, L. Chen, M. J. Chen, M. L. Chen, Q. H. Chen, S. H. Chen, S. Z. Chen , et al. (233 additional authors not shown)

Abstract: The Wide Field-of-View Cherenkov Telescope Array (WFCTA) and the Water Cherenkov Detector Arrays (WCDA) of LHAASO are designed to work in combination for measuring the energy spectra of various cosmic ray species over a very wide energy range from a few TeV to 10 PeV. The energy calibration of WCDA can be achieved with a proven technique of measuring the westward shift of the Moon shadow of galact… ▽ More The Wide Field-of-View Cherenkov Telescope Array (WFCTA) and the Water Cherenkov Detector Arrays (WCDA) of LHAASO are designed to work in combination for measuring the energy spectra of various cosmic ray species over a very wide energy range from a few TeV to 10 PeV. The energy calibration of WCDA can be achieved with a proven technique of measuring the westward shift of the Moon shadow of galactic cosmic rays due to the geomagnetic field. This deflection angle $Δ$ is inversely proportional to the energy of the cosmic rays. The precise measurements of the shifts by WCDA allows us to calibrate its energy scale for energies as high as 35 TeV. The energy scale measured by WCDA can be used to cross calibrate the energy reconstructed by WFCTA, which spans the whole energy range up to 10 PeV. In this work, we will demonstrate the feasibility of the method using the data collected from April 2019 to January 2020 by the WFCTA array and WCDA-1 detector, the first of the three water Cherenkov ponds, already commissioned at LHAASO site. △ Less

Submitted 13 April, 2021; v1 submitted 11 April, 2021; originally announced April 2021.

Journal ref: Phys. Rev. D 104, 062007 (2021)

When Face Recognition Meets Occlusion: A New Benchmark

Authors: Baojin Huang, Zhongyuan Wang, Guangcheng Wang, Kui Jiang, Kangli Zeng, Zhen Han, Xin Tian, Yuhong Yang

Abstract: The existing face recognition datasets usually lack occlusion samples, which hinders the development of face recognition. Especially during the COVID-19 coronavirus epidemic, wearing a mask has become an effective means of preventing the virus spread. Traditional CNN-based face recognition models trained on existing datasets are almost ineffective for heavy occlusion. To this end, we pioneer a sim… ▽ More The existing face recognition datasets usually lack occlusion samples, which hinders the development of face recognition. Especially during the COVID-19 coronavirus epidemic, wearing a mask has become an effective means of preventing the virus spread. Traditional CNN-based face recognition models trained on existing datasets are almost ineffective for heavy occlusion. To this end, we pioneer a simulated occlusion face recognition dataset. In particular, we first collect a variety of glasses and masks as occlusion, and randomly combine the occlusion attributes (occlusion objects, textures,and colors) to achieve a large number of more realistic occlusion types. We then cover them in the proper position of the face image with the normal occlusion habit. Furthermore, we reasonably combine original normal face images and occluded face images to form our final dataset, termed as Webface-OCC. It covers 804,704 face images of 10,575 subjects, with diverse occlusion types to ensure its diversity and stability. Extensive experiments on public datasets show that the ArcFace retrained by our dataset significantly outperforms the state-of-the-arts. Webface-OCC is available at https://github.com/Baojin-Huang/Webface-OCC. △ Less

Submitted 3 March, 2021; originally announced March 2021.

Comments: Accepted by ICASSP 2021

REPOSE: Distributed Top-k Trajectory Similarity Search with Local Reference Point Tries

Authors: Bolong Zheng, Lianggui Weng, Xi Zhao, Kai Zeng, Xiaofang Zhou, Christian S. Jensen

Abstract: Trajectory similarity computation is a fundamental component in a variety of real-world applications, such as ridesharing, road planning, and transportation optimization. Recent advances in mobile devices have enabled an unprecedented increase in the amount of available trajectory data such that efficient query processing can no longer be supported by a single machine. As a result, means of perfor… ▽ More Trajectory similarity computation is a fundamental component in a variety of real-world applications, such as ridesharing, road planning, and transportation optimization. Recent advances in mobile devices have enabled an unprecedented increase in the amount of available trajectory data such that efficient query processing can no longer be supported by a single machine. As a result, means of performing distributed in-memory trajectory similarity search are called for. However, existing distributed proposals suffer from either computing resource waste or are unable to support the range of similarity measures that are being used. We propose a distributed in-memory management framework called REPOSE for processing top-k trajectory similarity queries on Spark. We develop a reference point trie (RP-Trie) index to organize trajectory data for local search. In addition, we design a novel heterogeneous global partitioning strategy to eliminate load imbalance in distributed settings. We report on extensive experiments with real-world data that offer insight into the performance of the solution, and show that the solution is capable of outperforming the state-of-the-art proposals. △ Less

Submitted 26 January, 2021; v1 submitted 21 January, 2021; originally announced January 2021.

Strong Phonon-Cavity Coupling and Parametric Interaction in a Single Microcantilever under Ambient Conditions

Authors: Qibin Zeng, Kaiyang Zeng

Abstract: Parametrically tuning the oscillation dynamics of coupled micro/nano-mechanical resonators through a mechanical pump scheme has recently attracted great attentions from fundamental physics to various applications. However, the special design of the coupled resonators and low dissipation operation conditions significantly restrict the wide application of this tuning technique. In this study, we wil… ▽ More Parametrically tuning the oscillation dynamics of coupled micro/nano-mechanical resonators through a mechanical pump scheme has recently attracted great attentions from fundamental physics to various applications. However, the special design of the coupled resonators and low dissipation operation conditions significantly restrict the wide application of this tuning technique. In this study, we will show that, under ambient conditions, mechanical pump can parametrically control the oscillation dynamics in a single commercial microcantilever resonator. A strong phonon-cavity coupling with cooperativity up to ~398 and normal-mode splitting are observed in the microcantilever. The strong parametric interaction of the phonon-cavity coupling enables using mechanical pump to achieve a 43 dB (3 dB) parametric amplification (cooling). By utilizing mechanical pump, the force sensitivity and signal-to-noise ratio of the frequency-modulation Kelvin Probe Force Microscopy can be significantly improved in the ambient environment. Furthermore, both single-mode and two-mode thermomechanical noise squeezing states can be created in the microcantilever via applying mechanical pump. △ Less

Submitted 18 March, 2021; v1 submitted 5 January, 2021; originally announced January 2021.

Comments: Main Text includes 25 pages, 5 figures and SI includes 8 pages, 4 figures

Journal ref: Journal of Physics D: Applied Physics, 2021, 54:475307

A Pluggable Learned Index Method via Sampling and Gap Insertion

Authors: Yaliang Li, Daoyuan Chen, Bolin Ding, Kai Zeng, Jingren Zhou

Abstract: Database indexes facilitate data retrieval and benefit broad applications in real-world systems. Recently, a new family of index, named learned index, is proposed to learn hidden yet useful data distribution and incorporate such information into the learning of indexes, which leads to promising performance improvements. However, the "learning" process of learned indexes is still under-explored. In… ▽ More Database indexes facilitate data retrieval and benefit broad applications in real-world systems. Recently, a new family of index, named learned index, is proposed to learn hidden yet useful data distribution and incorporate such information into the learning of indexes, which leads to promising performance improvements. However, the "learning" process of learned indexes is still under-explored. In this paper, we propose a formal machine learning based framework to quantify the index learning objective, and study two general and pluggable techniques to enhance the learning efficiency and learning effectiveness for learned indexes. With the guidance of the formal learning objective, we can efficiently learn index by incorporating the proposed sampling technique, and learn precise index with enhanced generalization ability brought by the proposed result-driven gap insertion technique. We conduct extensive experiments on real-world datasets and compare several indexing methods from the perspective of the index learning objective. The results show the ability of the proposed framework to help to design suitable indexes for different scenarios. Further, we demonstrate the effectiveness of the proposed sampling technique, which achieves up to 78x construction speedup while maintaining non-degraded indexing performance. Finally, we show the gap insertion technique can enhance both the static and dynamic indexing performances of existing learned index methods with up to 1.59x query speedup. We will release our codes and processed data for further study, which can enable more exploration of learned indexes from both the perspectives of machine learning and database. △ Less

Submitted 4 January, 2021; originally announced January 2021.

BayesCard: Revitilizing Bayesian Frameworks for Cardinality Estimation

Authors: Ziniu Wu, Amir Shaikhha, Rong Zhu, Kai Zeng, Yuxing Han, Jingren Zhou

Abstract: Cardinality estimation (CardEst) is an essential component in query optimizers and a fundamental problem in DBMS. A desired CardEst method should attain good algorithm performance, be stable to varied data settings, and be friendly to system deployment. However, no existing CardEst method can fulfill the three criteria at the same time. Traditional methods often have significant algorithm drawback… ▽ More Cardinality estimation (CardEst) is an essential component in query optimizers and a fundamental problem in DBMS. A desired CardEst method should attain good algorithm performance, be stable to varied data settings, and be friendly to system deployment. However, no existing CardEst method can fulfill the three criteria at the same time. Traditional methods often have significant algorithm drawbacks such as large estimation errors. Recently proposed deep learning based methods largely improve the estimation accuracy but their performance can be greatly affected by data and often difficult for system deployment. In this paper, we revitalize the Bayesian networks (BN) for CardEst by incorporating the techniques of probabilistic programming languages. We present BayesCard, the first framework that inherits the advantages of BNs, i.e., high estimation accuracy and interpretability, while overcomes their drawbacks, i.e. low structure learning and inference efficiency. This makes BayesCard a perfect candidate for commercial DBMS deployment. Our experimental results on several single-table and multi-table benchmarks indicate BayesCard's superiority over existing state-of-the-art CardEst methods: BayesCard achieves comparable or better accuracy, 1-2 orders of magnitude faster inference time, 1-3 orders faster training time, 1-3 orders smaller model size, and 1-2 orders faster updates. Meanwhile, BayesCard keeps stable performance when varying data with different settings. We also deploy BayesCard into PostgreSQL. On the IMDB benchmark workload, it improves the end-to-end query time by 13.3%, which is very close to the optimal result of 14.2% using an oracle of true cardinality. △ Less

Submitted 2 February, 2021; v1 submitted 29 December, 2020; originally announced December 2020.

Construction and On-site Performance of the LHAASO WFCTA Camera

Authors: F. Aharonian, Q. An, Axikegu, L. X. Bai, Y. X. Bai, Y. W. Bao, D. Bastieri, X. J. Bi, Y. J. Bi, H. Cai, J. T. Cai, Z. Cao, Z. Cao, J. Chang, J. F. Chang, X. C. Chang, B. M. Chen, J. Chen, L. Chen, L. Chen, L. Chen, M. J. Chen, M. L. Chen, Q. H. Chen, S. H. Chen , et al. (234 additional authors not shown)

Abstract: The focal plane camera is the core component of the Wide Field-of-view Cherenkov/fluorescence Telescope Array (WFCTA) of the Large High-Altitude Air Shower Observatory (LHAASO). Because of the capability of working under moonlight without aging, silicon photomultipliers (SiPM) have been proven to be not only an alternative but also an improvement to conventional photomultiplier tubes (PMT) in this… ▽ More The focal plane camera is the core component of the Wide Field-of-view Cherenkov/fluorescence Telescope Array (WFCTA) of the Large High-Altitude Air Shower Observatory (LHAASO). Because of the capability of working under moonlight without aging, silicon photomultipliers (SiPM) have been proven to be not only an alternative but also an improvement to conventional photomultiplier tubes (PMT) in this application. Eighteen SiPM-based cameras with square light funnels have been built for WFCTA. The telescopes have collected more than 100 million cosmic ray events and preliminary results indicate that these cameras are capable of working under moonlight. The characteristics of the light funnels and SiPMs pose challenges (e.g. dynamic range, dark count rate, assembly techniques). In this paper, we present the design features, manufacturing techniques and performances of these cameras. Finally, the test facilities, the test methods and results of SiPMs in the cameras are reported here. △ Less

Submitted 4 July, 2021; v1 submitted 29 December, 2020; originally announced December 2020.

Comments: 45 pages, 21 figures, article

Journal ref: Eur. Phys. J. C 81, 657 (2021)

FLAT: Fast, Lightweight and Accurate Method for Cardinality Estimation

Authors: Rong Zhu, Ziniu Wu, Yuxing Han, Kai Zeng, Andreas Pfadler, Zhengping Qian, Jingren Zhou, Bin Cui

Abstract: Query optimizers rely on accurate cardinality estimation (CardEst) to produce good execution plans. The core problem of CardEst is how to model the rich joint distribution of attributes in an accurate and compact manner. Despite decades of research, existing methods either over simplify the models only using independent factorization which leads to inaccurate estimates, or over complicate them by… ▽ More Query optimizers rely on accurate cardinality estimation (CardEst) to produce good execution plans. The core problem of CardEst is how to model the rich joint distribution of attributes in an accurate and compact manner. Despite decades of research, existing methods either over simplify the models only using independent factorization which leads to inaccurate estimates, or over complicate them by lossless conditional factorization without any independent assumption which results in slow probability computation. In this paper, we propose FLAT, a CardEst method that is simultaneously fast in probability computation, lightweight in model size and accurate in estimation quality. The key idea of FLAT is a novel unsupervised graphical model, called FSPN. It utilizes both independent and conditional factorization to adaptively model different levels of attributes correlations, and thus dovetails their advantages. FLAT supports efficient online probability computation in near liner time on the underlying FSPN model, provides effective offline model construction and enables incremental model updates. It can estimate cardinality for both single table queries and multi table join queries. Extensive experimental study demonstrates the superiority of FLAT over existing CardEst methods on well known IMDB benchmarks: FLAT achieves 1 to 5 orders of magnitude better accuracy, 1 to 3 orders of magnitude faster probability computation speed and 1 to 2 orders of magnitude lower storage cost. We also integrate FLAT into Postgres to perform an end to end test. It improves the query execution time by 12.9% on the benchmark workload, which is very close to the optimal result 14.2% using the true cardinality. △ Less

Submitted 19 May, 2021; v1 submitted 17 November, 2020; originally announced November 2020.

Comments: Technical Report of the FLAT Paper in VLDB 2021

FSPN: A New Class of Probabilistic Graphical Model

Authors: Ziniu Wu, Rong Zhu, Andreas Pfadler, Yuxing Han, Jiangneng Li, Zhengping Qian, Kai Zeng, Jingren Zhou

Abstract: We introduce factorize sum split product networks (FSPNs), a new class of probabilistic graphical models (PGMs). FSPNs are designed to overcome the drawbacks of existing PGMs in terms of estimation accuracy and inference efficiency. Specifically, Bayesian networks (BNs) have low inference speed and performance of tree structured sum product networks(SPNs) significantly degrades in presence of high… ▽ More We introduce factorize sum split product networks (FSPNs), a new class of probabilistic graphical models (PGMs). FSPNs are designed to overcome the drawbacks of existing PGMs in terms of estimation accuracy and inference efficiency. Specifically, Bayesian networks (BNs) have low inference speed and performance of tree structured sum product networks(SPNs) significantly degrades in presence of highly correlated variables. FSPNs absorb their advantages by adaptively modeling the joint distribution of variables according to their dependence degree, so that one can simultaneously attain the two desirable goals: high estimation accuracy and fast inference speed. We present efficient probability inference and structure learning algorithms for FSPNs, along with a theoretical analysis and extensive evaluation evidence. Our experimental results on synthetic and benchmark datasets indicate the superiority of FSPN over other PGMs. △ Less

Submitted 20 November, 2020; v1 submitted 17 November, 2020; originally announced November 2020.

Comments: 16 pages

The observation of the Crab Nebula with LHAASO-KM2A for the performance study

Authors: F. Aharonian, Q. An, Axikegu, L. X. Bai, Y. X. Bai, Y. W. Bao, D. Bastieri, X. J. Bi, Y. J. Bi, H. Cai, J. T. Cai, Z. Cao, Z. Cao, J. Chang, J. F. Chang, X. C. Chang, B. M. Chen, J. Chen, L. Chen, L. Chen, L. Chen, M. J. Chen, M. L. Chen, Q. H. Chen, S. H. Chen , et al. (234 additional authors not shown)

Abstract: As a sub-array of the Large High Altitude Air Shower Observatory (LHAASO), KM2A is mainly designed to cover a large fraction of the northern sky to hunt for gamma-ray sources at energies above 10 TeV. Even though the detector construction is still underway, a half of the KM2A array has been operating stably since the end of 2019. In this paper, we present the pipeline of KM2A data analysis and the… ▽ More As a sub-array of the Large High Altitude Air Shower Observatory (LHAASO), KM2A is mainly designed to cover a large fraction of the northern sky to hunt for gamma-ray sources at energies above 10 TeV. Even though the detector construction is still underway, a half of the KM2A array has been operating stably since the end of 2019. In this paper, we present the pipeline of KM2A data analysis and the first observation on the Crab Nebula, a standard candle in very high energy gamma-ray astronomy. We detect gamma-ray signals from the Crab Nebula in both energy ranges of 10$-$100 TeV and $>$100 TeV with high significance, by analyzing the KM2A data of 136 live days between December 2019 and May 2020. With the observations, we test the detector performance including angular resolution, pointing accuracy and cosmic ray background rejection power. The energy spectrum of the Crab Nebula in the energy range 10-250 TeV fits well with a single power-law function dN/dE =(1.13$\pm$0.05$_{stat}$$\pm$0.08$_{sys}$)$\times$10$^{-14}$$\cdot$(E/20TeV)$^{-3.09\pm0.06_{stat}\pm0.02_{sys}}$ cm$^{-2}$ s$^{-1}$ TeV$^{-1}$. It is consistent with previous measurements by other experiments. This opens a new window of gamma-ray astronomy above 0.1 PeV through which ultrahigh-energy gamma-ray new phenomena, such as cosmic PeVatrons, might be discovered. △ Less

Submitted 13 October, 2020; originally announced October 2020.

Comments: 13 pages, 15 figures,submitted to CPC

Journal ref: Chinese Phys. C 45 025002 (2021)

MicroRec: Efficient Recommendation Inference by Hardware and Data Structure Solutions

Authors: Wenqi Jiang, Zhenhao He, Shuai Zhang, Thomas B. Preußer, Kai Zeng, Liang Feng, Jiansong Zhang, Tongxuan Liu, Yong Li, Jingren Zhou, Ce Zhang, Gustavo Alonso

Abstract: Deep neural networks are widely used in personalized recommendation systems. Unlike regular DNN inference workloads, recommendation inference is memory-bound due to the many random memory accesses needed to lookup the embedding tables. The inference is also heavily constrained in terms of latency because producing a recommendation for a user must be done in about tens of milliseconds. In this pape… ▽ More Deep neural networks are widely used in personalized recommendation systems. Unlike regular DNN inference workloads, recommendation inference is memory-bound due to the many random memory accesses needed to lookup the embedding tables. The inference is also heavily constrained in terms of latency because producing a recommendation for a user must be done in about tens of milliseconds. In this paper, we propose MicroRec, a high-performance inference engine for recommendation systems. MicroRec accelerates recommendation inference by (1) redesigning the data structures involved in the embeddings to reduce the number of lookups needed and (2) taking advantage of the availability of High-Bandwidth Memory (HBM) in FPGA accelerators to tackle the latency by enabling parallel lookups. We have implemented the resulting design on an FPGA board including the embedding lookup step as well as the complete inference process. Compared to the optimized CPU baseline (16 vCPU, AVX2-enabled), MicroRec achieves 13.8~14.7x speedup on embedding lookup alone and 2.5$~5.4x speedup for the entire recommendation inference in terms of throughput. As for latency, CPU-based engines needs milliseconds for inferring a recommendation while MicroRec only takes microseconds, a significant advantage in real-time recommendation systems. △ Less

Submitted 19 February, 2021; v1 submitted 12 October, 2020; originally announced October 2020.

Comments: Accepted by MLSys'21 (the 4th Conference on Machine Learning and Systems)

Tempura: A General Cost Based Optimizer Framework for Incremental Data Processing (Extended Version)

Authors: Zuozhi Wang, Kai Zeng, Botong Huang, Wei Chen, Xiaozong Cui, Bo Wang, Ji Liu, Liya Fan, Dachuan Qu, Zhenyu Hou, Tao Guan, Chen Li, Jingren Zhou

Abstract: Incremental processing is widely-adopted in many applications, ranging from incremental view maintenance, stream computing, to recently emerging progressive data warehouse and intermittent query processing. Despite many algorithms developed on this topic, none of them can produce an incremental plan that always achieves the best performance, since the optimal plan is data dependent. In this paper,… ▽ More Incremental processing is widely-adopted in many applications, ranging from incremental view maintenance, stream computing, to recently emerging progressive data warehouse and intermittent query processing. Despite many algorithms developed on this topic, none of them can produce an incremental plan that always achieves the best performance, since the optimal plan is data dependent. In this paper, we develop a novel cost-based optimizer framework, called Tempura, for optimizing incremental data processing. We propose an incremental query planning model called TIP based on the concept of time-varying relations, which can formally model incremental processing in its most general form. We give a full specification of Tempura, which can not only unify various existing techniques to generate an optimal incremental plan, but also allow the developer to add their rewrite rules. We study how to explore the plan space and search for an optimal incremental plan. We conduct a thorough experimental evaluation of Tempura in various incremental processing scenarios to show its effectiveness and efficiency. △ Less

Submitted 28 September, 2020; originally announced September 2020.

Comments: 19 pages, 8 figures. The short version of this paper is accepeted at VLDB 2021 (PVLDB Volume 14, Issue 1)

ACM Class: H.2.4

NANOGrav results and Dark First Order Phase Transitions

Authors: Andrea Addazi, Yi-Fu Cai, Qingyu Gan, Antonino Marciano, Kaiqiang Zeng

Abstract: The recent NANOGrav evidence of a common-source stochastic background provides a hint to Gravitational Waves (GW) radiation from the Early Universe. We show that this result can be interpreted as a GW spectrum produced from First Order Phase Transitions (FOPTs) around a temperature in the KeV-MeV window. Such a class of FOPTs at temperatures much below the electroweak scale can be naturally envisa… ▽ More The recent NANOGrav evidence of a common-source stochastic background provides a hint to Gravitational Waves (GW) radiation from the Early Universe. We show that this result can be interpreted as a GW spectrum produced from First Order Phase Transitions (FOPTs) around a temperature in the KeV-MeV window. Such a class of FOPTs at temperatures much below the electroweak scale can be naturally envisaged in several Warm Dark Matter models such as Majoron Dark Matter. △ Less

Submitted 23 September, 2020; v1 submitted 22 September, 2020; originally announced September 2020.

Comments: More details and results on possible WDM-inspired GW spectra added, including more recent numerical tools in the subject. New references added. The main conclusions are substantially unchanged

Journal ref: Sci.China Phys.Mech.Astron. 64, 290411 (2021)

AllenAct: A Framework for Embodied AI Research

Authors: Luca Weihs, Jordi Salvador, Klemen Kotar, Unnat Jain, Kuo-Hao Zeng, Roozbeh Mottaghi, Aniruddha Kembhavi

Abstract: The domain of Embodied AI, in which agents learn to complete tasks through interaction with their environment from egocentric observations, has experienced substantial growth with the advent of deep reinforcement learning and increased interest from the computer vision, NLP, and robotics communities. This growth has been facilitated by the creation of a large number of simulated environments (such… ▽ More The domain of Embodied AI, in which agents learn to complete tasks through interaction with their environment from egocentric observations, has experienced substantial growth with the advent of deep reinforcement learning and increased interest from the computer vision, NLP, and robotics communities. This growth has been facilitated by the creation of a large number of simulated environments (such as AI2-THOR, Habitat and CARLA), tasks (like point navigation, instruction following, and embodied question answering), and associated leaderboards. While this diversity has been beneficial and organic, it has also fragmented the community: a huge amount of effort is required to do something as simple as taking a model trained in one environment and testing it in another. This discourages good science. We introduce AllenAct, a modular and flexible learning framework designed with a focus on the unique requirements of Embodied AI research. AllenAct provides first-class support for a growing collection of embodied environments, tasks and algorithms, provides reproductions of state-of-the-art models and includes extensive documentation, tutorials, start-up code, and pre-trained models. We hope that our framework makes Embodied AI more accessible and encourages new researchers to join this exciting area. The framework can be accessed at: https://allenact.org/ △ Less

Submitted 28 August, 2020; originally announced August 2020.

Consumer UAV Cybersecurity Vulnerability Assessment Using Fuzzing Tests

Authors: David Rudo, Dr. Kai Zeng

Abstract: Unmanned Aerial Vehicles (UAVs) are remote-controlled vehicles capable of flight and are present in a variety of environments from military operations to domestic enjoyment. These vehicles are great assets, but just as their pilot can control them remotely, cyberattacks can be executed in a similar manner. Cyber attacks on UAVs can bring a plethora of issues to physical and virtual systems. Such m… ▽ More Unmanned Aerial Vehicles (UAVs) are remote-controlled vehicles capable of flight and are present in a variety of environments from military operations to domestic enjoyment. These vehicles are great assets, but just as their pilot can control them remotely, cyberattacks can be executed in a similar manner. Cyber attacks on UAVs can bring a plethora of issues to physical and virtual systems. Such malfunctions are capable of giving an attacker the ability to steal data, incapacitate the UAV, or hijack the UAV. To mitigate such attacks, it is necessary to identify and patch vulnerabilities that may be maliciously exploited. In this paper, a new UAV vulnerability is explored with related UAV security practices identified for possible exploitation using large streams of data sent at specific ports. The more in-depth model involves strings of data involving FTP-specific keywords sent to the UAV's FTP port in the form of a fuzzing test and launching thousands of packets at other ports on the UAV as well. During these tests, virtual and physical systems are monitored extensively to identify specific patterns and vulnerabilities. This model is applied to a Parrot Bebop 2, which accurately portrays a UAV that had their network compromised by an attacker and portrays many lower-end UAV models for domestic use. During testings, the Parrot Bebop 2 is monitored for degradation in GPS performance, video speed, the UAV's reactivity to the pilot, motor function, and the accuracy of the UAV's sensor data. All these points of monitoring give a comprehensive view of the UAV's reaction to each individual test. In this paper, countermeasures to combat the exploitation of this vulnerability will be discussed as well as possible attacks that can branch from the fuzzing tests. △ Less

Submitted 8 August, 2020; originally announced August 2020.

Comments: 10 pages, 9 figures

NMR study of the spin correlations in the $S=1$ armchair chain Ni$_2$NbBO$_6$

Authors: K. Y. Zeng, Long Ma, L. M. Xu, Z. M. Tian, L. S. Ling, Li Pi

Abstract: We report our nuclear magnetic resonance (NMR) study on the structurally spin chain compound Ni$_2$NbBO$_6$ with complex magnetic coupling. The antiferromagnetic transition is monitored by the line splitting resulting from the staggered internal hyperfine field. The magnetic coupling configuration proposed by the first-principle density functional theory (DFT) is supported by our NMR spectral anal… ▽ More We report our nuclear magnetic resonance (NMR) study on the structurally spin chain compound Ni$_2$NbBO$_6$ with complex magnetic coupling. The antiferromagnetic transition is monitored by the line splitting resulting from the staggered internal hyperfine field. The magnetic coupling configuration proposed by the first-principle density functional theory (DFT) is supported by our NMR spectral analysis. For the spin dynamics, a prominent peak at $T\sim35$ K well above the Néel temperature ($T_N\sim20$ K at $μ_0H=10$ T) is observed from the spin-lattice relaxation data. As compared with the dc-susceptibility, this behavior indicates a antiferromagnetic coupling with the typical energy scale of $\sim3$ meV. Thus, the Ni$_2$NbBO$_6$ compound can be viewed as strongly ferromagnetically coupled armchair spin chains along the crystalline $b$-axis. These facts place strong constraints to the theoretical model for this compound. △ Less

Submitted 5 August, 2020; originally announced August 2020.

Comments: 6 pages, 4 figures

Journal ref: Chin. Phys. B, 30, 047503 (2021)

Artificial two-dimensional polar metal by charge transfer to a ferroelectric insulator

Authors: W. X. Zhou, H. J. Wu, J. Zhou, S. W. Zeng, C. J. Li, M. S. Li, R. Guo, J. X. Xiao, Z. Huang, W. M. Lv, K. Han, P. Yang, C. G. Li, Z. S. Lim, H. Wang, Y. Zhang, S. J. Chua, K. Y. Zeng, T. Venkatesan, J. S. Chen, Y. P. Feng, S. J. Pennycook, A. Ariando

Abstract: Integrating multiple properties in a single system is crucial for the continuous developments in electronic devices. However, some physical properties are mutually exclusive in nature. Here, we report the coexistence of two seemingly mutually exclusive properties-polarity and two-dimensional conductivity-in ferroelectric Ba$_{0.2}$Sr$_{0.8}$TiO$_3$ thin films at the LaAlO$_3$/Ba$_{0.2}$Sr$_{0.8}$T… ▽ More Integrating multiple properties in a single system is crucial for the continuous developments in electronic devices. However, some physical properties are mutually exclusive in nature. Here, we report the coexistence of two seemingly mutually exclusive properties-polarity and two-dimensional conductivity-in ferroelectric Ba$_{0.2}$Sr$_{0.8}$TiO$_3$ thin films at the LaAlO$_3$/Ba$_{0.2}$Sr$_{0.8}$TiO$_3$ interface at room temperature. The polarity of a ~3.2 nm Ba$_{0.2}$Sr$_{0.8}$TiO$_3$ thin film is preserved with a two-dimensional mobile carrier density of ~0.05 electron per unit cell. We show that the electronic reconstruction resulting from the competition between the built-in electric field of LaAlO$_3$ and the polarization of Ba$_{0.2}$Sr$_{0.8}$TiO$_3$ is responsible for this unusual two-dimensional conducting polar phase. The general concept of exploiting mutually exclusive properties at oxide interfaces via electronic reconstruction may be applicable to other strongly-correlated oxide interfaces, thus opening windows to new functional nanoscale materials for applications in novel nanoelectronics. △ Less

Submitted 11 July, 2020; originally announced July 2020.

Comments: Main text: 25 pages, 4 figures Supplementary note: 19 pages, 11 figures

Journal ref: Commun. Phys. 2, 125 (2019)