Showing 151–200 of 416 results for author: Yue, Y

Smooth Trajectory Collision Avoidance through Deep Reinforcement Learning

Authors: Sirui Song, Kirk Saunders, Ye Yue, Jundong Liu

Abstract: Collision avoidance is a crucial task in vision-guided autonomous navigation. Solutions based on deep reinforcement learning (DRL) has become increasingly popular. In this work, we proposed several novel agent state and reward function designs to tackle two critical issues in DRL-based navigation solutions: 1) smoothness of the trained flight trajectories; and 2) model generalization to handle uns… ▽ More Collision avoidance is a crucial task in vision-guided autonomous navigation. Solutions based on deep reinforcement learning (DRL) has become increasingly popular. In this work, we proposed several novel agent state and reward function designs to tackle two critical issues in DRL-based navigation solutions: 1) smoothness of the trained flight trajectories; and 2) model generalization to handle unseen environments. Formulated under a DRL framework, our model relies on margin reward and smoothness constraints to ensure UAVs fly smoothly while greatly reducing the chance of collision. The proposed smoothness reward minimizes a combination of first-order and second-order derivatives of flight trajectories, which can also drive the points to be evenly distributed, leading to stable flight speed. To enhance the agent's capability of handling new unseen environments, two practical setups are proposed to improve the invariance of both the state and reward function when deploying in different scenes. Experiments demonstrate the effectiveness of our overall design and individual components. △ Less

Submitted 12 October, 2022; originally announced October 2022.

Comments: Accepted to ICMLA 2022

Neurosymbolic Programming for Science

Authors: Jennifer J. Sun, Megan Tjandrasuwita, Atharva Sehgal, Armando Solar-Lezama, Swarat Chaudhuri, Yisong Yue, Omar Costilla-Reyes

Abstract: Neurosymbolic Programming (NP) techniques have the potential to accelerate scientific discovery. These models combine neural and symbolic components to learn complex patterns and representations from data, using high-level concepts or known constraints. NP techniques can interface with symbolic domain knowledge from scientists, such as prior knowledge and experimental context, to produce interpret… ▽ More Neurosymbolic Programming (NP) techniques have the potential to accelerate scientific discovery. These models combine neural and symbolic components to learn complex patterns and representations from data, using high-level concepts or known constraints. NP techniques can interface with symbolic domain knowledge from scientists, such as prior knowledge and experimental context, to produce interpretable outputs. We identify opportunities and challenges between current NP models and scientific workflows, with real-world examples from behavior analysis in science: to enable the use of NP broadly for workflows across the natural and social sciences. △ Less

Submitted 7 November, 2022; v1 submitted 10 October, 2022; originally announced October 2022.

Comments: Neural Information Processing Systems 2022 - AI for science workshop

On convergence of an unconditional stable numerical scheme for Q-tensor flow based on invariant quardratization method

Authors: Yukun Yue

Abstract: We present convergence analysis towards a numerical scheme designed for Q-tensor flows of nematic liquid crystals. This scheme is based on the Invariant Energy Quadratization method, which introduces an auxiliary variable to replace the original energy functional. In this work, we have shown that given an initial value with $H^2$ regularity, we can obtain a uniform $H^2$ estimate on the numerical… ▽ More We present convergence analysis towards a numerical scheme designed for Q-tensor flows of nematic liquid crystals. This scheme is based on the Invariant Energy Quadratization method, which introduces an auxiliary variable to replace the original energy functional. In this work, we have shown that given an initial value with $H^2$ regularity, we can obtain a uniform $H^2$ estimate on the numerical solutions for Q-tensor flows and then deduce the convergence to a strong solution of the parabolic-type Q-tensor equation. We have also shown that the limit of the auxiliary variable is equivalent to the original energy functional term in the strong sense. △ Less

Submitted 2 October, 2022; originally announced October 2022.

AdaFocusV3: On Unified Spatial-temporal Dynamic Video Recognition

Authors: Yulin Wang, Yang Yue, Xinhong Xu, Ali Hassani, Victor Kulikov, Nikita Orlov, Shiji Song, Humphrey Shi, Gao Huang

Abstract: Recent research has revealed that reducing the temporal and spatial redundancy are both effective approaches towards efficient video recognition, e.g., allocating the majority of computation to a task-relevant subset of frames or the most valuable image regions of each frame. However, in most existing works, either type of redundancy is typically modeled with another absent. This paper explores th… ▽ More Recent research has revealed that reducing the temporal and spatial redundancy are both effective approaches towards efficient video recognition, e.g., allocating the majority of computation to a task-relevant subset of frames or the most valuable image regions of each frame. However, in most existing works, either type of redundancy is typically modeled with another absent. This paper explores the unified formulation of spatial-temporal dynamic computation on top of the recently proposed AdaFocusV2 algorithm, contributing to an improved AdaFocusV3 framework. Our method reduces the computational cost by activating the expensive high-capacity network only on some small but informative 3D video cubes. These cubes are cropped from the space formed by frame height, width, and video duration, while their locations are adaptively determined with a light-weighted policy network on a per-sample basis. At test time, the number of the cubes corresponding to each video is dynamically configured, i.e., video cubes are processed sequentially until a sufficiently reliable prediction is produced. Notably, AdaFocusV3 can be effectively trained by approximating the non-differentiable cropping operation with the interpolation of deep features. Extensive empirical results on six benchmark datasets (i.e., ActivityNet, FCVID, Mini-Kinetics, Something-Something V1&V2 and Diving48) demonstrate that our model is considerably more efficient than competitive baselines. △ Less

Submitted 27 September, 2022; originally announced September 2022.

Comments: ECCV 2022

Graph-to-Text Generation with Dynamic Structure Pruning

Authors: Liang Li, Ruiying Geng, Bowen Li, Can Ma, Yinliang Yue, Binhua Li, Yongbin Li

Abstract: Most graph-to-text works are built on the encoder-decoder framework with cross-attention mechanism. Recent studies have shown that explicitly modeling the input graph structure can significantly improve the performance. However, the vanilla structural encoder cannot capture all specialized information in a single forward pass for all decoding steps, resulting in inaccurate semantic representations… ▽ More Most graph-to-text works are built on the encoder-decoder framework with cross-attention mechanism. Recent studies have shown that explicitly modeling the input graph structure can significantly improve the performance. However, the vanilla structural encoder cannot capture all specialized information in a single forward pass for all decoding steps, resulting in inaccurate semantic representations. Meanwhile, the input graph is flatted as an unordered sequence in the cross attention, ignoring the original graph structure. As a result, the obtained input graph context vector in the decoder may be flawed. To address these issues, we propose a Structure-Aware Cross-Attention (SACA) mechanism to re-encode the input graph representation conditioning on the newly generated context at each decoding step in a structure aware manner. We further adapt SACA and introduce its variant Dynamic Graph Pruning (DGP) mechanism to dynamically drop irrelevant nodes in the decoding process. We achieve new state-of-the-art results on two graph-to-text datasets, LDC2020T02 and ENT-DESC, with only minor increase on computational cost. △ Less

Submitted 15 September, 2022; originally announced September 2022.

Comments: accepted by COLING2022 Oral

Finding neural signatures for obesity through feature selection on source-localized EEG

Authors: Yuan Yue, Dirk De Ridder, Patrick Manning, Samantha Ross, Jeremiah D. Deng

Abstract: Obesity is a serious issue in the modern society and is often associated to significantly reduced quality of life. Current research conducted to explore obesity-related neurological evidences using electroencephalography (EEG) data are limited to traditional approaches. In this study, we developed a novel machine learning model to identify brain networks of obese females using alpha band functiona… ▽ More Obesity is a serious issue in the modern society and is often associated to significantly reduced quality of life. Current research conducted to explore obesity-related neurological evidences using electroencephalography (EEG) data are limited to traditional approaches. In this study, we developed a novel machine learning model to identify brain networks of obese females using alpha band functional connectivity features derived from EEG data. An overall classification accuracy of 0.937 is achieved. Our finding suggests that the obese brain is characterized by a dysfunctional network in which the areas that responsible for processing self-referential information and environmental context information are impaired. △ Less

Submitted 21 June, 2023; v1 submitted 30 August, 2022; originally announced August 2022.

Comments: 4 pages, 3 figures, conference submission

Ballistic Transport Enhanced Heat Convection at Nanoscale Hotspots

Authors: Yanru Xu, Shen Xu, Jingchao Zhang, Jianshu Gao, Shugang Deng, Wenxiang Liu, Xinwei Wang, Xin Zhang, Yanan Yue

Abstract: Along with device miniaturization, severe heat accumulation at unexpected nanoscale hotspots attracts wide attentions and urges efficient thermal management. Heat convection is one of the important heat dissipating paths but its mechanism at nanoscale hotspots is still unclear. Here shows the first experimental investigation of the convective heat transfer coefficient at size-controllable nanoscal… ▽ More Along with device miniaturization, severe heat accumulation at unexpected nanoscale hotspots attracts wide attentions and urges efficient thermal management. Heat convection is one of the important heat dissipating paths but its mechanism at nanoscale hotspots is still unclear. Here shows the first experimental investigation of the convective heat transfer coefficient at size-controllable nanoscale hotspots. A specially designed structure of a single layer graphene supported by gold nanorods (AuNRs) is proposed, in which the AuNRs generate plasmonic heating sources of the order of hundreds of nanometers under laser irradiation and the graphene layer works as a temperature probe in Raman thermometry. The determined convective heat transfer coefficient is found to be about three orders of magnitude higher than that of nature convection, when the simultaneous interfacial heat conduction and radiation are carefully evaluated. Heat convection thus accounts to more than half of the total energy transferred across the graphene/AuNRs interface. Both the plasmonic heating induced nanoscale hotspots and ballistic convection of gas molecules contribute to the enhanced heat convection. This work reveals the importance of heat convection at nanoscale hotspots to the accurate thermal design of miniaturized electronics, and further offers a new way to evaluate the convective heat transfer coefficient at nanoscale hotspots. △ Less

Submitted 19 August, 2022; originally announced August 2022.

Ballistic Thermal Transport at Sub-10 nm Laser-Induced Hot Spots in GaN Crystal

Authors: Dezhao Huang, Qiangsheng Sun, Zeyu Liu, Shen Xu, Ronggui Yang, Yanan Yue

Abstract: Gallium nitride (GaN) is a typical wide-bandgap semiconductor with a critical role in a wide range of electronic applications. Ballistic thermal transport at nanoscale hotspots will greatly reduce the performance of a device when its characteristic length reaches the nanometer scale, due to heat dissipation. In this work, we developed a tip-enhanced Raman thermometry approach to study ballistic th… ▽ More Gallium nitride (GaN) is a typical wide-bandgap semiconductor with a critical role in a wide range of electronic applications. Ballistic thermal transport at nanoscale hotspots will greatly reduce the performance of a device when its characteristic length reaches the nanometer scale, due to heat dissipation. In this work, we developed a tip-enhanced Raman thermometry approach to study ballistic thermal transport within the range of 10 nm in GaN, simultaneously achieving laser heating and measuring the local temperature. The Raman results showed that the temperature increase from an Au-coated tip-focused hotspot was up to two times higher (40 K) than that in a bare tip-focused region (20 K). To further investigate the possible mechanisms behind this temperature difference, we performed electromagnetic simulations to generate a highly focused heating field, and observed a highly localized optical penetration, within a range of 10 nm. The phonon mean free path (MFP) of the GaN substrate could thus be determined by comparing the numerical simulation results with the experimentally measured temperature increase which was in good agreement with the average MFP weighted by the mode-specific thermal conductivity, as calculated from first-principles simulations. Our results demonstrate that the phonon MFP of a material can be rapidly predicted through a combination of experiments and simulations, which can find wide application in the thermal management of GaN-based electronics. △ Less

Submitted 19 August, 2022; originally announced August 2022.

POLAR: Preference Optimization and Learning Algorithms for Robotics

Authors: Maegan Tucker, Kejun Li, Yisong Yue, Aaron D. Ames

Abstract: Parameter tuning for robotic systems is a time-consuming and challenging task that often relies on domain expertise of the human operator. Moreover, existing learning methods are not well suited for parameter tuning for many reasons including: the absence of a clear numerical metric for `good robotic behavior'; limited data due to the reliance on real-world experimental data; and the large search… ▽ More Parameter tuning for robotic systems is a time-consuming and challenging task that often relies on domain expertise of the human operator. Moreover, existing learning methods are not well suited for parameter tuning for many reasons including: the absence of a clear numerical metric for `good robotic behavior'; limited data due to the reliance on real-world experimental data; and the large search space of parameter combinations. In this work, we present an open-source MATLAB Preference Optimization and Learning Algorithms for Robotics toolbox (POLAR) for systematically exploring high-dimensional parameter spaces using human-in-the-loop preference-based learning. This aim of this toolbox is to systematically and efficiently accomplish one of two objectives: 1) to optimize robotic behaviors for human operator preference; 2) to learn the operator's underlying preference landscape to better understand the relationship between adjustable parameters and operator preference. The POLAR toolbox achieves these objectives using only subjective feedback mechanisms (pairwise preferences, coactive feedback, and ordinal labels) to infer a Bayesian posterior over the underlying reward function dictating the user's preferences. We demonstrate the performance of the toolbox in simulation and present various applications of human-in-the-loop preference-based learning. △ Less

Submitted 8 August, 2022; originally announced August 2022.

Comments: 8 page main text, 2 page appendix, 5 figures

Sensitive Multi-beam Targeted SETI Observations towards 33 Exoplanet Systems with FAST

Authors: Zhen-Zhao Tao, Hai-Chen Zhao, Tong-Jie Zhang, Vishal Gajjar, Yan Zhu, You-Ling Yue, Hai-Yan Zhang, Wen-Fei Liu, Shi-Yu Li, Jian-Chen Zhang, Cong Liu, Hong-Feng Wang, Ran Duan, Lei Qian, Cheng-Jin Jin, Di Li, Andrew Siemion, Peng Jiang, Dan Werthime, Jeff Cobb, Eric Korpela, David P. Anderson

Abstract: As a major approach to looking for life beyond the Earth, the search for extraterrestrial intelligence (SETI) is committed to detecting technosignatures such as engineered radio signals that are indicative of technologically capable life. In this paper, we report a targeted SETI campaign employing an observation strategy named multi-beam coincidence matching (MBCM) at the Five-hundred-meter Apertu… ▽ More As a major approach to looking for life beyond the Earth, the search for extraterrestrial intelligence (SETI) is committed to detecting technosignatures such as engineered radio signals that are indicative of technologically capable life. In this paper, we report a targeted SETI campaign employing an observation strategy named multi-beam coincidence matching (MBCM) at the Five-hundred-meter Aperture Spherical radio Telescope (FAST) towards 33 known exoplanet systems, searching for ETI narrow-band drifting signals across 1.05-1.45 GHz in two orthogonal linear polarization directions separately. A signal at 1140.604 MHz detected from the observation towards Kepler-438 originally peaked our interest because its features are roughly consistent with assumed ETI technosignatures. However, evidences such as its polarization characteristics are almost able to eliminate the possibility of an extraterrestrial origin. Our observations achieve an unprecedented sensitivity since the minimum equivalent isotropic radiated power (EIRP) we are able to detect reaches 1.48 x10^9 W. △ Less

Submitted 29 September, 2022; v1 submitted 3 August, 2022; originally announced August 2022.

Comments: 17 pages, 12 figures, matches the published version

Journal ref: The Astronomical Journal, 164:160 (14pp), 2022 October

Low-temperature transport properties of intermetallic compound HoAgGe with kagome spin ice state

Authors: N. Li, Q. Huang, X. Y. Yue, S. K. Guang, K. Xia, Y. Y. Wang, Q. J. Li, X. Zhao, H. D. Zhou, X. F. Sun

Abstract: We study the magnetic susceptibility, magnetization, resistivity and thermal conductivity of intermetallic HoAgGe single crystals at low temperatures and in magnetic fields along the $a$ and $c$ axis, while the electric and heat currents are along the $c$ axis. The magnetization curves show a series of metamagnetic transitions and small hysteresis at low field for $B \parallel a$, and a weak metam… ▽ More We study the magnetic susceptibility, magnetization, resistivity and thermal conductivity of intermetallic HoAgGe single crystals at low temperatures and in magnetic fields along the $a$ and $c$ axis, while the electric and heat currents are along the $c$ axis. The magnetization curves show a series of metamagnetic transitions and small hysteresis at low field for $B \parallel a$, and a weak metamagnetic transition for $B \parallel c$, respectively. Both the magnetic susceptibility and $ρ(T)$ curve show anomalies at the antiferromagnetic transition ($T\rm_N \sim$ 11.3 K) and spin reorientation transition ($\sim$ 7 K). In zero field and at very low temperatures, the electrons are found to be the main heat carriers. For $B \parallel a$, the $ρ(B)$ curves display large and positive transverse magnetoresistance (MR) with extraordinary field dependence between $B^2$ and $B$-linear, accompanied with anomalies at the metamagnetic transitions and low-field hysteresis; meanwhile, the $κ(B)$ mainly decrease with increasing field and display some anomalies at the metamagnetic transitions. For $B \parallel c$, there is weak and negative longitudinal MR while the $κ(B)$ show rather strong field dependence, indicating the role of phonon heat transport. △ Less

Submitted 25 July, 2022; originally announced July 2022.

Comments: 8 pages, 8 figures

Journal ref: Phys. Rev. B 106, 014416 (2022)

MABe22: A Multi-Species Multi-Task Benchmark for Learned Representations of Behavior

Authors: Jennifer J. Sun, Markus Marks, Andrew Ulmer, Dipam Chakraborty, Brian Geuther, Edward Hayes, Heng Jia, Vivek Kumar, Sebastian Oleszko, Zachary Partridge, Milan Peelman, Alice Robie, Catherine E. Schretter, Keith Sheppard, Chao Sun, Param Uttarwar, Julian M. Wagner, Eric Werner, Joseph Parker, Pietro Perona, Yisong Yue, Kristin Branson, Ann Kennedy

Abstract: We introduce MABe22, a large-scale, multi-agent video and trajectory benchmark to assess the quality of learned behavior representations. This dataset is collected from a variety of biology experiments, and includes triplets of interacting mice (4.7 million frames video+pose tracking data, 10 million frames pose only), symbiotic beetle-ant interactions (10 million frames video data), and groups of… ▽ More We introduce MABe22, a large-scale, multi-agent video and trajectory benchmark to assess the quality of learned behavior representations. This dataset is collected from a variety of biology experiments, and includes triplets of interacting mice (4.7 million frames video+pose tracking data, 10 million frames pose only), symbiotic beetle-ant interactions (10 million frames video data), and groups of interacting flies (4.4 million frames of pose tracking data). Accompanying these data, we introduce a panel of real-life downstream analysis tasks to assess the quality of learned representations by evaluating how well they preserve information about the experimental conditions (e.g. strain, time of day, optogenetic stimulation) and animal behavior. We test multiple state-of-the-art self-supervised video and trajectory representation learning methods to demonstrate the use of our benchmark, revealing that methods developed using human action datasets do not fully translate to animal datasets. We hope that our benchmark and dataset encourage a broader exploration of behavior representation learning methods across species and settings. △ Less

Submitted 30 June, 2023; v1 submitted 21 July, 2022; originally announced July 2022.

Comments: To appear in ICML 2023, Project website: https://sites.google.com/view/computational-behavior/our-datasets/mabe2022-dataset

Compactly Restrictable Metric Policy Optimization Problems

Authors: Victor D. Dorobantu, Kamyar Azizzadenesheli, Yisong Yue

Abstract: We study policy optimization problems for deterministic Markov decision processes (MDPs) with metric state and action spaces, which we refer to as Metric Policy Optimization Problems (MPOPs). Our goal is to establish theoretical results on the well-posedness of MPOPs that can characterize practically relevant continuous control systems. To do so, we define a special class of MPOPs called Compactly… ▽ More We study policy optimization problems for deterministic Markov decision processes (MDPs) with metric state and action spaces, which we refer to as Metric Policy Optimization Problems (MPOPs). Our goal is to establish theoretical results on the well-posedness of MPOPs that can characterize practically relevant continuous control systems. To do so, we define a special class of MPOPs called Compactly Restrictable MPOPs (CR-MPOPs), which are flexible enough to capture the complex behavior of robotic systems but specific enough to admit solutions using dynamic programming methods such as value iteration. We show how to arrive at CR-MPOPs using forward-invariance. We further show that our theoretical results on CR-MPOPs can be used to characterize feedback linearizable control affine systems. △ Less

Submitted 12 July, 2022; originally announced July 2022.

Comments: 11 pages, 1 figure, submitted to Transactions on Automatic Control

Value-Consistent Representation Learning for Data-Efficient Reinforcement Learning

Authors: Yang Yue, Bingyi Kang, Zhongwen Xu, Gao Huang, Shuicheng Yan

Abstract: Deep reinforcement learning (RL) algorithms suffer severe performance degradation when the interaction data is scarce, which limits their real-world application. Recently, visual representation learning has been shown to be effective and promising for boosting sample efficiency in RL. These methods usually rely on contrastive learning and data augmentation to train a transition model for state pre… ▽ More Deep reinforcement learning (RL) algorithms suffer severe performance degradation when the interaction data is scarce, which limits their real-world application. Recently, visual representation learning has been shown to be effective and promising for boosting sample efficiency in RL. These methods usually rely on contrastive learning and data augmentation to train a transition model for state prediction, which is different from how the model is used in RL--performing value-based planning. Accordingly, the learned representation by these visual methods may be good for recognition but not optimal for estimating state value and solving the decision problem. To address this issue, we propose a novel method, called value-consistent representation learning (VCR), to learn representations that are directly related to decision-making. More specifically, VCR trains a model to predict the future state (also referred to as the ''imagined state'') based on the current one and a sequence of actions. Instead of aligning this imagined state with a real state returned by the environment, VCR applies a $Q$-value head on both states and obtains two distributions of action values. Then a distance is computed and minimized to force the imagined state to produce a similar action value prediction as that by the real state. We develop two implementations of the above idea for the discrete and continuous action spaces respectively. We conduct experiments on Atari 100K and DeepMind Control Suite benchmarks to validate their effectiveness for improving sample efficiency. It has been demonstrated that our methods achieve new state-of-the-art performance for search-free RL algorithms. △ Less

Submitted 16 August, 2022; v1 submitted 24 June, 2022; originally announced June 2022.

Comments: 13 pages, 4 figures

Policy Optimization with Linear Temporal Logic Constraints

Authors: Cameron Voloshin, Hoang M. Le, Swarat Chaudhuri, Yisong Yue

Abstract: We study the problem of policy optimization (PO) with linear temporal logic (LTL) constraints. The language of LTL allows flexible description of tasks that may be unnatural to encode as a scalar cost function. We consider LTL-constrained PO as a systematic framework, decoupling task specification from policy selection, and as an alternative to the standard of cost shaping. With access to a genera… ▽ More We study the problem of policy optimization (PO) with linear temporal logic (LTL) constraints. The language of LTL allows flexible description of tasks that may be unnatural to encode as a scalar cost function. We consider LTL-constrained PO as a systematic framework, decoupling task specification from policy selection, and as an alternative to the standard of cost shaping. With access to a generative model, we develop a model-based approach that enjoys a sample complexity analysis for guaranteeing both task satisfaction and cost optimality (through a reduction to a reachability problem). Empirically, our algorithm can achieve strong performance even in low-sample regimes. △ Less

Submitted 19 October, 2022; v1 submitted 19 June, 2022; originally announced June 2022.

Deep Neural Imputation: A Framework for Recovering Incomplete Brain Recordings

Authors: Sabera Talukder, Jennifer J. Sun, Matthew Leonard, Bingni W. Brunton, Yisong Yue

Abstract: Neuroscientists and neuroengineers have long relied on multielectrode neural recordings to study the brain. However, in a typical experiment, many factors corrupt neural recordings from individual electrodes, including electrical noise, movement artifacts, and faulty manufacturing. Currently, common practice is to discard these corrupted recordings, reducing already limited data that is difficult… ▽ More Neuroscientists and neuroengineers have long relied on multielectrode neural recordings to study the brain. However, in a typical experiment, many factors corrupt neural recordings from individual electrodes, including electrical noise, movement artifacts, and faulty manufacturing. Currently, common practice is to discard these corrupted recordings, reducing already limited data that is difficult to collect. To address this challenge, we propose Deep Neural Imputation (DNI), a framework to recover missing values from electrodes by learning from data collected across spatial locations, days, and participants. We explore our framework with a linear nearest-neighbor approach and two deep generative autoencoders, demonstrating DNI's flexibility. One deep autoencoder models participants individually, while the other extends this architecture to model many participants jointly. We evaluate our models across 12 human participants implanted with multielectrode intracranial electrocorticography arrays; participants had no explicit task and behaved naturally across hundreds of recording hours. We show that DNI recovers not only time series but also frequency content, and further establish DNI's practical value by recovering significant performance on a scientifically-relevant downstream neural decoding task. △ Less

Submitted 16 June, 2022; originally announced June 2022.

Categorize Radio Interference using component and temporal analysis

Authors: Mao Yuan, Weiwei Zhu, Haiyan Zhang, Shijie Huang, Mengyao Xue, Di Li, Youling Yue, Pei Wang, 1 Jiarui Niu, Yuxuan Hu, Chunjiang Li, Chenchen Miao, Yu Wang, Lingqi Meng, Bo Peng

Abstract: Radio frequency interference (RFI) is a significant challenge faced by today's radio astronomers. While most past efforts were devoted to cleaning the RFI from the data, we develop a novel method for categorizing and cataloguing RFI for forensic purpose. We present a classifier that categorizes RFI into different types based on features extracted using Principal Component Analysis (PCA) and Fourie… ▽ More Radio frequency interference (RFI) is a significant challenge faced by today's radio astronomers. While most past efforts were devoted to cleaning the RFI from the data, we develop a novel method for categorizing and cataloguing RFI for forensic purpose. We present a classifier that categorizes RFI into different types based on features extracted using Principal Component Analysis (PCA) and Fourier analysis. The classifier can identify narrowband non-periodic RFI above 2 sigma, narrowband periodic RFI above 3 sigma, and wideband impulsive RFI above 5 sigma with F1 scores between 0.87 and 0.91 in simulation. This classifier could be used to identify the sources of RFI as well as to clean RFI contamination (particularly in pulsar search). In the long-term analysis of the categorized RFI, we found a special type of drifting periodic RFI that is detrimental to pulsar search. We also found evidences of an increased rate of impulsive RFI when the telescope is pointing toward the cities. These results demonstrate this classifier's potential as a forensic tool for RFI environment monitoring of radio telescopes. △ Less

Submitted 6 June, 2023; v1 submitted 18 May, 2022; originally announced May 2022.

Comments: 15 pages, 19 figures

Journal ref: published in MNRAS,15 April 2022

Neural-Fly Enables Rapid Learning for Agile Flight in Strong Winds

Authors: Michael O'Connell, Guanya Shi, Xichen Shi, Kamyar Azizzadenesheli, Anima Anandkumar, Yisong Yue, Soon-Jo Chung

Abstract: Executing safe and precise flight maneuvers in dynamic high-speed winds is important for the ongoing commoditization of uninhabited aerial vehicles (UAVs). However, because the relationship between various wind conditions and its effect on aircraft maneuverability is not well understood, it is challenging to design effective robot controllers using traditional control design methods. We present Ne… ▽ More Executing safe and precise flight maneuvers in dynamic high-speed winds is important for the ongoing commoditization of uninhabited aerial vehicles (UAVs). However, because the relationship between various wind conditions and its effect on aircraft maneuverability is not well understood, it is challenging to design effective robot controllers using traditional control design methods. We present Neural-Fly, a learning-based approach that allows rapid online adaptation by incorporating pretrained representations through deep learning. Neural-Fly builds on two key observations that aerodynamics in different wind conditions share a common representation and that the wind-specific part lies in a low-dimensional space. To that end, Neural-Fly uses a proposed learning algorithm, domain adversarially invariant meta-learning (DAIML), to learn the shared representation, only using 12 minutes of flight data. With the learned representation as a basis, Neural-Fly then uses a composite adaptation law to update a set of linear coefficients for mixing the basis elements. When evaluated under challenging wind conditions generated with the Caltech Real Weather Wind Tunnel, with wind speeds up to 43.6 kilometers/hour (12.1 meters/second), Neural-Fly achieves precise flight control with substantially smaller tracking error than state-of-the-art nonlinear and adaptive controllers. In addition to strong empirical performance, the exponential stability of Neural-Fly results in robustness guarantees. Last, our control design extrapolates to unseen wind conditions, is shown to be effective for outdoor flights with only onboard sensors, and can transfer across drones with minimal performance degradation. △ Less

Submitted 11 April, 2024; v1 submitted 13 May, 2022; originally announced May 2022.

Comments: This is the accepted version of Science Robotics Vol. 7, Issue 66, eabm6597 (2022). Video: https://youtu.be/TuF9teCZX0U

Arecibo and FAST Timing Follow-up of twelve Millisecond Pulsars Discovered in Commensal Radio Astronomy FAST Survey

Authors: C. C. Miao, W. W. Zhu, D. Li, P. C. C. Freire, J. R. Niu, P. Wang, J. P. Yuan, M. Y. Xue, A. D. Cameron, D. J. Champion, M. Cruces, Y. T. Chen, M. M. Chi, X. F. Cheng, S. J. Dang, M. F. Ding, Y. Feng, Z. Y. Gan, G. Hobbs, M. Kramer, Z. J. Liu, Y. X. Li, Z. K. Luo, X. L. Miao, L. Q. Meng , et al. (24 additional authors not shown)

Abstract: We report the phase-connected timing ephemeris, polarization pulse profiles, Faraday rotation measurements, and Rotating-Vector-Model (RVM) fitting results of twelve millisecond pulsars (MSPs) discovered with the Five-hundred-meter Aperture Spherical radio Telescope (FAST) in the Commensal radio Astronomy FAST survey (CRAFTS). The timing campaigns were carried out with FAST and Arecibo over three… ▽ More We report the phase-connected timing ephemeris, polarization pulse profiles, Faraday rotation measurements, and Rotating-Vector-Model (RVM) fitting results of twelve millisecond pulsars (MSPs) discovered with the Five-hundred-meter Aperture Spherical radio Telescope (FAST) in the Commensal radio Astronomy FAST survey (CRAFTS). The timing campaigns were carried out with FAST and Arecibo over three years. Eleven of the twelve pulsars are in neutron star - white dwarf binary systems, with orbital periods between 2.4 and 100 d. Ten of them have spin periods, companion masses, and orbital eccentricities that are consistent with the theoretical expectations for MSP - Helium white dwarf (He WD) systems. The last binary pulsar (PSR J1912$-$0952) has a significantly smaller spin frequency and a smaller companion mass, the latter could be caused by a low orbital inclination for the system. Its orbital period of 29 days is well within the range of orbital periods where some MSP - He WD systems have shown anomalous eccentricities, however, the eccentricity of PSR J1912$-$0952 is typical of what one finds for the remaining MSP - He WD systems. △ Less

Submitted 9 May, 2022; originally announced May 2022.

Comments: 11 pages, 5 figures, MNRAS accepted

Investigating Generalization by Controlling Normalized Margin

Authors: Alexander R. Farhang, Jeremy Bernstein, Kushal Tirumala, Yang Liu, Yisong Yue

Abstract: Weight norm $\|w\|$ and margin $γ$ participate in learning theory via the normalized margin $γ/\|w\|$. Since standard neural net optimizers do not control normalized margin, it is hard to test whether this quantity causally relates to generalization. This paper designs a series of experimental studies that explicitly control normalized margin and thereby tackle two central questions. First: does n… ▽ More Weight norm $\|w\|$ and margin $γ$ participate in learning theory via the normalized margin $γ/\|w\|$. Since standard neural net optimizers do not control normalized margin, it is hard to test whether this quantity causally relates to generalization. This paper designs a series of experimental studies that explicitly control normalized margin and thereby tackle two central questions. First: does normalized margin always have a causal effect on generalization? The paper finds that no -- networks can be produced where normalized margin has seemingly no relationship with generalization, counter to the theory of Bartlett et al. (2017). Second: does normalized margin ever have a causal effect on generalization? The paper finds that yes -- in a standard training setup, test performance closely tracks normalized margin. The paper suggests a Gaussian process model as a promising explanation for this behavior. △ Less

Submitted 20 September, 2022; v1 submitted 8 May, 2022; originally announced May 2022.

Neural Gaits: Learning Bipedal Locomotion via Control Barrier Functions and Zero Dynamics Policies

Authors: Ivan Dario Jimenez Rodriguez, Noel Csomay-Shanklin, Yisong Yue, Aaron D. Ames

Abstract: This work presents Neural Gaits, a method for learning dynamic walking gaits through the enforcement of set invariance that can be refined episodically using experimental data from the robot. We frame walking as a set invariance problem enforceable via control barrier functions (CBFs) defined on the reduced-order dynamics quantifying the underactuated component of the robot: the zero dynamics. Our… ▽ More This work presents Neural Gaits, a method for learning dynamic walking gaits through the enforcement of set invariance that can be refined episodically using experimental data from the robot. We frame walking as a set invariance problem enforceable via control barrier functions (CBFs) defined on the reduced-order dynamics quantifying the underactuated component of the robot: the zero dynamics. Our approach contains two learning modules: one for learning a policy that satisfies the CBF condition, and another for learning a residual dynamics model to refine imperfections of the nominal model. Importantly, learning only over the zero dynamics significantly reduces the dimensionality of the learning problem while using CBFs allows us to still make guarantees for the full-order system. The method is demonstrated experimentally on an underactuated bipedal robot, where we are able to show agile and dynamic locomotion, even with partially unknown dynamics. △ Less

Submitted 17 April, 2022; originally announced April 2022.

Na$_5$Co$_{15.5}$Te$_6$O$_{36}$: an $S$ = 1/2 stacked Ising kagome antiferromagnet with a partially disordered ground state

Authors: Z. Y. Zhao, X. Y. Yue, J. Y. Li, N. Li, H. L. Che, X. F. Sun, Z. Z. He

Abstract: $S$ = 1/2 Ising kagome antiferromagnets (KAFs) are rare in reality. In this work, we report the magnetic ground state and field-induced transitions of an $S$ = 1/2 Ising antiferromagnet with a stacked kagome geometry, Na$_5$Co$_{15.5}$Te$_6$O$_{36}$. Upon cooling, magnetic susceptibility measurement reveals three successive magnetic transitions at $T_1$ = 45.2 K, $T_2$ = 35.4 K, and $T_3 \sim… ▽ More $S$ = 1/2 Ising kagome antiferromagnets (KAFs) are rare in reality. In this work, we report the magnetic ground state and field-induced transitions of an $S$ = 1/2 Ising antiferromagnet with a stacked kagome geometry, Na$_5$Co$_{15.5}$Te$_6$O$_{36}$. Upon cooling, magnetic susceptibility measurement reveals three successive magnetic transitions at $T_1$ = 45.2 K, $T_2$ = 35.4 K, and $T_3 \sim$ 20 K. When the magnetic field is applied along the Ising $c$ axis, a strikingly anomalous initial magnetization lying outside the hysteresis loop is observed below $T_3$. Through the detailed characterizations, the magnetic field $vs$ temperature phase diagram is established. A partially disordered antiferromagnetic state is proposed below $T_1$, which becomes frozen below $T_3$. Na$_5$Co$_{15.5}$Te$_6$O$_{36}$ is therefore a promising candidate for $S$ = 1/2 Ising KAFs, and this unique composite structure may shed light on the exploratory path for $S$ = 1/2 Ising KAFs. △ Less

Submitted 31 March, 2022; originally announced April 2022.

Comments: 9 pages, 9 pictures, to be published in PRB

Realization of the topological Hopf term in two-dimensional lattice models

Authors: YanGuang Yue, ZhengXin Liu

Abstract: It is known that a two-dimensional spin system can acquire a topological Hopf term by coupling to massless Dirac fermions whose energy spectrum has a single cone. But it is challenging to realize the Hopf term in condensed matter physics due to the fermion-doubling in the low-energy spectrum. In this work we propose a scenario to realize the Hopf term in lattice models. The central aim is tuning t… ▽ More It is known that a two-dimensional spin system can acquire a topological Hopf term by coupling to massless Dirac fermions whose energy spectrum has a single cone. But it is challenging to realize the Hopf term in condensed matter physics due to the fermion-doubling in the low-energy spectrum. In this work we propose a scenario to realize the Hopf term in lattice models. The central aim is tuning the coupling between the spins and the Dirac fermions such that the topological terms contributed by the two cones do not cancel each other. To this end, we consider $p_x$ and $p_y$ orbitals for the Dirac fermions on the honeycomb lattice such that there are totally four bands. By utilizing the orbital degrees of freedom, a $θ=2π$ Hopf term is successfully generated for the spin system after integrating out the Dirac fermions. If the fermions have a small gap $m_0$ or if the spin-orbit coupling is considered, then $θ$ is no longer quantized, but it may flow to multiple of $2π$ under renormalization. The ground state and the physical response of a spin system having the Hopf term are discussed. △ Less

Submitted 27 January, 2023; v1 submitted 30 March, 2022; originally announced March 2022.

Journal ref: Phys. Rev. B 107, 045130 (2023)

A World-Self Model Towards Understanding Intelligence

Authors: Yutao Yue

Abstract: The symbolism, connectionism and behaviorism approaches of artificial intelligence have achieved a lot of successes in various tasks, while we still do not have a clear definition of "intelligence" with enough consensus in the community (although there are over 70 different "versions" of definitions). The nature of intelligence is still in darkness. In this work we do not take any of these three t… ▽ More The symbolism, connectionism and behaviorism approaches of artificial intelligence have achieved a lot of successes in various tasks, while we still do not have a clear definition of "intelligence" with enough consensus in the community (although there are over 70 different "versions" of definitions). The nature of intelligence is still in darkness. In this work we do not take any of these three traditional approaches, instead we try to identify certain fundamental aspects of the nature of intelligence, and construct a mathematical model to represent and potentially reproduce these fundamental aspects. We first stress the importance of defining the scope of discussion and granularity of investigation. We carefully compare human and artificial intelligence, and qualitatively demonstrate an information abstraction process, which we propose to be the key to connect perception and cognition. We then present the broader idea of "concept", separate the idea of self model out of the world model, and construct a new model called world-self model (WSM). We show the mechanisms of creating and connecting concepts, and the flow of how the WSM receives, processes and outputs information with respect to an arbitrary type of problem to solve. We also consider and discuss the potential computer implementation issues of the proposed theoretical framework, and finally we propose a unified general framework of intelligence based on WSM. △ Less

Submitted 15 June, 2022; v1 submitted 25 March, 2022; originally announced March 2022.

Comments: 21 pages, 5 figures

ACM Class: I.2.0; G.0; H.1.1

Journal ref: IEEE Access, vol. 10, pp. 63034-63048, 2022

Safety of Sampled-Data Systems with Control Barrier Functions via Approximate Discrete Time Models

Authors: Andrew J. Taylor, Victor D. Dorobantu, Ryan K. Cosner, Yisong Yue, Aaron D. Ames

Abstract: Control Barrier Functions (CBFs) have been demonstrated to be a powerful tool for safety-critical controller design for nonlinear systems. Existing design paradigms do not address the gap between theory (controller design with continuous time models) and practice (the discrete time sampled implementation of the resulting controllers); this can lead to poor performance and violations of safety for… ▽ More Control Barrier Functions (CBFs) have been demonstrated to be a powerful tool for safety-critical controller design for nonlinear systems. Existing design paradigms do not address the gap between theory (controller design with continuous time models) and practice (the discrete time sampled implementation of the resulting controllers); this can lead to poor performance and violations of safety for hardware instantiations. We propose an approach to close this gap by synthesizing sampled-data counterparts to these CBF-based controllers using approximate discrete time models and Sampled-Data Control Barrier Functions (SD-CBFs). Using properties of a system's continuous time model, we establish a relationship between SD-CBFs and a notion of practical safety for sampled-data systems. Furthermore, we construct convex optimization-based controllers that formally endow nonlinear systems with safety guarantees in practice. We demonstrate the efficacy of these controllers in simulation. △ Less

Submitted 13 June, 2022; v1 submitted 22 March, 2022; originally announced March 2022.

Comments: 8 pages, 4 figures, submitted to 2022 Conference on Decision & Control (CDC)

MLNav: Learning to Safely Navigate on Martian Terrains

Authors: Shreyansh Daftry, Neil Abcouwer, Tyler Del Sesto, Siddarth Venkatraman, Jialin Song, Lucas Igel, Amos Byon, Ugo Rosolia, Yisong Yue, Masahiro Ono

Abstract: We present MLNav, a learning-enhanced path planning framework for safety-critical and resource-limited systems operating in complex environments, such as rovers navigating on Mars. MLNav makes judicious use of machine learning to enhance the efficiency of path planning while fully respecting safety constraints. In particular, the dominant computational cost in such safety-critical settings is runn… ▽ More We present MLNav, a learning-enhanced path planning framework for safety-critical and resource-limited systems operating in complex environments, such as rovers navigating on Mars. MLNav makes judicious use of machine learning to enhance the efficiency of path planning while fully respecting safety constraints. In particular, the dominant computational cost in such safety-critical settings is running a model-based safety checker on the proposed paths. Our learned search heuristic can simultaneously predict the feasibility for all path options in a single run, and the model-based safety checker is only invoked on the top-scoring paths. We validate in high-fidelity simulations using both real Martian terrain data collected by the Perseverance rover, as well as a suite of challenging synthetic terrains. Our experiments show that: (i) compared to the baseline ENav path planner on board the Perserverance rover, MLNav can provide a significant improvement in multiple key metrics, such as a 10x reduction in collision checks when navigating real Martian terrains, despite being trained with synthetic terrains; and (ii) MLNav can successfully navigate highly challenging terrains where the baseline ENav fails to find a feasible path before timing out. △ Less

Submitted 9 March, 2022; originally announced March 2022.

Comments: IEEE Robotics and Automation Letters (RA-L) and ICRA 2022

Self-Supervised Online Learning for Safety-Critical Control using Stereo Vision

Authors: Ryan K. Cosner, Ivan D. Jimenez Rodriguez, Tamas G. Molnar, Wyatt Ubellacker, Yisong Yue, Aaron D. Ames, Katherine L. Bouman

Abstract: With the increasing prevalence of complex vision-based sensing methods for use in obstacle identification and state estimation, characterizing environment-dependent measurement errors has become a difficult and essential part of modern robotics. This paper presents a self-supervised learning approach to safety-critical control. In particular, the uncertainty associated with stereo vision is estima… ▽ More With the increasing prevalence of complex vision-based sensing methods for use in obstacle identification and state estimation, characterizing environment-dependent measurement errors has become a difficult and essential part of modern robotics. This paper presents a self-supervised learning approach to safety-critical control. In particular, the uncertainty associated with stereo vision is estimated, and adapted online to new visual environments, wherein this estimate is leveraged in a safety-critical controller in a robust fashion. To this end, we propose an algorithm that exploits the structure of stereo-vision to learn an uncertainty estimate without the need for ground-truth data. We then robustify existing Control Barrier Function-based controllers to provide safety in the presence of this uncertainty estimate. We demonstrate the efficacy of our method on a quadrupedal robot in a variety of environments. When not using our method safety is violated. With offline training alone we observe the robot is safe, but overly-conservative. With our online method the quadruped remains safe and conservatism is reduced. △ Less

Submitted 2 March, 2022; originally announced March 2022.

Comments: 7 pages, 4 figures, conference publication at ICRA 2022

Mobile Device Association and Resource Allocation in Small-Cell IoT Networks with Mobile Edge Computing and Caching

Authors: Tianqing Zhou, Yali Yue, Dong Qin, Xuefang Nie, Xuan Li, Chunguo Li

Abstract: To meet the need of computation-sensitive (CS) and high-rate (HR) communications, the framework of mobile edge computing and caching has been widely regarded as a promising solution. When such a framework is implemented in small-cell IoT (Internet of Tings) networks, it is a key and open topic how to assign mobile edge computing and caching servers to mobile devices (MDs) with CS and HR communicat… ▽ More To meet the need of computation-sensitive (CS) and high-rate (HR) communications, the framework of mobile edge computing and caching has been widely regarded as a promising solution. When such a framework is implemented in small-cell IoT (Internet of Tings) networks, it is a key and open topic how to assign mobile edge computing and caching servers to mobile devices (MDs) with CS and HR communications. Since these servers are integrated into small base stations (BSs), the assignment of them refers to not only the BS selection (i.e., MD association), but also the selection of computing and caching modes. To mitigate the network interference and thus enhance the system performance, some highly-effective resource partitioning mechanisms are introduced for access and backhaul links firstly. After that a problem with minimizing the sum of MDs' weighted delays is formulated to attain a goal of joint MD association and resource allocation under limited resources. Considering that the MD association and resource allocation parameters are coupling in such a formulated problem, we develop an alternating optimization algorithm according to the coalitional game and convex optimization theorems. To ensure that the designed algorithm begins from a feasible initial solution, we develop an initiation algorithm according to the conventional best channel association, which is used for comparison and the input of coalition game in the simulation. Simulation results show that the algorithm designed for minimizing the sum of MDs' weighted delays may achieve a better performance than the initiation (best channel association) algorithm in general. △ Less

Submitted 26 February, 2022; originally announced February 2022.

Frequency-dependent polarization of repeating fast radio bursts-implications for their origin

Authors: Yi Feng, Di Li, Yuan-Pei Yang, Yongkun Zhang, Weiwei Zhu, Bing Zhang, Wenbin Lu, Pei Wang, Shi Dai, Ryan S. Lynch, Jumei Yao, Jinchen Jiang, Jiarui Niu, Dejiang Zhou, Heng Xu, Chenchen Miao, Chenhui Niu, Lingqi Meng, Lei Qian, Chao-Wei Tsai, Bojun Wang, Mengyao Xue, Youling Yue, Mao Yuan, Songbo Zhang , et al. (1 additional authors not shown)

Abstract: The polarization of fast radio bursts (FRBs), bright astronomical transients, contains crucial information about their environments. We report polarization measurements of five repeating FRBs, the abundant signals of which enable wide-band observations with two telescopes. A clear trend of lower polarization at lower frequencies was found, which can be well characterized by a single parameter rota… ▽ More The polarization of fast radio bursts (FRBs), bright astronomical transients, contains crucial information about their environments. We report polarization measurements of five repeating FRBs, the abundant signals of which enable wide-band observations with two telescopes. A clear trend of lower polarization at lower frequencies was found, which can be well characterized by a single parameter rotation-measure-scatter (σRM) and modeled by multi-path scatter. Sources with higher σRM have higher RM magnitude and scattering timescales. The two sources with the most substantial σRM, FRB 20121102A and FRB 20190520B, are associated with a compact persistent radio source. These properties indicate a complex environment near the repeating FRBs, such as a supernova remnant or a pulsar wind nebula, consistent with their arising from young populations. △ Less

Submitted 19 March, 2022; v1 submitted 19 February, 2022; originally announced February 2022.

Eco-engineering controls vegetation trends in southwest China karst

Authors: Xuemei Zhang, Yuemin Yue, Xiaowei Tong, Kelin Wang, Xiangkun Qi, Chuxiong Deng, Martin Brandt

Abstract: The karst area in Yunnan-Guangxi-Guizhou region in southwest China is known for widespread rocky desertification but several studies report a greening trend since the year 2000. While the start of the greening trend seems to match with the implementation of ecological conservation projects, no statistical evidence on a relationship between vegetation greening and eco-engineering exists. Moreover,… ▽ More The karst area in Yunnan-Guangxi-Guizhou region in southwest China is known for widespread rocky desertification but several studies report a greening trend since the year 2000. While the start of the greening trend seems to match with the implementation of ecological conservation projects, no statistical evidence on a relationship between vegetation greening and eco-engineering exists. Moreover, dominant factors influencing the spatial patterns of vegetation trends have rarely been investigated. Here we use six comprehensive factors representing the natural conditions and human activities of the study area, and several statistical models consistently show that eco-engineering explains large parts of the positive vegetation trends in the karst areas, while negative vegetation trends in non-karst areas of Yunnan were related with a decrease in rainfall. We further show that the interaction of eco-engineering with other factors leads to a heterogeneous pattern of different vegetation trends. Knowing and understanding these patterns is crucial when planning ecological restoration, especially in diverse landscapes like China karst and the methods can be reused in other restoration areas. △ Less

Submitted 18 February, 2022; v1 submitted 16 February, 2022; originally announced February 2022.

Journal ref: Sci. Total Environ., 770 (8) (2021), Article 145160

Improving short-term bike sharing demand forecast through an irregular convolutional neural network

Authors: Xinyu Li, Yang Xu, Xiaohu Zhang, Wenzhong Shi, Yang Yue, Qingquan Li

Abstract: As an important task for the management of bike sharing systems, accurate forecast of travel demand could facilitate dispatch and relocation of bicycles to improve user satisfaction. In recent years, many deep learning algorithms have been introduced to improve bicycle usage forecast. A typical practice is to integrate convolutional (CNN) and recurrent neural network (RNN) to capture spatial-tempo… ▽ More As an important task for the management of bike sharing systems, accurate forecast of travel demand could facilitate dispatch and relocation of bicycles to improve user satisfaction. In recent years, many deep learning algorithms have been introduced to improve bicycle usage forecast. A typical practice is to integrate convolutional (CNN) and recurrent neural network (RNN) to capture spatial-temporal dependency in historical travel demand. For typical CNN, the convolution operation is conducted through a kernel that moves across a "matrix-format" city to extract features over spatially adjacent urban areas. This practice assumes that areas close to each other could provide useful information that improves prediction accuracy. However, bicycle usage in neighboring areas might not always be similar, given spatial variations in built environment characteristics and travel behavior that affect cycling activities. Yet, areas that are far apart can be relatively more similar in temporal usage patterns. To utilize the hidden linkage among these distant urban areas, the study proposes an irregular convolutional Long-Short Term Memory model (IrConv+LSTM) to improve short-term bike sharing demand forecast. The model modifies traditional CNN with irregular convolutional architecture to extract dependency among "semantic neighbors". The proposed model is evaluated with a set of benchmark models in five study sites, which include one dockless bike sharing system in Singapore, and four station-based systems in Chicago, Washington, D.C., New York, and London. We find that IrConv+LSTM outperforms other benchmark models in the five cities. The model also achieves superior performance in areas with varying levels of bicycle usage and during peak periods. The findings suggest that "thinking beyond spatial neighbors" can further improve short-term travel demand prediction of urban bike sharing systems. △ Less

Submitted 11 February, 2022; v1 submitted 9 February, 2022; originally announced February 2022.

Comments: 20 pages with 9 figures

LyaNet: A Lyapunov Framework for Training Neural ODEs

Authors: Ivan Dario Jimenez Rodriguez, Aaron D. Ames, Yisong Yue

Abstract: We propose a method for training ordinary differential equations by using a control-theoretic Lyapunov condition for stability. Our approach, called LyaNet, is based on a novel Lyapunov loss formulation that encourages the inference dynamics to converge quickly to the correct prediction. Theoretically, we show that minimizing Lyapunov loss guarantees exponential convergence to the correct solution… ▽ More We propose a method for training ordinary differential equations by using a control-theoretic Lyapunov condition for stability. Our approach, called LyaNet, is based on a novel Lyapunov loss formulation that encourages the inference dynamics to converge quickly to the correct prediction. Theoretically, we show that minimizing Lyapunov loss guarantees exponential convergence to the correct solution and enables a novel robustness guarantee. We also provide practical algorithms, including one that avoids the cost of backpropagating through a solver or using the adjoint method. Relative to standard Neural ODE training, we empirically find that LyaNet can offer improved prediction performance, faster convergence of inference dynamics, and improved adversarial robustness. Our code available at https://github.com/ivandariojr/LyapunovLearning . △ Less

Submitted 5 February, 2022; originally announced February 2022.

Impact of recent $(g-2)_μ$ measurement on the light CP-even Higgs scenario in general Next-to-Minimal Supersymmetric Standard Model

Authors: Junjie Cao, Jingwei Lian, Yusi Pan, Yuanfang Yue, Di Zhang

Abstract: The General Next-to-Minimal Supersymmetric Standard Model (GNMSSM) is an attractive theory that is free from the tadpole problem and the domain-wall problem of $Z_3$-NMSSM, and can form an economic secluded dark matter (DM) sector to naturally predict the DM experimental results. It also provides mechanisms to easily and significantly weaken the constraints from the LHC search for supersymmetric p… ▽ More The General Next-to-Minimal Supersymmetric Standard Model (GNMSSM) is an attractive theory that is free from the tadpole problem and the domain-wall problem of $Z_3$-NMSSM, and can form an economic secluded dark matter (DM) sector to naturally predict the DM experimental results. It also provides mechanisms to easily and significantly weaken the constraints from the LHC search for supersymmetric particles. These characteristics enable the theory to explain the recently measured muon anomalous magnetic moment, $(g-2)_μ$, in a broad parameter space that is consistent with all experimental results and at same time keeps the electroweak symmetry breaking natural. This work focuses on a popular scenario of the GNMSSM in which the next-to-lightest CP-even Higgs boson corresponds to the scalar discovered at the Large Hadron Collider (LHC). Both analytic formulae and a sophisticated numerical study show that in order to predict the scenario without significant tunings of relevant parameters, the Higgsino mass $μ_{tot} \lesssim 500~{\rm GeV}$ and $\tan β\lesssim 30$ are preferred. This character, if combined with the requirement to account for the $(g-2)_μ$ anomaly, will entail some light sparticles and make the LHC constraints very tight. As a result, this scenario can explain the muon anomalous magnetic moment in very narrow corners of its parameter space. △ Less

Submitted 12 March, 2022; v1 submitted 27 January, 2022; originally announced January 2022.

Comments: 50 pages; Version accepted by JHEP

Magnon-Polaron Driven Thermal Hall Effect in a Heisenberg-Kitaev Antiferromagnet

Authors: N. Li, R. R. Neumann, S. K. Guang, Q. Huang, J. Liu, K. Xia, X. Y. Yue, Y. Sun, Y. Y. Wang, Q. J. Li, Y. Jiang, J. Fang, Z. Jiang, X. Zhao, A. Mook, J. Henk, I. Mertig, H. D. Zhou, X. F. Sun

Abstract: The thermal Hall effect, defined as a heat current response transversal to an applied temperature gradient, is a central experimental probe of exotic electrically insulating phases of matter. A key question is how the interplay between magnetic and structural degrees of freedom gives rise to a nonzero thermal Hall conductivity (THC). Here, we present evidence for an intrinsic thermal Hall effect i… ▽ More The thermal Hall effect, defined as a heat current response transversal to an applied temperature gradient, is a central experimental probe of exotic electrically insulating phases of matter. A key question is how the interplay between magnetic and structural degrees of freedom gives rise to a nonzero thermal Hall conductivity (THC). Here, we present evidence for an intrinsic thermal Hall effect in the Heisenberg-Kitaev antiferromagnet and spin-liquid candidate Na$_2$Co$_2$TeO$_6$ brought about by the quantum-geometric Berry curvature of so-called magnon polarons, resulting from magnon-phonon hybridization. At low temperatures, our field- and temperature-dependent measurements show a negative THC for magnetic fields below 10 T and a sign change to positive THC above. Theoretically, the sign and the order of magnitude of the THC cannot be solely explained with magnetic excitations. We demonstrate that, by incorporating spin-lattice coupling into our theoretical calculations, the Berry curvature of magnon polarons counteracts the purely magnonic contribution, reverses the overall sign of the THC, and increases its magnitude, which significantly improves agreement with experimental data. Our work highlights the crucial role of spin-lattice coupling in the thermal Hall effect. △ Less

Submitted 27 February, 2023; v1 submitted 27 January, 2022; originally announced January 2022.

Comments: 19 pages, 4 figures

MonoDistill: Learning Spatial Features for Monocular 3D Object Detection

Authors: Zhiyu Chong, Xinzhu Ma, Hong Zhang, Yuxin Yue, Haojie Li, Zhihui Wang, Wanli Ouyang

Abstract: 3D object detection is a fundamental and challenging task for 3D scene understanding, and the monocular-based methods can serve as an economical alternative to the stereo-based or LiDAR-based methods. However, accurately detecting objects in the 3D space from a single image is extremely difficult due to the lack of spatial cues. To mitigate this issue, we propose a simple and effective scheme to i… ▽ More 3D object detection is a fundamental and challenging task for 3D scene understanding, and the monocular-based methods can serve as an economical alternative to the stereo-based or LiDAR-based methods. However, accurately detecting objects in the 3D space from a single image is extremely difficult due to the lack of spatial cues. To mitigate this issue, we propose a simple and effective scheme to introduce the spatial information from LiDAR signals to the monocular 3D detectors, without introducing any extra cost in the inference phase. In particular, we first project the LiDAR signals into the image plane and align them with the RGB images. After that, we use the resulting data to train a 3D detector (LiDAR Net) with the same architecture as the baseline model. Finally, this LiDAR Net can serve as the teacher to transfer the learned knowledge to the baseline model. Experimental results show that the proposed method can significantly boost the performance of the baseline model and ranks the $1^{st}$ place among all monocular-based methods on the KITTI benchmark. Besides, extensive ablation studies are conducted, which further prove the effectiveness of each part of our designs and illustrate what the baseline model has learned from the LiDAR Net. Our code will be released at \url{https://github.com/monster-ghost/MonoDistill}. △ Less

Submitted 26 January, 2022; originally announced January 2022.

Comments: Accepted by ICLR 2022

ATOMS: ALMA Three-millimeter Observations of Massive Star-forming regions -- VIII. A search for hot cores by using C$_2$H$_5$CN, CH$_3$OCHO and CH$_3$OH lines

Authors: Sheng-Li Qin, Tie Liu, Xunchuan Liu, Paul F. Goldsmith, Di Li, Qizhou Zhang, Hong-Li Liu, Yuefang Wu, Leonardo Bronfman, Mika Juvela, Chang Won Lee, Guido Garay, Yong Zhang, Jinhua He, Shih-Ying Hsu, Zhi-Qiang Shen, Jeong-Eun Lee, Ke Wang, Ningyu Tang, Mengyao Tang, Chao Zhang, Yinghua Yue, Qiaowei Xue, Shang-Huo Li, Yaping Peng , et al. (7 additional authors not shown)

Abstract: Hot cores characterized by rich lines of complex organic molecules are considered as ideal sites for investigating the physical and chemical environments of massive star formation. We present a search for hot cores by using typical nitrogen- and oxygen-bearing complex organic molecules (C$_2$H$_5$CN, CH$_3$OCHO and CH$_3$OH), based on ALMA Three-millimeter Observations of Massive Star-forming regi… ▽ More Hot cores characterized by rich lines of complex organic molecules are considered as ideal sites for investigating the physical and chemical environments of massive star formation. We present a search for hot cores by using typical nitrogen- and oxygen-bearing complex organic molecules (C$_2$H$_5$CN, CH$_3$OCHO and CH$_3$OH), based on ALMA Three-millimeter Observations of Massive Star-forming regions (ATOMS). The angular resolutions and line sensitivities of the ALMA observations are better than 2 arcsec and 10 mJy/beam, respectively. A total of 60 hot cores are identified with 45 being newly detected, in which the complex organic molecules have high gas temperatures ($>$ 100 K) and small source sizes ($<$ 0.1 pc). So far this is the largest sample of hot cores observed with similar angular resolution and spectral coverage. The observations have also shown nitrogen and oxygen differentiation in both line emission and gas distribution in 29 hot cores. Column densities of CH$_3$OH and CH$_3$OCHO increase as rotation temperatures rise. The column density of CH$_3$OCHO correlates tightly with that of CH$_3$OH. The pathways for production of different species are discussed. Based on the spatial position difference between hot cores and UC~H{\sc ii} regions, we conclude that 24 hot cores are externally heated while the other hot cores are internally heated. The observations presented here will potentially help establish a hot core template for studying massive star formation and astrochemistry. △ Less

Submitted 25 January, 2022; v1 submitted 24 January, 2022; originally announced January 2022.

Comments: 52 pages; Accepted by MNRAS

ImpliCity: City Modeling from Satellite Images with Deep Implicit Occupancy Fields

Authors: Corinne Stucker, Bingxin Ke, Yuanwen Yue, Shengyu Huang, Iro Armeni, Konrad Schindler

Abstract: High-resolution optical satellite sensors, combined with dense stereo algorithms, have made it possible to reconstruct 3D city models from space. However, these models are, in practice, rather noisy and tend to miss small geometric features that are clearly visible in the images. We argue that one reason for the limited quality may be a too early, heuristic reduction of the triangulated 3D point c… ▽ More High-resolution optical satellite sensors, combined with dense stereo algorithms, have made it possible to reconstruct 3D city models from space. However, these models are, in practice, rather noisy and tend to miss small geometric features that are clearly visible in the images. We argue that one reason for the limited quality may be a too early, heuristic reduction of the triangulated 3D point cloud to an explicit height field or surface mesh. To make full use of the point cloud and the underlying images, we introduce ImpliCity, a neural representation of the 3D scene as an implicit, continuous occupancy field, driven by learned embeddings of the point cloud and a stereo pair of ortho-photos. We show that this representation enables the extraction of high-quality DSMs: with image resolution 0.5$\,$m, ImpliCity reaches a median height error of $\approx\,$0.7$\,$m and outperforms competing methods, especially w.r.t. building reconstruction, featuring intricate roof details, smooth surfaces, and straight, regular outlines. △ Less

Submitted 6 May, 2022; v1 submitted 24 January, 2022; originally announced January 2022.

Comments: Accepted for publication in the International Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences (camera-ready version including keywords + supplementary material)

Journal ref: ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci., V-2-2022, 193-201, 2022

Learning to Rank For Push Notifications Using Pairwise Expected Regret

Authors: Yuguang Yue, Yuanpu Xie, Huasen Wu, Haofeng Jia, Shaodan Zhai, Wenzhe Shi, Jonathan J Hunt

Abstract: Listwise ranking losses have been widely studied in recommender systems. However, new paradigms of content consumption present new challenges for ranking methods. In this work we contribute an analysis of learning to rank for personalized mobile push notifications and discuss the unique challenges this presents compared to traditional ranking problems. To address these challenges, we introduce a n… ▽ More Listwise ranking losses have been widely studied in recommender systems. However, new paradigms of content consumption present new challenges for ranking methods. In this work we contribute an analysis of learning to rank for personalized mobile push notifications and discuss the unique challenges this presents compared to traditional ranking problems. To address these challenges, we introduce a novel ranking loss based on weighting the pairwise loss between candidates by the expected regret incurred for misordering the pair. We demonstrate that the proposed method can outperform prior methods both in a simulated environment and in a production experiment on a major social network. △ Less

Submitted 19 January, 2022; originally announced January 2022.

AdaFocus V2: End-to-End Training of Spatial Dynamic Networks for Video Recognition

Authors: Yulin Wang, Yang Yue, Yuanze Lin, Haojun Jiang, Zihang Lai, Victor Kulikov, Nikita Orlov, Humphrey Shi, Gao Huang

Abstract: Recent works have shown that the computational efficiency of video recognition can be significantly improved by reducing the spatial redundancy. As a representative work, the adaptive focus method (AdaFocus) has achieved a favorable trade-off between accuracy and inference speed by dynamically identifying and attending to the informative regions in each video frame. However, AdaFocus requires a co… ▽ More Recent works have shown that the computational efficiency of video recognition can be significantly improved by reducing the spatial redundancy. As a representative work, the adaptive focus method (AdaFocus) has achieved a favorable trade-off between accuracy and inference speed by dynamically identifying and attending to the informative regions in each video frame. However, AdaFocus requires a complicated three-stage training pipeline (involving reinforcement learning), leading to slow convergence and is unfriendly to practitioners. This work reformulates the training of AdaFocus as a simple one-stage algorithm by introducing a differentiable interpolation-based patch selection operation, enabling efficient end-to-end optimization. We further present an improved training scheme to address the issues introduced by the one-stage formulation, including the lack of supervision, input diversity and training stability. Moreover, a conditional-exit technique is proposed to perform temporal adaptive computation on top of AdaFocus without additional training. Extensive experiments on six benchmark datasets (i.e., ActivityNet, FCVID, Mini-Kinetics, Something-Something V1&V2, and Jester) demonstrate that our model significantly outperforms the original AdaFocus and other competitive baselines, while being considerably more simple and efficient to train. Code is available at https://github.com/LeapLabTHU/AdaFocusV2. △ Less

Submitted 11 April, 2022; v1 submitted 28 December, 2021; originally announced December 2021.

Comments: Accepted by CVPR-2022

An Early Transition to Magnetic Supercriticality in Star Formation

Authors: Tao-Chung Ching, Di Li, Carl Heiles, Zhi-Yun Li, Lei Qian, Youling Yue, Jing Tang, Sihan Jiao

Abstract: Magnetic fields play an important role in the evolution of interstellar medium and star formation. As the only direct probe of interstellar field strength, credible Zeeman measurements remain sparse due to the lack of suitable Zeeman probes, particularly for cold, molecular gas. Here we report the detection of a magnetic field of $+$3.8 $\pm$ 0.3 $μ$G through the HI narrow self-absorption (HINSA)… ▽ More Magnetic fields play an important role in the evolution of interstellar medium and star formation. As the only direct probe of interstellar field strength, credible Zeeman measurements remain sparse due to the lack of suitable Zeeman probes, particularly for cold, molecular gas. Here we report the detection of a magnetic field of $+$3.8 $\pm$ 0.3 $μ$G through the HI narrow self-absorption (HINSA) toward L1544, a well-studied prototypical prestellar core in an early transition between starless and protostellar phases characterized by high central number density and low central temperature. A combined analysis of the Zeeman measurements of quasar HI absorption, HI emission, OH emission, and HINSA reveals a coherent magnetic field from the atomic cold neutral medium (CNM) to the molecular envelope. The molecular envelope traced by HINSA is found to be magnetically supercritical, with a field strength comparable to that of the surrounding diffuse, magnetically subcritical CNM despite a large increase in density. The reduction of the magnetic flux relative to the mass, necessary for star formation, thus seems to have already happened during the transition from the diffuse CNM to the molecular gas traced by HINSA, earlier than envisioned in the classical picture where magnetically supercritical cores capable of collapsing into stars form out of magnetically subcritical envelopes. △ Less

Submitted 23 December, 2021; originally announced December 2021.

Comments: 3 figures, 1 table, Nature accepted

Full Transformer Framework for Robust Point Cloud Registration with Deep Information Interaction

Authors: Guangyan Chen, Meiling Wang, Yufeng Yue, Qingxiang Zhang, Li Yuan

Abstract: Recent Transformer-based methods have achieved advanced performance in point cloud registration by utilizing advantages of the Transformer in order-invariance and modeling dependency to aggregate information. However, they still suffer from indistinct feature extraction, sensitivity to noise, and outliers. The reasons are: (1) the adoption of CNNs fails to model global relations due to their local… ▽ More Recent Transformer-based methods have achieved advanced performance in point cloud registration by utilizing advantages of the Transformer in order-invariance and modeling dependency to aggregate information. However, they still suffer from indistinct feature extraction, sensitivity to noise, and outliers. The reasons are: (1) the adoption of CNNs fails to model global relations due to their local receptive fields, resulting in extracted features susceptible to noise; (2) the shallow-wide architecture of Transformers and lack of positional encoding lead to indistinct feature extraction due to inefficient information interaction; (3) the omission of geometrical compatibility leads to inaccurate classification between inliers and outliers. To address above limitations, a novel full Transformer network for point cloud registration is proposed, named the Deep Interaction Transformer (DIT), which incorporates: (1) a Point Cloud Structure Extractor (PSE) to model global relations and retrieve structural information with Transformer encoders; (2) a deep-narrow Point Feature Transformer (PFT) to facilitate deep information interaction across two point clouds with positional encoding, such that Transformers can establish comprehensive associations and directly learn relative position between points; (3) a Geometric Matching-based Correspondence Confidence Evaluation (GMCCE) method to measure spatial consistency and estimate inlier confidence by designing the triangulated descriptor. Extensive experiments on clean, noisy, partially overlapping point cloud registration demonstrate that our method outperforms state-of-the-art methods. △ Less

Submitted 17 December, 2021; originally announced December 2021.

Comments: 10pages, 7figures

Safety-Aware Preference-Based Learning for Safety-Critical Control

Authors: Ryan K. Cosner, Maegan Tucker, Andrew J. Taylor, Kejun Li, Tamás G. Molnár, Wyatt Ubellacker, Anil Alan, Gábor Orosz, Yisong Yue, Aaron D. Ames

Abstract: Bringing dynamic robots into the wild requires a tenuous balance between performance and safety. Yet controllers designed to provide robust safety guarantees often result in conservative behavior, and tuning these controllers to find the ideal trade-off between performance and safety typically requires domain expertise or a carefully constructed reward function. This work presents a design paradig… ▽ More Bringing dynamic robots into the wild requires a tenuous balance between performance and safety. Yet controllers designed to provide robust safety guarantees often result in conservative behavior, and tuning these controllers to find the ideal trade-off between performance and safety typically requires domain expertise or a carefully constructed reward function. This work presents a design paradigm for systematically achieving behaviors that balance performance and robust safety by integrating safety-aware Preference-Based Learning (PBL) with Control Barrier Functions (CBFs). Fusing these concepts -- safety-aware learning and safety-critical control -- gives a robust means to achieve safe behaviors on complex robotic systems in practice. We demonstrate the capability of this design paradigm to achieve safe and performant perception-based autonomous operation of a quadrupedal robot both in simulation and experimentally on hardware. △ Less

Submitted 11 April, 2022; v1 submitted 15 December, 2021; originally announced December 2021.

Comments: 15 pages, 4 figures

SNF: Filter Pruning via Searching the Proper Number of Filters

Authors: Pengkun Liu, Yaru Yue, Yanjun Guo, Xingxiang Tao, Xiaoguang Zhou

Abstract: Convolutional Neural Network (CNN) has an amount of parameter redundancy, filter pruning aims to remove the redundant filters and provides the possibility for the application of CNN on terminal devices. However, previous works pay more attention to designing evaluation criteria of filter importance and then prune less important filters with a fixed pruning rate or a fixed number to reduce convolut… ▽ More Convolutional Neural Network (CNN) has an amount of parameter redundancy, filter pruning aims to remove the redundant filters and provides the possibility for the application of CNN on terminal devices. However, previous works pay more attention to designing evaluation criteria of filter importance and then prune less important filters with a fixed pruning rate or a fixed number to reduce convolutional neural networks' redundancy. It does not consider how many filters to reserve for each layer is the most reasonable choice. From this perspective, we propose a new filter pruning method by searching the proper number of filters (SNF). SNF is dedicated to searching for the most reasonable number of reserved filters for each layer and then pruning filters with specific criteria. It can tailor the most suitable network structure at different FLOPs. Filter pruning with our method leads to the state-of-the-art (SOTA) accuracy on CIFAR-10 and achieves competitive performance on ImageNet ILSVRC-2012.SNF based on the ResNet-56 network achieves an increase of 0.14% in Top-1 accuracy at 52.94% FLOPs reduction on CIFAR-10. Pruning ResNet-110 on CIFAR-10 also improves the Top-1 accuracy of 0.03% when reducing 68.68% FLOPs. For ImageNet, we set the pruning rates as 52.10% FLOPs, and the Top-1 accuracy only has a drop of 0.74%. The codes can be available at https://github.com/pk-l/SNF. △ Less

Submitted 14 December, 2021; originally announced December 2021.

Output fusion of MPC and PID and its application in intelligent layered water injection of oilfield

Authors: Yuan-Long Yue, Hao-Yang Wen, Xin Zuo, Mao Sheng, Fu-Chao Sun

Abstract: To improve the dynamic response performance of wave code communication in intelligent layered water injection of oilfield, this paper proposes an output optimal fusion control method based on MPC-PID. Firstly, depending on the well structure and the flow-pressure characteristics of the layer, the steady-state model between the differential pressure and flow of the whole well and different layer se… ▽ More To improve the dynamic response performance of wave code communication in intelligent layered water injection of oilfield, this paper proposes an output optimal fusion control method based on MPC-PID. Firstly, depending on the well structure and the flow-pressure characteristics of the layer, the steady-state model between the differential pressure and flow of the whole well and different layer sections is established for layered water injection, and the corresponding wave code amplitude at the steady-state operating point of different layer sections is solved, the numerical calculation verifies that the increase of the nozzle opening in a single layer section will drive the pressure and flow curve of the whole well downward. Secondly, combining the dynamic response characteristics and steady-state model of the whole-well water distribution equipment, a dynamic model of layered intelligent water injection is established, and the generation process of the wave code is defined; Finally, the MPC-PID optimal fusion control algorithm structure is designed to derive the fusion control law that minimizes the cost function under fixed weights, , and the optimal weights are calculated by combining the internal model structure of controller, so the optimization performance of each algorithm in the optimal fusion control is balanced. By analyzing the control simulation results, the fast response characteristics of the fusion control method are verified. Meanwhile, the simulation comparison experiments of fast wave code communication under different methods are conducted with the actual working conditions, the results show that the fusion control method has both fast tracking control capability and strong robustness, which effectively enhances the efficiency of wave code communication and shortens the wave code operation time. △ Less

Submitted 13 December, 2021; originally announced December 2021.

Joint Device Association, Resource Allocation and Computation Offloading in Ultra-Dense Multi-Device and Multi-Task IoT Networks

Authors: Tianqing Zhou, Yali Yue, Dong Qin, Xuefang Nie, Xuan Li, Chunguo Li

Abstract: With the emergence of more and more applications of Internet-of-Things (IoT) mobile devices (IMDs), a contradiction between mobile energy demand and limited battery capacity becomes increasingly prominent. In addition, in ultra-dense IoT networks, the ultra-densely deployed small base stations (SBSs) will consume a large amount of energy. To reduce the network-wide energy consumption and extend th… ▽ More With the emergence of more and more applications of Internet-of-Things (IoT) mobile devices (IMDs), a contradiction between mobile energy demand and limited battery capacity becomes increasingly prominent. In addition, in ultra-dense IoT networks, the ultra-densely deployed small base stations (SBSs) will consume a large amount of energy. To reduce the network-wide energy consumption and extend the standby time of IMDs and SBSs, under the proportional computation resource allocation and devices' latency constraints, we jointly perform the device association, computation offloading and resource allocation to minimize the network-wide energy consumption for ultra-dense multi-device and multi-task IoT networks. To further balance the network loads and fully utilize the computation resources, we take account of multi-step computation offloading. Considering that the finally formulated problem is in a nonlinear and mixed-integer form, we utilize the hierarchical adaptive search (HAS) algorithm to find its solution. Then, we give the convergence, computation complexity and parallel implementation analyses for such an algorithm. By comparing with other algorithms, we can easily find that such an algorithm can greatly reduce the network-wide energy consumption under devices' latency constraints. △ Less

Submitted 10 December, 2021; originally announced December 2021.

Self-Supervised Keypoint Discovery in Behavioral Videos

Authors: Jennifer J. Sun, Serim Ryou, Roni Goldshmid, Brandon Weissbourd, John Dabiri, David J. Anderson, Ann Kennedy, Yisong Yue, Pietro Perona

Abstract: We propose a method for learning the posture and structure of agents from unlabelled behavioral videos. Starting from the observation that behaving agents are generally the main sources of movement in behavioral videos, our method, Behavioral Keypoint Discovery (B-KinD), uses an encoder-decoder architecture with a geometric bottleneck to reconstruct the spatiotemporal difference between video fram… ▽ More We propose a method for learning the posture and structure of agents from unlabelled behavioral videos. Starting from the observation that behaving agents are generally the main sources of movement in behavioral videos, our method, Behavioral Keypoint Discovery (B-KinD), uses an encoder-decoder architecture with a geometric bottleneck to reconstruct the spatiotemporal difference between video frames. By focusing only on regions of movement, our approach works directly on input videos without requiring manual annotations. Experiments on a variety of agent types (mouse, fly, human, jellyfish, and trees) demonstrate the generality of our approach and reveal that our discovered keypoints represent semantically meaningful body parts, which achieve state-of-the-art performance on keypoint regression among self-supervised methods. Additionally, B-KinD achieve comparable performance to supervised keypoints on downstream tasks, such as behavior classification, suggesting that our method can dramatically reduce model training costs vis-a-vis supervised methods. △ Less

Submitted 27 April, 2022; v1 submitted 9 December, 2021; originally announced December 2021.

Comments: CVPR 2022. Code: https://github.com/neuroethology/BKinD Project page: https://sites.google.com/view/b-kind

Automatic Synthesis of Diverse Weak Supervision Sources for Behavior Analysis

Authors: Albert Tseng, Jennifer J. Sun, Yisong Yue

Abstract: Obtaining annotations for large training sets is expensive, especially in settings where domain knowledge is required, such as behavior analysis. Weak supervision has been studied to reduce annotation costs by using weak labels from task-specific labeling functions (LFs) to augment ground truth labels. However, domain experts still need to hand-craft different LFs for different tasks, limiting sca… ▽ More Obtaining annotations for large training sets is expensive, especially in settings where domain knowledge is required, such as behavior analysis. Weak supervision has been studied to reduce annotation costs by using weak labels from task-specific labeling functions (LFs) to augment ground truth labels. However, domain experts still need to hand-craft different LFs for different tasks, limiting scalability. To reduce expert effort, we present AutoSWAP: a framework for automatically synthesizing data-efficient task-level LFs. The key to our approach is to efficiently represent expert knowledge in a reusable domain-specific language and more general domain-level LFs, with which we use state-of-the-art program synthesis techniques and a small labeled dataset to generate task-level LFs. Additionally, we propose a novel structural diversity cost that allows for efficient synthesis of diverse sets of LFs, further improving AutoSWAP's performance. We evaluate AutoSWAP in three behavior analysis domains and demonstrate that AutoSWAP outperforms existing approaches using only a fraction of the data. Our results suggest that AutoSWAP is an effective way to automatically generate LFs that can significantly reduce expert effort for behavior analysis. △ Less

Submitted 11 May, 2022; v1 submitted 30 November, 2021; originally announced November 2021.

Comments: 8 pages, to appear at CVPR 2022

A fast radio burst source at a complex magnetised site in a barred galaxy

Authors: H. Xu, J. R. Niu, P. Chen, K. J. Lee, W. W. Zhu, S. Dong, B. Zhang, J. C. Jiang, B. J. Wang, J. W. Xu, C. F. Zhang, H. Fu, A. V. Filippenko, E. W. Peng, D. J. Zhou, Y. K. Zhang, P. Wang, Y. Feng, Y. Li, T. G. Brink, D. Z. Li, W. Lu, Y. P. Yang, R. N. Caballero, C. Cai , et al. (49 additional authors not shown)

Abstract: Fast radio bursts (FRBs) are highly dispersed millisecond-duration radio bursts. Recent observations of a Galactic FRB suggest that at least some FRBs originate from magnetars, but the origin of cosmological FRBs is still not settled. Here we report the detection of 1863 bursts in 82 hr over 54 days from the repeating source FRB~20201124A. These observations show irregular short-time variation of… ▽ More Fast radio bursts (FRBs) are highly dispersed millisecond-duration radio bursts. Recent observations of a Galactic FRB suggest that at least some FRBs originate from magnetars, but the origin of cosmological FRBs is still not settled. Here we report the detection of 1863 bursts in 82 hr over 54 days from the repeating source FRB~20201124A. These observations show irregular short-time variation of the Faraday rotation measure (RM), which probes the density-weighted line-of-sight magnetic field strength, of individual bursts during the first 36 days, followed by a constant RM. We detected circular polarisation in more than half of the burst sample, including one burst reaching a high fractional circular polarisation of 75%. Oscillations in fractional linear and circular polarisations as well as polarisation angle as a function of wavelength were detected. All of these features provide evidence for a complicated, dynamically evolving, magnetised immediate environment within about an astronomical unit (au; Earth-Sun distance) of the source. Our optical observations of its Milky-Way-sized, metal-rich host galaxy reveal a barred spiral, with the FRB source residing in a low stellar density, interarm region at an intermediate galactocentric distance. This environment is inconsistent with a young magnetar engine formed during an extreme explosion of a massive star that resulted in a long gamma-ray burst or superluminous supernova. △ Less

Submitted 13 September, 2022; v1 submitted 23 November, 2021; originally announced November 2021.

Comments: 28 pages, 10 figures, updated to match the published version

Learning Explicit User Interest Boundary for Recommendation

Authors: Jianhuan Zhuo, Qiannan Zhu, Yinliang Yue, Yuhong Zhao

Abstract: The core objective of modelling recommender systems from implicit feedback is to maximize the positive sample score $s_p$ and minimize the negative sample score $s_n$, which can usually be summarized into two paradigms: the pointwise and the pairwise. The pointwise approaches fit each sample with its label individually, which is flexible in weighting and sampling on instance-level but ignores the… ▽ More The core objective of modelling recommender systems from implicit feedback is to maximize the positive sample score $s_p$ and minimize the negative sample score $s_n$, which can usually be summarized into two paradigms: the pointwise and the pairwise. The pointwise approaches fit each sample with its label individually, which is flexible in weighting and sampling on instance-level but ignores the inherent ranking property. By qualitatively minimizing the relative score $s_n - s_p$, the pairwise approaches capture the ranking of samples naturally but suffer from training efficiency. Additionally, both approaches are hard to explicitly provide a personalized decision boundary to determine if users are interested in items unseen. To address those issues, we innovatively introduce an auxiliary score $b_u$ for each user to represent the User Interest Boundary(UIB) and individually penalize samples that cross the boundary with pairwise paradigms, i.e., the positive samples whose score is lower than $b_u$ and the negative samples whose score is higher than $b_u$. In this way, our approach successfully achieves a hybrid loss of the pointwise and the pairwise to combine the advantages of both. Analytically, we show that our approach can provide a personalized decision boundary and significantly improve the training efficiency without any special sampling strategy. Extensive results show that our approach achieves significant improvements on not only the classical pointwise or pairwise models but also state-of-the-art models with complex loss function and complicated feature encoding. △ Less

Submitted 22 November, 2021; originally announced November 2021.

Comments: 12 pages, 9 figures, 5 tables

Zero-Shot Learning in Named-Entity Recognition with External Knowledge

Authors: Nguyen Van Hoang, Soeren Hougaard Mulvad, Dexter Neo Yuan Rong, Yang Yue

Abstract: A significant shortcoming of current state-of-the-art (SOTA) named-entity recognition (NER) systems is their lack of generalization to unseen domains, which poses a major problem since obtaining labeled data for NER in a new domain is expensive and time-consuming. We propose ZERO, a model that performs zero-shot and few-shot learning in NER to generalize to unseen domains by incorporating pre-exis… ▽ More A significant shortcoming of current state-of-the-art (SOTA) named-entity recognition (NER) systems is their lack of generalization to unseen domains, which poses a major problem since obtaining labeled data for NER in a new domain is expensive and time-consuming. We propose ZERO, a model that performs zero-shot and few-shot learning in NER to generalize to unseen domains by incorporating pre-existing knowledge in the form of semantic word embeddings. ZERO first obtains contextualized word representations of input sentences using the model LUKE, reduces their dimensionality, and compares them directly with the embeddings of the external knowledge, allowing ZERO to be trained to recognize unseen output entities. We find that ZERO performs well on unseen NER domains with an average macro F1 score of 0.23, outperforms LUKE in few-shot learning, and even achieves competitive scores on an in-domain comparison. The performance across source-target domain pairs is shown to be inversely correlated with the pairs' KL divergence. △ Less

Submitted 15 November, 2021; originally announced November 2021.

Comments: 4 main pages, 5 including broader impact and references. 4 figures. 2 equations. 2 tables. For code, see https://github.com/shmulvad/zero-for-ner