Showing 201–250 of 416 results for author: Yue, Y

Separating Content and Style for Unsupervised Image-to-Image Translation

Authors: Yunfei Liu, Haofei Wang, Yang Yue, Feng Lu

Abstract: Unsupervised image-to-image translation aims to learn the mapping between two visual domains with unpaired samples. Existing works focus on disentangling domain-invariant content code and domain-specific style code individually for multimodal purposes. However, less attention has been paid to interpreting and manipulating the translated image. In this paper, we propose to separate the content code… ▽ More Unsupervised image-to-image translation aims to learn the mapping between two visual domains with unpaired samples. Existing works focus on disentangling domain-invariant content code and domain-specific style code individually for multimodal purposes. However, less attention has been paid to interpreting and manipulating the translated image. In this paper, we propose to separate the content code and style code simultaneously in a unified framework. Based on the correlation between the latent features and the high-level domain-invariant tasks, the proposed framework demonstrates superior performance in multimodal translation, interpretability and manipulation of the translated image. Experimental results show that the proposed approach outperforms the existing unsupervised image translation methods in terms of visual quality and diversity. △ Less

Submitted 27 October, 2021; originally announced October 2021.

Comments: Accepted by BMVC2021

A GPU based single-pulse search pipeline (GSP) with database and its application to the commensal radio astronomy FAST survey (CRAFTS)

Authors: Shanping You, Pei Wang, Xuhong Yu, Xiaoyao Xie, Di Li, Zhijie Liu, Zhichen Pan, Youling Yue, Lei Qian, Bin Zhang, Zonghao Chen

Abstract: We developed a GPU based single-pulse search pipeline (GSP) with candidate-archiving database. Largely based upon the infrastructure of Open source pulsar search and analysis toolkit (PRESTO), GSP implements GPU acceleration of the de-dispersion and integrates a candidate-archiving database. We applied GSP to the data streams from the commensal radio astronomy FAST survey (CRAFTS), which resulted… ▽ More We developed a GPU based single-pulse search pipeline (GSP) with candidate-archiving database. Largely based upon the infrastructure of Open source pulsar search and analysis toolkit (PRESTO), GSP implements GPU acceleration of the de-dispersion and integrates a candidate-archiving database. We applied GSP to the data streams from the commensal radio astronomy FAST survey (CRAFTS), which resulted in a quasi-real-time processing. The integrated candidate database facilitates synergistic usage of multiple machine-learning tools and thus improves efficient identification of radio pulsars such as rotating radio transients (RRATs) and Fast Radio Bursts (FRBs). We first tested GSP on pilot CRAFTS observations with the FAST Ultra-Wide Band (UWB) receiver. GSP detected all pulsars known from the the Parkes multibeam pulsar survey in the respective sky area covered by the FAST-UWB. GSP also discovered 13 new pulsars. We measured the computational efficiency of GSP to be ~120 times faster than the original PRESTO and ~60 times faster than a MPI-parallelized version of PRESTO. △ Less

Submitted 25 October, 2021; originally announced October 2021.

A repeating fast radio burst associated with a persistent radio source

Authors: C. -H. Niu, K. Aggarwal, D. Li, X. Zhang, S. Chatterjee, C. -W. Tsai, W. Yu, C. J. Law, S. Burke-Spolaor, J. M. Cordes, Y. -K. Zhang, S. Ocker, J. -M. Yao, P. Wang, Y. Feng, Y. Niino, C. Bochenek, M. Cruces, L. Connor, J. -A. Jiang, S. Dai, R. Luo, G. -D. Li, C. -C. Miao, J. -R. Niu , et al. (10 additional authors not shown)

Abstract: The dispersive sweep of fast radio bursts (FRBs) has been used to probe the ionized baryon content of the intergalactic medium, which is assumed to dominate the total extragalactic dispersion. While the host galaxy contributions to dispersion measure (DM) appear to be small for most FRBs, in at least one case there is evidence for an extreme magneto-ionic local environment and a compact persistent… ▽ More The dispersive sweep of fast radio bursts (FRBs) has been used to probe the ionized baryon content of the intergalactic medium, which is assumed to dominate the total extragalactic dispersion. While the host galaxy contributions to dispersion measure (DM) appear to be small for most FRBs, in at least one case there is evidence for an extreme magneto-ionic local environment and a compact persistent radio source. Here we report the detection and localization of the repeating FRB 20190520B, which is co-located with a compact, persistent radio source and associated with a dwarf host galaxy of high specific star formation rate at a redshift $z=0.241\pm0.001$. The estimated host galaxy DM $\approx 903^{+72}_{-111}$ pc cm$^{-3}$, nearly an order of magnitude higher than the average of FRB host galaxies, far exceeds the DM contribution of the intergalactic medium. Caution is thus warranted in inferring redshifts for FRBs without accurate host galaxy identifications. △ Less

Submitted 20 April, 2022; v1 submitted 14 October, 2021; originally announced October 2021.

Comments: Accepted, Version 3

Kernel Interpolation as a Bayes Point Machine

Authors: Jeremy Bernstein, Alex Farhang, Yisong Yue

Abstract: A Bayes point machine is a single classifier that approximates the majority decision of an ensemble of classifiers. This paper observes that kernel interpolation is a Bayes point machine for Gaussian process classification. This observation facilitates the transfer of results from both ensemble theory as well as an area of convex geometry known as Brunn-Minkowski theory to derive PAC-Bayes risk bo… ▽ More A Bayes point machine is a single classifier that approximates the majority decision of an ensemble of classifiers. This paper observes that kernel interpolation is a Bayes point machine for Gaussian process classification. This observation facilitates the transfer of results from both ensemble theory as well as an area of convex geometry known as Brunn-Minkowski theory to derive PAC-Bayes risk bounds for kernel interpolation. Since large margin, infinite width neural networks are kernel interpolators, the paper's findings may help to explain generalisation in neural networks more broadly. Supporting this idea, the paper finds evidence that large margin, finite width neural networks behave like Bayes point machines too. △ Less

Submitted 28 January, 2022; v1 submitted 8 October, 2021; originally announced October 2021.

Effect of Visual Cues on Pointing Tasks in Co-located Augmented Reality Collaboration

Authors: Lei Chen, Yilin Liu, Yue Li, Lingyun Yu, BoYu Gao, Maurizio Caon, Yong Yue, Hai-Ning Liang

Abstract: Visual cues are essential in computer-mediated communication. It is especially important when communication happens in a collaboration scenario that requires focusing several users' attention on aspecific object among other similar ones. This paper explores the effect of visual cues on pointing tasks in co-located Augmented Reality (AR) collaboration. A user study (N = 32, 16 pairs) was conducted… ▽ More Visual cues are essential in computer-mediated communication. It is especially important when communication happens in a collaboration scenario that requires focusing several users' attention on aspecific object among other similar ones. This paper explores the effect of visual cues on pointing tasks in co-located Augmented Reality (AR) collaboration. A user study (N = 32, 16 pairs) was conducted to compare two types of visual cues: Pointing Line (PL)and Moving Track (MT). Both are head-based visual techniques.Through a series of collaborative pointing tasks on objects with different states (static and dynamic) and density levels (low, mediumand high), the results showed that PL was better on task performance and usability, but MT was rated higher on social presenceand user preference. Based on our results, some design implicationsare provided for pointing tasks in co-located AR collaboration. △ Less

Submitted 8 October, 2021; originally announced October 2021.

Natural Multicontact Walking for Robotic Assistive Devices via Musculoskeletal Models and Hybrid Zero Dynamics

Authors: Kejun Li, Maegan Tucker, Rachel Gehlhar, Yisong Yue, Aaron D. Ames

Abstract: Generating stable walking gaits that yield natural locomotion when executed on robotic-assistive devices is a challenging task that often requires hand-tuning by domain experts. This paper presents an alternative methodology, where we propose the addition of musculoskeletal models directly into the gait generation process to intuitively shape the resulting behavior. In particular, we construct a m… ▽ More Generating stable walking gaits that yield natural locomotion when executed on robotic-assistive devices is a challenging task that often requires hand-tuning by domain experts. This paper presents an alternative methodology, where we propose the addition of musculoskeletal models directly into the gait generation process to intuitively shape the resulting behavior. In particular, we construct a multi-domain hybrid system model that combines the system dynamics with muscle models to represent natural multicontact walking. Provably stable walking gaits can then be generated for this model via the hybrid zero dynamics (HZD) method. We experimentally apply our integrated framework towards achieving multicontact locomotion on a dual-actuated transfemoral prosthesis, AMPRO3, for two subjects. The results demonstrate that enforcing muscle model constraints produces gaits that yield natural locomotion (as analyzed via comparison to motion capture data and electromyography). Moreover, gaits generated with our framework were strongly preferred by the non-disabled prosthetic users as compared to gaits generated with the nominal HZD method, even with the use of systematic tuning methods. We conclude that the novel approach of combining robotic walking methods (specifically HZD) with muscle models successfully generates anthropomorphic robotic-assisted locomotion. △ Less

Submitted 14 March, 2022; v1 submitted 10 September, 2021; originally announced September 2021.

Comments: 8 pages, 7 figures

FAST discovery of an extremely radio-faint millisecond pulsar from the Fermi-LAT unassociated source 3FGL J0318.1+0252

Authors: Pei Wang, Di Li, Colin J. Clark, Pablo Saz Parkinson, Xian Hou, Weiwei Zhu, Lei Qian, Youling Yue, Zhichen Pan, Zhijie Liu, Xuhong Yu, Xiaoyao Xie, Qijun Zhi, Hui Zhang, Jumei Yao, Jun Yan, Chengmin Zhang, Paul S. Ray, Matthew Kerr, David A. Smith, Peter F. Michelson, Elizabeth C. Ferrara, David J. Thompson, Zhiqiang Shen, Na Wang , et al. (1 additional authors not shown)

Abstract: High sensitivity radio searches of unassociated $γ$-ray sources have proven to be an effective way of finding new pulsars. Using the Five-hundred-meter Aperture Spherical radio Telescope (FAST) during its commissioning phase, we have carried out a number of targeted deep searches of \textit{Fermi} Large Area Telescope (LAT) $γ$-ray sources. On Feb. 27$^{th}$, 2018 we discovered an isolated millise… ▽ More High sensitivity radio searches of unassociated $γ$-ray sources have proven to be an effective way of finding new pulsars. Using the Five-hundred-meter Aperture Spherical radio Telescope (FAST) during its commissioning phase, we have carried out a number of targeted deep searches of \textit{Fermi} Large Area Telescope (LAT) $γ$-ray sources. On Feb. 27$^{th}$, 2018 we discovered an isolated millisecond pulsar (MSP), PSR J0318+0253, coincident with the unassociated $γ$-ray source 3FGL J0318.1+0252. PSR J0318+0253 has a spin period of $5.19$ milliseconds, a dispersion measure (DM) of $26$ pc cm$^{-3}$ corresponding to a DM distance of about $1.3$ kpc, and a period-averaged flux density of $\sim$11 $\pm$ 2 $μ$Jy at L-band (1.05-1.45 GHz). Among all high energy MSPs, PSR J0318+0253 is the faintest ever detected in radio bands, by a factor of at least $\sim$4 in terms of L-band fluxes. With the aid of the radio ephemeris, an analysis of 9.6 years of \textit{Fermi}-LAT data revealed that PSR J0318+0253 also displays strong $γ$-ray pulsations. Follow-up observations carried out by both Arecibo and FAST suggest a likely spectral turn-over around 350 MHz. This is the first result from the collaboration between FAST and the \textit{Fermi}-LAT teams as well as the first confirmed new MSP discovery by FAST, raising hopes for the detection of many more MSPs. Such discoveries will make a significant contribution to our understanding of the neutron star zoo while potentially contributing to the future detection of gravitational waves, via pulsar timing array (PTA) experiments. △ Less

Submitted 3 September, 2021; v1 submitted 2 September, 2021; originally announced September 2021.

Comments: 7 pages, 2 figures, 1 table

Journal ref: Sci. China-Phys. Mech. Astron. 64: 129562 (2021)

The Mixed-Observable Constrained Linear Quadratic Regulator Problem: the Exact Solution and Practical Algorithms

Authors: Ugo Rosolia, Yuxiao Chen, Shreyansh Daftry, Masahiro Ono, Yisong Yue, Aaron D. Ames

Abstract: This paper studies the problem of steering a linear time-invariant system subject to state and input constraints towards a goal location that may be inferred only through partial observations. We assume mixed-observable settings, where the system's state is fully observable and the environment's state defining the goal location is only partially observed. In these settings, the planning problem is… ▽ More This paper studies the problem of steering a linear time-invariant system subject to state and input constraints towards a goal location that may be inferred only through partial observations. We assume mixed-observable settings, where the system's state is fully observable and the environment's state defining the goal location is only partially observed. In these settings, the planning problem is an infinite-dimensional optimization problem where the objective is to minimize the expected cost. We show how to reformulate the control problem as a finite-dimensional deterministic problem by optimizing over a trajectory tree. Leveraging this result, we demonstrate that when the environment is static, the observation model piecewise, and cost function convex, the original control problem can be reformulated as a Mixed-Integer Convex Program (MICP) that can be solved to global optimality using a branch-and-bound algorithm. The effectiveness of the proposed approach is demonstrated on navigation tasks, where the system has to reach a goal location identified from partial observations. △ Less

Submitted 20 November, 2022; v1 submitted 26 August, 2021; originally announced August 2021.

FAST early pulsar discoveries: Effelsberg follow-up

Authors: M. Cruces, D. J. Champion, D. Li, M. Kramer, W. W. Zhu, P. Wang, A. D. Cameron, Y. T. Chen, G. Hobbs, P. C. C. Freire, E. Graikou, M. Krco, Z. J. Liu, C. C. Miao, J. Niu, Z. C. Pan, L. Qian, M. Y. Xue, X. Y. Xie, S. P. You, X. H. Yu, M. Yuan, Y. L. Yue, Y. Zhu

Abstract: We report the follow-up of 10 pulsars discovered by the Five-hundred-meter Aperture Spherical radio-Telescope (FAST) during its commissioning. The pulsars were discovered at a frequency of 500-MHz using the ultra-wide-band (UWB) receiver in drift-scan mode, as part of the Commensal Radio Astronomy FAST Survey (CRAFTS). We carried out the timing campaign with the 100-m Effelsberg radio-telescope at… ▽ More We report the follow-up of 10 pulsars discovered by the Five-hundred-meter Aperture Spherical radio-Telescope (FAST) during its commissioning. The pulsars were discovered at a frequency of 500-MHz using the ultra-wide-band (UWB) receiver in drift-scan mode, as part of the Commensal Radio Astronomy FAST Survey (CRAFTS). We carried out the timing campaign with the 100-m Effelsberg radio-telescope at L-band around 1.36 GHz. Along with 11 FAST pulsars previously reported, FAST seems to be uncovering a population of older pulsars, bordering and/or even across the pulsar death-lines. We report here two sources with notable characteristics. PSR J1951$+$4724 is a young and energetic pulsar with nearly 100% of linearly polarized flux density and visible up to an observing frequency of 8 GHz. PSR J2338+4818, a mildly recycled pulsar in a 95.2-d orbit with a Carbon-Oxygen white dwarf (WD) companion of $\gtrsim 1\rm{M}_{\odot}$, based on estimates from the mass function. This system is the widest WD binary with the most massive companion known to-date. Conspicuous discrepancy was found between estimations based on NE2001 and YMW16 electron density models, which can be attributed to under-representation of pulsars in the sky region between Galactic longitudes $70^o<l<100^o$. This work represents one of the early CRAFTS results, which start to show potential to substantially enrich the pulsar sample and refine the Galactic electron density model. △ Less

Submitted 20 August, 2021; originally announced August 2021.

Semantic Reinforced Attention Learning for Visual Place Recognition

Authors: Guohao Peng, Yufeng Yue, Jun Zhang, Zhenyu Wu, Xiaoyu Tang, Danwei Wang

Abstract: Large-scale visual place recognition (VPR) is inherently challenging because not all visual cues in the image are beneficial to the task. In order to highlight the task-relevant visual cues in the feature embedding, the existing attention mechanisms are either based on artificial rules or trained in a thorough data-driven manner. To fill the gap between the two types, we propose a novel Semantic R… ▽ More Large-scale visual place recognition (VPR) is inherently challenging because not all visual cues in the image are beneficial to the task. In order to highlight the task-relevant visual cues in the feature embedding, the existing attention mechanisms are either based on artificial rules or trained in a thorough data-driven manner. To fill the gap between the two types, we propose a novel Semantic Reinforced Attention Learning Network (SRALNet), in which the inferred attention can benefit from both semantic priors and data-driven fine-tuning. The contribution lies in two-folds. (1) To suppress misleading local features, an interpretable local weighting scheme is proposed based on hierarchical feature distribution. (2) By exploiting the interpretability of the local weighting scheme, a semantic constrained initialization is proposed so that the local attention can be reinforced by semantic priors. Experiments demonstrate that our method outperforms state-of-the-art techniques on city-scale VPR benchmark datasets. △ Less

Submitted 18 August, 2021; originally announced August 2021.

Adaptive Optimizers with Sparse Group Lasso for Neural Networks in CTR Prediction

Authors: Yun Yue, Yongchao Liu, Suo Tong, Minghao Li, Zhen Zhang, Chunyang Wen, Huanjun Bao, Lihong Gu, Jinjie Gu, Yixiang Mu

Abstract: We develop a novel framework that adds the regularizers of the sparse group lasso to a family of adaptive optimizers in deep learning, such as Momentum, Adagrad, Adam, AMSGrad, AdaHessian, and create a new class of optimizers, which are named Group Momentum, Group Adagrad, Group Adam, Group AMSGrad and Group AdaHessian, etc., accordingly. We establish theoretically proven convergence guarantees in… ▽ More We develop a novel framework that adds the regularizers of the sparse group lasso to a family of adaptive optimizers in deep learning, such as Momentum, Adagrad, Adam, AMSGrad, AdaHessian, and create a new class of optimizers, which are named Group Momentum, Group Adagrad, Group Adam, Group AMSGrad and Group AdaHessian, etc., accordingly. We establish theoretically proven convergence guarantees in the stochastic convex settings, based on primal-dual methods. We evaluate the regularized effect of our new optimizers on three large-scale real-world ad click datasets with state-of-the-art deep learning models. The experimental results reveal that compared with the original optimizers with the post-processing procedure which uses the magnitude pruning method, the performance of the models can be significantly improved on the same sparsity level. Furthermore, in comparison to the cases without magnitude pruning, our methods can achieve extremely high sparsity with significantly better or highly competitive performance. The code is available at https://github.com/intelligent-machine-learning/dlrover/blob/master/tfplus. △ Less

Submitted 18 October, 2023; v1 submitted 30 July, 2021; originally announced July 2021.

Comments: 24 pages. Published as a conference paper at ECML PKDD 2021. This version includes Appendix which was not included in the published version because of page limit

Journal ref: Machine Learning and Knowledge Discovery in Databases. Research Track - European Conference, ECML PKDD 2021, Bilbao, Spain, September 13-17, 2021, Proceedings, Part III

Unsupervised Learning of Neurosymbolic Encoders

Authors: Eric Zhan, Jennifer J. Sun, Ann Kennedy, Yisong Yue, Swarat Chaudhuri

Abstract: We present a framework for the unsupervised learning of neurosymbolic encoders, which are encoders obtained by composing neural networks with symbolic programs from a domain-specific language. Our framework naturally incorporates symbolic expert knowledge into the learning process, which leads to more interpretable and factorized latent representations compared to fully neural encoders. We integra… ▽ More We present a framework for the unsupervised learning of neurosymbolic encoders, which are encoders obtained by composing neural networks with symbolic programs from a domain-specific language. Our framework naturally incorporates symbolic expert knowledge into the learning process, which leads to more interpretable and factorized latent representations compared to fully neural encoders. We integrate modern program synthesis techniques with the variational autoencoding (VAE) framework, in order to learn a neurosymbolic encoder in conjunction with a standard decoder. The programmatic descriptions from our encoders can benefit many analysis workflows, such as in behavior modeling where interpreting agent actions and movements is important. We evaluate our method on learning latent representations for real-world trajectory data from animal biology and sports analytics. We show that our approach offers significantly better separation of meaningful categories than standard VAEs and leads to practical gains on downstream analysis tasks, such as for behavior classification. △ Less

Submitted 20 December, 2022; v1 submitted 27 July, 2021; originally announced July 2021.

A bimodal burst energy distribution of a repeating fast radio burst source

Authors: D. Li, P. Wang, W. W. Zhu, B. Zhang, X. X. Zhang, R. Duan, Y. K. Zhang, Y. Feng, N. Y. Tang, S. Chatterjee, J. M. Cordes, M. Cruces, S. Dai, V. Gajjar, G. Hobbs, C. Jin, M. Kramer, D. R. Lorimer, C. C. Miao, C. H. Niu, J. R. Niu, Z. C. Pan, L. Qian, L. Spitler, D. Werthimer , et al. (7 additional authors not shown)

Abstract: The event rate, energy distribution, and time-domain behaviour of repeating fast radio bursts (FRBs) contains essential information regarding their physical nature and central engine, which are as yet unknown. As the first precisely-localized source, FRB 121102 has been extensively observed and shows non-Poisson clustering of bursts over time and a power-law energy distribution. However, the exten… ▽ More The event rate, energy distribution, and time-domain behaviour of repeating fast radio bursts (FRBs) contains essential information regarding their physical nature and central engine, which are as yet unknown. As the first precisely-localized source, FRB 121102 has been extensively observed and shows non-Poisson clustering of bursts over time and a power-law energy distribution. However, the extent of the energy distribution towards the fainter end was not known. Here we report the detection of 1652 independent bursts with a peak burst rate of 122~hr^{-1}, in 59.5 hours spanning 47 days. A peak in the isotropic equivalent energy distribution is found to be ~4.8 x 10^{37} erg at 1.25~GHz, below which the detection of bursts is suppressed. The burst energy distribution is bimodal, and well characterized by a combination of a log-normal function and a generalized Cauchy function. The large number of bursts in hour-long spans allow sensitive periodicity searches between 1 ms and 1000 s. The non-detection of any periodicity or quasi-periodicity poses challenges for models involving a single rotating compact object. The high burst rate also implies that FRBs must be generated with a high radiative efficiency, disfavoring emission mechanisms with large energy requirements or contrived triggering conditions. △ Less

Submitted 14 October, 2021; v1 submitted 17 July, 2021; originally announced July 2021.

Comments: 69 pages, 14 figures, 2 tables; Updates for author correction

Journal ref: Nature 598 (2021) 267-271

Survival of itinerant excitations and quantum spin state transitions in YbMgGaO$_4$ with chemical disorder

Authors: X. Rao, G. Hussain, Q. Huang, W. J. Chu, N. Li, X. Zhao, Z. Dun, E. S. Choi, T. Asaba, L. Chen, L. Li, X. Y. Yue, N. N. Wang, J. -G. Cheng, Y. H. Gao, Y. Shen, J. Zhao, G. Chen, H. D. Zhou, X. F. Sun

Abstract: A recent focus of quantum spin liquid (QSL) studies is how disorder/randomness in a QSL candidate affects its true magnetic ground state. The ultimate question is whether the QSL survives disorder or the disorder leads to a "spin-liquid-like" state, such as the proposed random-singlet (RS) state. Since disorder is a standard feature of most QSL candidates, this question represents a major challeng… ▽ More A recent focus of quantum spin liquid (QSL) studies is how disorder/randomness in a QSL candidate affects its true magnetic ground state. The ultimate question is whether the QSL survives disorder or the disorder leads to a "spin-liquid-like" state, such as the proposed random-singlet (RS) state. Since disorder is a standard feature of most QSL candidates, this question represents a major challenge for QSL candidates. YbMgGaO$_4$, a triangular lattice antiferromagnet with effective spin-1/2 Yb$^{3+}$ ions, is an ideal system to address this question, since it shows no long-range magnetic ordering with Mg/Ga site disorder. Despite the intensive study, it remains unresolved as to whether YbMgGaO$_4$ is a QSL or in the RS state. Here, through ultralow-temperature thermal conductivity and magnetic torque measurements, plus specific heat and DC magnetization data, we observed a residual $κ_0/T$ term and series of quantum spin state transitions in the zero temperature limit for YbMgGaO$_4$. These observations strongly suggest that a QSL state with itinerant excitations and quantum spin fluctuations survives disorder in YbMgGaO$_4$. △ Less

Submitted 4 July, 2021; originally announced July 2021.

Comments: 31 pages, 10 figures

Journal ref: Nat. Commun. 12, 4949 (2021)

Quantum spin state transitions in spin-1 equilateral triangular lattice antiferromagnet Na$_2$BaNi(PO$_4$)$_2$

Authors: N. Li, Q. Huang, A. Brassington, X. Y. Yue, W. J. Chu, S. K. Guang, X. H. Zhou, P. Gao, E. X. Feng, H. B. Cao, E. S. Choi, Y. Sun, Q. J. Li, X. Zhao, H. D. Zhou, X. F. Sun

Abstract: We have grown single crystals of Na$_2$BaNi(PO$_4$)$_2$, a new spin-1 equilateral triangular lattice antiferromagnet (ETLAF), and performed magnetic susceptibility, specific heat and thermal conductivity measurements at ultralow temperatures. The main results are (i) at zero magnetic field, Na$_2$BaNi(PO$_4$)$_2$ exhibits a magnetic ordering at 430 mK with a weak ferromagnetic moment along the… ▽ More We have grown single crystals of Na$_2$BaNi(PO$_4$)$_2$, a new spin-1 equilateral triangular lattice antiferromagnet (ETLAF), and performed magnetic susceptibility, specific heat and thermal conductivity measurements at ultralow temperatures. The main results are (i) at zero magnetic field, Na$_2$BaNi(PO$_4$)$_2$ exhibits a magnetic ordering at 430 mK with a weak ferromagnetic moment along the $c$ axis. This suggests a canted 120$^\circ$ spin structure, which is in a plane including the crystallographic $c$ axis due to the existence of an easy-axis anisotropy and ferromagnetically stacked along the $c$ axis; (ii) with increasing field along the $c$ axis, a 1/3 magnetization plateau is observed which means the canted 120$^\circ$ spin structure is transformed to a up up down (UUD) spin structure. With even higher fields, the UUD phase further evolves to possible V and V' phases; (iii) with increasing field along the $a$ axis, the canted 120$^\circ$ spin structure is possibly transformed to a umbrella phase and a V phase. Therefore, Na$_2$BaNi(PO$_4$)$_2$ is a rare example of spin-1 ETLAF with single crystalline form to exhibit easy-axis spin anisotropy and series of quantum spin state transitions. △ Less

Submitted 24 August, 2021; v1 submitted 1 July, 2021; originally announced July 2021.

Comments: 9 pages, 10 figures, accepted for publication in Phys. Rev. B

Journal ref: Phys. Rev. B 104, 104403 (2021)

Analyzing Adversarial Robustness of Deep Neural Networks in Pixel Space: a Semantic Perspective

Authors: Lina Wang, Xingshu Chen, Yulong Wang, Yawei Yue, Yi Zhu, Xuemei Zeng, Wei Wang

Abstract: The vulnerability of deep neural networks to adversarial examples, which are crafted maliciously by modifying the inputs with imperceptible perturbations to misled the network produce incorrect outputs, reveals the lack of robustness and poses security concerns. Previous works study the adversarial robustness of image classifiers on image level and use all the pixel information in an image indiscr… ▽ More The vulnerability of deep neural networks to adversarial examples, which are crafted maliciously by modifying the inputs with imperceptible perturbations to misled the network produce incorrect outputs, reveals the lack of robustness and poses security concerns. Previous works study the adversarial robustness of image classifiers on image level and use all the pixel information in an image indiscriminately, lacking of exploration of regions with different semantic meanings in the pixel space of an image. In this work, we fill this gap and explore the pixel space of the adversarial image by proposing an algorithm to looking for possible perturbations pixel by pixel in different regions of the segmented image. The extensive experimental results on CIFAR-10 and ImageNet verify that searching for the modified pixel in only some pixels of an image can successfully launch the one-pixel adversarial attacks without requiring all the pixels of the entire image, and there exist multiple vulnerable points scattered in different regions of an image. We also demonstrate that the adversarial robustness of different regions on the image varies with the amount of semantic information contained. △ Less

Submitted 17 June, 2021; originally announced June 2021.

Comments: 13 pages, 6figures

MSC Class: 68T-06

Interpreting Expert Annotation Differences in Animal Behavior

Authors: Megan Tjandrasuwita, Jennifer J. Sun, Ann Kennedy, Swarat Chaudhuri, Yisong Yue

Abstract: Hand-annotated data can vary due to factors such as subjective differences, intra-rater variability, and differing annotator expertise. We study annotations from different experts who labelled the same behavior classes on a set of animal behavior videos, and observe a variation in annotation styles. We propose a new method using program synthesis to help interpret annotation differences for behavi… ▽ More Hand-annotated data can vary due to factors such as subjective differences, intra-rater variability, and differing annotator expertise. We study annotations from different experts who labelled the same behavior classes on a set of animal behavior videos, and observe a variation in annotation styles. We propose a new method using program synthesis to help interpret annotation differences for behavior analysis. Our model selects relevant trajectory features and learns a temporal filter as part of a program, which corresponds to estimated importance an annotator places on that feature at each timestamp. Our experiments on a dataset from behavioral neuroscience demonstrate that compared to baseline approaches, our method is more accurate at capturing annotator labels and learns interpretable temporal filters. We believe that our method can lead to greater reproducibility of behavior annotations used in scientific studies. We plan to release our code. △ Less

Submitted 10 June, 2021; originally announced June 2021.

Comments: 4 pages, 5 figures, presented as a poster at CV4Animals workshop @ CVPR21

Meta-Adaptive Nonlinear Control: Theory and Algorithms

Authors: Guanya Shi, Kamyar Azizzadenesheli, Michael O'Connell, Soon-Jo Chung, Yisong Yue

Abstract: We present an online multi-task learning approach for adaptive nonlinear control, which we call Online Meta-Adaptive Control (OMAC). The goal is to control a nonlinear system subject to adversarial disturbance and unknown $\textit{environment-dependent}$ nonlinear dynamics, under the assumption that the environment-dependent dynamics can be well captured with some shared representation. Our approa… ▽ More We present an online multi-task learning approach for adaptive nonlinear control, which we call Online Meta-Adaptive Control (OMAC). The goal is to control a nonlinear system subject to adversarial disturbance and unknown $\textit{environment-dependent}$ nonlinear dynamics, under the assumption that the environment-dependent dynamics can be well captured with some shared representation. Our approach is motivated by robot control, where a robotic system encounters a sequence of new environmental conditions that it must quickly adapt to. A key emphasis is to integrate online representation learning with established methods from control theory, in order to arrive at a unified framework that yields both control-theoretic and learning-theoretic guarantees. We provide instantiations of our approach under varying conditions, leading to the first non-asymptotic end-to-end convergence guarantee for multi-task nonlinear control. OMAC can also be integrated with deep representation learning. Experiments show that OMAC significantly outperforms conventional adaptive control approaches which do not learn the shared representation, in inverted pendulum and 6-DoF drone control tasks under varying wind conditions. △ Less

Submitted 26 October, 2021; v1 submitted 10 June, 2021; originally announced June 2021.

Comments: 35th Conference on Neural Information Processing Systems (NeurIPS 2021), Sydney, Australia

Fine-Grained System Identification of Nonlinear Neural Circuits

Authors: Dawna Bagherian, James Gornet, Jeremy Bernstein, Yu-Li Ni, Yisong Yue, Markus Meister

Abstract: We study the problem of sparse nonlinear model recovery of high dimensional compositional functions. Our study is motivated by emerging opportunities in neuroscience to recover fine-grained models of biological neural circuits using collected measurement data. Guided by available domain knowledge in neuroscience, we explore conditions under which one can recover the underlying biological circuit t… ▽ More We study the problem of sparse nonlinear model recovery of high dimensional compositional functions. Our study is motivated by emerging opportunities in neuroscience to recover fine-grained models of biological neural circuits using collected measurement data. Guided by available domain knowledge in neuroscience, we explore conditions under which one can recover the underlying biological circuit that generated the training data. Our results suggest insights of both theoretical and practical interests. Most notably, we find that a sign constraint on the weights is a necessary condition for system recovery, which we establish both theoretically with an identifiability guarantee and empirically on simulated biological circuits. We conclude with a case study on retinal ganglion cell circuits using data collected from mouse retina, showcasing the practical potential of this approach. △ Less

Submitted 9 June, 2021; originally announced June 2021.

Comments: Preprint. 11 pages, 8 figures. Accepted Research Track paper to appear at KDD '21, August 14-18, Virtual Event, Singapore

Learning Pseudo-Backdoors for Mixed Integer Programs

Authors: Aaron Ferber, Jialin Song, Bistra Dilkina, Yisong Yue

Abstract: We propose a machine learning approach for quickly solving Mixed Integer Programs (MIP) by learning to prioritize a set of decision variables, which we call pseudo-backdoors, for branching that results in faster solution times. Learning-based approaches have seen success in the area of solving combinatorial optimization problems by being able to flexibly leverage common structures in a given distr… ▽ More We propose a machine learning approach for quickly solving Mixed Integer Programs (MIP) by learning to prioritize a set of decision variables, which we call pseudo-backdoors, for branching that results in faster solution times. Learning-based approaches have seen success in the area of solving combinatorial optimization problems by being able to flexibly leverage common structures in a given distribution of problems. Our approach takes inspiration from the concept of strong backdoors, which corresponds to a small set of variables such that only branching on these variables yields an optimal integral solution and a proof of optimality. Our notion of pseudo-backdoors corresponds to a small set of variables such that only branching on them leads to faster solve time (which can be solver dependent). A key advantage of pseudo-backdoors over strong backdoors is that they are much amenable to data-driven identification or prediction. Our proposed method learns to estimate the solver performance of a proposed pseudo-backdoor, using a labeled dataset collected on a set of training MIP instances. This model can then be used to identify high-quality pseudo-backdoors on new MIP instances from the same distribution. We evaluate our method on the generalized independent set problems and find that our approach can efficiently identify high-quality pseudo-backdoors. In addition, we compare our learned approach against Gurobi, a state-of-the-art MIP solver, demonstrating that our method can be used to improve solver performance. △ Less

Submitted 9 June, 2021; originally announced June 2021.

Comments: 2 pages, 1 page reference, SOCS extended abstract

End-to-End Sequential Sampling and Reconstruction for MRI

Authors: Tianwei Yin, Zihui Wu, He Sun, Adrian V. Dalca, Yisong Yue, Katherine L. Bouman

Abstract: Accelerated MRI shortens acquisition time by subsampling in the measurement $κ$-space. Recovering a high-fidelity anatomical image from subsampled measurements requires close cooperation between two components: (1) a sampler that chooses the subsampling pattern and (2) a reconstructor that recovers images from incomplete measurements. In this paper, we leverage the sequential nature of MRI measure… ▽ More Accelerated MRI shortens acquisition time by subsampling in the measurement $κ$-space. Recovering a high-fidelity anatomical image from subsampled measurements requires close cooperation between two components: (1) a sampler that chooses the subsampling pattern and (2) a reconstructor that recovers images from incomplete measurements. In this paper, we leverage the sequential nature of MRI measurements, and propose a fully differentiable framework that jointly learns a sequential sampling policy simultaneously with a reconstruction strategy. This co-designed framework is able to adapt during acquisition in order to capture the most informative measurements for a particular target. Experimental results on the fastMRI knee dataset demonstrate that the proposed approach successfully utilizes intermediate information during the sampling process to boost reconstruction performance. In particular, our proposed method can outperform the current state-of-the-art learned $κ$-space sampling baseline on over 96% of test samples. We also investigate the individual and collective benefits of the sequential sampling and co-design strategies. △ Less

Submitted 16 July, 2022; v1 submitted 13 May, 2021; originally announced May 2021.

Comments: Code and supplementary materials are available at http://imaging.cms.caltech.edu/seq-mri

Journal ref: Proceedings of Machine Learning for Health, PMLR 158:261-281, 2021

Ideology in Open Source Development

Authors: Yang Yue, Xiaoran Yu, Xinyi You, Yi Wang, David Redmiles

Abstract: Open source development, to a great extent, is a type of social movement in which shared ideologies play critical roles. For participants of open source development, ideology determines how they make sense of things, shapes their thoughts, actions, and interactions, enables rich social dynamics in their projects and communities, and hereby realizes profound impacts at both individual and organizat… ▽ More Open source development, to a great extent, is a type of social movement in which shared ideologies play critical roles. For participants of open source development, ideology determines how they make sense of things, shapes their thoughts, actions, and interactions, enables rich social dynamics in their projects and communities, and hereby realizes profound impacts at both individual and organizational levels. While software engineering researchers have been increasingly recognizing ideology's importance in open source development, the notion of "ideology" has shown significant ambiguity and vagueness, and resulted in theoretical and empirical confusion. In this article, we first examine the historical development of ideology's conceptualization, and its theories in multiple disciplines. Then, we review the extant software engineering literature related to ideology. We further argue the imperatives of developing an empirical theory of ideology in open source development, and propose a research agenda for developing such a theory. How such a theory could be applied is also discussed. △ Less

Submitted 26 April, 2021; originally announced April 2021.

Comments: To be published in CHASE 2021

Modulation instability, conservation laws and localized waves for the generalized coupled Fokas-Lenells equation

Authors: Yunfei Yue, Yong Chen

Abstract: This paper focuses on the modulation instability, conservation laws and localized wave solutions of the generalized coupled Fokas-Lenells equation. Based on the theory of linear stability analysis, distribution pattern of modulation instability gain G in the (K,k) frequency plane is depicted, and the constraints for the existence of rogue waves are derived. Subsequently, we construct the infinitel… ▽ More This paper focuses on the modulation instability, conservation laws and localized wave solutions of the generalized coupled Fokas-Lenells equation. Based on the theory of linear stability analysis, distribution pattern of modulation instability gain G in the (K,k) frequency plane is depicted, and the constraints for the existence of rogue waves are derived. Subsequently, we construct the infinitely many conservation laws for the generalized coupled Fokas-Lenells equation from the Riccati-type formulas of the Lax pair. In addition, the compact determinant expressions of the N-order localized wave solutions are given via generalized Darboux transformation, including higher-order rogue waves and interaction solutions among rogue waves with bright-dark solitons or breathers. These solutions are parameter controllable: (m_i,n_i) and (α,β) control the structure and ridge deflection of solution respectively, while the value of |d| controls the strength of interaction to realize energy exchange. Especially, when d=0, the interaction solutions degenerate into the corresponding order of rogue waves. △ Less

Submitted 20 April, 2021; originally announced April 2021.

Comments: 21 pages, 10 figures

The Multi-Agent Behavior Dataset: Mouse Dyadic Social Interactions

Authors: Jennifer J. Sun, Tomomi Karigo, Dipam Chakraborty, Sharada P. Mohanty, Benjamin Wild, Quan Sun, Chen Chen, David J. Anderson, Pietro Perona, Yisong Yue, Ann Kennedy

Abstract: Multi-agent behavior modeling aims to understand the interactions that occur between agents. We present a multi-agent dataset from behavioral neuroscience, the Caltech Mouse Social Interactions (CalMS21) Dataset. Our dataset consists of trajectory data of social interactions, recorded from videos of freely behaving mice in a standard resident-intruder assay. To help accelerate behavioral studies,… ▽ More Multi-agent behavior modeling aims to understand the interactions that occur between agents. We present a multi-agent dataset from behavioral neuroscience, the Caltech Mouse Social Interactions (CalMS21) Dataset. Our dataset consists of trajectory data of social interactions, recorded from videos of freely behaving mice in a standard resident-intruder assay. To help accelerate behavioral studies, the CalMS21 dataset provides benchmarks to evaluate the performance of automated behavior classification methods in three settings: (1) for training on large behavioral datasets all annotated by a single annotator, (2) for style transfer to learn inter-annotator differences in behavior definitions, and (3) for learning of new behaviors of interest given limited training data. The dataset consists of 6 million frames of unlabeled tracked poses of interacting mice, as well as over 1 million frames with tracked poses and corresponding frame-level behavior annotations. The challenge of our dataset is to be able to classify behaviors accurately using both labeled and unlabeled tracking data, as well as being able to generalize to new settings. △ Less

Submitted 18 November, 2021; v1 submitted 6 April, 2021; originally announced April 2021.

Comments: NeurIPS2021 Datasets & Benchmarks. Dataset: https://data.caltech.edu/records/1991, Website: https://sites.google.com/view/computational-behavior/our-datasets/calms21-dataset

Online Robust Control of Nonlinear Systems with Large Uncertainty

Authors: Dimitar Ho, Hoang M. Le, John C. Doyle, Yisong Yue

Abstract: Robust control is a core approach for controlling systems with performance guarantees that are robust to modeling error, and is widely used in real-world systems. However, current robust control approaches can only handle small system uncertainty, and thus require significant effort in system identification prior to controller design. We present an online approach that robustly controls a nonlinea… ▽ More Robust control is a core approach for controlling systems with performance guarantees that are robust to modeling error, and is widely used in real-world systems. However, current robust control approaches can only handle small system uncertainty, and thus require significant effort in system identification prior to controller design. We present an online approach that robustly controls a nonlinear system under large model uncertainty. Our approach is based on decomposing the problem into two sub-problems, "robust control design" (which assumes small model uncertainty) and "chasing consistent models", which can be solved using existing tools from control theory and online learning, respectively. We provide a learning convergence analysis that yields a finite mistake bound on the number of times performance requirements are not met and can provide strong safety guarantees, by bounding the worst-case state deviation. To the best of our knowledge, this is the first approach for online robust control of nonlinear systems with such learning theoretic and safety guarantees. We also show how to instantiate this framework for general robotic systems, demonstrating the practicality of our approach. △ Less

Submitted 4 June, 2021; v1 submitted 19 March, 2021; originally announced March 2021.

Comments: 58 pages, 5 figures

Journal ref: Proceedings of The 24th International Conference on Artificial Intelligence and Statistics 2021, PMLR 130:3475-3483

Reducing Redundancy in Data Organization and Arithmetic Calculation for Stencil Computations

Authors: Kun Li, Liang Yuan, Yunquan Zhang, Yue Yue, Hang Cao, Pengqi Lu

Abstract: Stencil computation is one of the most important kernels in various scientific and engineering applications. A variety of work has focused on vectorization techniques, aiming at exploiting the in-core data parallelism. Briefly, they either incur data alignment conflicts or hurt the data locality when integrated with tiling. In this paper, a novel transpose layout is devised to preserve the data lo… ▽ More Stencil computation is one of the most important kernels in various scientific and engineering applications. A variety of work has focused on vectorization techniques, aiming at exploiting the in-core data parallelism. Briefly, they either incur data alignment conflicts or hurt the data locality when integrated with tiling. In this paper, a novel transpose layout is devised to preserve the data locality for tiling in the data space and reduce the data reorganization overhead for vectorization simultaneously. We then propose an approach of temporal computation folding designed to further reduce the redundancy of arithmetic calculations by exploiting the register reuse, alleviating the increased register pressure, and deducing generalization with a linear regression model. Experimental results on the AVX-2 and AVX-512 CPUs show that our approach obtains a competitive performance. △ Less

Submitted 16 March, 2021; originally announced March 2021.

Comments: arXiv admin note: substantial text overlap with arXiv:2103.08825

An Efficient Vectorization Scheme for Stencil Computation

Authors: Kun Li, Liang Yuan, Yunquan Zhang, Yue Yue, Hang Cao, Pengqi Lu

Abstract: Stencil computation is one of the most important kernels in various scientific and engineering applications. A variety of work has focused on vectorization and tiling techniques, aiming at exploiting the in-core data parallelism and data locality respectively. In this paper, the downsides of existing vectorization schemes are analyzed. Briefly, they either incur data alignment conflicts or hurt th… ▽ More Stencil computation is one of the most important kernels in various scientific and engineering applications. A variety of work has focused on vectorization and tiling techniques, aiming at exploiting the in-core data parallelism and data locality respectively. In this paper, the downsides of existing vectorization schemes are analyzed. Briefly, they either incur data alignment conflicts or hurt the data locality when integrated with tiling. Then we propose a novel transpose layout to preserve the data locality for tiling and reduce the data reorganization overhead for vectorization simultaneously. To further improve the data reuse at the register level, a time loop unroll-and-jam strategy is designed to perform multistep stencil computation along the time dimension. Experimental results on the AVX-2 and AVX-512 CPUs show that our approach obtains a competitive performance. △ Less

Submitted 17 March, 2021; v1 submitted 15 March, 2021; originally announced March 2021.

Extragalactic HI 21-cm absorption line observations with the Five-hundred-meter Aperture Spherical radio Telescope

Authors: Bo Zhang, Ming Zhu, Zhong-Zu Wu, Qing-Zheng Yu, Peng Jiang, You-Ling Yue, Meng-Lin Huang, Qiao-Li Hao

Abstract: We present a pilot study of extragalactic HI 21-cm absorption lines using the Five-hundred-meter Aperture Spherical radio Telescope (FAST). We observed 5 continuum sources with HI absorption features firstly identified in the 40% data release of the Arecibo Legacy Fast Arecibo L-Band Feed Array (ALFA) Survey (ALFALFA), including two systems later detected by the Westerbork Synthesis Radio Telescop… ▽ More We present a pilot study of extragalactic HI 21-cm absorption lines using the Five-hundred-meter Aperture Spherical radio Telescope (FAST). We observed 5 continuum sources with HI absorption features firstly identified in the 40% data release of the Arecibo Legacy Fast Arecibo L-Band Feed Array (ALFA) Survey (ALFALFA), including two systems later detected by the Westerbork Synthesis Radio Telescope (WSRT). Most of our observations were carried out during the FAST commissioning phase, and we have tested different observing modes, as well as data reduction methods, to produce the best spectra. Our observations successfully confirmed the existence of HI absorption lines in all these systems, including two sources that were marginally detected by ALFALFA. We fitted the HI profiles with single or double of Gaussian functions, and calculated the HI column densities of each source. The HI absorption profiles obtained by FAST show much higher spectral resolution and higher S/N ratio than the existing data in the literature, thus demonstrating the power of FAST in revealing detailed structures of HI absorption lines. Our pilot observations and tests have enabled us to develop a strategy to search for HI absorption sources using the data from the FAST extragalactic HI survey, which is one of the key projects undertaken at FAST. We expect that over 1,500 extragalactic HI absorbing systems could be detected with survey data, based on sensitivity level we achieved in pilot observations. △ Less

Submitted 11 March, 2021; originally announced March 2021.

Comments: 13 pages, 14 figures. Accepted by Monthly Notices of the Royal Astronomical Society

Learning to Control an Unstable System with One Minute of Data: Leveraging Gaussian Process Differentiation in Predictive Control

Authors: Ivan D. Jimenez Rodriguez, Ugo Rosolia, Aaron D. Ames, Yisong Yue

Abstract: We present a straightforward and efficient way to control unstable robotic systems using an estimated dynamics model. Specifically, we show how to exploit the differentiability of Gaussian Processes to create a state-dependent linearized approximation of the true continuous dynamics that can be integrated with model predictive control. Our approach is compatible with most Gaussian process approach… ▽ More We present a straightforward and efficient way to control unstable robotic systems using an estimated dynamics model. Specifically, we show how to exploit the differentiability of Gaussian Processes to create a state-dependent linearized approximation of the true continuous dynamics that can be integrated with model predictive control. Our approach is compatible with most Gaussian process approaches for system identification, and can learn an accurate model using modest amounts of training data. We validate our approach by learning the dynamics of an unstable system such as a segway with a 7-D state space and 2-D input space (using only one minute of data), and we show that the resulting controller is robust to unmodelled dynamics and disturbances, while state-of-the-art control methods based on nominal models can fail under small perturbations. Code is open sourced at https://github.com/learning-and-control/core . △ Less

Submitted 1 August, 2021; v1 submitted 8 March, 2021; originally announced March 2021.

Sampled-Data Stabilization with Control Lyapunov Functions via Quadratically Constrained Quadratic Programs

Authors: Andrew J. Taylor, Victor D. Dorobantu, Yisong Yue, Paulo Tabuada, Aaron D. Ames

Abstract: Controller design for nonlinear systems with Control Lyapunov Function (CLF) based quadratic programs has recently been successfully applied to a diverse set of difficult control tasks. These existing formulations do not address the gap between design with continuous time models and the discrete time sampled implementation of the resulting controllers, often leading to poor performance on hardware… ▽ More Controller design for nonlinear systems with Control Lyapunov Function (CLF) based quadratic programs has recently been successfully applied to a diverse set of difficult control tasks. These existing formulations do not address the gap between design with continuous time models and the discrete time sampled implementation of the resulting controllers, often leading to poor performance on hardware platforms. We propose an approach to close this gap by synthesizing sampled-data counterparts to these CLF-based controllers, specified as quadratically constrained quadratic programs (QCQPs). Assuming feedback linearizability and stable zero-dynamics of a system's continuous time model, we derive practical stability guarantees for the resulting sampled-data system. We demonstrate improved performance of the proposed approach over continuous time counterparts in simulation. △ Less

Submitted 5 March, 2021; originally announced March 2021.

Comments: 6 pages, 1 figure, submitted to IEEE L-CSS / CDC 2021

Minimax Model Learning

Authors: Cameron Voloshin, Nan Jiang, Yisong Yue

Abstract: We present a novel off-policy loss function for learning a transition model in model-based reinforcement learning. Notably, our loss is derived from the off-policy policy evaluation objective with an emphasis on correcting distribution shift. Compared to previous model-based techniques, our approach allows for greater robustness under model misspecification or distribution shift induced by learnin… ▽ More We present a novel off-policy loss function for learning a transition model in model-based reinforcement learning. Notably, our loss is derived from the off-policy policy evaluation objective with an emphasis on correcting distribution shift. Compared to previous model-based techniques, our approach allows for greater robustness under model misspecification or distribution shift induced by learning/evaluating policies that are distinct from the data-generating policy. We provide a theoretical analysis and show empirical improvements over existing model-based off-policy evaluation methods. We provide further analysis showing our loss can be used for off-policy optimization (OPO) and demonstrate its integration with more recent improvements in OPO. △ Less

Submitted 2 March, 2021; originally announced March 2021.

Journal ref: PMLR, Volume 130, 2021

Computing the Information Content of Trained Neural Networks

Authors: Jeremy Bernstein, Yisong Yue

Abstract: How much information does a learning algorithm extract from the training data and store in a neural network's weights? Too much, and the network would overfit to the training data. Too little, and the network would not fit to anything at all. Naïvely, the amount of information the network stores should scale in proportion to the number of trainable weights. This raises the question: how can neural… ▽ More How much information does a learning algorithm extract from the training data and store in a neural network's weights? Too much, and the network would overfit to the training data. Too little, and the network would not fit to anything at all. Naïvely, the amount of information the network stores should scale in proportion to the number of trainable weights. This raises the question: how can neural networks with vastly more weights than training data still generalise? A simple resolution to this conundrum is that the number of weights is usually a bad proxy for the actual amount of information stored. For instance, typical weight vectors may be highly compressible. Then another question occurs: is it possible to compute the actual amount of information stored? This paper derives both a consistent estimator and a closed-form upper bound on the information content of infinitely wide neural networks. The derivation is based on an identification between neural information content and the negative log probability of a Gaussian orthant. This identification yields bounds that analytically control the generalisation behaviour of the entire solution space of infinitely wide networks. The bounds have a simple dependence on both the network architecture and the training data. Corroborating the findings of Valle-Pérez et al. (2019), who conducted a similar analysis using approximate Gaussian integration techniques, the bounds are found to be both non-vacuous and correlated with the empirical generalisation behaviour at finite width. △ Less

Submitted 1 March, 2021; originally announced March 2021.

CRAFTS for Fast Radio Bursts Extending the dispersion-fluence relation with new FRBs detected by FAST

Authors: Chen-Hui Niu, Di Li, Rui Luo, Wei-Yang Wang, Jumei Yao, Bing Zhang, Wei-Wei Zhu, Pei Wang, Haoyang Ye, Yong-Kun Zhang, Jia-rui Niu, Ning-yu Tang, Ran Duan, Marko Krco, Shi Dai, Yi Feng, Chenchen Miao, Zhichen Pan, Lei Qian, Mengyao Xue, Mao Yuan, Youling Yue, Lei Zhang, Xinxin Zhang

Abstract: We report three new FRBs discovered by the Five-hundred-meter Aperture Spherical radio Telescope (FAST), namely FRB 181017.J0036+11, FRB 181118 and FRB 181130, through the Commensal Radio Astronomy FAST Survey (CRAFTS). Together with FRB 181123 that was reported earlier, all four FAST-discovered FRBs share the same characteristics of low fluence ($\leq$0.2 Jy ms) and high dispersion measure (DM,… ▽ More We report three new FRBs discovered by the Five-hundred-meter Aperture Spherical radio Telescope (FAST), namely FRB 181017.J0036+11, FRB 181118 and FRB 181130, through the Commensal Radio Astronomy FAST Survey (CRAFTS). Together with FRB 181123 that was reported earlier, all four FAST-discovered FRBs share the same characteristics of low fluence ($\leq$0.2 Jy ms) and high dispersion measure (DM, $>1000$ \dmu), consistent with the anti-correlation between DM and fluence of the entire FRB population. FRB 181118 and FRB 181130 exhibit band-limited features. FRB 181130 is prominently scattered ($τ_s\simeq8$ ms) at 1.25 GHz. FRB 181017.J0036+11 has full-bandwidth emission with a fluence of 0.042 Jy ms, which is one of the faintest FRB sources detected so far. CRAFTS starts to built a new sample of FRBs that fills the region for more distant and fainter FRBs in the fluence-$\rm DM_E$ diagram, previously out of reach of other surveys. The implied all sky event rate of FRBs is $1.24^{+1.94}_{-0.90} \times 10^5$ sky$^{-1}$ day$^{-1}$ at the $95\%$ confidence interval above 0.0146 Jy ms. We also demonstrate here that the probability density function of CRAFTS FRB detections is sensitive to the assumed intrinsic FRB luminosity function and cosmological evolution, which may be further constrained with more discoveries. △ Less

Submitted 21 February, 2021; originally announced February 2021.

Comments: 9 Pages, 4 Plots and 1 Table. The Astrophysical Journal Letter Accepted

Journal ref: ApJL 909 L8 (2021)

Learning Invariant Representation of Tasks for Robust Surgical State Estimation

Authors: Yidan Qin, Max Allan, Yisong Yue, Joel W. Burdick, Mahdi Azizian

Abstract: Surgical state estimators in robot-assisted surgery (RAS) - especially those trained via learning techniques - rely heavily on datasets that capture surgeon actions in laboratory or real-world surgical tasks. Real-world RAS datasets are costly to acquire, are obtained from multiple surgeons who may use different surgical strategies, and are recorded under uncontrolled conditions in highly complex… ▽ More Surgical state estimators in robot-assisted surgery (RAS) - especially those trained via learning techniques - rely heavily on datasets that capture surgeon actions in laboratory or real-world surgical tasks. Real-world RAS datasets are costly to acquire, are obtained from multiple surgeons who may use different surgical strategies, and are recorded under uncontrolled conditions in highly complex environments. The combination of high diversity and limited data calls for new learning methods that are robust and invariant to operating conditions and surgical techniques. We propose StiseNet, a Surgical Task Invariance State Estimation Network with an invariance induction framework that minimizes the effects of variations in surgical technique and operating environments inherent to RAS datasets. StiseNet's adversarial architecture learns to separate nuisance factors from information needed for surgical state estimation. StiseNet is shown to outperform state-of-the-art state estimation methods on three datasets (including a new real-world RAS dataset: HERNIA-20). △ Less

Submitted 17 February, 2021; originally announced February 2021.

Comments: Accepted to IEEE Robotics & Automation Letters

Multiple-camera defocus imaging of ultracold atomic gases

Authors: A. R. Perry, S. Sugawa, F. Salces-Carcoba, Y. Yue, I. B. Spielman

Abstract: In cold atom experiments, each image of light refracted and absorbed by an atomic ensemble carries a remarkable amount of information. Numerous imaging techniques including absorption, fluorescence, and phase-contrast are commonly used. Other techniques such as off-resonance defocused imaging (ORDI), where an in-focus image is deconvolved from a defocused image, have been demonstrated but find onl… ▽ More In cold atom experiments, each image of light refracted and absorbed by an atomic ensemble carries a remarkable amount of information. Numerous imaging techniques including absorption, fluorescence, and phase-contrast are commonly used. Other techniques such as off-resonance defocused imaging (ORDI), where an in-focus image is deconvolved from a defocused image, have been demonstrated but find only niche applications. The ORDI inversion process introduces systematic artifacts because it relies on regularization to account for missing information at some spatial frequencies. In the present work, we extend ORDI to use multiple cameras simultaneously at degrees of defocus, eliminating the need for regularization and its attendant artifacts. We demonstrate this technique by imaging Bose-Einstein condensates, and show that the statistical uncertainties in the measured column density using the multiple-camera off-resonance defocused (MORD) imaging method are competitive with absorption imaging near resonance and phase contrast imaging far from resonance. Experimentally, the MORD method may be incorporated into existing set-ups with minimal additional equipment. △ Less

Submitted 16 February, 2021; originally announced February 2021.

Comments: 13 pages; 6 figures

Learning by Turning: Neural Architecture Aware Optimisation

Authors: Yang Liu, Jeremy Bernstein, Markus Meister, Yisong Yue

Abstract: Descent methods for deep networks are notoriously capricious: they require careful tuning of step size, momentum and weight decay, and which method will work best on a new benchmark is a priori unclear. To address this problem, this paper conducts a combined study of neural architecture and optimisation, leading to a new optimiser called Nero: the neuronal rotator. Nero trains reliably without mom… ▽ More Descent methods for deep networks are notoriously capricious: they require careful tuning of step size, momentum and weight decay, and which method will work best on a new benchmark is a priori unclear. To address this problem, this paper conducts a combined study of neural architecture and optimisation, leading to a new optimiser called Nero: the neuronal rotator. Nero trains reliably without momentum or weight decay, works in situations where Adam and SGD fail, and requires little to no learning rate tuning. Also, Nero's memory footprint is ~ square root that of Adam or LAMB. Nero combines two ideas: (1) projected gradient descent over the space of balanced networks; (2) neuron-specific updates, where the step size sets the angle through which each neuron's hyperplane turns. The paper concludes by discussing how this geometric connection between architecture and optimisation may impact theories of generalisation in deep learning. △ Less

Submitted 18 September, 2021; v1 submitted 14 February, 2021; originally announced February 2021.

Singlino-dominated dark matter in general NMSSM

Authors: Junjie Cao, Demin Li, Jingwei Lian, Yuanfang Yue, Haijing Zhou

Abstract: The general Next-to-Minimal Supersymmetric Standard Model (NMSSM) describes the singlino-dominated dark-matter (DM) property by four independent parameters: singlet-doublet Higgs coupling coefficient $λ$, Higgsino mass $μ_{tot}$, DM mass $m_{\tildeχ_1^0}$, and singlet Higgs self-coupling coefficient $κ$. The first three parameters strongly influence the DM-nucleon scattering rate, while $κ$ usuall… ▽ More The general Next-to-Minimal Supersymmetric Standard Model (NMSSM) describes the singlino-dominated dark-matter (DM) property by four independent parameters: singlet-doublet Higgs coupling coefficient $λ$, Higgsino mass $μ_{tot}$, DM mass $m_{\tildeχ_1^0}$, and singlet Higgs self-coupling coefficient $κ$. The first three parameters strongly influence the DM-nucleon scattering rate, while $κ$ usually affects the scattering only slightly. This characteristic implies that singlet-dominated particles may form a secluded DM sector. Under such a theoretical structure, the DM achieves the correct abundance by annihilating into a pair of singlet-dominated Higgs bosons by adjusting $κ$'s value. Its scattering with nucleons is suppressed when $λv/μ_{tot}$ is small. This speculation is verified by sophisticated scanning of the theory's parameter space with various experiment constraints considered. In addition, the Bayesian evidence of the general NMSSM and that of $Z_3$-NMSSM is computed. It is found that, at the cost of introducing one additional parameter, the former is approximately $3.3 \times 10^3$ times the latter. This result corresponds to Jeffrey's scale of 8.05 and implies that the considered experiments strongly prefer the general NMSSM to the $Z_3$-NMSSM. △ Less

Submitted 19 May, 2021; v1 submitted 10 February, 2021; originally announced February 2021.

Comments: 29 pages, 9 figures

Disentangling Observed Causal Effects from Latent Confounders using Method of Moments

Authors: Anqi Liu, Hao Liu, Tongxin Li, Saeed Karimi-Bidhendi, Yisong Yue, Anima Anandkumar

Abstract: Discovering the complete set of causal relations among a group of variables is a challenging unsupervised learning problem. Often, this challenge is compounded by the fact that there are latent or hidden confounders. When only observational data is available, the problem is ill-posed, i.e. the causal relationships are non-identifiable unless strong modeling assumptions are made. When interventions… ▽ More Discovering the complete set of causal relations among a group of variables is a challenging unsupervised learning problem. Often, this challenge is compounded by the fact that there are latent or hidden confounders. When only observational data is available, the problem is ill-posed, i.e. the causal relationships are non-identifiable unless strong modeling assumptions are made. When interventions are available, we provide guarantees on identifiability and learnability under mild assumptions. We assume a linear structural equation model (SEM) with independent latent factors and directed acyclic graph (DAG) relationships among the observables. Since the latent variable inference is based on independent component analysis (ICA), we call this model SEM-ICA. We use the method of moments principle to establish model identifiability. We develop efficient algorithms based on coupled tensor decomposition with linear constraints to obtain scalable and guaranteed solutions. Thus, we provide a principled approach to tackling the joint problem of causal discovery and latent variable inference. △ Less

Submitted 17 January, 2021; originally announced January 2021.

Periodic and Phase-locked Modulation in PSR B1929+10 Observed with FAST

Authors: F. F. Kou, W. M. Yan, B. Peng, J. G. Lu, K. Liu, C. M. Zhang, R. G. Strom, L. Wang, J. P. Yuan, Rai Yuen, Y. Z. Yu, J. M. Yao, B. Liu, J. Yan, P. Jiang, C. J. Jin, D. Li, L. Qian, Y. L. Yue, Y. Zhu

Abstract: We present a detailed single-pulse analysis for PSR B1929+10 based on observations with the Five-hundred-meter Aperture Spherical radio Telescope (FAST). The main pulse and interpulse are found to be modulated with a periodicity of $\sim12$ times the pulsar's rotational period ($P$). The $\sim12P$ modulation is confirmed as a periodic amplitude modulation instead of systematic drifting. The period… ▽ More We present a detailed single-pulse analysis for PSR B1929+10 based on observations with the Five-hundred-meter Aperture Spherical radio Telescope (FAST). The main pulse and interpulse are found to be modulated with a periodicity of $\sim12$ times the pulsar's rotational period ($P$). The $\sim12P$ modulation is confirmed as a periodic amplitude modulation instead of systematic drifting. The periodic amplitude modulation in the IP is found to be anti-correlated with that in the weak preceding component of the MP (MP_I), but correlated with that in the first two components of the MP (MP_II), which implies that the modulation patterns in the IP and the MP are phase-locked. What is more interesting is that the modulation in MP_II is delayed that in the IP by about 1P. Furthermore, high sensitivity observations by FAST reveal that weak emission exists between the MP and the IP. In addition, we confirm that the separation between the IP and the MP is independent of radio frequency. The above results are a conundrum for pulsar theories and cannot be satisfactorily explained by the current pulsar models. Therefore, our results observed with FAST provide an opportunity to probe the structure of pulsar emission and the neutron star's magnetosphere. △ Less

Submitted 18 December, 2020; originally announced December 2020.

Comments: 13 pages 12 figures

The ITRF coordinates of the spherical center of FAST

Authors: Lei Qian, Youling Yue

Abstract: The ITRF coordinates of the spherical center of the Five-hundred-meter Aperture Spherical radio Telescope (FAST) are $(X,Y,Z)=(-1668557.2070983793,$ $5506838.5266271923, 2744934.9655897617)$. The ITRF coordinates of the spherical center of the Five-hundred-meter Aperture Spherical radio Telescope (FAST) are $(X,Y,Z)=(-1668557.2070983793,$ $5506838.5266271923, 2744934.9655897617)$. △ Less

Submitted 16 December, 2020; v1 submitted 14 December, 2020; originally announced December 2020.

Comments: A short report that will appear in the proceeding of FAST/Future Pulsar Symposium 9 (FPS9), July 28-30, 2020, Xiamen University, Xiamen, - P. R. China

A single pulse study of PSR J1022+1001

Authors: Yi Feng, George Hobbs, Di Li, Shi Dai, Weiwei Zhu, Youling Yue, Pei Wang, Songbo Zhang, Lei Qian, Lei Zhang, Shuangqiang Wang, Chenchen Miao, Mao Yuan, Yongkun Zhang

Abstract: Using the Five-hundred-meter Aperture Spherical radio Telescope (FAST), we have recorded 10^5 single pulses from PSR J1022+1001. We studied the polarization properties, their energy distribution and their times of arrival. This is only possible with the high sensitivity available using FAST. There is no indication that PSR~J1022+1001 exhibits giant pulse, nulling or traditional mode changing pheno… ▽ More Using the Five-hundred-meter Aperture Spherical radio Telescope (FAST), we have recorded 10^5 single pulses from PSR J1022+1001. We studied the polarization properties, their energy distribution and their times of arrival. This is only possible with the high sensitivity available using FAST. There is no indication that PSR~J1022+1001 exhibits giant pulse, nulling or traditional mode changing phenomena. The energy in the leading and trailing components of the integrated profile is shown to be correlated. The degree of both linear and circular polarization increases with the pulse flux density for individual pulses. Our data indicates that pulse jitter leads to an excess noise in the timing residuals of 67 ns when scaled to one hour, which is consistent with Liu et al. (2015). We have unsuccessfully trialled various methods to improve timing precision through the selection of specific single pulses. Our work demonstrates that FAST can detect individual pulses from pulsars that are observed in order to detect and study gravitational waves. This capability enables detailed studies, and parameterisation, of the noise processes that affect the sensitivity of a pulsar timing array. △ Less

Submitted 11 December, 2020; originally announced December 2020.

Comments: Accepted by ApJ

Neural-Swarm2: Planning and Control of Heterogeneous Multirotor Swarms using Learned Interactions

Authors: Guanya Shi, Wolfgang Hönig, Xichen Shi, Yisong Yue, Soon-Jo Chung

Abstract: We present Neural-Swarm2, a learning-based method for motion planning and control that allows heterogeneous multirotors in a swarm to safely fly in close proximity. Such operation for drones is challenging due to complex aerodynamic interaction forces, such as downwash generated by nearby drones and ground effect. Conventional planning and control methods neglect capturing these interaction forces… ▽ More We present Neural-Swarm2, a learning-based method for motion planning and control that allows heterogeneous multirotors in a swarm to safely fly in close proximity. Such operation for drones is challenging due to complex aerodynamic interaction forces, such as downwash generated by nearby drones and ground effect. Conventional planning and control methods neglect capturing these interaction forces, resulting in sparse swarm configuration during flight. Our approach combines a physics-based nominal dynamics model with learned Deep Neural Networks (DNNs) with strong Lipschitz properties. We make use of two techniques to accurately predict the aerodynamic interactions between heterogeneous multirotors: i) spectral normalization for stability and generalization guarantees of unseen data and ii) heterogeneous deep sets for supporting any number of heterogeneous neighbors in a permutation-invariant manner without reducing expressiveness. The learned residual dynamics benefit both the proposed interaction-aware multi-robot motion planning and the nonlinear tracking control design because the learned interaction forces reduce the modelling errors. Experimental results demonstrate that Neural-Swarm2 is able to generalize to larger swarms beyond training cases and significantly outperforms a baseline nonlinear tracking controller with up to three times reduction in worst-case tracking errors. △ Less

Submitted 15 July, 2021; v1 submitted 10 December, 2020; originally announced December 2020.

Comments: Accepted by IEEE Transactions on Robotics (T-RO), 2021. Video is available at https://youtu.be/Y02juH6BDxo

Convergence analysis of a fully discrete energy-stable numerical scheme for the Q-tensor flow of liquid crystals

Authors: Varun M. Gudibanda, Franziska Weber, Yukun Yue

Abstract: We present a fully discrete convergent finite difference scheme for the Q-tensor flow of liquid crystals based on the energy-stable semi-discrete scheme by Zhao, Yang, Gong, and Wang (Comput. Methods Appl. Mech. Engrg. 2017). We prove stability properties of the scheme and show convergence to weak solutions of the Q-tensor flow equations. We demonstrate the performance of the scheme in numerical s… ▽ More We present a fully discrete convergent finite difference scheme for the Q-tensor flow of liquid crystals based on the energy-stable semi-discrete scheme by Zhao, Yang, Gong, and Wang (Comput. Methods Appl. Mech. Engrg. 2017). We prove stability properties of the scheme and show convergence to weak solutions of the Q-tensor flow equations. We demonstrate the performance of the scheme in numerical simulations. △ Less

Submitted 26 May, 2022; v1 submitted 1 December, 2020; originally announced December 2020.

Task Programming: Learning Data Efficient Behavior Representations

Authors: Jennifer J. Sun, Ann Kennedy, Eric Zhan, David J. Anderson, Yisong Yue, Pietro Perona

Abstract: Specialized domain knowledge is often necessary to accurately annotate training sets for in-depth analysis, but can be burdensome and time-consuming to acquire from domain experts. This issue arises prominently in automated behavior analysis, in which agent movements or actions of interest are detected from video tracking data. To reduce annotation effort, we present TREBA: a method to learn annot… ▽ More Specialized domain knowledge is often necessary to accurately annotate training sets for in-depth analysis, but can be burdensome and time-consuming to acquire from domain experts. This issue arises prominently in automated behavior analysis, in which agent movements or actions of interest are detected from video tracking data. To reduce annotation effort, we present TREBA: a method to learn annotation-sample efficient trajectory embedding for behavior analysis, based on multi-task self-supervised learning. The tasks in our method can be efficiently engineered by domain experts through a process we call "task programming", which uses programs to explicitly encode structured knowledge from domain experts. Total domain expert effort can be reduced by exchanging data annotation time for the construction of a small number of programmed tasks. We evaluate this trade-off using data from behavioral neuroscience, in which specialized domain knowledge is used to identify behaviors. We present experimental results in three datasets across two domains: mice and fruit flies. Using embeddings from TREBA, we reduce annotation burden by up to a factor of 10 without compromising accuracy compared to state-of-the-art features. Our results thus suggest that task programming and self-supervision can be an effective way to reduce annotation effort for domain experts. △ Less

Submitted 29 March, 2021; v1 submitted 27 November, 2020; originally announced November 2020.

Comments: To appear in as an Oral in CVPR 2021. Code: https://github.com/neuroethology/TREBA. Project page: https://sites.google.com/view/task-programming

Towards Robust Data-Driven Control Synthesis for Nonlinear Systems with Actuation Uncertainty

Authors: Andrew J. Taylor, Victor D. Dorobantu, Sarah Dean, Benjamin Recht, Yisong Yue, Aaron D. Ames

Abstract: Modern nonlinear control theory seeks to endow systems with properties such as stability and safety, and has been deployed successfully across various domains. Despite this success, model uncertainty remains a significant challenge in ensuring that model-based controllers transfer to real world systems. This paper develops a data-driven approach to robust control synthesis in the presence of model… ▽ More Modern nonlinear control theory seeks to endow systems with properties such as stability and safety, and has been deployed successfully across various domains. Despite this success, model uncertainty remains a significant challenge in ensuring that model-based controllers transfer to real world systems. This paper develops a data-driven approach to robust control synthesis in the presence of model uncertainty using Control Certificate Functions (CCFs), resulting in a convex optimization based controller for achieving properties like stability and safety. An important benefit of our framework is nuanced data-dependent guarantees, which in principle can yield sample-efficient data collection approaches that need not fully determine the input-to-state relationship. This work serves as a starting point for addressing important questions at the intersection of nonlinear control theory and non-parametric learning, both theoretical and in application. We validate the proposed method in simulation with an inverted pendulum in multiple experimental configurations. △ Less

Submitted 31 March, 2021; v1 submitted 21 November, 2020; originally announced November 2020.

Comments: 8 pages, 2 figures, submitted to Conference on Decision & Control (CDC) 2021

On the Benefits of Early Fusion in Multimodal Representation Learning

Authors: George Barnum, Sabera Talukder, Yisong Yue

Abstract: Intelligently reasoning about the world often requires integrating data from multiple modalities, as any individual modality may contain unreliable or incomplete information. Prior work in multimodal learning fuses input modalities only after significant independent processing. On the other hand, the brain performs multimodal processing almost immediately. This divide between conventional multimod… ▽ More Intelligently reasoning about the world often requires integrating data from multiple modalities, as any individual modality may contain unreliable or incomplete information. Prior work in multimodal learning fuses input modalities only after significant independent processing. On the other hand, the brain performs multimodal processing almost immediately. This divide between conventional multimodal learning and neuroscience suggests that a detailed study of early multimodal fusion could improve artificial multimodal representations. To facilitate the study of early multimodal fusion, we create a convolutional LSTM network architecture that simultaneously processes both audio and visual inputs, and allows us to select the layer at which audio and visual information combines. Our results demonstrate that immediate fusion of audio and visual inputs in the initial C-LSTM layer results in higher performing networks that are more robust to the addition of white noise in both audio and visual inputs. △ Less

Submitted 13 November, 2020; originally announced November 2020.

Machine Learning Based Path Planning for Improved Rover Navigation (Pre-Print Version)

Authors: Neil Abcouwer, Shreyansh Daftry, Siddarth Venkatraman, Tyler del Sesto, Olivier Toupet, Ravi Lanka, Jialin Song, Yisong Yue, Masahiro Ono

Abstract: Enhanced AutoNav (ENav), the baseline surface navigation software for NASA's Perseverance rover, sorts a list of candidate paths for the rover to traverse, then uses the Approximate Clearance Evaluation (ACE) algorithm to evaluate whether the most highly ranked paths are safe. ACE is crucial for maintaining the safety of the rover, but is computationally expensive. If the most promising candidates… ▽ More Enhanced AutoNav (ENav), the baseline surface navigation software for NASA's Perseverance rover, sorts a list of candidate paths for the rover to traverse, then uses the Approximate Clearance Evaluation (ACE) algorithm to evaluate whether the most highly ranked paths are safe. ACE is crucial for maintaining the safety of the rover, but is computationally expensive. If the most promising candidates in the list of paths are all found to be infeasible, ENav must continue to search the list and run time-consuming ACE evaluations until a feasible path is found. In this paper, we present two heuristics that, given a terrain heightmap around the rover, produce cost estimates that more effectively rank the candidate paths before ACE evaluation. The first heuristic uses Sobel operators and convolution to incorporate the cost of traversing high-gradient terrain. The second heuristic uses a machine learning (ML) model to predict areas that will be deemed untraversable by ACE. We used physics simulations to collect training data for the ML model and to run Monte Carlo trials to quantify navigation performance across a variety of terrains with various slopes and rock distributions. Compared to ENav's baseline performance, integrating the heuristics can lead to a significant reduction in ACE evaluations and average computation time per planning cycle, increase path efficiency, and maintain or improve the rate of successful traverses. This strategy of targeting specific bottlenecks with ML while maintaining the original ACE safety checks provides an example of how ML can be infused into planetary science missions and other safety-critical software. △ Less

Submitted 11 November, 2020; originally announced November 2020.

Comments: 9 pages, 5 figures, Pre-Print, This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

ACM Class: I.2.6; I.2.9; I.2.8

ROIAL: Region of Interest Active Learning for Characterizing Exoskeleton Gait Preference Landscapes

Authors: Kejun Li, Maegan Tucker, Erdem Bıyık, Ellen Novoseller, Joel W. Burdick, Yanan Sui, Dorsa Sadigh, Yisong Yue, Aaron D. Ames

Abstract: Characterizing what types of exoskeleton gaits are comfortable for users, and understanding the science of walking more generally, require recovering a user's utility landscape. Learning these landscapes is challenging, as walking trajectories are defined by numerous gait parameters, data collection from human trials is expensive, and user safety and comfort must be ensured. This work proposes the… ▽ More Characterizing what types of exoskeleton gaits are comfortable for users, and understanding the science of walking more generally, require recovering a user's utility landscape. Learning these landscapes is challenging, as walking trajectories are defined by numerous gait parameters, data collection from human trials is expensive, and user safety and comfort must be ensured. This work proposes the Region of Interest Active Learning (ROIAL) framework, which actively learns each user's underlying utility function over a region of interest that ensures safety and comfort. ROIAL learns from ordinal and preference feedback, which are more reliable feedback mechanisms than absolute numerical scores. The algorithm's performance is evaluated both in simulation and experimentally for three non-disabled subjects walking inside of a lower-body exoskeleton. ROIAL learns Bayesian posteriors that predict each exoskeleton user's utility landscape across four exoskeleton gait parameters. The algorithm discovers both commonalities and discrepancies across users' gait preferences and identifies the gait parameters that most influenced user feedback. These results demonstrate the feasibility of recovering gait utility landscapes from limited human trials. △ Less

Submitted 30 March, 2021; v1 submitted 9 November, 2020; originally announced November 2020.

Comments: 6 pages + 1 page of references; 7 figures; To Appear at ICRA 2021

Architecture Agnostic Neural Networks

Authors: Sabera Talukder, Guruprasad Raghavan, Yisong Yue

Abstract: In this paper, we explore an alternate method for synthesizing neural network architectures, inspired by the brain's stochastic synaptic pruning. During a person's lifetime, numerous distinct neuronal architectures are responsible for performing the same tasks. This indicates that biological neural networks are, to some degree, architecture agnostic. However, artificial networks rely on their fine… ▽ More In this paper, we explore an alternate method for synthesizing neural network architectures, inspired by the brain's stochastic synaptic pruning. During a person's lifetime, numerous distinct neuronal architectures are responsible for performing the same tasks. This indicates that biological neural networks are, to some degree, architecture agnostic. However, artificial networks rely on their fine-tuned weights and hand-crafted architectures for their remarkable performance. This contrast begs the question: Can we build artificial architecture agnostic neural networks? To ground this study we utilize sparse, binary neural networks that parallel the brain's circuits. Within this sparse, binary paradigm we sample many binary architectures to create families of architecture agnostic neural networks not trained via backpropagation. These high-performing network families share the same sparsity, distribution of binary weights, and succeed in both static and dynamic tasks. In summation, we create an architecture manifold search procedure to discover families or architecture agnostic neural networks. △ Less

Submitted 11 December, 2020; v1 submitted 5 November, 2020; originally announced November 2020.

Competitive Control with Delayed Imperfect Information

Authors: Chenkai Yu, Guanya Shi, Soon-Jo Chung, Yisong Yue, Adam Wierman

Abstract: This paper studies the impact of imperfect information in online control with adversarial disturbances. In particular, we consider both delayed state feedback and inexact predictions of future disturbances. We introduce a greedy, myopic policy that yields a constant competitive ratio against the offline optimal policy. We also analyze the fundamental limits of online control with limited informati… ▽ More This paper studies the impact of imperfect information in online control with adversarial disturbances. In particular, we consider both delayed state feedback and inexact predictions of future disturbances. We introduce a greedy, myopic policy that yields a constant competitive ratio against the offline optimal policy. We also analyze the fundamental limits of online control with limited information by showing that our competitive ratio bounds for the greedy, myopic policy in the adversarial setting match (up to lower-order terms) lower bounds in the stochastic setting. △ Less

Submitted 25 March, 2022; v1 submitted 22 October, 2020; originally announced October 2020.