Showing 151–200 of 404 results for author: Gu, Z

XYLayoutLM: Towards Layout-Aware Multimodal Networks For Visually-Rich Document Understanding

Authors: Zhangxuan Gu, Changhua Meng, Ke Wang, Jun Lan, Weiqiang Wang, Ming Gu, Liqing Zhang

Abstract: Recently, various multimodal networks for Visually-Rich Document Understanding(VRDU) have been proposed, showing the promotion of transformers by integrating visual and layout information with the text embeddings. However, most existing approaches utilize the position embeddings to incorporate the sequence information, neglecting the noisy improper reading order obtained by OCR tools. In this pape… ▽ More Recently, various multimodal networks for Visually-Rich Document Understanding(VRDU) have been proposed, showing the promotion of transformers by integrating visual and layout information with the text embeddings. However, most existing approaches utilize the position embeddings to incorporate the sequence information, neglecting the noisy improper reading order obtained by OCR tools. In this paper, we propose a robust layout-aware multimodal network named XYLayoutLM to capture and leverage rich layout information from proper reading orders produced by our Augmented XY Cut. Moreover, a Dilated Conditional Position Encoding module is proposed to deal with the input sequence of variable lengths, and it additionally extracts local layout information from both textual and visual modalities while generating position embeddings. Experiment results show that our XYLayoutLM achieves competitive results on document understanding tasks. △ Less

Submitted 15 March, 2022; v1 submitted 14 March, 2022; originally announced March 2022.

Comments: Accepted by CVPR2022

STC: Spatio-Temporal Contrastive Learning for Video Instance Segmentation

Authors: Zhengkai Jiang, Zhangxuan Gu, Jinlong Peng, Hang Zhou, Liang Liu, Yabiao Wang, Ying Tai, Chengjie Wang, Liqing Zhang

Abstract: Video Instance Segmentation (VIS) is a task that simultaneously requires classification, segmentation, and instance association in a video. Recent VIS approaches rely on sophisticated pipelines to achieve this goal, including RoI-related operations or 3D convolutions. In contrast, we present a simple and efficient single-stage VIS framework based on the instance segmentation method CondInst by add… ▽ More Video Instance Segmentation (VIS) is a task that simultaneously requires classification, segmentation, and instance association in a video. Recent VIS approaches rely on sophisticated pipelines to achieve this goal, including RoI-related operations or 3D convolutions. In contrast, we present a simple and efficient single-stage VIS framework based on the instance segmentation method CondInst by adding an extra tracking head. To improve instance association accuracy, a novel bi-directional spatio-temporal contrastive learning strategy for tracking embedding across frames is proposed. Moreover, an instance-wise temporal consistency scheme is utilized to produce temporally coherent results. Experiments conducted on the YouTube-VIS-2019, YouTube-VIS-2021, and OVIS-2021 datasets validate the effectiveness and efficiency of the proposed method. We hope the proposed framework can serve as a simple and strong alternative for many other instance-level video association tasks. △ Less

Submitted 20 August, 2022; v1 submitted 8 February, 2022; originally announced February 2022.

Personalized visual encoding model construction with small data

Authors: Zijin Gu, Keith Jamison, Mert Sabuncu, Amy Kuceyeski

Abstract: Encoding models that predict brain response patterns to stimuli are one way to capture this relationship between variability in bottom-up neural systems and individual's behavior or pathological state. However, they generally need a large amount of training data to achieve optimal accuracy. Here, we propose and test an alternative personalized ensemble encoding model approach to utilize existing e… ▽ More Encoding models that predict brain response patterns to stimuli are one way to capture this relationship between variability in bottom-up neural systems and individual's behavior or pathological state. However, they generally need a large amount of training data to achieve optimal accuracy. Here, we propose and test an alternative personalized ensemble encoding model approach to utilize existing encoding models, to create encoding models for novel individuals with relatively little stimuli-response data. We show that these personalized ensemble encoding models trained with small amounts of data for a specific individual, i.e. ~300 image-response pairs, achieve accuracy not different from models trained on ~20,000 image-response pairs for the same individual. Importantly, the personalized ensemble encoding models preserve patterns of inter-individual variability in the image-response relationship. Additionally, we show the proposed approach is robust against domain shift by validating on a prospectively collected set of image-response data in novel individuals with a different scanner and experimental setup. Finally, we use our personalized ensemble encoding model within the recently developed NeuroGen framework to generate optimal stimuli designed to maximize specific regions' activations for a specific individual. We show that the inter-individual differences in face areas responses to images of animal vs human faces observed previously is replicated using NeuroGen with the ensemble encoding model. Our approach shows the potential to use previously collected, deeply sampled data to efficiently create accurate, personalized encoding models and, subsequently, personalized optimal synthetic images for new individuals scanned under different experimental conditions. △ Less

Submitted 14 May, 2022; v1 submitted 4 February, 2022; originally announced February 2022.

Probabilistic spatial clustering based on the Self Discipline Learning (SDL) model of autonomous learning

Authors: Zecang Gu, Xiaoqi Sun, Yuan Sun, Fuquan Zhang

Abstract: Unsupervised clustering algorithm can effectively reduce the dimension of high-dimensional unlabeled data, thus reducing the time and space complexity of data processing. However, the traditional clustering algorithm needs to set the upper bound of the number of categories in advance, and the deep learning clustering algorithm will fall into the problem of local optimum. In order to solve these pr… ▽ More Unsupervised clustering algorithm can effectively reduce the dimension of high-dimensional unlabeled data, thus reducing the time and space complexity of data processing. However, the traditional clustering algorithm needs to set the upper bound of the number of categories in advance, and the deep learning clustering algorithm will fall into the problem of local optimum. In order to solve these problems, a probabilistic spatial clustering algorithm based on the Self Discipline Learning(SDL) model is proposed. The algorithm is based on the Gaussian probability distribution of the probability space distance between vectors, and uses the probability scale and maximum probability value of the probability space distance as the distance measurement judgment, and then determines the category of each sample according to the distribution characteristics of the data set itself. The algorithm is tested in Laboratory for Intelligent and Safe Automobiles(LISA) traffic light data set, the accuracy rate is 99.03%, the recall rate is 91%, and the effect is achieved. △ Less

Submitted 14 January, 2022; v1 submitted 7 January, 2022; originally announced January 2022.

Analysis and Optimization of Cache-Enabled mmWave HetNets with Integrated Access and Backhaul

Authors: Chenwu Zhang, Hancheng Lu, Zhuojia Gu

Abstract: In milimeter wave heterogenous networks with integrated access and backhaul (mABHetNets), a considerable part of spectrum resources are occupied by the backhaul link, which limits the performance of the access link. In order to overcome such backhaul "spectrum occupancy", we introduce cache in mABHetNets. Caching popular files at small base stations (SBSs) can offload the backhaul traffic and tran… ▽ More In milimeter wave heterogenous networks with integrated access and backhaul (mABHetNets), a considerable part of spectrum resources are occupied by the backhaul link, which limits the performance of the access link. In order to overcome such backhaul "spectrum occupancy", we introduce cache in mABHetNets. Caching popular files at small base stations (SBSs) can offload the backhaul traffic and transfer spectrum from the backhaul link to the access link. To achieve the optimal performance of the cache-enabled mABHetNets, we first analyze the signal-to-interference-plus-noise ratio (SINR) distribution and derive the average potential throughput (APT) expression by stochastic geometric tools. Then, based on our analytical work, we formulate a joint optimization problem of cache decision and spectrum partition to maximize the APT. Inspired by the block coordinate descent (BCD) method, we propose a joint cache decision, spectrum partition and power allocation (JCSPA) algorithm to find the optimal solution. Simulation results show the convergence and enhancement of the proposed algorithm. Besides, we verify the APT under different parameters and find that the introduction of cache facilitates the transfer of backhaul spectrum to access link. Jointly deploying appropriate caching capacity at SBSs and performing specified spectrum partition can bring up about 90% APT gain in mABHetNets. △ Less

Submitted 4 January, 2022; originally announced January 2022.

Comments: arXiv admin note: text overlap with arXiv:1911.01162

Exactly solvable lattice models for interacting electronic insulators in two dimensions

Authors: Qing-Rui Wang, Yang Qi, Chen Fang, Meng Cheng, Zheng-Cheng Gu

Abstract: In the past decade, tremendous efforts have been made towards understanding fermionic symmetry protected topological (FSPT) phases in interacting systems. Nevertheless, for systems with continuum symmetry, e.g., electronic insulators, it is still unclear how to construct an exactly solvable model with a finite dimensional Hilbert space in general. In this paper, we give a lattice model constructio… ▽ More In the past decade, tremendous efforts have been made towards understanding fermionic symmetry protected topological (FSPT) phases in interacting systems. Nevertheless, for systems with continuum symmetry, e.g., electronic insulators, it is still unclear how to construct an exactly solvable model with a finite dimensional Hilbert space in general. In this paper, we give a lattice model construction and classification for 2D interacting electronic insulators. Based on the physical picture of $\mathrm{U(1)}_f$-charge decorations, we illustrate the key idea by considering the well known 2D interacting topological insulator. Then we generalize our construction to an arbitrary 2D interacting electronic insulator with symmetry $G_f=\mathrm{U(1)}_f \rtimes_{ρ_1,ω_2} G$, where $\mathrm{U(1)}_f$ is the charge conservation symmetry and $ρ_1, ω_2$ are additional data which fully characterize the group structure of $G_f$. Finally we study more examples, including the full interacting classification of 2D crystalline topological insulators. △ Less

Submitted 31 December, 2021; originally announced December 2021.

Comments: 6+11 pages, 2 figures, 3 tables

Journal ref: Phys. Rev. B 108, L121104 (2023)

Automatic morphological classification of galaxies: convolutional autoencoder and bagging-based multiclustering model

Authors: C. C. Zhou, Y. Z. Gu, G. W. Fang, Z. S. Lin

Abstract: In order to obtain morphological information of unlabeled galaxies, we present an unsupervised machine-learning (UML) method for morphological classification of galaxies, which can be summarized as two aspects: (1) the methodology of convolutional autoencoder (CAE) is used to reduce the dimensions and extract features from the imaging data; (2) the bagging-based multiclustering model is proposed t… ▽ More In order to obtain morphological information of unlabeled galaxies, we present an unsupervised machine-learning (UML) method for morphological classification of galaxies, which can be summarized as two aspects: (1) the methodology of convolutional autoencoder (CAE) is used to reduce the dimensions and extract features from the imaging data; (2) the bagging-based multiclustering model is proposed to obtain the classifications with high confidence at the cost of rejecting the disputed sources that are inconsistently voted. We apply this method on the sample of galaxies with $H<24.5$ in CANDELS. Galaxies are clustered into 100 groups, each contains galaxies with analogous characteristics. To explore the robustness of the morphological classifications, we merge 100 groups into five categories by visual verification, including spheroid, early-type disk, late-type disk, irregular, and unclassifiable. After eliminating the unclassifiable category and the sources with inconsistent voting, the purity of the remaining four subclasses are significantly improved. Massive galaxies ($M_*>10^{10}M_\odot$) are selected to investigate the connection with other physical properties. The classification scheme separates galaxies well in the U-V and V-J color space and Gini-$M_{20}$ space. The gradual tendency of Sérsic indexes and effective radii is shown from the spheroid subclass to the irregular subclass. It suggests that the combination of CAE and multi-clustering strategy is an effective method to cluster galaxies with similar features and can yield high-quality morphological classifications. Our study demonstrates the feasibility of UML in morphological analysis that would develop and serve the future observations made with China Space Station telescope. △ Less

Submitted 29 December, 2021; v1 submitted 27 December, 2021; originally announced December 2021.

Comments: 17 pages, 13 figures, To be published in AJ

Asymptotically Optimal Golay-ZCZ Sequence Sets with Flexible Length

Authors: Zhi Gu, Zhengchun Zhou, Avik Ranjan Adhikary, Yanghe Feng, Pingzhi Fan

Abstract: Zero correlation zone (ZCZ) sequences and Golay complementary sequences are two kinds of sequences with different preferable correlation properties. Golay-ZCZ sequences are special kinds of complementary sequences which also possess a large ZCZ and are good candidates for pilots in OFDM systems. Known Golay-ZCZ sequences reported in the literature have a limitation in the length which is the form… ▽ More Zero correlation zone (ZCZ) sequences and Golay complementary sequences are two kinds of sequences with different preferable correlation properties. Golay-ZCZ sequences are special kinds of complementary sequences which also possess a large ZCZ and are good candidates for pilots in OFDM systems. Known Golay-ZCZ sequences reported in the literature have a limitation in the length which is the form of a power of 2. In this paper, we propose two constructions of Golay-ZCZ sequence sets with new parameters which generalize the constructions of Gong et al. (IEEE Transaction on Communications 61(9), 2013) and Chen et al (IEEE Transaction on Communications 61(9), 2018). Notably, one of the constructions results in optimal binary Golay-ZCZ sequences, while the other results in asymptotically optimal polyphase Golay-ZCZ sequences as the number of sequences increases. △ Less

Submitted 16 December, 2021; originally announced December 2021.

Comments: There are some cross between the paper with arXiv:2108.05657v2

Towards a complete classification of non-chiral topological phases in 2D fermion systems

Authors: Jing-Ren Zhou, Qing-Rui Wang, Zheng-Cheng Gu

Abstract: In recent years, fermionic topological phases of quantum matter has attracted a lot of attention. In a pioneer work by Gu, Wang and Wen, the concept of equivalence classes of fermionic local unitary(FLU) transformations was proposed to systematically understand non-chiral topological phases in 2D fermion systems and an incomplete classification was obtained. On the other hand, the physical picture… ▽ More In recent years, fermionic topological phases of quantum matter has attracted a lot of attention. In a pioneer work by Gu, Wang and Wen, the concept of equivalence classes of fermionic local unitary(FLU) transformations was proposed to systematically understand non-chiral topological phases in 2D fermion systems and an incomplete classification was obtained. On the other hand, the physical picture of fermion condensation and its corresponding super pivotal categories give rise to a generic mathematical framework to describe fermionic topological phases of quantum matter. In particular, it has been pointed out that in certain fermionic topological phases, there exists the so-called q-type anyon excitations, which have no analogues in bosonic theories. In this paper, we generalize the Gu, Wang and Wen construction to include those fermionic topological phases with q-type anyon excitations. We argue that all non-chiral fermionic topological phases in 2+1D are characterized by a set of tensors $(N^{ij}_{k},F^{ij}_{k},F^{ijm,αβ}_{kln,χδ},n_{i},d_{i})$, which satisfy a set of nonlinear algebraic equations parameterized by phase factors $Ξ^{ijm,αβ}_{kl}$, $Ξ^{ij}_{kln,χδ}$, $Ω^{kim,αβ}_{jl}$ and $Ω^{ki}_{jln,χδ}$. Moreover, consistency conditions among algebraic equations give rise to additional constraints on these phase factors which allow us to construct a topological invariant partition for an arbitrary triangulation of 3D spin manifold. Finally, several examples with q-type anyon excitations are discussed, including the Fermionic topological phase from Tambara-Yamagami category for $\mathbb{Z}_{2N}$, which can be regarded as the $\mathbb{Z}_{2N}$ parafermion generalization of Ising fermionic topological phase. △ Less

Submitted 27 December, 2023; v1 submitted 11 December, 2021; originally announced December 2021.

Comments: 51 pages, 3 figures

Journal ref: Phys. Rev. B 106, 245120 (2022)

Public Policymaking for International Agricultural Trade using Association Rules and Ensemble Machine Learning

Authors: Feras A. Batarseh, Munisamy Gopinath, Anderson Monken, Zhengrong Gu

Abstract: International economics has a long history of improving our understanding of factors causing trade, and the consequences of free flow of goods and services across countries. The recent shocks to the free trade regime, especially trade disputes among major economies, as well as black swan events, such as trade wars and pandemics, raise the need for improved predictions to inform policy decisions. A… ▽ More International economics has a long history of improving our understanding of factors causing trade, and the consequences of free flow of goods and services across countries. The recent shocks to the free trade regime, especially trade disputes among major economies, as well as black swan events, such as trade wars and pandemics, raise the need for improved predictions to inform policy decisions. AI methods are allowing economists to solve such prediction problems in new ways. In this manuscript, we present novel methods that predict and associate food and agricultural commodities traded internationally. Association Rules (AR) analysis has been deployed successfully for economic scenarios at the consumer or store level, such as for market basket analysis. In our work however, we present analysis of imports and exports associations and their effects on commodity trade flows. Moreover, Ensemble Machine Learning methods are developed to provide improved agricultural trade predictions, outlier events' implications, and quantitative pointers to policy makers. △ Less

Submitted 14 November, 2021; originally announced November 2021.

Comments: Paper published at Elsevier's Journal of Machine Learning with Applications https://www.sciencedirect.com/science/article/pii/S2666827021000232

Journal ref: Machine Learning with Applications, Volume 5, 2021, 100046, ISSN 2666-8270

One model Packs Thousands of Items with Recurrent Conditional Query Learning

Authors: Dongda Li, Zhaoquan Gu, Yuexuan Wang, Changwei Ren, Francis C. M. Lau

Abstract: Recent studies have revealed that neural combinatorial optimization (NCO) has advantages over conventional algorithms in many combinatorial optimization problems such as routing, but it is less efficient for more complicated optimization tasks such as packing which involves mutually conditioned action spaces. In this paper, we propose a Recurrent Conditional Query Learning (RCQL) method to solve b… ▽ More Recent studies have revealed that neural combinatorial optimization (NCO) has advantages over conventional algorithms in many combinatorial optimization problems such as routing, but it is less efficient for more complicated optimization tasks such as packing which involves mutually conditioned action spaces. In this paper, we propose a Recurrent Conditional Query Learning (RCQL) method to solve both 2D and 3D packing problems. We first embed states by a recurrent encoder, and then adopt attention with conditional queries from previous actions. The conditional query mechanism fills the information gap between learning steps, which shapes the problem as a Markov decision process. Benefiting from the recurrence, a single RCQL model is capable of handling different sizes of packing problems. Experiment results show that RCQL can effectively learn strong heuristics for offline and online strip packing problems (SPPs), outperforming a wide range of baselines in space utilization ratio. RCQL reduces the average bin gap ratio by 1.83% in offline 2D 40-box cases and 7.84% in 3D cases compared with state-of-the-art methods. Meanwhile, our method also achieves 5.64% higher space utilization ratio for SPPs with 1000 items than the state of the art. △ Less

Submitted 12 November, 2021; originally announced November 2021.

Comments: 16 pages, 5 figures, 3 tables. Accepted to Knowledge-Based Systems, 2022

ACM Class: I.2.6; I.2.8

Journal ref: Knowledge-Based Systems, Volume 235, 2022, 107683, ISSN 0950-7051

3D Object Tracking with Transformer

Authors: Yubo Cui, Zheng Fang, Jiayao Shan, Zuoxu Gu, Sifan Zhou

Abstract: Feature fusion and similarity computation are two core problems in 3D object tracking, especially for object tracking using sparse and disordered point clouds. Feature fusion could make similarity computing more efficient by including target object information. However, most existing LiDAR-based approaches directly use the extracted point cloud feature to compute similarity while ignoring the atte… ▽ More Feature fusion and similarity computation are two core problems in 3D object tracking, especially for object tracking using sparse and disordered point clouds. Feature fusion could make similarity computing more efficient by including target object information. However, most existing LiDAR-based approaches directly use the extracted point cloud feature to compute similarity while ignoring the attention changes of object regions during tracking. In this paper, we propose a feature fusion network based on transformer architecture. Benefiting from the self-attention mechanism, the transformer encoder captures the inter- and intra- relations among different regions of the point cloud. By using cross-attention, the transformer decoder fuses features and includes more target cues into the current point cloud feature to compute the region attentions, which makes the similarity computing more efficient. Based on this feature fusion network, we propose an end-to-end point cloud object tracking framework, a simple yet effective method for 3D object tracking using point clouds. Comprehensive experimental results on the KITTI dataset show that our method achieves new state-of-the-art performance. Code is available at: https://github.com/3bobo/lttr. △ Less

Submitted 28 October, 2021; originally announced October 2021.

Comments: BMVC2021

Integrated Task and Motion Planning for Safe Legged Navigation in Partially Observable Environments

Authors: Abdulaziz Shamsah, Zhaoyuan Gu, Jonas Warnke, Seth Hutchinson, Ye Zhao

Abstract: This study proposes a hierarchically integrated framework for safe task and motion planning (TAMP) of bipedal locomotion in a partially observable environment with dynamic obstacles and uneven terrain. The high-level task planner employs linear temporal logic (LTL) for a reactive game synthesis between the robot and its environment and provides a formal guarantee on navigation safety and task comp… ▽ More This study proposes a hierarchically integrated framework for safe task and motion planning (TAMP) of bipedal locomotion in a partially observable environment with dynamic obstacles and uneven terrain. The high-level task planner employs linear temporal logic (LTL) for a reactive game synthesis between the robot and its environment and provides a formal guarantee on navigation safety and task completion. To address environmental partial observability, a belief abstraction is employed at the high-level navigation planner to estimate the dynamic obstacles' location. Accordingly, a synthesized action planner sends a set of locomotion actions to the middle-level motion planner, while incorporating safe locomotion specifications extracted from safety theorems based on a reduced-order model (ROM) of the locomotion process. The motion planner employs the ROM to design safety criteria and a sampling algorithm to generate non-periodic motion plans that accurately track high-level actions. At the low level, a foot placement controller based on an angular-momentum linear inverted pendulum model is implemented and integrated with an ankle-actuated passivity-based controller for full-body trajectory tracking. To address external perturbations, this study also investigates safe sequential composition of the keyframe locomotion state and achieves robust transitions against external perturbations through reachability analysis. The overall TAMP framework is validated with extensive simulations and hardware experiments on bipedal walking robots Cassie and Digit designed by Agility Robotics. △ Less

Submitted 7 March, 2023; v1 submitted 22 October, 2021; originally announced October 2021.

Comments: 22 pages, 18 figures

The emergence of gapless quantum spin liquid from deconfined quantum critical point

Authors: Wen-Yuan Liu, Juraj Hasik, Shou-Shu Gong, Didier Poilblanc, Wei-Qiang Chen, Zheng-Cheng Gu

Abstract: A quantum spin liquid (QSL) is a novel phase of matter with long-range entanglement where localized spins are highly correlated with the vanishing of magnetic order. Such exotic quantum states provide the opportunities to develop new theoretical frameworks for many-body physics and have the potential application in realizing robust quantum computations. Here we show that a gapless QSL can naturall… ▽ More A quantum spin liquid (QSL) is a novel phase of matter with long-range entanglement where localized spins are highly correlated with the vanishing of magnetic order. Such exotic quantum states provide the opportunities to develop new theoretical frameworks for many-body physics and have the potential application in realizing robust quantum computations. Here we show that a gapless QSL can naturally emerge from a deconfined quantum critical point (DQCP), which is originally proposed to describe Landau forbidden continuous phase transition between antiferromagnetic (AFM) and valence-bond solid (VBS) phases. Via large-scale tensor network simulations of a square-lattice spin-1/2 frustrated Heisenberg model, both QSL state and DQCP-type AFM-VBS transition are observed. With tuning coupling constants, the AFM-VBS transition vanishes and instead, a gapless QSL phase gradually develops in between. Remarkably, along the phase boundaries of AFM-QSL and QSL-VBS transitions, we always observe the same correlation length exponents $ν\approx 1.0$, which is intrinsically different from the one of the DQCP-type transition, indicating new types of universality classes. Our results explicitly demonstrate a new scenario for understanding the emergence of gapless QSL from an underlying DQCP. The discovered QSL phase survives in a large region of tuning parameters and we expect its experimental realizations in solid state materials or quantum simulators. △ Less

Submitted 8 December, 2021; v1 submitted 21 October, 2021; originally announced October 2021.

Journal ref: PhysRevX.12.031039 (2022)

MOS: A Low Latency and Lightweight Framework for Face Detection, Landmark Localization, and Head Pose Estimation

Authors: Yepeng Liu, Zaiwang Gu, Shenghua Gao, Dong Wang, Yusheng Zeng, Jun Cheng

Abstract: With the emergence of service robots and surveillance cameras, dynamic face recognition (DFR) in wild has received much attention in recent years. Face detection and head pose estimation are two important steps for DFR. Very often, the pose is estimated after the face detection. However, such sequential computations lead to higher latency. In this paper, we propose a low latency and lightweight ne… ▽ More With the emergence of service robots and surveillance cameras, dynamic face recognition (DFR) in wild has received much attention in recent years. Face detection and head pose estimation are two important steps for DFR. Very often, the pose is estimated after the face detection. However, such sequential computations lead to higher latency. In this paper, we propose a low latency and lightweight network for simultaneous face detection, landmark localization and head pose estimation. Inspired by the observation that it is more challenging to locate the facial landmarks for faces with large angles, a pose loss is proposed to constrain the learning. Moreover, we also propose an uncertainty multi-task loss to learn the weights of individual tasks automatically. Another challenge is that robots often use low computational units like ARM based computing core and we often need to use lightweight networks instead of the heavy ones, which lead to performance drop especially for small and hard faces. In this paper, we propose online feedback sampling to augment the training samples across different scales, which increases the diversity of training data automatically. Through validation in commonly used WIDER FACE, AFLW and AFLW2000 datasets, the results show that the proposed method achieves the state-of-the-art performance in low computational resources. The code and data will be available at https://github.com/lyp-deeplearning/MOS-Multi-Task-Face-Detect. △ Less

Submitted 1 November, 2021; v1 submitted 21 October, 2021; originally announced October 2021.

Comments: Accepted at BMVC 2021

Energon: Towards Efficient Acceleration of Transformers Using Dynamic Sparse Attention

Authors: Zhe Zhou, Junlin Liu, Zhenyu Gu, Guangyu Sun

Abstract: In recent years, transformer models have revolutionized Natural Language Processing (NLP) and shown promising performance on Computer Vision (CV) tasks. Despite their effectiveness, transformers' attention operations are hard to accelerate due to the complicated data movement and quadratic computational complexity, prohibiting the real-time inference on resource-constrained edge-computing platform… ▽ More In recent years, transformer models have revolutionized Natural Language Processing (NLP) and shown promising performance on Computer Vision (CV) tasks. Despite their effectiveness, transformers' attention operations are hard to accelerate due to the complicated data movement and quadratic computational complexity, prohibiting the real-time inference on resource-constrained edge-computing platforms. To tackle this challenge, we propose Energon, an algorithm-architecture co-design approach that accelerates various transformers using dynamic sparse attention. With the observation that attention results only depend on a few important query-key pairs, we propose a Mix-Precision Multi-Round Filtering (MP-MRF) algorithm to dynamically identify such pairs at runtime. We adopt low bitwidth in each filtering round and only use high-precision tensors in the attention stage to reduce overall complexity. By this means, we significantly mitigate the computational cost with negligible accuracy loss. To enable such an algorithm with lower latency and better energy efficiency, we also propose an Energon co-processor architecture. Elaborated pipelines and specialized optimizations jointly boost the performance and reduce power consumption. Extensive experiments on both NLP and CV benchmarks demonstrate that Energon achieves $168\times$ and $8.7\times$ geo-mean speedup and up to $10^4\times$ and $10^3\times$ energy reduction compared with Intel Xeon 5220 CPU and NVIDIA V100 GPU. Compared to state-of-the-art attention accelerators SpAtten and $A^3$, Energon also achieves $1.7\times, 1.25\times$ speedup and $1.6 \times, 1.5\times $ higher energy efficiency. △ Less

Submitted 25 April, 2022; v1 submitted 18 October, 2021; originally announced October 2021.

Reactive Locomotion Decision-Making and Robust Motion Planning for Real-Time Perturbation Recovery

Authors: Zhaoyuan Gu, Nathan Boyd, Ye Zhao

Abstract: In this paper, we examine the problem of push recovery for bipedal robot locomotion and present a reactive decision-making and robust planning framework for locomotion resilient to external perturbations. Rejecting perturbations is an essential capability of bipedal robots and has been widely studied in the locomotion literature. However, adversarial disturbances and aggressive turning can lead to… ▽ More In this paper, we examine the problem of push recovery for bipedal robot locomotion and present a reactive decision-making and robust planning framework for locomotion resilient to external perturbations. Rejecting perturbations is an essential capability of bipedal robots and has been widely studied in the locomotion literature. However, adversarial disturbances and aggressive turning can lead to negative lateral step width (i.e., crossed-leg scenarios) with unstable motions and self-collision risks. These motion planning problems are computationally difficult and have not been explored under a hierarchically integrated task and motion planning method. We explore a planning and decision-making framework that closely ties linear-temporal-logic-based reactive synthesis with trajectory optimization incorporating the robot's full-body dynamics, kinematics, and leg collision avoidance constraints. Between the high-level discrete symbolic decision-making and the low-level continuous motion planning, behavior trees serve as a reactive interface to handle perturbations occurring at any time of the locomotion process. Our experimental results show the efficacy of our method in generating resilient recovery behaviors in response to diverse perturbations from any direction with bounded magnitudes. △ Less

Submitted 2 March, 2022; v1 submitted 6 October, 2021; originally announced October 2021.

The Helmholtz decomposition of a space of vector fields with bounded mean oscillation in a bounded domain

Authors: Yoshikazu Giga, Zhongyang Gu

Abstract: We introduce a space of vector fields with bounded mean oscillation whose ``tangential'' and ``normal'' components to the boundary behave differently. We establish its Helmholtz decomposition when the domain is bounded. This substantially extends the authors' earlier result for a half space. We introduce a space of vector fields with bounded mean oscillation whose ``tangential'' and ``normal'' components to the boundary behave differently. We establish its Helmholtz decomposition when the domain is bounded. This substantially extends the authors' earlier result for a half space. △ Less

Submitted 2 October, 2021; originally announced October 2021.

Comments: 42 pages

MSC Class: 30H35

Enforced symmetry breaking by invertible topological order

Authors: Shang-Qiang Ning, Yang Qi, Zheng-Cheng Gu, Chenjie Wang

Abstract: It is well known that two-dimensional fermionic systems with a nonzero Chern number must break the time reversal symmetry, manifested by the appearance of chiral edge modes on an open boundary. Such an incompatibility between topology and symmetry can occur more generally. We will refer to this phenomenon as enforced symmetry breaking by topological orders. In this work, we systematically study en… ▽ More It is well known that two-dimensional fermionic systems with a nonzero Chern number must break the time reversal symmetry, manifested by the appearance of chiral edge modes on an open boundary. Such an incompatibility between topology and symmetry can occur more generally. We will refer to this phenomenon as enforced symmetry breaking by topological orders. In this work, we systematically study enforced breaking of a general finite group $G_f$ by a class of topological orders, namely 0D, 1D and 2D fermionic invertible topological orders. Mathematically, the symmetry group $G_f$ is a central extension of a bosonic group $G$ by the fermion parity group $Z_2^f$, characterized by a 2-cocycle $λ$ $\in H^2(G,Z_2)$. With some minor assumptions and for given $G$ and $λ$, we are able to obtain a series of criteria on the existence or non-existence of enforced symmetry breaking by the fermionic invertible topological orders. Using these criteria, we discover many examples that are not known previously. For 2D systems, we define the physical quantities to describe symmetry-enriched invertible topological orders and derive some obstruction functions using both fermionic and bosonic languages. In the latter case which is done via gauging the fermion parity, we find that some obstruction functions are consequences of conditional anomalies of the bosonic symmetry-enriched topological states, with the conditions inherited from the original fermionic system. We also study enforced breaking of the continuous group $SU_f(N)$ by 2D invertible topological orders through a different argument. △ Less

Submitted 23 February, 2022; v1 submitted 30 September, 2021; originally announced September 2021.

Comments: 29 pages, 4 figures, 6 tables, comment and suggestion are welcome

Journal ref: Phys. Rev. Research 5, 023153 (2023)

TREATED:Towards Universal Defense against Textual Adversarial Attacks

Authors: Bin Zhu, Zhaoquan Gu, Le Wang, Zhihong Tian

Abstract: Recent work shows that deep neural networks are vulnerable to adversarial examples. Much work studies adversarial example generation, while very little work focuses on more critical adversarial defense. Existing adversarial detection methods usually make assumptions about the adversarial example and attack method (e.g., the word frequency of the adversarial example, the perturbation level of the a… ▽ More Recent work shows that deep neural networks are vulnerable to adversarial examples. Much work studies adversarial example generation, while very little work focuses on more critical adversarial defense. Existing adversarial detection methods usually make assumptions about the adversarial example and attack method (e.g., the word frequency of the adversarial example, the perturbation level of the attack method). However, this limits the applicability of the detection method. To this end, we propose TREATED, a universal adversarial detection method that can defend against attacks of various perturbation levels without making any assumptions. TREATED identifies adversarial examples through a set of well-designed reference models. Extensive experiments on three competitive neural networks and two widely used datasets show that our method achieves better detection performance than baselines. We finally conduct ablation studies to verify the effectiveness of our method. △ Less

Submitted 12 September, 2021; originally announced September 2021.

Horizontal and Vertical Collaboration for VR Delivery in MEC-Enabled Small-Cell Networks

Authors: Zhuojia Gu, Hancheng Lu, Chenkai Zou

Abstract: Due to the large bandwidth, low latency and computationally intensive features of virtual reality (VR) video applications, the current resource-constrained wireless and edge networks cannot meet the requirements of on-demand VR delivery. In this letter, we propose a joint horizontal and vertical collaboration architecture in mobile edge computing (MEC)-enabled small-cell networks for VR delivery.… ▽ More Due to the large bandwidth, low latency and computationally intensive features of virtual reality (VR) video applications, the current resource-constrained wireless and edge networks cannot meet the requirements of on-demand VR delivery. In this letter, we propose a joint horizontal and vertical collaboration architecture in mobile edge computing (MEC)-enabled small-cell networks for VR delivery. In the proposed architecture, multiple MEC servers can jointly provide VR head-mounted devices (HMDs) with edge caching and viewpoint computation services, while the computation tasks can also be performed at HMDs or on the cloud. Power allocation at base stations (BSs) is considered in coordination with horizontal collaboration (HC) and vertical collaboration (VC) of MEC servers to obtain lower end-to-end latency of VR delivery. A joint caching, power allocation and task offloading problem is then formulated, and a discrete branch-reduce-and-bound (DBRB) algorithm inspired by monotone optimization is proposed to effectively solve the problem. Simulation results demonstrate the advantage of the proposed architecture and algorithm in terms of existing ones. △ Less

Submitted 4 September, 2021; originally announced September 2021.

Comments: 5 pages, 5 figures

Spatiotemporal Inconsistency Learning for DeepFake Video Detection

Authors: Zhihao Gu, Yang Chen, Taiping Yao, Shouhong Ding, Jilin Li, Feiyue Huang, Lizhuang Ma

Abstract: The rapid development of facial manipulation techniques has aroused public concerns in recent years. Following the success of deep learning, existing methods always formulate DeepFake video detection as a binary classification problem and develop frame-based and video-based solutions. However, little attention has been paid to capturing the spatial-temporal inconsistency in forged videos. To addre… ▽ More The rapid development of facial manipulation techniques has aroused public concerns in recent years. Following the success of deep learning, existing methods always formulate DeepFake video detection as a binary classification problem and develop frame-based and video-based solutions. However, little attention has been paid to capturing the spatial-temporal inconsistency in forged videos. To address this issue, we term this task as a Spatial-Temporal Inconsistency Learning (STIL) process and instantiate it into a novel STIL block, which consists of a Spatial Inconsistency Module (SIM), a Temporal Inconsistency Module (TIM), and an Information Supplement Module (ISM). Specifically, we present a novel temporal modeling paradigm in TIM by exploiting the temporal difference over adjacent frames along with both horizontal and vertical directions. And the ISM simultaneously utilizes the spatial information from SIM and temporal information from TIM to establish a more comprehensive spatial-temporal representation. Moreover, our STIL block is flexible and could be plugged into existing 2D CNNs. Extensive experiments and visualizations are presented to demonstrate the effectiveness of our method against the state-of-the-art competitors. △ Less

Submitted 11 October, 2021; v1 submitted 4 September, 2021; originally announced September 2021.

Comments: To appear in ACM MM 2021

CODEs: Chamfer Out-of-Distribution Examples against Overconfidence Issue

Authors: Keke Tang, Dingruibo Miao, Weilong Peng, Jianpeng Wu, Yawen Shi, Zhaoquan Gu, Zhihong Tian, Wenping Wang

Abstract: Overconfident predictions on out-of-distribution (OOD) samples is a thorny issue for deep neural networks. The key to resolve the OOD overconfidence issue inherently is to build a subset of OOD samples and then suppress predictions on them. This paper proposes the Chamfer OOD examples (CODEs), whose distribution is close to that of in-distribution samples, and thus could be utilized to alleviate t… ▽ More Overconfident predictions on out-of-distribution (OOD) samples is a thorny issue for deep neural networks. The key to resolve the OOD overconfidence issue inherently is to build a subset of OOD samples and then suppress predictions on them. This paper proposes the Chamfer OOD examples (CODEs), whose distribution is close to that of in-distribution samples, and thus could be utilized to alleviate the OOD overconfidence issue effectively by suppressing predictions on them. To obtain CODEs, we first generate seed OOD examples via slicing&splicing operations on in-distribution samples from different categories, and then feed them to the Chamfer generative adversarial network for distribution transformation, without accessing to any extra data. Training with suppressing predictions on CODEs is validated to alleviate the OOD overconfidence issue largely without hurting classification accuracy, and outperform the state-of-the-art methods. Besides, we demonstrate CODEs are useful for improving OOD detection and classification. △ Less

Submitted 12 August, 2021; originally announced August 2021.

Comments: ICCV 2021

New Constructions of Golay Complementary Pair/Array with Large Zero Correlation Zone

Authors: Zhi Gu, Zhengchun Zhou, Avik Ranjan Adhikary, Yanghe Feng, Pingzhi Fan

Abstract: Zero correlation zone (ZCZ) sequences and Golay sequences are two kinds of sequences with different preferable correlation properties. It was shown by Gong \textit{et al.} and Chen \textit{et al.} that some Golay sequences also possess a large ZCZ and are good candidates for pilots in OFDM systems. Known Golay sequences with ZCZ reported in the literature have a limitation in the length which is t… ▽ More Zero correlation zone (ZCZ) sequences and Golay sequences are two kinds of sequences with different preferable correlation properties. It was shown by Gong \textit{et al.} and Chen \textit{et al.} that some Golay sequences also possess a large ZCZ and are good candidates for pilots in OFDM systems. Known Golay sequences with ZCZ reported in the literature have a limitation in the length which is the form of a power of 2. One objective of this paper is to propose a construction of Golay complementary pairs (GCPs) with new lengths whose periodic autocorrelation of each of the Golay sequences and periodic corss-correlation of the pair displays a zero correlation zone (ZCZ) around the in-phase position. Specifically, the proposed GCPs have length $4N$ (where, $N$ is the length of a GCP) and ZCZ width $N+1$. Another objective of this paper is to extend the construction to two-dimensional Golay complementary array pairs (GCAPs). Interestingly the periodic corss-correlation of the proposed GACPs also have large ZCZs around the in-phase position. △ Less

Submitted 13 August, 2021; v1 submitted 12 August, 2021; originally announced August 2021.

Joint Power and User Grouping Optimization in Cell-Free Massive MIMO Systems

Authors: Fengqian Guo, Hancheng Lu, Zhuojia Gu

Abstract: To relieve the stress on channel estimation and decoding complexity in cell-free massive multiple-input multiple-output (MIMO) systems, user grouping problem is investigated in this paper, where access points (APs) based on time-division duplex (TDD) are considered to serve users on different time resources and the same frequency resource. In addition, when quality of service (QoS) requirements ar… ▽ More To relieve the stress on channel estimation and decoding complexity in cell-free massive multiple-input multiple-output (MIMO) systems, user grouping problem is investigated in this paper, where access points (APs) based on time-division duplex (TDD) are considered to serve users on different time resources and the same frequency resource. In addition, when quality of service (QoS) requirements are considered, widely-used max-min power control is no longer applicable. We derive the minimum power constraints under diverse QoS requirements considering user grouping. Based on the analysis, we formulate the joint power and user grouping problem under QoS constraints, aiming at minimizing the total transmit power. A generalized benders decomposition (GBD) based algorithm is proposed, where the primal problem and master problem are solved iteratively to approach the optimal solution. Simulation results demonstrate that by user grouping, the number of users served in cell-free MIMO systems can be as much as the number of APs without increasing the complexity of channel estimation and decoding. Furthermore, with the proposed user grouping strategy, the power consumption can be reduced by 2-3 dB compared with the reference user grouping strategy{, and by 7 dB compared with the total transmit power without grouping. △ Less

Submitted 27 July, 2021; originally announced July 2021.

Comments: 15 pages, 9 figures, 41 conference

Quantitative Determination of the Confinement and Deconfinement of spinons in the anomalous spectra of Antiferromagnets via the Entanglement Entropy

Authors: Zhao-Yang Dong, Wei Wang, Zhao-Long Gu, Jian-Xin Li

Abstract: We introduce an entanglement entropy analysis to quantitatively identify the confinement and deconfinement of the spinons in the spin excitations of quantum magnets. Our proposal is implemented by the parton construction of a honeycomb-lattice antiferromagnet exhibiting high-energy anomalous spectra. To obtain the quasiparticles of spin excitations for entanglement entropy calculations, we develop… ▽ More We introduce an entanglement entropy analysis to quantitatively identify the confinement and deconfinement of the spinons in the spin excitations of quantum magnets. Our proposal is implemented by the parton construction of a honeycomb-lattice antiferromagnet exhibiting high-energy anomalous spectra. To obtain the quasiparticles of spin excitations for entanglement entropy calculations, we develop an effective Hamiltonian using the random phase approximation. We elaborate quantitatively the deconfinement-to-confinement transition of spinons in the anomalous spectra with the increase of the Hubbard interaction, indicating the avoided fractionalization of magnons in the strong interaction regime. Meanwhile, the Higgs mode at the Γ0 point is fractionalized into four degenerate spinon pairs, although it appears as a sharp well-defined peak in the spectra. Our work extends our understanding of the deconfinement of the spinon and its coexistence with the magnon in quantum magnets. △ Less

Submitted 19 July, 2021; originally announced July 2021.

Comments: 6 pages, 4 figures

Solving system of Urysohn type integral equation via bicomplex partial b-metric space

Authors: Gunaseelan Mani, Arul Joseph Gnanaprakasam, Yongjin Li, Zhaohui Gu

Abstract: In this paper, we introduce the notion of bicomplex partial b-metric space and prove some common fixed point theorems. Our results generalize and expand some of the literature's well known results. We also explore some of the applications of our key results to Urysohn type integral equations. In this paper, we introduce the notion of bicomplex partial b-metric space and prove some common fixed point theorems. Our results generalize and expand some of the literature's well known results. We also explore some of the applications of our key results to Urysohn type integral equations. △ Less

Submitted 9 July, 2021; originally announced July 2021.

Topological magnon insulator spin excitations in the two-dimensional ferromagnet CrBr$_3$

Authors: Zhengwei Cai, Song Bao, Zhao-Long Gu, Yi-Peng Gao, Zhen Ma, Yanyan Shangguan, Wenda Si, Zhao-Yang Dong, Wei Wang, Yizhang Wu, Dongjing Lin, Jinghui Wang, Kejing Ran, Shichao Li, Devashibhai Adroja, Xiaoxiang Xi, Shun-Li Yu, Xiaoshan Wu, Jian-Xin Li, Jinsheng Wen

Abstract: Topological magnons are bosonic analogues of topological fermions in electronic systems. They have been studied extensively by theory but rarely realized by experiment. Here, by performing inelastic neutron scattering measurements on single crystals of a two-dimensional ferromagnet CrBr$_3$, which was classified as Dirac magnon semimetal featured by the linear bands crossing at the Dirac points, w… ▽ More Topological magnons are bosonic analogues of topological fermions in electronic systems. They have been studied extensively by theory but rarely realized by experiment. Here, by performing inelastic neutron scattering measurements on single crystals of a two-dimensional ferromagnet CrBr$_3$, which was classified as Dirac magnon semimetal featured by the linear bands crossing at the Dirac points, we fully map out the magnetic excitation spectra, and reveal that there is an apparent gap of $\sim$3.5~meV between the acoustic and optical branches of the magnons at the K point. By collaborative efforts between experiment and theoretical calculations using a five-orbital Hubbard model obtained from first-principles calculations to derive the exchange parameters, we find that a Hamiltonian with Heisenberg exchange interactions, next-nearest-neighbor Dzyaloshinskii-Moriya (DM) interaction, and single-ion anisotropy is more appropriate to describe the system. Calculations using the model show that the lower and upper magnon bands separated by the gap exhibit Chern numbers of $\pm1$. These results indicate that CrBr$_3$ is a topological magnon insulator, where the nontrivial gap is a result of the DM interaction. △ Less

Submitted 6 July, 2021; originally announced July 2021.

Comments: Version as published in PRB Letter, main text 7 pages, supplementary materials 6 pages

Journal ref: Phys. Rev. B 104, L020402 (2021)

Epitaxial growth of Ruddlesden-Popper neodymium nickelates Nd$_{n+1}$Ni$_{n}$O$_{3n+1}$ (${n}$ = 1-5)

Authors: Wenjie Sun, Yueying Li, Xiangbin Cai, Jiangfeng Yang, Wei Guo, Zhengbin Gu, Ye Zhu, Yuefeng Nie

Abstract: A series of Ruddlesden-Popper nickelates, Nd$_{n+1}$Ni$_{n}$O$_{3n+1}$ (${n}$ = 1-5), have been stabilized in thin film form using reactive molecular-beam epitaxy. High crystalline quality has been verified by X-ray diffraction and scanning transmission electron microscopy. X-ray photoelectron spectroscopy indicates the ${n}$-dependent valence states of nickel in these compounds. Metal-insulator t… ▽ More A series of Ruddlesden-Popper nickelates, Nd$_{n+1}$Ni$_{n}$O$_{3n+1}$ (${n}$ = 1-5), have been stabilized in thin film form using reactive molecular-beam epitaxy. High crystalline quality has been verified by X-ray diffraction and scanning transmission electron microscopy. X-ray photoelectron spectroscopy indicates the ${n}$-dependent valence states of nickel in these compounds. Metal-insulator transitions show clear ${n}$ dependence for intermediate members (${n}$ = 3-5), and the low-temperature resistivities of which show logarithmic dependence, resembling the Kondo-scattering as observed in the parent compounds of superconducting infinite-layer nickelates. △ Less

Submitted 24 June, 2021; originally announced June 2021.

Comments: 12 pages, 4 figures

Journal ref: PRB 104, 184518 (2021)

Topological gravity in 3+1D and a possible origin of dark matte

Authors: Tianyao Fang, Zheng-Cheng Gu

Abstract: Dark matter is one of the deepest mystery of the universe. So far there is no natural explanation why the dark matter should exist and even dominate the universe. In this paper, we begin with a 3+1D topological gravity theory which is super renormalizable with vanishing beta functions, then we argue that Einstein gravity can emerge by condensing loop-like excitation from the underlying topological… ▽ More Dark matter is one of the deepest mystery of the universe. So far there is no natural explanation why the dark matter should exist and even dominate the universe. In this paper, we begin with a 3+1D topological gravity theory which is super renormalizable with vanishing beta functions, then we argue that Einstein gravity can emerge by condensing loop-like excitation from the underlying topological gravity theory. In the meanwhile, the uncondensed loop-like excitations serves as a natural candidate of dark matter and a generalized Einstein equation can be derived in the presence of loop-source(dark matter) background. Surprisingly, we find that such kind of dark matter will not contribute to scalar curvature, however, it will become a source of torsion. Finally, we derive the generalized Einstein equation in the presence of Dirac field. Very different from the usual Einstein-Carton theory, our theory further predicts that any type of normal matter, including Dirac field will not produce torsion. All these unique predictions can be tested by future experiments. Our framework suggests that topological invariant principle might play a more profound role than the well-known general covariance principle, especially towards understanding the nature of dark matter and quantum gravity in 3+1D. △ Less

Submitted 18 June, 2021; originally announced June 2021.

Comments: 24 pages, comments and suggestions are welcome

Armstrong Liquid Bridge: Formation, Evolution and Breakup

Authors: Xueqin Pan, Man Hu, Bingrui Xu, Feng Wang, Peng Huo, Fangqi Chen, Zhibo Gu, Daosheng Deng

Abstract: In this paper, we experimentally explore the formation, evolution and breakup of Armstrong liquid bridge. The extremely complicated evolution stage is revealed, which involves many coupled processes including the morphology change, current variation, heat transfer, and water evaporation. By focusing on the final fate of this liquid bridge, we observe that the breakup occurs once an effective lengt… ▽ More In this paper, we experimentally explore the formation, evolution and breakup of Armstrong liquid bridge. The extremely complicated evolution stage is revealed, which involves many coupled processes including the morphology change, current variation, heat transfer, and water evaporation. By focusing on the final fate of this liquid bridge, we observe that the breakup occurs once an effective length ($\tilde{L}$) is reached. This effective length increases linearly with the applied voltage, implying a threshold electric field to sustain the liquid bridge. Moreover, by an introduced external flow, the lifetime of the liquid bridge can be controlled, while the effective length associated with the breakup is independent on the external flow rate. Hence, these findings remarkably demonstrate that the breakup of liquid bridge is directly correlated with the effective length. In order to understand this correlation, a simplified model of an electrified jet is employed to take the electric field into account. By the linear stability analysis, the attained phase diagram agrees with the experiments well. Although a more comprehensive theory is required to consider other factors such as the surface charges, these results might provide a fresh perspective on the ``century-old" Armstrong liquid bridge to further elucidate its underlying physical mechanism. △ Less

Submitted 18 June, 2021; originally announced June 2021.

Journal ref: Phys. Rev. Fluids 6, 093901 (2021)

Impact of Cation Stoichiometry on the Crystalline Structure and Superconductivity in Nickelates

Authors: Yueying Li, Wenjie Sun, Jiangfeng Yang, Xiangbin Cai, Wei Guo, Zhengbin Gu, Ye Zhu, Yuefeng Nie

Abstract: The recent discovery of superconductivity in infinite-layer nickelate films has aroused great interest since it provides a new platform to explore the mechanism of high-temperature superconductivity. However, superconductivity only appears in the thin film form and synthesizing superconducting nickelate films is extremely challenging, limiting the in-depth studies on this compound. Here, we explor… ▽ More The recent discovery of superconductivity in infinite-layer nickelate films has aroused great interest since it provides a new platform to explore the mechanism of high-temperature superconductivity. However, superconductivity only appears in the thin film form and synthesizing superconducting nickelate films is extremely challenging, limiting the in-depth studies on this compound. Here, we explore the critical parameters in the growth of high quality nickelate films using molecular beam epitaxy (MBE). We found that stoichiometry is crucial in optimizing the crystalline structure and realizing superconductivity in nickelate films. In precursor NdNiO3 films, optimal stoichiometry of cations yields the most compact lattice while off-stoichiometry of cations causes obvious lattice expansion, influencing the subsequent topotactic reduction and the emergence of superconductivity in infinite-layer nickelates. Surprisingly, in-situ reflection high energy electron diffraction (RHEED) indicates that some impurity phases always appear once Sr ions are doped into NdNiO3 although the X-ray diffraction (XRD) data are of high quality. While these impurity phases do not seem to suppress the superconductivity, their impacts on the electronic and magnetic structure deserve further studies. Our work demonstrates and highlights the significance of cation stoichiometry in superconducting nickelate family. △ Less

Submitted 4 June, 2021; originally announced June 2021.

Comments: 12 pages, 3 figures

Journal ref: Front. Phys. 9:719534 (2021)

Separation of Powers in Federated Learning

Authors: Pau-Chen Cheng, Kevin Eykholt, Zhongshu Gu, Hani Jamjoom, K. R. Jayaram, Enriquillo Valdez, Ashish Verma

Abstract: Federated Learning (FL) enables collaborative training among mutually distrusting parties. Model updates, rather than training data, are concentrated and fused in a central aggregation server. A key security challenge in FL is that an untrustworthy or compromised aggregation process might lead to unforeseeable information leakage. This challenge is especially acute due to recently demonstrated att… ▽ More Federated Learning (FL) enables collaborative training among mutually distrusting parties. Model updates, rather than training data, are concentrated and fused in a central aggregation server. A key security challenge in FL is that an untrustworthy or compromised aggregation process might lead to unforeseeable information leakage. This challenge is especially acute due to recently demonstrated attacks that have reconstructed large fractions of training data from ostensibly "sanitized" model updates. In this paper, we introduce TRUDA, a new cross-silo FL system, employing a trustworthy and decentralized aggregation architecture to break down information concentration with regard to a single aggregator. Based on the unique computational properties of model-fusion algorithms, all exchanged model updates in TRUDA are disassembled at the parameter-granularity and re-stitched to random partitions designated for multiple TEE-protected aggregators. Thus, each aggregator only has a fragmentary and shuffled view of model updates and is oblivious to the model architecture. Our new security mechanisms can fundamentally mitigate training reconstruction attacks, while still preserving the final accuracy of trained models and keeping performance overheads low. △ Less

Submitted 19 May, 2021; originally announced May 2021.

NeuroGen: activation optimized image synthesis for discovery neuroscience

Authors: Zijin Gu, Keith W. Jamison, Meenakshi Khosla, Emily J. Allen, Yihan Wu, Thomas Naselaris, Kendrick Kay, Mert R. Sabuncu, Amy Kuceyeski

Abstract: Functional MRI (fMRI) is a powerful technique that has allowed us to characterize visual cortex responses to stimuli, yet such experiments are by nature constructed based on a priori hypotheses, limited to the set of images presented to the individual while they are in the scanner, are subject to noise in the observed brain responses, and may vary widely across individuals. In this work, we propos… ▽ More Functional MRI (fMRI) is a powerful technique that has allowed us to characterize visual cortex responses to stimuli, yet such experiments are by nature constructed based on a priori hypotheses, limited to the set of images presented to the individual while they are in the scanner, are subject to noise in the observed brain responses, and may vary widely across individuals. In this work, we propose a novel computational strategy, which we call NeuroGen, to overcome these limitations and develop a powerful tool for human vision neuroscience discovery. NeuroGen combines an fMRI-trained neural encoding model of human vision with a deep generative network to synthesize images predicted to achieve a target pattern of macro-scale brain activation. We demonstrate that the reduction of noise that the encoding model provides, coupled with the generative network's ability to produce images of high fidelity, results in a robust discovery architecture for visual neuroscience. By using only a small number of synthetic images created by NeuroGen, we demonstrate that we can detect and amplify differences in regional and individual human brain response patterns to visual stimuli. We then verify that these discoveries are reflected in the several thousand observed image responses measured with fMRI. We further demonstrate that NeuroGen can create synthetic images predicted to achieve regional response patterns not achievable by the best-matching natural images. The NeuroGen framework extends the utility of brain encoding models and opens up a new avenue for exploring, and possibly precisely controlling, the human visual system. △ Less

Submitted 15 May, 2021; originally announced May 2021.

A macro-micro approach to modeling parking

Authors: Ziyuan Gu, Farshid Safarighouzhdib, Meead Saberi, Taha H. Rashidi

Abstract: In this paper, we propose a new macro-micro approach to modeling parking. We first develop a microscopic parking simulation model considering both on- and off-street parking with limited capacity. In the microscopic model, a parking search algorithm is proposed to mimic cruising-for-parking based on the principle of proximity, and a parking-related state tracking algorithm is proposed to acquire a… ▽ More In this paper, we propose a new macro-micro approach to modeling parking. We first develop a microscopic parking simulation model considering both on- and off-street parking with limited capacity. In the microscopic model, a parking search algorithm is proposed to mimic cruising-for-parking based on the principle of proximity, and a parking-related state tracking algorithm is proposed to acquire an event-based simulated data set. Some key aspects of parking modeling are discussed based on the sim-ulated evidence and theoretical analysis. Results suggest (i) although the low cruising speed reduces the network performance, it does not significantly alter the macroscopic or network fundamental diagram (MFD or NFD) unless the cruising vehicles dominate the traffic stream; (ii) distance to park is not uniquely determined by parking occupancy because factors such as cruising speed and parking dura-tion also contribute; and (iii) multiscale parking occupancy-driven intelligent parking guidance can re-duce distance to park yielding considerable network efficiency gains. Using the microscopic model, we then extend, calibrate, and validate a macroscopic parking dynamics model with an NFD representation. The demonstrated consistency between the macro- and micro-models permits integration of the two for online parking pricing optimization via model predictive control. Numerical experiments highlight the effectiveness of the proposed approach as well as one caveat. That is, when pricing on-street parking, the road network connected to the alternate off-street parking lots must have sufficient capacity to ac-commodate the increased parking demand; otherwise, local congestion may arise that violates the ho-mogeneity assumption underlying the macroscopic model. △ Less

Submitted 27 April, 2021; originally announced April 2021.

Comments: 33 pages and 15 figures

Journal ref: Transportation Research Part B: Methodological, Volume 147, May 2021, Pages 220-244

Advancing from phenomenological to predictive theory of ferroelectric oxide solution properties through consideration of domain walls

Authors: Atanu Samanta, Suhas Yadav, Or Shafir, Zongquan Gu, Cedric J. G. Meyers, Liyan Wu, Dongfang Chen, Shishir Pandya, Robert A. York, Lane W. Martin, Jonathan E. Spanier, Ilya Grinberg

Abstract: Prediction of properties from composition is a fundamental goal of materials science and can greatly accelerate development of functional materials. It is particularly relevant for ferroelectric perovskite solid solutions where compositional variation is a primary tool for materials design. To advance beyond the commonly used Landau-Ginzburg-Devonshire and density functional theory methods that de… ▽ More Prediction of properties from composition is a fundamental goal of materials science and can greatly accelerate development of functional materials. It is particularly relevant for ferroelectric perovskite solid solutions where compositional variation is a primary tool for materials design. To advance beyond the commonly used Landau-Ginzburg-Devonshire and density functional theory methods that despite their power are not predictive, we elucidate the key interactions that govern ferroelectrics using 5-atom bulk unit cells and non-ground-state defect-like ferroelectric domain walls as a simple as possible but not simpler model systems. We also develop a theory relating properties at several different length scales that provides a unified framework for the prediction of ferroelectric, antiferroelectric and ferroelectric phase stabilities and the key transition temperature, coercive field and polarization properties from composition. The elucidated physically meaningful relationships enable rapid identification of promising piezoelectric and dielectric materials. △ Less

Submitted 25 April, 2021; originally announced April 2021.

Bio-Inspired Design of Artificial Striated Muscles Composed of Sarcomere-Like Contraction Units (preprint)

Authors: Luiza Labazanova, Zeyu Wu, Zhengping Gu, David Navarro-Alarcon

Abstract: Biological muscles have always attracted robotics researchers due to their efficient capabilities in compliance, force generation, and mechanical work. Many groups are working on the development of artificial muscles, however, state-of-the-art methods still fall short in performance when compared with their biological counterpart. Muscles with high force output are mostly rigid, whereas traditiona… ▽ More Biological muscles have always attracted robotics researchers due to their efficient capabilities in compliance, force generation, and mechanical work. Many groups are working on the development of artificial muscles, however, state-of-the-art methods still fall short in performance when compared with their biological counterpart. Muscles with high force output are mostly rigid, whereas traditional soft actuators take much space and are limited in strength and producing displacement. In this work, we aim to find a reasonable trade-off between these features by mimicking the striated structure of skeletal muscles. For that, we designed an artificial pneumatic myofibril composed of multiple contraction units that combine stretchable and inextensible materials. Varying the geometric parameters and the number of units in series provides flexible adjustment of the desired muscle operation. We derived a mathematical model that predicts the relationship between the input pneumatic pressure and the generated output force. A detailed experimental study is conducted to validate the performance of the proposed bio-inspired muscle. △ Less

Submitted 17 March, 2021; originally announced March 2021.

Distribution Adaptive INT8 Quantization for Training CNNs

Authors: Kang Zhao, Sida Huang, Pan Pan, Yinghan Li, Yingya Zhang, Zhenyu Gu, Yinghui Xu

Abstract: Researches have demonstrated that low bit-width (e.g., INT8) quantization can be employed to accelerate the inference process. It makes the gradient quantization very promising since the backward propagation requires approximately twice more computation than forward one. Due to the variability and uncertainty of gradient distribution, a lot of methods have been proposed to attain training stabilit… ▽ More Researches have demonstrated that low bit-width (e.g., INT8) quantization can be employed to accelerate the inference process. It makes the gradient quantization very promising since the backward propagation requires approximately twice more computation than forward one. Due to the variability and uncertainty of gradient distribution, a lot of methods have been proposed to attain training stability. However, most of them ignore the channel-wise gradient distributions and the impact of gradients with different magnitudes, resulting in the degradation of final accuracy. In this paper, we propose a novel INT8 quantization training framework for convolutional neural network to address the above issues. Specifically, we adopt Gradient Vectorized Quantization to quantize the gradient, based on the observation that layer-wise gradients contain multiple distributions along the channel dimension. Then, Magnitude-aware Clipping Strategy is introduced by taking the magnitudes of gradients into consideration when minimizing the quantization error, and we present a theoretical derivation to solve the quantization parameters of different distributions. Experimental results on broad range of computer vision tasks, such as image classification, object detection and video classification, demonstrate that the proposed Distribution Adaptive INT8 Quantization training method has achieved almost lossless training accuracy for different backbones, including ResNet, MobileNetV2, InceptionV3, VGG and AlexNet, which is superior to the state-of-the-art techniques. Moreover, we further implement the INT8 kernel that can accelerate the training iteration more than 200% under the latest Turing architecture, i.e., our method excels on both training accuracy and speed. △ Less

Submitted 9 February, 2021; originally announced February 2021.

Comments: This paper has been accepted by AAAI 2021

Smart Auto Insurance: High Resolution, Dynamic, Privacy-Driven, Telematic Insurance

Authors: Michael Bartholic, Zhengrong Gu, Jianan Su, Justin Goldstein, Shin'ichiro Matsuo

Abstract: Data driven approaches to problem solving are, in many regards, the holy grail of evidence backed decision making. Using first-party empirical data to analyze behavior and establish predictions yields us the ability to base in-depth analyses on particular individuals and reduce our dependence on generalizations. Modern mobile and embedded devices provide a wealth of sensors and means for collectin… ▽ More Data driven approaches to problem solving are, in many regards, the holy grail of evidence backed decision making. Using first-party empirical data to analyze behavior and establish predictions yields us the ability to base in-depth analyses on particular individuals and reduce our dependence on generalizations. Modern mobile and embedded devices provide a wealth of sensors and means for collecting and tracking individualized data. Applying these assets to the realm of insurance (which is a statistically backed endeavor at heart) is certainly nothing new; yet doing so in a way that is privacy-driven and secure has not been a central focus of implementers. Existing data-driven insurance technologies require a certain level of trust in the data tracking agency (i.e. insurer) to not misuse, mishandle, or over-collect user data. Smart contracts and blockchain technology provide us an opportunity to re-balance these systems such that the blockchain itself is a trusted agent which both insurers and the insured can confide in. We propose a "Smart Auto Insurance" system that minimizes data sharing while simultaneously providing quality-of-life improvements to both sides. Furthermore, we use a simple game theoretical argument to show that the clients using such a system are disincentivized from behaving adversarially. △ Less

Submitted 5 February, 2021; originally announced February 2021.

Comments: 15 pages, 1 figure, 2 tables

Unexpected Hydrophobicity on Self-Assembled Monolayers Terminated with Two Hydrophilic Hydroxyl Groups

Authors: Dangxin Mao, Xian Wang, Yuanyan Wu, Zonglin Gu, Chunlei Wang, Yusong Tu

Abstract: Current major approaches to access surface hydrophobicity include directly introducing hydrophobic nonpolar groups/molecules into surface or elaborately fabricating surface roughness. Here, for the first time, molecular dynamics simulations show an unexpected hydrophobicity with a contact angle of $82^o$ on a flexible self-assembled monolayer terminated only with two hydrophilic OH groups (… ▽ More Current major approaches to access surface hydrophobicity include directly introducing hydrophobic nonpolar groups/molecules into surface or elaborately fabricating surface roughness. Here, for the first time, molecular dynamics simulations show an unexpected hydrophobicity with a contact angle of $82^o$ on a flexible self-assembled monolayer terminated only with two hydrophilic OH groups ($(OH)_2\!-\!SAM$). This hydrophobicity is attributed to the formation of a hexagonal-ice-like H-bonding structure in the OH matrix of $(OH)_2\!-\!SAM$, which sharply reduces the hydrogen bonds between surface and water molecules above. The unique simple interface presented here offers a significant molecular-level platform for examining the bio-interfacial interactions ranging from biomolecules binding to cell adhesion. △ Less

Submitted 5 February, 2021; originally announced February 2021.

Towards Speeding up Adversarial Training in Latent Spaces

Authors: Yaguan Qian, Qiqi Shao, Tengteng Yao, Bin Wang, Shouling Ji, Shaoning Zeng, Zhaoquan Gu, Wassim Swaileh

Abstract: Adversarial training is wildly considered as one of the most effective way to defend against adversarial examples. However, existing adversarial training methods consume unbearable time, due to the fact that they need to generate adversarial examples in the large input space. To speed up adversarial training, we propose a novel adversarial training method that does not need to generate real advers… ▽ More Adversarial training is wildly considered as one of the most effective way to defend against adversarial examples. However, existing adversarial training methods consume unbearable time, due to the fact that they need to generate adversarial examples in the large input space. To speed up adversarial training, we propose a novel adversarial training method that does not need to generate real adversarial examples. By adding perturbations to logits to generate Endogenous Adversarial Examples (EAEs) -- the adversarial examples in the latent space, the time consuming gradient calculation can be avoided. Extensive experiments are conducted on CIFAR-10 and ImageNet, and the results show that comparing to state-of-the-art methods, our EAE adversarial training not only shortens the training time, but also enhances the robustness of the model and has less impact on the accuracy of clean examples than the existing methods. △ Less

Submitted 8 March, 2021; v1 submitted 1 February, 2021; originally announced February 2021.

Alpha-Cluster formation in heavy alpha-emitters within a multistep model

Authors: J. M. Dong, Q. Zhao, L. J. Wang, W. Zuo, J. Z. Gu

Abstract: $α$-decay always has enormous impetuses to the development of physics and chemistry, in particular due to its indispensable role in the research of new elements. Although it has been observed in laboratories for more than a century, it remains a difficult problem to calculate accurately the formation probability $S_α… ▽ More $α$-decay always has enormous impetuses to the development of physics and chemistry, in particular due to its indispensable role in the research of new elements. Although it has been observed in laboratories for more than a century, it remains a difficult problem to calculate accurately the formation probability $S_α$ microscopically. To this end, we establish a new model, i.e., multistep model, and the corresponding formation probability $S_α$ values of some typical $α$-emitters are calculated without adjustable parameters. The experimental half-lives, in particular their irregular behavior around a shell closure, are remarkably well reproduced by half-life laws combined with these $S_α$. In our strategy, the cluster formation is a gradual process in heavy nuclei, different from the situation that cluster pre-exists in light nuclei. The present study may pave the way to a fully understanding of $α$-decay from the perspective of nuclear structure. △ Less

Submitted 19 January, 2021; originally announced January 2021.

Comments: 7 pages, 4 figures

Journal ref: Physics Letters B, 813, 136063 (2021)

Real-space construction of crystalline topological superconductors and insulators in 2D interacting fermionic systems

Authors: Jian-Hao Zhang, Shuo Yang, Yang Qi, Zheng-Cheng Gu

Abstract: The construction and classification of crystalline symmetry protected topological (SPT) phases in interacting bosonic and fermionic systems have been intensively studied in the past few years. Crystalline SPT phases are not only of conceptual importance, but also provide great opportunities towards experimental realization since space group symmetries naturally exist for any realistic material. In… ▽ More The construction and classification of crystalline symmetry protected topological (SPT) phases in interacting bosonic and fermionic systems have been intensively studied in the past few years. Crystalline SPT phases are not only of conceptual importance, but also provide great opportunities towards experimental realization since space group symmetries naturally exist for any realistic material. In this paper, we systematically classify the crystalline topological superconductors (TSC) and topological insulators (TI) in 2D interacting fermionic systems by using an explicit real-space construction. In particular, we discover an intriguing fermionic crystalline topological superconductor that can only be realized in interacting fermionic systems (i.e., not in free-fermion or bosonic SPT systems). Moreover, we also verify the recently conjectured crystalline equivalence principle for generic 2D interacting fermionic systems. △ Less

Submitted 20 June, 2023; v1 submitted 31 December, 2020; originally announced December 2020.

Comments: 39+37 pages, 10+13 figures, 3+1 tables, all comments and suggestions are very welcome

Journal ref: Phys. Rev. Research 4, 033081 (2022)

Ionic conductance oscillations in sub-nanometer pores probed by optoelectronic control

Authors: Fanfan Chen, Zonglin Gu, Chunxiao Zhao, Yuang Chen, Xiaowei Jiang, Zhi He, Yuxian Lu, Ruhong Zhou, Jiandong Feng

Abstract: Ionic Coulomb blockade is one of the mesoscopic effects in ion transport revealing the quantized nature of ionic charges, which is of crucial importance to our understanding of the sub-continuum transport in nanofluidics and the mechanism of biological ion channels. Herein, we report an experimental observation and plausible theoretical reasoning of ionic conduction oscillations. Our experiment wa… ▽ More Ionic Coulomb blockade is one of the mesoscopic effects in ion transport revealing the quantized nature of ionic charges, which is of crucial importance to our understanding of the sub-continuum transport in nanofluidics and the mechanism of biological ion channels. Herein, we report an experimental observation and plausible theoretical reasoning of ionic conduction oscillations. Our experiment was performed under strong confinement in single sub-nanometer MoS2 pores with optoelectronic control enabled for active tuning of pore surface charges. Under this charge control, we measured the ionic current at fixed voltages and observed multiple current peaks. Our analytical discussions and molecular dynamics simulations further reveal that the conductance oscillations in atomically thin nanopores may originate from the multi-ion interaction at the pore entry, particularly the electrostatic repulsion of ions external to the pore by ions bound inside the pore. Our work adds a further understanding of ionic Coulomb blockade effect under extreme confinement in atomically thin nanopores and paves the way for developing advanced ionic machineries. △ Less

Submitted 27 December, 2020; originally announced December 2020.

Rayleigh-Brillouin light scattering spectroscopy of air; experiment, predictive model and dimensionless scaling

Authors: Yuanqing Wang, Ziyu Gu, Kun Liang, Wim Ubachs

Abstract: Spontaneous Rayleigh-Brillouin scattering (RBS) experiments have been performed in air for pressures in the range 0.25 - 3 bar and temperatures in the range 273 - 333 K. The functional behaviour of the RB-spectral profile as a function of experimental parameters, such as the incident wavelength, scattering angle, pressure and temperature is analyzed, as well as the dependence on thermodynamic prop… ▽ More Spontaneous Rayleigh-Brillouin scattering (RBS) experiments have been performed in air for pressures in the range 0.25 - 3 bar and temperatures in the range 273 - 333 K. The functional behaviour of the RB-spectral profile as a function of experimental parameters, such as the incident wavelength, scattering angle, pressure and temperature is analyzed, as well as the dependence on thermodynamic properties of the gas, as the shear viscosity, the thermal conductivity, the internal heat capacity and the bulk viscosity. Measurements are performed in a scattering geometry detecting at a scattering angle $θ=55.7^\circ$ and an incident wavelength of $λ_i=532.22$ nm, at which the Brillouin features become more pronounced than in a right angles geometry and for ultraviolet light. For pressure conditions of 1 - 3 bar the RB-spectra, measured at high signal-to-noise ratio, are compared to Tenti-S6 model calculations and values for the bulk viscosity of air are extracted. Values of $η_b$ are found to exhibit a linear dependence on temperature over the measurement interval in the range $1.0 - 2.0 \times 10^{-5}$ Pa$\cdot$s. A temperature dependent value is deduced from a collection of experiments to yield: $η_{\rm b} = (0.86 \times 10^{-5}) + 1.29 \times 10^{-7} \cdot (T - 250)$. These results are implemented in model calculations that were verified for the low pressure conditions ($p < 1$ bar) relevant for the Earth's atmosphere. As a result we demonstrate that the RB-scattering spectral profiles for air under sub-atmospheric conditions can be generated via the Tenti-S6 model, for given gas-phase and detection conditions ($p$, $T$, $λ_i$, and $θ$), and for values for the gas transport coefficients. △ Less

Submitted 16 December, 2020; originally announced December 2020.

Journal ref: Molecular Physics e1804635 (2020)

Interactive Search Based on Deep Reinforcement Learning

Authors: Yang Yu, Zhenhao Gu, Rong Tao, Jingtian Ge, Kenglun Chang

Abstract: With the continuous development of machine learning technology, major e-commerce platforms have launched recommendation systems based on it to serve a large number of customers with different needs more efficiently. Compared with traditional supervised learning, reinforcement learning can better capture the user's state transition in the decision-making process, and consider a series of user actio… ▽ More With the continuous development of machine learning technology, major e-commerce platforms have launched recommendation systems based on it to serve a large number of customers with different needs more efficiently. Compared with traditional supervised learning, reinforcement learning can better capture the user's state transition in the decision-making process, and consider a series of user actions, not just the static characteristics of the user at a certain moment. In theory, it will have a long-term perspective, producing a more effective recommendation. The special requirements of reinforcement learning for data make it need to rely on an offline virtual system for training. Our project mainly establishes a virtual user environment for offline training. At the same time, we tried to improve a reinforcement learning algorithm based on bi-clustering to expand the action space and recommended path space of the recommendation agent. △ Less

Submitted 9 December, 2020; originally announced December 2020.

Towards a Domain Specific Solution for a New Generation of Wireless Modems

Authors: Alan Gatherer, Ashish Shrivastava, Hao Luan, Asheesh Kashyap, Zhenguo Gu, Miguel Dajer

Abstract: Wireless cellular System on Chip (SoC) are experiencing unprecedented demands on data rate, latency use case variety. 5G wireless technologies require a massive number of antennas and complex signal processing to improve bandwidth and spectral efficiency. The Internet of Things is causing a proliferation in the number of connected devices, and service categories, such as ultra-reliable low latency… ▽ More Wireless cellular System on Chip (SoC) are experiencing unprecedented demands on data rate, latency use case variety. 5G wireless technologies require a massive number of antennas and complex signal processing to improve bandwidth and spectral efficiency. The Internet of Things is causing a proliferation in the number of connected devices, and service categories, such as ultra-reliable low latency, which will produce new use cases, such as self-driving cars, robotic factories, and remote surgery. In addressing these challenges, we can no longer rely on faster cores, or even more silicon. Modem software development is becoming increasingly error prone and difficult as the complexity of the applications and the architectures increase. In this report we propose a Wireless Domain Specific Solution that takes a Dataflow acceleration approach and addresses the need of the SoC to support dataflows that change with use case and user activity, while maintaining the Firm Real Time High Availability with low probability of Heisenbugs that is required in cellular modems. We do this by developing a Domain Specific Architecture that describes the requirements in a suitably abstracted dataflow Domain Specific language. A toolchain is described that automates translation of those requirements in an efficient and robust manner and provides formal guarantees against Heisenbugs. The dataflow native DSA supports the toolchain output with specialized processing, data management and control features with high performance and low power, and recovers rapidly from dropped dataflows while continuing to achieve the real time requirements. This report focuses on the dataflow acceleration in the DSA and the part of the automated toolchain that formally checks the performance and correctness of software running on this dataflow hardware. Results are presented and a summary of future work is given. △ Less

Submitted 4 December, 2020; originally announced December 2020.

Comments: 49 pages

Visually Imperceptible Adversarial Patch Attacks on Digital Images

Authors: Yaguan Qian, Jiamin Wang, Bin Wang, Shaoning Zeng, Zhaoquan Gu, Shouling Ji, Wassim Swaileh

Abstract: The vulnerability of deep neural networks (DNNs) to adversarial examples has attracted more attention. Many algorithms have been proposed to craft powerful adversarial examples. However, most of these algorithms modified the global or local region of pixels without taking network explanations into account. Hence, the perturbations are redundant, which are easily detected by human eyes. In this pap… ▽ More The vulnerability of deep neural networks (DNNs) to adversarial examples has attracted more attention. Many algorithms have been proposed to craft powerful adversarial examples. However, most of these algorithms modified the global or local region of pixels without taking network explanations into account. Hence, the perturbations are redundant, which are easily detected by human eyes. In this paper, we propose a novel method to generate local region perturbations. The main idea is to find a contributing feature region (CFR) of an image by simulating the human attention mechanism and then add perturbations to CFR. Furthermore, a soft mask matrix is designed on the basis of an activation map to finely represent the contributions of each pixel in CFR. With this soft mask, we develop a new loss function with inverse temperature to search for optimal perturbations in CFR. Due to the network explanations, the perturbations added to CFR are more effective than those added to other regions. Extensive experiments conducted on CIFAR-10 and ILSVRC2012 demonstrate the effectiveness of the proposed method, including attack success rate, imperceptibility, and transferability. △ Less

Submitted 27 April, 2021; v1 submitted 1 December, 2020; originally announced December 2020.

Normal trace for vector fields of bounded mean oscillation

Authors: Yoshikazu Giga, Zhongyang Gu

Abstract: We introduce various spaces of vector fields of bounded mean oscillation ($BMO$) defined in a domain so that normal trace on the boundary is bounded when its divergence is well controlled. The behavior of "normal" component and "tangential" component may be different for our $BMO$ vector fields. As a result zero extension of the normal component stays in $BMO$ although such property may not hold f… ▽ More We introduce various spaces of vector fields of bounded mean oscillation ($BMO$) defined in a domain so that normal trace on the boundary is bounded when its divergence is well controlled. The behavior of "normal" component and "tangential" component may be different for our $BMO$ vector fields. As a result zero extension of the normal component stays in $BMO$ although such property may not hold for tangential components. △ Less

Submitted 24 November, 2020; originally announced November 2020.

MSC Class: 30H35; 46B10; 46E35

Simulation-based Optimization of Toll Pricing in Large-Scale Urban Networks using the Network Fundamental Diagram: A Cross-Comparison of Methods

Authors: Ziyuan Gu, Meead Saberi

Abstract: Simulation-based optimization (SO or SBO) has become increasingly important to address challenging transportation network design problems. In this paper, we propose to solve two toll pricing problems with different levels of complexity using the concept of the macroscopic or network fundamental diagram (MFD or NFD), where a large-scale simulation-based dynamic traffic assignment model of Melbourne… ▽ More Simulation-based optimization (SO or SBO) has become increasingly important to address challenging transportation network design problems. In this paper, we propose to solve two toll pricing problems with different levels of complexity using the concept of the macroscopic or network fundamental diagram (MFD or NFD), where a large-scale simulation-based dynamic traffic assignment model of Melbourne, Australia is used. Four computationally efficient SBO methods are applied and compared, including the proportional-integral (PI) controller, regressing kriging (RK), DIviding RECTangles (DIRECT), and simultaneous perturbation stochastic approximation (SPSA). The comparison reveals that these methods work equally well on the simple problem without exhibiting significant performance differences. But, for the complex problem, RK manifests itself to be the best-performing method thanks to its capability of filtering out the numerical noise arising from computer simulations (i.e. allowing for non-smoothness of the objective function). While the PI controller is a more competitive solution to the simple problem given its faster rate of convergence, the poor scalability of the method in the complex problem results in limited applicability. Two caveats, however, deserve emphasis: (i) the chosen critical network density of the NFD does not necessarily represent a robust network control or optimization threshold, as it might shift in the presence of toll pricing; and (ii) re-interpolation is required as part of RK in order to achieve global convergence. △ Less

Submitted 23 November, 2020; originally announced November 2020.