-
AEAD Modes for ZUC Family Stream Ciphers
Authors:
Hongli Li,
Yonghui Wang,
Yongbiao Ma,
Wenyi Jia,
Liang Bai
Abstract:
In order to improve the efficiency of using ZUC primitives, we give two AEAD (Authenticated Encryption with Associated Data) modes for them, ZUC-GXM and ZUC-MUR. They are suitable for ZUC (ZUC-128) and two cases of ZUC-256. The former is a nonce-based AEAD, which is following the GCM framework. The latter is a nonce misuse-resistant one which is based on the framework of SIV variance, providing mo…
▽ More
In order to improve the efficiency of using ZUC primitives, we give two AEAD (Authenticated Encryption with Associated Data) modes for them, ZUC-GXM and ZUC-MUR. They are suitable for ZUC (ZUC-128) and two cases of ZUC-256. The former is a nonce-based AEAD, which is following the GCM framework. The latter is a nonce misuse-resistant one which is based on the framework of SIV variance, providing more robust applications for ZUC family stream ciphers.
△ Less
Submitted 9 November, 2021;
originally announced November 2021.
-
Integrating Deep Event-Level and Script-Level Information for Script Event Prediction
Authors:
Long Bai,
Saiping Guan,
Jiafeng Guo,
Zixuan Li,
Xiaolong Jin,
Xueqi Cheng
Abstract:
Scripts are structured sequences of events together with the participants, which are extracted from the texts.Script event prediction aims to predict the subsequent event given the historical events in the script. Two kinds of information facilitate this task, namely, the event-level information and the script-level information. At the event level, existing studies view an event as a verb with its…
▽ More
Scripts are structured sequences of events together with the participants, which are extracted from the texts.Script event prediction aims to predict the subsequent event given the historical events in the script. Two kinds of information facilitate this task, namely, the event-level information and the script-level information. At the event level, existing studies view an event as a verb with its participants, while neglecting other useful properties, such as the state of the participants. At the script level, most existing studies only consider a single event sequence corresponding to one common protagonist. In this paper, we propose a Transformer-based model, called MCPredictor, which integrates deep event-level and script-level information for script event prediction. At the event level, MCPredictor utilizes the rich information in the text to obtain more comprehensive event semantic representations. At the script-level, it considers multiple event sequences corresponding to different participants of the subsequent event. The experimental results on the widely-used New York Times corpus demonstrate the effectiveness and superiority of the proposed model.
△ Less
Submitted 24 September, 2021;
originally announced October 2021.
-
Detecting long-range dependence for time-varying linear models
Authors:
Lujia Bai,
Weichi Wu
Abstract:
We consider the problem of testing for long-range dependence in time-varying coefficient regression models, where the covariates and errors are locally stationary, allowing complex temporal dynamics and heteroscedasticity. We develop KPSS, R/S, V/S, and K/S-type statistics based on the nonparametric residuals. Under the null hypothesis, the local alternatives as well as the fixed alternatives, we…
▽ More
We consider the problem of testing for long-range dependence in time-varying coefficient regression models, where the covariates and errors are locally stationary, allowing complex temporal dynamics and heteroscedasticity. We develop KPSS, R/S, V/S, and K/S-type statistics based on the nonparametric residuals. Under the null hypothesis, the local alternatives as well as the fixed alternatives, we derive the limiting distributions of the test statistics. As the four types of test statistics could degenerate when the time-varying mean, variance, long-run variance of errors, covariates, and the intercept lie in certain hyperplanes, we show the bootstrap-assisted tests are consistent under both degenerate and non-degenerate scenarios. In particular, in the presence of covariates the exact local asymptotic power of the bootstrap-assisted tests can enjoy the same order as that of the classical KPSS test of long memory for strictly stationary series. The asymptotic theory is built on a new Gaussian approximation technique for locally stationary long-memory processes with short-memory covariates, which is of independent interest. The effectiveness of our tests is demonstrated by extensive simulation studies and real data analysis.
△ Less
Submitted 8 March, 2023; v1 submitted 15 October, 2021;
originally announced October 2021.
-
Distribution Locational Marginal Pricing Under Uncertainty Considering Coordination of Distribution and Wholesale Markets
Authors:
Zongzheng Zhao,
Yixin Liu,
Li Guo,
Linquan Bai,
Chengshan Wang
Abstract:
An effective distribution electricity market (DEM) is required to manage the rapidly growing small-scale distributed energy resources (DERs) in distribution systems (DSs). This paper proposes a day-ahead DEM clearing and pricing mechanism to account for the uncertainty of DERs and the coordination with the wholesale electricity market (WEM) through a bi-level model. The upper-level model clears th…
▽ More
An effective distribution electricity market (DEM) is required to manage the rapidly growing small-scale distributed energy resources (DERs) in distribution systems (DSs). This paper proposes a day-ahead DEM clearing and pricing mechanism to account for the uncertainty of DERs and the coordination with the wholesale electricity market (WEM) through a bi-level model. The upper-level model clears the WEM in the transmission system (TS) and forms the locational marginal price (LMP) and uncertainty LMP (ULMP) for energy and uncertainty/reserve, respectively. In the lower level, a robust scheduling model considering WEM-DEM coordination and uncertainties is proposed to clear the DEM. Accordingly, the distribution LMPs (DLMPs) for active power, reactive power and uncertainty/reserve are derived to reward the energy/reserve provision and charge uncertain resources in the DEM, which provide effective price signals for managing not only the voltage and congestion, but also the uncertainty in DSs. A heterogeneous decomposition (HGD) algorithm is utilized to solve the bi-level model in a decentralized manner with limited information interaction between TS and DSs, which guarantees the solution efficiency and information privacy. The effectiveness of the proposed method is verified via numerous case studies.
△ Less
Submitted 14 October, 2021;
originally announced October 2021.
-
Deep Instance Segmentation with Automotive Radar Detection Points
Authors:
Jianan Liu,
Weiyi Xiong,
Liping Bai,
Yuxuan Xia,
Tao Huang,
Wanli Ouyang,
Bing Zhu
Abstract:
Automotive radar provides reliable environmental perception in all-weather conditions with affordable cost, but it hardly supplies semantic and geometry information due to the sparsity of radar detection points. With the development of automotive radar technologies in recent years, instance segmentation becomes possible by using automotive radar. Its data contain contexts such as radar cross secti…
▽ More
Automotive radar provides reliable environmental perception in all-weather conditions with affordable cost, but it hardly supplies semantic and geometry information due to the sparsity of radar detection points. With the development of automotive radar technologies in recent years, instance segmentation becomes possible by using automotive radar. Its data contain contexts such as radar cross section and micro-Doppler effects, and sometimes can provide detection when the field of view is obscured. The outcome from instance segmentation could be potentially used as the input of trackers for tracking targets. The existing methods often utilize a clustering-based classification framework, which fits the need of real-time processing but has limited performance due to minimum information provided by sparse radar detection points. In this paper, we propose an efficient method based on clustering of estimated semantic information to achieve instance segmentation for the sparse radar detection points. In addition, we show that the performance of the proposed approach can be further enhanced by incorporating the visual multi-layer perceptron. The effectiveness of the proposed method is verified by experimental results on the popular RadarScenes dataset, achieving 89.53% mean coverage and 86.97% mean average precision with the IoU threshold of 0.5, which is superior to other approaches in the literature. More significantly, the consumed memory is around 1MB, and the inference time is less than 40ms, indicating that our proposed algorithm is storage and time efficient. These two criteria ensure the practicality of the proposed method in real-world systems.
△ Less
Submitted 5 February, 2023; v1 submitted 4 October, 2021;
originally announced October 2021.
-
Accurate force field of two-dimensional ferroelectrics from deep learning
Authors:
Jing Wu,
Liyi Bai,
Jiawei Huang,
Liyang Ma,
Jian Liu,
Shi Liu
Abstract:
The discovery of two-dimensional (2D) ferroelectrics with switchable out-of-plane polarization such as monolayer $α$-In$_2$Se$_3$ offers a new avenue for ultrathin high-density ferroelectric-based nanoelectronics such as ferroelectric field effect transistors and memristors. The functionality of ferroelectrics depends critically on the dynamics of polarization switching in response to an external…
▽ More
The discovery of two-dimensional (2D) ferroelectrics with switchable out-of-plane polarization such as monolayer $α$-In$_2$Se$_3$ offers a new avenue for ultrathin high-density ferroelectric-based nanoelectronics such as ferroelectric field effect transistors and memristors. The functionality of ferroelectrics depends critically on the dynamics of polarization switching in response to an external electric/stress field. Unlike the switching dynamics in bulk ferroelectrics that have been extensively studied, the mechanisms and dynamics of polarization switching in 2D remain largely unexplored. Molecular dynamics (MD) using classical force fields is a reliable and efficient method for large-scale simulations of dynamical processes with atomic resolution. Here we developed a deep neural network-based force field of monolayer In$_2$Se$_3$ using a concurrent learning procedure that efficiently updates the first-principles-based training database. The model potential has accuracy comparable with density functional theory (DFT), capable of predicting a range of thermodynamic properties of In$_2$Se$_3$ polymorphs and lattice dynamics of ferroelectric In$_2$Se$_3$. Pertinent to the switching dynamics, the model potential also reproduces the DFT kinetic pathways of polarization reversal and 180$^\circ$ domain wall motions. Moreover, isobaric-isothermal ensemble MD simulations predict a temperature-driven $α\rightarrow β$ phase transition at the single-layer limit, as revealed by both local atomic displacement and Steinhardt's bond orientational order parameter $Q_4$. Our work paves the way for further research on the dynamics of ferroelectric $α$-In$_2$Se$_3$ and related systems.
△ Less
Submitted 29 October, 2021; v1 submitted 15 September, 2021;
originally announced September 2021.
-
Graph-Based 3D Multi-Person Pose Estimation Using Multi-View Images
Authors:
Size Wu,
Sheng Jin,
Wentao Liu,
Lei Bai,
Chen Qian,
Dong Liu,
Wanli Ouyang
Abstract:
This paper studies the task of estimating the 3D human poses of multiple persons from multiple calibrated camera views. Following the top-down paradigm, we decompose the task into two stages, i.e. person localization and pose estimation. Both stages are processed in coarse-to-fine manners. And we propose three task-specific graph neural networks for effective message passing. For 3D person localiz…
▽ More
This paper studies the task of estimating the 3D human poses of multiple persons from multiple calibrated camera views. Following the top-down paradigm, we decompose the task into two stages, i.e. person localization and pose estimation. Both stages are processed in coarse-to-fine manners. And we propose three task-specific graph neural networks for effective message passing. For 3D person localization, we first use Multi-view Matching Graph Module (MMG) to learn the cross-view association and recover coarse human proposals. The Center Refinement Graph Module (CRG) further refines the results via flexible point-based prediction. For 3D pose estimation, the Pose Regression Graph Module (PRG) learns both the multi-view geometry and structural relations between human joints. Our approach achieves state-of-the-art performance on CMU Panoptic and Shelf datasets with significantly lower computation complexity.
△ Less
Submitted 13 September, 2021;
originally announced September 2021.
-
FIDNet: LiDAR Point Cloud Semantic Segmentation with Fully Interpolation Decoding
Authors:
Yiming Zhao,
Lin Bai,
Xinming Huang
Abstract:
Projecting the point cloud on the 2D spherical range image transforms the LiDAR semantic segmentation to a 2D segmentation task on the range image. However, the LiDAR range image is still naturally different from the regular 2D RGB image; for example, each position on the range image encodes the unique geometry information. In this paper, we propose a new projection-based LiDAR semantic segmentati…
▽ More
Projecting the point cloud on the 2D spherical range image transforms the LiDAR semantic segmentation to a 2D segmentation task on the range image. However, the LiDAR range image is still naturally different from the regular 2D RGB image; for example, each position on the range image encodes the unique geometry information. In this paper, we propose a new projection-based LiDAR semantic segmentation pipeline that consists of a novel network structure and an efficient post-processing step. In our network structure, we design a FID (fully interpolation decoding) module that directly upsamples the multi-resolution feature maps using bilinear interpolation. Inspired by the 3D distance interpolation used in PointNet++, we argue this FID module is a 2D version distance interpolation on $(θ, φ)$ space. As a parameter-free decoding module, the FID largely reduces the model complexity by maintaining good performance. Besides the network structure, we empirically find that our model predictions have clear boundaries between different semantic classes. This makes us rethink whether the widely used K-nearest-neighbor post-processing is still necessary for our pipeline. Then, we realize the many-to-one mapping causes the blurring effect that some points are mapped into the same pixel and share the same label. Therefore, we propose to process those occluded points by assigning the nearest predicted label to them. This NLA (nearest label assignment) post-processing step shows a better performance than KNN with faster inference speed in the ablation study. On the SemanticKITTI dataset, our pipeline achieves the best performance among all projection-based methods with $64 \times 2048$ resolution and all point-wise solutions. With a ResNet-34 as the backbone, both the training and testing of our model can be finished on a single RTX 2080 Ti with 11G memory. The code is released.
△ Less
Submitted 8 September, 2021;
originally announced September 2021.
-
Dual camera snapshot hyperspectral imaging system via physics informed learning
Authors:
Hui Xie,
Zhuang Zhao,
Jing Han,
Yi Zhang,
Lianfa Bai,
Jun Lu
Abstract:
We consider using the system's optical imaging process with convolutional neural networks (CNNs) to solve the snapshot hyperspectral imaging reconstruction problem, which uses a dual-camera system to capture the three-dimensional hyperspectral images (HSIs) in a compressed way. Various methods using CNNs have been developed in recent years to reconstruct HSIs, but most of the supervised deep learn…
▽ More
We consider using the system's optical imaging process with convolutional neural networks (CNNs) to solve the snapshot hyperspectral imaging reconstruction problem, which uses a dual-camera system to capture the three-dimensional hyperspectral images (HSIs) in a compressed way. Various methods using CNNs have been developed in recent years to reconstruct HSIs, but most of the supervised deep learning methods aimed to fit a brute-force mapping relationship between the captured compressed image and standard HSIs. Thus, the learned mapping would be invalid when the observation data deviate from the training data. Especially, we usually don't have ground truth in real-life scenarios. In this paper, we present a self-supervised dual-camera equipment with an untrained physics-informed CNNs framework. Extensive simulation and experimental results show that our method without training can be adapted to a wide imaging environment with good performance. Furthermore, compared with the training-based methods, our system can be constantly fine-tuned and self-improved in real-life scenarios.
△ Less
Submitted 17 November, 2021; v1 submitted 6 September, 2021;
originally announced September 2021.
-
Extremes of Gaussian random fields with non-additive dependence structure
Authors:
Long Bai,
Krzysztof Debicki,
Peng Liu
Abstract:
We derive exact asymptotics of $$\mathbb{P}\left(\sup_{\mathbf{t}\in {\mathcal{A}}}X(\mathbf{t})>u\right),~ \text{as}~ u\to\infty,$$ for a centered Gaussian field $X(\mathbf{t}),~ \mathbf{t}\in \mathcal{A}\subset\mathbb{R}^n$, $n>1$ with continuous sample paths a.s., for which $\arg \max_{\mathbf{t}\in {\mathcal{A}}} Var(X(\mathbf{t}))$ is a Jordan set with finite and positive Lebesque measure of…
▽ More
We derive exact asymptotics of $$\mathbb{P}\left(\sup_{\mathbf{t}\in {\mathcal{A}}}X(\mathbf{t})>u\right),~ \text{as}~ u\to\infty,$$ for a centered Gaussian field $X(\mathbf{t}),~ \mathbf{t}\in \mathcal{A}\subset\mathbb{R}^n$, $n>1$ with continuous sample paths a.s., for which $\arg \max_{\mathbf{t}\in {\mathcal{A}}} Var(X(\mathbf{t}))$ is a Jordan set with finite and positive Lebesque measure of dimension $k\leq n$ and its dependence structure is not necessarily locally stationary. Our findings are applied to deriving the asymptotics of tail probabilities related to performance tables and chi processes where the covariance structure is not locally stationary.
△ Less
Submitted 16 November, 2021; v1 submitted 20 August, 2021;
originally announced August 2021.
-
PSViT: Better Vision Transformer via Token Pooling and Attention Sharing
Authors:
Boyu Chen,
Peixia Li,
Baopu Li,
Chuming Li,
Lei Bai,
Chen Lin,
Ming Sun,
Junjie Yan,
Wanli Ouyang
Abstract:
In this paper, we observe two levels of redundancies when applying vision transformers (ViT) for image recognition. First, fixing the number of tokens through the whole network produces redundant features at the spatial level. Second, the attention maps among different transformer layers are redundant. Based on the observations above, we propose a PSViT: a ViT with token Pooling and attention Shar…
▽ More
In this paper, we observe two levels of redundancies when applying vision transformers (ViT) for image recognition. First, fixing the number of tokens through the whole network produces redundant features at the spatial level. Second, the attention maps among different transformer layers are redundant. Based on the observations above, we propose a PSViT: a ViT with token Pooling and attention Sharing to reduce the redundancy, effectively enhancing the feature representation ability, and achieving a better speed-accuracy trade-off. Specifically, in our PSViT, token pooling can be defined as the operation that decreases the number of tokens at the spatial level. Besides, attention sharing will be built between the neighboring transformer layers for reusing the attention maps having a strong correlation among adjacent layers. Then, a compact set of the possible combinations for different token pooling and attention sharing mechanisms are constructed. Based on the proposed compact set, the number of tokens in each layer and the choices of layers sharing attention can be treated as hyper-parameters that are learned from data automatically. Experimental results show that the proposed scheme can achieve up to 6.6% accuracy improvement in ImageNet classification compared with the DeiT.
△ Less
Submitted 7 August, 2021;
originally announced August 2021.
-
The Influence of Age and Gender Information on the Diagnosis of Diabetic Retinopathy: Based on Neural Networks
Authors:
Long Bai,
Sihang Chen,
Mingyang Gao,
Leila Abdelrahman,
Manal Al Ghamdi,
Mohamed Abdel-Mottaleb
Abstract:
This paper proposes the importance of age and gender information in the diagnosis of diabetic retinopathy. We utilized Deep Residual Neural Networks (ResNet) and Densely Connected Convolutional Networks (DenseNet), which are proven effective on image classification problems and the diagnosis of diabetic retinopathy using the retinal fundus images. We used the ensemble of several classical networks…
▽ More
This paper proposes the importance of age and gender information in the diagnosis of diabetic retinopathy. We utilized Deep Residual Neural Networks (ResNet) and Densely Connected Convolutional Networks (DenseNet), which are proven effective on image classification problems and the diagnosis of diabetic retinopathy using the retinal fundus images. We used the ensemble of several classical networks and decentralized the training so that the network was simple and avoided overfitting. To observe whether the age and gender information could help enhance the performance, we added the information before the dense layer and compared the results with the results that did not add age and gender information. We found that the test accuracy of the network with age and gender information was 2.67% higher than that of the network without age and gender information. Meanwhile, compared with gender information, age information had a better help for the results.
△ Less
Submitted 6 August, 2021;
originally announced August 2021.
-
GLiT: Neural Architecture Search for Global and Local Image Transformer
Authors:
Boyu Chen,
Peixia Li,
Chuming Li,
Baopu Li,
Lei Bai,
Chen Lin,
Ming Sun,
Junjie yan,
Wanli Ouyang
Abstract:
We introduce the first Neural Architecture Search (NAS) method to find a better transformer architecture for image recognition. Recently, transformers without CNN-based backbones are found to achieve impressive performance for image recognition. However, the transformer is designed for NLP tasks and thus could be sub-optimal when directly used for image recognition. In order to improve the visual…
▽ More
We introduce the first Neural Architecture Search (NAS) method to find a better transformer architecture for image recognition. Recently, transformers without CNN-based backbones are found to achieve impressive performance for image recognition. However, the transformer is designed for NLP tasks and thus could be sub-optimal when directly used for image recognition. In order to improve the visual representation ability for transformers, we propose a new search space and searching algorithm. Specifically, we introduce a locality module that models the local correlations in images explicitly with fewer computational cost. With the locality module, our search space is defined to let the search algorithm freely trade off between global and local information as well as optimizing the low-level design choice in each module. To tackle the problem caused by huge search space, a hierarchical neural architecture search method is proposed to search the optimal vision transformer from two levels separately with the evolutionary algorithm. Extensive experiments on the ImageNet dataset demonstrate that our method can find more discriminative and efficient transformer variants than the ResNet family (e.g., ResNet101) and the baseline ViT for image classification.
△ Less
Submitted 17 August, 2021; v1 submitted 6 July, 2021;
originally announced July 2021.
-
Online Metro Origin-Destination Prediction via Heterogeneous Information Aggregation
Authors:
Lingbo Liu,
Yuying Zhu,
Guanbin Li,
Ziyi Wu,
Lei Bai,
Liang Lin
Abstract:
Metro origin-destination prediction is a crucial yet challenging time-series analysis task in intelligent transportation systems, which aims to accurately forecast two specific types of cross-station ridership, i.e., Origin-Destination (OD) one and Destination-Origin (DO) one. However, complete OD matrices of previous time intervals can not be obtained immediately in online metro systems, and conv…
▽ More
Metro origin-destination prediction is a crucial yet challenging time-series analysis task in intelligent transportation systems, which aims to accurately forecast two specific types of cross-station ridership, i.e., Origin-Destination (OD) one and Destination-Origin (DO) one. However, complete OD matrices of previous time intervals can not be obtained immediately in online metro systems, and conventional methods only used limited information to forecast the future OD and DO ridership separately. In this work, we proposed a novel neural network module termed Heterogeneous Information Aggregation Machine (HIAM), which fully exploits heterogeneous information of historical data (e.g., incomplete OD matrices, unfinished order vectors, and DO matrices) to jointly learn the evolutionary patterns of OD and DO ridership. Specifically, an OD modeling branch estimates the potential destinations of unfinished orders explicitly to complement the information of incomplete OD matrices, while a DO modeling branch takes DO matrices as input to capture the spatial-temporal distribution of DO ridership. Moreover, a Dual Information Transformer is introduced to propagate the mutual information among OD features and DO features for modeling the OD-DO causality and correlation. Based on the proposed HIAM, we develop a unified Seq2Seq network to forecast the future OD and DO ridership simultaneously. Extensive experiments conducted on two large-scale benchmarks demonstrate the effectiveness of our method for online metro origin-destination prediction. Our code is resealed at https://github.com/HCPLab-SYSU/HIAM.
△ Less
Submitted 24 May, 2022; v1 submitted 2 July, 2021;
originally announced July 2021.
-
Enabling 3D Object Detection with a Low-Resolution LiDAR
Authors:
Lin Bai,
Yiming Zhao,
Xinming Huang
Abstract:
Light Detection And Ranging (LiDAR) has been widely used in autonomous vehicles for perception and localization. However, the cost of a high-resolution LiDAR is still prohibitively expensive, while its low-resolution counterpart is much more affordable. Therefore, using low-resolution LiDAR for autonomous driving is an economically viable solution, but the point cloud sparsity makes it extremely c…
▽ More
Light Detection And Ranging (LiDAR) has been widely used in autonomous vehicles for perception and localization. However, the cost of a high-resolution LiDAR is still prohibitively expensive, while its low-resolution counterpart is much more affordable. Therefore, using low-resolution LiDAR for autonomous driving is an economically viable solution, but the point cloud sparsity makes it extremely challenging. In this paper, we propose a two-stage neural network framework that enables 3D object detection using a low-resolution LiDAR. Taking input from a low-resolution LiDAR point cloud and a monocular camera image, a depth completion network is employed to produce dense point cloud that is subsequently processed by a voxel-based network for 3D object detection. Evaluated with KITTI dataset for 3D object detection in Bird-Eye View (BEV), the experimental result shows that the proposed approach performs significantly better than directly applying the 16-line LiDAR point cloud for object detection. For both easy and moderate cases, our 3D vehicle detection results are close to those using 64-line high-resolution LiDARs.
△ Less
Submitted 3 May, 2022; v1 submitted 4 May, 2021;
originally announced May 2021.
-
Fuzzy Discriminant Clustering with Fuzzy Pairwise Constraints
Authors:
Zhen Wang,
Shan-Shan Wang,
Lan Bai,
Wen-Si Wang,
Yuan-Hai Shao
Abstract:
In semi-supervised fuzzy clustering, this paper extends the traditional pairwise constraint (i.e., must-link or cannot-link) to fuzzy pairwise constraint. The fuzzy pairwise constraint allows a supervisor to provide the grade of similarity or dissimilarity between the implicit fuzzy vectors of a pair of samples. This constraint can present more complicated relationship between the pair of samples…
▽ More
In semi-supervised fuzzy clustering, this paper extends the traditional pairwise constraint (i.e., must-link or cannot-link) to fuzzy pairwise constraint. The fuzzy pairwise constraint allows a supervisor to provide the grade of similarity or dissimilarity between the implicit fuzzy vectors of a pair of samples. This constraint can present more complicated relationship between the pair of samples and avoid eliminating the fuzzy characteristics. We propose a fuzzy discriminant clustering model (FDC) to fuse the fuzzy pairwise constraints. The nonconvex optimization problem in our FDC is solved by a modified expectation-maximization algorithm, involving to solve several indefinite quadratic programming problems (IQPPs). Further, a diagonal block coordinate decent (DBCD) algorithm is proposed for these IQPPs, whose stationary points are guaranteed, and the global solutions can be obtained under certain conditions. To suit for different applications, the FDC is extended into various metric spaces, e.g., the Reproducing Kernel Hilbert Space. Experimental results on several benchmark datasets and facial expression database demonstrate the outperformance of our FDC compared with some state-of-the-art clustering models.
△ Less
Submitted 17 April, 2021;
originally announced April 2021.
-
A Surface Geometry Model for LiDAR Depth Completion
Authors:
Yiming Zhao,
Lin Bai,
Ziming Zhang,
Xinming Huang
Abstract:
LiDAR depth completion is a task that predicts depth values for every pixel on the corresponding camera frame, although only sparse LiDAR points are available. Most of the existing state-of-the-art solutions are based on deep neural networks, which need a large amount of data and heavy computations for training the models. In this letter, a novel non-learning depth completion method is proposed by…
▽ More
LiDAR depth completion is a task that predicts depth values for every pixel on the corresponding camera frame, although only sparse LiDAR points are available. Most of the existing state-of-the-art solutions are based on deep neural networks, which need a large amount of data and heavy computations for training the models. In this letter, a novel non-learning depth completion method is proposed by exploiting the local surface geometry that is enhanced by an outlier removal algorithm. The proposed surface geometry model is inspired by the observation that most pixels with unknown depth have a nearby LiDAR point. Therefore, it is assumed those pixels share the same surface with the nearest LiDAR point, and their respective depth can be estimated as the nearest LiDAR depth value plus a residual error. The residual error is calculated by using a derived equation with several physical parameters as input, including the known camera intrinsic parameters, estimated normal vector, and offset distance on the image plane. The proposed method is further enhanced by an outlier removal algorithm that is designed to remove incorrectly mapped LiDAR points from occluded regions. On KITTI dataset, the proposed solution achieves the best error performance among all existing non-learning methods and is comparable to the best self-supervised learning method and some supervised learning methods. Moreover, since outlier points from occluded regions is a commonly existing problem, the proposed outlier removal algorithm is a general preprocessing step that is applicable to many robotic systems with both camera and LiDAR sensors.
△ Less
Submitted 17 April, 2021;
originally announced April 2021.
-
Calibration of the Air Shower Energy Scale of the Water and Air Cherenkov Techniques in the LHAASO experiment
Authors:
F. Aharonian,
Q. An,
Axikegu,
L. X. Bai,
Y. X. Bai,
Y. W. Bao,
D. Bastieri,
X. J. Bi,
Y. J. Bi,
H. Cai,
J. T. Cai,
Z. Cao Z. Cao,
J. Chang,
J. F. Chang,
X. C. Chang,
B. M. Chen,
J. Chen,
L. Chen,
L. Chen,
L. Chen,
M. J. Chen,
M. L. Chen,
Q. H. Chen,
S. H. Chen,
S. Z. Chen
, et al. (233 additional authors not shown)
Abstract:
The Wide Field-of-View Cherenkov Telescope Array (WFCTA) and the Water Cherenkov Detector Arrays (WCDA) of LHAASO are designed to work in combination for measuring the energy spectra of various cosmic ray species over a very wide energy range from a few TeV to 10 PeV. The energy calibration of WCDA can be achieved with a proven technique of measuring the westward shift of the Moon shadow of galact…
▽ More
The Wide Field-of-View Cherenkov Telescope Array (WFCTA) and the Water Cherenkov Detector Arrays (WCDA) of LHAASO are designed to work in combination for measuring the energy spectra of various cosmic ray species over a very wide energy range from a few TeV to 10 PeV. The energy calibration of WCDA can be achieved with a proven technique of measuring the westward shift of the Moon shadow of galactic cosmic rays due to the geomagnetic field. This deflection angle $Δ$ is inversely proportional to the energy of the cosmic rays. The precise measurements of the shifts by WCDA allows us to calibrate its energy scale for energies as high as 35 TeV. The energy scale measured by WCDA can be used to cross calibrate the energy reconstructed by WFCTA, which spans the whole energy range up to 10 PeV. In this work, we will demonstrate the feasibility of the method using the data collected from April 2019 to January 2020 by the WFCTA array and WCDA-1 detector, the first of the three water Cherenkov ponds, already commissioned at LHAASO site.
△ Less
Submitted 13 April, 2021; v1 submitted 11 April, 2021;
originally announced April 2021.
-
Learning Conjoint Attentions for Graph Neural Nets
Authors:
Tiantian He,
Yew-Soon Ong,
Lu Bai
Abstract:
In this paper, we present Conjoint Attentions (CAs), a class of novel learning-to-attend strategies for graph neural networks (GNNs). Besides considering the layer-wise node features propagated within the GNN, CAs can additionally incorporate various structural interventions, such as node cluster embedding, and higher-order structural correlations that can be learned outside of GNN, when computing…
▽ More
In this paper, we present Conjoint Attentions (CAs), a class of novel learning-to-attend strategies for graph neural networks (GNNs). Besides considering the layer-wise node features propagated within the GNN, CAs can additionally incorporate various structural interventions, such as node cluster embedding, and higher-order structural correlations that can be learned outside of GNN, when computing attention scores. The node features that are regarded as significant by the conjoint criteria are therefore more likely to be propagated in the GNN. Given the novel Conjoint Attention strategies, we then propose Graph conjoint attention networks (CATs) that can learn representations embedded with significant latent features deemed by the Conjoint Attentions. Besides, we theoretically validate the discriminative capacity of CATs. CATs utilizing the proposed Conjoint Attention strategies have been extensively tested in well-established benchmarking datasets and comprehensively compared with state-of-the-art baselines. The obtained notable performance demonstrates the effectiveness of the proposed Conjoint Attentions.
△ Less
Submitted 12 December, 2021; v1 submitted 5 February, 2021;
originally announced February 2021.
-
Resolution Limits of Non-Adaptive 20 Questions Search for Multiple Targets
Authors:
Lin Zhou,
Lin Bai,
Alfred Hero
Abstract:
We study the problem of simultaneous search for multiple targets over a multidimensional unit cube and derive fundamental resolution limits of non-adaptive querying procedures using the 20 questions estimation framework. The performance criterion that we consider is the achievable resolution, which is defined as the maximal $L_\infty$ norm between the location vector and its estimated version wher…
▽ More
We study the problem of simultaneous search for multiple targets over a multidimensional unit cube and derive fundamental resolution limits of non-adaptive querying procedures using the 20 questions estimation framework. The performance criterion that we consider is the achievable resolution, which is defined as the maximal $L_\infty$ norm between the location vector and its estimated version where the maximization is over all target location vectors. The fundamental resolution limit is defined as the minimal achievable resolution of any non-adaptive query procedure, where each query has binary yes/no answers. We drive non-asymptotic and second-order asymptotic bounds on the minimal achievable resolution, using tools from finite blocklength information theory. Specifically, in the achievability part, we relate the 20 questions problem to data transmission over a multiple access channel, use the information spectrum method by Han and borrow results from finite blocklength analysis for random access channel coding. In the converse part, we relate the 20 questions problem to data transmission over a point-to-point channel and adapt finite blocklength converse results for channel coding. Our results extend the purely first-order asymptotic analyses of Kaspi \emph{et al.} (ISIT 2015) for the one-dimensional case: we consider channels beyond the binary symmetric channel and derive non-asymptotic and second-order asymptotic bounds on the performance of optimal non-adaptive query procedures.
△ Less
Submitted 6 April, 2022; v1 submitted 17 January, 2021;
originally announced January 2021.
-
Construction and On-site Performance of the LHAASO WFCTA Camera
Authors:
F. Aharonian,
Q. An,
Axikegu,
L. X. Bai,
Y. X. Bai,
Y. W. Bao,
D. Bastieri,
X. J. Bi,
Y. J. Bi,
H. Cai,
J. T. Cai,
Z. Cao,
Z. Cao,
J. Chang,
J. F. Chang,
X. C. Chang,
B. M. Chen,
J. Chen,
L. Chen,
L. Chen,
L. Chen,
M. J. Chen,
M. L. Chen,
Q. H. Chen,
S. H. Chen
, et al. (234 additional authors not shown)
Abstract:
The focal plane camera is the core component of the Wide Field-of-view Cherenkov/fluorescence Telescope Array (WFCTA) of the Large High-Altitude Air Shower Observatory (LHAASO). Because of the capability of working under moonlight without aging, silicon photomultipliers (SiPM) have been proven to be not only an alternative but also an improvement to conventional photomultiplier tubes (PMT) in this…
▽ More
The focal plane camera is the core component of the Wide Field-of-view Cherenkov/fluorescence Telescope Array (WFCTA) of the Large High-Altitude Air Shower Observatory (LHAASO). Because of the capability of working under moonlight without aging, silicon photomultipliers (SiPM) have been proven to be not only an alternative but also an improvement to conventional photomultiplier tubes (PMT) in this application. Eighteen SiPM-based cameras with square light funnels have been built for WFCTA. The telescopes have collected more than 100 million cosmic ray events and preliminary results indicate that these cameras are capable of working under moonlight. The characteristics of the light funnels and SiPMs pose challenges (e.g. dynamic range, dark count rate, assembly techniques). In this paper, we present the design features, manufacturing techniques and performances of these cameras. Finally, the test facilities, the test methods and results of SiPMs in the cameras are reported here.
△ Less
Submitted 4 July, 2021; v1 submitted 29 December, 2020;
originally announced December 2020.
-
A Locational Marginal Pricing Mechanism for Uncertainty Management Based on Improved Multi-Ellipsoidal Uncertainty Set
Authors:
Zongzheng Zhao,
Yixin Liu,
Li Guo,
Linquan Bai,
Chengshan Wang
Abstract:
Large-scale integration of renewable energy sources (RES) brings huge challenges to the power system. A cost-effective reserve deployment and uncertainty pricing mechanism are critical to deal with the uncertainty and variability of RES. To this end, this paper proposes a novel locational marginal pricing mechanism in day-ahead market for managing uncertainties from RES. Firstly, an improved multi…
▽ More
Large-scale integration of renewable energy sources (RES) brings huge challenges to the power system. A cost-effective reserve deployment and uncertainty pricing mechanism are critical to deal with the uncertainty and variability of RES. To this end, this paper proposes a novel locational marginal pricing mechanism in day-ahead market for managing uncertainties from RES. Firstly, an improved multi-ellipsoidal uncertainty set (IMEUS) considering the temporal correlation and conditional correlation of wind power forecast is formulated to better capture the uncertainty of wind power. The dimension of each ellipsoidal subset is optimized based on a comprehensive evaluation index to reduce the invalid region without large loss of modeling accuracy, so as to reduce the conservatism. Then, an IMEUS-based robust unit commitment (RUC) model and a robust economic dispatch (RED) model are established for the day-ahead market clearing. Both the reserve cost and ramping constraints are considered in the overall dispatch process. Furthermore, based on the Langrangian function of the RED model, a new locational marginal pricing mechanism is developed. The uncertainty locational marginal price (ULMP) is introduced to charge the RES for its uncertainties and reward the generators who provide reserve to mitigate uncertainties. The new pricing mechanism can provide effective price signals to incentivize the uncertainty management in the day-ahead market. Finally, the effectiveness of the proposed methods is verified via numerous simulations on the PJM 5-bus system and IEEE 118-bus system.
△ Less
Submitted 15 December, 2020;
originally announced December 2020.
-
Predicting the Evolution of Photospheric Magnetic Field in Solar Active Regions Using Deep Learning
Authors:
Liang Bai,
Yi Bi,
Bo Yang,
Jun-Chao Hong,
Zhe Xu,
Zhen-Hong Shang,
Hui Liu,
Hai-Sheng Ji,
Kai-Fan Ji
Abstract:
The continuous observation of the magnetic field by Solar Dynamics Observatory (SDO)/Helioseismic and Magnetic Imager (HMI) produces numerous image sequences in time and space. These sequences provide data support for predicting the evolution of photospheric magnetic field. Based on the spatiotemporal long short-term memory(LSTM) network, we use the preprocessed data of photospheric magnetic field…
▽ More
The continuous observation of the magnetic field by Solar Dynamics Observatory (SDO)/Helioseismic and Magnetic Imager (HMI) produces numerous image sequences in time and space. These sequences provide data support for predicting the evolution of photospheric magnetic field. Based on the spatiotemporal long short-term memory(LSTM) network, we use the preprocessed data of photospheric magnetic field in active regions to build a prediction model for magnetic field evolution. Because of the elaborate learning and memory mechanism, the trained model can characterize the inherent relationships contained in spatiotemporal features. The testing results of the prediction model indicate that (1) the prediction pattern learned by the model can be applied to predict the evolution of new magnetic field in the next 6 hour that have not been trained, and predicted results are roughly consistent with real observed magnetic field evolution in terms of large-scale structure and movement speed; (2) the performance of the model is related to the prediction time; the shorter the prediction time, the higher the accuracy of the predicted results; (3) the performance of the model is stable not only for active regions in the north and south but also for data in positive and negative regions. Detailed experimental results and discussions on magnetic flux emergence and magnetic neutral lines finally show that the proposed model could effectively predict the large-scale and short-term evolution of the photospheric magnetic field in active regions. Moreover, our study may provide a reference for the spatiotemporal prediction of other solar activities.
△ Less
Submitted 7 December, 2020;
originally announced December 2020.
-
Temporal-Channel Transformer for 3D Lidar-Based Video Object Detection in Autonomous Driving
Authors:
Zhenxun Yuan,
Xiao Song,
Lei Bai,
Wengang Zhou,
Zhe Wang,
Wanli Ouyang
Abstract:
The strong demand of autonomous driving in the industry has lead to strong interest in 3D object detection and resulted in many excellent 3D object detection algorithms. However, the vast majority of algorithms only model single-frame data, ignoring the temporal information of the sequence of data. In this work, we propose a new transformer, called Temporal-Channel Transformer, to model the spatia…
▽ More
The strong demand of autonomous driving in the industry has lead to strong interest in 3D object detection and resulted in many excellent 3D object detection algorithms. However, the vast majority of algorithms only model single-frame data, ignoring the temporal information of the sequence of data. In this work, we propose a new transformer, called Temporal-Channel Transformer, to model the spatial-temporal domain and channel domain relationships for video object detecting from Lidar data. As a special design of this transformer, the information encoded in the encoder is different from that in the decoder, i.e. the encoder encodes temporal-channel information of multiple frames while the decoder decodes the spatial-channel information for the current frame in a voxel-wise manner. Specifically, the temporal-channel encoder of the transformer is designed to encode the information of different channels and frames by utilizing the correlation among features from different channels and frames. On the other hand, the spatial decoder of the transformer will decode the information for each location of the current frame. Before conducting the object detection with detection head, the gate mechanism is deployed for re-calibrating the features of current frame, which filters out the object irrelevant information by repetitively refine the representation of target frame along with the up-sampling process. Experimental results show that we achieve the state-of-the-art performance in grid voxel-based 3D object detection on the nuScenes benchmark.
△ Less
Submitted 27 November, 2020;
originally announced November 2020.
-
Two-dimensional Bhattacharyya bound linear discriminant analysis with its applications
Authors:
Yan-Ru Guo,
Yan-Qin Bai,
Chun-Na Li,
Lan Bai,
Yuan-Hai Shao
Abstract:
Recently proposed L2-norm linear discriminant analysis criterion via the Bhattacharyya error bound estimation (L2BLDA) is an effective improvement of linear discriminant analysis (LDA) for feature extraction. However, L2BLDA is only proposed to cope with vector input samples. When facing with two-dimensional (2D) inputs, such as images, it will lose some useful information, since it does not consi…
▽ More
Recently proposed L2-norm linear discriminant analysis criterion via the Bhattacharyya error bound estimation (L2BLDA) is an effective improvement of linear discriminant analysis (LDA) for feature extraction. However, L2BLDA is only proposed to cope with vector input samples. When facing with two-dimensional (2D) inputs, such as images, it will lose some useful information, since it does not consider intrinsic structure of images. In this paper, we extend L2BLDA to a two-dimensional Bhattacharyya bound linear discriminant analysis (2DBLDA). 2DBLDA maximizes the matrix-based between-class distance which is measured by the weighted pairwise distances of class means and meanwhile minimizes the matrix-based within-class distance. The weighting constant between the between-class and within-class terms is determined by the involved data that makes the proposed 2DBLDA adaptive. In addition, the criterion of 2DBLDA is equivalent to optimizing an upper bound of the Bhattacharyya error. The construction of 2DBLDA makes it avoid the small sample size problem while also possess robustness, and can be solved through a simple standard eigenvalue decomposition problem. The experimental results on image recognition and face image reconstruction demonstrate the effectiveness of the proposed methods.
△ Less
Submitted 10 November, 2020;
originally announced November 2020.
-
Cross-Supervised Joint-Event-Extraction with Heterogeneous Information Networks
Authors:
Yue Wang,
Zhuo Xu,
Lu Bai,
Yao Wan,
Lixin Cui,
Qian Zhao,
Edwin R. Hancock,
Philip S. Yu
Abstract:
Joint-event-extraction, which extracts structural information (i.e., entities or triggers of events) from unstructured real-world corpora, has attracted more and more research attention in natural language processing. Most existing works do not fully address the sparse co-occurrence relationships between entities and triggers, which loses this important information and thus deteriorates the extrac…
▽ More
Joint-event-extraction, which extracts structural information (i.e., entities or triggers of events) from unstructured real-world corpora, has attracted more and more research attention in natural language processing. Most existing works do not fully address the sparse co-occurrence relationships between entities and triggers, which loses this important information and thus deteriorates the extraction performance. To mitigate this issue, we first define the joint-event-extraction as a sequence-to-sequence labeling task with a tag set composed of tags of triggers and entities. Then, to incorporate the missing information in the aforementioned co-occurrence relationships, we propose a Cross-Supervised Mechanism (CSM) to alternately supervise the extraction of either triggers or entities based on the type distribution of each other. Moreover, since the connected entities and triggers naturally form a heterogeneous information network (HIN), we leverage the latent pattern along meta-paths for a given corpus to further improve the performance of our proposed method. To verify the effectiveness of our proposed method, we conduct extensive experiments on four real-world datasets as well as compare our method with state-of-the-art methods. Empirical results and analysis show that our approach outperforms the state-of-the-art methods in both entity and trigger extraction.
△ Less
Submitted 13 October, 2020; v1 submitted 13 October, 2020;
originally announced October 2020.
-
The observation of the Crab Nebula with LHAASO-KM2A for the performance study
Authors:
F. Aharonian,
Q. An,
Axikegu,
L. X. Bai,
Y. X. Bai,
Y. W. Bao,
D. Bastieri,
X. J. Bi,
Y. J. Bi,
H. Cai,
J. T. Cai,
Z. Cao,
Z. Cao,
J. Chang,
J. F. Chang,
X. C. Chang,
B. M. Chen,
J. Chen,
L. Chen,
L. Chen,
L. Chen,
M. J. Chen,
M. L. Chen,
Q. H. Chen,
S. H. Chen
, et al. (234 additional authors not shown)
Abstract:
As a sub-array of the Large High Altitude Air Shower Observatory (LHAASO), KM2A is mainly designed to cover a large fraction of the northern sky to hunt for gamma-ray sources at energies above 10 TeV. Even though the detector construction is still underway, a half of the KM2A array has been operating stably since the end of 2019. In this paper, we present the pipeline of KM2A data analysis and the…
▽ More
As a sub-array of the Large High Altitude Air Shower Observatory (LHAASO), KM2A is mainly designed to cover a large fraction of the northern sky to hunt for gamma-ray sources at energies above 10 TeV. Even though the detector construction is still underway, a half of the KM2A array has been operating stably since the end of 2019. In this paper, we present the pipeline of KM2A data analysis and the first observation on the Crab Nebula, a standard candle in very high energy gamma-ray astronomy. We detect gamma-ray signals from the Crab Nebula in both energy ranges of 10$-$100 TeV and $>$100 TeV with high significance, by analyzing the KM2A data of 136 live days between December 2019 and May 2020. With the observations, we test the detector performance including angular resolution, pointing accuracy and cosmic ray background rejection power.
The energy spectrum of the Crab Nebula in the energy range 10-250 TeV fits well with a single power-law function dN/dE =(1.13$\pm$0.05$_{stat}$$\pm$0.08$_{sys}$)$\times$10$^{-14}$$\cdot$(E/20TeV)$^{-3.09\pm0.06_{stat}\pm0.02_{sys}}$ cm$^{-2}$ s$^{-1}$ TeV$^{-1}$. It is consistent with previous measurements by other experiments. This opens a new window of gamma-ray astronomy above 0.1 PeV through which ultrahigh-energy gamma-ray new phenomena, such as cosmic PeVatrons, might be discovered.
△ Less
Submitted 13 October, 2020;
originally announced October 2020.
-
Novel Visible Light Communication Assisted Perspective-Four-Line Algorithm for Indoor Localization
Authors:
Lin Bai
Abstract:
In this paper, we propose a novel visible light communication (VLC) assisted Perspective-fourLine algorithm (V-P4L) for practical indoor localization. The basic idea of V-P4L is to joint VLC and computer vision to achieve high accuracy regardless of LED height differences. In particular, we first exploit the space-domain information to estimate the orientation and coordinate of a single rectangula…
▽ More
In this paper, we propose a novel visible light communication (VLC) assisted Perspective-fourLine algorithm (V-P4L) for practical indoor localization. The basic idea of V-P4L is to joint VLC and computer vision to achieve high accuracy regardless of LED height differences. In particular, we first exploit the space-domain information to estimate the orientation and coordinate of a single rectangular LED luminaire in the camera coordinate system based on the plane and solid geometry. Then, based on the time-domain information transmitted by VLC and the estimated luminaire information, V-P4L can estimate the position and pose of the camera by the single-view geometry theory and the linear least square (LLS) method. To further mitigate the effect of height differences among LEDs on localization accuracy, we then propose a correction algorithm of V-P4L based on the LLS method and a simple optimization method. Due to the combination of time- and space-domain information, V-P4L only requires a single luminaire for localization without limitation on the correspondences between the features and their projections. Simulation results show that for V-P4L the position error is always less than 15 cm and the orientation error is always less than 3° using popular indoor luminaires.
△ Less
Submitted 25 September, 2020;
originally announced September 2020.
-
Knowledge Adaption for Demand Prediction based on Multi-task Memory Neural Network
Authors:
Can Li,
Lei Bai,
Wei Liu,
Lina Yao,
S Travis Waller
Abstract:
Accurate demand forecasting of different public transport modes(e.g., buses and light rails) is essential for public service operation.However, the development level of various modes often varies sig-nificantly, which makes it hard to predict the demand of the modeswith insufficient knowledge and sparse station distribution (i.e.,station-sparse mode). Intuitively, different public transit modes ma…
▽ More
Accurate demand forecasting of different public transport modes(e.g., buses and light rails) is essential for public service operation.However, the development level of various modes often varies sig-nificantly, which makes it hard to predict the demand of the modeswith insufficient knowledge and sparse station distribution (i.e.,station-sparse mode). Intuitively, different public transit modes mayexhibit shared demand patterns temporally and spatially in a city.As such, we propose to enhance the demand prediction of station-sparse modes with the data from station-intensive mode and designaMemory-Augmented Multi-taskRecurrent Network (MATURE)to derive the transferable demand patterns from each mode andboost the prediction of station-sparse modes through adaptingthe relevant patterns from the station-intensive mode. Specifically,MATUREcomprises three components: 1) a memory-augmentedrecurrent network for strengthening the ability to capture the long-short term information and storing temporal knowledge of eachtransit mode; 2) a knowledge adaption module to adapt the rele-vant knowledge from a station-intensive source to station-sparsesources; 3) a multi-task learning framework to incorporate all theinformation and forecast the demand of multiple modes jointly.The experimental results on a real-world dataset covering four pub-lic transport modes demonstrate that our model can promote thedemand forecasting performance for the station-sparse modes.
△ Less
Submitted 12 September, 2020;
originally announced September 2020.
-
Face to Purchase: Predicting Consumer Choices with Structured Facial and Behavioral Traits Embedding
Authors:
Zhe Liu,
Xianzhi Wang,
Lina Yao,
Jake An,
Lei Bai,
Ee-Peng Lim
Abstract:
Predicting consumers' purchasing behaviors is critical for targeted advertisement and sales promotion in e-commerce. Human faces are an invaluable source of information for gaining insights into consumer personality and behavioral traits. However, consumer's faces are largely unexplored in previous research, and the existing face-related studies focus on high-level features such as personality tra…
▽ More
Predicting consumers' purchasing behaviors is critical for targeted advertisement and sales promotion in e-commerce. Human faces are an invaluable source of information for gaining insights into consumer personality and behavioral traits. However, consumer's faces are largely unexplored in previous research, and the existing face-related studies focus on high-level features such as personality traits while neglecting the business significance of learning from facial data. We propose to predict consumers' purchases based on their facial features and purchasing histories. We design a semi-supervised model based on a hierarchical embedding network to extract high-level features of consumers and to predict the top-$N$ purchase destinations of a consumer. Our experimental results on a real-world dataset demonstrate the positive effect of incorporating facial information in predicting consumers' purchasing behaviors.
△ Less
Submitted 14 July, 2020;
originally announced July 2020.
-
Spectrum-Guided Adversarial Disparity Learning
Authors:
Zhe Liu,
Lina Yao,
Lei Bai,
Xianzhi Wang,
Can Wang
Abstract:
It has been a significant challenge to portray intraclass disparity precisely in the area of activity recognition, as it requires a robust representation of the correlation between subject-specific variation for each activity class. In this work, we propose a novel end-to-end knowledge directed adversarial learning framework, which portrays the class-conditioned intraclass disparity using two comp…
▽ More
It has been a significant challenge to portray intraclass disparity precisely in the area of activity recognition, as it requires a robust representation of the correlation between subject-specific variation for each activity class. In this work, we propose a novel end-to-end knowledge directed adversarial learning framework, which portrays the class-conditioned intraclass disparity using two competitive encoding distributions and learns the purified latent codes by denoising learned disparity. Furthermore, the domain knowledge is incorporated in an unsupervised manner to guide the optimization and further boosts the performance. The experiments on four HAR benchmark datasets demonstrate the robustness and generalization of our proposed methods over a set of state-of-the-art. We further prove the effectiveness of automatic domain knowledge incorporation in performance enhancement.
△ Less
Submitted 14 July, 2020;
originally announced July 2020.
-
Adaptive Graph Convolutional Recurrent Network for Traffic Forecasting
Authors:
Lei Bai,
Lina Yao,
Can Li,
Xianzhi Wang,
Can Wang
Abstract:
Modeling complex spatial and temporal correlations in the correlated time series data is indispensable for understanding the traffic dynamics and predicting the future status of an evolving traffic system. Recent works focus on designing complicated graph neural network architectures to capture shared patterns with the help of pre-defined graphs. In this paper, we argue that learning node-specific…
▽ More
Modeling complex spatial and temporal correlations in the correlated time series data is indispensable for understanding the traffic dynamics and predicting the future status of an evolving traffic system. Recent works focus on designing complicated graph neural network architectures to capture shared patterns with the help of pre-defined graphs. In this paper, we argue that learning node-specific patterns is essential for traffic forecasting while the pre-defined graph is avoidable. To this end, we propose two adaptive modules for enhancing Graph Convolutional Network (GCN) with new capabilities: 1) a Node Adaptive Parameter Learning (NAPL) module to capture node-specific patterns; 2) a Data Adaptive Graph Generation (DAGG) module to infer the inter-dependencies among different traffic series automatically. We further propose an Adaptive Graph Convolutional Recurrent Network (AGCRN) to capture fine-grained spatial and temporal correlations in traffic series automatically based on the two modules and recurrent networks. Our experiments on two real-world traffic datasets show AGCRN outperforms state-of-the-art by a significant margin without pre-defined graphs about spatial connections.
△ Less
Submitted 21 October, 2020; v1 submitted 6 July, 2020;
originally announced July 2020.
-
DepthNet: Real-Time LiDAR Point Cloud Depth Completion for Autonomous Vehicles
Authors:
Lin Bai,
Yiming Zhao,
Mahdi Elhousni,
Xinming Huang
Abstract:
Autonomous vehicles rely heavily on sensors such as camera and LiDAR, which provide real-time information about their surroundings for the tasks of perception, planning and control. Typically a LiDAR can only provide sparse point cloud owing to a limited number of scanning lines. By employing depth completion, a dense depth map can be generated by assigning each camera pixel a corresponding depth…
▽ More
Autonomous vehicles rely heavily on sensors such as camera and LiDAR, which provide real-time information about their surroundings for the tasks of perception, planning and control. Typically a LiDAR can only provide sparse point cloud owing to a limited number of scanning lines. By employing depth completion, a dense depth map can be generated by assigning each camera pixel a corresponding depth value. However, the existing depth completion convolutional neural networks are very complex that requires high-end GPUs for processing, and thus they are not applicable to real-time autonomous driving. In this paper, a light-weight network is proposed for the task of LiDAR point cloud depth completion. With an astonishing 96.2% reduction in the number of parameters, it still achieves comparable performance (9.3% better in MAE but 3.9% worse in RMSE) to the state-of-the-art network. For real-time embedded platforms, depthwise separable technique is applied to both convolution and deconvolution operations and the number of parameters decreases further by a factor of 7.3, with only a small percentage increase in RMSE and MAE performance. Moreover, a system-on-chip architecture for depth completion is developed on a PYNQ-based FPGA platform that achieves real-time processing for HDL-64E LiDAR at the speed 11.1 frame per second.
△ Less
Submitted 5 July, 2020;
originally announced July 2020.
-
Study of Charge Radii with Neural Networks
Authors:
Di Wu,
C. L. Bai,
H. Sagawa,
H. Q. Zhang
Abstract:
A feed-forward neural network model is trained to calculate the nuclear charge radii. The model trained with input data set of proton and neutron number $Z,N$, the electric quadrupole transition strength $B(E2)$ from the first excited 2$^+$ state to the ground state, together with the symmetry energy. The model reproduces well not only the isotope dependence of charge radii, but also the kinks of…
▽ More
A feed-forward neural network model is trained to calculate the nuclear charge radii. The model trained with input data set of proton and neutron number $Z,N$, the electric quadrupole transition strength $B(E2)$ from the first excited 2$^+$ state to the ground state, together with the symmetry energy. The model reproduces well not only the isotope dependence of charge radii, but also the kinks of charge radii at the neutron magic numbers $N=82$ for Sn and Sm isotopes, and also $N=126$ for Pb isotopes. The important role of $B(E2)$ value is pointed out to reproduce the kink of the isotope dependence of charge radii in these nuclei. Moreover, with the inclusion of the symmetry energy term in the inputs, the charge radii of Ca isotopes are well reproduced. This result suggests a new correlation between the symmetry energy and charge radii of Ca isotopes. The Skyrme HFB calculation is performed to confirm the existence of this correlation in a microscopic model.
△ Less
Submitted 17 June, 2020;
originally announced June 2020.
-
Multiagent Reinforcement Learning based Energy Beamforming Control
Authors:
Liping Bai,
Zhongqiang Pang
Abstract:
Ultra low power devices make far-field wireless power transfer a viable option for energy delivery despite the exponential attenuation. Electromagnetic beams are constructed from the stations such that wireless energy is directionally concentrated around the ultra low power devices. Energy beamforming faces different challenges compare to information beamforming due to the lack of feedback on chan…
▽ More
Ultra low power devices make far-field wireless power transfer a viable option for energy delivery despite the exponential attenuation. Electromagnetic beams are constructed from the stations such that wireless energy is directionally concentrated around the ultra low power devices. Energy beamforming faces different challenges compare to information beamforming due to the lack of feedback on channel state. Various methods have been proposed such as one-bit channel feedback to enhance energy beamforming capacity, yet it still has considerable computation overhead and need to be computed centrally. Valuable resources and time is wasted on transfering control information back and forth. In this paper, we propose a novel multiagent reinforcement learning(MARL) formulation for codebook based beamforming control. It takes advantage of the inherienntly distributed structure in a wirelessly powered network and lay the ground work for fully locally computed beam control algorithms. Source code can be found at https://github.com/BaiLiping/WirelessPowerTransfer.
△ Less
Submitted 15 June, 2020;
originally announced June 2020.
-
RoadNet-RT: High Throughput CNN Architecture and SoC Design for Real-Time Road Segmentation
Authors:
Lin Bai,
Yecheng Lyu,
Xinming Huang
Abstract:
In recent years, convolutional neural network has gained popularity in many engineering applications especially for computer vision. In order to achieve better performance, often more complex structures and advanced operations are incorporated into the neural networks, which results very long inference time. For time-critical tasks such as autonomous driving and virtual reality, real-time processi…
▽ More
In recent years, convolutional neural network has gained popularity in many engineering applications especially for computer vision. In order to achieve better performance, often more complex structures and advanced operations are incorporated into the neural networks, which results very long inference time. For time-critical tasks such as autonomous driving and virtual reality, real-time processing is fundamental. In order to reach real-time process speed, a light-weight, high-throughput CNN architecture namely RoadNet-RT is proposed for road segmentation in this paper. It achieves 90.33% MaxF score on test set of KITTI road segmentation task and 8 ms per frame when running on GTX 1080 GPU. Comparing to the state-of-the-art network, RoadNet-RT speeds up the inference time by a factor of 20 at the cost of only 6.2% accuracy loss. For hardware design optimization, several techniques such as depthwise separable convolution and non-uniformed kernel size convolution are customized designed to further reduce the processing time. The proposed CNN architecture has been successfully implemented on an FPGA ZCU102 MPSoC platform that achieves the computation capability of 83.05 GOPS. The system throughput reaches 327.9 frames per second with image size 1216x176.
△ Less
Submitted 17 May, 2021; v1 submitted 13 June, 2020;
originally announced June 2020.
-
Exploring open cluster properties with Gaia and LAMOST
Authors:
Jing Zhong,
Li Chen,
Di Wu,
Lu Li,
Leya Bai,
Jinliang Hou
Abstract:
In Gaia DR2, the unprecedented high-precision level reached in sub-mas for astrometry and mmag for photometry. Using cluster members identified with these astrometry and photometry in Gaia DR2, we can obtain a reliable determination of cluster properties. However, because of the shortcoming of Gaia spectroscopic observation in dealing with densely crowded cluster region, the number of radial veloc…
▽ More
In Gaia DR2, the unprecedented high-precision level reached in sub-mas for astrometry and mmag for photometry. Using cluster members identified with these astrometry and photometry in Gaia DR2, we can obtain a reliable determination of cluster properties. However, because of the shortcoming of Gaia spectroscopic observation in dealing with densely crowded cluster region, the number of radial velocity and metallicity for cluster member stars from Gaia DR2 is still lacking. In this study, we aim to improve the cluster properties by combining the LAMOST spectra. In particular, we provide the list of cluster members with spectroscopic parameters as an add-value catalog in LAMOST DR5, which can be used to perform detailed study for a better understanding on the stellar properties, by using their spectra and fundamental properties from the host cluster. We cross-matched the spectroscopic catalog in LAMOST DR5 with the identified cluster members in Cantat-Gaudin et al.2018 and then used members with spectroscopic parameters to derive statistical properties of open clusters. We obtained a list of 8811 members with spectroscopic parameters and a catalog of 295 cluster properties. In addition, we study the radial and vertical metallicity gradient and age-metallicity relation with the compiled open clusters as tracers, finding slopes of -0.053$\pm$0.004 dex kpc$^{-1}$, -0.252$\pm$0.039 dex kpc$^{-1}$ and 0.022$\pm$0.008 dex Gyr$^{-1}$, respectively. Both slopes of metallicity distribution relation for young clusters (0.1 Gyr < Age < 2 Gyr) and the age-metallicity relation for clusters within 6 Gyr are consistent with literature results. In order to fully study the chemical evolution history in the disk, more spectroscopic observations for old and distant open clusters are needed for further investigation.
△ Less
Submitted 15 June, 2020; v1 submitted 11 June, 2020;
originally announced June 2020.
-
A Unified Hardware Architecture for Convolutions and Deconvolutions in CNN
Authors:
Lin Bai,
Yecheng Lyu,
Xinming Huang
Abstract:
In this paper, a scalable neural network hardware architecture for image segmentation is proposed. By sharing the same computing resources, both convolution and deconvolution operations are handled by the same process element array. In addition, access to on-chip and off-chip memories is optimized to alleviate the burden introduced by partial sum. As an example, SegNet-Basic has been implemented u…
▽ More
In this paper, a scalable neural network hardware architecture for image segmentation is proposed. By sharing the same computing resources, both convolution and deconvolution operations are handled by the same process element array. In addition, access to on-chip and off-chip memories is optimized to alleviate the burden introduced by partial sum. As an example, SegNet-Basic has been implemented using the proposed unified architecture by targeting on Xilinx ZC706 FPGA, which achieves the performance of 151.5 GOPS and 94.3 GOPS for convolution and deconvolution respectively. This unified convolution/deconvolution design is applicable to other CNNs with deconvolution.
△ Less
Submitted 29 May, 2020;
originally announced June 2020.
-
PointNet on FPGA for Real-Time LiDAR Point Cloud Processing
Authors:
Lin Bai,
Yecheng Lyu,
Xin Xu,
Xinming Huang
Abstract:
LiDAR sensors have been widely used in many autonomous vehicle modalities, such as perception, mapping, and localization. This paper presents an FPGA-based deep learning platform for real-time point cloud processing targeted on autonomous vehicles. The software driver for the Velodyne LiDAR sensor is modified and moved into the on-chip processor system, while the programmable logic is designed as…
▽ More
LiDAR sensors have been widely used in many autonomous vehicle modalities, such as perception, mapping, and localization. This paper presents an FPGA-based deep learning platform for real-time point cloud processing targeted on autonomous vehicles. The software driver for the Velodyne LiDAR sensor is modified and moved into the on-chip processor system, while the programmable logic is designed as a customized hardware accelerator. As the state-of-art deep learning algorithm for point cloud processing, PointNet is successfully implemented on the proposed FPGA platform. Targeted on a Xilinx Zynq UltraScale+ MPSoC ZCU104 development board, the FPGA implementations of PointNet achieve the computing performance of 182.1 GOPS and 280.0 GOPS for classification and segmentation respectively. The proposed design can support an input up to 4096 points per frame. The processing time is 19.8 ms for classification and 34.6 ms for segmentation, which meets the real-time requirement for most of the existing LiDAR sensors.
△ Less
Submitted 29 May, 2020;
originally announced June 2020.
-
Angle-Dependent Phase Shifter Model for Reconfigurable Intelligent Surfaces: Does the Angle-Reciprocity Hold?
Authors:
Weicong Chen,
Lin Bai,
Wankai Tang,
Shi Jin,
Wei Xiang Jiang,
Tie Jun Cui
Abstract:
The existing phase shifter models adopted for reconfigurable intelligent surfaces (RISs) have ignored the electromagnetic (EM) waves propagation behavior, thus cannot reveal practical effects of RIS on wireless communication systems. Based on the equivalent circuit, this paper introduces an angle-dependent phase shifter model for varactor-based RISs. To the best of our knowledge, this is the first…
▽ More
The existing phase shifter models adopted for reconfigurable intelligent surfaces (RISs) have ignored the electromagnetic (EM) waves propagation behavior, thus cannot reveal practical effects of RIS on wireless communication systems. Based on the equivalent circuit, this paper introduces an angle-dependent phase shifter model for varactor-based RISs. To the best of our knowledge, this is the first phase shifter model which reveals that the incident angle of EM waves has influence on the reflection coefficient of RIS. In addition, the angle-reciprocity on RIS is investigated and further proved to be tenable when the reflection phase difference of adjacent RIS unit cells is invariant for an impinging EM wave and its reverse incident one. The angle-dependent characteristic of RIS is verified through full-wave simulation. According to our analysis and the simulation results, we find that the angle-reciprocity of varactor-based RIS only holds under small incident angles of both forward and reverse incident EM waves, thus limits the channel reciprocity in RIS-assisted TDD systems.
△ Less
Submitted 8 May, 2020;
originally announced May 2020.
-
A Novel Received Signal Strength Assisted Perspective-three-Point Algorithm for Indoor Visible Light Positioning
Authors:
Lin Bai,
Yang Yang,
Chunyan Feng,
Caili Guo
Abstract:
In this paper, a received signal strength assisted Perspective-three-Point positioning algorithm (R-P3P) is proposed for visible light positioning (VLP) systems. The basic idea of R-P3P is to joint visual and strength information to estimate the receiver position using 3 LEDs regardless of the LEDs' orientations. R-P3P first utilizes visual information captured by the camera to estimate the incide…
▽ More
In this paper, a received signal strength assisted Perspective-three-Point positioning algorithm (R-P3P) is proposed for visible light positioning (VLP) systems. The basic idea of R-P3P is to joint visual and strength information to estimate the receiver position using 3 LEDs regardless of the LEDs' orientations. R-P3P first utilizes visual information captured by the camera to estimate the incidence angles of visible lights. Then, R-P3P calculates the candidate distances between the LEDs and the receiver based on the law of cosines and the Wu-Ritt's zero decomposition method. Based on the incidence angles, the candidate distances and the physical characteristics of the LEDs, R-P3P can select the exact distances from all the candidate distances. Finally, the linear least square (LLS) method is employed to estimate the position of the receiver. Due to the combination of visual and strength information of visible light signals, R-P3P can achieve high accuracy using 3 LEDs regardless of the LEDs' orientations. Simulation results show that R-P3P can achieve positioning accuracy within 10 cm over 70% indoor area with low complexity regardless of LEDs orientations.
△ Less
Submitted 21 May, 2020;
originally announced May 2020.
-
A Learning-from-noise Dilated Wide Activation Network for denoising Arterial Spin Labeling (ASL) Perfusion Images
Authors:
Danfeng Xie,
Yiran Li,
Hanlu Yang,
Li Bai,
Lei Zhang,
Ze Wang
Abstract:
Arterial spin labeling (ASL) perfusion MRI provides a non-invasive way to quantify cerebral blood flow (CBF) but it still suffers from a low signal-to-noise-ratio (SNR). Using deep machine learning (DL), several groups have shown encouraging denoising results. Interestingly, the improvement was obtained when the deep neural network was trained using noise-contaminated surrogate reference because o…
▽ More
Arterial spin labeling (ASL) perfusion MRI provides a non-invasive way to quantify cerebral blood flow (CBF) but it still suffers from a low signal-to-noise-ratio (SNR). Using deep machine learning (DL), several groups have shown encouraging denoising results. Interestingly, the improvement was obtained when the deep neural network was trained using noise-contaminated surrogate reference because of the lack of golden standard high quality ASL CBF images. More strikingly, the output of these DL ASL networks (ASLDN) showed even higher SNR than the surrogate reference. This phenomenon indicates a learning-from-noise capability of deep networks for ASL CBF image denoising, which can be further enhanced by network optimization. In this study, we proposed a new ASLDN to test whether similar or even better ASL CBF image quality can be achieved in the case of highly noisy training reference. Different experiments were performed to validate the learning-from-noise hypothesis. The results showed that the learning-from-noise strategy produced better output quality than ASLDN trained with relatively high SNR reference.
△ Less
Submitted 15 May, 2020;
originally announced May 2020.
-
Are You A Risk Taker? Adversarial Learning of Asymmetric Cross-Domain Alignment for Risk Tolerance Prediction
Authors:
Zhe Liu,
Lina Yao,
Xianzhi Wang,
Lei Bai,
Jake An
Abstract:
Most current studies on survey analysis and risk tolerance modelling lack professional knowledge and domain-specific models. Given the effectiveness of generative adversarial learning in cross-domain information, we design an Asymmetric cross-Domain Generative Adversarial Network (ADGAN) for domain scale inequality. ADGAN utilizes the information-sufficient domain to provide extra information to i…
▽ More
Most current studies on survey analysis and risk tolerance modelling lack professional knowledge and domain-specific models. Given the effectiveness of generative adversarial learning in cross-domain information, we design an Asymmetric cross-Domain Generative Adversarial Network (ADGAN) for domain scale inequality. ADGAN utilizes the information-sufficient domain to provide extra information to improve the representation learning on the information-insufficient domain via domain alignment. We provide data analysis and user model on two data sources: Consumer Consumption Information and Survey Information. We further test ADGAN on a real-world dataset with view embedding structures and show ADGAN can better deal with the class imbalance and unqualified data space than state-of-the-art, demonstrating the effectiveness of leveraging asymmetrical domain information.
△ Less
Submitted 18 April, 2020;
originally announced April 2020.
-
Minimizing the Ruin Probability under the Sparre Andersen Model
Authors:
Linlin Tian,
Lihua Bai
Abstract:
In this paper, we consider the problem of minimizing the ruin probability of an insurance company in which the surplus process follows the Sparre Andersen model. Similar to Bai et al. \cite{bai2017optimal}, we recast this problem in a Markovian framework by adding another dimension representing the time elapsed since the last claim. After Markovization, We investigate the regularity properties of…
▽ More
In this paper, we consider the problem of minimizing the ruin probability of an insurance company in which the surplus process follows the Sparre Andersen model. Similar to Bai et al. \cite{bai2017optimal}, we recast this problem in a Markovian framework by adding another dimension representing the time elapsed since the last claim. After Markovization, We investigate the regularity properties of the value function and state the dynamic programming principle. Furthermore, we show that the value function is the unique constrained viscosity solution to the associated Hamilton-Jacobi-Bellman equation. It should be noted that there is no discount factor in our paper, which makes it tricky to prove the uniqueness. To overcome this difficulty, we construct the strict viscosity supersolution. Then instead of comparing the usual viscosity supersolution and subsolution, we compare the supersolution and the strict subsolution. Eventually we show that all viscosity subsolution is less than the supersolution.
△ Less
Submitted 17 April, 2020;
originally announced April 2020.
-
A High Coverage Camera Assisted Received Signal Strength Ratio Algorithm for Indoor Visible Light Positioning
Authors:
Lin Bai,
Yang Yang,
Chunyan Feng,
Caili Guo,
Julian Cheng
Abstract:
In this paper, a high coverage algorithm termed enhanced camera assisted received signal strength ratio (eCA-RSSR) positioning algorithm is proposed for visible light positioning (VLP) systems. The basic idea of eCA-RSSR is to utilize visual information captured by the camera to estimate the incidence angles of visible lights first. Based on the incidence angles, eCA-RSSR utilizes the received sig…
▽ More
In this paper, a high coverage algorithm termed enhanced camera assisted received signal strength ratio (eCA-RSSR) positioning algorithm is proposed for visible light positioning (VLP) systems. The basic idea of eCA-RSSR is to utilize visual information captured by the camera to estimate the incidence angles of visible lights first. Based on the incidence angles, eCA-RSSR utilizes the received signal strength ratio (RSSR) calculated by the photodiode (PD) to estimate the ratios of the distances between the LEDs and the receiver. Based on an Euclidean plane geometry theorem, eCA-RSSR transforms the ratios of the distances into the absolute values. In this way, eCA-RSSR only requires 3 LEDs for both orientation-free 2D and 3D positioning, implying that eCA-RSSR can achieve high coverage. Based on the absolute values of the distances, the linear least square method is employed to estimate the position of the receiver. Therefore, for the receiver having a small distance between the PD and the camera, the accuracy of eCA-RSSR does not depend on the starting values of the non-linear least square method and the complexity of eCA-RSSR is low. Furthermore, since the distance between the PD and camera can significantly affect the performance of eCA-RSSR, we further propose a compensation algorithm for eCA-RSSR based on the single-view geometry. Simulation results show that eCA-RSSR can achieve centimeter-level accuracy over 80% indoor area for both the receivers having a small and a large distance between the PD and the camera.
△ Less
Submitted 13 April, 2020;
originally announced April 2020.
-
On the Generalized Cluster Algebras of Geometric Type
Authors:
Liqian Bai,
Xueqing Chen,
Ming Ding,
Fan Xu
Abstract:
We develop and prove the analogs of some results shown in [Berenstein A., Fomin S., Zelevinsky A., Duke Math. J. 126 (2005), 1-52] concerning lower and upper bounds of cluster algebras to the generalized cluster algebras of geometric type. We show that lower bounds coincide with upper bounds under the conditions of acyclicity and coprimality. Consequently, we obtain the standard monomial bases of…
▽ More
We develop and prove the analogs of some results shown in [Berenstein A., Fomin S., Zelevinsky A., Duke Math. J. 126 (2005), 1-52] concerning lower and upper bounds of cluster algebras to the generalized cluster algebras of geometric type. We show that lower bounds coincide with upper bounds under the conditions of acyclicity and coprimality. Consequently, we obtain the standard monomial bases of these generalized cluster algebras. Moreover, in the appendix, we prove that an acyclic generalized cluster algebra is equal to the corresponding generalized upper cluster algebra without the assumption of the existence of coprimality.
△ Less
Submitted 28 September, 2020; v1 submitted 31 March, 2020;
originally announced March 2020.
-
Laser Intensity Noise Suppression for Preparing Audio-Frequency 795 nm Squeezed Vacuum State of Light at Rubidium D1 Line
Authors:
Lele Bai,
Xin Wen,
Yulin Yang,
Jun He,
Junmin Wang
Abstract:
Laser intensity noise suppression has essential effects on preparation and characterization of the audio-frequency squeezed vacuum state of light based on a sub-threshold optical parametric oscillator (OPO).We have implemented two feedback loops by using relevant acousto-optical modulators (AOM) to stabilize the intensity of 795-nm near infrared (NIR) fundamental laser and 397.5-nm ultraviolet (UV…
▽ More
Laser intensity noise suppression has essential effects on preparation and characterization of the audio-frequency squeezed vacuum state of light based on a sub-threshold optical parametric oscillator (OPO).We have implemented two feedback loops by using relevant acousto-optical modulators (AOM) to stabilize the intensity of 795-nm near infrared (NIR) fundamental laser and 397.5-nm ultraviolet (UV) laser generated by cavity-enhanced frequency doubling.Typical peak-to-peak laser intensity fluctuation with a bandwidth of $\sim10$ kHz in a half hour has been improved from $\pm7.45$$\%$ to $\pm0.06$$\%$ for 795-nm NIR laser beam, and from $\pm9.04$$\%$ to $\pm0.05$$\%$ for 397.5-nm UV laser beam, respectively. The squeezing level of the squeezed vacuum state at 795 nm prepared by the sub-threshold OPO with a PPKTP crystal has been improved from -3.3 to -4.0 dB around 3$\sim$9 kHz of audio analysis frequency range.
△ Less
Submitted 10 March, 2020;
originally announced March 2020.
-
A Big Data Enabled Channel Model for 5G Wireless Communication Systems
Authors:
Jie Huang,
Cheng-Xiang Wang,
Lu Bai,
Jian Sun,
Yang Yang,
Jie Li,
Olav Tirkkonen,
Ming-Tuo Zhou
Abstract:
The standardization process of the fifth generation (5G) wireless communications has recently been accelerated and the first commercial 5G services would be provided as early as in 2018. The increasing of enormous smartphones, new complex scenarios, large frequency bands, massive antenna elements, and dense small cells will generate big datasets and bring 5G communications to the era of big data.…
▽ More
The standardization process of the fifth generation (5G) wireless communications has recently been accelerated and the first commercial 5G services would be provided as early as in 2018. The increasing of enormous smartphones, new complex scenarios, large frequency bands, massive antenna elements, and dense small cells will generate big datasets and bring 5G communications to the era of big data. This paper investigates various applications of big data analytics, especially machine learning algorithms in wireless communications and channel modeling. We propose a big data and machine learning enabled wireless channel model framework. The proposed channel model is based on artificial neural networks (ANNs), including feed-forward neural network (FNN) and radial basis function neural network (RBF-NN). The input parameters are transmitter (Tx) and receiver (Rx) coordinates, Tx-Rx distance, and carrier frequency, while the output parameters are channel statistical properties, including the received power, root mean square (RMS) delay spread (DS), and RMS angle spreads (ASs). Datasets used to train and test the ANNs are collected from both real channel measurements and a geometry based stochastic model (GBSM). Simulation results show good performance and indicate that machine learning algorithms can be powerful analytical tools for future measurement-based wireless channel modeling.
△ Less
Submitted 28 February, 2020;
originally announced February 2020.
-
Multiple Flat Projections for Cross-manifold Clustering
Authors:
Lan Bai,
Yuan-Hai Shao,
Wei-Jie Chen,
Zhen Wang,
Nai-Yang Deng
Abstract:
Cross-manifold clustering is a hard topic and many traditional clustering methods fail because of the cross-manifold structures. In this paper, we propose a Multiple Flat Projections Clustering (MFPC) to deal with cross-manifold clustering problems. In our MFPC, the given samples are projected into multiple subspaces to discover the global structures of the implicit manifolds. Thus, the cross-mani…
▽ More
Cross-manifold clustering is a hard topic and many traditional clustering methods fail because of the cross-manifold structures. In this paper, we propose a Multiple Flat Projections Clustering (MFPC) to deal with cross-manifold clustering problems. In our MFPC, the given samples are projected into multiple subspaces to discover the global structures of the implicit manifolds. Thus, the cross-manifold clusters are distinguished from the various projections. Further, our MFPC is extended to nonlinear manifold clustering via kernel tricks to deal with more complex cross-manifold clustering. A series of non-convex matrix optimization problems in MFPC are solved by a proposed recursive algorithm. The synthetic tests show that our MFPC works on the cross-manifold structures well. Moreover, experimental results on the benchmark datasets show the excellent performance of our MFPC compared with some state-of-the-art clustering methods.
△ Less
Submitted 16 February, 2020;
originally announced February 2020.
-
A Hierarchical Transitive-Aligned Graph Kernel for Un-attributed Graphs
Authors:
Lu Bai,
Lixin Cui,
Edwin R. Hancock
Abstract:
In this paper, we develop a new graph kernel, namely the Hierarchical Transitive-Aligned kernel, by transitively aligning the vertices between graphs through a family of hierarchical prototype graphs. Comparing to most existing state-of-the-art graph kernels, the proposed kernel has three theoretical advantages. First, it incorporates the locational correspondence information between graphs into t…
▽ More
In this paper, we develop a new graph kernel, namely the Hierarchical Transitive-Aligned kernel, by transitively aligning the vertices between graphs through a family of hierarchical prototype graphs. Comparing to most existing state-of-the-art graph kernels, the proposed kernel has three theoretical advantages. First, it incorporates the locational correspondence information between graphs into the kernel computation, and thus overcomes the shortcoming of ignoring structural correspondences arising in most R-convolution kernels. Second, it guarantees the transitivity between the correspondence information that is not available for most existing matching kernels. Third, it incorporates the information of all graphs under comparisons into the kernel computation process, and thus encapsulates richer characteristics. By transductively training the C-SVM classifier, experimental evaluations demonstrate the effectiveness of the new transitive-aligned kernel. The proposed kernel can outperform state-of-the-art graph kernels on standard graph-based datasets in terms of the classification accuracy.
△ Less
Submitted 8 February, 2020;
originally announced February 2020.