Showing 151–200 of 233 results for author: Qin, B

Sequential vessel segmentation via deep channel attention network

Authors: Dongdong Hao, Song Ding, Linwei Qiu, Yisong Lv, Baowei Fei, Yueqi Zhu, Binjie Qin

Abstract: This paper develops a novel encoder-decoder deep network architecture which exploits the several contextual frames of 2D+t sequential images in a sliding window centered at current frame to segment 2D vessel masks from the current frame. The architecture is equipped with temporal-spatial feature extraction in encoder stage, feature fusion in skip connection layers and channel attention mechanism i… ▽ More This paper develops a novel encoder-decoder deep network architecture which exploits the several contextual frames of 2D+t sequential images in a sliding window centered at current frame to segment 2D vessel masks from the current frame. The architecture is equipped with temporal-spatial feature extraction in encoder stage, feature fusion in skip connection layers and channel attention mechanism in decoder stage. In the encoder stage, a series of 3D convolutional layers are employed to hierarchically extract temporal-spatial features. Skip connection layers subsequently fuse the temporal-spatial feature maps and deliver them to the corresponding decoder stages. To efficiently discriminate vessel features from the complex and noisy backgrounds in the XCA images, the decoder stage effectively utilizes channel attention blocks to refine the intermediate feature maps from skip connection layers for subsequently decoding the refined features in 2D ways to produce the segmented vessel masks. Furthermore, Dice loss function is implemented to train the proposed deep network in order to tackle the class imbalance problem in the XCA data due to the wide distribution of complex background artifacts. Extensive experiments by comparing our method with other state-of-the-art algorithms demonstrate the proposed method's superior performance over other methods in terms of the quantitative metrics and visual validation. The source codes are at https://github.com/Binjie-Qin/SVS-net △ Less

Submitted 9 February, 2021; originally announced February 2021.

Comments: 14

Journal ref: Neural Networks, 2020

Dialogue Discourse-Aware Graph Model and Data Augmentation for Meeting Summarization

Authors: Xiachong Feng, Xiaocheng Feng, Bing Qin, Xinwei Geng

Abstract: Meeting summarization is a challenging task due to its dynamic interaction nature among multiple speakers and lack of sufficient training data. Existing methods view the meeting as a linear sequence of utterances while ignoring the diverse relations between each utterance. Besides, the limited labeled data further hinders the ability of data-hungry neural models. In this paper, we try to mitigate… ▽ More Meeting summarization is a challenging task due to its dynamic interaction nature among multiple speakers and lack of sufficient training data. Existing methods view the meeting as a linear sequence of utterances while ignoring the diverse relations between each utterance. Besides, the limited labeled data further hinders the ability of data-hungry neural models. In this paper, we try to mitigate the above challenges by introducing dialogue-discourse relations. First, we present a Dialogue Discourse-Dware Meeting Summarizer (DDAMS) to explicitly model the interaction between utterances in a meeting by modeling different discourse relations. The core module is a relational graph encoder, where the utterances and discourse relations are modeled in a graph interaction manner. Moreover, we devise a Dialogue Discourse-Aware Data Augmentation (DDADA) strategy to construct a pseudo-summarization corpus from existing input meetings, which is 20 times larger than the original dataset and can be used to pretrain DDAMS. Experimental results on AMI and ICSI meeting datasets show that our full system can achieve SOTA performance. Our codes will be available at: https://github.com/xcfcode/DDAMS. △ Less

Submitted 19 May, 2021; v1 submitted 7 December, 2020; originally announced December 2020.

Comments: IJCAI 2021

A Mechanical System Inspired Microscopic Traffic Model: Modeling, Analysis, and Validation

Authors: Mohammad R. Hajidavalloo, Zhaojian Li, Dong Chen, Ali Louati, Shuo Feng, Wubing B. Qin

Abstract: In this paper, we develop a mechanical system inspired microscopic traffic model to characterize the longitudinal interaction dynamics among a chain of vehicles. In particular, we extend our prior work on mass-spring-damper-clutch based car-following model between two vehicles to multi-vehicle scenario. This model can naturally capture the driver's tendency to maintain the same speed as the vehicl… ▽ More In this paper, we develop a mechanical system inspired microscopic traffic model to characterize the longitudinal interaction dynamics among a chain of vehicles. In particular, we extend our prior work on mass-spring-damper-clutch based car-following model between two vehicles to multi-vehicle scenario. This model can naturally capture the driver's tendency to maintain the same speed as the vehicle ahead while keeping a (speed-dependent) desired spacing. It is also capable of characterizing the impact of the following vehicle on the preceding vehicle, which is generally neglected in existing models. A new string stability criterion is defined for the considered multi-vehicle dynamics, and stability analysis is performed on the system parameters and time delays. An efficient online parameter identification algorithm, sequential recursive least squares with inverse QR decomposition (SRLS-IQR), is developed to estimate the driving-related model parameters. These real-time estimated parameters can be employed in advanced longitudinal control systems to enable accurate prediction of vehicle trajectories for improved safety and fuel efficiency. The proposed model and the parameter identification algorithm are validated on NGSIM, a naturalistic driving dataset, as well as our own connected vehicle driving data. Promising performance is demonstrated. △ Less

Submitted 5 December, 2020; originally announced December 2020.

Biomedical Knowledge Graph Refinement with Embedding and Logic Rules

Authors: Sendong Zhao, Bing Qin, Ting Liu, Fei Wang

Abstract: Currently, there is a rapidly increasing need for high-quality biomedical knowledge graphs (BioKG) that provide direct and precise biomedical knowledge. In the context of COVID-19, this issue is even more necessary to be highlighted. However, most BioKG construction inevitably includes numerous conflicts and noises deriving from incorrect knowledge descriptions in literature and defective informat… ▽ More Currently, there is a rapidly increasing need for high-quality biomedical knowledge graphs (BioKG) that provide direct and precise biomedical knowledge. In the context of COVID-19, this issue is even more necessary to be highlighted. However, most BioKG construction inevitably includes numerous conflicts and noises deriving from incorrect knowledge descriptions in literature and defective information extraction techniques. Many studies have demonstrated that reasoning upon the knowledge graph is effective in eliminating such conflicts and noises. This paper proposes a method BioGRER to improve the BioKG's quality, which comprehensively combines the knowledge graph embedding and logic rules that support and negate triplets in the BioKG. In the proposed model, the BioKG refinement problem is formulated as the probability estimation for triplets in the BioKG. We employ the variational EM algorithm to optimize knowledge graph embedding and logic rule inference alternately. In this way, our model could combine efforts from both the knowledge graph embedding and logic rules, leading to better results than using them alone. We evaluate our model over a COVID-19 knowledge graph and obtain competitive results. △ Less

Submitted 2 December, 2020; originally announced December 2020.

Incorporating Commonsense Knowledge into Abstractive Dialogue Summarization via Heterogeneous Graph Networks

Authors: Xiachong Feng, Xiaocheng Feng, Bing Qin, Ting Liu

Abstract: Abstractive dialogue summarization is the task of capturing the highlights of a dialogue and rewriting them into a concise version. In this paper, we present a novel multi-speaker dialogue summarizer to demonstrate how large-scale commonsense knowledge can facilitate dialogue understanding and summary generation. In detail, we consider utterance and commonsense knowledge as two different types of… ▽ More Abstractive dialogue summarization is the task of capturing the highlights of a dialogue and rewriting them into a concise version. In this paper, we present a novel multi-speaker dialogue summarizer to demonstrate how large-scale commonsense knowledge can facilitate dialogue understanding and summary generation. In detail, we consider utterance and commonsense knowledge as two different types of data and design a Dialogue Heterogeneous Graph Network (D-HGN) for modeling both information. Meanwhile, we also add speakers as heterogeneous nodes to facilitate information flow. Experimental results on the SAMSum dataset show that our model can outperform various methods. We also conduct zero-shot setting experiments on the Argumentative Dialogue Summary Corpus, the results show that our model can better generalized to the new domain. △ Less

Submitted 20 October, 2020; originally announced October 2020.

Partial FC: Training 10 Million Identities on a Single Machine

Authors: Xiang An, Xuhan Zhu, Yang Xiao, Lan Wu, Ming Zhang, Yuan Gao, Bin Qin, Debing Zhang, Ying Fu

Abstract: Face recognition has been an active and vital topic among computer vision community for a long time. Previous researches mainly focus on loss functions used for facial feature extraction network, among which the improvements of softmax-based loss functions greatly promote the performance of face recognition. However, the contradiction between the drastically increasing number of face identities an… ▽ More Face recognition has been an active and vital topic among computer vision community for a long time. Previous researches mainly focus on loss functions used for facial feature extraction network, among which the improvements of softmax-based loss functions greatly promote the performance of face recognition. However, the contradiction between the drastically increasing number of face identities and the shortage of GPU memories is gradually becoming irreconcilable. In this paper, we thoroughly analyze the optimization goal of softmax-based loss functions and the difficulty of training massive identities. We find that the importance of negative classes in softmax function in face representation learning is not as high as we previously thought. The experiment demonstrates no loss of accuracy when training with only 10\% randomly sampled classes for the softmax-based loss functions, compared with training with full classes using state-of-the-art models on mainstream benchmarks. We also implement a very efficient distributed sampling algorithm, taking into account model accuracy and training efficiency, which uses only eight NVIDIA RTX2080Ti to complete classification tasks with tens of millions of identities. The code of this paper has been made available https://github.com/deepinsight/insightface/tree/master/recognition/partial_fc. △ Less

Submitted 23 January, 2021; v1 submitted 11 October, 2020; originally announced October 2020.

Comments: 8 pages, 9 figures

AE-Netv2: Optimization of Image Fusion Efficiency and Network Architecture

Authors: Aiqing Fang, Xinbo Zhao, Jiaqi Yang, Beibei Qin, Yanning Zhang

Abstract: Existing image fusion methods pay few research attention to image fusion efficiency and network architecture. However, the efficiency and accuracy of image fusion has an important impact in practical applications. To solve this problem, we propose an \textit{efficient autonomous evolution image fusion method, dubed by AE-Netv2}. Different from other image fusion methods based on deep learning, AE-… ▽ More Existing image fusion methods pay few research attention to image fusion efficiency and network architecture. However, the efficiency and accuracy of image fusion has an important impact in practical applications. To solve this problem, we propose an \textit{efficient autonomous evolution image fusion method, dubed by AE-Netv2}. Different from other image fusion methods based on deep learning, AE-Netv2 is inspired by human brain cognitive mechanism. Firstly, we discuss the influence of different network architecture on image fusion quality and fusion efficiency, which provides a reference for the design of image fusion architecture. Secondly, we explore the influence of pooling layer on image fusion task and propose an image fusion method with pooling layer. Finally, we explore the commonness and characteristics of different image fusion tasks, which provides a research basis for further research on the continuous learning characteristics of human brain in the field of image fusion. Comprehensive experiments demonstrate the superiority of AE-Netv2 compared with state-of-the-art methods in different fusion tasks at a real time speed of 100+ FPS on GTX 2070. Among all tested methods based on deep learning, AE-Netv2 has the faster speed, the smaller model size and the better robustness. △ Less

Submitted 6 October, 2020; v1 submitted 5 October, 2020; originally announced October 2020.

Comments: Some mistakes have been fixed

The conformity of HI galaxies in ALFALFA-SDSS sample

Authors: Lincheng Li, Bo Qin, Jie Wang, Jing Wang, Yougang Wang

Abstract: The conformity effect, indicating the evolution of a galaxy is related to its surrounding neighbour galaxies as far as a few Mpc, is an interesting phenomenon in the modeling of galaxy and evolution. Here we study the conformity effect of HI galaxies in a matched galaxy sample between SDSS DR7 and ALFALFA surveys. By checking the probability difference for the detected HI galaxies as a function of… ▽ More The conformity effect, indicating the evolution of a galaxy is related to its surrounding neighbour galaxies as far as a few Mpc, is an interesting phenomenon in the modeling of galaxy and evolution. Here we study the conformity effect of HI galaxies in a matched galaxy sample between SDSS DR7 and ALFALFA surveys. By checking the probability difference for the detected HI galaxies as a function of distance around a normal or an HI galaxy, we find that this effect is significant out to 5 Mpc. It also shows a dependence on the stellar mass of galaxies, with the strength the strongest in the stellar mass range of 10^10~10^10.5. However, when the sample is confined to central galaxies in groups with virial radii smaller than 1 Mpc, the 1-halo conformity signal is still evident, while the 2-halo conformity signal is reduced to a very weak amplitude. Our results confirm the previous study in the optical band that the 2-halo term is possibly caused by the bias effect in the sample selection. Furthermore, we confirm the existence of the 1-halo conformity discovered in the optical and radio band in previous lectures. Our results provide another viewpoint of the conformity effect and hope to shed the light on the co-evolution of the galaxies and their neighbours in the current galaxy formation models. △ Less

Submitted 14 August, 2020; v1 submitted 13 August, 2020; originally announced August 2020.

Comments: 11 pages, 6 figures, accepted by Research in Astronomy and Astrophysics

Canonicalizing Open Knowledge Bases with Multi-Layered Meta-Graph Neural Network

Authors: Tianwen Jiang, Tong Zhao, Bing Qin, Ting Liu, Nitesh V. Chawla, Meng Jiang

Abstract: Noun phrases and relational phrases in Open Knowledge Bases are often not canonical, leading to redundant and ambiguous facts. In this work, we integrate structural information (from which tuple, which sentence) and semantic information (semantic similarity) to do the canonicalization. We represent the two types of information as a multi-layered graph: the structural information forms the links ac… ▽ More Noun phrases and relational phrases in Open Knowledge Bases are often not canonical, leading to redundant and ambiguous facts. In this work, we integrate structural information (from which tuple, which sentence) and semantic information (semantic similarity) to do the canonicalization. We represent the two types of information as a multi-layered graph: the structural information forms the links across the sentence, relational phrase, and noun phrase layers; the semantic information forms weighted intra-layer links for each layer. We propose a graph neural network model to aggregate the representations of noun phrases and relational phrases through the multi-layered meta-graph structure. Experiments show that our model outperforms existing approaches on a public datasets in general domain. △ Less

Submitted 16 June, 2020; originally announced June 2020.

How Does Selective Mechanism Improve Self-Attention Networks?

Authors: Xinwei Geng, Longyue Wang, Xing Wang, Bing Qin, Ting Liu, Zhaopeng Tu

Abstract: Self-attention networks (SANs) with selective mechanism has produced substantial improvements in various NLP tasks by concentrating on a subset of input words. However, the underlying reasons for their strong performance have not been well explained. In this paper, we bridge the gap by assessing the strengths of selective SANs (SSANs), which are implemented with a flexible and universal Gumbel-Sof… ▽ More Self-attention networks (SANs) with selective mechanism has produced substantial improvements in various NLP tasks by concentrating on a subset of input words. However, the underlying reasons for their strong performance have not been well explained. In this paper, we bridge the gap by assessing the strengths of selective SANs (SSANs), which are implemented with a flexible and universal Gumbel-Softmax. Experimental results on several representative NLP tasks, including natural language inference, semantic role labelling, and machine translation, show that SSANs consistently outperform the standard SANs. Through well-designed probing experiments, we empirically validate that the improvement of SSANs can be attributed in part to mitigating two commonly-cited weaknesses of SANs: word order encoding and structure modeling. Specifically, the selective mechanism improves SANs by paying more attention to content words that contribute to the meaning of the sentence. The code and data are released at https://github.com/xwgeng/SSAN. △ Less

Submitted 3 May, 2020; originally announced May 2020.

Comments: ACL 2020

Revisiting Pre-Trained Models for Chinese Natural Language Processing

Authors: Yiming Cui, Wanxiang Che, Ting Liu, Bing Qin, Shijin Wang, Guoping Hu

Abstract: Bidirectional Encoder Representations from Transformers (BERT) has shown marvelous improvements across various NLP tasks, and consecutive variants have been proposed to further improve the performance of the pre-trained language models. In this paper, we target on revisiting Chinese pre-trained language models to examine their effectiveness in a non-English language and release the Chinese pre-tra… ▽ More Bidirectional Encoder Representations from Transformers (BERT) has shown marvelous improvements across various NLP tasks, and consecutive variants have been proposed to further improve the performance of the pre-trained language models. In this paper, we target on revisiting Chinese pre-trained language models to examine their effectiveness in a non-English language and release the Chinese pre-trained language model series to the community. We also propose a simple but effective model called MacBERT, which improves upon RoBERTa in several ways, especially the masking strategy that adopts MLM as correction (Mac). We carried out extensive experiments on eight Chinese NLP tasks to revisit the existing pre-trained language models as well as the proposed MacBERT. Experimental results show that MacBERT could achieve state-of-the-art performances on many NLP tasks, and we also ablate details with several findings that may help future research. Resources available: https://github.com/ymcui/MacBERT △ Less

Submitted 2 November, 2020; v1 submitted 28 April, 2020; originally announced April 2020.

Comments: 12 pages, to appear at Findings of EMNLP 2020

Molweni: A Challenge Multiparty Dialogues-based Machine Reading Comprehension Dataset with Discourse Structure

Authors: Jiaqi Li, Ming Liu, Min-Yen Kan, Zihao Zheng, Zekun Wang, Wenqiang Lei, Ting Liu, Bing Qin

Abstract: Research into the area of multiparty dialog has grown considerably over recent years. We present the Molweni dataset, a machine reading comprehension (MRC) dataset with discourse structure built over multiparty dialog. Molweni's source samples from the Ubuntu Chat Corpus, including 10,000 dialogs comprising 88,303 utterances. We annotate 30,066 questions on this corpus, including both answerable a… ▽ More Research into the area of multiparty dialog has grown considerably over recent years. We present the Molweni dataset, a machine reading comprehension (MRC) dataset with discourse structure built over multiparty dialog. Molweni's source samples from the Ubuntu Chat Corpus, including 10,000 dialogs comprising 88,303 utterances. We annotate 30,066 questions on this corpus, including both answerable and unanswerable questions. Molweni also uniquely contributes discourse dependency annotations in a modified Segmented Discourse Representation Theory (SDRT; Asher et al., 2016) style for all of its multiparty dialogs, contributing large-scale (78,245 annotated discourse relations) data to bear on the task of multiparty dialog discourse parsing. Our experiments show that Molweni is a challenging dataset for current MRC models: BERT-wwm, a current, strong SQuAD 2.0 performer, achieves only 67.7% F1 on Molweni's questions, a 20+% significant drop as compared against its SQuAD 2.0 performance. △ Less

Submitted 7 November, 2020; v1 submitted 10 April, 2020; originally announced April 2020.

Comments: Accepted by COLING 2020, long Paper

Learning to Select Bi-Aspect Information for Document-Scale Text Content Manipulation

Authors: Xiaocheng Feng, Yawei Sun, Bing Qin, Heng Gong, Yibo Sun, Wei Bi, Xiaojiang Liu, Ting Liu

Abstract: In this paper, we focus on a new practical task, document-scale text content manipulation, which is the opposite of text style transfer and aims to preserve text styles while altering the content. In detail, the input is a set of structured records and a reference text for describing another recordset. The output is a summary that accurately describes the partial content in the source recordset wi… ▽ More In this paper, we focus on a new practical task, document-scale text content manipulation, which is the opposite of text style transfer and aims to preserve text styles while altering the content. In detail, the input is a set of structured records and a reference text for describing another recordset. The output is a summary that accurately describes the partial content in the source recordset with the same writing style of the reference. The task is unsupervised due to lack of parallel data, and is challenging to select suitable records and style words from bi-aspect inputs respectively and generate a high-fidelity long document. To tackle those problems, we first build a dataset based on a basketball game report corpus as our testbed, and present an unsupervised neural model with interactive attention mechanism, which is used for learning the semantic relationship between records and reference texts to achieve better content transfer and better style preservation. In addition, we also explore the effectiveness of the back-translation in our task for constructing some pseudo-training pairs. Empirical results show superiority of our approaches over competitive methods, and the models also yield a new state-of-the-art result on a sentence-level dataset. △ Less

Submitted 24 February, 2020; originally announced February 2020.

Comments: accepted by AAAI2020

CodeBERT: A Pre-Trained Model for Programming and Natural Languages

Authors: Zhangyin Feng, Daya Guo, Duyu Tang, Nan Duan, Xiaocheng Feng, Ming Gong, Linjun Shou, Bing Qin, Ting Liu, Daxin Jiang, Ming Zhou

Abstract: We present CodeBERT, a bimodal pre-trained model for programming language (PL) and nat-ural language (NL). CodeBERT learns general-purpose representations that support downstream NL-PL applications such as natural language codesearch, code documentation generation, etc. We develop CodeBERT with Transformer-based neural architecture, and train it with a hybrid objective function that incorporates t… ▽ More We present CodeBERT, a bimodal pre-trained model for programming language (PL) and nat-ural language (NL). CodeBERT learns general-purpose representations that support downstream NL-PL applications such as natural language codesearch, code documentation generation, etc. We develop CodeBERT with Transformer-based neural architecture, and train it with a hybrid objective function that incorporates the pre-training task of replaced token detection, which is to detect plausible alternatives sampled from generators. This enables us to utilize both bimodal data of NL-PL pairs and unimodal data, where the former provides input tokens for model training while the latter helps to learn better generators. We evaluate CodeBERT on two NL-PL applications by fine-tuning model parameters. Results show that CodeBERT achieves state-of-the-art performance on both natural language code search and code documentation generation tasks. Furthermore, to investigate what type of knowledge is learned in CodeBERT, we construct a dataset for NL-PL probing, and evaluate in a zero-shot setting where parameters of pre-trained models are fixed. Results show that CodeBERT performs better than previous pre-trained models on NL-PL probing. △ Less

Submitted 18 September, 2020; v1 submitted 19 February, 2020; originally announced February 2020.

Comments: Accepted to Findings of EMNLP 2020. 12 pages

Designation of a binocular structure for complex sources of x-rays and neutron source

Authors: X. B. Yang, X. B. Qin, P. H. Liu, T. Li, K. Zhuang

Abstract: A structure, used as a complex source of X-rays and neutron source, is designed with the assistance of CST module tool. Particles of -H and electron, attracted from a plasma source, are designed to be separated by an energy selector. Soon after the separation, the trajectory and beam quality of -H is controlled by a special designation of potential barrier and potential well. And the acceleration… ▽ More A structure, used as a complex source of X-rays and neutron source, is designed with the assistance of CST module tool. Particles of -H and electron, attracted from a plasma source, are designed to be separated by an energy selector. Soon after the separation, the trajectory and beam quality of -H is controlled by a special designation of potential barrier and potential well. And the acceleration of both particles is realized by three pairs of pierce similar pole to an energy of 150keV to produce x-rays or neutron. With proper optimization of structure and potential combination, a binocular structure with beam center distance of 15mm, beam diameter smaller than 3.5mm has been devised, which giveps a feasible suggestion to produce two rays with one structure in the same time. △ Less

Submitted 12 February, 2020; originally announced February 2020.

Comments: 7 pages, 8 sets figures and 13 inall

Are We Ready for Service Robots? The OpenLORIS-Scene Datasets for Lifelong SLAM

Authors: Xuesong Shi, Dongjiang Li, Pengpeng Zhao, Qinbin Tian, Yuxin Tian, Qiwei Long, Chunhao Zhu, Jingwei Song, Fei Qiao, Le Song, Yangquan Guo, Zhigang Wang, Yimin Zhang, Baoxing Qin, Wei Yang, Fangshi Wang, Rosa H. M. Chan, Qi She

Abstract: Service robots should be able to operate autonomously in dynamic and daily changing environments over an extended period of time. While Simultaneous Localization And Mapping (SLAM) is one of the most fundamental problems for robotic autonomy, most existing SLAM works are evaluated with data sequences that are recorded in a short period of time. In real-world deployment, there can be out-of-sight s… ▽ More Service robots should be able to operate autonomously in dynamic and daily changing environments over an extended period of time. While Simultaneous Localization And Mapping (SLAM) is one of the most fundamental problems for robotic autonomy, most existing SLAM works are evaluated with data sequences that are recorded in a short period of time. In real-world deployment, there can be out-of-sight scene changes caused by both natural factors and human activities. For example, in home scenarios, most objects may be movable, replaceable or deformable, and the visual features of the same place may be significantly different in some successive days. Such out-of-sight dynamics pose great challenges to the robustness of pose estimation, and hence a robot's long-term deployment and operation. To differentiate the forementioned problem from the conventional works which are usually evaluated in a static setting in a single run, the term \textit{lifelong SLAM} is used here to address SLAM problems in an ever-changing environment over a long period of time. To accelerate lifelong SLAM research, we release the OpenLORIS-Scene datasets. The data are collected in real-world indoor scenes, for multiple times in each place to include scene changes in real life. We also design benchmarking metrics for lifelong SLAM, with which the robustness and accuracy of pose estimation are evaluated separately. The datasets and benchmark are available online at https://lifelong-robotic-vision.github.io/dataset/scene. △ Less

Submitted 13 March, 2020; v1 submitted 13 November, 2019; originally announced November 2019.

Comments: To be published on ICRA 2020; 7 pages, 3 figures; v2 fixed a number in Table III

An Annotation Scheme of A Large-scale Multi-party Dialogues Dataset for Discourse Parsing and Machine Comprehension

Authors: Jiaqi Li, Ming Liu, Bing Qin, Zihao Zheng, Ting Liu

Abstract: In this paper, we propose the scheme for annotating large-scale multi-party chat dialogues for discourse parsing and machine comprehension. The main goal of this project is to help understand multi-party dialogues. Our dataset is based on the Ubuntu Chat Corpus. For each multi-party dialogue, we annotate the discourse structure and question-answer pairs for dialogues. As we know, this is the first… ▽ More In this paper, we propose the scheme for annotating large-scale multi-party chat dialogues for discourse parsing and machine comprehension. The main goal of this project is to help understand multi-party dialogues. Our dataset is based on the Ubuntu Chat Corpus. For each multi-party dialogue, we annotate the discourse structure and question-answer pairs for dialogues. As we know, this is the first large scale corpus for multi-party dialogues discourse parsing, and we firstly propose the task for multi-party dialogues machine reading comprehension. △ Less

Submitted 8 November, 2019; originally announced November 2019.

Transforming Wikipedia into Augmented Data for Query-Focused Summarization

Authors: Haichao Zhu, Li Dong, Furu Wei, Bing Qin, Ting Liu

Abstract: The limited size of existing query-focused summarization datasets renders training data-driven summarization models challenging. Meanwhile, the manual construction of a query-focused summarization corpus is costly and time-consuming. In this paper, we use Wikipedia to automatically collect a large query-focused summarization dataset (named WIKIREF) of more than 280, 000 examples, which can serve a… ▽ More The limited size of existing query-focused summarization datasets renders training data-driven summarization models challenging. Meanwhile, the manual construction of a query-focused summarization corpus is costly and time-consuming. In this paper, we use Wikipedia to automatically collect a large query-focused summarization dataset (named WIKIREF) of more than 280, 000 examples, which can serve as a means of data augmentation. We also develop a BERT-based query-focused summarization model (Q-BERT) to extract sentences from the documents as summaries. To better adapt a huge model containing millions of parameters to tiny benchmarks, we identify and fine-tune only a sparse subnetwork, which corresponds to a small fraction of the whole model parameters. Experimental results on three DUC benchmarks show that the model pre-trained on WIKIREF has already achieved reasonable performance. After fine-tuning on the specific benchmark datasets, the model with data augmentation outperforms strong comparison systems. Moreover, both our proposed Q-BERT model and subnetwork fine-tuning further improve the model performance. The dataset is publicly available at https://aka.ms/wikiref. △ Less

Submitted 22 July, 2022; v1 submitted 8 November, 2019; originally announced November 2019.

Comments: Accepted by IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP)

Neural Semantic Parsing in Low-Resource Settings with Back-Translation and Meta-Learning

Authors: Yibo Sun, Duyu Tang, Nan Duan, Yeyun Gong, Xiaocheng Feng, Bing Qin, Daxin Jiang

Abstract: Neural semantic parsing has achieved impressive results in recent years, yet its success relies on the availability of large amounts of supervised data. Our goal is to learn a neural semantic parser when only prior knowledge about a limited number of simple rules is available, without access to either annotated programs or execution results. Our approach is initialized by rules, and improved in a… ▽ More Neural semantic parsing has achieved impressive results in recent years, yet its success relies on the availability of large amounts of supervised data. Our goal is to learn a neural semantic parser when only prior knowledge about a limited number of simple rules is available, without access to either annotated programs or execution results. Our approach is initialized by rules, and improved in a back-translation paradigm using generated question-program pairs from the semantic parser and the question generator. A phrase table with frequent mapping patterns is automatically derived, also updated as training progresses, to measure the quality of generated instances. We train the model with model-agnostic meta-learning to guarantee the accuracy and stability on examples covered by rules, and meanwhile acquire the versatility to generalize well on examples uncovered by rules. Results on three benchmark datasets with different domains and programs show that our approach incrementally improves the accuracy. On WikiSQL, our best model is comparable to the SOTA system learned from denotations. △ Less

Submitted 11 September, 2019; originally announced September 2019.

Table-to-Text Generation with Effective Hierarchical Encoder on Three Dimensions (Row, Column and Time)

Authors: Heng Gong, Xiaocheng Feng, Bing Qin, Ting Liu

Abstract: Although Seq2Seq models for table-to-text generation have achieved remarkable progress, modeling table representation in one dimension is inadequate. This is because (1) the table consists of multiple rows and columns, which means that encoding a table should not depend only on one dimensional sequence or set of records and (2) most of the tables are time series data (e.g. NBA game data, stock mar… ▽ More Although Seq2Seq models for table-to-text generation have achieved remarkable progress, modeling table representation in one dimension is inadequate. This is because (1) the table consists of multiple rows and columns, which means that encoding a table should not depend only on one dimensional sequence or set of records and (2) most of the tables are time series data (e.g. NBA game data, stock market data), which means that the description of the current table may be affected by its historical data. To address aforementioned problems, not only do we model each table cell considering other records in the same row, we also enrich table's representation by modeling each table cell in context of other cells in the same column or with historical (time dimension) data respectively. In addition, we develop a table cell fusion gate to combine representations from row, column and time dimension into one dense vector according to the saliency of each dimension's representation. We evaluated our methods on ROTOWIRE, a benchmark dataset of NBA basketball games. Both automatic and human evaluation results demonstrate the effectiveness of our model with improvement of 2.66 in BLEU over the strong baseline and outperformance of state-of-the-art model. △ Less

Submitted 5 September, 2019; originally announced September 2019.

Comments: EMNLP 2019 (Long paper)

Cross-Lingual Machine Reading Comprehension

Authors: Yiming Cui, Wanxiang Che, Ting Liu, Bing Qin, Shijin Wang, Guoping Hu

Abstract: Though the community has made great progress on Machine Reading Comprehension (MRC) task, most of the previous works are solving English-based MRC problems, and there are few efforts on other languages mainly due to the lack of large-scale training data. In this paper, we propose Cross-Lingual Machine Reading Comprehension (CLMRC) task for the languages other than English. Firstly, we present seve… ▽ More Though the community has made great progress on Machine Reading Comprehension (MRC) task, most of the previous works are solving English-based MRC problems, and there are few efforts on other languages mainly due to the lack of large-scale training data. In this paper, we propose Cross-Lingual Machine Reading Comprehension (CLMRC) task for the languages other than English. Firstly, we present several back-translation approaches for CLMRC task, which is straightforward to adopt. However, to accurately align the answer into another language is difficult and could introduce additional noise. In this context, we propose a novel model called Dual BERT, which takes advantage of the large-scale training data provided by rich-resource language (such as English) and learn the semantic relations between the passage and question in a bilingual context, and then utilize the learned knowledge to improve reading comprehension performance of low-resource language. We conduct experiments on two Chinese machine reading comprehension datasets CMRC 2018 and DRCD. The results show consistent and significant improvements over various state-of-the-art systems by a large margin, which demonstrate the potentials in CLMRC task. Resources available: https://github.com/ymcui/Cross-Lingual-MRC △ Less

Submitted 1 September, 2019; originally announced September 2019.

Comments: 10 pages, accepted as a conference paper at EMNLP-IJCNLP 2019 (long paper)

Journal ref: EMNLP 2019 1586-1595

Asynchronous Distributed Voltage Control in Active Distribution Networks

Authors: Zhaojian Wang, Feng Liu, Yifan Su, Boyu Qin

Abstract: With the explosion of distributed energy resources (DERs), voltage regulation in distribution networks has been facing a great challenge. This paper derives an asynchronous distributed voltage control strategy based on the partial primal-dual gradient algorithm, where both active and reactive controllable power of DERs are considered. Different types of asynchrony due to imperfect communication or… ▽ More With the explosion of distributed energy resources (DERs), voltage regulation in distribution networks has been facing a great challenge. This paper derives an asynchronous distributed voltage control strategy based on the partial primal-dual gradient algorithm, where both active and reactive controllable power of DERs are considered. Different types of asynchrony due to imperfect communication or practical limits, such as random time delays and non-identical sampling/control rates, are fitted into a unified analytic framework. The asynchronous algorithm is then converted into a fixed-point problem by employing the operator splitting method, which leads to a convergence proof with mild conditions. Moreover, an online implementation method is provided to make the controller adjustable to time-varying environments. Finally, numerical experiments are carried out on a rudimentary 8-bus system and the IEEE-123 distribution network to verify the effectiveness of the proposed method. △ Less

Submitted 18 August, 2019; originally announced August 2019.

Multi-view Clustering with the Cooperation of Visible and Hidden Views

Authors: Zhaohong Deng, Ruixiu Liu, Te Zhang, Peng Xu, Kup-Sze Choi, Bin Qin, Shitong Wang

Abstract: Multi-view data are becoming common in real-world modeling tasks and many multi-view data clustering algorithms have thus been proposed. The existing algorithms usually focus on the cooperation of different views in the original space but neglect the influence of the hidden information among these different visible views, or they only consider the hidden information between the views. The algorith… ▽ More Multi-view data are becoming common in real-world modeling tasks and many multi-view data clustering algorithms have thus been proposed. The existing algorithms usually focus on the cooperation of different views in the original space but neglect the influence of the hidden information among these different visible views, or they only consider the hidden information between the views. The algorithms are therefore not efficient since the available information is not fully excavated, particularly the otherness information in different views and the consistency information between them. In practice, the otherness and consistency information in multi-view data are both very useful for effective clustering analyses. In this study, a Multi-View clustering algorithm developed with the Cooperation of Visible and Hidden views, i.e., MV-Co-VH, is proposed. The MV-Co-VH algorithm first projects the multiple views from different visible spaces to the common hidden space by using the non-negative matrix factorization (NMF) strategy to obtain the common hidden view data. Collaborative learning is then implemented in the clustering procedure based on the visible views and the shared hidden view. The results of extensive experiments on UCI multi-view datasets and real-world image multi-view datasets show that the clustering performance of the proposed algorithm is competitive with or even better than that of the existing algorithms. △ Less

Submitted 12 August, 2019; originally announced August 2019.

Comments: This paper has been submitted to IEEE TKDE in Jun. 2019

Constructing Information-Lossless Biological Knowledge Graphs from Conditional Statements

Authors: Tianwen Jiang, Tong Zhao, Bing Qin, Ting Liu, Nitesh V. Chawla, Meng Jiang

Abstract: Conditions are essential in the statements of biological literature. Without the conditions (e.g., environment, equipment) that were precisely specified, the facts (e.g., observations) in the statements may no longer be valid. One biological statement has one or multiple fact(s) and/or condition(s). Their subject and object can be either a concept or a concept's attribute. Existing information ext… ▽ More Conditions are essential in the statements of biological literature. Without the conditions (e.g., environment, equipment) that were precisely specified, the facts (e.g., observations) in the statements may no longer be valid. One biological statement has one or multiple fact(s) and/or condition(s). Their subject and object can be either a concept or a concept's attribute. Existing information extraction methods do not consider the role of condition in the biological statement nor the role of attribute in the subject/object. In this work, we design a new tag schema and propose a deep sequence tagging framework to structure conditional statement into fact and condition tuples from biological text. Experiments demonstrate that our method yields a information-lossless structure of the literature. △ Less

Submitted 26 June, 2019; originally announced July 2019.

Pre-Training with Whole Word Masking for Chinese BERT

Authors: Yiming Cui, Wanxiang Che, Ting Liu, Bing Qin, Ziqing Yang

Abstract: Bidirectional Encoder Representations from Transformers (BERT) has shown marvelous improvements across various NLP tasks, and its consecutive variants have been proposed to further improve the performance of the pre-trained language models. In this paper, we aim to first introduce the whole word masking (wwm) strategy for Chinese BERT, along with a series of Chinese pre-trained language models. Th… ▽ More Bidirectional Encoder Representations from Transformers (BERT) has shown marvelous improvements across various NLP tasks, and its consecutive variants have been proposed to further improve the performance of the pre-trained language models. In this paper, we aim to first introduce the whole word masking (wwm) strategy for Chinese BERT, along with a series of Chinese pre-trained language models. Then we also propose a simple but effective model called MacBERT, which improves upon RoBERTa in several ways. Especially, we propose a new masking strategy called MLM as correction (Mac). To demonstrate the effectiveness of these models, we create a series of Chinese pre-trained language models as our baselines, including BERT, RoBERTa, ELECTRA, RBT, etc. We carried out extensive experiments on ten Chinese NLP tasks to evaluate the created Chinese pre-trained language models as well as the proposed MacBERT. Experimental results show that MacBERT could achieve state-of-the-art performances on many NLP tasks, and we also ablate details with several findings that may help future research. We open-source our pre-trained language models for further facilitating our research community. Resources are available: https://github.com/ymcui/Chinese-BERT-wwm △ Less

Submitted 25 November, 2021; v1 submitted 19 June, 2019; originally announced June 2019.

Comments: 11 pages. Journal extension to arXiv:2004.13922

Journal ref: IEEE/ACM Transactions on Audio, Speech, and Language Processing (2021)

Learning to Ask Unanswerable Questions for Machine Reading Comprehension

Authors: Haichao Zhu, Li Dong, Furu Wei, Wenhui Wang, Bing Qin, Ting Liu

Abstract: Machine reading comprehension with unanswerable questions is a challenging task. In this work, we propose a data augmentation technique by automatically generating relevant unanswerable questions according to an answerable question paired with its corresponding paragraph that contains the answer. We introduce a pair-to-sequence model for unanswerable question generation, which effectively captures… ▽ More Machine reading comprehension with unanswerable questions is a challenging task. In this work, we propose a data augmentation technique by automatically generating relevant unanswerable questions according to an answerable question paired with its corresponding paragraph that contains the answer. We introduce a pair-to-sequence model for unanswerable question generation, which effectively captures the interactions between the question and the paragraph. We also present a way to construct training data for our question generation models by leveraging the existing reading comprehension dataset. Experimental results show that the pair-to-sequence model performs consistently better compared with the sequence-to-sequence baseline. We further use the automatically generated unanswerable questions as a means of data augmentation on the SQuAD 2.0 dataset, yielding 1.9 absolute F1 improvement with BERT-base model and 1.7 absolute F1 improvement with BERT-large model. △ Less

Submitted 14 June, 2019; originally announced June 2019.

Comments: ACL 2019 (long paper)

Towards Time-Aware Distant Supervision for Relation Extraction

Authors: Tianwen Jiang, Sendong Zhao, Jing Liu, Jin-Ge Yao, Ming Liu, Bing Qin, Ting Liu, Chin-Yew Lin

Abstract: Distant supervision for relation extraction heavily suffers from the wrong labeling problem. To alleviate this issue in news data with the timestamp, we take a new factor time into consideration and propose a novel time-aware distant supervision framework (Time-DS). Time-DS is composed of a time series instance-popularity and two strategies. Instance-popularity is to encode the strong relevance of… ▽ More Distant supervision for relation extraction heavily suffers from the wrong labeling problem. To alleviate this issue in news data with the timestamp, we take a new factor time into consideration and propose a novel time-aware distant supervision framework (Time-DS). Time-DS is composed of a time series instance-popularity and two strategies. Instance-popularity is to encode the strong relevance of time and true relation mention. Therefore, instance-popularity would be an effective clue to reduce the noises generated through distant supervision labeling. The two strategies, i.e., hard filter and curriculum learning are both ways to implement instance-popularity for better relation extraction in the manner of Time-DS. The curriculum learning is a more sophisticated and flexible way to exploit instance-popularity to eliminate the bad effects of noises, thus get better relation extraction performance. Experiments on our collected multi-source news corpus show that Time-DS achieves significant improvements for relation extraction. △ Less

Submitted 8 March, 2019; originally announced March 2019.

Attribute Acquisition in Ontology based on Representation Learning of Hierarchical Classes and Attributes

Authors: Tianwen Jiang, Ming Liu, Bing Qin, Ting Liu

Abstract: Attribute acquisition for classes is a key step in ontology construction, which is often achieved by community members manually. This paper investigates an attention-based automatic paradigm called TransATT for attribute acquisition, by learning the representation of hierarchical classes and attributes in Chinese ontology. The attributes of an entity can be acquired by merely inspecting its classe… ▽ More Attribute acquisition for classes is a key step in ontology construction, which is often achieved by community members manually. This paper investigates an attention-based automatic paradigm called TransATT for attribute acquisition, by learning the representation of hierarchical classes and attributes in Chinese ontology. The attributes of an entity can be acquired by merely inspecting its classes, because the entity can be regard as the instance of its classes and inherit their attributes. For explicitly describing of the class of an entity unambiguously, we propose class-path to represent the hierarchical classes in ontology, instead of the terminal class word of the hypernym-hyponym relation (i.e., is-a relation) based hierarchy. The high performance of TransATT on attribute acquisition indicates the promising ability of the learned representation of class-paths and attributes. Moreover, we construct a dataset named \textbf{BigCilin11k}. To the best of our knowledge, this is the first Chinese dataset with abundant hierarchical classes and entities with attributes. △ Less

Submitted 7 March, 2019; originally announced March 2019.

Learning to Refine Source Representations for Neural Machine Translation

Authors: Xinwei Geng, Longyue Wang, Xing Wang, Bing Qin, Ting Liu, Zhaopeng Tu

Abstract: Neural machine translation (NMT) models generally adopt an encoder-decoder architecture for modeling the entire translation process. The encoder summarizes the representation of input sentence from scratch, which is potentially a problem if the sentence is ambiguous. When translating a text, humans often create an initial understanding of the source sentence and then incrementally refine it along… ▽ More Neural machine translation (NMT) models generally adopt an encoder-decoder architecture for modeling the entire translation process. The encoder summarizes the representation of input sentence from scratch, which is potentially a problem if the sentence is ambiguous. When translating a text, humans often create an initial understanding of the source sentence and then incrementally refine it along the translation on the target side. Starting from this intuition, we propose a novel encoder-refiner-decoder framework, which dynamically refines the source representations based on the generated target-side information at each decoding step. Since the refining operations are time-consuming, we propose a strategy, leveraging the power of reinforcement learning models, to decide when to refine at specific decoding steps. Experimental results on both Chinese-English and English-German translation tasks show that the proposed approach significantly and consistently improves translation performance over the standard encoder-decoder framework. Furthermore, when refining strategy is applied, results still show reasonable improvement over the baseline without much decrease in decoding speed. △ Less

Submitted 26 December, 2018; originally announced December 2018.

Phase asymmetry ultrasound despeckling with fractional anisotropic diffusion and total variation

Authors: Kunqiang Mei, Bin Hu, Baowei Fei, Binjie Qin

Abstract: We propose an ultrasound speckle filtering method for not only preserving various edge features but also filtering tissue-dependent complex speckle noises in ultrasound images. The key idea is to detect these various edges using a phase congruence-based edge significance measure called phase asymmetry (PAS), which is invariant to the intensity amplitude of edges and takes 0 in non-edge smooth regi… ▽ More We propose an ultrasound speckle filtering method for not only preserving various edge features but also filtering tissue-dependent complex speckle noises in ultrasound images. The key idea is to detect these various edges using a phase congruence-based edge significance measure called phase asymmetry (PAS), which is invariant to the intensity amplitude of edges and takes 0 in non-edge smooth regions and 1 at the idea step edge, while also taking intermediate values at slowly varying ramp edges. By leveraging the PAS metric in designing weighting coefficients to maintain a balance between fractional-order anisotropic diffusion and total variation (TV) filters in TV cost function, we propose a new fractional TV framework to not only achieve the best despeckling performance with ramp edge preservation but also reduce the staircase effect produced by integral-order filters. Then, we exploit the PAS metric in designing a new fractional-order diffusion coefficient to properly preserve low-contrast edges in diffusion filtering. Finally, different from fixed fractional-order diffusion filters, an adaptive fractional order is introduced based on the PAS metric to enhance various weak edges in the spatially transitional areas between objects. The proposed fractional TV model is minimized using the gradient descent method to obtain the final denoised image. The experimental results and real application of ultrasound breast image segmentation show that the proposed method outperforms other state-of-the-art ultrasound despeckling filters for both speckle reduction and feature preservation in terms of visual evaluation and quantitative indices. △ Less

Submitted 9 February, 2021; v1 submitted 30 October, 2018; originally announced October 2018.

Comments: 12

Journal ref: IEEE Transaction on Image Processing, 2020

Texture variation adaptive image denoising with nonlocal PCA

Authors: Wenzhao Zhao, Qiegen Liu, Yisong Lv, Binjie Qin

Abstract: Image textures, as a kind of local variations, provide important information for human visual system. Many image textures, especially the small-scale or stochastic textures are rich in high-frequency variations, and are difficult to be preserved. Current state-of-the-art denoising algorithms typically adopt a nonlocal approach consisting of image patch grouping and group-wise denoising filtering.… ▽ More Image textures, as a kind of local variations, provide important information for human visual system. Many image textures, especially the small-scale or stochastic textures are rich in high-frequency variations, and are difficult to be preserved. Current state-of-the-art denoising algorithms typically adopt a nonlocal approach consisting of image patch grouping and group-wise denoising filtering. To achieve a better image denoising while preserving the variations in texture, we first adaptively group high correlated image patches with the same kinds of texture elements (texels) via an adaptive clustering method. This adaptive clustering method is applied in an over-clustering-and-iterative-merging approach, where its noise robustness is improved with a custom merging threshold relating to the noise level and cluster size. For texture-preserving denoising of each cluster, considering that the variations in texture are captured and wrapped in not only the between-dimension energy variations but also the within-dimension variations of PCA transform coefficients, we further propose a PCA-transform-domain variation adaptive filtering method to preserve the local variations in textures. Experiments on natural images show the superiority of the proposed transform-domain variation adaptive filtering to traditional PCA-based hard or soft threshold filtering. As a whole, the proposed denoising method achieves a favorable texture preserving performance both quantitatively and visually, especially for stochastic textures, which is further verified in camera raw image denoising. △ Less

Submitted 26 October, 2018; originally announced October 2018.

The Giant Radio Array for Neutrino Detection (GRAND): Science and Design

Authors: GRAND Collaboration, Jaime Alvarez-Muniz, Rafael Alves Batista, Aswathi Balagopal V., Julien Bolmont, Mauricio Bustamante, Washington R. Carvalho, Didier Charrier, Ismael Cognard, Valentin Decoene, Peter B. Denton, Sijbrand J. De Jong, Krijn D. De Vries, Ralph Engel, Ke Fang, Chad Finley, Stefano Gabici, QuanBu Gou, Junhua Gu, Claire Guépin, Hongbo Hu, Yan Huang, Kumiko Kotera, Sandra Le Coz, Jean-Philippe Lenain , et al. (26 additional authors not shown)

Abstract: The Giant Radio Array for Neutrino Detection (GRAND) is a planned large-scale observatory of ultra-high-energy (UHE) cosmic particles, with energies exceeding 10^8 GeV. Its goal is to solve the long-standing mystery of the origin of UHE cosmic rays. To do this, GRAND will detect an unprecedented number of UHE cosmic rays and search for the undiscovered UHE neutrinos and gamma rays associated to th… ▽ More The Giant Radio Array for Neutrino Detection (GRAND) is a planned large-scale observatory of ultra-high-energy (UHE) cosmic particles, with energies exceeding 10^8 GeV. Its goal is to solve the long-standing mystery of the origin of UHE cosmic rays. To do this, GRAND will detect an unprecedented number of UHE cosmic rays and search for the undiscovered UHE neutrinos and gamma rays associated to them with unmatched sensitivity. GRAND will use large arrays of antennas to detect the radio emission coming from extensive air showers initiated by UHE particles in the atmosphere. Its design is modular: 20 separate, independent sub-arrays, each of 10 000 radio antennas deployed over 10 000 km^2. A staged construction plan will validate key detection techniques while achieving important science goals early. Here we present the science goals, detection strategy, preliminary design, performance goals, and construction plans for GRAND. △ Less

Submitted 18 July, 2019; v1 submitted 23 October, 2018; originally announced October 2018.

Comments: 45 pages, 34 figures. Matches published version

Journal ref: Sci. China-Phys. Mech. Astron. 63, 219501 (2020)

An AMR Aligner Tuned by Transition-based Parser

Authors: Yijia Liu, Wanxiang Che, Bo Zheng, Bing Qin, Ting Liu

Abstract: In this paper, we propose a new rich resource enhanced AMR aligner which produces multiple alignments and a new transition system for AMR parsing along with its oracle parser. Our aligner is further tuned by our oracle parser via picking the alignment that leads to the highest-scored achievable AMR graph. Experimental results show that our aligner outperforms the rule-based aligner in previous wor… ▽ More In this paper, we propose a new rich resource enhanced AMR aligner which produces multiple alignments and a new transition system for AMR parsing along with its oracle parser. Our aligner is further tuned by our oracle parser via picking the alignment that leads to the highest-scored achievable AMR graph. Experimental results show that our aligner outperforms the rule-based aligner in previous work by achieving higher alignment F1 score and consistently improving two open-sourced AMR parsers. Based on our aligner and transition system, we develop a transition-based AMR parser that parses a sentence into its AMR graph directly. An ensemble of our parsers with only words and POS tags as input leads to 68.4 Smatch F1 score. △ Less

Submitted 8 October, 2018; originally announced October 2018.

Comments: EMNLP2018

Knowledge-Aware Conversational Semantic Parsing Over Web Tables

Authors: Yibo Sun, Duyu Tang, Nan Duan, Jingjing Xu, Xiaocheng Feng, Bing Qin

Abstract: Conversational semantic parsing over tables requires knowledge acquiring and reasoning abilities, which have not been well explored by current state-of-the-art approaches. Motivated by this fact, we propose a knowledge-aware semantic parser to improve parsing performance by integrating various types of knowledge. In this paper, we consider three types of knowledge, including grammar knowledge, exp… ▽ More Conversational semantic parsing over tables requires knowledge acquiring and reasoning abilities, which have not been well explored by current state-of-the-art approaches. Motivated by this fact, we propose a knowledge-aware semantic parser to improve parsing performance by integrating various types of knowledge. In this paper, we consider three types of knowledge, including grammar knowledge, expert knowledge, and external resource knowledge. First, grammar knowledge empowers the model to effectively replicate previously generated logical form, which effectively handles the co-reference and ellipsis phenomena in conversation Second, based on expert knowledge, we propose a decomposable model, which is more controllable compared with traditional end-to-end models that put all the burdens of learning on trial-and-error in an end-to-end way. Third, external resource knowledge, i.e., provided by a pre-trained language model or an entity typing model, is used to improve the representation of question and table for a better semantic understanding. We conduct experiments on the SequentialQA dataset. Results show that our knowledge-aware model outperforms the state-of-the-art approaches. Incremental experimental results also prove the usefulness of various knowledge. Further analysis shows that our approach has the ability to derive the meaning representation of a context-dependent utterance by leveraging previously generated outcomes. △ Less

Submitted 12 September, 2018; originally announced September 2018.

Knowledge Based Machine Reading Comprehension

Authors: Yibo Sun, Daya Guo, Duyu Tang, Nan Duan, Zhao Yan, Xiaocheng Feng, Bing Qin

Abstract: Machine reading comprehension (MRC) requires reasoning about both the knowledge involved in a document and knowledge about the world. However, existing datasets are typically dominated by questions that can be well solved by context matching, which fail to test this capability. To encourage the progress on knowledge-based reasoning in MRC, we present knowledge-based MRC in this paper, and build a… ▽ More Machine reading comprehension (MRC) requires reasoning about both the knowledge involved in a document and knowledge about the world. However, existing datasets are typically dominated by questions that can be well solved by context matching, which fail to test this capability. To encourage the progress on knowledge-based reasoning in MRC, we present knowledge-based MRC in this paper, and build a new dataset consisting of 40,047 question-answer pairs. The annotation of this dataset is designed so that successfully answering the questions requires understanding and the knowledge involved in a document. We implement a framework consisting of both a question answering model and a question generation model, both of which take the knowledge extracted from the document as well as relevant facts from an external knowledge base such as Freebase/ProBase/Reverb/NELL. Results show that incorporating side information from external KB improves the accuracy of the baseline question answer system. We compare it with a standard MRC model BiDAF, and also provide the difficulty of the dataset and lay out remaining challenges. △ Less

Submitted 12 September, 2018; originally announced September 2018.

Flow Resistance and Structures in Viscoelastic Channel Flows at Low Re

Authors: Boyang Qin, Paul F. Salipante, Steven D. Hudson, Paulo E. Arratia

Abstract: The flow of viscoelastic fluids in channels and pipes remain poorly understood, particularly at low Reynolds numbers. Here, we investigate the flow of polymeric solutions in straight channels using pressure measurements and particle tracking. The law of flow resistance is established by measuring the flow friction factor $f_η$ versus flow rate. Two regimes are found: a transitional regime marked b… ▽ More The flow of viscoelastic fluids in channels and pipes remain poorly understood, particularly at low Reynolds numbers. Here, we investigate the flow of polymeric solutions in straight channels using pressure measurements and particle tracking. The law of flow resistance is established by measuring the flow friction factor $f_η$ versus flow rate. Two regimes are found: a transitional regime marked by rapid increase in drag, and a turbulent-like regime characterized by a sudden decrease in drag and a weak dependence on flow rate. Lagrangian trajectories show finite transverse modulations not seen in Newtonian fluids. These curvature perturbations far downstream can generate sufficient hoop stresses to sustain the flow instabilities in the parallel shear flow. △ Less

Submitted 2 July, 2018; originally announced July 2018.

Comments: 5 pages, 5 figures

Journal ref: Phys. Rev. Lett. 123, 194501 (2019)

Distilling Knowledge for Search-based Structured Prediction

Authors: Yijia Liu, Wanxiang Che, Huaipeng Zhao, Bing Qin, Ting Liu

Abstract: Many natural language processing tasks can be modeled into structured prediction and solved as a search problem. In this paper, we distill an ensemble of multiple models trained with different initialization into a single model. In addition to learning to match the ensemble's probability output on the reference states, we also use the ensemble to explore the search space and learn from the encount… ▽ More Many natural language processing tasks can be modeled into structured prediction and solved as a search problem. In this paper, we distill an ensemble of multiple models trained with different initialization into a single model. In addition to learning to match the ensemble's probability output on the reference states, we also use the ensemble to explore the search space and learn from the encountered states in the exploration. Experimental results on two typical search-based structured prediction tasks -- transition-based dependency parsing and neural machine translation show that distillation can effectively improve the single model's performance and the final model achieves improvements of 1.32 in LAS and 2.65 in BLEU score on these two tasks respectively over strong baselines and it outperforms the greedy structured prediction models in previous literatures. △ Less

Submitted 28 May, 2018; originally announced May 2018.

Comments: To appear at ACL 2018

Semantic Parsing with Syntax- and Table-Aware SQL Generation

Authors: Yibo Sun, Duyu Tang, Nan Duan, Jianshu Ji, Guihong Cao, Xiaocheng Feng, Bing Qin, Ting Liu, Ming Zhou

Abstract: We present a generative model to map natural language questions into SQL queries. Existing neural network based approaches typically generate a SQL query word-by-word, however, a large portion of the generated results are incorrect or not executable due to the mismatch between question words and table contents. Our approach addresses this problem by considering the structure of table and the synta… ▽ More We present a generative model to map natural language questions into SQL queries. Existing neural network based approaches typically generate a SQL query word-by-word, however, a large portion of the generated results are incorrect or not executable due to the mismatch between question words and table contents. Our approach addresses this problem by considering the structure of table and the syntax of SQL language. The quality of the generated SQL query is significantly improved through (1) learning to replicate content from column names, cells or SQL keywords; and (2) improving the generation of WHERE clause by leveraging the column-cell relation. Experiments are conducted on WikiSQL, a recently released dataset with the largest question-SQL pairs. Our approach significantly improves the state-of-the-art execution accuracy from 69.0% to 74.4%. △ Less

Submitted 23 April, 2018; originally announced April 2018.

Parsing Tweets into Universal Dependencies

Authors: Yijia Liu, Yi Zhu, Wanxiang Che, Bing Qin, Nathan Schneider, Noah A. Smith

Abstract: We study the problem of analyzing tweets with Universal Dependencies. We extend the UD guidelines to cover special constructions in tweets that affect tokenization, part-of-speech tagging, and labeled dependencies. Using the extended guidelines, we create a new tweet treebank for English (Tweebank v2) that is four times larger than the (unlabeled) Tweebank v1 introduced by Kong et al. (2014). We c… ▽ More We study the problem of analyzing tweets with Universal Dependencies. We extend the UD guidelines to cover special constructions in tweets that affect tokenization, part-of-speech tagging, and labeled dependencies. Using the extended guidelines, we create a new tweet treebank for English (Tweebank v2) that is four times larger than the (unlabeled) Tweebank v1 introduced by Kong et al. (2014). We characterize the disagreements between our annotators and show that it is challenging to deliver consistent annotation due to ambiguity in understanding and explaining tweets. Nonetheless, using the new treebank, we build a pipeline system to parse raw tweets into UD. To overcome annotation noise without sacrificing computational efficiency, we propose a new method to distill an ensemble of 20 transition-based parsers into a single one. Our parser achieves an improvement of 2.2 in LAS over the un-ensembled baseline and outperforms parsers that are state-of-the-art on other treebanks in both accuracy and speed. △ Less

Submitted 22 April, 2018; originally announced April 2018.

Comments: To be presented at NAACL 2018

Nonperturbative Renormalization Group for the Landau-de Gennes Model

Authors: Bin Qin, Defu Hou, Mei Huang, Danning Li, Hui Zhang

Abstract: We studied the nematic isotropic phase transition by applying the functional renormalization group to the Landau-de Gennes model. We derived the flow equations for the effective potential as well as the cubic and quartic "couplings" and the anomalous dimension. We then solved the coupled flow equations on a grid using Newton Raphson method. A first order phase transition is observed. We also inves… ▽ More We studied the nematic isotropic phase transition by applying the functional renormalization group to the Landau-de Gennes model. We derived the flow equations for the effective potential as well as the cubic and quartic "couplings" and the anomalous dimension. We then solved the coupled flow equations on a grid using Newton Raphson method. A first order phase transition is observed. We also investigated the nematic isotropic puzzle (the NI puzzle) in this paper. We obtained the NI transition temperature difference ${T_c-T^*}=5.85K$ with sizable improvement over previous results. △ Less

Submitted 25 February, 2018; originally announced March 2018.

Comments: 8 pages, 8 figures in Revtex

Journal ref: Phys. Rev. B 98, 014102 (2018)

Non-approximability and Polylogarithmic Approximations of the Single-Sink Unsplittable and Confluent Dynamic Flow Problems

Authors: Mordecai J. Golin, Hadi Khodabande, Bo Qin

Abstract: Dynamic Flows were introduced by Ford and Fulkerson in 1958 to model flows over time. They define edge capacities to be the total amount of flow that can enter an edge {\em in one time unit}. Each edge also has a length, representing the time needed to traverse it. Dynamic Flows have been used to model many problems including traffic congestion, hop-routing of packets and evacuation protocols in b… ▽ More Dynamic Flows were introduced by Ford and Fulkerson in 1958 to model flows over time. They define edge capacities to be the total amount of flow that can enter an edge {\em in one time unit}. Each edge also has a length, representing the time needed to traverse it. Dynamic Flows have been used to model many problems including traffic congestion, hop-routing of packets and evacuation protocols in buildings. While the basic problem of moving the maximal amount of supplies from sources to sinks is polynomial time solvable, natural minor modifications can make it NP-hard. One such modification is that flows be confluent, i.e., all flows leaving a vertex must leave along the same edge. This corresponds to natural conditions in, e.g., evacuation planning and hop routing. We investigate the single-sink Confluent Quickest Flow problem. The input is a graph with edge capacities and lengths, sources with supplies and a sink. The problem is to find a confluent flow minimizing the time required to send supplies to the sink. Our main results include: a) Logarithmic Non-Approximability: Directed Confluent Quickest Flows cannot be approximated in polynomial time with an $O(\log n)$ approximation factor, unless $P=NP$. b) Polylogarithmic Bicriteria Approximations: Polynomial time $(O(\log^8 n), O(\log^2 κ))$ bicritera approximation algorithms for the Confluent Quickest Flow problem where $κ$ is the number of sinks, in both directed and undirected graphs. Corresponding results are also developed for the Confluent Maximum Flow over timeproblem. The techniques developed also improve recent approximation algorithms for static confluent flows. △ Less

Submitted 29 September, 2017; originally announced September 2017.

Comments: Full version of paper appearing in Isaac'17

Functional renormalization group study of the Quark-Meson model with $ω$ meson

Authors: Hui Zhang, Defu Hou, Toru Kojo, Bin Qin

Abstract: We study the phase diagram of two-flavor massless QCD at finite baryon density by applying the functional renormalization group (FRG) for a quark-meson model with $σ, π$, and $ω$ mesons. The dynamical fluctuations of quarks, $σ$, and $π$ are included into the flow equations, while the amplitudes of $ω$-fields are also allowed to fluctuate. At high temperature the effects of the $ω$-field on the ph… ▽ More We study the phase diagram of two-flavor massless QCD at finite baryon density by applying the functional renormalization group (FRG) for a quark-meson model with $σ, π$, and $ω$ mesons. The dynamical fluctuations of quarks, $σ$, and $π$ are included into the flow equations, while the amplitudes of $ω$-fields are also allowed to fluctuate. At high temperature the effects of the $ω$-field on the phase boundary are qualitatively similar to the mean-field calculations; the phase boundary is shifted to the higher chemical potential region. As the temperature is lowered, however, the transition line bends back to the lower chemical potential region, irrespective to the strength of the vector coupling. In our FRG calculations, the driving force of the low temperature first order line is the fluctuations rather the quark density, and the effects of $ω$-fields have little impact. At low temperature, the effective potential at small $σ$ field is very sensitive to the infrared cutoff scale, and this significantly affects our determination of the phase boundaries. The critical chemical potential at the tricritical point is affected by the $ω$-field effects but its critical temperature stays around the similar value. Some caveats are given in interpreting our model results. △ Less

Submitted 23 December, 2017; v1 submitted 17 September, 2017; originally announced September 2017.

Comments: 10 pages, 11 figures

Journal ref: Phys. Rev. D 96, 114029 (2017)

Truth Discovery with Memory Network

Authors: Luyang Li, Bing Qin, Wenjing Ren, Ting Liu

Abstract: Truth discovery is to resolve conflicts and find the truth from multiple-source statements. Conventional methods mostly research based on the mutual effect between the reliability of sources and the credibility of statements, however, pay no attention to the mutual effect among the credibility of statements about the same object. We propose memory network based models to incorporate these two idea… ▽ More Truth discovery is to resolve conflicts and find the truth from multiple-source statements. Conventional methods mostly research based on the mutual effect between the reliability of sources and the credibility of statements, however, pay no attention to the mutual effect among the credibility of statements about the same object. We propose memory network based models to incorporate these two ideas to do the truth discovery. We use feedforward memory network and feedback memory network to learn the representation of the credibility of statements which are about the same object. Specially, we adopt memory mechanism to learn source reliability and use it through truth prediction. During learning models, we use multiple types of data (categorical data and continuous data) by assigning different weights automatically in the loss function based on their own effect on truth discovery prediction. The experiment results show that the memory network based models much outperform the state-of-the-art method and other baseline methods. △ Less

Submitted 6 November, 2016; originally announced November 2016.

Comments: 10 pages, 2 figures

Characterizing Elastic Turbulence in Channel Flows at Low Reynolds number

Authors: Boyang Qin, Paulo E. Arratia

Abstract: We experimentally investigate the flow of a viscoelastic fluid in a parallel shear geometry at low Reynolds number. As the flow becomes unstable via a nonlinear subcritical instability, velocimetry measurements show non-periodic fluctuations over a broad range of frequencies and wavelengths, consistent with the main features of elastic turbulence. Using the same experimental setup, we compare thes… ▽ More We experimentally investigate the flow of a viscoelastic fluid in a parallel shear geometry at low Reynolds number. As the flow becomes unstable via a nonlinear subcritical instability, velocimetry measurements show non-periodic fluctuations over a broad range of frequencies and wavelengths, consistent with the main features of elastic turbulence. Using the same experimental setup, we compare these features to those in the flow around cylinders, which is upstream to the parallel shear region; we find significant differences in power spectra scaling, intermittency statistics, and flow structures. We propose a simple mechanism to explain the growth of velocity fluctuations in parallel shear flows based on polymer stretching due to fluctuations in streamwise velocity gradients. △ Less

Submitted 25 July, 2017; v1 submitted 27 September, 2016; originally announced September 2016.

Comments: 14 pages, 4 figures

Aspect Level Sentiment Classification with Deep Memory Network

Authors: Duyu Tang, Bing Qin, Ting Liu

Abstract: We introduce a deep memory network for aspect level sentiment classification. Unlike feature-based SVM and sequential neural models such as LSTM, this approach explicitly captures the importance of each context word when inferring the sentiment polarity of an aspect. Such importance degree and text representation are calculated with multiple computational layers, each of which is a neural attentio… ▽ More We introduce a deep memory network for aspect level sentiment classification. Unlike feature-based SVM and sequential neural models such as LSTM, this approach explicitly captures the importance of each context word when inferring the sentiment polarity of an aspect. Such importance degree and text representation are calculated with multiple computational layers, each of which is a neural attention model over an external memory. Experiments on laptop and restaurant datasets demonstrate that our approach performs comparable to state-of-art feature based SVM system, and substantially better than LSTM and attention-based LSTM architectures. On both datasets we show that multiple computational layers could improve the performance. Moreover, our approach is also fast. The deep memory network with 9 layers is 15 times faster than LSTM with a CPU implementation. △ Less

Submitted 24 September, 2016; v1 submitted 28 May, 2016; originally announced May 2016.

Comments: published in EMNLP 2016

Exploring Segment Representations for Neural Segmentation Models

Authors: Yijia Liu, Wanxiang Che, Jiang Guo, Bing Qin, Ting Liu

Abstract: Many natural language processing (NLP) tasks can be generalized into segmentation problem. In this paper, we combine semi-CRF with neural network to solve NLP segmentation tasks. Our model represents a segment both by composing the input units and embedding the entire segment. We thoroughly study different composition functions and different segment embeddings. We conduct extensive experiments on… ▽ More Many natural language processing (NLP) tasks can be generalized into segmentation problem. In this paper, we combine semi-CRF with neural network to solve NLP segmentation tasks. Our model represents a segment both by composing the input units and embedding the entire segment. We thoroughly study different composition functions and different segment embeddings. We conduct extensive experiments on two typical segmentation tasks: named entity recognition (NER) and Chinese word segmentation (CWS). Experimental results show that our neural semi-CRF model benefits from representing the entire segment and achieves the state-of-the-art performance on CWS benchmark dataset and competitive results on the CoNLL03 dataset. △ Less

Submitted 19 April, 2016; originally announced April 2016.

Flexible Attribute-Based Encryption Applicable to Secure E-Healthcare Records

Authors: Bo Qin, Hua Deng, Qianhong Wu, Josep Domingo-Ferrer, David Naccache, Yunya Zhou

Abstract: In e-healthcare record systems (EHRS), attribute-based encryption (ABE) appears as a natural way to achieve fine-grained access control on health records. Some proposals exploit key-policy ABE (KP-ABE) to protect privacy in such a way that all users are associated with specific access policies and only the ciphertexts matching the users' access policies can be decrypted. An issue with KP-ABE is th… ▽ More In e-healthcare record systems (EHRS), attribute-based encryption (ABE) appears as a natural way to achieve fine-grained access control on health records. Some proposals exploit key-policy ABE (KP-ABE) to protect privacy in such a way that all users are associated with specific access policies and only the ciphertexts matching the users' access policies can be decrypted. An issue with KP-ABE is that it requires an a priori formulation of access policies during key generation, which is not always practicable in EHRS because the policies to access health records are sometimes determined after key generation. In this paper, we revisit KPABE and propose a dynamic ABE paradigm, referred to as access policy redefinable ABE (APR-ABE). To address the above issue, APR-ABE allows users to redefine their access policies and delegate keys for the redefined ones; hence a priori precise policies are no longer mandatory. We construct an APR-ABE scheme with short ciphertexts and prove its full security in the standard model under several static assumptions. △ Less

Submitted 21 December, 2015; originally announced December 2015.

Journal ref: International Journal of Information Security, Vol. 14, no. 6, pp. 499-511, 2015

A Planning based Framework for Essay Generation

Authors: Bing Qin, Duyu Tang, Xinwei Geng, Dandan Ning, Jiahao Liu, Ting Liu

Abstract: Generating an article automatically with computer program is a challenging task in artificial intelligence and natural language processing. In this paper, we target at essay generation, which takes as input a topic word in mind and generates an organized article under the theme of the topic. We follow the idea of text planning \cite{Reiter1997} and develop an essay generation framework. The framew… ▽ More Generating an article automatically with computer program is a challenging task in artificial intelligence and natural language processing. In this paper, we target at essay generation, which takes as input a topic word in mind and generates an organized article under the theme of the topic. We follow the idea of text planning \cite{Reiter1997} and develop an essay generation framework. The framework consists of three components, including topic understanding, sentence extraction and sentence reordering. For each component, we studied several statistical algorithms and empirically compared between them in terms of qualitative or quantitative analysis. Although we run experiments on Chinese corpus, the method is language independent and can be easily adapted to other language. We lay out the remaining challenges and suggest avenues for future research. △ Less

Submitted 6 January, 2016; v1 submitted 18 December, 2015; originally announced December 2015.

Effective LSTMs for Target-Dependent Sentiment Classification

Authors: Duyu Tang, Bing Qin, Xiaocheng Feng, Ting Liu

Abstract: Target-dependent sentiment classification remains a challenge: modeling the semantic relatedness of a target with its context words in a sentence. Different context words have different influences on determining the sentiment polarity of a sentence towards the target. Therefore, it is desirable to integrate the connections between target word and context words when building a learning system. In t… ▽ More Target-dependent sentiment classification remains a challenge: modeling the semantic relatedness of a target with its context words in a sentence. Different context words have different influences on determining the sentiment polarity of a sentence towards the target. Therefore, it is desirable to integrate the connections between target word and context words when building a learning system. In this paper, we develop two target dependent long short-term memory (LSTM) models, where target information is automatically taken into account. We evaluate our methods on a benchmark dataset from Twitter. Empirical results show that modeling sentence representation with standard LSTM does not perform well. Incorporating target information into LSTM can significantly boost the classification accuracy. The target-dependent LSTM models achieve state-of-the-art performances without using syntactic parser or external sentiment lexicons. △ Less

Submitted 29 September, 2016; v1 submitted 3 December, 2015; originally announced December 2015.

Comments: 7 pages, 3 figures published in COLING 2016

On Sketching Quadratic Forms

Authors: Alexandr Andoni, Jiecao Chen, Robert Krauthgamer, Bo Qin, David P. Woodruff, Qin Zhang

Abstract: We undertake a systematic study of sketching a quadratic form: given an $n \times n$ matrix $A$, create a succinct sketch $\textbf{sk}(A)$ which can produce (without further access to $A$) a multiplicative $(1+ε)$-approximation to $x^T A x$ for any desired query $x \in \mathbb{R}^n$. While a general matrix does not admit non-trivial sketches, positive semi-definite (PSD) matrices admit sketches of… ▽ More We undertake a systematic study of sketching a quadratic form: given an $n \times n$ matrix $A$, create a succinct sketch $\textbf{sk}(A)$ which can produce (without further access to $A$) a multiplicative $(1+ε)$-approximation to $x^T A x$ for any desired query $x \in \mathbb{R}^n$. While a general matrix does not admit non-trivial sketches, positive semi-definite (PSD) matrices admit sketches of size $Θ(ε^{-2} n)$, via the Johnson-Lindenstrauss lemma, achieving the "for each" guarantee, namely, for each query $x$, with a constant probability the sketch succeeds. (For the stronger "for all" guarantee, where the sketch succeeds for all $x$'s simultaneously, again there are no non-trivial sketches.) We design significantly better sketches for the important subclass of graph Laplacian matrices, which we also extend to symmetric diagonally dominant matrices. A sequence of work culminating in that of Batson, Spielman, and Srivastava (SIAM Review, 2014), shows that by choosing and reweighting $O(ε^{-2} n)$ edges in a graph, one achieves the "for all" guarantee. Our main results advance this front. $\bullet$ For the "for all" guarantee, we prove that Batson et al.'s bound is optimal even when we restrict to "cut queries" $x\in \{0,1\}^n$. In contrast, previous lower bounds showed the bound only for {\em spectral-sparsifiers}. $\bullet$ For the "for each" guarantee, we design a sketch of size $\tilde O(ε^{-1} n)$ bits for "cut queries" $x\in \{0,1\}^n$. We prove a nearly-matching lower bound of $Ω(ε^{-1} n)$ bits. For general queries $x \in \mathbb{R}^n$, we construct sketches of size $\tilde{O}(ε^{-1.6} n)$ bits. △ Less

Submitted 19 November, 2015; originally announced November 2015.

Comments: 46 pages; merging of arXiv:1403.7058 and arXiv:1412.8225