-
A Fast Template-based Approach to Automatically Identify Primary Text Content of a Web Page
Authors:
Dat Quoc Nguyen,
Dai Quoc Nguyen,
Son Bao Pham,
The Duy Bui
Abstract:
Search engines have become an indispensable tool for browsing information on the Internet. The user, however, is often annoyed by redundant results from irrelevant Web pages. One reason is because search engines also look at non-informative blocks of Web pages such as advertisement, navigation links, etc. In this paper, we propose a fast algorithm called FastContentExtractor to automatically detec…
▽ More
Search engines have become an indispensable tool for browsing information on the Internet. The user, however, is often annoyed by redundant results from irrelevant Web pages. One reason is because search engines also look at non-informative blocks of Web pages such as advertisement, navigation links, etc. In this paper, we propose a fast algorithm called FastContentExtractor to automatically detect main content blocks in a Web page by improving the ContentExtractor algorithm. By automatically identifying and storing templates representing the structure of content blocks in a website, content blocks of a new Web page from the Website can be extracted quickly. The hierarchical order of the output blocks is also maintained which guarantees that the extracted content blocks are in the same order as the original ones.
△ Less
Submitted 26 November, 2019;
originally announced November 2019.
-
Rethinking Self-Attention: Towards Interpretability in Neural Parsing
Authors:
Khalil Mrini,
Franck Dernoncourt,
Quan Tran,
Trung Bui,
Walter Chang,
Ndapa Nakashole
Abstract:
Attention mechanisms have improved the performance of NLP tasks while allowing models to remain explainable. Self-attention is currently widely used, however interpretability is difficult due to the numerous attention distributions. Recent work has shown that model representations can benefit from label-specific information, while facilitating interpretation of predictions. We introduce the Label…
▽ More
Attention mechanisms have improved the performance of NLP tasks while allowing models to remain explainable. Self-attention is currently widely used, however interpretability is difficult due to the numerous attention distributions. Recent work has shown that model representations can benefit from label-specific information, while facilitating interpretation of predictions. We introduce the Label Attention Layer: a new form of self-attention where attention heads represent labels. We test our novel layer by running constituency and dependency parsing experiments and show our new model obtains new state-of-the-art results for both tasks on both the Penn Treebank (PTB) and Chinese Treebank. Additionally, our model requires fewer self-attention layers compared to existing work. Finally, we find that the Label Attention heads learn relations between syntactic categories and show pathways to analyze errors.
△ Less
Submitted 29 October, 2020; v1 submitted 10 November, 2019;
originally announced November 2019.
-
A Simple but Effective BERT Model for Dialog State Tracking on Resource-Limited Systems
Authors:
Tuan Manh Lai,
Quan Hung Tran,
Trung Bui,
Daisuke Kihara
Abstract:
In a task-oriented dialog system, the goal of dialog state tracking (DST) is to monitor the state of the conversation from the dialog history. Recently, many deep learning based methods have been proposed for the task. Despite their impressive performance, current neural architectures for DST are typically heavily-engineered and conceptually complex, making it difficult to implement, debug, and ma…
▽ More
In a task-oriented dialog system, the goal of dialog state tracking (DST) is to monitor the state of the conversation from the dialog history. Recently, many deep learning based methods have been proposed for the task. Despite their impressive performance, current neural architectures for DST are typically heavily-engineered and conceptually complex, making it difficult to implement, debug, and maintain them in a production setting. In this work, we propose a simple but effective DST model based on BERT. In addition to its simplicity, our approach also has a number of other advantages: (a) the number of parameters does not grow with the ontology size (b) the model can operate in situations where the domain ontology may change dynamically. Experimental results demonstrate that our BERT-based model outperforms previous methods by a large margin, achieving new state-of-the-art results on the standard WoZ 2.0 dataset. Finally, to make the model small and fast enough for resource-restricted systems, we apply the knowledge distillation method to compress our model. The final compressed model achieves comparable results with the original model while being 8x smaller and 7x faster.
△ Less
Submitted 8 February, 2020; v1 submitted 28 October, 2019;
originally announced October 2019.
-
Zero Duality Gap in View of Abstract Convexity
Authors:
Hoa T. Bui,
Regina S. Burachik,
Alexander Y. Kruger,
David T. Yost
Abstract:
Using tools provided by the theory of abstract convexity, we extend conditions for zero duality gap to the context of nonconvex and nonsmooth optimization. Mimicking the classical setting, an abstract convex function is the upper envelope of a family of abstract affine functions (being conventional vertical translations of the abstract linear functions). We establish new conditions for zero dualit…
▽ More
Using tools provided by the theory of abstract convexity, we extend conditions for zero duality gap to the context of nonconvex and nonsmooth optimization. Mimicking the classical setting, an abstract convex function is the upper envelope of a family of abstract affine functions (being conventional vertical translations of the abstract linear functions). We establish new conditions for zero duality gap under no topological assumptions on the space of abstract linear functions. In particular, we prove that the zero duality gap property can be fully characterized in terms of an inclusion involving (abstract) $\varepsilon-$subdifferentials. This result is new even for the classical convex setting. Endowing the space of abstract linear functions with the topology of pointwise convergence, we extend several fundamental facts of functional/convex analysis. This includes (i) the classical Banach--Alaoglu--Bourbaki theorem (ii) the subdifferential sum rule, and (iii) a constraint qualification for zero duality gap which extends a fact established by Borwein, Burachik and Yao (2014) for the conventional convex case. As an application, we show with a specific example how our results can be exploited to show zero duality for a family of nonconvex, non-differentiable problems.
△ Less
Submitted 12 September, 2020; v1 submitted 4 October, 2019;
originally announced October 2019.
-
A Decision Tree Learning Approach for Mining Relationship-Based Access Control Policies
Authors:
Thang Bui,
Scott D. Stoller
Abstract:
Relationship-based access control (ReBAC) provides a high level of expressiveness and flexibility that promotes security and information sharing, by allowing policies to be expressed in terms of chains of relationships between entities. ReBAC policy mining algorithms have the potential to significantly reduce the cost of migration from legacy access control systems to ReBAC, by partially automatin…
▽ More
Relationship-based access control (ReBAC) provides a high level of expressiveness and flexibility that promotes security and information sharing, by allowing policies to be expressed in terms of chains of relationships between entities. ReBAC policy mining algorithms have the potential to significantly reduce the cost of migration from legacy access control systems to ReBAC, by partially automating the development of a ReBAC policy.
This paper presents new algorithms, called DTRM (Decision Tree ReBAC Miner) and DTRM$^-$, based on decision trees, for mining ReBAC policies from access control lists (ACLs) and information about entities. Compared to state-of-the-art ReBAC mining algorithms, our algorithms are significantly faster, achieve comparable policy quality, and can mine policies in a richer language.
△ Less
Submitted 12 May, 2020; v1 submitted 24 September, 2019;
originally announced September 2019.
-
A Gated Self-attention Memory Network for Answer Selection
Authors:
Tuan Lai,
Quan Hung Tran,
Trung Bui,
Daisuke Kihara
Abstract:
Answer selection is an important research problem, with applications in many areas. Previous deep learning based approaches for the task mainly adopt the Compare-Aggregate architecture that performs word-level comparison followed by aggregation. In this work, we take a departure from the popular Compare-Aggregate architecture, and instead, propose a new gated self-attention memory network for the…
▽ More
Answer selection is an important research problem, with applications in many areas. Previous deep learning based approaches for the task mainly adopt the Compare-Aggregate architecture that performs word-level comparison followed by aggregation. In this work, we take a departure from the popular Compare-Aggregate architecture, and instead, propose a new gated self-attention memory network for the task. Combined with a simple transfer learning technique from a large-scale online corpus, our model outperforms previous methods by a large margin, achieving new state-of-the-art results on two standard answer selection datasets: TrecQA and WikiQA.
△ Less
Submitted 13 September, 2019;
originally announced September 2019.
-
Necessary Conditions for Non-Intersection of Collections of Sets
Authors:
Hoa T. Bui,
Alexander Y. Kruger
Abstract:
This paper continues studies of non-intersection properties of finite collections of sets initiated 40 years ago by the extremal principle. We study elementary non-intersection properties of collections of sets, making the core of the conventional definitions of extremality and stationarity. In the setting of general Banach/Asplund spaces, we establish new primal (slope) and dual (generalized sepa…
▽ More
This paper continues studies of non-intersection properties of finite collections of sets initiated 40 years ago by the extremal principle. We study elementary non-intersection properties of collections of sets, making the core of the conventional definitions of extremality and stationarity. In the setting of general Banach/Asplund spaces, we establish new primal (slope) and dual (generalized separation) necessary conditions for these non-intersection properties. The results are applied to convergence analysis of alternating projections.
△ Less
Submitted 17 April, 2021; v1 submitted 18 September, 2019;
originally announced September 2019.
-
Propagate-Selector: Detecting Supporting Sentences for Question Answering via Graph Neural Networks
Authors:
Seunghyun Yoon,
Franck Dernoncourt,
Doo Soon Kim,
Trung Bui,
Kyomin Jung
Abstract:
In this study, we propose a novel graph neural network called propagate-selector (PS), which propagates information over sentences to understand information that cannot be inferred when considering sentences in isolation. First, we design a graph structure in which each node represents an individual sentence, and some pairs of nodes are selectively connected based on the text structure. Then, we d…
▽ More
In this study, we propose a novel graph neural network called propagate-selector (PS), which propagates information over sentences to understand information that cannot be inferred when considering sentences in isolation. First, we design a graph structure in which each node represents an individual sentence, and some pairs of nodes are selectively connected based on the text structure. Then, we develop an iterative attentive aggregation and a skip-combine method in which a node interacts with its neighborhood nodes to accumulate the necessary information. To evaluate the performance of the proposed approaches, we conduct experiments with the standard HotpotQA dataset. The empirical results demonstrate the superiority of our proposed approach, which obtains the best performances, compared to the widely used answer-selection models that do not consider the intersentential relationship.
△ Less
Submitted 16 February, 2020; v1 submitted 24 August, 2019;
originally announced August 2019.
-
Exploiting semi-supervised training through a dropout regularization in end-to-end speech recognition
Authors:
Subhadeep Dey,
Petr Motlicek,
Trung Bui,
Franck Dernoncourt
Abstract:
In this paper, we explore various approaches for semi supervised learning in an end to end automatic speech recognition (ASR) framework. The first step in our approach involves training a seed model on the limited amount of labelled data. Additional unlabelled speech data is employed through a data selection mechanism to obtain the best hypothesized output, further used to retrain the seed model.…
▽ More
In this paper, we explore various approaches for semi supervised learning in an end to end automatic speech recognition (ASR) framework. The first step in our approach involves training a seed model on the limited amount of labelled data. Additional unlabelled speech data is employed through a data selection mechanism to obtain the best hypothesized output, further used to retrain the seed model. However, uncertainties of the model may not be well captured with a single hypothesis. As opposed to this technique, we apply a dropout mechanism to capture the uncertainty by obtaining multiple hypothesized text transcripts of an speech recording. We assume that the diversity of automatically generated transcripts for an utterance will implicitly increase the reliability of the model. Finally, the data selection process is also applied on these hypothesized transcripts to reduce the uncertainty. Experiments on freely available TEDLIUM corpus and proprietary Adobe's internal dataset show that the proposed approach significantly reduces ASR errors, compared to the baseline model.
△ Less
Submitted 8 August, 2019;
originally announced August 2019.
-
Design and characteristic study of electron blocking layer free AlInN nanowire deep ultraviolet light-emitting diodes
Authors:
Ravi Teja Velpula,
Barsha Jain,
Thang Ha Quoc Bui,
Tan Thi Pham,
Van Thang Le,
Hoang-Duy Nguyen,
Trupti Ranjan Lenka,
Hieu Pham Trung Nguyen
Abstract:
We report on the illustration of the first electron blocking layer (EBL) free AlInN nanowire light-emitting diodes (LEDs) operating in the deep ultraviolet (DUV) wavelength region (sub-250 nm). We have systematically analyzed the results using APSYS software and compared with simulated AlGaN nanowire DUV LEDs. From the simulation results, significant efficiency droop was observed in AlGaN based de…
▽ More
We report on the illustration of the first electron blocking layer (EBL) free AlInN nanowire light-emitting diodes (LEDs) operating in the deep ultraviolet (DUV) wavelength region (sub-250 nm). We have systematically analyzed the results using APSYS software and compared with simulated AlGaN nanowire DUV LEDs. From the simulation results, significant efficiency droop was observed in AlGaN based devices, attributed to the significant electron leakage. However, compared to AlGaN nanowire DUV LEDs at similar emission wavelength, the proposed single quantum well (SQW) AlInN based light-emitters offer higher internal quantum efficiency without droop up to current density of 1500 A/cm2 and high output optical power. Moreover, we find that transverse magnetic polarized emission is ~ 5 orders stronger than transverse electric polarized emission at 238 nm wavelength. Further research shows that the performance of the AlInN DUV nanowire LEDs decreases with multiple QWs in the active region due to the presence of the non-uniform carrier distribution in the active region. This study provides important insights on the design of new type of high performance AlInN nanowire DUV LEDs, by replacing currently used AlGaN semiconductors.
△ Less
Submitted 15 July, 2019;
originally announced July 2019.
-
Expressing Visual Relationships via Language
Authors:
Hao Tan,
Franck Dernoncourt,
Zhe Lin,
Trung Bui,
Mohit Bansal
Abstract:
Describing images with text is a fundamental problem in vision-language research. Current studies in this domain mostly focus on single image captioning. However, in various real applications (e.g., image editing, difference interpretation, and retrieval), generating relational captions for two images, can also be very useful. This important problem has not been explored mostly due to lack of data…
▽ More
Describing images with text is a fundamental problem in vision-language research. Current studies in this domain mostly focus on single image captioning. However, in various real applications (e.g., image editing, difference interpretation, and retrieval), generating relational captions for two images, can also be very useful. This important problem has not been explored mostly due to lack of datasets and effective models. To push forward the research in this direction, we first introduce a new language-guided image editing dataset that contains a large number of real image pairs with corresponding editing instructions. We then propose a new relational speaker model based on an encoder-decoder architecture with static relational attention and sequential multi-head attention. We also extend the model with dynamic relational attention, which calculates visual alignment while decoding. Our models are evaluated on our newly collected and two public datasets consisting of image pairs annotated with relationship sentences. Experimental results, based on both automatic and human evaluation, demonstrate that our model outperforms all baselines and existing methods on all the datasets.
△ Less
Submitted 18 June, 2019; v1 submitted 18 June, 2019;
originally announced June 2019.
-
A Compare-Aggregate Model with Latent Clustering for Answer Selection
Authors:
Seunghyun Yoon,
Franck Dernoncourt,
Doo Soon Kim,
Trung Bui,
Kyomin Jung
Abstract:
In this paper, we propose a novel method for a sentence-level answer-selection task that is a fundamental problem in natural language processing. First, we explore the effect of additional information by adopting a pretrained language model to compute the vector representation of the input text and by applying transfer learning from a large-scale corpus. Second, we enhance the compare-aggregate mo…
▽ More
In this paper, we propose a novel method for a sentence-level answer-selection task that is a fundamental problem in natural language processing. First, we explore the effect of additional information by adopting a pretrained language model to compute the vector representation of the input text and by applying transfer learning from a large-scale corpus. Second, we enhance the compare-aggregate model by proposing a novel latent clustering method to compute additional information within the target corpus and by changing the objective function from listwise to pointwise. To evaluate the performance of the proposed approaches, experiments are performed with the WikiQA and TREC-QA datasets. The empirical results demonstrate the superiority of our proposed approach, which achieve state-of-the-art performance for both datasets.
△ Less
Submitted 23 August, 2019; v1 submitted 30 May, 2019;
originally announced May 2019.
-
Improving and Understanding Variational Continual Learning
Authors:
Siddharth Swaroop,
Cuong V. Nguyen,
Thang D. Bui,
Richard E. Turner
Abstract:
In the continual learning setting, tasks are encountered sequentially. The goal is to learn whilst i) avoiding catastrophic forgetting, ii) efficiently using model capacity, and iii) employing forward and backward transfer learning. In this paper, we explore how the Variational Continual Learning (VCL) framework achieves these desiderata on two benchmarks in continual learning: split MNIST and per…
▽ More
In the continual learning setting, tasks are encountered sequentially. The goal is to learn whilst i) avoiding catastrophic forgetting, ii) efficiently using model capacity, and iii) employing forward and backward transfer learning. In this paper, we explore how the Variational Continual Learning (VCL) framework achieves these desiderata on two benchmarks in continual learning: split MNIST and permuted MNIST. We first report significantly improved results on what was already a competitive approach. The improvements are achieved by establishing a new best practice approach to mean-field variational Bayesian neural networks. We then look at the solutions in detail. This allows us to obtain an understanding of why VCL performs as it does, and we compare the solution to what an `ideal' continual learning solution might be.
△ Less
Submitted 6 May, 2019;
originally announced May 2019.
-
ARCHANGEL: Tamper-proofing Video Archives using Temporal Content Hashes on the Blockchain
Authors:
Tu Bui,
Daniel Cooper,
John Collomosse,
Mark Bell,
Alex Green,
John Sheridan,
Jez Higgins,
Arindra Das,
Jared Keller,
Olivier Thereaux,
Alan Brown
Abstract:
We present ARCHANGEL; a novel distributed ledger based system for assuring the long-term integrity of digital video archives. First, we describe a novel deep network architecture for computing compact temporal content hashes (TCHs) from audio-visual streams with durations of minutes or hours. Our TCHs are sensitive to accidental or malicious content modification (tampering) but invariant to the co…
▽ More
We present ARCHANGEL; a novel distributed ledger based system for assuring the long-term integrity of digital video archives. First, we describe a novel deep network architecture for computing compact temporal content hashes (TCHs) from audio-visual streams with durations of minutes or hours. Our TCHs are sensitive to accidental or malicious content modification (tampering) but invariant to the codec used to encode the video. This is necessary due to the curatorial requirement for archives to format shift video over time to ensure future accessibility. Second, we describe how the TCHs (and the models used to derive them) are secured via a proof-of-authority blockchain distributed across multiple independent archives. We report on the efficacy of ARCHANGEL within the context of a trial deployment in which the national government archives of the United Kingdom, Estonia and Norway participated.
△ Less
Submitted 26 April, 2019;
originally announced April 2019.
-
Toponym Identification in Epidemiology Articles - A Deep Learning Approach
Authors:
MohammadReza Davari,
Leila Kosseim,
Tien D. Bui
Abstract:
When analyzing the spread of viruses, epidemiologists often need to identify the location of infected hosts. This information can be found in public databases, such as GenBank, however, information provided in these databases are usually limited to the country or state level. More fine-grained localization information requires phylogeographers to manually read relevant scientific articles. In this…
▽ More
When analyzing the spread of viruses, epidemiologists often need to identify the location of infected hosts. This information can be found in public databases, such as GenBank, however, information provided in these databases are usually limited to the country or state level. More fine-grained localization information requires phylogeographers to manually read relevant scientific articles. In this work we propose an approach to automate the process of place name identification from medical (epidemiology) articles. The focus of this paper is to propose a deep learning based model for toponym detection and experiment with the use of external linguistic features and domain specific information. The model was evaluated using a collection of 105 epidemiology articles from PubMed Central provided by the recent SemEval task 12. Our best detection model achieves an F1 score of $80.13\%$, a significant improvement compared to the state of the art of $69.84\%$. These results underline the importance of domain specific embedding as well as specific linguistic features in toponym detection in medical journals.
△ Less
Submitted 27 April, 2019; v1 submitted 24 April, 2019;
originally announced April 2019.
-
LiveSketch: Query Perturbations for Guided Sketch-based Visual Search
Authors:
John Collomosse,
Tu Bui,
Hailin Jin
Abstract:
LiveSketch is a novel algorithm for searching large image collections using hand-sketched queries. LiveSketch tackles the inherent ambiguity of sketch search by creating visual suggestions that augment the query as it is drawn, making query specification an iterative rather than one-shot process that helps disambiguate users' search intent. Our technical contributions are: a triplet convnet archit…
▽ More
LiveSketch is a novel algorithm for searching large image collections using hand-sketched queries. LiveSketch tackles the inherent ambiguity of sketch search by creating visual suggestions that augment the query as it is drawn, making query specification an iterative rather than one-shot process that helps disambiguate users' search intent. Our technical contributions are: a triplet convnet architecture that incorporates an RNN based variational autoencoder to search for images using vector (stroke-based) queries; real-time clustering to identify likely search intents (and so, targets within the search embedding); and the use of backpropagation from those targets to perturb the input stroke sequence, so suggesting alterations to the query in order to guide the search. We show improvements in accuracy and time-to-task over contemporary baselines using a 67M image corpus.
△ Less
Submitted 13 April, 2019;
originally announced April 2019.
-
Aggregated kernel based tests for signal detection in a regression model
Authors:
Thi Thien Trang Bui
Abstract:
Considering a regression model, we address the question of testing the nullity of the regression function. The testing procedure is available when the variance of the observations is unknown and does not depend on any prior information on the alternative. We first propose a single testing procedure based on a general symmetrickernel and an estimation of the variance of the observations. The corres…
▽ More
Considering a regression model, we address the question of testing the nullity of the regression function. The testing procedure is available when the variance of the observations is unknown and does not depend on any prior information on the alternative. We first propose a single testing procedure based on a general symmetrickernel and an estimation of the variance of the observations. The corresponding critical values are constructed to obtain non asymptotic level-? tests. We then introduce an aggregation procedure to avoid the difficult choice of the kernel and of the parameters of the kernel. The multiple tests satisfy non-asymptotic properties and are adaptive in the minimax sense over several classes of regular alternatives.
△ Less
Submitted 5 April, 2019;
originally announced April 2019.
-
Efficient and error-tolerant schemes for non-adaptive complex group testing and its application in complex disease genetics
Authors:
Thach V. Bui,
Minoru Kuribayashi,
Mahdi Cheraghchi,
Isao Echizen
Abstract:
The goal of combinatorial group testing is to efficiently identify up to $d$ defective items in a large population of $n$ items, where $d \ll n$. Defective items satisfy certain properties while the remaining items in the population do not. To efficiently identify defective items, a subset of items is pooled and then tested. In this work, we consider complex group testing (CmplxGT) in which a set…
▽ More
The goal of combinatorial group testing is to efficiently identify up to $d$ defective items in a large population of $n$ items, where $d \ll n$. Defective items satisfy certain properties while the remaining items in the population do not. To efficiently identify defective items, a subset of items is pooled and then tested. In this work, we consider complex group testing (CmplxGT) in which a set of defective items consists of subsets of positive items (called \textit{positive complexes}). CmplxGT is classified into two categories: classical CmplxGT (CCmplxGT) and generalized CmplxGT (GCmplxGT). In CCmplxGT, the outcome of a test on a subset of items is positive if the subset contains at least one positive complex, and negative otherwise. In GCmplxGT, the outcome of a test on a subset of items is positive if the subset has a certain number of items of some positive complex, and negative otherwise.
For CCmplxGT, we present a scheme that efficiently identifies all positive complexes in time $t \times \mathrm{poly}(d, \ln{n})$ in the presence of erroneous outcomes, where $t$ is a predefined parameter. As $d \ll n$, this is significantly better than the currently best time of $\mathrm{poly}(t) \times O(n \ln{n})$. Moreover, in specific cases, the number of tests in our proposed scheme is smaller than previous work. For GCmplxGT, we present a scheme that efficiently identifies all positive complexes. These schemes are directly applicable in various areas such as complex disease genetics, molecular biology, and learning a hidden graph.
△ Less
Submitted 31 March, 2019;
originally announced April 2019.
-
Dance Dance Generation: Motion Transfer for Internet Videos
Authors:
Yipin Zhou,
Zhaowen Wang,
Chen Fang,
Trung Bui,
Tamara L. Berg
Abstract:
This work presents computational methods for transferring body movements from one person to another with videos collected in the wild. Specifically, we train a personalized model on a single video from the Internet which can generate videos of this target person driven by the motions of other people. Our model is built on two generative networks: a human (foreground) synthesis net which generates…
▽ More
This work presents computational methods for transferring body movements from one person to another with videos collected in the wild. Specifically, we train a personalized model on a single video from the Internet which can generate videos of this target person driven by the motions of other people. Our model is built on two generative networks: a human (foreground) synthesis net which generates photo-realistic imagery of the target person in a novel pose, and a fusion net which combines the generated foreground with the scene (background), adding shadows or reflections as needed to enhance realism. We validate the the efficacy of our proposed models over baselines with qualitative and quantitative evaluations as well as a subjective test.
△ Less
Submitted 29 March, 2019;
originally announced April 2019.
-
Performance Evaluation of Frequency Domain Equalisation Based Colour Shift Keying Modulation Schemes Over Diffuse Optical Wireless Channels
Authors:
Ravinder Singh,
Timothy O'Farrell,
Thai C. Bui,
Mauro Biagi,
John P. R. David
Abstract:
Multi-colour light-emitting diode (LED) based visible light communication (VLC) benefits from wavelength diversity while providing indoor illumination. Colour shift keying (CSK) is a well-researched IEEE standardised multi-colour VLC modulation technique. This paper presents an investigation into the performance of tri-chromatic LED (TLED) CSK standardised in IEEE 802.15.7 and a quad-chromatic LED…
▽ More
Multi-colour light-emitting diode (LED) based visible light communication (VLC) benefits from wavelength diversity while providing indoor illumination. Colour shift keying (CSK) is a well-researched IEEE standardised multi-colour VLC modulation technique. This paper presents an investigation into the performance of tri-chromatic LED (TLED) CSK standardised in IEEE 802.15.7 and a quad-chromatic LED (QLED) CSK, over a range of diffuse optical wireless channels, and proposes the use of frequency domain equalisation (FDE) at the receiver to combat multipath dispersion. The investigation results show that the FDE enables the higher order CSK modulation modes to achieve a bit error rate (BER) of 10\textsuperscript{-6} for finite amounts of optical power while operating over highly dispersive channels and hence provide data links of up to 85.33 and 256 Mbit/s through TLED and QLED CSK, respectively, for a system bandwidth of 24 MHz. The overall optical power requirements of the CSK schemes can be reduce by up to 12.6 dB with the use of FDE at the cost of a small overhead due to cyclic prefix. The optical channel model used in this investigation includes the cross-talk and insertion losses caused by the optical properties of commercially available system front end devices.
△ Less
Submitted 25 March, 2019;
originally announced March 2019.
-
Efficient and Extensible Policy Mining for Relationship-Based Access Control
Authors:
Thang Bui,
Scott D. Stoller,
Hieu Le
Abstract:
Relationship-based access control (ReBAC) is a flexible and expressive framework that allows policies to be expressed in terms of chains of relationship between entities as well as attributes of entities. ReBAC policy mining algorithms have a potential to significantly reduce the cost of migration from legacy access control systems to ReBAC, by partially automating the development of a ReBAC polic…
▽ More
Relationship-based access control (ReBAC) is a flexible and expressive framework that allows policies to be expressed in terms of chains of relationship between entities as well as attributes of entities. ReBAC policy mining algorithms have a potential to significantly reduce the cost of migration from legacy access control systems to ReBAC, by partially automating the development of a ReBAC policy. Existing ReBAC policy mining algorithms support a policy language with a limited set of operators; this limits their applicability. This paper presents a ReBAC policy mining algorithm designed to be both (1) easily extensible (to support additional policy language features) and (2) scalable. The algorithm is based on Bui et al.'s evolutionary algorithm for ReBAC policy mining algorithm. First, we simplify their algorithm, in order to make it easier to extend and provide a methodology that extends it to handle new policy language features. However, extending the policy language increases the search space of candidate policies explored by the evolutionary algorithm, thus causes longer running time and/or worse results. To address the problem, we enhance the algorithm with a feature selection phase. The enhancement utilizes a neural network to identify useful features. We use the result of feature selection to reduce the evolutionary algorithm's search space. The new algorithm is easy to extend and, as shown by our experiments, is more efficient and produces better policies.
△ Less
Submitted 8 August, 2019; v1 submitted 18 March, 2019;
originally announced March 2019.
-
Invariants of the bi-Lipschitz contact equivalence of continuous definable function germs
Authors:
Tien-Son Pham,
Nguyen Thao Nguyen Bui
Abstract:
We construct an invariant of the bi-Lipschitz contact equivalence of continuous function germs definable in a polynomially bounded o-minimal structure, such as semialgebraic functions. For a germ $f,$ the invariant is given in terms of the leading coefficients of the asymptotic expansions of $f$ along the connected components of the tangency variety of $f.$
We construct an invariant of the bi-Lipschitz contact equivalence of continuous function germs definable in a polynomially bounded o-minimal structure, such as semialgebraic functions. For a germ $f,$ the invariant is given in terms of the leading coefficients of the asymptotic expansions of $f$ along the connected components of the tangency variety of $f.$
△ Less
Submitted 14 January, 2019;
originally announced January 2019.
-
Supervised Transfer Learning for Product Information Question Answering
Authors:
Tuan Manh Lai,
Trung Bui,
Nedim Lipka,
Sheng Li
Abstract:
Popular e-commerce websites such as Amazon offer community question answering systems for users to pose product related questions and experienced customers may provide answers voluntarily. In this paper, we show that the large volume of existing community question answering data can be beneficial when building a system for answering questions related to product facts and specifications. Our experi…
▽ More
Popular e-commerce websites such as Amazon offer community question answering systems for users to pose product related questions and experienced customers may provide answers voluntarily. In this paper, we show that the large volume of existing community question answering data can be beneficial when building a system for answering questions related to product facts and specifications. Our experimental results demonstrate that the performance of a model for answering questions related to products listed in the Home Depot website can be improved by a large margin via a simple transfer learning technique from an existing large-scale Amazon community question answering dataset. Transfer learning can result in an increase of about 10% in accuracy in the experimental setting where we restrict the size of the data of the target task used for training. As an application of this work, we integrate the best performing model trained in this work into a mobile-based shopping assistant and show its usefulness.
△ Less
Submitted 8 January, 2019;
originally announced January 2019.
-
Improved encoding and decoding for non-adaptive threshold group testing
Authors:
Thach V. Bui,
Minoru Kuribayashi,
Mahdi Cheraghchi,
Isao Echizen
Abstract:
The goal of threshold group testing is to identify up to $d$ defective items among a population of $n$ items, where $d$ is usually much smaller than $n$. A test is positive if it has at least $u$ defective items and negative otherwise. Our objective is to identify defective items in sublinear time the number of items, e.g., $\mathrm{poly}(d, \ln{n}),$ by using the number of tests as low as possibl…
▽ More
The goal of threshold group testing is to identify up to $d$ defective items among a population of $n$ items, where $d$ is usually much smaller than $n$. A test is positive if it has at least $u$ defective items and negative otherwise. Our objective is to identify defective items in sublinear time the number of items, e.g., $\mathrm{poly}(d, \ln{n}),$ by using the number of tests as low as possible. In this paper, we reduce the number of tests to $O \left( h \times \frac{d^2 \ln^2{n}}{\mathsf{W}^2(d \ln{n})} \right)$ and the decoding time to $O \left( \mathrm{dec}_0 \times h \right),$ where $\\mathrm{dec}_0 = O \left( \frac{d^{3.57} \ln^{6.26}{n}}{\mathsf{W}^{6.26}(d \ln{n})} \right) + O \left( \frac{d^6 \ln^4{n}}{\mathsf{W}^4(d \ln{n})} \right)$, $h = O\left( \frac{d_0^2 \ln{\frac{n}{d_0}}}{(1-p)^2} \right)$ , $d_0 = \max\{u, d - u \}$, $p \in [0, 1),$ and $\mathsf{W}(x) = Θ\left( \ln{x} - \ln{\ln{x}} \right).$ If the number of tests is increased to $O\left( h \times \frac{d^2\ln^3{n}}{\mathsf{W}^2(d \ln{n})} \right),$ the decoding complexity is reduced to $O \left(\mathrm{dec}_1 \times h \right),$ where $\mathrm{dec}_1 = \max \left\{ \frac{d^2 \ln^3{n}}{\mathsf{W}^2(d \ln{n})}, \frac{ud \ln^4{n}}{\mathsf{W}^3(d \ln{n})} \right\}.$ Moreover, our proposed scheme is capable of handling errors in test outcomes.
△ Less
Submitted 8 January, 2019;
originally announced January 2019.
-
Some new characterizations of intrinsic transversality in Hilbert spaces
Authors:
Nguyen Hieu Thao,
Hoa Thi Bui,
Nguyen Duy Cuong,
Michel Verhaegen
Abstract:
Motivated by a number of research questions concerning transversality-type properties of pairs of sets recently raised by Ioffe and Kruger, this paper reports several new characterizations of the intrinsic transversality property in Hilbert spaces. Our dual space results clarify the picture of intrinsic transversality, its variants and the only existing sufficient dual condition for subtransversal…
▽ More
Motivated by a number of research questions concerning transversality-type properties of pairs of sets recently raised by Ioffe and Kruger, this paper reports several new characterizations of the intrinsic transversality property in Hilbert spaces. Our dual space results clarify the picture of intrinsic transversality, its variants and the only existing sufficient dual condition for subtransversality, and actually unify them. New primal space characterizations of the intrinsic transversality which is originally a dual space condition lead to new understanding of the property in terms of primal space elements for the first time. As a consequence, the obtained analysis allows us to address a number of research questions asked by the two aforementioned researchers about the intrinsic transversality property in the Hilbert space setting.
△ Less
Submitted 31 December, 2018;
originally announced December 2018.
-
A System for Automated Image Editing from Natural Language Commands
Authors:
Jacqueline Brixey,
Ramesh Manuvinakurike,
Nham Le,
Tuan Lai,
Walter Chang,
Trung Bui
Abstract:
This work presents the task of modifying images in an image editing program using natural language written commands. We utilize a corpus of over 6000 image edit text requests to alter real world images collected via crowdsourcing. A novel framework composed of actions and entities to map a user's natural language request to executable commands in an image editing program is described. We resolve p…
▽ More
This work presents the task of modifying images in an image editing program using natural language written commands. We utilize a corpus of over 6000 image edit text requests to alter real world images collected via crowdsourcing. A novel framework composed of actions and entities to map a user's natural language request to executable commands in an image editing program is described. We resolve previously labeled annotator disagreement through a voting process and complete annotation of the corpus. We experimented with different machine learning models and found that the LSTM, the SVM, and the bidirectional LSTM-CRF joint models are the best to detect image editing actions and associated entities in a given utterance.
△ Less
Submitted 3 December, 2018;
originally announced December 2018.
-
Partitioned Variational Inference: A unified framework encompassing federated and continual learning
Authors:
Thang D. Bui,
Cuong V. Nguyen,
Siddharth Swaroop,
Richard E. Turner
Abstract:
Variational inference (VI) has become the method of choice for fitting many modern probabilistic models. However, practitioners are faced with a fragmented literature that offers a bewildering array of algorithmic options. First, the variational family. Second, the granularity of the updates e.g. whether the updates are local to each data point and employ message passing or global. Third, the meth…
▽ More
Variational inference (VI) has become the method of choice for fitting many modern probabilistic models. However, practitioners are faced with a fragmented literature that offers a bewildering array of algorithmic options. First, the variational family. Second, the granularity of the updates e.g. whether the updates are local to each data point and employ message passing or global. Third, the method of optimization (bespoke or blackbox, closed-form or stochastic updates, etc.). This paper presents a new framework, termed Partitioned Variational Inference (PVI), that explicitly acknowledges these algorithmic dimensions of VI, unifies disparate literature, and provides guidance on usage. Crucially, the proposed PVI framework allows us to identify new ways of performing VI that are ideally suited to challenging learning scenarios including federated learning (where distributed computing is leveraged to process non-centralized data) and continual learning (where new data and tasks arrive over time and must be accommodated quickly). We showcase these new capabilities by developing communication-efficient federated training of Bayesian neural networks and continual learning for Gaussian process models with private pseudo-points. The new methods significantly outperform the state-of-the-art, whilst being almost as straightforward to implement as standard VI.
△ Less
Submitted 27 November, 2018;
originally announced November 2018.
-
Automatic Face Aging in Videos via Deep Reinforcement Learning
Authors:
Chi Nhan Duong,
Khoa Luu,
Kha Gia Quach,
Nghia Nguyen,
Eric Patterson,
Tien D. Bui,
Ngan Le
Abstract:
This paper presents a novel approach to synthesize automatically age-progressed facial images in video sequences using Deep Reinforcement Learning. The proposed method models facial structures and the longitudinal face-aging process of given subjects coherently across video frames. The approach is optimized using a long-term reward, Reinforcement Learning function with deep feature extraction from…
▽ More
This paper presents a novel approach to synthesize automatically age-progressed facial images in video sequences using Deep Reinforcement Learning. The proposed method models facial structures and the longitudinal face-aging process of given subjects coherently across video frames. The approach is optimized using a long-term reward, Reinforcement Learning function with deep feature extraction from Deep Convolutional Neural Network. Unlike previous age-progression methods that are only able to synthesize an aged likeness of a face from a single input image, the proposed approach is capable of age-progressing facial likenesses in videos with consistently synthesized facial features across frames. In addition, the deep reinforcement learning method guarantees preservation of the visual identity of input faces after age-progression. Results on videos of our new collected aging face AGFW-v2 database demonstrate the advantages of the proposed solution in terms of both quality of age-progressed faces, temporal smoothness, and cross-age face verification.
△ Less
Submitted 24 April, 2019; v1 submitted 27 November, 2018;
originally announced November 2018.
-
Spectral multipliers of self-adjoint operators on Besov and Triebel--Lizorkin spaces associated to operators
Authors:
The Anh Bui,
Xuan Thinh Duong
Abstract:
Let $X$ be a space of homogeneous type and let $L$ be a nonnegative self-adjoint operator on $L^2(X)$ which satisfies a Gaussian estimate on its heat kernel. In this paper we prove a Hömander type spectral multiplier theorem for $L$ on the Besov and Triebel--Lizorkin spaces associated to $L$. Our work not only recovers the boundedness of the spectral multipliers on $L^p$ spaces and Hardy spaces as…
▽ More
Let $X$ be a space of homogeneous type and let $L$ be a nonnegative self-adjoint operator on $L^2(X)$ which satisfies a Gaussian estimate on its heat kernel. In this paper we prove a Hömander type spectral multiplier theorem for $L$ on the Besov and Triebel--Lizorkin spaces associated to $L$. Our work not only recovers the boundedness of the spectral multipliers on $L^p$ spaces and Hardy spaces associated to $L$, but also is the first one which proves the boundedness of a general spectral theorem on Besov and Triebel--Lizorkin spaces.
△ Less
Submitted 15 November, 2018;
originally announced November 2018.
-
Comb-resolved spectroscopy with immersion grating in long-wave infrared
Authors:
Kana Iwakuni,
Thinh Q. Bui,
Justin Niedermeyer,
Takashi Sukegawa,
Jun Ye
Abstract:
We have developed a dispersive spectrometer using a compact immersion grating for direct frequency comb spectroscopy in the long-wave infrared region of 8-10 μm. A frequency resolution of 463 MHz is achieved, which is the highest reported in this wavelength region with a dispersive direct frequency comb spectrometer. We also demonstrate individual mode-resolved imaging of the frequency comb spectr…
▽ More
We have developed a dispersive spectrometer using a compact immersion grating for direct frequency comb spectroscopy in the long-wave infrared region of 8-10 μm. A frequency resolution of 463 MHz is achieved, which is the highest reported in this wavelength region with a dispersive direct frequency comb spectrometer. We also demonstrate individual mode-resolved imaging of the frequency comb spectrum by Vernier cavity filtering and apply this to obtain both simple and complex molecular spectra. These results indicate that the immersion grating spectrometer offers the next advancement for sensitive, high-resolution spectroscopy of transient and large/complex molecules when combined with cavity enhancement and cooling techniques.
△ Less
Submitted 1 November, 2018;
originally announced November 2018.
-
Improving GAN with neighbors embedding and gradient matching
Authors:
Ngoc-Trung Tran,
Tuan-Anh Bui,
Ngai-Man Cheung
Abstract:
We propose two new techniques for training Generative Adversarial Networks (GANs). Our objectives are to alleviate mode collapse in GAN and improve the quality of the generated samples. First, we propose neighbor embedding, a manifold learning-based regularization to explicitly retain local structures of latent samples in the generated samples. This prevents generator from producing nearly identic…
▽ More
We propose two new techniques for training Generative Adversarial Networks (GANs). Our objectives are to alleviate mode collapse in GAN and improve the quality of the generated samples. First, we propose neighbor embedding, a manifold learning-based regularization to explicitly retain local structures of latent samples in the generated samples. This prevents generator from producing nearly identical data samples from different latent samples, and reduces mode collapse. We propose an inverse t-SNE regularizer to achieve this. Second, we propose a new technique, gradient matching, to align the distributions of the generated samples and the real samples. As it is challenging to work with high-dimensional sample distributions, we propose to align these distributions through the scalar discriminator scores. We constrain the difference between the discriminator scores of the real samples and generated ones. We further constrain the difference between the gradients of these discriminator scores. We derive these constraints from Taylor approximations of the discriminator function. We perform experiments to demonstrate that our proposed techniques are computationally simple and easy to be incorporated in existing systems. When Gradient matching and Neighbour embedding are applied together, our GN-GAN achieves outstanding results on 1D/2D synthetic, CIFAR-10 and STL-10 datasets, e.g. FID score of $30.80$ for the STL-10 dataset. Our code is available at: https://github.com/tntrung/gan
△ Less
Submitted 4 November, 2018;
originally announced November 2018.
-
A framework for generalized group testing with inhibitors and its potential application in neuroscience
Authors:
Thach V. Bui,
Minoru Kuribayashi,
Mahdi Cheraghchi,
Isao Echizen
Abstract:
The main goal of group testing with inhibitors (GTI) is to efficiently identify a small number of defective items and inhibitor items in a large set of items. A test on a subset of items is positive if the subset satisfies some specific properties. Inhibitor items cancel the effects of defective items, which often make the outcome of a test containing defective items negative. Different GTI models…
▽ More
The main goal of group testing with inhibitors (GTI) is to efficiently identify a small number of defective items and inhibitor items in a large set of items. A test on a subset of items is positive if the subset satisfies some specific properties. Inhibitor items cancel the effects of defective items, which often make the outcome of a test containing defective items negative. Different GTI models can be formulated by considering how specific properties have different cancellation effects. This work introduces generalized GTI (GGTI) in which a new type of items is added, i.e., hybrid items. A hybrid item plays the roles of both defectives items and inhibitor items. Since the number of instances of GGTI is large (more than 7 million), we introduce a framework for classifying all types of items non-adaptively, i.e., all tests are designed in advance. We then explain how GGTI can be used to classify neurons in neuroscience. Finally, we show how to realize our proposed scheme in practice.
△ Less
Submitted 10 February, 2019; v1 submitted 2 October, 2018;
originally announced October 2018.
-
Approximation of A Class of Non-Zero-Sum Investment and Reinsurance Games for Regime-Switching Jump-Diffusion Models
Authors:
Trang Bui,
Xiang Cheng,
Zhuo Jin,
George Yin
Abstract:
This work develops an approximation procedure for a class of non-zero-sum stochastic differential investment and reinsurance games between two insurance companies. Both proportional reinsurance and excess-of loss reinsurance policies are considered. We develop numerical algorithms to obtain the Nash equilibrium by adopting the Markov chain approximation methodology and applying the dynamical progr…
▽ More
This work develops an approximation procedure for a class of non-zero-sum stochastic differential investment and reinsurance games between two insurance companies. Both proportional reinsurance and excess-of loss reinsurance policies are considered. We develop numerical algorithms to obtain the Nash equilibrium by adopting the Markov chain approximation methodology and applying the dynamical programming principle for the nonlinear integro-differential Hamilton-Jacobi-Isaacs (HJI) equations. Furthermore, we establish the convergence of the approximation sequences and the approximation to the value functions. Numerical examples are presented to illustrate the applicability of the algorithms.
△ Less
Submitted 13 September, 2018;
originally announced September 2018.
-
Hybrid Competitive Lotka-Volterra Ecosystems: Countable Switching States and Two-time-scale Models
Authors:
Trang Bui,
George Yin
Abstract:
This work is concerned with competitive Lotka-Volterra model with Markov switching. A novelty of the contribution is that the Markov chain has a countable state space. Our main objective of the paper is to reduce the computational complexity by using the two-time-scale systems. Because existence and uniqueness as well as continuity of solutions for
Lotka-Volterra ecosystems with Markovian switch…
▽ More
This work is concerned with competitive Lotka-Volterra model with Markov switching. A novelty of the contribution is that the Markov chain has a countable state space. Our main objective of the paper is to reduce the computational complexity by using the two-time-scale systems. Because existence and uniqueness as well as continuity of solutions for
Lotka-Volterra ecosystems with Markovian switching in which the switching takes place in a countable set are not available, such properties are studied first. The two-time scale feature is highlighted by introducing a small parameter into the generator of the Markov chain. When the small parameter goes to 0, there is a limit system or reduced system. It is established in this paper that if the reduced system possesses certain properties such as permanence and extinction, etc., then the complex system also has the same properties when the parameter is sufficiently small. These results are obtained by using the perturbed Lyapunov function methods.
△ Less
Submitted 13 September, 2018;
originally announced September 2018.
-
Weighted Besov and Triebel--Lizorkin spaces associated to operators
Authors:
Huy-Qui Bui,
The Anh Bui,
Xuan Thinh Duong
Abstract:
Let $X$ be a space of homogeneous type and $L$ be a nonnegative self-adjoint operator on $L^2(X)$ satisfying Gaussian upper bounds on its heat kernels. In this paper we develop the theory of weighted Besov spaces $\dot{B}^{α,L}_{p,q,w}(X)$ and weighted Triebel--Lizorkin spaces $\dot{F}^{α,L}_{p,q,w}(X)$ associated to the operator $L$ for the full range $0<p,q\le \infty$, $α\in \mathbb R$ and $w$ b…
▽ More
Let $X$ be a space of homogeneous type and $L$ be a nonnegative self-adjoint operator on $L^2(X)$ satisfying Gaussian upper bounds on its heat kernels. In this paper we develop the theory of weighted Besov spaces $\dot{B}^{α,L}_{p,q,w}(X)$ and weighted Triebel--Lizorkin spaces $\dot{F}^{α,L}_{p,q,w}(X)$ associated to the operator $L$ for the full range $0<p,q\le \infty$, $α\in \mathbb R$ and $w$ being in the Muckenhoupt weight class $A_\infty$. Similarly to the classical case in the Euclidean setting, we prove that our new spaces satisfy important features such as continuous charaterizations in terms of square functions, atomic decompositions and the identifications with some well known function spaces such as Hardy type spaces and Sobolev type spaces. Moreover, with extra assumptions on the operator $L$, we prove that the new function spaces associated to $L$ coincide with the classical function spaces. Finally we apply our results to prove the boundedness of the fractional power of $L$ and the spectral multiplier of $L$ in our new function spaces.
△ Less
Submitted 8 September, 2018;
originally announced September 2018.
-
Regularity estimates for Green operators of Dirichlet and Neumann problems on weighted Hardy spaces
Authors:
The Anh Bui,
Xuan Thinh Duong
Abstract:
In this paper we first study the generalized weighted Hardy spaces $H^p_{L,w}(X)$ for $0<p\le 1$ associated to nonnegative self-adjoint operators $L$ satisfying Gaussian upper bounds on the space of homogeneous type $X$ in both cases of finite and infinite measure. We show that the weighted Hardy spaces defined via maximal functions and atomic decompositions coincide. Then we prove weighted regula…
▽ More
In this paper we first study the generalized weighted Hardy spaces $H^p_{L,w}(X)$ for $0<p\le 1$ associated to nonnegative self-adjoint operators $L$ satisfying Gaussian upper bounds on the space of homogeneous type $X$ in both cases of finite and infinite measure. We show that the weighted Hardy spaces defined via maximal functions and atomic decompositions coincide. Then we prove weighted regularity estimates for the Green operators of the inhomogeneous Dirichlet and Neumann problems in suitable bounded or unbounded domains including bounded semiconvex domains, convex regions above a Lipschitz graph and upper half-spaces. Our estimates are in terms of weighted $L^p$ spaces for the range $1<p<\infty$ and in terms of the new weighted Hardy spaces for the range $0<p\le 1$. Our regularity estimates for the Green operators under the weak smoothness assumptions on the boundaries of the domains are new, especially the estimates on Hardy spaces for the full range $0<p\le 1$ and the case of unbounded domains.
△ Less
Submitted 29 August, 2018;
originally announced August 2018.
-
Extremality, Stationarity and Generalized Separation of Collections of Sets
Authors:
Hoa T. Bui,
Alexander Y. Kruger
Abstract:
The core arguments used in various proofs of the extremal principle and its extensions as well as in primal and dual characterizations of approximate stationarity and transversality of collections of sets are exposed, analyzed and refined, leading to a unifying theory, encompassing all existing approaches to obtaining 'extremal' statements. For that, we examine and clarify quantitative relationshi…
▽ More
The core arguments used in various proofs of the extremal principle and its extensions as well as in primal and dual characterizations of approximate stationarity and transversality of collections of sets are exposed, analyzed and refined, leading to a unifying theory, encompassing all existing approaches to obtaining 'extremal' statements. For that, we examine and clarify quantitative relationships between the parameters involved in the respective definitions and statements. Some new characterizations of extremality properties are obtained.
△ Less
Submitted 29 December, 2018; v1 submitted 16 August, 2018;
originally announced August 2018.
-
Protein escape at the ribosomal exit tunnel: Effects of native interactions, tunnel length and macromolecular crowding
Authors:
Phuong Thuy Bui,
Trinh Xuan Hoang
Abstract:
How fast a post-translational nascent protein escapes from the ribosomal exit tunnel is relevant to its folding and protection against aggregation. Here, by using Langevin molecular dynamics, we show that non-local native interactions help decreasing the escape time, and foldable proteins generally escape much faster than same-length self-repulsive homopolymers at low temperatures. The escape proc…
▽ More
How fast a post-translational nascent protein escapes from the ribosomal exit tunnel is relevant to its folding and protection against aggregation. Here, by using Langevin molecular dynamics, we show that non-local native interactions help decreasing the escape time, and foldable proteins generally escape much faster than same-length self-repulsive homopolymers at low temperatures. The escape process, however, is slowed down by the local interactions that stabilize the α-helices. The escape time is found to increase with both the tunnel length and the concentration of macromolecular crowders outside the tunnel. We show that a simple diffusion model described by the Smoluchowski equation with an effective linear potential can be used to map out the escape time distribution for various tunnel lengths and various crowder concentrations. The consistency between the simulation data and the diffusion model however is found only for the tunnel length smaller than a cross-over length of 90 Å to 110 Å, above which the escape time increases much faster with the tunnel length. It is suggested that the length of ribosomal exit tunnel has been selected by evolution to facilitate both the efficient folding and efficient escape of single domain proteins. We show that macromolecular crowders lead to an increase of the escape time, and attractive crowders are unfavorable for the folding of nascent polypeptide.
△ Less
Submitted 26 July, 2018;
originally announced July 2018.
-
Distribution regression model with a Reproducing Kernel Hilbert Space approach
Authors:
Thi Thien Trang Bui,
J-M Loubes,
Laurent Risser,
Patricia Balaresque
Abstract:
In this paper, we introduce a new distribution regression model for probability distributions. This model is based on a Reproducing Kernel Hilbert Space (RKHS) regression framework, where universal kernels are built using Wasserstein distances for distributions belonging to W 2 ($Ω$) and $Ω$ is a compact subspace of R. We prove the universal kernel property of such kernels and use this setting to…
▽ More
In this paper, we introduce a new distribution regression model for probability distributions. This model is based on a Reproducing Kernel Hilbert Space (RKHS) regression framework, where universal kernels are built using Wasserstein distances for distributions belonging to W 2 ($Ω$) and $Ω$ is a compact subspace of R. We prove the universal kernel property of such kernels and use this setting to perform regressions on functions. Different regression models are first compared with the proposed one on simulated functional data. We then apply our regression model to transient evoked otoascoutic emission (TEOAE) distribution responses and real predictors of the age.
△ Less
Submitted 4 October, 2019; v1 submitted 27 June, 2018;
originally announced June 2018.
-
An Interpretable Deep Hierarchical Semantic Convolutional Neural Network for Lung Nodule Malignancy Classification
Authors:
Shiwen Shen,
Simon X. Han,
Denise R. Aberle,
Alex A. T. Bui,
Willliam Hsu
Abstract:
While deep learning methods are increasingly being applied to tasks such as computer-aided diagnosis, these models are difficult to interpret, do not incorporate prior domain knowledge, and are often considered as a "black-box." The lack of model interpretability hinders them from being fully understood by target users such as radiologists. In this paper, we present a novel interpretable deep hier…
▽ More
While deep learning methods are increasingly being applied to tasks such as computer-aided diagnosis, these models are difficult to interpret, do not incorporate prior domain knowledge, and are often considered as a "black-box." The lack of model interpretability hinders them from being fully understood by target users such as radiologists. In this paper, we present a novel interpretable deep hierarchical semantic convolutional neural network (HSCNN) to predict whether a given pulmonary nodule observed on a computed tomography (CT) scan is malignant. Our network provides two levels of output: 1) low-level radiologist semantic features, and 2) a high-level malignancy prediction score. The low-level semantic outputs quantify the diagnostic features used by radiologists and serve to explain how the model interprets the images in an expert-driven manner. The information from these low-level tasks, along with the representations learned by the convolutional layers, are then combined and used to infer the high-level task of predicting nodule malignancy. This unified architecture is trained by optimizing a global loss function including both low- and high-level tasks, thereby learning all the parameters within a joint framework. Our experimental results using the Lung Image Database Consortium (LIDC) show that the proposed method not only produces interpretable lung cancer predictions but also achieves significantly better results compared to common 3D CNN approaches.
△ Less
Submitted 2 June, 2018;
originally announced June 2018.
-
Sublinear decoding schemes for non-adaptive group testing with inhibitors
Authors:
Thach V. Bui,
Minoru Kuribayashi,
Tetsuya Kojima,
Isao Echizen
Abstract:
Identification of up to $d$ defective items and up to $h$ inhibitors in a set of $n$ items is the main task of non-adaptive group testing with inhibitors. To efficiently reduce the cost of this Herculean task, a subset of the $n$ items is formed and then tested. This is called \textit{group testing}. A test outcome on a subset of items is positive if the subset contains at least one defective item…
▽ More
Identification of up to $d$ defective items and up to $h$ inhibitors in a set of $n$ items is the main task of non-adaptive group testing with inhibitors. To efficiently reduce the cost of this Herculean task, a subset of the $n$ items is formed and then tested. This is called \textit{group testing}. A test outcome on a subset of items is positive if the subset contains at least one defective item and no inhibitors, and negative otherwise. We present two decoding schemes for efficiently identifying the defective items and the inhibitors in the presence of $e$ erroneous outcomes in time $\mathsf{poly}(d, h, e, \log_2{n})$, which is sublinear to the number of items $n$. This decoding complexity significantly improves the state-of-the-art schemes in which the decoding time is linear to the number of items $n$, i.e., $\mathsf{poly}(d, h, e, n)$. Moreover, each column of the measurement matrices associated with the proposed schemes can be nonrandomly generated in polynomial order of the number of rows. As a result, one can save space for storing them. Simulation results confirm our theoretical analysis. When the number of items is sufficiently large, the decoding time in our proposed scheme is smallest in comparison with existing work. In addition, when some erroneous outcomes are allowed, the number of tests in the proposed scheme is often smaller than the number of tests in existing work.
△ Less
Submitted 9 January, 2019; v1 submitted 29 May, 2018;
originally announced May 2018.
-
Spin-Hall magnetoresistance in a low-dimensional magnetic insulator
Authors:
Saül Vélez,
Vitaly N. Golovach,
Juan M. Gomez-Perez,
Cong Tinh Bui,
F. Rivadulla,
Luis E. Hueso,
F. Sebastian Bergeret,
Fèlix Casanova
Abstract:
We observe an unusual behavior of the spin Hall magnetoresistance (SMR) measured in a Pt ultra-thin film deposited on a ferromagnetic insulator, which is a tensile-strained LaCoO3 (LCO) thin film with the Curie temperature Tc=85K. The SMR displays a strong magnetic-field dependence below Tc, with the SMR amplitude continuing to increase (linearly) with increasing the field far beyond the saturatio…
▽ More
We observe an unusual behavior of the spin Hall magnetoresistance (SMR) measured in a Pt ultra-thin film deposited on a ferromagnetic insulator, which is a tensile-strained LaCoO3 (LCO) thin film with the Curie temperature Tc=85K. The SMR displays a strong magnetic-field dependence below Tc, with the SMR amplitude continuing to increase (linearly) with increasing the field far beyond the saturation value of the ferromagnet. The SMR amplitude decreases gradually with raising the temperature across Tc and remains measurable even above Tc. Moreover, no hysteresis is observed in the field dependence of the SMR. These results indicate that a novel low-dimensional magnetic system forms on the surface of LCO and that the Pt/LCO interface decouples magnetically from the rest of the LCO thin film. To explain the experiment, we revisit the derivation of the SMR corrections and relate the spin-mixing conductances to the microscopic quantities describing the magnetism at the interface. Our results can be used as a technique to probe quantum magnetism on the surface of a magnetic insulator.
△ Less
Submitted 5 May, 2019; v1 submitted 28 May, 2018;
originally announced May 2018.
-
On three soft rectangle packing problems with guillotine constraints
Authors:
Quoc Trung Bui,
Thibaut Vidal,
Minh Hoàng Hà
Abstract:
We investigate how to partition a rectangular region of length $L_1$ and height $L_2$ into $n$ rectangles of given areas $(a_1, \dots, a_n)$ using two-stage guillotine cuts, so as to minimize either (i) the sum of the perimeters, (ii) the largest perimeter, or (iii) the maximum aspect ratio of the rectangles. These problems play an important role in the ongoing Vietnamese land-allocation reform, a…
▽ More
We investigate how to partition a rectangular region of length $L_1$ and height $L_2$ into $n$ rectangles of given areas $(a_1, \dots, a_n)$ using two-stage guillotine cuts, so as to minimize either (i) the sum of the perimeters, (ii) the largest perimeter, or (iii) the maximum aspect ratio of the rectangles. These problems play an important role in the ongoing Vietnamese land-allocation reform, as well as in the optimization of matrix multiplication algorithms. We show that the first problem can be solved to optimality in $\mathcal{O}(n \log n)$, while the two others are NP-hard. We propose mixed integer programming (MIP) formulations and a binary search-based approach for solving the NP-hard problems. Experimental analyses are conducted to compare the solution approaches in terms of computational efficiency and solution quality, for different objectives.
△ Less
Submitted 9 May, 2018;
originally announced May 2018.
-
Functional calculus of operators with heat kernel bounds on non-doubling manifolds with ends
Authors:
The Anh Bui,
Xuan Thinh Duong,
Ji Li,
Brett D. Wick
Abstract:
Let $Δ$ be the Laplace--Beltrami operator acting on a non-doubling manifold with two ends $\mathbb R^m \sharp \mathcal R^n$ with $m > n \ge 3$. Let $\frak{h}_t(x,y)$ be the kernels of the semigroup $e^{-tΔ}$ generated by $Δ$. We say that a non-negative self-adjoint operator $L$ on $L^2(\mathbb R^m \sharp \mathcal R^n)$ has a heat kernel with upper bound of Gaussian type if the kernel $h_t(x,y)$ of…
▽ More
Let $Δ$ be the Laplace--Beltrami operator acting on a non-doubling manifold with two ends $\mathbb R^m \sharp \mathcal R^n$ with $m > n \ge 3$. Let $\frak{h}_t(x,y)$ be the kernels of the semigroup $e^{-tΔ}$ generated by $Δ$. We say that a non-negative self-adjoint operator $L$ on $L^2(\mathbb R^m \sharp \mathcal R^n)$ has a heat kernel with upper bound of Gaussian type if the kernel $h_t(x,y)$ of the semigroup $e^{-tL}$ satisfies $ h_t(x,y) \le C \frak{h}_{αt}(x,y)$ for some constants $C$ and $α$. This class of operators includes the Schrödinger operator $L = Δ+ V$ where $V$ is an arbitrary non-negative potential. We then obtain upper bounds of the Poisson semigroup kernel of $L$ together with its time derivatives and use them to show the weak type $(1,1)$ estimate for the holomorphic functional calculus $\frak{M}(\sqrt{L})$ where $\frak{M}(z)$ is a function of Laplace transform type. Our result covers the purely imaginary powers $L^{is}, s \in \mathbb R$, as a special case and serves as a model case for weak type $(1,1)$ estimates of singular integrals with non-smooth kernels on non-doubling spaces.
△ Less
Submitted 25 November, 2018; v1 submitted 30 April, 2018;
originally announced April 2018.
-
ARCHANGEL: Trusted Archives of Digital Public Documents
Authors:
John Collomosse,
Tu Bui,
Alan Brown,
John Sheridan,
Alex Green,
Mark Bell,
Jamie Fawcett,
Jez Higgins,
Olivier Thereaux
Abstract:
We present ARCHANGEL; a de-centralised platform for ensuring the long-term integrity of digital documents stored within public archives. Document integrity is fundamental to public trust in archives. Yet currently that trust is built upon institutional reputation --- trust at face value in a centralised authority, like a national government archive or University. ARCHANGEL proposes a shift to a te…
▽ More
We present ARCHANGEL; a de-centralised platform for ensuring the long-term integrity of digital documents stored within public archives. Document integrity is fundamental to public trust in archives. Yet currently that trust is built upon institutional reputation --- trust at face value in a centralised authority, like a national government archive or University. ARCHANGEL proposes a shift to a technological underscoring of that trust, using distributed ledger technology (DLT) to cryptographically guarantee the provenance, immutability and so the integrity of archived documents. We describe the ARCHANGEL architecture, and report on a prototype of that architecture build over the Ethereum infrastructure. We report early evaluation and feedback of ARCHANGEL from stakeholders in the research data archives space.
△ Less
Submitted 23 April, 2018;
originally announced April 2018.
-
A Deep Learning Approach for Forecasting Air Pollution in South Korea Using LSTM
Authors:
Tien-Cuong Bui,
Van-Duc Le,
Sang-Kyun Cha
Abstract:
Tackling air pollution is an imperative problem in South Korea, especially in urban areas, over the last few years. More specially, South Korea has joined the ranks of the world's most polluted countries alongside with other Asian capitals, such as Beijing or Delhi. Much research is being conducted in environmental science to evaluate the dangerous impact of particulate matters on public health. B…
▽ More
Tackling air pollution is an imperative problem in South Korea, especially in urban areas, over the last few years. More specially, South Korea has joined the ranks of the world's most polluted countries alongside with other Asian capitals, such as Beijing or Delhi. Much research is being conducted in environmental science to evaluate the dangerous impact of particulate matters on public health. Besides that, deterministic models of air pollutant behavior are also generated; however, this is both complex and often inaccurate. On the contrary, deep recurrent neural network reveals potent potential on forecasting out-comes of time-series data and has become more prevalent. This paper uses Recurrent Neural Network (RNN) with Long Short-Term Memory units as a framework for leveraging knowledge from time-series data of air pollution and meteorological information in Daegu, Seoul, Beijing, and Shenyang. Additionally, we use encoder-decoder model, which is similar to machine comprehension problems, as a crucial part of our prediction machine. Finally, we investigate the prediction accuracy of various configurations. Our experiments prevent the efficiency of integrating multiple layers of RNN on prediction model when forecasting far timesteps ahead. This research is a significant motivation for not only continuing researching on urban air quality but also help the government leverage that insight to enact beneficial policies
△ Less
Submitted 10 May, 2018; v1 submitted 21 April, 2018;
originally announced April 2018.
-
Characterizations of Nonsmooth Robustly Quasiconvex Functions
Authors:
Hoa T. Bui,
Pham Duy Khanh,
Tran Thi Tu Trinh
Abstract:
Two criteria for the robust quasiconvexity of lower semicontinuous functions are established in terms of Fréchet subdifferentials in Asplund spaces.
Two criteria for the robust quasiconvexity of lower semicontinuous functions are established in terms of Fréchet subdifferentials in Asplund spaces.
△ Less
Submitted 18 April, 2018;
originally announced April 2018.
-
A Discourse-Aware Attention Model for Abstractive Summarization of Long Documents
Authors:
Arman Cohan,
Franck Dernoncourt,
Doo Soon Kim,
Trung Bui,
Seokhwan Kim,
Walter Chang,
Nazli Goharian
Abstract:
Neural abstractive summarization models have led to promising results in summarizing relatively short documents. We propose the first model for abstractive summarization of single, longer-form documents (e.g., research papers). Our approach consists of a new hierarchical encoder that models the discourse structure of a document, and an attentive discourse-aware decoder to generate the summary. Emp…
▽ More
Neural abstractive summarization models have led to promising results in summarizing relatively short documents. We propose the first model for abstractive summarization of single, longer-form documents (e.g., research papers). Our approach consists of a new hierarchical encoder that models the discourse structure of a document, and an attentive discourse-aware decoder to generate the summary. Empirical results on two large-scale datasets of scientific papers show that our model significantly outperforms state-of-the-art models.
△ Less
Submitted 22 May, 2018; v1 submitted 16 April, 2018;
originally announced April 2018.
-
Efficient (nonrandom) construction and decoding for non-adaptive group testing
Authors:
Thach V. Bui,
Minoru Kuribayashi,
Tetsuya Kojima,
Roghayyeh Haghvirdinezhad,
Isao Echizen
Abstract:
The task of non-adaptive group testing is to identify up to $d$ defective items from $N$ items, where a test is positive if it contains at least one defective item, and negative otherwise. If there are $t$ tests, they can be represented as a $t \times N$ measurement matrix. We have answered the question of whether there exists a scheme such that a larger measurement matrix, built from a given…
▽ More
The task of non-adaptive group testing is to identify up to $d$ defective items from $N$ items, where a test is positive if it contains at least one defective item, and negative otherwise. If there are $t$ tests, they can be represented as a $t \times N$ measurement matrix. We have answered the question of whether there exists a scheme such that a larger measurement matrix, built from a given $t\times N$ measurement matrix, can be used to identify up to $d$ defective items in time $O(t \log_2{N})$. In the meantime, a $t \times N$ nonrandom measurement matrix with $t = O \left(\frac{d^2 \log_2^2{N}}{(\log_2(d\log_2{N}) - \log_2{\log_2(d\log_2{N})})^2} \right)$ can be obtained to identify up to $d$ defective items in time $\mathrm{poly}(t)$. This is much better than the best well-known bound, $t = O \left( d^2 \log_2^2{N} \right)$. For the special case $d = 2$, there exists an efficient nonrandom construction in which at most two defective items can be identified in time $4\log_2^2{N}$ using $t = 4\log_2^2{N}$ tests. Numerical results show that our proposed scheme is more practical than existing ones, and experimental results confirm our theoretical analysis. In particular, up to $2^{7} = 128$ defective items can be identified in less than $16$s even for $N = 2^{100}$.
△ Less
Submitted 8 October, 2018; v1 submitted 11 April, 2018;
originally announced April 2018.
-
Emergent Properties of Antiagglomerant Films Control Methane Transport: Implications for Hydrate Management
Authors:
François Sicard,
Tai Bui,
Deepak Monteiro,
Qiang Lan,
Mark Ceglio,
Charlotte Burress,
Alberto Striolo
Abstract:
The relation between collective properties and performance of antiagglomerants (AAs) used in hydrate management is handled using molecular dynamics simulations and enhanced sampling techniques. A thin film of AAs adsorbed at the interface between one flat sII methane hydrate substrate and a fluid hydrocarbon mixture containing methane and n-dodecane is studied. The AA considered is a surface-activ…
▽ More
The relation between collective properties and performance of antiagglomerants (AAs) used in hydrate management is handled using molecular dynamics simulations and enhanced sampling techniques. A thin film of AAs adsorbed at the interface between one flat sII methane hydrate substrate and a fluid hydrocarbon mixture containing methane and n-dodecane is studied. The AA considered is a surface-active compound with a complex hydrophilic head that contains both amide and tertiary ammonium cation groups and hydrophobic tails. At sufficiently high AA density, the interplay between the surfactant layer and the liquid hydrocarbon excludes methane from the interfacial region. In this scenario, we combine metadynamics and umbrella sampling frameworks to study accurately the free-energy landscape and the equilibrium rates associated with the transport of one methane molecule across the AA film. We observe that local configurational changes of the liquid hydrocarbon packed within the AA film are associated with high free-energy barriers for methane transport. The time scales estimated for the transport of methane across the AA film can be, in some cases, comparable to those reported in the literature for the growth of the hydrates, suggesting that one possible mechanism by which AAs delay the formation of hydrate plugs could be providing a barrier to methane transport. Considering the interplay between structural design and collective properties of AAs might be of relevance to improve their performance in flow assurance.
△ Less
Submitted 4 April, 2018;
originally announced April 2018.