Showing 1–11 of 11 results for author: Dana, S

Comparison of LSTM autoencoder based deep learning enabled Bayesian inference using two time series reconstruction approaches

Authors: Saumik Dana

Abstract: In this work, we use a combination of Bayesian inference, Markov chain Monte Carlo and deep learning in the form of LSTM autoencoders to build and test a framework to provide robust estimates of injection rate from ground surface data in coupled flow and geomechanics problems. We use LSTM autoencoders to reconstruct the displacement time series for grid points on the top surface of a faulting due… ▽ More In this work, we use a combination of Bayesian inference, Markov chain Monte Carlo and deep learning in the form of LSTM autoencoders to build and test a framework to provide robust estimates of injection rate from ground surface data in coupled flow and geomechanics problems. We use LSTM autoencoders to reconstruct the displacement time series for grid points on the top surface of a faulting due to water injection problem. We then deploy this LSTM autoencoder based model instead of the high fidelity model in the Bayesian inference framework to estimate injection rate from displacement input. △ Less

Submitted 3 March, 2022; originally announced March 2022.

A Benchmark for Generalizable and Interpretable Temporal Question Answering over Knowledge Bases

Authors: Sumit Neelam, Udit Sharma, Hima Karanam, Shajith Ikbal, Pavan Kapanipathi, Ibrahim Abdelaziz, Nandana Mihindukulasooriya, Young-Suk Lee, Santosh Srivastava, Cezar Pendus, Saswati Dana, Dinesh Garg, Achille Fokoue, G P Shrivatsa Bhargav, Dinesh Khandelwal, Srinivas Ravishankar, Sairam Gurajada, Maria Chang, Rosario Uceda-Sosa, Salim Roukos, Alexander Gray, Guilherme Lima, Ryan Riegel, Francois Luus, L Venkata Subramaniam

Abstract: Knowledge Base Question Answering (KBQA) tasks that involve complex reasoning are emerging as an important research direction. However, most existing KBQA datasets focus primarily on generic multi-hop reasoning over explicit facts, largely ignoring other reasoning types such as temporal, spatial, and taxonomic reasoning. In this paper, we present a benchmark dataset for temporal reasoning, TempQA-… ▽ More Knowledge Base Question Answering (KBQA) tasks that involve complex reasoning are emerging as an important research direction. However, most existing KBQA datasets focus primarily on generic multi-hop reasoning over explicit facts, largely ignoring other reasoning types such as temporal, spatial, and taxonomic reasoning. In this paper, we present a benchmark dataset for temporal reasoning, TempQA-WD, to encourage research in extending the present approaches to target a more challenging set of complex reasoning tasks. Specifically, our benchmark is a temporal question answering dataset with the following advantages: (a) it is based on Wikidata, which is the most frequently curated, openly available knowledge base, (b) it includes intermediate sparql queries to facilitate the evaluation of semantic parsing based approaches for KBQA, and (c) it generalizes to multiple knowledge bases: Freebase and Wikidata. The TempQA-WD dataset is available at https://github.com/IBM/tempqa-wd. △ Less

Submitted 15 January, 2022; originally announced January 2022.

Comments: 7 pages, 2 figures, 7 tables. arXiv admin note: substantial text overlap with arXiv:2109.13430

SYGMA: System for Generalizable Modular Question Answering OverKnowledge Bases

Authors: Sumit Neelam, Udit Sharma, Hima Karanam, Shajith Ikbal, Pavan Kapanipathi, Ibrahim Abdelaziz, Nandana Mihindukulasooriya, Young-Suk Lee, Santosh Srivastava, Cezar Pendus, Saswati Dana, Dinesh Garg, Achille Fokoue, G P Shrivatsa Bhargav, Dinesh Khandelwal, Srinivas Ravishankar, Sairam Gurajada, Maria Chang, Rosario Uceda-Sosa, Salim Roukos, Alexander Gray, Guilherme LimaRyan Riegel, Francois Luus, L Venkata Subramaniam

Abstract: Knowledge Base Question Answering (KBQA) tasks that in-volve complex reasoning are emerging as an important re-search direction. However, most KBQA systems struggle withgeneralizability, particularly on two dimensions: (a) acrossmultiple reasoning types where both datasets and systems haveprimarily focused on multi-hop reasoning, and (b) across mul-tiple knowledge bases, where KBQA approaches are… ▽ More Knowledge Base Question Answering (KBQA) tasks that in-volve complex reasoning are emerging as an important re-search direction. However, most KBQA systems struggle withgeneralizability, particularly on two dimensions: (a) acrossmultiple reasoning types where both datasets and systems haveprimarily focused on multi-hop reasoning, and (b) across mul-tiple knowledge bases, where KBQA approaches are specif-ically tuned to a single knowledge base. In this paper, wepresent SYGMA, a modular approach facilitating general-izability across multiple knowledge bases and multiple rea-soning types. Specifically, SYGMA contains three high levelmodules: 1) KB-agnostic question understanding module thatis common across KBs 2) Rules to support additional reason-ing types and 3) KB-specific question mapping and answeringmodule to address the KB-specific aspects of the answer ex-traction. We demonstrate effectiveness of our system by evalu-ating on datasets belonging to two distinct knowledge bases,DBpedia and Wikidata. In addition, to demonstrate extensi-bility to additional reasoning types we evaluate on multi-hopreasoning datasets and a new Temporal KBQA benchmarkdataset on Wikidata, namedTempQA-WD1, introduced in thispaper. We show that our generalizable approach has bettercompetetive performance on multiple datasets on DBpediaand Wikidata that requires both multi-hop and temporal rea-soning △ Less

Submitted 27 September, 2021; originally announced September 2021.

Knowledge Graph Question Answering via SPARQL Silhouette Generation

Authors: Sukannya Purkayastha, Saswati Dana, Dinesh Garg, Dinesh Khandelwal, G P Shrivatsa Bhargav

Abstract: Knowledge Graph Question Answering (KGQA) has become a prominent area in natural language processing due to the emergence of large-scale Knowledge Graphs (KGs). Recently Neural Machine Translation based approaches are gaining momentum that translates natural language queries to structured query languages thereby solving the KGQA task. However, most of these methods struggle with out-of-vocabulary… ▽ More Knowledge Graph Question Answering (KGQA) has become a prominent area in natural language processing due to the emergence of large-scale Knowledge Graphs (KGs). Recently Neural Machine Translation based approaches are gaining momentum that translates natural language queries to structured query languages thereby solving the KGQA task. However, most of these methods struggle with out-of-vocabulary words where test entities and relations are not seen during training time. In this work, we propose a modular two-stage neural architecture to solve the KGQA task. The first stage generates a sketch of the target SPARQL called SPARQL silhouette for the input question. This comprises of (1) Noise simulator to facilitate out-of-vocabulary words and to reduce vocabulary size (2) seq2seq model for text to SPARQL silhouette generation. The second stage is a Neural Graph Search Module. SPARQL silhouette generated in the first stage is distilled in the second stage by substituting precise relation in the predicted structure. We simulate ideal and realistic scenarios by designing a noise simulator. Experimental results show that the quality of generated SPARQL silhouette in the first stage is outstanding for the ideal scenarios but for realistic scenarios (i.e. noisy linker), the quality of the resulting SPARQL silhouette drops drastically. However, our neural graph search module recovers it considerably. We show that our method can achieve reasonable performance improving the state-of-art by a margin of 3.72% F1 for the LC-QuAD-1 dataset. We believe, our proposed approach is novel and will lead to dynamic KGQA solutions that are suited for practical applications. △ Less

Submitted 6 September, 2021; originally announced September 2021.

Comments: 7 + 6 pages, 10 figures

Uncertainty Quantification in Friction Model for Earthquakes using Bayesian inference

Authors: Saumik Dana, Karthik Reddy Lyathakula

Abstract: This work presents a framework to inversely quantify uncertainty in the model parameters of the friction model using earthquake data via the Bayesian inference. The forward model is the popular rate- and state- friction (RSF) model along with the spring slider damper idealization. The inverse model is to determine the model parameters using the earthquake data as the response of the RSF model. The… ▽ More This work presents a framework to inversely quantify uncertainty in the model parameters of the friction model using earthquake data via the Bayesian inference. The forward model is the popular rate- and state- friction (RSF) model along with the spring slider damper idealization. The inverse model is to determine the model parameters using the earthquake data as the response of the RSF model. The conventional solution to the inverse problem is the deterministic parameter values, which may not represent the true value, and quantifying uncertainty in the model parameters increases confidence in the estimation. The uncertainty in the model parameters is estimated by the posterior distribution obtained through the Bayesian inversion. △ Less

Submitted 19 April, 2021; originally announced April 2021.

Two-grid method on unstructured tetrahedra: Applying computational geometry to staggered solution of coupled flow and mechanics problems

Authors: Saumik Dana, Xiaoxi Zhao, Birendra Jha

Abstract: We develop a computational framework that leverages the features of sophisticated software tools and numerics to tackle some of the pressing issues in the realm of earth sciences. The algorithms to handle the physics of multiphase flow, concomitant geomechanics all the way to the surface of the earth and the complex geometries of field cases with surfaces of discontinuity are stacked on top of eac… ▽ More We develop a computational framework that leverages the features of sophisticated software tools and numerics to tackle some of the pressing issues in the realm of earth sciences. The algorithms to handle the physics of multiphase flow, concomitant geomechanics all the way to the surface of the earth and the complex geometries of field cases with surfaces of discontinuity are stacked on top of each other in a modular fashion which allows for easy use to the end user. The current focus of the framework is to provide the user with tools for assessing seismic risks associated with energy technologies as well as for use in generating forward simulations in inversion analysis from data obtained using GPS and InSAR. In this work, we focus on one critical aspect in the development of the framework: the use of computational geometry in a two-grid method for unstructured tetrahedral meshes △ Less

Submitted 7 February, 2021; originally announced February 2021.

Leveraging Abstract Meaning Representation for Knowledge Base Question Answering

Authors: Pavan Kapanipathi, Ibrahim Abdelaziz, Srinivas Ravishankar, Salim Roukos, Alexander Gray, Ramon Astudillo, Maria Chang, Cristina Cornelio, Saswati Dana, Achille Fokoue, Dinesh Garg, Alfio Gliozzo, Sairam Gurajada, Hima Karanam, Naweed Khan, Dinesh Khandelwal, Young-Suk Lee, Yunyao Li, Francois Luus, Ndivhuwo Makondo, Nandana Mihindukulasooriya, Tahira Naseem, Sumit Neelam, Lucian Popa, Revanth Reddy , et al. (5 additional authors not shown)

Abstract: Knowledge base question answering (KBQA)is an important task in Natural Language Processing. Existing approaches face significant challenges including complex question understanding, necessity for reasoning, and lack of large end-to-end training datasets. In this work, we propose Neuro-Symbolic Question Answering (NSQA), a modular KBQA system, that leverages (1) Abstract Meaning Representation (AM… ▽ More Knowledge base question answering (KBQA)is an important task in Natural Language Processing. Existing approaches face significant challenges including complex question understanding, necessity for reasoning, and lack of large end-to-end training datasets. In this work, we propose Neuro-Symbolic Question Answering (NSQA), a modular KBQA system, that leverages (1) Abstract Meaning Representation (AMR) parses for task-independent question understanding; (2) a simple yet effective graph transformation approach to convert AMR parses into candidate logical queries that are aligned to the KB; (3) a pipeline-based approach which integrates multiple, reusable modules that are trained specifically for their individual tasks (semantic parser, entity andrelationship linkers, and neuro-symbolic reasoner) and do not require end-to-end training data. NSQA achieves state-of-the-art performance on two prominent KBQA datasets based on DBpedia (QALD-9 and LC-QuAD1.0). Furthermore, our analysis emphasizes that AMR is a powerful tool for KBQA systems. △ Less

Submitted 2 June, 2021; v1 submitted 3 December, 2020; originally announced December 2020.

Comments: Accepted to Findings of ACL

A machine learning accelerated FE$^2$ homogenization algorithm for elastic solids

Authors: Saumik Dana, Mary F Wheeler

Abstract: The FE$^2$ homogenization algorithm for multiscale modeling iterates between the macroscale and the microscale (represented by a representative volume element) till convergence is achieved at every increment of macroscale loading. The information exchange between the two scales occurs at the gauss points of the macroscale finite element discretization. The microscale problem is also solved using f… ▽ More The FE$^2$ homogenization algorithm for multiscale modeling iterates between the macroscale and the microscale (represented by a representative volume element) till convergence is achieved at every increment of macroscale loading. The information exchange between the two scales occurs at the gauss points of the macroscale finite element discretization. The microscale problem is also solved using finite elements on-the-fly thus rendering the algorithm computationally expensive for complex microstructures. We invoke machine learning to establish the input-output causality of the RVE boundary value problem using a neural network framework. This renders the RVE as a blackbox which gets the information from the macroscale as an input and gives information back to the macroscale as output, thereby eliminating the need for on-the-fly finite element solves at the RVE level. This framework has the potential to significantly accelerate the FE$^2$ algorithm. △ Less

Submitted 30 July, 2021; v1 submitted 21 March, 2020; originally announced March 2020.

Comments: arXiv admin note: substantial text overlap with arXiv:2002.03770

An efficient algorithm for numerical homogenization of fluid filled porous solids: part-I

Authors: Saumik Dana, Mary F Wheeler

Abstract: The concept of representative volume element or RVE is invoked to develop an algorithm for numerical homogenization of fluid filled porous solids. RVE based methods decouple analysis of a composite material into analyses at the local and global levels. The local level analysis models the microstructural details to determine effective properties by applying boundary conditions to the RVE and solvin… ▽ More The concept of representative volume element or RVE is invoked to develop an algorithm for numerical homogenization of fluid filled porous solids. RVE based methods decouple analysis of a composite material into analyses at the local and global levels. The local level analysis models the microstructural details to determine effective properties by applying boundary conditions to the RVE and solving the resultant boundary value problem. The composite structure is then replaced by an equivalent homogeneous material having the calculated effective properties. We combine the features of two techniques: one is the definition of a displacement field for the fluid phase to allow for a definition of a continuous displacement field across the microstructure and the other is the $FE^2$ numerical homogenization that couples the macroscale with the RVE scale via gauss points. △ Less

Submitted 28 July, 2021; v1 submitted 3 February, 2020; originally announced February 2020.

A simple framework for arriving at bounds on effective moduli in heterogeneous anisotropic poroelastic solids

Authors: Saumik Dana

Abstract: The concepts of representative volume element (RVE), statistical homogeneity and homogeneous boundary conditions are invoked to arrive at bounds on effective moduli for heterogeneous anisotropic poroelastic solids. The homogeneous displacement boundary condition applicable to linear elasticity is replaced by a homogeneous displacement-pressure boundary condition to arrive at an upper bound within… ▽ More The concepts of representative volume element (RVE), statistical homogeneity and homogeneous boundary conditions are invoked to arrive at bounds on effective moduli for heterogeneous anisotropic poroelastic solids. The homogeneous displacement boundary condition applicable to linear elasticity is replaced by a homogeneous displacement-pressure boundary condition to arrive at an upper bound within the RVE while the homogeneous traction boundary condition applicable to linear elasticity is replaced by a homogeneous traction-fluid content boundary condition to arrive at a lower bound within the RVE. Statistical homogeneity is then invoked to argue that the bounds obtained over the RVE are representative of the bounds obtained over the whole heterogeneous poroelastic solid. △ Less

Submitted 27 July, 2021; v1 submitted 19 December, 2019; originally announced December 2019.

The TechQA Dataset

Authors: Vittorio Castelli, Rishav Chakravarti, Saswati Dana, Anthony Ferritto, Radu Florian, Martin Franz, Dinesh Garg, Dinesh Khandelwal, Scott McCarley, Mike McCawley, Mohamed Nasr, Lin Pan, Cezar Pendus, John Pitrelli, Saurabh Pujar, Salim Roukos, Andrzej Sakrajda, Avirup Sil, Rosario Uceda-Sosa, Todd Ward, Rong Zhang

Abstract: We introduce TechQA, a domain-adaptation question answering dataset for the technical support domain. The TechQA corpus highlights two real-world issues from the automated customer support domain. First, it contains actual questions posed by users on a technical forum, rather than questions generated specifically for a competition or a task. Second, it has a real-world size -- 600 training, 310 de… ▽ More We introduce TechQA, a domain-adaptation question answering dataset for the technical support domain. The TechQA corpus highlights two real-world issues from the automated customer support domain. First, it contains actual questions posed by users on a technical forum, rather than questions generated specifically for a competition or a task. Second, it has a real-world size -- 600 training, 310 dev, and 490 evaluation question/answer pairs -- thus reflecting the cost of creating large labeled datasets with actual data. Consequently, TechQA is meant to stimulate research in domain adaptation rather than being a resource to build QA systems from scratch. The dataset was obtained by crawling the IBM Developer and IBM DeveloperWorks forums for questions with accepted answers that appear in a published IBM Technote---a technical document that addresses a specific technical issue. We also release a collection of the 801,998 publicly available Technotes as of April 4, 2019 as a companion resource that might be used for pretraining, to learn representations of the IT domain language. △ Less

Submitted 7 November, 2019; originally announced November 2019.

Comments: Long version of conference paper to be submitted