-
A Unified Framework for Human-Allied Learning of Probabilistic Circuits
Authors:
Athresh Karanam,
Saurabh Mathur,
Sahil Sidheekh,
Sriraam Natarajan
Abstract:
Probabilistic Circuits (PCs) have emerged as an efficient framework for representing and learning complex probability distributions. Nevertheless, the existing body of research on PCs predominantly concentrates on data-driven parameter learning, often neglecting the potential of knowledge-intensive learning, a particular issue in data-scarce/knowledge-rich domains such as healthcare. To bridge thi…
▽ More
Probabilistic Circuits (PCs) have emerged as an efficient framework for representing and learning complex probability distributions. Nevertheless, the existing body of research on PCs predominantly concentrates on data-driven parameter learning, often neglecting the potential of knowledge-intensive learning, a particular issue in data-scarce/knowledge-rich domains such as healthcare. To bridge this gap, we propose a novel unified framework that can systematically integrate diverse domain knowledge into the parameter learning process of PCs. Experiments on several benchmarks as well as real world datasets show that our proposed framework can both effectively and efficiently leverage domain knowledge to achieve superior performance compared to purely data-driven learning approaches.
△ Less
Submitted 3 May, 2024;
originally announced May 2024.
-
Conformal Prediction via Regression-as-Classification
Authors:
Etash Guha,
Shlok Natarajan,
Thomas Möllenhoff,
Mohammad Emtiyaz Khan,
Eugene Ndiaye
Abstract:
Conformal prediction (CP) for regression can be challenging, especially when the output distribution is heteroscedastic, multimodal, or skewed. Some of the issues can be addressed by estimating a distribution over the output, but in reality, such approaches can be sensitive to estimation error and yield unstable intervals.~Here, we circumvent the challenges by converting regression to a classifica…
▽ More
Conformal prediction (CP) for regression can be challenging, especially when the output distribution is heteroscedastic, multimodal, or skewed. Some of the issues can be addressed by estimating a distribution over the output, but in reality, such approaches can be sensitive to estimation error and yield unstable intervals.~Here, we circumvent the challenges by converting regression to a classification problem and then use CP for classification to obtain CP sets for regression.~To preserve the ordering of the continuous-output space, we design a new loss function and make necessary modifications to the CP classification techniques.~Empirical results on many benchmarks shows that this simple approach gives surprisingly good results on many practical problems.
△ Less
Submitted 11 April, 2024;
originally announced April 2024.
-
Enhancing Functional Safety in Automotive AMS Circuits through Unsupervised Machine Learning
Authors:
Ayush Arunachalam,
Ian Kintz,
Suvadeep Banerjee,
Arnab Raha,
Xiankun Jin,
Fei Su,
Viswanathan Pillai Prasanth,
Rubin A. Parekhji,
Suriyaprakash Natarajan,
Kanad Basu
Abstract:
Given the widespread use of safety-critical applications in the automotive field, it is crucial to ensure the Functional Safety (FuSa) of circuits and components within automotive systems. The Analog and Mixed-Signal (AMS) circuits prevalent in these systems are more vulnerable to faults induced by parametric perturbations, noise, environmental stress, and other factors, in comparison to their dig…
▽ More
Given the widespread use of safety-critical applications in the automotive field, it is crucial to ensure the Functional Safety (FuSa) of circuits and components within automotive systems. The Analog and Mixed-Signal (AMS) circuits prevalent in these systems are more vulnerable to faults induced by parametric perturbations, noise, environmental stress, and other factors, in comparison to their digital counterparts. However, their continuous signal characteristics present an opportunity for early anomaly detection, enabling the implementation of safety mechanisms to prevent system failure. To address this need, we propose a novel framework based on unsupervised machine learning for early anomaly detection in AMS circuits. The proposed approach involves injecting anomalies at various circuit locations and individual components to create a diverse and comprehensive anomaly dataset, followed by the extraction of features from the observed circuit signals. Subsequently, we employ clustering algorithms to facilitate anomaly detection. Finally, we propose a time series framework to enhance and expedite anomaly detection performance. Our approach encompasses a systematic analysis of anomaly abstraction at multiple levels pertaining to the automotive domain, from hardware- to block-level, where anomalies are injected to create diverse fault scenarios. By monitoring the system behavior under these anomalous conditions, we capture the propagation of anomalies and their effects at different abstraction levels, thereby potentially paving the way for the implementation of reliable safety mechanisms to ensure the FuSa of automotive SoCs. Our experimental findings indicate that our approach achieves 100% anomaly detection accuracy and significantly optimizes the associated latency by 5X, underscoring the effectiveness of our devised solution.
△ Less
Submitted 2 April, 2024;
originally announced April 2024.
-
Credibility-Aware Multi-Modal Fusion Using Probabilistic Circuits
Authors:
Sahil Sidheekh,
Pranuthi Tenali,
Saurabh Mathur,
Erik Blasch,
Kristian Kersting,
Sriraam Natarajan
Abstract:
We consider the problem of late multi-modal fusion for discriminative learning. Motivated by noisy, multi-source domains that require understanding the reliability of each data source, we explore the notion of credibility in the context of multi-modal fusion. We propose a combination function that uses probabilistic circuits (PCs) to combine predictive distributions over individual modalities. We…
▽ More
We consider the problem of late multi-modal fusion for discriminative learning. Motivated by noisy, multi-source domains that require understanding the reliability of each data source, we explore the notion of credibility in the context of multi-modal fusion. We propose a combination function that uses probabilistic circuits (PCs) to combine predictive distributions over individual modalities. We also define a probabilistic measure to evaluate the credibility of each modality via inference queries over the PC. Our experimental evaluation demonstrates that our fusion method can reliably infer credibility while maintaining competitive performance with the state-of-the-art.
△ Less
Submitted 17 July, 2024; v1 submitted 5 March, 2024;
originally announced March 2024.
-
Building Expressive and Tractable Probabilistic Generative Models: A Review
Authors:
Sahil Sidheekh,
Sriraam Natarajan
Abstract:
We present a comprehensive survey of the advancements and techniques in the field of tractable probabilistic generative modeling, primarily focusing on Probabilistic Circuits (PCs). We provide a unified perspective on the inherent trade-offs between expressivity and tractability, highlighting the design principles and algorithmic extensions that have enabled building expressive and efficient PCs,…
▽ More
We present a comprehensive survey of the advancements and techniques in the field of tractable probabilistic generative modeling, primarily focusing on Probabilistic Circuits (PCs). We provide a unified perspective on the inherent trade-offs between expressivity and tractability, highlighting the design principles and algorithmic extensions that have enabled building expressive and efficient PCs, and provide a taxonomy of the field. We also discuss recent efforts to build deep and hybrid PCs by fusing notions from deep neural models, and outline the challenges and open questions that can guide future research in this evolving field.
△ Less
Submitted 6 June, 2024; v1 submitted 1 February, 2024;
originally announced February 2024.
-
Promoting Research Collaboration with Open Data Driven Team Recommendation in Response to Call for Proposals
Authors:
Siva Likitha Valluru,
Biplav Srivastava,
Sai Teja Paladi,
Siwen Yan,
Sriraam Natarajan
Abstract:
Building teams and promoting collaboration are two very common business activities. An example of these are seen in the TeamingForFunding problem, where research institutions and researchers are interested to identify collaborative opportunities when applying to funding agencies in response to latter's calls for proposals. We describe a novel system to recommend teams using a variety of AI methods…
▽ More
Building teams and promoting collaboration are two very common business activities. An example of these are seen in the TeamingForFunding problem, where research institutions and researchers are interested to identify collaborative opportunities when applying to funding agencies in response to latter's calls for proposals. We describe a novel system to recommend teams using a variety of AI methods, such that (1) each team achieves the highest possible skill coverage that is demanded by the opportunity, and (2) the workload of distributing the opportunities is balanced amongst the candidate members. We address these questions by extracting skills latent in open data of proposal calls (demand) and researcher profiles (supply), normalizing them using taxonomies, and creating efficient algorithms that match demand to supply. We create teams to maximize goodness along a novel metric balancing short- and long-term objectives. We validate the success of our algorithms (1) quantitatively, by evaluating the recommended teams using a goodness score and find that more informed methods lead to recommendations of smaller number of teams but higher goodness, and (2) qualitatively, by conducting a large-scale user study at a college-wide level, and demonstrate that users overall found the tool very useful and relevant. Lastly, we evaluate our system in two diverse settings in US and India (of researchers and proposal calls) to establish generality of our approach, and deploy it at a major US university for routine use.
△ Less
Submitted 25 January, 2024; v1 submitted 17 September, 2023;
originally announced September 2023.
-
Polytopal composite finite elements for modeling concrete fracture based on nonlocal damage models
Authors:
Hai D. Huynh,
S. Natarajan,
H. Nguyen-Xuan,
Xiaoying Zhuang
Abstract:
The paper presents an assumed strain formulation over polygonal meshes to accurately evaluate the strain fields in nonlocal damage models. An assume strained technique based on the Hu-Washizu variational principle is employed to generate a new strain approximation instead of direct derivation from the basis functions and the displacement fields. The underlying idea embedded in arbitrary finite pol…
▽ More
The paper presents an assumed strain formulation over polygonal meshes to accurately evaluate the strain fields in nonlocal damage models. An assume strained technique based on the Hu-Washizu variational principle is employed to generate a new strain approximation instead of direct derivation from the basis functions and the displacement fields. The underlying idea embedded in arbitrary finite polygons is named as Polytopal composite finite elements (PCFEM). The PCFEM is accordingly applied within the framework of the nonlocal model of continuum damage mechanics to enhance the description of damage behaviours in which highly localized deformations must be captured accurately. This application is helpful to reduce the mesh-sensitivity and elaborate the process-zone of damage models. Several numerical examples are designed for various cases of fracture to discuss and validate the computational capability of the present method through comparison with published numerical results and experimental data from the literature.
△ Less
Submitted 11 July, 2023;
originally announced September 2023.
-
Knowledge-based Refinement of Scientific Publication Knowledge Graphs
Authors:
Siwen Yan,
Phillip Odom,
Sriraam Natarajan
Abstract:
We consider the problem of identifying authorship by posing it as a knowledge graph construction and refinement. To this effect, we model this problem as learning a probabilistic logic model in the presence of human guidance (knowledge-based learning). Specifically, we learn relational regression trees using functional gradient boosting that outputs explainable rules. To incorporate human knowledg…
▽ More
We consider the problem of identifying authorship by posing it as a knowledge graph construction and refinement. To this effect, we model this problem as learning a probabilistic logic model in the presence of human guidance (knowledge-based learning). Specifically, we learn relational regression trees using functional gradient boosting that outputs explainable rules. To incorporate human knowledge, advice in the form of first-order clauses is injected to refine the trees. We demonstrate the usefulness of human knowledge both quantitatively and qualitatively in seven authorship domains.
△ Less
Submitted 9 September, 2023;
originally announced September 2023.
-
Exploring Linguistic Similarity and Zero-Shot Learning for Multilingual Translation of Dravidian Languages
Authors:
Danish Ebadulla,
Rahul Raman,
S. Natarajan,
Hridhay Kiran Shetty,
Ashish Harish Shenoy
Abstract:
Current research in zero-shot translation is plagued by several issues such as high compute requirements, increased training time and off target translations. Proposed remedies often come at the cost of additional data or compute requirements. Pivot based neural machine translation is preferred over a single-encoder model for most settings despite the increased training and evaluation time. In thi…
▽ More
Current research in zero-shot translation is plagued by several issues such as high compute requirements, increased training time and off target translations. Proposed remedies often come at the cost of additional data or compute requirements. Pivot based neural machine translation is preferred over a single-encoder model for most settings despite the increased training and evaluation time. In this work, we overcome the shortcomings of zero-shot translation by taking advantage of transliteration and linguistic similarity. We build a single encoder-decoder neural machine translation system for Dravidian-Dravidian multilingual translation and perform zero-shot translation. We compare the data vs zero-shot accuracy tradeoff and evaluate the performance of our vanilla method against the current state of the art pivot based method. We also test the theory that morphologically rich languages require large vocabularies by restricting the vocabulary using an optimal transport based technique. Our model manages to achieves scores within 3 BLEU of large-scale pivot-based models when it is trained on 50\% of the language directions.
△ Less
Submitted 10 August, 2023;
originally announced August 2023.
-
MACOptions: Multi-Agent Learning with Centralized Controller and Options Framework
Authors:
Alakh Aggarwal,
Rishita Bansal,
Parth Padalkar,
Sriraam Natarajan
Abstract:
These days automation is being applied everywhere. In every environment, planning for the actions to be taken by the agents is an important aspect. In this paper, we plan to implement planning for multi-agents with a centralized controller. We compare three approaches: random policy, Q-learning, and Q-learning with Options Framework. We also show the effectiveness of planners by showing performanc…
▽ More
These days automation is being applied everywhere. In every environment, planning for the actions to be taken by the agents is an important aspect. In this paper, we plan to implement planning for multi-agents with a centralized controller. We compare three approaches: random policy, Q-learning, and Q-learning with Options Framework. We also show the effectiveness of planners by showing performance comparison between Q-Learning with Planner and without Planner.
△ Less
Submitted 7 February, 2023;
originally announced February 2023.
-
On the fractional transversely isotropic functionally graded nature of soft biological tissues
Authors:
Sachin Gunda,
Sundararajan Natarajan,
Olga Barrera
Abstract:
This paper focuses on the origin of the poroelastic anisotropic behaviour of the meniscal tissue and its spatially varying properties. We present confined compression creep test results on samples extracted from three parts of the tissue (Central body, Anterior horn and Posterior horn) in three orientations (Circumferential, Radial and Vertical). We show that a poroelastic model in which the fluid…
▽ More
This paper focuses on the origin of the poroelastic anisotropic behaviour of the meniscal tissue and its spatially varying properties. We present confined compression creep test results on samples extracted from three parts of the tissue (Central body, Anterior horn and Posterior horn) in three orientations (Circumferential, Radial and Vertical). We show that a poroelastic model in which the fluid flow evolution is ruled by non-integer order operators (fractional Darcy's law) provides accurate agreement with the experimental creep data. The model is validated against two additional sets of experimental data: stress relaxation and fluid loss during the consolidation process measured as weight reduction. Results show that the meniscus can be considered as a transversely isotropic poroelastic material. This behaviour is due to the fluid flow rate being about three times higher in the circumferential direction than in the radial and vertical directions in the body region of the meniscus. In the anterior horn, the elastic properties are transversely isotropic, with the aggregate modulus higher in the radial direction than in the circumferential and vertical directions. The 3D fractional poroelastic model is implemented in finite element software and quantities such as flux of interstitial fluid during the consolidation process, a non-trivial experimental measure, are determined.
△ Less
Submitted 5 January, 2023;
originally announced January 2023.
-
Domain Generalization for Prostate Segmentation in Transrectal Ultrasound Images: A Multi-center Study
Authors:
Sulaiman Vesal,
Iani Gayo,
Indrani Bhattacharya,
Shyam Natarajan,
Leonard S. Marks,
Dean C Barratt,
Richard E. Fan,
Yipeng Hu,
Geoffrey A. Sonn,
Mirabela Rusu
Abstract:
Prostate biopsy and image-guided treatment procedures are often performed under the guidance of ultrasound fused with magnetic resonance images (MRI). Accurate image fusion relies on accurate segmentation of the prostate on ultrasound images. Yet, the reduced signal-to-noise ratio and artifacts (e.g., speckle and shadowing) in ultrasound images limit the performance of automated prostate segmentat…
▽ More
Prostate biopsy and image-guided treatment procedures are often performed under the guidance of ultrasound fused with magnetic resonance images (MRI). Accurate image fusion relies on accurate segmentation of the prostate on ultrasound images. Yet, the reduced signal-to-noise ratio and artifacts (e.g., speckle and shadowing) in ultrasound images limit the performance of automated prostate segmentation techniques and generalizing these methods to new image domains is inherently difficult. In this study, we address these challenges by introducing a novel 2.5D deep neural network for prostate segmentation on ultrasound images. Our approach addresses the limitations of transfer learning and finetuning methods (i.e., drop in performance on the original training data when the model weights are updated) by combining a supervised domain adaptation technique and a knowledge distillation loss. The knowledge distillation loss allows the preservation of previously learned knowledge and reduces the performance drop after model finetuning on new datasets. Furthermore, our approach relies on an attention module that considers model feature positioning information to improve the segmentation accuracy. We trained our model on 764 subjects from one institution and finetuned our model using only ten subjects from subsequent institutions. We analyzed the performance of our method on three large datasets encompassing 2067 subjects from three different institutions. Our method achieved an average Dice Similarity Coefficient (Dice) of $94.0\pm0.03$ and Hausdorff Distance (HD95) of 2.28 $mm$ in an independent set of subjects from the first institution. Moreover, our model generalized well in the studies from the other two institutions (Dice: $91.0\pm0.03$; HD95: 3.7$mm$ and Dice: $82.0\pm0.03$; HD95: 7.1 $mm$).
△ Less
Submitted 5 September, 2022;
originally announced September 2022.
-
Human-guided Collaborative Problem Solving: A Natural Language based Framework
Authors:
Harsha Kokel,
Mayukh Das,
Rakibul Islam,
Julia Bonn,
Jon Cai,
Soham Dan,
Anjali Narayan-Chen,
Prashant Jayannavar,
Janardhan Rao Doppa,
Julia Hockenmaier,
Sriraam Natarajan,
Martha Palmer,
Dan Roth
Abstract:
We consider the problem of human-machine collaborative problem solving as a planning task coupled with natural language communication. Our framework consists of three components -- a natural language engine that parses the language utterances to a formal representation and vice-versa, a concept learner that induces generalized concepts for plans based on limited interactions with the user, and an…
▽ More
We consider the problem of human-machine collaborative problem solving as a planning task coupled with natural language communication. Our framework consists of three components -- a natural language engine that parses the language utterances to a formal representation and vice-versa, a concept learner that induces generalized concepts for plans based on limited interactions with the user, and an HTN planner that solves the task based on human interaction. We illustrate the ability of this framework to address the key challenges of collaborative problem solving by demonstrating it on a collaborative building task in a Minecraft-based blocksworld domain. The accompanied demo video is available at https://youtu.be/q1pWe4aahF0.
△ Less
Submitted 19 July, 2022;
originally announced July 2022.
-
Explainable Models via Compression of Tree Ensembles
Authors:
Siwen Yan,
Sriraam Natarajan,
Saket Joshi,
Roni Khardon,
Prasad Tadepalli
Abstract:
Ensemble models (bagging and gradient-boosting) of relational decision trees have proved to be one of the most effective learning methods in the area of probabilistic logic models (PLMs). While effective, they lose one of the most important aspect of PLMs -- interpretability. In this paper we consider the problem of compressing a large set of learned trees into a single explainable model. To this…
▽ More
Ensemble models (bagging and gradient-boosting) of relational decision trees have proved to be one of the most effective learning methods in the area of probabilistic logic models (PLMs). While effective, they lose one of the most important aspect of PLMs -- interpretability. In this paper we consider the problem of compressing a large set of learned trees into a single explainable model. To this effect, we propose CoTE -- Compression of Tree Ensembles -- that produces a single small decision list as a compressed representation. CoTE first converts the trees to decision lists and then performs the combination and compression with the aid of the original training set. An experimental evaluation demonstrates the effectiveness of CoTE in several benchmark relational data sets.
△ Less
Submitted 16 June, 2022;
originally announced June 2022.
-
A contagion process with self-exciting jumps in credit risk applications
Authors:
Puneet Pasricha,
Dharmaraja Selvamuthu,
Selvaraju Natarajan
Abstract:
The modeling of the probability of joint default or total number of defaults among the firms is one of the crucial problems to mitigate the credit risk since the default correlations significantly affect the portfolio loss distribution and hence play a significant role in allocating capital for solvency purposes. In this article, we derive a closed-form expression for the probability of default of…
▽ More
The modeling of the probability of joint default or total number of defaults among the firms is one of the crucial problems to mitigate the credit risk since the default correlations significantly affect the portfolio loss distribution and hence play a significant role in allocating capital for solvency purposes. In this article, we derive a closed-form expression for the probability of default of a single firm and the probability of the total number of defaults by any time $t$ in a homogeneous portfolio of firms. We use a contagion process to model the arrival of credit events that causes the default and develop a framework that allows firms to have resistance against default unlike the standard intensity-based models. We assume the point process driving the credit events to be composed of a systematic and an idiosyncratic component, whose intensities are independently specified by a mean-reverting affine jump-diffusion process with self-exciting jumps. The proposed framework is competent of capturing the feedback effect, an empirically observed phenomenon in the default events. We further demonstrate how the proposed framework can be used to price synthetic collateralized debt obligation (CDO) and obtain a closed-form solution for tranche spread. Finally, we present the sensitivity analysis to demonstrate the effect of different parameters governing the contagion effect on the spread of tranches and the expected loss of the CDO.
△ Less
Submitted 8 February, 2022;
originally announced February 2022.
-
Convergence Analysis of Virtual Element Method for Nonlinear Nonlocal Dynamic Plate Equation
Authors:
D. Adak,
D. Mora,
S. Natarajan
Abstract:
In this article, we have considered a nonlinear nonlocal time dependent fourth order equation demonstrating the deformation of a thin and narrow rectangular plate. We propose $C^1$ conforming virtual element method (VEM) of arbitrary order, $k\ge2$, to approximate the model problem numerically. We employ VEM to discretize the space variable and fully implicit scheme for temporal variable. Well-pos…
▽ More
In this article, we have considered a nonlinear nonlocal time dependent fourth order equation demonstrating the deformation of a thin and narrow rectangular plate. We propose $C^1$ conforming virtual element method (VEM) of arbitrary order, $k\ge2$, to approximate the model problem numerically. We employ VEM to discretize the space variable and fully implicit scheme for temporal variable. Well-posedness of the fully discrete scheme is proved under certain conditions on the physical parameters, and we derive optimal order of convergence in both space and time variable. Finally, numerical experiments are presented to illustrate the behaviour of the proposed numerical scheme.
△ Less
Submitted 4 February, 2022;
originally announced February 2022.
-
Explaining Deep Tractable Probabilistic Models: The sum-product network case
Authors:
Athresh Karanam,
Saurabh Mathur,
Predrag Radivojac,
David M. Haas,
Kristian Kersting,
Sriraam Natarajan
Abstract:
We consider the problem of explaining a class of tractable deep probabilistic models, the Sum-Product Networks (SPNs) and present an algorithm ExSPN to generate explanations. To this effect, we define the notion of a context-specific independence tree(CSI-tree) and present an iterative algorithm that converts an SPN to a CSI-tree. The resulting CSI-tree is both interpretable and explainable to the…
▽ More
We consider the problem of explaining a class of tractable deep probabilistic models, the Sum-Product Networks (SPNs) and present an algorithm ExSPN to generate explanations. To this effect, we define the notion of a context-specific independence tree(CSI-tree) and present an iterative algorithm that converts an SPN to a CSI-tree. The resulting CSI-tree is both interpretable and explainable to the domain expert. We achieve this by extracting the conditional independencies encoded by the SPN and approximating the local context specified by the structure of the SPN. Our extensive empirical evaluations on synthetic, standard, and real-world clinical data sets demonstrate that the CSI-tree exhibits superior explainability.
△ Less
Submitted 21 September, 2022; v1 submitted 19 October, 2021;
originally announced October 2021.
-
Relational Neural Markov Random Fields
Authors:
Yuqiao Chen,
Sriraam Natarajan,
Nicholas Ruozzi
Abstract:
Statistical Relational Learning (SRL) models have attracted significant attention due to their ability to model complex data while handling uncertainty. However, most of these models have been limited to discrete domains due to their limited potential functions. We introduce Relational Neural Markov Random Fields (RN-MRFs) which allow for handling of complex relational hybrid domains. The key adva…
▽ More
Statistical Relational Learning (SRL) models have attracted significant attention due to their ability to model complex data while handling uncertainty. However, most of these models have been limited to discrete domains due to their limited potential functions. We introduce Relational Neural Markov Random Fields (RN-MRFs) which allow for handling of complex relational hybrid domains. The key advantage of our model is that it makes minimal data distributional assumptions and can seamlessly allow for human knowledge through potentials or relational rules. We propose a maximum pseudolikelihood estimation-based learning algorithm with importance sampling for training the neural potential parameters. Our empirical evaluations across diverse domains such as image processing and relational object mapping, clearly demonstrate its effectiveness against non-neural counterparts.
△ Less
Submitted 18 October, 2021;
originally announced October 2021.
-
Dynamic probabilistic logic models for effective abstractions in RL
Authors:
Harsha Kokel,
Arjun Manoharan,
Sriraam Natarajan,
Balaraman Ravindran,
Prasad Tadepalli
Abstract:
State abstraction enables sample-efficient learning and better task transfer in complex reinforcement learning environments. Recently, we proposed RePReL (Kokel et al. 2021), a hierarchical framework that leverages a relational planner to provide useful state abstractions for learning. We present a brief overview of this framework and the use of a dynamic probabilistic logic model to design these…
▽ More
State abstraction enables sample-efficient learning and better task transfer in complex reinforcement learning environments. Recently, we proposed RePReL (Kokel et al. 2021), a hierarchical framework that leverages a relational planner to provide useful state abstractions for learning. We present a brief overview of this framework and the use of a dynamic probabilistic logic model to design these state abstractions. Our experiments show that RePReL not only achieves better performance and efficient learning on the task at hand but also demonstrates better generalization to unseen tasks.
△ Less
Submitted 15 October, 2021;
originally announced October 2021.
-
Neural-network acceleration of projection-based model-order-reduction for finite plasticity: Application to RVEs
Authors:
S. Vijayaraghavan,
L. Wu,
L. Noels,
S. P. A. Bordas,
S. Natarajan,
L. A. A. Beex
Abstract:
Compared to conventional projection-based model-order-reduction, its neural-network acceleration has the advantage that the online simulations are equation-free, meaning that no system of equations needs to be solved iteratively. Consequently, no stiffness matrix needs to be constructed and the stress update needs to be computed only once per increment. In this contribution, a recurrent neural net…
▽ More
Compared to conventional projection-based model-order-reduction, its neural-network acceleration has the advantage that the online simulations are equation-free, meaning that no system of equations needs to be solved iteratively. Consequently, no stiffness matrix needs to be constructed and the stress update needs to be computed only once per increment. In this contribution, a recurrent neural network is developed to accelerate a projection-based model-order-reduction of the elastoplastic mechanical behaviour of an RVE. In contrast to a neural network that merely emulates the relation between the macroscopic deformation (path) and the macroscopic stress, the neural network acceleration of projection-based model-order-reduction preserves all microstructural information, at the price of computing this information once per increment.
△ Less
Submitted 16 September, 2021;
originally announced September 2021.
-
A Comparative Study of Algorithms for Intelligent Traffic Signal Control
Authors:
Hrishit Chaudhuri,
Vibha Masti,
Vishruth Veerendranath,
S Natarajan
Abstract:
In this paper, methods have been explored to effectively optimise traffic signal control to minimise waiting times and queue lengths, thereby increasing traffic flow. The traffic intersection was first defined as a Markov Decision Process, and a state representation, actions and rewards were chosen. Simulation of Urban MObility (SUMO) was used to simulate an intersection and then compare a Round R…
▽ More
In this paper, methods have been explored to effectively optimise traffic signal control to minimise waiting times and queue lengths, thereby increasing traffic flow. The traffic intersection was first defined as a Markov Decision Process, and a state representation, actions and rewards were chosen. Simulation of Urban MObility (SUMO) was used to simulate an intersection and then compare a Round Robin Scheduler, a Feedback Control mechanism and two Reinforcement Learning techniques - Deep Q Network (DQN) and Advantage Actor-Critic (A2C), as the policy for the traffic signal in the simulation under different scenarios. Finally, the methods were tested on a simulation of a real-world intersection in Bengaluru, India.
△ Less
Submitted 18 September, 2021; v1 submitted 2 September, 2021;
originally announced September 2021.
-
Virtual element approximation of two-dimensional parabolic variational inequalities
Authors:
Dibyendu Adak,
Gianmarco Manzini,
Sundararajan Natarajan
Abstract:
We design a virtual element method for the numerical treatment of the two-dimensional parabolic variational inequality problem on unstructured polygonal meshes. Due to the expected low regularity of the exact solution, the virtual element method is based on the lowest-order virtual element space that contains the subspace of the linear polynomials defined on each element. The connection between th…
▽ More
We design a virtual element method for the numerical treatment of the two-dimensional parabolic variational inequality problem on unstructured polygonal meshes. Due to the expected low regularity of the exact solution, the virtual element method is based on the lowest-order virtual element space that contains the subspace of the linear polynomials defined on each element. The connection between the nonnegativity of the virtual element functions and the nonnegativity of the degrees of freedom, i.e., the values at the mesh vertices, is established by applying the Maximum and Minimum Principle Theorem. The mass matrix is computed through an approximate L 2 polynomial projection, whose properties are carefully investigated in the paper. We prove the well-posedness of the resulting scheme in two different ways that reveal the contractive nature of the VEM and its connection with the minimization of quadratic functionals. The convergence analysis requires the existence of a nonnegative quasi-interpolation operator, whose construction is also discussed in the paper. The variational crime introduced by the virtual element setting produces five error terms that we control by estimating a suitable upper bound. Numerical experiments confirm the theoretical convergence rate for the refinement in space and time on three different mesh families including distorted squares, nonconvex elements, and Voronoi tesselations.
△ Less
Submitted 29 May, 2021;
originally announced May 2021.
-
Grasp Synthesis for Novel Objects Using Heuristic-based and Data-driven Active Vision Methods
Authors:
Sabhari Natarajan,
Galen Brown,
Berk Calli
Abstract:
In this work, we present several heuristic-based and data-driven active vision strategies for viewpoint optimization of an arm-mounted depth camera for the purpose of aiding robotic grasping. These strategies aim to efficiently collect data to boost the performance of an underlying grasp synthesis algorithm. We created an open-source benchmarking platform in simulation (https://github.com/galenbr/…
▽ More
In this work, we present several heuristic-based and data-driven active vision strategies for viewpoint optimization of an arm-mounted depth camera for the purpose of aiding robotic grasping. These strategies aim to efficiently collect data to boost the performance of an underlying grasp synthesis algorithm. We created an open-source benchmarking platform in simulation (https://github.com/galenbr/2021ActiveVision), and provide an extensive study for assessing the performance of the proposed methods as well as comparing them against various baseline strategies. We also provide an experimental study with a real-world setup by utilizing an existing grasping planning benchmark in the literature. With these analyses, we were able to quantitatively demonstrate the versatility of heuristic methods that prioritize certain types of exploration, and qualitatively show their robustness to both novel objects and the transition from simulation to the real world. We identified scenarios in which our methods did not perform well and scenarios that are objectively difficult, and present a discussion on which avenues for future research show promise.
△ Less
Submitted 22 April, 2021;
originally announced April 2021.
-
Speech Denoising Without Clean Training Data: A Noise2Noise Approach
Authors:
Madhav Mahesh Kashyap,
Anuj Tambwekar,
Krishnamoorthy Manohara,
S Natarajan
Abstract:
This paper tackles the problem of the heavy dependence of clean speech data required by deep learning based audio-denoising methods by showing that it is possible to train deep speech denoising networks using only noisy speech samples. Conventional wisdom dictates that in order to achieve good speech denoising performance, there is a requirement for a large quantity of both noisy speech samples an…
▽ More
This paper tackles the problem of the heavy dependence of clean speech data required by deep learning based audio-denoising methods by showing that it is possible to train deep speech denoising networks using only noisy speech samples. Conventional wisdom dictates that in order to achieve good speech denoising performance, there is a requirement for a large quantity of both noisy speech samples and perfectly clean speech samples, resulting in a need for expensive audio recording equipment and extremely controlled soundproof recording studios. These requirements pose significant challenges in data collection, especially in economically disadvantaged regions and for low resource languages. This work shows that speech denoising deep neural networks can be successfully trained utilizing only noisy training audio. Furthermore it is revealed that such training regimes achieve superior denoising performance over conventional training regimes utilizing clean training audio targets, in cases involving complex noise distributions and low Signal-to-Noise ratios (high noise environments). This is demonstrated through experiments studying the efficacy of our proposed approach over both real-world noises and synthetic noises using the 20 layered Deep Complex U-Net architecture.
△ Less
Submitted 19 September, 2021; v1 submitted 8 April, 2021;
originally announced April 2021.
-
Unconstrained Face Recognition using ASURF and Cloud-Forest Classifier optimized with VLAD
Authors:
A Vinay,
Aviral Joshi,
Hardik Mahipal Surana,
Harsh Garg,
K N BalasubramanyaMurthy,
S Natarajan
Abstract:
The paper posits a computationally-efficient algorithm for multi-class facial image classification in which images are constrained with translation, rotation, scale, color, illumination and affine distortion. The proposed method is divided into five main building blocks including Haar-Cascade for face detection, Bilateral Filter for image preprocessing to remove unwanted noise, Affine Speeded-Up R…
▽ More
The paper posits a computationally-efficient algorithm for multi-class facial image classification in which images are constrained with translation, rotation, scale, color, illumination and affine distortion. The proposed method is divided into five main building blocks including Haar-Cascade for face detection, Bilateral Filter for image preprocessing to remove unwanted noise, Affine Speeded-Up Robust Features (ASURF) for keypoint detection and description, Vector of Locally Aggregated Descriptors (VLAD) for feature quantization and Cloud Forest for image classification. The proposed method aims at improving the accuracy and the time taken for face recognition systems. The usage of the Cloud Forest algorithm as a classifier on three benchmark datasets, namely the FACES95, FACES96 and ORL facial datasets, showed promising results. The proposed methodology using Cloud Forest algorithm successfully improves the recognition model by 2-12\% when differentiated against other ensemble techniques like the Random Forest classifier depending upon the dataset used.
△ Less
Submitted 1 April, 2021;
originally announced April 2021.
-
Predicting Drug-Drug Interactions from Heterogeneous Data: An Embedding Approach
Authors:
Devendra Singh Dhami,
Siwen Yan,
Gautam Kunapuli,
David Page,
Sriraam Natarajan
Abstract:
Predicting and discovering drug-drug interactions (DDIs) using machine learning has been studied extensively. However, most of the approaches have focused on text data or textual representation of the drug structures. We present the first work that uses multiple data sources such as drug structure images, drug structure string representation and relational representation of drug relationships as t…
▽ More
Predicting and discovering drug-drug interactions (DDIs) using machine learning has been studied extensively. However, most of the approaches have focused on text data or textual representation of the drug structures. We present the first work that uses multiple data sources such as drug structure images, drug structure string representation and relational representation of drug relationships as the input. To this effect, we exploit the recent advances in deep networks to integrate these varied sources of inputs in predicting DDIs. Our empirical evaluation against several state-of-the-art methods using standalone different data types for drugs clearly demonstrate the efficacy of combining heterogeneous data in predicting DDIs.
△ Less
Submitted 19 March, 2021;
originally announced March 2021.
-
Interventional Sum-Product Networks: Causal Inference with Tractable Probabilistic Models
Authors:
Matej Zečević,
Devendra Singh Dhami,
Athresh Karanam,
Sriraam Natarajan,
Kristian Kersting
Abstract:
While probabilistic models are an important tool for studying causality, doing so suffers from the intractability of inference. As a step towards tractable causal models, we consider the problem of learning interventional distributions using sum-product networks (SPNs) that are over-parameterized by gate functions, e.g., neural networks. Providing an arbitrarily intervened causal graph as input, e…
▽ More
While probabilistic models are an important tool for studying causality, doing so suffers from the intractability of inference. As a step towards tractable causal models, we consider the problem of learning interventional distributions using sum-product networks (SPNs) that are over-parameterized by gate functions, e.g., neural networks. Providing an arbitrarily intervened causal graph as input, effectively subsuming Pearl's do-operator, the gate function predicts the parameters of the SPN. The resulting interventional SPNs are motivated and illustrated by a structural causal model themed around personal health. Our empirical evaluation on three benchmark data sets as well as a synthetic health data set clearly demonstrates that interventional SPNs indeed are both expressive in modelling and flexible in adapting to the interventions.
△ Less
Submitted 25 October, 2021; v1 submitted 20 February, 2021;
originally announced February 2021.
-
A Statistical Relational Approach to Learning Distance-based GCNs
Authors:
Devendra Singh Dhami,
Siwen Yan,
Sriraam Natarajan
Abstract:
We consider the problem of learning distance-based Graph Convolutional Networks (GCNs) for relational data. Specifically, we first embed the original graph into the Euclidean space $\mathbb{R}^m$ using a relational density estimation technique thereby constructing a secondary Euclidean graph. The graph vertices correspond to the target triples and edges denote the Euclidean distances between the t…
▽ More
We consider the problem of learning distance-based Graph Convolutional Networks (GCNs) for relational data. Specifically, we first embed the original graph into the Euclidean space $\mathbb{R}^m$ using a relational density estimation technique thereby constructing a secondary Euclidean graph. The graph vertices correspond to the target triples and edges denote the Euclidean distances between the target triples. We emphasize the importance of learning the secondary Euclidean graph and the advantages of employing a distance matrix over the typically used adjacency matrix. Our comprehensive empirical evaluation demonstrates the superiority of our approach over $12$ different GCN models, relational embedding techniques and rule learning techniques.
△ Less
Submitted 12 October, 2021; v1 submitted 13 February, 2021;
originally announced February 2021.
-
Particle Swarm Based Hyper-Parameter Optimization for Machine Learned Interatomic Potentials
Authors:
Suresh Kondati Natarajan,
Miguel A. Caro
Abstract:
Modeling non-empirical and highly flexible interatomic potential energy surfaces (PES) using machine learning (ML) approaches is becoming popular in molecular and materials research. Training an ML-PES is typically performed in two stages: feature extraction and structure-property relationship modeling. The feature extraction stage transforms atomic positions into a symmetry-invariant mathematical…
▽ More
Modeling non-empirical and highly flexible interatomic potential energy surfaces (PES) using machine learning (ML) approaches is becoming popular in molecular and materials research. Training an ML-PES is typically performed in two stages: feature extraction and structure-property relationship modeling. The feature extraction stage transforms atomic positions into a symmetry-invariant mathematical representation. This representation can be fine-tuned by adjusting on a set of so-called "hyper-parameters" (HPs). Subsequently, an ML algorithm such as neural networks or Gaussian process regression (GPR) is used to model the structure-PES relationship based on another set of HPs. Choosing optimal values for the two sets of HPs is critical to ensure the high quality of the resulting ML-PES model.
In this paper, we explore HP optimization strategies tailored for ML-PES generation using a custom-coded parallel particle swarm optimizer (available freely at https://github.com/suresh0807/PPSO.git). We employ the smooth overlap of atomic positions (SOAP) descriptor in combination with GPR-based Gaussian approximation potentials (GAP) and optimize HPs for four distinct systems: a toy C dimer, amorphous carbon, $α$-Fe, and small organic molecules (QM9 dataset). We propose a two-step optimization strategy in which the HPs related to the feature extraction stage are optimized first, followed by the optimization of the HPs in the training stage. This strategy is computationally more efficient than optimizing all HPs at the same time by means of significantly reducing the number of ML models needed to be trained to obtain the optimal HPs. This approach can be trivially extended to other combinations of descriptor and ML algorithm and brings us another step closer to fully automated ML-PES generation.
△ Less
Submitted 31 December, 2020;
originally announced January 2021.
-
Relational Boosted Bandits
Authors:
Ashutosh Kakadiya,
Sriraam Natarajan,
Balaraman Ravindran
Abstract:
Contextual bandits algorithms have become essential in real-world user interaction problems in recent years. However, these algorithms rely on context as attribute value representation, which makes them unfeasible for real-world domains like social networks are inherently relational. We propose Relational Boosted Bandits(RB2), acontextual bandits algorithm for relational domains based on (relation…
▽ More
Contextual bandits algorithms have become essential in real-world user interaction problems in recent years. However, these algorithms rely on context as attribute value representation, which makes them unfeasible for real-world domains like social networks are inherently relational. We propose Relational Boosted Bandits(RB2), acontextual bandits algorithm for relational domains based on (relational) boosted trees. RB2 enables us to learn interpretable and explainable models due to the more descriptive nature of the relational representation. We empirically demonstrate the effectiveness and interpretability of RB2 on tasks such as link prediction, relational classification, and recommendations.
△ Less
Submitted 16 December, 2020;
originally announced December 2020.
-
Graph Based Temporal Aggregation for Video Retrieval
Authors:
Arvind Srinivasan,
Aprameya Bharadwaj,
Aveek Saha,
Subramanyam Natarajan
Abstract:
Large scale video retrieval is a field of study with a lot of ongoing research. Most of the work in the field is on video retrieval through text queries using techniques such as VSE++. However, there is little research done on video retrieval through image queries, and the work that has been done in this field either uses image queries from within the video dataset or iterates through videos frame…
▽ More
Large scale video retrieval is a field of study with a lot of ongoing research. Most of the work in the field is on video retrieval through text queries using techniques such as VSE++. However, there is little research done on video retrieval through image queries, and the work that has been done in this field either uses image queries from within the video dataset or iterates through videos frame by frame. These approaches are not generalized for queries from outside the dataset and do not scale well for large video datasets. To overcome these issues, we propose a new approach for video retrieval through image queries where an undirected graph is constructed from the combined set of frames from all videos to be searched. The node features of this graph are used in the task of video retrieval. Experimentation is done on the MSR-VTT dataset by using query images from outside the dataset. To evaluate this novel approach P@5, P@10 and P@20 metrics are calculated. Two different ResNet models namely, ResNet-152 and ResNet-50 are used in this study.
△ Less
Submitted 4 November, 2020;
originally announced November 2020.
-
Fitted Q-Learning for Relational Domains
Authors:
Srijita Das,
Sriraam Natarajan,
Kaushik Roy,
Ronald Parr,
Kristian Kersting
Abstract:
We consider the problem of Approximate Dynamic Programming in relational domains. Inspired by the success of fitted Q-learning methods in propositional settings, we develop the first relational fitted Q-learning algorithms by representing the value function and Bellman residuals. When we fit the Q-functions, we show how the two steps of Bellman operator; application and projection steps can be per…
▽ More
We consider the problem of Approximate Dynamic Programming in relational domains. Inspired by the success of fitted Q-learning methods in propositional settings, we develop the first relational fitted Q-learning algorithms by representing the value function and Bellman residuals. When we fit the Q-functions, we show how the two steps of Bellman operator; application and projection steps can be performed using a gradient-boosting technique. Our proposed framework performs reasonably well on standard domains without using domain models and using fewer training trajectories.
△ Less
Submitted 9 June, 2020;
originally announced June 2020.
-
Optimization of Image Embeddings for Few Shot Learning
Authors:
Arvind Srinivasan,
Aprameya Bharadwaj,
Manasa Sathyan,
S Natarajan
Abstract:
In this paper we improve the image embeddings generated in the graph neural network solution for few shot learning. We propose alternate architectures for existing networks such as Inception-Net, U-Net, Attention U-Net, and Squeeze-Net to generate embeddings and increase the accuracy of the models. We improve the quality of embeddings created at the cost of the time taken to generate them. The pro…
▽ More
In this paper we improve the image embeddings generated in the graph neural network solution for few shot learning. We propose alternate architectures for existing networks such as Inception-Net, U-Net, Attention U-Net, and Squeeze-Net to generate embeddings and increase the accuracy of the models. We improve the quality of embeddings created at the cost of the time taken to generate them. The proposed implementations outperform the existing state of the art methods for 1-shot and 5-shot learning on the Omniglot dataset. The experiments involved a testing set and training set which had no common classes between them. The results for 5-way and 10-way/20-way tests have been tabulated.
△ Less
Submitted 4 April, 2020;
originally announced April 2020.
-
Knowledge Graph Alignment using String Edit Distance
Authors:
Navdeep Kaur,
Gautam Kunapuli,
Sriraam Natarajan
Abstract:
In this work, we propose a novel knowledge graph alignment technique based upon string edit distance that exploits the type information between entities and can find similarity between relations of any arity
In this work, we propose a novel knowledge graph alignment technique based upon string edit distance that exploits the type information between entities and can find similarity between relations of any arity
△ Less
Submitted 29 March, 2020; v1 submitted 13 March, 2020;
originally announced March 2020.
-
Scaling Hyperledger Fabric Using Pipelined Execution and Sparse Peers
Authors:
Parth Thakkar,
Senthilnathan Natarajan
Abstract:
Permissioned blockchains are becoming popular as data management systems in the enterprise setting. Compared to traditional distributed databases, blockchain platforms provide increased security guarantees but significantly lower performance. Further, these platforms are quite expensive to run for the low throughput they provide. The following are two ways to improve performance and reduce cost: (…
▽ More
Permissioned blockchains are becoming popular as data management systems in the enterprise setting. Compared to traditional distributed databases, blockchain platforms provide increased security guarantees but significantly lower performance. Further, these platforms are quite expensive to run for the low throughput they provide. The following are two ways to improve performance and reduce cost: (1) make the system utilize allocated resources efficiently; (2) allow rapid and dynamic scaling of allocated resources based on load. We explore both of these in this work.
We first investigate the reasons for the poor performance and scalability of the dominant permissioned blockchain flavor called Execute-Order-Validate (EOV). We do this by studying the scaling characteristics of Hyperledger Fabric, a popular EOV platform, using vertical scaling and horizontal scaling. We find that the transaction throughput scales very poorly with these techniques. At least in the permissioned setting, the real bottleneck is transaction processing, not the consensus protocol. With vertical scaling, the allocated vCPUs go under-utilized. In contrast, with horizontal scaling, the allocated resources get wasted due to redundant work across nodes within an organization.
To mitigate the above concerns, we first improve resource efficiency by (a) improving CPU utilization with a pipelined execution of validation & commit phases; (b) avoiding redundant work across nodes by introducing a new type of peer node called sparse peer that selectively commits transactions. We further propose a technique that enables the rapid scaling of resources. Our implementation - SmartFabric, built on top of Hyperledger Fabric demonstrates 3x higher throughput, 12-26x faster scale-up time, and provides Fabric's throughput at 50% to 87% lower cost.
△ Less
Submitted 1 March, 2021; v1 submitted 11 March, 2020;
originally announced March 2020.
-
Adaptive phase field modelling of crack propagation in orthotropic functionally graded materials
Authors:
Hirshikesh,
Emilio Martínez-Pañeda,
Sundararajan Natarajan
Abstract:
In this work, we extend the recently proposed adaptive phase field method to model fracture in orthotropic functionally graded materials (FGMs). A recovery type error indicator combined with quadtree decomposition is employed for adaptive mesh refinement. The proposed approach is capable of capturing the fracture process with a localized mesh refinement that provides notable gains in computational…
▽ More
In this work, we extend the recently proposed adaptive phase field method to model fracture in orthotropic functionally graded materials (FGMs). A recovery type error indicator combined with quadtree decomposition is employed for adaptive mesh refinement. The proposed approach is capable of capturing the fracture process with a localized mesh refinement that provides notable gains in computational efficiency. The implementation is validated against experimental data and other numerical experiments on orthotropic materials with different material orientations. The results reveal an increase in the stiffness and the maximum force with increasing material orientation angle. The study is then extended to the analysis of orthotropic FGMs. It is observed that, if the gradation in fracture properties is neglected, the material gradient plays a secondary role, with the fracture behaviour being dominated by the orthotropy of the material. However, when the toughness increases along the crack propagation path, a substantial gain in fracture resistance is observed.
△ Less
Submitted 4 March, 2020;
originally announced March 2020.
-
Non-Parametric Learning of Lifted Restricted Boltzmann Machines
Authors:
Navdeep Kaur,
Gautam Kunapuli,
Sriraam Natarajan
Abstract:
We consider the problem of discriminatively learning restricted Boltzmann machines in the presence of relational data. Unlike previous approaches that employ a rule learner (for structure learning) and a weight learner (for parameter learning) sequentially, we develop a gradient-boosted approach that performs both simultaneously. Our approach learns a set of weak relational regression trees, whose…
▽ More
We consider the problem of discriminatively learning restricted Boltzmann machines in the presence of relational data. Unlike previous approaches that employ a rule learner (for structure learning) and a weight learner (for parameter learning) sequentially, we develop a gradient-boosted approach that performs both simultaneously. Our approach learns a set of weak relational regression trees, whose paths from root to leaf are conjunctive clauses and represent the structure, and whose leaf values represent the parameters. When the learned relational regression trees are transformed into a lifted RBM, its hidden nodes are precisely the conjunctive clauses derived from the relational regression trees. This leads to a more interpretable and explainable model. Our empirical evaluations clearly demonstrate this aspect, while displaying no loss in effectiveness of the learned models.
△ Less
Submitted 9 January, 2020;
originally announced January 2020.
-
Adaptive Importance Sampling based Neural Network framework for Reliability and Sensitivity Prediction for Variable Stiffness Composite Laminates with hybrid uncertainties
Authors:
Tittu Varghese Mathew,
P Prajith,
RO Ruiz,
E Atroshchenko,
S Natarajan
Abstract:
In this work, we propose to leverage the advantages of both the Artificial Neural Network (ANN) based Second Order Reliability Method (SORM) and Importance sampling to yield an Adaptive Importance Sampling based ANN, with specific application towards failure probability and sensitivity estimates of Variable Stiffness Composite Laminate (VSCL) plates, in the presence of multiple independent geometr…
▽ More
In this work, we propose to leverage the advantages of both the Artificial Neural Network (ANN) based Second Order Reliability Method (SORM) and Importance sampling to yield an Adaptive Importance Sampling based ANN, with specific application towards failure probability and sensitivity estimates of Variable Stiffness Composite Laminate (VSCL) plates, in the presence of multiple independent geometric and material uncertainties. The performance function for the case studies is defined based on the fundamental frequency of the VSCL plate. The accuracy in both the reliability estimates and sensitivity studies using the proposed method were found to be in close agreement with that obtained using the ANN based brute-force MCS method, with a significant computational savings of 95\%. Moreover, the importance of taking into account the randomness in ply thickness for failure probability estimates is also highlighted quantitatively under the sensitivity studies section.
△ Less
Submitted 27 January, 2020;
originally announced January 2020.
-
Continuum modelling of stress diffusion interactions in an elastoplastic medium in the presence of geometric discontinuity
Authors:
Rupesh Kumar Mahendran,
Hirshikesh,
Ratna Kumar Annabattula,
Sundararajan Natarajan
Abstract:
Chemo-mechanical coupled systems have been a subject of interest for many decades now. Previous attempts to solve such models have mainly focused on elastic materials without taking into account the plastic deformation beyond yield, thus causing inaccuracies in failure calculations. This paper aims to study the effect of stress-diffusion interactions in an elastoplastic material using a coupled ch…
▽ More
Chemo-mechanical coupled systems have been a subject of interest for many decades now. Previous attempts to solve such models have mainly focused on elastic materials without taking into account the plastic deformation beyond yield, thus causing inaccuracies in failure calculations. This paper aims to study the effect of stress-diffusion interactions in an elastoplastic material using a coupled chemo-mechanical system. The induced stress is dependent on the local concentration in a one way coupled system, and vice versa in a two way coupled system. The time-dependent transient coupled system is solved using a finite element formulation in an open-source finite element solver FEniCS. This paper attempts to computationally study the interaction of deformation and diffusion and its effect on the localization of plastic strain. We investigate the role of geometric discontinuities in scenarios involving diffusing species, namely, a plate with a notch/hole/void and particle with a void/hole/core. We also study the effect of stress concentrations and plastic yielding on the diffusion-deformation. The developed code can be from https://github.com/mrupeshkumar/Elastoplastic-stress-diffusion-coupling
△ Less
Submitted 11 January, 2020;
originally announced January 2020.
-
A Preliminary Approach for Learning Relational Policies for the Management of Critically Ill Children
Authors:
Michael A. Skinner,
Lakshmi Raman,
Neel Shah,
Abdelaziz Farhat,
Sriraam Natarajan
Abstract:
The increased use of electronic health records has made possible the automated extraction of medical policies from patient records to aid in the development of clinical decision support systems. We adapted a boosted Statistical Relational Learning (SRL) framework to learn probabilistic rules from clinical hospital records for the management of physiologic parameters of children with severe cardiac…
▽ More
The increased use of electronic health records has made possible the automated extraction of medical policies from patient records to aid in the development of clinical decision support systems. We adapted a boosted Statistical Relational Learning (SRL) framework to learn probabilistic rules from clinical hospital records for the management of physiologic parameters of children with severe cardiac or respiratory failure who were managed with extracorporeal membrane oxygenation. In this preliminary study, the results were promising. In particular, the algorithm returned logic rules for medical actions that are consistent with medical reasoning.
△ Less
Submitted 13 January, 2020;
originally announced January 2020.
-
Lifted Hybrid Variational Inference
Authors:
Yuqiao Chen,
Yibo Yang,
Sriraam Natarajan,
Nicholas Ruozzi
Abstract:
A variety of lifted inference algorithms, which exploit model symmetry to reduce computational cost, have been proposed to render inference tractable in probabilistic relational models. Most existing lifted inference algorithms operate only over discrete domains or continuous domains with restricted potential functions, e.g., Gaussian. We investigate two approximate lifted variational approaches t…
▽ More
A variety of lifted inference algorithms, which exploit model symmetry to reduce computational cost, have been proposed to render inference tractable in probabilistic relational models. Most existing lifted inference algorithms operate only over discrete domains or continuous domains with restricted potential functions, e.g., Gaussian. We investigate two approximate lifted variational approaches that are applicable to hybrid domains and expressive enough to capture multi-modality. We demonstrate that the proposed variational methods are both scalable and can take advantage of approximate model symmetries, even in the presence of a large amount of continuous evidence. We demonstrate that our approach compares favorably against existing message-passing based approaches in a variety of settings. Finally, we present a sufficient condition for the Bethe approximation to yield a non-trivial estimate over the marginal polytope.
△ Less
Submitted 7 February, 2020; v1 submitted 8 January, 2020;
originally announced January 2020.
-
Non-Parametric Learning of Gaifman Models
Authors:
Devendra Singh Dhami,
Siwen Yan,
Gautam Kunapuli,
Sriraam Natarajan
Abstract:
We consider the problem of structure learning for Gaifman models and learn relational features that can be used to derive feature representations from a knowledge base. These relational features are first-order rules that are then partially grounded and counted over local neighborhoods of a Gaifman model to obtain the feature representations. We propose a method for learning these relational featu…
▽ More
We consider the problem of structure learning for Gaifman models and learn relational features that can be used to derive feature representations from a knowledge base. These relational features are first-order rules that are then partially grounded and counted over local neighborhoods of a Gaifman model to obtain the feature representations. We propose a method for learning these relational features for a Gaifman model by using relational tree distances. Our empirical evaluation on real data sets demonstrates the superiority of our approach over classical rule-learning.
△ Less
Submitted 15 January, 2020; v1 submitted 2 January, 2020;
originally announced January 2020.
-
User Friendly Automatic Construction of Background Knowledge: Mode Construction from ER Diagrams
Authors:
Alexander L. Hayes,
Mayukh Das,
Phillip Odom,
Sriraam Natarajan
Abstract:
One of the key advantages of Inductive Logic Programming systems is the ability of the domain experts to provide background knowledge as modes that allow for efficient search through the space of hypotheses. However, there is an inherent assumption that this expert should also be an ILP expert to provide effective modes. We relax this assumption by designing a graphical user interface that allows…
▽ More
One of the key advantages of Inductive Logic Programming systems is the ability of the domain experts to provide background knowledge as modes that allow for efficient search through the space of hypotheses. However, there is an inherent assumption that this expert should also be an ILP expert to provide effective modes. We relax this assumption by designing a graphical user interface that allows the domain expert to interact with the system using Entity Relationship diagrams. These interactions are used to construct modes for the learning system. We evaluate our algorithm on a probabilistic logic learning system where we demonstrate that the user is able to construct effective background knowledge on par with the expert-encoded knowledge on five data sets.
△ Less
Submitted 16 December, 2019;
originally announced December 2019.
-
One-Shot Induction of Generalized Logical Concepts via Human Guidance
Authors:
Mayukh Das,
Nandini Ramanan,
Janardhan Rao Doppa,
Sriraam Natarajan
Abstract:
We consider the problem of learning generalized first-order representations of concepts from a single example. To address this challenging problem, we augment an inductive logic programming learner with two novel algorithmic contributions. First, we define a distance measure between candidate concept representations that improves the efficiency of search for target concept and generalization. Seco…
▽ More
We consider the problem of learning generalized first-order representations of concepts from a single example. To address this challenging problem, we augment an inductive logic programming learner with two novel algorithmic contributions. First, we define a distance measure between candidate concept representations that improves the efficiency of search for target concept and generalization. Second, we leverage richer human inputs in the form of advice to improve the sample-efficiency of learning. We prove that the proposed distance measure is semantically valid and use that to derive a PAC bound. Our experimental analysis on diverse concept learning tasks demonstrates both the effectiveness and efficiency of the proposed approach over a first-order concept learner using only examples.
△ Less
Submitted 15 December, 2019;
originally announced December 2019.
-
Virtual element method for semilinear sine-Gordon equation over polygonal mesh using product approximation technique
Authors:
Dibyendu Adak,
Sundararajan Natarajan
Abstract:
In this paper, we employ the linear virtual element spaces to discretize the semilinear sine-Gordon equation in two dimensions. The salient features of the virtual element method (VEM) are: (a) it does not require explicit form of the shape functions to construct the nonlinear and the bilinear terms, and (b) relaxes the constraint on the mesh topology by allowing the domain to be discretized with…
▽ More
In this paper, we employ the linear virtual element spaces to discretize the semilinear sine-Gordon equation in two dimensions. The salient features of the virtual element method (VEM) are: (a) it does not require explicit form of the shape functions to construct the nonlinear and the bilinear terms, and (b) relaxes the constraint on the mesh topology by allowing the domain to be discretized with general polygons consisting of both convex and concave elements, and (c) easy mesh refinements (hanging nodes and interfaces are allowed). The nonlinear source term is discretized by employing the product approximation technique and for temporal discretization, the Crank-Nicolson scheme is used. The resulting nonlinear equations are solved using the Newton's method. We derive a priori error estimations in $L^2$ and $H^1$ norms. The convergence properties and the accuracy of the virtual element method for the solution of the sine-Gordon equation are demonstrated with academic numerical experiments.
△ Less
Submitted 11 December, 2019;
originally announced December 2019.
-
Beyond Textual Data: Predicting Drug-Drug Interactions from Molecular Structure Images using Siamese Neural Networks
Authors:
Devendra Singh Dhami,
Siwen Yan,
Gautam Kunapuli,
David Page,
Sriraam Natarajan
Abstract:
Predicting and discovering drug-drug interactions (DDIs) is an important problem and has been studied extensively both from medical and machine learning point of view. Almost all of the machine learning approaches have focused on text data or textual representation of the structural data of drugs. We present the first work that uses drug structure images as the input and utilizes a Siamese convolu…
▽ More
Predicting and discovering drug-drug interactions (DDIs) is an important problem and has been studied extensively both from medical and machine learning point of view. Almost all of the machine learning approaches have focused on text data or textual representation of the structural data of drugs. We present the first work that uses drug structure images as the input and utilizes a Siamese convolutional network architecture to predict DDIs.
△ Less
Submitted 29 June, 2020; v1 submitted 14 November, 2019;
originally announced November 2019.
-
Neural Networks for Relational Data
Authors:
Navdeep Kaur,
Gautam Kunapuli,
Saket Joshi,
Kristian Kersting,
Sriraam Natarajan
Abstract:
While deep networks have been enormously successful over the last decade, they rely on flat-feature vector representations, which makes them unsuitable for richly structured domains such as those arising in applications like social network analysis. Such domains rely on relational representations to capture complex relationships between entities and their attributes. Thus, we consider the problem…
▽ More
While deep networks have been enormously successful over the last decade, they rely on flat-feature vector representations, which makes them unsuitable for richly structured domains such as those arising in applications like social network analysis. Such domains rely on relational representations to capture complex relationships between entities and their attributes. Thus, we consider the problem of learning neural networks for relational data. We distinguish ourselves from current approaches that rely on expert hand-coded rules by learning relational random-walk-based features to capture local structural interactions and the resulting network architecture. We further exploit parameter tying of the network weights of the resulting relational neural network, where instances of the same type share parameters. Our experimental results across several standard relational data sets demonstrate the effectiveness of the proposed approach over multiple neural net baselines as well as state-of-the-art statistical relational models.
△ Less
Submitted 13 January, 2020; v1 submitted 28 August, 2019;
originally announced September 2019.
-
Knowledge-augmented Column Networks: Guiding Deep Learning with Advice
Authors:
Mayukh Das,
Devendra Singh Dhami,
Yang Yu,
Gautam Kunapuli,
Sriraam Natarajan
Abstract:
Recently, deep models have had considerable success in several tasks, especially with low-level representations. However, effective learning from sparse noisy samples is a major challenge in most deep models, especially in domains with structured representations. Inspired by the proven success of human guided machine learning, we propose Knowledge-augmented Column Networks, a relational deep learn…
▽ More
Recently, deep models have had considerable success in several tasks, especially with low-level representations. However, effective learning from sparse noisy samples is a major challenge in most deep models, especially in domains with structured representations. Inspired by the proven success of human guided machine learning, we propose Knowledge-augmented Column Networks, a relational deep learning framework that leverages human advice/knowledge to learn better models in presence of sparsity and systematic noise.
△ Less
Submitted 31 May, 2019;
originally announced June 2019.
-
Phase field modelling of crack propagation in functionally graded materials
Authors:
Hirshikesh,
Sundararajan Natarajan,
Ratna K. Annabattula,
Emilio Martínez-Pañeda
Abstract:
We present a phase field formulation for fracture in functionally graded materials (FGMs). The model builds upon homogenization theory and accounts for the spatial variation of elastic and fracture properties. Several paradigmatic case studies are addressed to demonstrate the potential of the proposed modelling framework. Specifically, we (i) gain insight into the crack growth resistance of FGMs b…
▽ More
We present a phase field formulation for fracture in functionally graded materials (FGMs). The model builds upon homogenization theory and accounts for the spatial variation of elastic and fracture properties. Several paradigmatic case studies are addressed to demonstrate the potential of the proposed modelling framework. Specifically, we (i) gain insight into the crack growth resistance of FGMs by conducting numerical experiments over a wide range of material gradation profiles and orientations, (ii) accurately reproduce the crack trajectories observed in graded photodegradable copolymers and glass-filled epoxy FGMs, (iii) benchmark our predictions with results from alternative numerical methodologies, and (iv) model complex crack paths and failure in three dimensional functionally graded solids. The suitability of phase field fracture methods in capturing the crack deflections intrinsic to crack tip mode-mixity due to material gradients is demonstrated. Material gradient profiles that prevent unstable fracture and enhance crack growth resistance are identified: this provides the foundation for the design of fracture resistant FGMs. The finite element code developed can be downloaded from www.empaneda.com/codes.
△ Less
Submitted 7 April, 2019;
originally announced April 2019.
-
Human-Guided Learning of Column Networks: Augmenting Deep Learning with Advice
Authors:
Mayukh Das,
Yang Yu,
Devendra Singh Dhami,
Gautam Kunapuli,
Sriraam Natarajan
Abstract:
Recently, deep models have been successfully applied in several applications, especially with low-level representations. However, sparse, noisy samples and structured domains (with multiple objects and interactions) are some of the open challenges in most deep models. Column Networks, a deep architecture, can succinctly capture such domain structure and interactions, but may still be prone to sub-…
▽ More
Recently, deep models have been successfully applied in several applications, especially with low-level representations. However, sparse, noisy samples and structured domains (with multiple objects and interactions) are some of the open challenges in most deep models. Column Networks, a deep architecture, can succinctly capture such domain structure and interactions, but may still be prone to sub-optimal learning from sparse and noisy samples. Inspired by the success of human-advice guided learning in AI, especially in data-scarce domains, we propose Knowledge-augmented Column Networks that leverage human advice/knowledge for better learning with noisy/sparse samples. Our experiments demonstrate that our approach leads to either superior overall performance or faster convergence (i.e., both effective and efficient).
△ Less
Submitted 15 April, 2019;
originally announced April 2019.