Showing 1–50 of 104 results for author: Natarajan, S

A Unified Framework for Human-Allied Learning of Probabilistic Circuits

Authors: Athresh Karanam, Saurabh Mathur, Sahil Sidheekh, Sriraam Natarajan

Abstract: Probabilistic Circuits (PCs) have emerged as an efficient framework for representing and learning complex probability distributions. Nevertheless, the existing body of research on PCs predominantly concentrates on data-driven parameter learning, often neglecting the potential of knowledge-intensive learning, a particular issue in data-scarce/knowledge-rich domains such as healthcare. To bridge thi… ▽ More Probabilistic Circuits (PCs) have emerged as an efficient framework for representing and learning complex probability distributions. Nevertheless, the existing body of research on PCs predominantly concentrates on data-driven parameter learning, often neglecting the potential of knowledge-intensive learning, a particular issue in data-scarce/knowledge-rich domains such as healthcare. To bridge this gap, we propose a novel unified framework that can systematically integrate diverse domain knowledge into the parameter learning process of PCs. Experiments on several benchmarks as well as real world datasets show that our proposed framework can both effectively and efficiently leverage domain knowledge to achieve superior performance compared to purely data-driven learning approaches. △ Less

Submitted 3 May, 2024; originally announced May 2024.

Conformal Prediction via Regression-as-Classification

Authors: Etash Guha, Shlok Natarajan, Thomas Möllenhoff, Mohammad Emtiyaz Khan, Eugene Ndiaye

Abstract: Conformal prediction (CP) for regression can be challenging, especially when the output distribution is heteroscedastic, multimodal, or skewed. Some of the issues can be addressed by estimating a distribution over the output, but in reality, such approaches can be sensitive to estimation error and yield unstable intervals.~Here, we circumvent the challenges by converting regression to a classifica… ▽ More Conformal prediction (CP) for regression can be challenging, especially when the output distribution is heteroscedastic, multimodal, or skewed. Some of the issues can be addressed by estimating a distribution over the output, but in reality, such approaches can be sensitive to estimation error and yield unstable intervals.~Here, we circumvent the challenges by converting regression to a classification problem and then use CP for classification to obtain CP sets for regression.~To preserve the ordering of the continuous-output space, we design a new loss function and make necessary modifications to the CP classification techniques.~Empirical results on many benchmarks shows that this simple approach gives surprisingly good results on many practical problems. △ Less

Submitted 11 April, 2024; originally announced April 2024.

Comments: International Conference of Learning Representations 2024

Journal ref: International Conference of Learning Representations 2024

Enhancing Functional Safety in Automotive AMS Circuits through Unsupervised Machine Learning

Authors: Ayush Arunachalam, Ian Kintz, Suvadeep Banerjee, Arnab Raha, Xiankun Jin, Fei Su, Viswanathan Pillai Prasanth, Rubin A. Parekhji, Suriyaprakash Natarajan, Kanad Basu

Abstract: Given the widespread use of safety-critical applications in the automotive field, it is crucial to ensure the Functional Safety (FuSa) of circuits and components within automotive systems. The Analog and Mixed-Signal (AMS) circuits prevalent in these systems are more vulnerable to faults induced by parametric perturbations, noise, environmental stress, and other factors, in comparison to their dig… ▽ More Given the widespread use of safety-critical applications in the automotive field, it is crucial to ensure the Functional Safety (FuSa) of circuits and components within automotive systems. The Analog and Mixed-Signal (AMS) circuits prevalent in these systems are more vulnerable to faults induced by parametric perturbations, noise, environmental stress, and other factors, in comparison to their digital counterparts. However, their continuous signal characteristics present an opportunity for early anomaly detection, enabling the implementation of safety mechanisms to prevent system failure. To address this need, we propose a novel framework based on unsupervised machine learning for early anomaly detection in AMS circuits. The proposed approach involves injecting anomalies at various circuit locations and individual components to create a diverse and comprehensive anomaly dataset, followed by the extraction of features from the observed circuit signals. Subsequently, we employ clustering algorithms to facilitate anomaly detection. Finally, we propose a time series framework to enhance and expedite anomaly detection performance. Our approach encompasses a systematic analysis of anomaly abstraction at multiple levels pertaining to the automotive domain, from hardware- to block-level, where anomalies are injected to create diverse fault scenarios. By monitoring the system behavior under these anomalous conditions, we capture the propagation of anomalies and their effects at different abstraction levels, thereby potentially paving the way for the implementation of reliable safety mechanisms to ensure the FuSa of automotive SoCs. Our experimental findings indicate that our approach achieves 100% anomaly detection accuracy and significantly optimizes the associated latency by 5X, underscoring the effectiveness of our devised solution. △ Less

Submitted 2 April, 2024; originally announced April 2024.

Comments: 12 pages, 12 figures

Credibility-Aware Multi-Modal Fusion Using Probabilistic Circuits

Authors: Sahil Sidheekh, Pranuthi Tenali, Saurabh Mathur, Erik Blasch, Kristian Kersting, Sriraam Natarajan

Abstract: We consider the problem of late multi-modal fusion for discriminative learning. Motivated by noisy, multi-source domains that require understanding the reliability of each data source, we explore the notion of credibility in the context of multi-modal fusion. We propose a combination function that uses probabilistic circuits (PCs) to combine predictive distributions over individual modalities. We… ▽ More We consider the problem of late multi-modal fusion for discriminative learning. Motivated by noisy, multi-source domains that require understanding the reliability of each data source, we explore the notion of credibility in the context of multi-modal fusion. We propose a combination function that uses probabilistic circuits (PCs) to combine predictive distributions over individual modalities. We also define a probabilistic measure to evaluate the credibility of each modality via inference queries over the PC. Our experimental evaluation demonstrates that our fusion method can reliably infer credibility while maintaining competitive performance with the state-of-the-art. △ Less

Submitted 17 July, 2024; v1 submitted 5 March, 2024; originally announced March 2024.

Building Expressive and Tractable Probabilistic Generative Models: A Review

Authors: Sahil Sidheekh, Sriraam Natarajan

Abstract: We present a comprehensive survey of the advancements and techniques in the field of tractable probabilistic generative modeling, primarily focusing on Probabilistic Circuits (PCs). We provide a unified perspective on the inherent trade-offs between expressivity and tractability, highlighting the design principles and algorithmic extensions that have enabled building expressive and efficient PCs,… ▽ More We present a comprehensive survey of the advancements and techniques in the field of tractable probabilistic generative modeling, primarily focusing on Probabilistic Circuits (PCs). We provide a unified perspective on the inherent trade-offs between expressivity and tractability, highlighting the design principles and algorithmic extensions that have enabled building expressive and efficient PCs, and provide a taxonomy of the field. We also discuss recent efforts to build deep and hybrid PCs by fusing notions from deep neural models, and outline the challenges and open questions that can guide future research in this evolving field. △ Less

Submitted 6 June, 2024; v1 submitted 1 February, 2024; originally announced February 2024.

Promoting Research Collaboration with Open Data Driven Team Recommendation in Response to Call for Proposals

Authors: Siva Likitha Valluru, Biplav Srivastava, Sai Teja Paladi, Siwen Yan, Sriraam Natarajan

Abstract: Building teams and promoting collaboration are two very common business activities. An example of these are seen in the TeamingForFunding problem, where research institutions and researchers are interested to identify collaborative opportunities when applying to funding agencies in response to latter's calls for proposals. We describe a novel system to recommend teams using a variety of AI methods… ▽ More Building teams and promoting collaboration are two very common business activities. An example of these are seen in the TeamingForFunding problem, where research institutions and researchers are interested to identify collaborative opportunities when applying to funding agencies in response to latter's calls for proposals. We describe a novel system to recommend teams using a variety of AI methods, such that (1) each team achieves the highest possible skill coverage that is demanded by the opportunity, and (2) the workload of distributing the opportunities is balanced amongst the candidate members. We address these questions by extracting skills latent in open data of proposal calls (demand) and researcher profiles (supply), normalizing them using taxonomies, and creating efficient algorithms that match demand to supply. We create teams to maximize goodness along a novel metric balancing short- and long-term objectives. We validate the success of our algorithms (1) quantitatively, by evaluating the recommended teams using a goodness score and find that more informed methods lead to recommendations of smaller number of teams but higher goodness, and (2) qualitatively, by conducting a large-scale user study at a college-wide level, and demonstrate that users overall found the tool very useful and relevant. Lastly, we evaluate our system in two diverse settings in US and India (of researchers and proposal calls) to establish generality of our approach, and deploy it at a major US university for routine use. △ Less

Submitted 25 January, 2024; v1 submitted 17 September, 2023; originally announced September 2023.

Comments: 9 pages, 2 figures, 3 tables, Accepted to The Thirty-Sixth Annual Conference on Innovative Applications of Artificial Intelligence (IAAI/AAAI-24)

ACM Class: H.3.3; I.2.7

Polytopal composite finite elements for modeling concrete fracture based on nonlocal damage models

Authors: Hai D. Huynh, S. Natarajan, H. Nguyen-Xuan, Xiaoying Zhuang

Abstract: The paper presents an assumed strain formulation over polygonal meshes to accurately evaluate the strain fields in nonlocal damage models. An assume strained technique based on the Hu-Washizu variational principle is employed to generate a new strain approximation instead of direct derivation from the basis functions and the displacement fields. The underlying idea embedded in arbitrary finite pol… ▽ More The paper presents an assumed strain formulation over polygonal meshes to accurately evaluate the strain fields in nonlocal damage models. An assume strained technique based on the Hu-Washizu variational principle is employed to generate a new strain approximation instead of direct derivation from the basis functions and the displacement fields. The underlying idea embedded in arbitrary finite polygons is named as Polytopal composite finite elements (PCFEM). The PCFEM is accordingly applied within the framework of the nonlocal model of continuum damage mechanics to enhance the description of damage behaviours in which highly localized deformations must be captured accurately. This application is helpful to reduce the mesh-sensitivity and elaborate the process-zone of damage models. Several numerical examples are designed for various cases of fracture to discuss and validate the computational capability of the present method through comparison with published numerical results and experimental data from the literature. △ Less

Submitted 11 July, 2023; originally announced September 2023.

Knowledge-based Refinement of Scientific Publication Knowledge Graphs

Authors: Siwen Yan, Phillip Odom, Sriraam Natarajan

Abstract: We consider the problem of identifying authorship by posing it as a knowledge graph construction and refinement. To this effect, we model this problem as learning a probabilistic logic model in the presence of human guidance (knowledge-based learning). Specifically, we learn relational regression trees using functional gradient boosting that outputs explainable rules. To incorporate human knowledg… ▽ More We consider the problem of identifying authorship by posing it as a knowledge graph construction and refinement. To this effect, we model this problem as learning a probabilistic logic model in the presence of human guidance (knowledge-based learning). Specifically, we learn relational regression trees using functional gradient boosting that outputs explainable rules. To incorporate human knowledge, advice in the form of first-order clauses is injected to refine the trees. We demonstrate the usefulness of human knowledge both quantitatively and qualitatively in seven authorship domains. △ Less

Submitted 9 September, 2023; originally announced September 2023.

Comments: 10 pages, 14 figures, 2 tables

Exploring Linguistic Similarity and Zero-Shot Learning for Multilingual Translation of Dravidian Languages

Authors: Danish Ebadulla, Rahul Raman, S. Natarajan, Hridhay Kiran Shetty, Ashish Harish Shenoy

Abstract: Current research in zero-shot translation is plagued by several issues such as high compute requirements, increased training time and off target translations. Proposed remedies often come at the cost of additional data or compute requirements. Pivot based neural machine translation is preferred over a single-encoder model for most settings despite the increased training and evaluation time. In thi… ▽ More Current research in zero-shot translation is plagued by several issues such as high compute requirements, increased training time and off target translations. Proposed remedies often come at the cost of additional data or compute requirements. Pivot based neural machine translation is preferred over a single-encoder model for most settings despite the increased training and evaluation time. In this work, we overcome the shortcomings of zero-shot translation by taking advantage of transliteration and linguistic similarity. We build a single encoder-decoder neural machine translation system for Dravidian-Dravidian multilingual translation and perform zero-shot translation. We compare the data vs zero-shot accuracy tradeoff and evaluate the performance of our vanilla method against the current state of the art pivot based method. We also test the theory that morphologically rich languages require large vocabularies by restricting the vocabulary using an optimal transport based technique. Our model manages to achieves scores within 3 BLEU of large-scale pivot-based models when it is trained on 50\% of the language directions. △ Less

Submitted 10 August, 2023; originally announced August 2023.

MACOptions: Multi-Agent Learning with Centralized Controller and Options Framework

Authors: Alakh Aggarwal, Rishita Bansal, Parth Padalkar, Sriraam Natarajan

Abstract: These days automation is being applied everywhere. In every environment, planning for the actions to be taken by the agents is an important aspect. In this paper, we plan to implement planning for multi-agents with a centralized controller. We compare three approaches: random policy, Q-learning, and Q-learning with Options Framework. We also show the effectiveness of planners by showing performanc… ▽ More These days automation is being applied everywhere. In every environment, planning for the actions to be taken by the agents is an important aspect. In this paper, we plan to implement planning for multi-agents with a centralized controller. We compare three approaches: random policy, Q-learning, and Q-learning with Options Framework. We also show the effectiveness of planners by showing performance comparison between Q-Learning with Planner and without Planner. △ Less

Submitted 7 February, 2023; originally announced February 2023.

On the fractional transversely isotropic functionally graded nature of soft biological tissues

Authors: Sachin Gunda, Sundararajan Natarajan, Olga Barrera

Abstract: This paper focuses on the origin of the poroelastic anisotropic behaviour of the meniscal tissue and its spatially varying properties. We present confined compression creep test results on samples extracted from three parts of the tissue (Central body, Anterior horn and Posterior horn) in three orientations (Circumferential, Radial and Vertical). We show that a poroelastic model in which the fluid… ▽ More This paper focuses on the origin of the poroelastic anisotropic behaviour of the meniscal tissue and its spatially varying properties. We present confined compression creep test results on samples extracted from three parts of the tissue (Central body, Anterior horn and Posterior horn) in three orientations (Circumferential, Radial and Vertical). We show that a poroelastic model in which the fluid flow evolution is ruled by non-integer order operators (fractional Darcy's law) provides accurate agreement with the experimental creep data. The model is validated against two additional sets of experimental data: stress relaxation and fluid loss during the consolidation process measured as weight reduction. Results show that the meniscus can be considered as a transversely isotropic poroelastic material. This behaviour is due to the fluid flow rate being about three times higher in the circumferential direction than in the radial and vertical directions in the body region of the meniscus. In the anterior horn, the elastic properties are transversely isotropic, with the aggregate modulus higher in the radial direction than in the circumferential and vertical directions. The 3D fractional poroelastic model is implemented in finite element software and quantities such as flux of interstitial fluid during the consolidation process, a non-trivial experimental measure, are determined. △ Less

Submitted 5 January, 2023; originally announced January 2023.

Domain Generalization for Prostate Segmentation in Transrectal Ultrasound Images: A Multi-center Study

Authors: Sulaiman Vesal, Iani Gayo, Indrani Bhattacharya, Shyam Natarajan, Leonard S. Marks, Dean C Barratt, Richard E. Fan, Yipeng Hu, Geoffrey A. Sonn, Mirabela Rusu

Abstract: Prostate biopsy and image-guided treatment procedures are often performed under the guidance of ultrasound fused with magnetic resonance images (MRI). Accurate image fusion relies on accurate segmentation of the prostate on ultrasound images. Yet, the reduced signal-to-noise ratio and artifacts (e.g., speckle and shadowing) in ultrasound images limit the performance of automated prostate segmentat… ▽ More Prostate biopsy and image-guided treatment procedures are often performed under the guidance of ultrasound fused with magnetic resonance images (MRI). Accurate image fusion relies on accurate segmentation of the prostate on ultrasound images. Yet, the reduced signal-to-noise ratio and artifacts (e.g., speckle and shadowing) in ultrasound images limit the performance of automated prostate segmentation techniques and generalizing these methods to new image domains is inherently difficult. In this study, we address these challenges by introducing a novel 2.5D deep neural network for prostate segmentation on ultrasound images. Our approach addresses the limitations of transfer learning and finetuning methods (i.e., drop in performance on the original training data when the model weights are updated) by combining a supervised domain adaptation technique and a knowledge distillation loss. The knowledge distillation loss allows the preservation of previously learned knowledge and reduces the performance drop after model finetuning on new datasets. Furthermore, our approach relies on an attention module that considers model feature positioning information to improve the segmentation accuracy. We trained our model on 764 subjects from one institution and finetuned our model using only ten subjects from subsequent institutions. We analyzed the performance of our method on three large datasets encompassing 2067 subjects from three different institutions. Our method achieved an average Dice Similarity Coefficient (Dice) of $94.0\pm0.03$ and Hausdorff Distance (HD95) of 2.28 $mm$ in an independent set of subjects from the first institution. Moreover, our model generalized well in the studies from the other two institutions (Dice: $91.0\pm0.03$; HD95: 3.7$mm$ and Dice: $82.0\pm0.03$; HD95: 7.1 $mm$). △ Less

Submitted 5 September, 2022; originally announced September 2022.

Comments: Accepted to the journal of Medical Image Analysis (MedIA)

Human-guided Collaborative Problem Solving: A Natural Language based Framework

Authors: Harsha Kokel, Mayukh Das, Rakibul Islam, Julia Bonn, Jon Cai, Soham Dan, Anjali Narayan-Chen, Prashant Jayannavar, Janardhan Rao Doppa, Julia Hockenmaier, Sriraam Natarajan, Martha Palmer, Dan Roth

Abstract: We consider the problem of human-machine collaborative problem solving as a planning task coupled with natural language communication. Our framework consists of three components -- a natural language engine that parses the language utterances to a formal representation and vice-versa, a concept learner that induces generalized concepts for plans based on limited interactions with the user, and an… ▽ More We consider the problem of human-machine collaborative problem solving as a planning task coupled with natural language communication. Our framework consists of three components -- a natural language engine that parses the language utterances to a formal representation and vice-versa, a concept learner that induces generalized concepts for plans based on limited interactions with the user, and an HTN planner that solves the task based on human interaction. We illustrate the ability of this framework to address the key challenges of collaborative problem solving by demonstrating it on a collaborative building task in a Minecraft-based blocksworld domain. The accompanied demo video is available at https://youtu.be/q1pWe4aahF0. △ Less

Submitted 19 July, 2022; originally announced July 2022.

Comments: ICAPS 2021 (demo track)

Explainable Models via Compression of Tree Ensembles

Authors: Siwen Yan, Sriraam Natarajan, Saket Joshi, Roni Khardon, Prasad Tadepalli

Abstract: Ensemble models (bagging and gradient-boosting) of relational decision trees have proved to be one of the most effective learning methods in the area of probabilistic logic models (PLMs). While effective, they lose one of the most important aspect of PLMs -- interpretability. In this paper we consider the problem of compressing a large set of learned trees into a single explainable model. To this… ▽ More Ensemble models (bagging and gradient-boosting) of relational decision trees have proved to be one of the most effective learning methods in the area of probabilistic logic models (PLMs). While effective, they lose one of the most important aspect of PLMs -- interpretability. In this paper we consider the problem of compressing a large set of learned trees into a single explainable model. To this effect, we propose CoTE -- Compression of Tree Ensembles -- that produces a single small decision list as a compressed representation. CoTE first converts the trees to decision lists and then performs the combination and compression with the aid of the original training set. An experimental evaluation demonstrates the effectiveness of CoTE in several benchmark relational data sets. △ Less

Submitted 16 June, 2022; originally announced June 2022.

Comments: 24 pages, 14 figures

A contagion process with self-exciting jumps in credit risk applications

Authors: Puneet Pasricha, Dharmaraja Selvamuthu, Selvaraju Natarajan

Abstract: The modeling of the probability of joint default or total number of defaults among the firms is one of the crucial problems to mitigate the credit risk since the default correlations significantly affect the portfolio loss distribution and hence play a significant role in allocating capital for solvency purposes. In this article, we derive a closed-form expression for the probability of default of… ▽ More The modeling of the probability of joint default or total number of defaults among the firms is one of the crucial problems to mitigate the credit risk since the default correlations significantly affect the portfolio loss distribution and hence play a significant role in allocating capital for solvency purposes. In this article, we derive a closed-form expression for the probability of default of a single firm and the probability of the total number of defaults by any time $t$ in a homogeneous portfolio of firms. We use a contagion process to model the arrival of credit events that causes the default and develop a framework that allows firms to have resistance against default unlike the standard intensity-based models. We assume the point process driving the credit events to be composed of a systematic and an idiosyncratic component, whose intensities are independently specified by a mean-reverting affine jump-diffusion process with self-exciting jumps. The proposed framework is competent of capturing the feedback effect, an empirically observed phenomenon in the default events. We further demonstrate how the proposed framework can be used to price synthetic collateralized debt obligation (CDO) and obtain a closed-form solution for tranche spread. Finally, we present the sensitivity analysis to demonstrate the effect of different parameters governing the contagion effect on the spread of tranches and the expected loss of the CDO. △ Less

Submitted 8 February, 2022; originally announced February 2022.

Comments: 20 pages, 3 figures, 4 tables

Journal ref: Stochastics: An International Journal Of Probability And Stochastic Processes, 2022

Convergence Analysis of Virtual Element Method for Nonlinear Nonlocal Dynamic Plate Equation

Authors: D. Adak, D. Mora, S. Natarajan

Abstract: In this article, we have considered a nonlinear nonlocal time dependent fourth order equation demonstrating the deformation of a thin and narrow rectangular plate. We propose $C^1$ conforming virtual element method (VEM) of arbitrary order, $k\ge2$, to approximate the model problem numerically. We employ VEM to discretize the space variable and fully implicit scheme for temporal variable. Well-pos… ▽ More In this article, we have considered a nonlinear nonlocal time dependent fourth order equation demonstrating the deformation of a thin and narrow rectangular plate. We propose $C^1$ conforming virtual element method (VEM) of arbitrary order, $k\ge2$, to approximate the model problem numerically. We employ VEM to discretize the space variable and fully implicit scheme for temporal variable. Well-posedness of the fully discrete scheme is proved under certain conditions on the physical parameters, and we derive optimal order of convergence in both space and time variable. Finally, numerical experiments are presented to illustrate the behaviour of the proposed numerical scheme. △ Less

Submitted 4 February, 2022; originally announced February 2022.

MSC Class: 65N30; 65N12; 65N15; 35Q74; 74K20

Explaining Deep Tractable Probabilistic Models: The sum-product network case

Authors: Athresh Karanam, Saurabh Mathur, Predrag Radivojac, David M. Haas, Kristian Kersting, Sriraam Natarajan

Abstract: We consider the problem of explaining a class of tractable deep probabilistic models, the Sum-Product Networks (SPNs) and present an algorithm ExSPN to generate explanations. To this effect, we define the notion of a context-specific independence tree(CSI-tree) and present an iterative algorithm that converts an SPN to a CSI-tree. The resulting CSI-tree is both interpretable and explainable to the… ▽ More We consider the problem of explaining a class of tractable deep probabilistic models, the Sum-Product Networks (SPNs) and present an algorithm ExSPN to generate explanations. To this effect, we define the notion of a context-specific independence tree(CSI-tree) and present an iterative algorithm that converts an SPN to a CSI-tree. The resulting CSI-tree is both interpretable and explainable to the domain expert. We achieve this by extracting the conditional independencies encoded by the SPN and approximating the local context specified by the structure of the SPN. Our extensive empirical evaluations on synthetic, standard, and real-world clinical data sets demonstrate that the CSI-tree exhibits superior explainability. △ Less

Submitted 21 September, 2022; v1 submitted 19 October, 2021; originally announced October 2021.

Comments: Main paper: 8 pages, references: 1 page. Main paper: 4 figures

Journal ref: PMLR 186:325-336 (2022)

Relational Neural Markov Random Fields

Authors: Yuqiao Chen, Sriraam Natarajan, Nicholas Ruozzi

Abstract: Statistical Relational Learning (SRL) models have attracted significant attention due to their ability to model complex data while handling uncertainty. However, most of these models have been limited to discrete domains due to their limited potential functions. We introduce Relational Neural Markov Random Fields (RN-MRFs) which allow for handling of complex relational hybrid domains. The key adva… ▽ More Statistical Relational Learning (SRL) models have attracted significant attention due to their ability to model complex data while handling uncertainty. However, most of these models have been limited to discrete domains due to their limited potential functions. We introduce Relational Neural Markov Random Fields (RN-MRFs) which allow for handling of complex relational hybrid domains. The key advantage of our model is that it makes minimal data distributional assumptions and can seamlessly allow for human knowledge through potentials or relational rules. We propose a maximum pseudolikelihood estimation-based learning algorithm with importance sampling for training the neural potential parameters. Our empirical evaluations across diverse domains such as image processing and relational object mapping, clearly demonstrate its effectiveness against non-neural counterparts. △ Less

Submitted 18 October, 2021; originally announced October 2021.

Comments: StarAI 2021 workshop on IJCLR 2021

Dynamic probabilistic logic models for effective abstractions in RL

Authors: Harsha Kokel, Arjun Manoharan, Sriraam Natarajan, Balaraman Ravindran, Prasad Tadepalli

Abstract: State abstraction enables sample-efficient learning and better task transfer in complex reinforcement learning environments. Recently, we proposed RePReL (Kokel et al. 2021), a hierarchical framework that leverages a relational planner to provide useful state abstractions for learning. We present a brief overview of this framework and the use of a dynamic probabilistic logic model to design these… ▽ More State abstraction enables sample-efficient learning and better task transfer in complex reinforcement learning environments. Recently, we proposed RePReL (Kokel et al. 2021), a hierarchical framework that leverages a relational planner to provide useful state abstractions for learning. We present a brief overview of this framework and the use of a dynamic probabilistic logic model to design these state abstractions. Our experiments show that RePReL not only achieves better performance and efficient learning on the task at hand but also demonstrates better generalization to unseen tasks. △ Less

Submitted 15 October, 2021; originally announced October 2021.

Comments: Accepted at StarAI 2021 (held in conjunction with IJCLR 2021)

Neural-network acceleration of projection-based model-order-reduction for finite plasticity: Application to RVEs

Authors: S. Vijayaraghavan, L. Wu, L. Noels, S. P. A. Bordas, S. Natarajan, L. A. A. Beex

Abstract: Compared to conventional projection-based model-order-reduction, its neural-network acceleration has the advantage that the online simulations are equation-free, meaning that no system of equations needs to be solved iteratively. Consequently, no stiffness matrix needs to be constructed and the stress update needs to be computed only once per increment. In this contribution, a recurrent neural net… ▽ More Compared to conventional projection-based model-order-reduction, its neural-network acceleration has the advantage that the online simulations are equation-free, meaning that no system of equations needs to be solved iteratively. Consequently, no stiffness matrix needs to be constructed and the stress update needs to be computed only once per increment. In this contribution, a recurrent neural network is developed to accelerate a projection-based model-order-reduction of the elastoplastic mechanical behaviour of an RVE. In contrast to a neural network that merely emulates the relation between the macroscopic deformation (path) and the macroscopic stress, the neural network acceleration of projection-based model-order-reduction preserves all microstructural information, at the price of computing this information once per increment. △ Less

Submitted 16 September, 2021; originally announced September 2021.

A Comparative Study of Algorithms for Intelligent Traffic Signal Control

Authors: Hrishit Chaudhuri, Vibha Masti, Vishruth Veerendranath, S Natarajan

Abstract: In this paper, methods have been explored to effectively optimise traffic signal control to minimise waiting times and queue lengths, thereby increasing traffic flow. The traffic intersection was first defined as a Markov Decision Process, and a state representation, actions and rewards were chosen. Simulation of Urban MObility (SUMO) was used to simulate an intersection and then compare a Round R… ▽ More In this paper, methods have been explored to effectively optimise traffic signal control to minimise waiting times and queue lengths, thereby increasing traffic flow. The traffic intersection was first defined as a Markov Decision Process, and a state representation, actions and rewards were chosen. Simulation of Urban MObility (SUMO) was used to simulate an intersection and then compare a Round Robin Scheduler, a Feedback Control mechanism and two Reinforcement Learning techniques - Deep Q Network (DQN) and Advantage Actor-Critic (A2C), as the policy for the traffic signal in the simulation under different scenarios. Finally, the methods were tested on a simulation of a real-world intersection in Bengaluru, India. △ Less

Submitted 18 September, 2021; v1 submitted 2 September, 2021; originally announced September 2021.

Comments: 15 pages, 18 figures, ICMLAS 2021 Conference

ACM Class: G.3; I.2.11

Journal ref: Machine Learning and Autonomous Systems. Springer, Singapore, 2022. 271-287

Virtual element approximation of two-dimensional parabolic variational inequalities

Authors: Dibyendu Adak, Gianmarco Manzini, Sundararajan Natarajan

Abstract: We design a virtual element method for the numerical treatment of the two-dimensional parabolic variational inequality problem on unstructured polygonal meshes. Due to the expected low regularity of the exact solution, the virtual element method is based on the lowest-order virtual element space that contains the subspace of the linear polynomials defined on each element. The connection between th… ▽ More We design a virtual element method for the numerical treatment of the two-dimensional parabolic variational inequality problem on unstructured polygonal meshes. Due to the expected low regularity of the exact solution, the virtual element method is based on the lowest-order virtual element space that contains the subspace of the linear polynomials defined on each element. The connection between the nonnegativity of the virtual element functions and the nonnegativity of the degrees of freedom, i.e., the values at the mesh vertices, is established by applying the Maximum and Minimum Principle Theorem. The mass matrix is computed through an approximate L 2 polynomial projection, whose properties are carefully investigated in the paper. We prove the well-posedness of the resulting scheme in two different ways that reveal the contractive nature of the VEM and its connection with the minimization of quadratic functionals. The convergence analysis requires the existence of a nonnegative quasi-interpolation operator, whose construction is also discussed in the paper. The variational crime introduced by the virtual element setting produces five error terms that we control by estimating a suitable upper bound. Numerical experiments confirm the theoretical convergence rate for the refinement in space and time on three different mesh families including distorted squares, nonconvex elements, and Voronoi tesselations. △ Less

Submitted 29 May, 2021; originally announced May 2021.

Comments: 33 pages, 3 figures

MSC Class: 65M12; 65M60

Grasp Synthesis for Novel Objects Using Heuristic-based and Data-driven Active Vision Methods

Authors: Sabhari Natarajan, Galen Brown, Berk Calli

Abstract: In this work, we present several heuristic-based and data-driven active vision strategies for viewpoint optimization of an arm-mounted depth camera for the purpose of aiding robotic grasping. These strategies aim to efficiently collect data to boost the performance of an underlying grasp synthesis algorithm. We created an open-source benchmarking platform in simulation (https://github.com/galenbr/… ▽ More In this work, we present several heuristic-based and data-driven active vision strategies for viewpoint optimization of an arm-mounted depth camera for the purpose of aiding robotic grasping. These strategies aim to efficiently collect data to boost the performance of an underlying grasp synthesis algorithm. We created an open-source benchmarking platform in simulation (https://github.com/galenbr/2021ActiveVision), and provide an extensive study for assessing the performance of the proposed methods as well as comparing them against various baseline strategies. We also provide an experimental study with a real-world setup by utilizing an existing grasping planning benchmark in the literature. With these analyses, we were able to quantitatively demonstrate the versatility of heuristic methods that prioritize certain types of exploration, and qualitatively show their robustness to both novel objects and the transition from simulation to the real world. We identified scenarios in which our methods did not perform well and scenarios that are objectively difficult, and present a discussion on which avenues for future research show promise. △ Less

Submitted 22 April, 2021; originally announced April 2021.

Comments: 18 pages, 13 figures, submitted to Frontiers in Robotics and AI 2021

Speech Denoising Without Clean Training Data: A Noise2Noise Approach

Authors: Madhav Mahesh Kashyap, Anuj Tambwekar, Krishnamoorthy Manohara, S Natarajan

Abstract: This paper tackles the problem of the heavy dependence of clean speech data required by deep learning based audio-denoising methods by showing that it is possible to train deep speech denoising networks using only noisy speech samples. Conventional wisdom dictates that in order to achieve good speech denoising performance, there is a requirement for a large quantity of both noisy speech samples an… ▽ More This paper tackles the problem of the heavy dependence of clean speech data required by deep learning based audio-denoising methods by showing that it is possible to train deep speech denoising networks using only noisy speech samples. Conventional wisdom dictates that in order to achieve good speech denoising performance, there is a requirement for a large quantity of both noisy speech samples and perfectly clean speech samples, resulting in a need for expensive audio recording equipment and extremely controlled soundproof recording studios. These requirements pose significant challenges in data collection, especially in economically disadvantaged regions and for low resource languages. This work shows that speech denoising deep neural networks can be successfully trained utilizing only noisy training audio. Furthermore it is revealed that such training regimes achieve superior denoising performance over conventional training regimes utilizing clean training audio targets, in cases involving complex noise distributions and low Signal-to-Noise ratios (high noise environments). This is demonstrated through experiments studying the efficacy of our proposed approach over both real-world noises and synthetic noises using the 20 layered Deep Complex U-Net architecture. △ Less

Submitted 19 September, 2021; v1 submitted 8 April, 2021; originally announced April 2021.

Comments: Published in Interspeech 2021 ( See https://www.isca-speech.org/archive/interspeech_2021/kashyap21_interspeech.html ). 5 pages, 2 figures, 1 table

ACM Class: I.2.6; I.5.4

Journal ref: Proc. Interspeech 2021, 2716-2720

Unconstrained Face Recognition using ASURF and Cloud-Forest Classifier optimized with VLAD

Authors: A Vinay, Aviral Joshi, Hardik Mahipal Surana, Harsh Garg, K N BalasubramanyaMurthy, S Natarajan

Abstract: The paper posits a computationally-efficient algorithm for multi-class facial image classification in which images are constrained with translation, rotation, scale, color, illumination and affine distortion. The proposed method is divided into five main building blocks including Haar-Cascade for face detection, Bilateral Filter for image preprocessing to remove unwanted noise, Affine Speeded-Up R… ▽ More The paper posits a computationally-efficient algorithm for multi-class facial image classification in which images are constrained with translation, rotation, scale, color, illumination and affine distortion. The proposed method is divided into five main building blocks including Haar-Cascade for face detection, Bilateral Filter for image preprocessing to remove unwanted noise, Affine Speeded-Up Robust Features (ASURF) for keypoint detection and description, Vector of Locally Aggregated Descriptors (VLAD) for feature quantization and Cloud Forest for image classification. The proposed method aims at improving the accuracy and the time taken for face recognition systems. The usage of the Cloud Forest algorithm as a classifier on three benchmark datasets, namely the FACES95, FACES96 and ORL facial datasets, showed promising results. The proposed methodology using Cloud Forest algorithm successfully improves the recognition model by 2-12\% when differentiated against other ensemble techniques like the Random Forest classifier depending upon the dataset used. △ Less

Submitted 1 April, 2021; originally announced April 2021.

Comments: 8 Pages, 3 Figures

Journal ref: Procedia computer science, 143, 570-578 (2018)

Predicting Drug-Drug Interactions from Heterogeneous Data: An Embedding Approach

Authors: Devendra Singh Dhami, Siwen Yan, Gautam Kunapuli, David Page, Sriraam Natarajan

Abstract: Predicting and discovering drug-drug interactions (DDIs) using machine learning has been studied extensively. However, most of the approaches have focused on text data or textual representation of the drug structures. We present the first work that uses multiple data sources such as drug structure images, drug structure string representation and relational representation of drug relationships as t… ▽ More Predicting and discovering drug-drug interactions (DDIs) using machine learning has been studied extensively. However, most of the approaches have focused on text data or textual representation of the drug structures. We present the first work that uses multiple data sources such as drug structure images, drug structure string representation and relational representation of drug relationships as the input. To this effect, we exploit the recent advances in deep networks to integrate these varied sources of inputs in predicting DDIs. Our empirical evaluation against several state-of-the-art methods using standalone different data types for drugs clearly demonstrate the efficacy of combining heterogeneous data in predicting DDIs. △ Less

Submitted 19 March, 2021; originally announced March 2021.

Comments: 10 pages, 6 figures, Accepted as a short paper to 'Artificial Intelligence in Medicine 2021'

Interventional Sum-Product Networks: Causal Inference with Tractable Probabilistic Models

Authors: Matej Zečević, Devendra Singh Dhami, Athresh Karanam, Sriraam Natarajan, Kristian Kersting

Abstract: While probabilistic models are an important tool for studying causality, doing so suffers from the intractability of inference. As a step towards tractable causal models, we consider the problem of learning interventional distributions using sum-product networks (SPNs) that are over-parameterized by gate functions, e.g., neural networks. Providing an arbitrarily intervened causal graph as input, e… ▽ More While probabilistic models are an important tool for studying causality, doing so suffers from the intractability of inference. As a step towards tractable causal models, we consider the problem of learning interventional distributions using sum-product networks (SPNs) that are over-parameterized by gate functions, e.g., neural networks. Providing an arbitrarily intervened causal graph as input, effectively subsuming Pearl's do-operator, the gate function predicts the parameters of the SPN. The resulting interventional SPNs are motivated and illustrated by a structural causal model themed around personal health. Our empirical evaluation on three benchmark data sets as well as a synthetic health data set clearly demonstrates that interventional SPNs indeed are both expressive in modelling and flexible in adapting to the interventions. △ Less

Submitted 25 October, 2021; v1 submitted 20 February, 2021; originally announced February 2021.

Comments: Main paper: 10 pages, References: 3 pages, Appendix: 8 pages. Main paper: 6 figures, Appendix: 5 figures

A Statistical Relational Approach to Learning Distance-based GCNs

Authors: Devendra Singh Dhami, Siwen Yan, Sriraam Natarajan

Abstract: We consider the problem of learning distance-based Graph Convolutional Networks (GCNs) for relational data. Specifically, we first embed the original graph into the Euclidean space $\mathbb{R}^m$ using a relational density estimation technique thereby constructing a secondary Euclidean graph. The graph vertices correspond to the target triples and edges denote the Euclidean distances between the t… ▽ More We consider the problem of learning distance-based Graph Convolutional Networks (GCNs) for relational data. Specifically, we first embed the original graph into the Euclidean space $\mathbb{R}^m$ using a relational density estimation technique thereby constructing a secondary Euclidean graph. The graph vertices correspond to the target triples and edges denote the Euclidean distances between the target triples. We emphasize the importance of learning the secondary Euclidean graph and the advantages of employing a distance matrix over the typically used adjacency matrix. Our comprehensive empirical evaluation demonstrates the superiority of our approach over $12$ different GCN models, relational embedding techniques and rule learning techniques. △ Less

Submitted 12 October, 2021; v1 submitted 13 February, 2021; originally announced February 2021.

Comments: 8 pages, 5 figures, 4 tables; accepted to STARAI workshop

Particle Swarm Based Hyper-Parameter Optimization for Machine Learned Interatomic Potentials

Authors: Suresh Kondati Natarajan, Miguel A. Caro

Abstract: Modeling non-empirical and highly flexible interatomic potential energy surfaces (PES) using machine learning (ML) approaches is becoming popular in molecular and materials research. Training an ML-PES is typically performed in two stages: feature extraction and structure-property relationship modeling. The feature extraction stage transforms atomic positions into a symmetry-invariant mathematical… ▽ More Modeling non-empirical and highly flexible interatomic potential energy surfaces (PES) using machine learning (ML) approaches is becoming popular in molecular and materials research. Training an ML-PES is typically performed in two stages: feature extraction and structure-property relationship modeling. The feature extraction stage transforms atomic positions into a symmetry-invariant mathematical representation. This representation can be fine-tuned by adjusting on a set of so-called "hyper-parameters" (HPs). Subsequently, an ML algorithm such as neural networks or Gaussian process regression (GPR) is used to model the structure-PES relationship based on another set of HPs. Choosing optimal values for the two sets of HPs is critical to ensure the high quality of the resulting ML-PES model. In this paper, we explore HP optimization strategies tailored for ML-PES generation using a custom-coded parallel particle swarm optimizer (available freely at https://github.com/suresh0807/PPSO.git). We employ the smooth overlap of atomic positions (SOAP) descriptor in combination with GPR-based Gaussian approximation potentials (GAP) and optimize HPs for four distinct systems: a toy C dimer, amorphous carbon, $α$-Fe, and small organic molecules (QM9 dataset). We propose a two-step optimization strategy in which the HPs related to the feature extraction stage are optimized first, followed by the optimization of the HPs in the training stage. This strategy is computationally more efficient than optimizing all HPs at the same time by means of significantly reducing the number of ML models needed to be trained to obtain the optimal HPs. This approach can be trivially extended to other combinations of descriptor and ML algorithm and brings us another step closer to fully automated ML-PES generation. △ Less

Submitted 31 December, 2020; originally announced January 2021.

Relational Boosted Bandits

Authors: Ashutosh Kakadiya, Sriraam Natarajan, Balaraman Ravindran

Abstract: Contextual bandits algorithms have become essential in real-world user interaction problems in recent years. However, these algorithms rely on context as attribute value representation, which makes them unfeasible for real-world domains like social networks are inherently relational. We propose Relational Boosted Bandits(RB2), acontextual bandits algorithm for relational domains based on (relation… ▽ More Contextual bandits algorithms have become essential in real-world user interaction problems in recent years. However, these algorithms rely on context as attribute value representation, which makes them unfeasible for real-world domains like social networks are inherently relational. We propose Relational Boosted Bandits(RB2), acontextual bandits algorithm for relational domains based on (relational) boosted trees. RB2 enables us to learn interpretable and explainable models due to the more descriptive nature of the relational representation. We empirically demonstrate the effectiveness and interpretability of RB2 on tasks such as link prediction, relational classification, and recommendations. △ Less

Submitted 16 December, 2020; originally announced December 2020.

Comments: 8 pages, 3 figures

Graph Based Temporal Aggregation for Video Retrieval

Authors: Arvind Srinivasan, Aprameya Bharadwaj, Aveek Saha, Subramanyam Natarajan

Abstract: Large scale video retrieval is a field of study with a lot of ongoing research. Most of the work in the field is on video retrieval through text queries using techniques such as VSE++. However, there is little research done on video retrieval through image queries, and the work that has been done in this field either uses image queries from within the video dataset or iterates through videos frame… ▽ More Large scale video retrieval is a field of study with a lot of ongoing research. Most of the work in the field is on video retrieval through text queries using techniques such as VSE++. However, there is little research done on video retrieval through image queries, and the work that has been done in this field either uses image queries from within the video dataset or iterates through videos frame by frame. These approaches are not generalized for queries from outside the dataset and do not scale well for large video datasets. To overcome these issues, we propose a new approach for video retrieval through image queries where an undirected graph is constructed from the combined set of frames from all videos to be searched. The node features of this graph are used in the task of video retrieval. Experimentation is done on the MSR-VTT dataset by using query images from outside the dataset. To evaluate this novel approach P@5, P@10 and P@20 metrics are calculated. Two different ResNet models namely, ResNet-152 and ResNet-50 are used in this study. △ Less

Submitted 4 November, 2020; originally announced November 2020.

Comments: 6 pages, 6 figures, 7 tables

Fitted Q-Learning for Relational Domains

Authors: Srijita Das, Sriraam Natarajan, Kaushik Roy, Ronald Parr, Kristian Kersting

Abstract: We consider the problem of Approximate Dynamic Programming in relational domains. Inspired by the success of fitted Q-learning methods in propositional settings, we develop the first relational fitted Q-learning algorithms by representing the value function and Bellman residuals. When we fit the Q-functions, we show how the two steps of Bellman operator; application and projection steps can be per… ▽ More We consider the problem of Approximate Dynamic Programming in relational domains. Inspired by the success of fitted Q-learning methods in propositional settings, we develop the first relational fitted Q-learning algorithms by representing the value function and Bellman residuals. When we fit the Q-functions, we show how the two steps of Bellman operator; application and projection steps can be performed using a gradient-boosting technique. Our proposed framework performs reasonably well on standard domains without using domain models and using fewer training trajectories. △ Less

Submitted 9 June, 2020; originally announced June 2020.

Comments: 10 pages, 12 figures

Optimization of Image Embeddings for Few Shot Learning

Authors: Arvind Srinivasan, Aprameya Bharadwaj, Manasa Sathyan, S Natarajan

Abstract: In this paper we improve the image embeddings generated in the graph neural network solution for few shot learning. We propose alternate architectures for existing networks such as Inception-Net, U-Net, Attention U-Net, and Squeeze-Net to generate embeddings and increase the accuracy of the models. We improve the quality of embeddings created at the cost of the time taken to generate them. The pro… ▽ More In this paper we improve the image embeddings generated in the graph neural network solution for few shot learning. We propose alternate architectures for existing networks such as Inception-Net, U-Net, Attention U-Net, and Squeeze-Net to generate embeddings and increase the accuracy of the models. We improve the quality of embeddings created at the cost of the time taken to generate them. The proposed implementations outperform the existing state of the art methods for 1-shot and 5-shot learning on the Omniglot dataset. The experiments involved a testing set and training set which had no common classes between them. The results for 5-way and 10-way/20-way tests have been tabulated. △ Less

Submitted 4 April, 2020; originally announced April 2020.

Comments: 6 pages, 8 figures

Knowledge Graph Alignment using String Edit Distance

Authors: Navdeep Kaur, Gautam Kunapuli, Sriraam Natarajan

Abstract: In this work, we propose a novel knowledge graph alignment technique based upon string edit distance that exploits the type information between entities and can find similarity between relations of any arity In this work, we propose a novel knowledge graph alignment technique based upon string edit distance that exploits the type information between entities and can find similarity between relations of any arity △ Less

Submitted 29 March, 2020; v1 submitted 13 March, 2020; originally announced March 2020.

Comments: Position Paper

Scaling Hyperledger Fabric Using Pipelined Execution and Sparse Peers

Authors: Parth Thakkar, Senthilnathan Natarajan

Abstract: Permissioned blockchains are becoming popular as data management systems in the enterprise setting. Compared to traditional distributed databases, blockchain platforms provide increased security guarantees but significantly lower performance. Further, these platforms are quite expensive to run for the low throughput they provide. The following are two ways to improve performance and reduce cost: (… ▽ More Permissioned blockchains are becoming popular as data management systems in the enterprise setting. Compared to traditional distributed databases, blockchain platforms provide increased security guarantees but significantly lower performance. Further, these platforms are quite expensive to run for the low throughput they provide. The following are two ways to improve performance and reduce cost: (1) make the system utilize allocated resources efficiently; (2) allow rapid and dynamic scaling of allocated resources based on load. We explore both of these in this work. We first investigate the reasons for the poor performance and scalability of the dominant permissioned blockchain flavor called Execute-Order-Validate (EOV). We do this by studying the scaling characteristics of Hyperledger Fabric, a popular EOV platform, using vertical scaling and horizontal scaling. We find that the transaction throughput scales very poorly with these techniques. At least in the permissioned setting, the real bottleneck is transaction processing, not the consensus protocol. With vertical scaling, the allocated vCPUs go under-utilized. In contrast, with horizontal scaling, the allocated resources get wasted due to redundant work across nodes within an organization. To mitigate the above concerns, we first improve resource efficiency by (a) improving CPU utilization with a pipelined execution of validation & commit phases; (b) avoiding redundant work across nodes by introducing a new type of peer node called sparse peer that selectively commits transactions. We further propose a technique that enables the rapid scaling of resources. Our implementation - SmartFabric, built on top of Hyperledger Fabric demonstrates 3x higher throughput, 12-26x faster scale-up time, and provides Fabric's throughput at 50% to 87% lower cost. △ Less

Submitted 1 March, 2021; v1 submitted 11 March, 2020; originally announced March 2020.

Adaptive phase field modelling of crack propagation in orthotropic functionally graded materials

Authors: Hirshikesh, Emilio Martínez-Pañeda, Sundararajan Natarajan

Abstract: In this work, we extend the recently proposed adaptive phase field method to model fracture in orthotropic functionally graded materials (FGMs). A recovery type error indicator combined with quadtree decomposition is employed for adaptive mesh refinement. The proposed approach is capable of capturing the fracture process with a localized mesh refinement that provides notable gains in computational… ▽ More In this work, we extend the recently proposed adaptive phase field method to model fracture in orthotropic functionally graded materials (FGMs). A recovery type error indicator combined with quadtree decomposition is employed for adaptive mesh refinement. The proposed approach is capable of capturing the fracture process with a localized mesh refinement that provides notable gains in computational efficiency. The implementation is validated against experimental data and other numerical experiments on orthotropic materials with different material orientations. The results reveal an increase in the stiffness and the maximum force with increasing material orientation angle. The study is then extended to the analysis of orthotropic FGMs. It is observed that, if the gradation in fracture properties is neglected, the material gradient plays a secondary role, with the fracture behaviour being dominated by the orthotropy of the material. However, when the toughness increases along the crack propagation path, a substantial gain in fracture resistance is observed. △ Less

Submitted 4 March, 2020; originally announced March 2020.

Journal ref: Defence Technology (2020)

Non-Parametric Learning of Lifted Restricted Boltzmann Machines

Authors: Navdeep Kaur, Gautam Kunapuli, Sriraam Natarajan

Abstract: We consider the problem of discriminatively learning restricted Boltzmann machines in the presence of relational data. Unlike previous approaches that employ a rule learner (for structure learning) and a weight learner (for parameter learning) sequentially, we develop a gradient-boosted approach that performs both simultaneously. Our approach learns a set of weak relational regression trees, whose… ▽ More We consider the problem of discriminatively learning restricted Boltzmann machines in the presence of relational data. Unlike previous approaches that employ a rule learner (for structure learning) and a weight learner (for parameter learning) sequentially, we develop a gradient-boosted approach that performs both simultaneously. Our approach learns a set of weak relational regression trees, whose paths from root to leaf are conjunctive clauses and represent the structure, and whose leaf values represent the parameters. When the learned relational regression trees are transformed into a lifted RBM, its hidden nodes are precisely the conjunctive clauses derived from the relational regression trees. This leads to a more interpretable and explainable model. Our empirical evaluations clearly demonstrate this aspect, while displaying no loss in effectiveness of the learned models. △ Less

Submitted 9 January, 2020; originally announced January 2020.

Comments: 33 pages, 12 figures

Adaptive Importance Sampling based Neural Network framework for Reliability and Sensitivity Prediction for Variable Stiffness Composite Laminates with hybrid uncertainties

Authors: Tittu Varghese Mathew, P Prajith, RO Ruiz, E Atroshchenko, S Natarajan

Abstract: In this work, we propose to leverage the advantages of both the Artificial Neural Network (ANN) based Second Order Reliability Method (SORM) and Importance sampling to yield an Adaptive Importance Sampling based ANN, with specific application towards failure probability and sensitivity estimates of Variable Stiffness Composite Laminate (VSCL) plates, in the presence of multiple independent geometr… ▽ More In this work, we propose to leverage the advantages of both the Artificial Neural Network (ANN) based Second Order Reliability Method (SORM) and Importance sampling to yield an Adaptive Importance Sampling based ANN, with specific application towards failure probability and sensitivity estimates of Variable Stiffness Composite Laminate (VSCL) plates, in the presence of multiple independent geometric and material uncertainties. The performance function for the case studies is defined based on the fundamental frequency of the VSCL plate. The accuracy in both the reliability estimates and sensitivity studies using the proposed method were found to be in close agreement with that obtained using the ANN based brute-force MCS method, with a significant computational savings of 95\%. Moreover, the importance of taking into account the randomness in ply thickness for failure probability estimates is also highlighted quantitatively under the sensitivity studies section. △ Less

Submitted 27 January, 2020; originally announced January 2020.

Journal ref: Composite Structures, 2020

Continuum modelling of stress diffusion interactions in an elastoplastic medium in the presence of geometric discontinuity

Authors: Rupesh Kumar Mahendran, Hirshikesh, Ratna Kumar Annabattula, Sundararajan Natarajan

Abstract: Chemo-mechanical coupled systems have been a subject of interest for many decades now. Previous attempts to solve such models have mainly focused on elastic materials without taking into account the plastic deformation beyond yield, thus causing inaccuracies in failure calculations. This paper aims to study the effect of stress-diffusion interactions in an elastoplastic material using a coupled ch… ▽ More Chemo-mechanical coupled systems have been a subject of interest for many decades now. Previous attempts to solve such models have mainly focused on elastic materials without taking into account the plastic deformation beyond yield, thus causing inaccuracies in failure calculations. This paper aims to study the effect of stress-diffusion interactions in an elastoplastic material using a coupled chemo-mechanical system. The induced stress is dependent on the local concentration in a one way coupled system, and vice versa in a two way coupled system. The time-dependent transient coupled system is solved using a finite element formulation in an open-source finite element solver FEniCS. This paper attempts to computationally study the interaction of deformation and diffusion and its effect on the localization of plastic strain. We investigate the role of geometric discontinuities in scenarios involving diffusing species, namely, a plate with a notch/hole/void and particle with a void/hole/core. We also study the effect of stress concentrations and plastic yielding on the diffusion-deformation. The developed code can be from https://github.com/mrupeshkumar/Elastoplastic-stress-diffusion-coupling △ Less

Submitted 11 January, 2020; originally announced January 2020.

Report number: IITM-2020-01

A Preliminary Approach for Learning Relational Policies for the Management of Critically Ill Children

Authors: Michael A. Skinner, Lakshmi Raman, Neel Shah, Abdelaziz Farhat, Sriraam Natarajan

Abstract: The increased use of electronic health records has made possible the automated extraction of medical policies from patient records to aid in the development of clinical decision support systems. We adapted a boosted Statistical Relational Learning (SRL) framework to learn probabilistic rules from clinical hospital records for the management of physiologic parameters of children with severe cardiac… ▽ More The increased use of electronic health records has made possible the automated extraction of medical policies from patient records to aid in the development of clinical decision support systems. We adapted a boosted Statistical Relational Learning (SRL) framework to learn probabilistic rules from clinical hospital records for the management of physiologic parameters of children with severe cardiac or respiratory failure who were managed with extracorporeal membrane oxygenation. In this preliminary study, the results were promising. In particular, the algorithm returned logic rules for medical actions that are consistent with medical reasoning. △ Less

Submitted 13 January, 2020; originally announced January 2020.

Comments: 6 pages, 1 figure, presented at the 2020 AAAI StarAI workshop

Lifted Hybrid Variational Inference

Authors: Yuqiao Chen, Yibo Yang, Sriraam Natarajan, Nicholas Ruozzi

Abstract: A variety of lifted inference algorithms, which exploit model symmetry to reduce computational cost, have been proposed to render inference tractable in probabilistic relational models. Most existing lifted inference algorithms operate only over discrete domains or continuous domains with restricted potential functions, e.g., Gaussian. We investigate two approximate lifted variational approaches t… ▽ More A variety of lifted inference algorithms, which exploit model symmetry to reduce computational cost, have been proposed to render inference tractable in probabilistic relational models. Most existing lifted inference algorithms operate only over discrete domains or continuous domains with restricted potential functions, e.g., Gaussian. We investigate two approximate lifted variational approaches that are applicable to hybrid domains and expressive enough to capture multi-modality. We demonstrate that the proposed variational methods are both scalable and can take advantage of approximate model symmetries, even in the presence of a large amount of continuous evidence. We demonstrate that our approach compares favorably against existing message-passing based approaches in a variety of settings. Finally, we present a sufficient condition for the Bethe approximation to yield a non-trivial estimate over the marginal polytope. △ Less

Submitted 7 February, 2020; v1 submitted 8 January, 2020; originally announced January 2020.

Comments: AAAI 2020 Workshop on Statistical Relational AI (StarAI 2020)

Non-Parametric Learning of Gaifman Models

Authors: Devendra Singh Dhami, Siwen Yan, Gautam Kunapuli, Sriraam Natarajan

Abstract: We consider the problem of structure learning for Gaifman models and learn relational features that can be used to derive feature representations from a knowledge base. These relational features are first-order rules that are then partially grounded and counted over local neighborhoods of a Gaifman model to obtain the feature representations. We propose a method for learning these relational featu… ▽ More We consider the problem of structure learning for Gaifman models and learn relational features that can be used to derive feature representations from a knowledge base. These relational features are first-order rules that are then partially grounded and counted over local neighborhoods of a Gaifman model to obtain the feature representations. We propose a method for learning these relational features for a Gaifman model by using relational tree distances. Our empirical evaluation on real data sets demonstrates the superiority of our approach over classical rule-learning. △ Less

Submitted 15 January, 2020; v1 submitted 2 January, 2020; originally announced January 2020.

Comments: 8 pages, 6 figures

User Friendly Automatic Construction of Background Knowledge: Mode Construction from ER Diagrams

Authors: Alexander L. Hayes, Mayukh Das, Phillip Odom, Sriraam Natarajan

Abstract: One of the key advantages of Inductive Logic Programming systems is the ability of the domain experts to provide background knowledge as modes that allow for efficient search through the space of hypotheses. However, there is an inherent assumption that this expert should also be an ILP expert to provide effective modes. We relax this assumption by designing a graphical user interface that allows… ▽ More One of the key advantages of Inductive Logic Programming systems is the ability of the domain experts to provide background knowledge as modes that allow for efficient search through the space of hypotheses. However, there is an inherent assumption that this expert should also be an ILP expert to provide effective modes. We relax this assumption by designing a graphical user interface that allows the domain expert to interact with the system using Entity Relationship diagrams. These interactions are used to construct modes for the learning system. We evaluate our algorithm on a probabilistic logic learning system where we demonstrate that the user is able to construct effective background knowledge on par with the expert-encoded knowledge on five data sets. △ Less

Submitted 16 December, 2019; originally announced December 2019.

Comments: 8 pages. Published in Proceedings of the Knowledge Capture Conference, 2017

Journal ref: Proceedings of the Knowledge Capture Conference (2017) 30:1-30:8

One-Shot Induction of Generalized Logical Concepts via Human Guidance

Authors: Mayukh Das, Nandini Ramanan, Janardhan Rao Doppa, Sriraam Natarajan

Abstract: We consider the problem of learning generalized first-order representations of concepts from a single example. To address this challenging problem, we augment an inductive logic programming learner with two novel algorithmic contributions. First, we define a distance measure between candidate concept representations that improves the efficiency of search for target concept and generalization. Seco… ▽ More We consider the problem of learning generalized first-order representations of concepts from a single example. To address this challenging problem, we augment an inductive logic programming learner with two novel algorithmic contributions. First, we define a distance measure between candidate concept representations that improves the efficiency of search for target concept and generalization. Second, we leverage richer human inputs in the form of advice to improve the sample-efficiency of learning. We prove that the proposed distance measure is semantically valid and use that to derive a PAC bound. Our experimental analysis on diverse concept learning tasks demonstrates both the effectiveness and efficiency of the proposed approach over a first-order concept learner using only examples. △ Less

Submitted 15 December, 2019; originally announced December 2019.

Comments: STARAI '20, Workshop version

Virtual element method for semilinear sine-Gordon equation over polygonal mesh using product approximation technique

Authors: Dibyendu Adak, Sundararajan Natarajan

Abstract: In this paper, we employ the linear virtual element spaces to discretize the semilinear sine-Gordon equation in two dimensions. The salient features of the virtual element method (VEM) are: (a) it does not require explicit form of the shape functions to construct the nonlinear and the bilinear terms, and (b) relaxes the constraint on the mesh topology by allowing the domain to be discretized with… ▽ More In this paper, we employ the linear virtual element spaces to discretize the semilinear sine-Gordon equation in two dimensions. The salient features of the virtual element method (VEM) are: (a) it does not require explicit form of the shape functions to construct the nonlinear and the bilinear terms, and (b) relaxes the constraint on the mesh topology by allowing the domain to be discretized with general polygons consisting of both convex and concave elements, and (c) easy mesh refinements (hanging nodes and interfaces are allowed). The nonlinear source term is discretized by employing the product approximation technique and for temporal discretization, the Crank-Nicolson scheme is used. The resulting nonlinear equations are solved using the Newton's method. We derive a priori error estimations in $L^2$ and $H^1$ norms. The convergence properties and the accuracy of the virtual element method for the solution of the sine-Gordon equation are demonstrated with academic numerical experiments. △ Less

Submitted 11 December, 2019; originally announced December 2019.

Comments: 28 pages, 3 Figures, 3 Tables

Beyond Textual Data: Predicting Drug-Drug Interactions from Molecular Structure Images using Siamese Neural Networks

Authors: Devendra Singh Dhami, Siwen Yan, Gautam Kunapuli, David Page, Sriraam Natarajan

Abstract: Predicting and discovering drug-drug interactions (DDIs) is an important problem and has been studied extensively both from medical and machine learning point of view. Almost all of the machine learning approaches have focused on text data or textual representation of the structural data of drugs. We present the first work that uses drug structure images as the input and utilizes a Siamese convolu… ▽ More Predicting and discovering drug-drug interactions (DDIs) is an important problem and has been studied extensively both from medical and machine learning point of view. Almost all of the machine learning approaches have focused on text data or textual representation of the structural data of drugs. We present the first work that uses drug structure images as the input and utilizes a Siamese convolutional network architecture to predict DDIs. △ Less

Submitted 29 June, 2020; v1 submitted 14 November, 2019; originally announced November 2019.

Comments: 9 pages, 9 figures

Neural Networks for Relational Data

Authors: Navdeep Kaur, Gautam Kunapuli, Saket Joshi, Kristian Kersting, Sriraam Natarajan

Abstract: While deep networks have been enormously successful over the last decade, they rely on flat-feature vector representations, which makes them unsuitable for richly structured domains such as those arising in applications like social network analysis. Such domains rely on relational representations to capture complex relationships between entities and their attributes. Thus, we consider the problem… ▽ More While deep networks have been enormously successful over the last decade, they rely on flat-feature vector representations, which makes them unsuitable for richly structured domains such as those arising in applications like social network analysis. Such domains rely on relational representations to capture complex relationships between entities and their attributes. Thus, we consider the problem of learning neural networks for relational data. We distinguish ourselves from current approaches that rely on expert hand-coded rules by learning relational random-walk-based features to capture local structural interactions and the resulting network architecture. We further exploit parameter tying of the network weights of the resulting relational neural network, where instances of the same type share parameters. Our experimental results across several standard relational data sets demonstrate the effectiveness of the proposed approach over multiple neural net baselines as well as state-of-the-art statistical relational models. △ Less

Submitted 13 January, 2020; v1 submitted 28 August, 2019; originally announced September 2019.

Comments: 15 pages, 2 figures. To appear in the proceedings of 29th International Conference on Inductive Logic Programming (2019)

Knowledge-augmented Column Networks: Guiding Deep Learning with Advice

Authors: Mayukh Das, Devendra Singh Dhami, Yang Yu, Gautam Kunapuli, Sriraam Natarajan

Abstract: Recently, deep models have had considerable success in several tasks, especially with low-level representations. However, effective learning from sparse noisy samples is a major challenge in most deep models, especially in domains with structured representations. Inspired by the proven success of human guided machine learning, we propose Knowledge-augmented Column Networks, a relational deep learn… ▽ More Recently, deep models have had considerable success in several tasks, especially with low-level representations. However, effective learning from sparse noisy samples is a major challenge in most deep models, especially in domains with structured representations. Inspired by the proven success of human guided machine learning, we propose Knowledge-augmented Column Networks, a relational deep learning framework that leverages human advice/knowledge to learn better models in presence of sparsity and systematic noise. △ Less

Submitted 31 May, 2019; originally announced June 2019.

Comments: Presented at 2019 ICML Workshop on Human in the Loop Learning (HILL 2019), Long Beach, USA. arXiv admin note: substantial text overlap with arXiv:1904.06950

Phase field modelling of crack propagation in functionally graded materials

Authors: Hirshikesh, Sundararajan Natarajan, Ratna K. Annabattula, Emilio Martínez-Pañeda

Abstract: We present a phase field formulation for fracture in functionally graded materials (FGMs). The model builds upon homogenization theory and accounts for the spatial variation of elastic and fracture properties. Several paradigmatic case studies are addressed to demonstrate the potential of the proposed modelling framework. Specifically, we (i) gain insight into the crack growth resistance of FGMs b… ▽ More We present a phase field formulation for fracture in functionally graded materials (FGMs). The model builds upon homogenization theory and accounts for the spatial variation of elastic and fracture properties. Several paradigmatic case studies are addressed to demonstrate the potential of the proposed modelling framework. Specifically, we (i) gain insight into the crack growth resistance of FGMs by conducting numerical experiments over a wide range of material gradation profiles and orientations, (ii) accurately reproduce the crack trajectories observed in graded photodegradable copolymers and glass-filled epoxy FGMs, (iii) benchmark our predictions with results from alternative numerical methodologies, and (iv) model complex crack paths and failure in three dimensional functionally graded solids. The suitability of phase field fracture methods in capturing the crack deflections intrinsic to crack tip mode-mixity due to material gradients is demonstrated. Material gradient profiles that prevent unstable fracture and enhance crack growth resistance are identified: this provides the foundation for the design of fracture resistant FGMs. The finite element code developed can be downloaded from www.empaneda.com/codes. △ Less

Submitted 7 April, 2019; originally announced April 2019.

Journal ref: Composites Part B: Engineering (2019)

Human-Guided Learning of Column Networks: Augmenting Deep Learning with Advice

Authors: Mayukh Das, Yang Yu, Devendra Singh Dhami, Gautam Kunapuli, Sriraam Natarajan

Abstract: Recently, deep models have been successfully applied in several applications, especially with low-level representations. However, sparse, noisy samples and structured domains (with multiple objects and interactions) are some of the open challenges in most deep models. Column Networks, a deep architecture, can succinctly capture such domain structure and interactions, but may still be prone to sub-… ▽ More Recently, deep models have been successfully applied in several applications, especially with low-level representations. However, sparse, noisy samples and structured domains (with multiple objects and interactions) are some of the open challenges in most deep models. Column Networks, a deep architecture, can succinctly capture such domain structure and interactions, but may still be prone to sub-optimal learning from sparse and noisy samples. Inspired by the success of human-advice guided learning in AI, especially in data-scarce domains, we propose Knowledge-augmented Column Networks that leverage human advice/knowledge for better learning with noisy/sparse samples. Our experiments demonstrate that our approach leads to either superior overall performance or faster convergence (i.e., both effective and efficient). △ Less

Submitted 15 April, 2019; originally announced April 2019.

Comments: Under Review at 'Machine Learning Journal' (MLJ)