-
GraphRNN Revisited: An Ablation Study and Extensions for Directed Acyclic Graphs
Authors:
Taniya Das,
Mark Koch,
Maya Ravichandran,
Nikhil Khatri
Abstract:
GraphRNN is a deep learning-based architecture proposed by You et al. for learning generative models for graphs. We replicate the results of You et al. using a reproduced implementation of the GraphRNN architecture and evaluate this against baseline models using new metrics. Through an ablation study, we find that the BFS traversal suggested by You et al. to collapse representations of isomorphic…
▽ More
GraphRNN is a deep learning-based architecture proposed by You et al. for learning generative models for graphs. We replicate the results of You et al. using a reproduced implementation of the GraphRNN architecture and evaluate this against baseline models using new metrics. Through an ablation study, we find that the BFS traversal suggested by You et al. to collapse representations of isomorphic graphs contributes significantly to model performance. Additionally, we extend GraphRNN to generate directed acyclic graphs by replacing the BFS traversal with a topological sort. We demonstrate that this method improves significantly over a directed-multiclass variant of GraphRNN on a real-world dataset.
△ Less
Submitted 26 July, 2023;
originally announced July 2023.
-
Deterministic Approximation Algorithms for Volumes of Spectrahedra
Authors:
Mahmut Levent Doğan,
Jonathan Leake,
Mohan Ravichandran
Abstract:
We give a method for computing asymptotic formulas and approximations for the volumes of spectrahedra, based on the maximum-entropy principle from statistical physics. The method gives an approximate volume formula based on a single convex optimization problem of minimizing $-\log \det P$ over the spectrahedron. Spectrahedra can be described as affine slices of the convex cone of positive semi-def…
▽ More
We give a method for computing asymptotic formulas and approximations for the volumes of spectrahedra, based on the maximum-entropy principle from statistical physics. The method gives an approximate volume formula based on a single convex optimization problem of minimizing $-\log \det P$ over the spectrahedron. Spectrahedra can be described as affine slices of the convex cone of positive semi-definite (PSD) matrices, and the method yields efficient deterministic approximation algorithms and asymptotic formulas whenever the number of affine constraints is sufficiently dominated by the dimension of the PSD cone.
Our approach is inspired by the work of Barvinok and Hartigan who used an analogous framework for approximately computing volumes of polytopes. Spectrahedra, however, possess a remarkable feature not shared by polytopes, a new fact that we also prove: central sections of the set of density matrices (the quantum version of the simplex) all have asymptotically the same volume. This allows for very general approximation algorithms, which apply to large classes of naturally occurring spectrahedra.
We give two main applications of this method. First, we apply this method to what we call the "multi-way Birkhoff spectrahedron" and obtain an explicit asymptotic formula for its volume. This spectrahedron is the set of quantum states with maximal entanglement (i.e., the quantum states having univariant quantum marginals equal to the identity matrix) and is the quantum analog of the multi-way Birkhoff polytope. Second, we apply this method to explicitly compute the asymptotic volume of central sections of the set of density matrices.
△ Less
Submitted 22 November, 2022;
originally announced November 2022.
-
Quasipolynomial-time algorithms for Gibbs point processes
Authors:
Matthew Jenssen,
Marcus Michelen,
Mohan Ravichandran
Abstract:
We demonstrate a quasipolynomial-time deterministic approximation algorithm for the partition function of a Gibbs point process interacting via a finite-range stable potential. This result holds for all activities $λ$ for which the partition function satisfies a zero-free assumption in a neighborhood of the interval $[0,λ]$. As a corollary, for all finite-range stable potentials we obtain a quasip…
▽ More
We demonstrate a quasipolynomial-time deterministic approximation algorithm for the partition function of a Gibbs point process interacting via a finite-range stable potential. This result holds for all activities $λ$ for which the partition function satisfies a zero-free assumption in a neighborhood of the interval $[0,λ]$. As a corollary, for all finite-range stable potentials we obtain a quasipolynomial-time determinsitic algorithm for all $λ< /(e^{B + 1} \hat C_φ)$ where $\hat C_φ$ is a temperedness parameter and $B$ is the stability constant of $φ$. In the special case of a repulsive potential such as the hard-sphere gas we improve the range of activity by a factor of at least $e^2$ and obtain a quasipolynomial-time deterministic approximation algorithm for all $λ< e/Δ_φ$, where $Δ_φ$ is the potential-weighted connective constant of the potential $φ$. Our algorithm approximates coefficients of the cluster expansion of the partition function and uses the interpolation method of Barvinok to extend this approximation throughout the zero-free region.
△ Less
Submitted 23 May, 2023; v1 submitted 21 September, 2022;
originally announced September 2022.
-
Mediators: Conversational Agents Explaining NLP Model Behavior
Authors:
Nils Feldhus,
Ajay Madhavan Ravichandran,
Sebastian Möller
Abstract:
The human-centric explainable artificial intelligence (HCXAI) community has raised the need for framing the explanation process as a conversation between human and machine. In this position paper, we establish desiderata for Mediators, text-based conversational agents which are capable of explaining the behavior of neural models interactively using natural language. From the perspective of natural…
▽ More
The human-centric explainable artificial intelligence (HCXAI) community has raised the need for framing the explanation process as a conversation between human and machine. In this position paper, we establish desiderata for Mediators, text-based conversational agents which are capable of explaining the behavior of neural models interactively using natural language. From the perspective of natural language processing (NLP) research, we engineer a blueprint of such a Mediator for the task of sentiment analysis and assess how far along current research is on the path towards dialogue-based explanations.
△ Less
Submitted 13 June, 2022;
originally announced June 2022.
-
Approximation algorithms for the random-field Ising model
Authors:
Tyler Helmuth,
Holden Lee,
Will Perkins,
Mohan Ravichandran,
Qiang Wu
Abstract:
Approximating the partition function of the ferromagnetic Ising model with general external fields is known to be #BIS-hard in the worst case, even for bounded-degree graphs, and it is widely believed that no polynomial-time approximation scheme exists. This motivates an average-case question: are there classes of instances for which polynomial-time approximation schemes exist? We investigate this…
▽ More
Approximating the partition function of the ferromagnetic Ising model with general external fields is known to be #BIS-hard in the worst case, even for bounded-degree graphs, and it is widely believed that no polynomial-time approximation scheme exists. This motivates an average-case question: are there classes of instances for which polynomial-time approximation schemes exist? We investigate this question for the random field Ising model on graphs with maximum degree $Δ$. We establish the existence of fully polynomial-time approximation schemes and samplers with high probability over the random fields if the external fields are IID Gaussians with variance larger than a constant depending only on the inverse temperature and $Δ$. The main challenge comes from the positive density of vertices at which the external field is small. These regions, which may have connected components of size $Θ(\log n)$, are a barrier to algorithms based on establishing a zero-free region, and cause worst-case analyses of Glauber dynamics to fail. The analysis of our algorithm is based on percolation on a self-avoiding walk tree.
△ Less
Submitted 26 August, 2021;
originally announced August 2021.
