Showing 1–50 of 137 results for author: Arora, R

Bayesian Inference analysis of jet quenching using inclusive jet and hadron suppression measurements

Authors: R. Ehlers, Y. Chen, J. Mulligan, Y. Ji, A. Kumar, S. Mak, P. M. Jacobs, A. Majumder, A. Angerami, R. Arora, S. A. Bass, R. Datta, L. Du, H. Elfner, R. J. Fries, C. Gale, Y. He, B. V. Jacak, S. Jeon, F. Jonas, L. Kasper, M. Kordell II, R. Kunnawalkam-Elayavalli, J. Latessa, Y. -J. Lee , et al. (28 additional authors not shown)

Abstract: The JETSCAPE Collaboration reports a new determination of the jet transport parameter $\hat{q}$ in the Quark-Gluon Plasma (QGP) using Bayesian Inference, incorporating all available inclusive hadron and jet yield suppression data measured in heavy-ion collisions at RHIC and the LHC. This multi-observable analysis extends the previously published JETSCAPE Bayesian Inference determination of… ▽ More The JETSCAPE Collaboration reports a new determination of the jet transport parameter $\hat{q}$ in the Quark-Gluon Plasma (QGP) using Bayesian Inference, incorporating all available inclusive hadron and jet yield suppression data measured in heavy-ion collisions at RHIC and the LHC. This multi-observable analysis extends the previously published JETSCAPE Bayesian Inference determination of $\hat{q}$, which was based solely on a selection of inclusive hadron suppression data. JETSCAPE is a modular framework incorporating detailed dynamical models of QGP formation and evolution, and jet propagation and interaction in the QGP. Virtuality-dependent partonic energy loss in the QGP is modeled as a thermalized weakly-coupled plasma, with parameters determined from Bayesian calibration using soft-sector observables. This Bayesian calibration of $\hat{q}$ utilizes Active Learning, a machine--learning approach, for efficient exploitation of computing resources. The experimental data included in this analysis span a broad range in collision energy and centrality, and in transverse momentum. In order to explore the systematic dependence of the extracted parameter posterior distributions, several different calibrations are reported, based on combined jet and hadron data; on jet or hadron data separately; and on restricted kinematic or centrality ranges of the jet and hadron data. Tension is observed in comparison of these variations, providing new insights into the physics of jet transport in the QGP and its theoretical formulation. △ Less

Submitted 28 August, 2024; v1 submitted 15 August, 2024; originally announced August 2024.

Comments: 20 pages, 10 figures, 2 tables, submitted to PRC; updated acknowledgements

The Harmonic Exponential Filter for Nonparametric Estimation on Motion Groups

Authors: Miguel Saavedra-Ruiz, Steven A. Parkison, Ria Arora, James Richard Forbes, Liam Paull

Abstract: Bayesian estimation is a vital tool in robotics as it allows systems to update the belief of the robot state using incomplete information from noisy sensors. To render the state estimation problem tractable, many systems assume that the motion and measurement noise, as well as the state distribution, are all unimodal and Gaussian. However, there are numerous scenarios and systems that do not compl… ▽ More Bayesian estimation is a vital tool in robotics as it allows systems to update the belief of the robot state using incomplete information from noisy sensors. To render the state estimation problem tractable, many systems assume that the motion and measurement noise, as well as the state distribution, are all unimodal and Gaussian. However, there are numerous scenarios and systems that do not comply with these assumptions. Existing non-parametric filters that are used to model multimodal distributions have drawbacks that limit their ability to represent a diverse set of distributions. In this paper, we introduce a novel approach to nonparametric Bayesian filtering to cope with multimodal distributions using harmonic exponential distributions. This approach leverages two key insights of harmonic exponential distributions: a) the product of two distributions can be expressed as the element-wise addition of their log-likelihood Fourier coefficients, and b) the convolution of two distributions can be efficiently computed as the tensor product of their Fourier coefficients. These observations enable the development of an efficient and exact solution to the Bayes filter up to the band limit of a Fourier transform. We demonstrate our filter's superior performance compared with established nonparametric filtering methods across a range of simulated and real-world localization tasks. △ Less

Submitted 1 August, 2024; originally announced August 2024.

Comments: Preprint under review. Code available at https://github.com/montrealrobotics/harmonic-filter. Webpage and additional videos at https://montrealrobotics.ca/hef/

Global gradient estimates for solutions of parabolic equations with nonstandard growth

Authors: Rakesh Arora, Sergey Shmarev

Abstract: We study how the smoothness of the initial datum and the free term affect the global regularity properties of solutions to the Dirichlet problem for the class of parabolic equations of $p(x,t)$-Laplace type %with nonlinear sources depending on the solution and its gradient: \[ u_t-Δ_{p(\cdot)}u=f(z)+F(z,u,\nabla u),\quad z=(x,t)\in Q_T=Ω\times (0,T), \] with the nonlinear source… ▽ More We study how the smoothness of the initial datum and the free term affect the global regularity properties of solutions to the Dirichlet problem for the class of parabolic equations of $p(x,t)$-Laplace type %with nonlinear sources depending on the solution and its gradient: \[ u_t-Δ_{p(\cdot)}u=f(z)+F(z,u,\nabla u),\quad z=(x,t)\in Q_T=Ω\times (0,T), \] with the nonlinear source $F(z,u,\nabla u)=a(z)|u|^{q(z)-2}u+|\nabla u|^{s(z)-2}(\vec c,\nabla u)$. It is proven the existence of a solution such that if $|\nabla u(x,0)|\in L^r(Ω)$ for some $r\geq \max\{2,\max p(z)\}$, then the gradient preserves the initial order of integrability in time, gains global higher integrability, and the solution acquires the second-order regularity in the following sense: \[ \text{$|\nabla u(x,t)|\in L^r(Ω)$ for a.e. $t \in (0,T)$}, \qquad \text{$|\nabla u|^{p(z)+ρ+r-2} \in L^1(Q_T)$ for any $ρ\in \left(0, \frac{4}{N+2}\right)$}, \] and \[ |\nabla u|^{\frac{p(z)+r}{2}-2}\nabla u\in L^2(0,T;W^{1,2}(Ω))^N. \] The exponent $r$ is arbitrary and independent of $p(z)$ if $f\in L^{N+2}(Q_T)$, while for $f\in L^σ(Q_T)$ with $σ\in (2,N+2)$ the exponent $r$ belongs to a bounded interval whose endpoints are defined by $\max p(z)$, $\min p(z)$, $N$, and $σ$. An integration by parts formula is also proven, which is of independent interest. △ Less

Submitted 29 July, 2024; originally announced July 2024.

Comments: 30 pages. Comments are welcome

MSC Class: 35K65; 35K67; 35B65; 35K55; 35K99

A soft-hard framework with exact four momentum conservation for small systems

Authors: I. Soudi, W. Zhao, A. Majumder, C. Shen, J. H. Putschke, B. Boudreaux, A. Angerami, R. Arora, S. A. Bass, Y. Chen, R. Datta, L. Du, R. Ehlers, H. Elfner, R. J. Fries, C. Gale, Y. He, B. V. Jacak, P. M. Jacobs, S. Jeon, Y. Ji, L. Kasper, M. Kelsey, M. Kordell II, A. Kumar , et al. (28 additional authors not shown)

Abstract: A new framework, called x-scape, for the combined study of both hard and soft transverse momentum sectors in high energy proton-proton ($p$-$p$) and proton-nucleus ($p$-$A$) collisions is set up. A dynamical initial state is set up using the 3d-Glauber model with transverse locations of hotspots within each incoming nucleon. A hard scattering that emanates from two colliding hotspots is carried ou… ▽ More A new framework, called x-scape, for the combined study of both hard and soft transverse momentum sectors in high energy proton-proton ($p$-$p$) and proton-nucleus ($p$-$A$) collisions is set up. A dynamical initial state is set up using the 3d-Glauber model with transverse locations of hotspots within each incoming nucleon. A hard scattering that emanates from two colliding hotspots is carried out using the Pythia generator. Initial state radiation from the incoming hard partons is carried out in a new module called I-matter, which includes the longitudinal location of initial splits. The energy-momentum of both the initial hard partons and their associated beam remnants is removed from the hot spots, depleting the energy-momentum available for the formation of the bulk medium. Outgoing showers are simulated using the matter generator, and results are presented for both cases, allowing for and not allowing for energy loss. First comparisons between this hard-soft model and single inclusive hadron and jet data from $p$-$p$ and minimum bias $p$-$Pb$ collisions are presented. Single hadron spectra in $p$-$p$ are used to carry out a limited (in number of parameters) Bayesian calibration of the model. Fair comparisons with data are indicative of the utility of this new framework. Theoretical studies of the correlation between jet $p_T$ and event activity at mid and forward rapidity are carried out. △ Less

Submitted 24 July, 2024; originally announced July 2024.

Comments: 18 pages, 15 figures

Data-driven Multistage Distributionally Robust Linear Optimization with Nested Distance

Authors: Rui Gao, Rohit Arora, Yizhe Huang

Abstract: We study multistage distributionally robust linear optimization, where the uncertainty set is defined as a ball of distribution centered at a scenario tree using the nested distance. The resulting minimax problem is notoriously difficult to solve due to its inherent non-convexity. In this paper, we demonstrate that, under mild conditions, the robust risk evaluation of a given policy can be express… ▽ More We study multistage distributionally robust linear optimization, where the uncertainty set is defined as a ball of distribution centered at a scenario tree using the nested distance. The resulting minimax problem is notoriously difficult to solve due to its inherent non-convexity. In this paper, we demonstrate that, under mild conditions, the robust risk evaluation of a given policy can be expressed in an equivalent recursive form. Furthermore, assuming stagewise independence, we derive equivalent dynamic programming reformulations to find an optimal robust policy that is time-consistent and well-defined on unseen sample paths. Our reformulations reconcile two modeling frameworks: the multistage-static formulation (with nested distance) and the multistage-dynamic formulation (with one-period Wasserstein distance). Moreover, we identify tractable cases when the value functions can be computed efficiently using convex optimization techniques. △ Less

Submitted 23 July, 2024; originally announced July 2024.

Comments: First appeared online at https://optimization-online.org/?p=20641 on Oct 15, 2022

Socially Interactive Agents for Robotic Neurorehabilitation Training: Conceptualization and Proof-of-concept Study

Authors: Rhythm Arora, Pooja Prajod, Matteo Lavit Nicora, Daniele Panzeri, Giovanni Tauro, Rocco Vertechy, Matteo Malosio, Elisabeth André, Patrick Gebhard

Abstract: Individuals with diverse motor abilities often benefit from intensive and specialized rehabilitation therapies aimed at enhancing their functional recovery. Nevertheless, the challenge lies in the restricted availability of neurorehabilitation professionals, hindering the effective delivery of the necessary level of care. Robotic devices hold great potential in reducing the dependence on medical p… ▽ More Individuals with diverse motor abilities often benefit from intensive and specialized rehabilitation therapies aimed at enhancing their functional recovery. Nevertheless, the challenge lies in the restricted availability of neurorehabilitation professionals, hindering the effective delivery of the necessary level of care. Robotic devices hold great potential in reducing the dependence on medical personnel during therapy but, at the same time, they generally lack the crucial human interaction and motivation that traditional in-person sessions provide. To bridge this gap, we introduce an AI-based system aimed at delivering personalized, out-of-hospital assistance during neurorehabilitation training. This system includes a rehabilitation training device, affective signal classification models, training exercises, and a socially interactive agent as the user interface. With the assistance of a professional, the envisioned system is designed to be tailored to accommodate the unique rehabilitation requirements of an individual patient. Conceptually, after a preliminary setup and instruction phase, the patient is equipped to continue their rehabilitation regimen autonomously in the comfort of their home, facilitated by a socially interactive agent functioning as a virtual coaching assistant. Our approach involves the integration of an interactive socially-aware virtual agent into a neurorehabilitation robotic framework, with the primary objective of recreating the social aspects inherent to in-person rehabilitation sessions. We also conducted a feasibility study to test the framework with healthy patients. The results of our preliminary investigation indicate that participants demonstrated a propensity to adapt to the system. Notably, the presence of the interactive agent during the proposed exercises did not act as a source of distraction; instead, it positively impacted users' engagement. △ Less

Submitted 17 June, 2024; originally announced June 2024.

2D Nitride Ordered Alloys: A Novel Class of Ultra-Wide Bandgap Semiconductors

Authors: Raagya Arora, Ariel R. Barr, Daniel Bennett, Daniel T. Larson, Michele Pizzochero, Efthimios Kaxiras

Abstract: Ultra-wide bandgap (UWBG) semiconductors are poised to transform power electronics by surpassing the capabilities of established wide bandgap materials, such as GaN and SiC, owing to their capability to operate at higher voltage, frequency, and temperature ranges. While bulk group-III nitrides and their alloys have been extensively studied in the UWBG realm, their two-dimensional counterparts rema… ▽ More Ultra-wide bandgap (UWBG) semiconductors are poised to transform power electronics by surpassing the capabilities of established wide bandgap materials, such as GaN and SiC, owing to their capability to operate at higher voltage, frequency, and temperature ranges. While bulk group-III nitrides and their alloys have been extensively studied in the UWBG realm, their two-dimensional counterparts remain unexplored. Here, we examine the stability and electronic properties of monolayers of ordered boron-based group-III nitride alloys with general formula BxM1-xN, where M = Al, Ga. On the basis of ab initio calculations we identify a number of energetically and dynamically stable structures. Instrumental to their stability is a previously overlooked out-of-plane displacement (puckering) of atoms, which induces a polar ordering and antiferroelectric ground state. Our findings reveal the energy barrier between metastable ferroelectric states is lowered by successive switching of out-of-plane displacements through an antiferroelectric state. △ Less

Submitted 14 May, 2024; originally announced May 2024.

Comments: 18 pages, 3 figures

Catalyzing Social Interactions in Mixed Reality using ML Recommendation Systems

Authors: Sparsh Srivastava, Rohan Arora

Abstract: We create an innovative mixed reality-first social recommendation model, utilizing features uniquely collected through mixed reality (MR) systems to promote social interaction, such as gaze recognition, proximity, noise level, congestion level, and conversational intensity. We further extend these models to include right-time features to deliver timely notifications. We measure performance metrics… ▽ More We create an innovative mixed reality-first social recommendation model, utilizing features uniquely collected through mixed reality (MR) systems to promote social interaction, such as gaze recognition, proximity, noise level, congestion level, and conversational intensity. We further extend these models to include right-time features to deliver timely notifications. We measure performance metrics across various models by creating a new intersection of user features, MR features, and right-time features. We create four model types trained on different combinations of the feature classes, where we compare the baseline model trained on the class of user features against the models trained on MR features, right-time features, and a combination of all of the feature classes. Due to limitations in data collection and cost, we observe performance degradation in the right-time, mixed reality, and combination models. Despite these challenges, we introduce optimizations to improve accuracy across all models by over 14 percentage points, where the best performing model achieved 24% greater accuracy. △ Less

Submitted 29 April, 2024; originally announced April 2024.

The Third Monocular Depth Estimation Challenge

Authors: Jaime Spencer, Fabio Tosi, Matteo Poggi, Ripudaman Singh Arora, Chris Russell, Simon Hadfield, Richard Bowden, GuangYuan Zhou, ZhengXin Li, Qiang Rao, YiPing Bao, Xiao Liu, Dohyeong Kim, Jinseong Kim, Myunghyun Kim, Mykola Lavreniuk, Rui Li, Qing Mao, Jiang Wu, Yu Zhu, Jinqiu Sun, Yanning Zhang, Suraj Patni, Aradhye Agarwal, Chetan Arora , et al. (16 additional authors not shown)

Abstract: This paper discusses the results of the third edition of the Monocular Depth Estimation Challenge (MDEC). The challenge focuses on zero-shot generalization to the challenging SYNS-Patches dataset, featuring complex scenes in natural and indoor settings. As with the previous edition, methods can use any form of supervision, i.e. supervised or self-supervised. The challenge received a total of 19 su… ▽ More This paper discusses the results of the third edition of the Monocular Depth Estimation Challenge (MDEC). The challenge focuses on zero-shot generalization to the challenging SYNS-Patches dataset, featuring complex scenes in natural and indoor settings. As with the previous edition, methods can use any form of supervision, i.e. supervised or self-supervised. The challenge received a total of 19 submissions outperforming the baseline on the test set: 10 among them submitted a report describing their approach, highlighting a diffused use of foundational models such as Depth Anything at the core of their method. The challenge winners drastically improved 3D F-Score performance, from 17.51% to 23.72%. △ Less

Submitted 27 April, 2024; v1 submitted 25 April, 2024; originally announced April 2024.

Comments: To appear in CVPRW2024

Unveiling the Impact of Macroeconomic Policies: A Double Machine Learning Approach to Analyzing Interest Rate Effects on Financial Markets

Authors: Anoop Kumar, Suresh Dodda, Navin Kamuni, Rajeev Kumar Arora

Abstract: This study examines the effects of macroeconomic policies on financial markets using a novel approach that combines Machine Learning (ML) techniques and causal inference. It focuses on the effect of interest rate changes made by the US Federal Reserve System (FRS) on the returns of fixed income and equity funds between January 1986 and December 2021. The analysis makes a distinction between active… ▽ More This study examines the effects of macroeconomic policies on financial markets using a novel approach that combines Machine Learning (ML) techniques and causal inference. It focuses on the effect of interest rate changes made by the US Federal Reserve System (FRS) on the returns of fixed income and equity funds between January 1986 and December 2021. The analysis makes a distinction between actively and passively managed funds, hypothesizing that the latter are less susceptible to changes in interest rates. The study contrasts gradient boosting and linear regression models using the Double Machine Learning (DML) framework, which supports a variety of statistical learning techniques. Results indicate that gradient boosting is a useful tool for predicting fund returns; for example, a 1% increase in interest rates causes an actively managed fund's return to decrease by -11.97%. This understanding of the relationship between interest rates and fund performance provides opportunities for additional research and insightful, data-driven advice for fund managers and investors △ Less

Submitted 30 March, 2024; originally announced April 2024.

Anticipate & Collab: Data-driven Task Anticipation and Knowledge-driven Planning for Human-robot Collaboration

Authors: Shivam Singh, Karthik Swaminathan, Raghav Arora, Ramandeep Singh, Ahana Datta, Dipanjan Das, Snehasis Banerjee, Mohan Sridharan, Madhava Krishna

Abstract: An agent assisting humans in daily living activities can collaborate more effectively by anticipating upcoming tasks. Data-driven methods represent the state of the art in task anticipation, planning, and related problems, but these methods are resource-hungry and opaque. Our prior work introduced a proof of concept framework that used an LLM to anticipate 3 high-level tasks that served as goals f… ▽ More An agent assisting humans in daily living activities can collaborate more effectively by anticipating upcoming tasks. Data-driven methods represent the state of the art in task anticipation, planning, and related problems, but these methods are resource-hungry and opaque. Our prior work introduced a proof of concept framework that used an LLM to anticipate 3 high-level tasks that served as goals for a classical planning system that computed a sequence of low-level actions for the agent to achieve these goals. This paper describes DaTAPlan, our framework that significantly extends our prior work toward human-robot collaboration. Specifically, DaTAPlan planner computes actions for an agent and a human to collaboratively and jointly achieve the tasks anticipated by the LLM, and the agent automatically adapts to unexpected changes in human action outcomes and preferences. We evaluate DaTAPlan capabilities in a realistic simulation environment, demonstrating accurate task anticipation, effective human-robot collaboration, and the ability to adapt to unexpected changes. Project website: https://dataplan-hrc.github.io △ Less

Submitted 4 April, 2024; originally announced April 2024.

Offline Multitask Representation Learning for Reinforcement Learning

Authors: Haque Ishfaq, Thanh Nguyen-Tang, Songtao Feng, Raman Arora, Mengdi Wang, Ming Yin, Doina Precup

Abstract: We study offline multitask representation learning in reinforcement learning (RL), where a learner is provided with an offline dataset from different tasks that share a common representation and is asked to learn the shared representation. We theoretically investigate offline multitask low-rank RL, and propose a new algorithm called MORL for offline multitask representation learning. Furthermore,… ▽ More We study offline multitask representation learning in reinforcement learning (RL), where a learner is provided with an offline dataset from different tasks that share a common representation and is asked to learn the shared representation. We theoretically investigate offline multitask low-rank RL, and propose a new algorithm called MORL for offline multitask representation learning. Furthermore, we examine downstream RL in reward-free, offline and online scenarios, where a new task is introduced to the agent that shares the same representation as the upstream offline tasks. Our theoretical results demonstrate the benefits of using the learned representation from the upstream offline task instead of directly learning the representation of the low-rank model. △ Less

Submitted 18 March, 2024; originally announced March 2024.

Public-data Assisted Private Stochastic Optimization: Power and Limitations

Authors: Enayat Ullah, Michael Menart, Raef Bassily, Cristóbal Guzmán, Raman Arora

Abstract: We study the limits and capability of public-data assisted differentially private (PA-DP) algorithms. Specifically, we focus on the problem of stochastic convex optimization (SCO) with either labeled or unlabeled public data. For complete/labeled public data, we show that any $(ε,δ)$-PA-DP has excess risk… ▽ More We study the limits and capability of public-data assisted differentially private (PA-DP) algorithms. Specifically, we focus on the problem of stochastic convex optimization (SCO) with either labeled or unlabeled public data. For complete/labeled public data, we show that any $(ε,δ)$-PA-DP has excess risk $\tildeΩ\big(\min\big\{\frac{1}{\sqrt{n_{\text{pub}}}},\frac{1}{\sqrt{n}}+\frac{\sqrt{d}}{nε} \big\} \big)$, where $d$ is the dimension, ${n_{\text{pub}}}$ is the number of public samples, ${n_{\text{priv}}}$ is the number of private samples, and $n={n_{\text{pub}}}+{n_{\text{priv}}}$. These lower bounds are established via our new lower bounds for PA-DP mean estimation, which are of a similar form. Up to constant factors, these lower bounds show that the simple strategy of either treating all data as private or discarding the private data, is optimal. We also study PA-DP supervised learning with \textit{unlabeled} public samples. In contrast to our previous result, we here show novel methods for leveraging public data in private supervised learning. For generalized linear models (GLM) with unlabeled public data, we show an efficient algorithm which, given $\tilde{O}({n_{\text{priv}}}ε)$ unlabeled public samples, achieves the dimension independent rate $\tilde{O}\big(\frac{1}{\sqrt{n_{\text{priv}}}} + \frac{1}{\sqrt{n_{\text{priv}}ε}}\big)$. We develop new lower bounds for this setting which shows that this rate cannot be improved with more public samples, and any fewer public samples leads to a worse rate. Finally, we provide extensions of this result to general hypothesis classes with finite fat-shattering dimension with applications to neural networks and non-Euclidean geometries. △ Less

Submitted 6 March, 2024; originally announced March 2024.

DART: A Principled Approach to Adversarially Robust Unsupervised Domain Adaptation

Authors: Yunjuan Wang, Hussein Hazimeh, Natalia Ponomareva, Alexey Kurakin, Ibrahim Hammoud, Raman Arora

Abstract: Distribution shifts and adversarial examples are two major challenges for deploying machine learning models. While these challenges have been studied individually, their combination is an important topic that remains relatively under-explored. In this work, we study the problem of adversarial robustness under a common setting of distribution shift - unsupervised domain adaptation (UDA). Specifical… ▽ More Distribution shifts and adversarial examples are two major challenges for deploying machine learning models. While these challenges have been studied individually, their combination is an important topic that remains relatively under-explored. In this work, we study the problem of adversarial robustness under a common setting of distribution shift - unsupervised domain adaptation (UDA). Specifically, given a labeled source domain $D_S$ and an unlabeled target domain $D_T$ with related but different distributions, the goal is to obtain an adversarially robust model for $D_T$. The absence of target domain labels poses a unique challenge, as conventional adversarial robustness defenses cannot be directly applied to $D_T$. To address this challenge, we first establish a generalization bound for the adversarial target loss, which consists of (i) terms related to the loss on the data, and (ii) a measure of worst-case domain divergence. Motivated by this bound, we develop a novel unified defense framework called Divergence Aware adveRsarial Training (DART), which can be used in conjunction with a variety of standard UDA methods; e.g., DANN [Ganin and Lempitsky, 2015]. DART is applicable to general threat models, including the popular $\ell_p$-norm model, and does not require heuristic regularizers or architectural changes. We also release DomainRobust: a testbed for evaluating robustness of UDA models to adversarial attacks. DomainRobust consists of 4 multi-domain benchmark datasets (with 46 source-target pairs) and 7 meta-algorithms with a total of 11 variants. Our large-scale experiments demonstrate that on average, DART significantly enhances model robustness on all benchmarks compared to the state of the art, while maintaining competitive standard accuracy. The relative improvement in robustness from DART reaches up to 29.2% on the source-target domain pairs considered. △ Less

Submitted 16 February, 2024; originally announced February 2024.

Photon-triggered jets as probes of multi-stage jet modification

Authors: C. Sirimanna, Y. Tachibana, A. Angerami, R. Arora, S. A. Bass, S. Cao, Y. Chen, L. Du, R. Ehlers, H. Elfner, W. Fan, R. J. Fries, C. Gale, Y. He, U. Heinz, B. V. Jacak, P. M. Jacobs, S. Jeon, Y. Ji, L. Kasper, M. Kordell II, A. Kumar, R. Kunnawalkam-Elayavalli, J. Latessa, S. Lee , et al. (28 additional authors not shown)

Abstract: Prompt photons are created in the early stages of heavy ion collisions and traverse the QGP medium without any interaction. Therefore, photon-triggered jets can be used to study the jet quenching in the QGP medium. In this work, photon-triggered jets are studied through different jet and jet substructure observables for different collision systems and energies using the JETSCAPE framework. Since t… ▽ More Prompt photons are created in the early stages of heavy ion collisions and traverse the QGP medium without any interaction. Therefore, photon-triggered jets can be used to study the jet quenching in the QGP medium. In this work, photon-triggered jets are studied through different jet and jet substructure observables for different collision systems and energies using the JETSCAPE framework. Since the multistage evolution used in the JETSCAPE framework is adequate to describe a wide range of experimental observables simultaneously using the same parameter tune, we use the same parameters tuned for jet and leading hadron studies. The same isolation criteria used in the experimental analysis are used to identify prompt photons for better comparison. For the first time, high-accuracy JETSCAPE results are compared with multi-energy LHC and RHIC measurements to better understand the deviations observed in prior studies. This study highlights the importance of multistage evolution for the simultaneous description of experimental observables through different collision systems and energies using a single parameter tune. △ Less

Submitted 30 January, 2024; originally announced January 2024.

Comments: 4 pages, 5 figures. Proceedings of Quark Matter 2023 - XXXth International Conference on Ultra-relativistic Nucleus-Nucleus Collisions, Houston, TX, 3-9 September 2023

Measuring jet quenching with a Bayesian inference analysis of hadron and jet data by JETSCAPE

Authors: R. Ehlers, A. Angerami, R. Arora, S. A. Bass, S. Cao, Y. Chen, L. Du, H. Elfner, W. Fan, R. J. Fries, C. Gale, Y. He, U. Heinz, B. V. Jacak, P. M. Jacobs, S. Jeon, Y. Ji, L. Kasper, M. Kordell II, A. Kumar, R. Kunnawalkam-Elayavalli, J. Latessa, S. Lee, Y. -J. Lee, D. Liyanage , et al. (28 additional authors not shown)

Abstract: The JETSCAPE Collaboration reports the first multi-messenger study of the QGP jet transport parameter $\hat{q}$ using Bayesian inference, incorporating all available hadron and jet inclusive yield and jet substructure data from RHIC and the LHC. The theoretical model utilizes virtuality-dependent in-medium partonic energy loss coupled to a detailed dynamical model of QGP evolution. Tension is obse… ▽ More The JETSCAPE Collaboration reports the first multi-messenger study of the QGP jet transport parameter $\hat{q}$ using Bayesian inference, incorporating all available hadron and jet inclusive yield and jet substructure data from RHIC and the LHC. The theoretical model utilizes virtuality-dependent in-medium partonic energy loss coupled to a detailed dynamical model of QGP evolution. Tension is observed when constraining $\hat{q}$ for different kinematic cuts of the inclusive hadron data. The addition of substructure data is shown to improve the constraint on $\hat{q}$, without inducing tension with the constraint due to inclusive observables. These studies provide new insight into the mechanisms of jet interactions in matter, and point to next steps in the field for comprehensive understanding of jet quenching as a probe of the QGP. △ Less

Submitted 8 January, 2024; originally announced January 2024.

Comments: 4 pages, 2 figures. Proceedings of Quark Matter 2023 - XXXth International Conference on Ultra-relativistic Nucleus-Nucleus Collisions, Houston, TX, 3-9 September 2023

On Sample-Efficient Offline Reinforcement Learning: Data Diversity, Posterior Sampling, and Beyond

Authors: Thanh Nguyen-Tang, Raman Arora

Abstract: We seek to understand what facilitates sample-efficient learning from historical datasets for sequential decision-making, a problem that is popularly known as offline reinforcement learning (RL). Further, we are interested in algorithms that enjoy sample efficiency while leveraging (value) function approximation. In this paper, we address these fundamental questions by (i) proposing a notion of da… ▽ More We seek to understand what facilitates sample-efficient learning from historical datasets for sequential decision-making, a problem that is popularly known as offline reinforcement learning (RL). Further, we are interested in algorithms that enjoy sample efficiency while leveraging (value) function approximation. In this paper, we address these fundamental questions by (i) proposing a notion of data diversity that subsumes the previous notions of coverage measures in offline RL and (ii) using this notion to {unify} three distinct classes of offline RL algorithms based on version spaces (VS), regularized optimization (RO), and posterior sampling (PS). We establish that VS-based, RO-based, and PS-based algorithms, under standard assumptions, achieve \emph{comparable} sample efficiency, which recovers the state-of-the-art sub-optimality bounds for finite and linear model classes with the standard assumptions. This result is surprising, given that the prior work suggested an unfavorable sample complexity of the RO-based algorithm compared to the VS-based algorithm, whereas posterior sampling is rarely considered in offline RL due to its explorative nature. Notably, our proposed model-free PS-based algorithm for offline RL is {novel}, with sub-optimality bounds that are {frequentist} (i.e., worst-case) in nature. △ Less

Submitted 6 February, 2024; v1 submitted 6 January, 2024; originally announced January 2024.

Comments: NeurIPS'23; Arxiv is the authors' preferred version; v2: add a missing related work

3D Multi-system Bayesian Calibration with Energy Conservation to Study Rapidity-dependent Dynamics of Nuclear Collisions

Authors: Andi Mankolli, Aaron Angerami, Ritu Arora, Steffen Bass, Shanshan Cao, Yi Chen, Lipei Du, Raymond Ehlers, Hannah Elfner, Wenkai Fan, Rainer J. Fries, Charles Gale, Yayun He, Ulrich Heinz, Barbara Jacak, Peter Jacobs, Sangyong Jeon, Yi Ji, Lauren Kasper, Michael Kordell II, Amit Kumar, R. Kunnawalkam-Elayavalli, Joseph Latessa, Sook H. Lee, Yen-Jie Lee , et al. (26 additional authors not shown)

Abstract: Considerable information about the early-stage dynamics of heavy-ion collisions is encoded in the rapidity dependence of measurements. To leverage the large amount of experimental data, we perform a systematic analysis using three-dimensional hydrodynamic simulations of multiple collision systems -- large and small, symmetric and asymmetric. Specifically, we perform fully 3D multi-stage hydrodynam… ▽ More Considerable information about the early-stage dynamics of heavy-ion collisions is encoded in the rapidity dependence of measurements. To leverage the large amount of experimental data, we perform a systematic analysis using three-dimensional hydrodynamic simulations of multiple collision systems -- large and small, symmetric and asymmetric. Specifically, we perform fully 3D multi-stage hydrodynamic simulations initialized by a parameterized model for rapidity-dependent energy deposition, which we calibrate on the hadron multiplicity and anisotropic flow coefficients. We utilize Bayesian inference to constrain properties of the early- and late- time dynamics of the system, and highlight the impact of enforcing global energy conservation in our 3D model. △ Less

Submitted 31 December, 2023; originally announced January 2024.

$\textit{greylock}$: A Python Package for Measuring The Composition of Complex Datasets

Authors: Phuc Nguyen, Rohit Arora, Elliot D. Hill, Jasper Braun, Alexandra Morgan, Liza M. Quintana, Gabrielle Mazzoni, Ghee Rye Lee, Rima Arnaout, Ramy Arnaout

Abstract: Machine-learning datasets are typically characterized by measuring their size and class balance. However, there exists a richer and potentially more useful set of measures, termed diversity measures, that incorporate elements' frequencies and between-element similarities. Although these have been available in the R and Julia programming languages for other applications, they have not been as readi… ▽ More Machine-learning datasets are typically characterized by measuring their size and class balance. However, there exists a richer and potentially more useful set of measures, termed diversity measures, that incorporate elements' frequencies and between-element similarities. Although these have been available in the R and Julia programming languages for other applications, they have not been as readily available in Python, which is widely used for machine learning, and are not easily applied to machine-learning-sized datasets without special coding considerations. To address these issues, we developed $\textit{greylock}$, a Python package that calculates diversity measures and is tailored to large datasets. $\textit{greylock}$ can calculate any of the frequency-sensitive measures of Hill's D-number framework, and going beyond Hill, their similarity-sensitive counterparts (Greylock is a mountain). $\textit{greylock}$ also outputs measures that compare datasets (beta diversities). We first briefly review the D-number framework, illustrating how it incorporates elements' frequencies and between-element similarities. We then describe $\textit{greylock}$'s key features and usage. We end with several examples - immunomics, metagenomics, computational pathology, and medical imaging - illustrating $\textit{greylock}$'s applicability across a range of dataset types and fields. △ Less

Submitted 29 December, 2023; originally announced January 2024.

Comments: 42 pages, many figures. Many thanks to Ralf Bundschuh for help with the submission process

Scaling Monte-Carlo-Based Inference on Antibody and TCR Repertoires

Authors: Josiah Couch, Rohit Arora, Jasper Braun, Joesph Kaplinsky, Elliot Hill, Anthony Li, Brett Altschul, Ramy Arnaout

Abstract: Previously, it has been shown that maximum-entropy models of immune-repertoire sequence can be used to determine a person's vaccination status. However, this approach has the drawback of requiring a computationally intensive method to compute each model's partition function ($Z$), the normalization constant required for calculating the probability that the model will generate a given sequence. Spe… ▽ More Previously, it has been shown that maximum-entropy models of immune-repertoire sequence can be used to determine a person's vaccination status. However, this approach has the drawback of requiring a computationally intensive method to compute each model's partition function ($Z$), the normalization constant required for calculating the probability that the model will generate a given sequence. Specifically, the method required generating approximately $10^{10}$ sequences via Monte-Carlo simulations for each model. This is impractical for large numbers of models. Here we propose an alternative method that requires estimating $Z$ this way for only a few models: it then uses these expensive estimates to estimate $Z$ more efficiently for the remaining models. We demonstrate that this new method enables the generation of accurate estimates for 27 models using only three expensive estimates, thereby reducing the computational cost by an order of magnitude. Importantly, this gain in efficiency is achieved with only minimal impact on classification accuracy. Thus, this new method enables larger-scale investigations in computational immunology and represents a useful contribution to energy-based modeling more generally. △ Less

Submitted 19 December, 2023; originally announced December 2023.

Comments: 11 pages, 2 tables, 4 figures

The role of magnetic fields in disc galaxies: spiral arm instability

Authors: Raghav Arora, Christoph Federrath, Robi Banerjee, Bastian Körtgen

Abstract: Context. Regularly-spaced, star-forming regions along the spiral arms of nearby galaxies provide insight into the early stages and initial conditions of star formation. The regular separation of these star-forming regions suggests spiral arm instability as their origin. Aims. We explore the effects of magnetic fields on the spiral arm instability. Methods. We use three-dimensional global magne… ▽ More Context. Regularly-spaced, star-forming regions along the spiral arms of nearby galaxies provide insight into the early stages and initial conditions of star formation. The regular separation of these star-forming regions suggests spiral arm instability as their origin. Aims. We explore the effects of magnetic fields on the spiral arm instability. Methods. We use three-dimensional global magnetohydrodynamical simulations of isolated spiral galaxies, comparing three different initial plasma $β$ values (ratios of thermal to magnetic pressure) of $β=\infty$, $50$, and $10$. We perform Fourier analysis to calculate the separation of the over-dense regions formed from the spiral instability. We then compare the separations with observations. Results. We find that the spiral arms in the hydro case ($β= \infty$) are unstable, with the fragments initially connected by gas streams, reminiscent of Kelvin-Helmholtz instability. In the $β= 50$ case, the spiral arms fragment, but the fragments separate earlier and tend to be elongated in the direction perpendicular to the spiral arms. However, in the $β= 10$ run the arms are stabilised against fragmentation by magnetic pressure. The spiral arms in the unstable cases fragment into regularly-spaced, over-dense regions. We determine their separation to be $\sim 0.5$ kpc in the hydro and $\sim 0.65$ kpc in the $β= 50$ case, both in agreement with the observations of nearby galaxies. We find a smaller median characteristic wavelength of the over-densities to be $0.73^{+0.31}_{-0.36}$ kpc in the hydro case, compared to $0.98^{+0.49}_{-0.46}$ kpc in the $β= 50$ case. Moreover, we find a higher growth rate of the over-densities in the $β= 50$ run compared to the hydro run. We observe magnetic hills and valleys along the fragmented arms in the $β= 50$ run, which is characteristic of the Parker instability. △ Less

Submitted 27 November, 2023; originally announced November 2023.

Comments: 14 pages, 10 figures, submitted to Astronomy & Astrophysics

Journal ref: A&A 687, A276 (2024)

Differentially Private Non-Convex Optimization under the KL Condition with Optimal Rates

Authors: Michael Menart, Enayat Ullah, Raman Arora, Raef Bassily, Cristóbal Guzmán

Abstract: We study private empirical risk minimization (ERM) problem for losses satisfying the $(γ,κ)$-Kurdyka-Łojasiewicz (KL) condition. The Polyak-Łojasiewicz (PL) condition is a special case of this condition when $κ=2$. Specifically, we study this problem under the constraint of $ρ$ zero-concentrated differential privacy (zCDP). When $κ\in[1,2]$ and the loss function is Lipschitz and smooth over a suff… ▽ More We study private empirical risk minimization (ERM) problem for losses satisfying the $(γ,κ)$-Kurdyka-Łojasiewicz (KL) condition. The Polyak-Łojasiewicz (PL) condition is a special case of this condition when $κ=2$. Specifically, we study this problem under the constraint of $ρ$ zero-concentrated differential privacy (zCDP). When $κ\in[1,2]$ and the loss function is Lipschitz and smooth over a sufficiently large region, we provide a new algorithm based on variance reduced gradient descent that achieves the rate $\tilde{O}\big(\big(\frac{\sqrt{d}}{n\sqrtρ}\big)^κ\big)$ on the excess empirical risk, where $n$ is the dataset size and $d$ is the dimension. We further show that this rate is nearly optimal. When $κ\geq 2$ and the loss is instead Lipschitz and weakly convex, we show it is possible to achieve the rate $\tilde{O}\big(\big(\frac{\sqrt{d}}{n\sqrtρ}\big)^κ\big)$ with a private implementation of the proximal point method. When the KL parameters are unknown, we provide a novel modification and analysis of the noisy gradient descent algorithm and show that this algorithm achieves a rate of $\tilde{O}\big(\big(\frac{\sqrt{d}}{n\sqrtρ}\big)^{\frac{2κ}{4-κ}}\big)$ adaptively, which is nearly optimal when $κ= 2$. We further show that, without assuming the KL condition, the same gradient descent algorithm can achieve fast convergence to a stationary point when the gradient stays sufficiently large during the run of the algorithm. Specifically, we show that this algorithm can approximate stationary points of Lipschitz, smooth (and possibly nonconvex) objectives with rate as fast as $\tilde{O}\big(\frac{\sqrt{d}}{n\sqrtρ}\big)$ and never worse than $\tilde{O}\big(\big(\frac{\sqrt{d}}{n\sqrtρ}\big)^{1/2}\big)$. The latter rate matches the best known rate for methods that do not rely on variance reduction. △ Less

Submitted 3 April, 2024; v1 submitted 22 November, 2023; originally announced November 2023.

Hybrid Hadronization of Jet Showers from $e^++e^-$ to $A+A$ with JETSCAPE

Authors: Cameron Parker, Aaron Angerami, Ritu Arora, Steffen Bass, Shanshan Cao, Yi Chen, Raymond Ehlers, Hannah Elfner, Wenkai Fan, Rainer J. Fries, Charles Gale, Yayun He, Ulrich Heinz, Barbara Jacak, Peter Jacobs, Sangyong Jeon, Yi Ji, Lauren Kasper, Michael Kordell II, Amit Kumar, Joseph Latessa, Yen-Jie Lee, Roy Lemmon, Dananjaya Liyanage, Arthur Lopez , et al. (26 additional authors not shown)

Abstract: In this talk we review jet production in a large variety of collision systems using the JETSCAPE event generator and Hybrid Hadronization. Hybrid Hadronization combines quark recombination, applicable when distances between partons in phase space are small, and string fragmentation appropriate for dilute parton systems. It can therefore smoothly describe the transition from very dilute parton syst… ▽ More In this talk we review jet production in a large variety of collision systems using the JETSCAPE event generator and Hybrid Hadronization. Hybrid Hadronization combines quark recombination, applicable when distances between partons in phase space are small, and string fragmentation appropriate for dilute parton systems. It can therefore smoothly describe the transition from very dilute parton systems like $e^++e^-$ to full $A+A$ collisions. We test this picture by using JETSCAPE to generate jets in various systems. Comparison to experimental data in $e^++e^-$ and $p+p$ collisions allows for a precise tuning of vacuum baseline parameters in JETSCAPE and Hybrid Hadronization. Proceeding to systems with jets embedded in a medium, we study in-medium hadronization for jet showers. We quantify the effects of an ambient medium, focusing in particular on the dependence on the collective flow and size of the medium. Our results clarify the effects we expect from in-medium hadronization of jets on observables like fragmentation functions, hadron chemistry and jet shape. △ Less

Submitted 7 November, 2023; v1 submitted 31 October, 2023; originally announced October 2023.

Comments: 6 pages, 4 figures, Hard Probes 2023 conference, accepted for publication in Proceedings of Science: version 2, references added, typos fixed

On logarithmic double phase problems

Authors: Rakesh Arora, Ángel Crespo-Blanco, Patrick Winkert

Abstract: In this paper we introduce a new logarithmic double phase type operator of the form\begin{align*}\mathcal{G}u:=-\operatorname{div}\left(|\nabla u|^{p(x)-2}\nabla u+μ(x)\left[\log(e+|\nabla u|)+\frac{|\nabla u|}{q(x)(e+|\nabla u|)}\right]|\nabla u|^{q(x)-2} \nabla u \right),\end{align*}where $Ω\subseteq\mathbb{R}^N$, $N\geq 2$, is a bounded domain with Lipschitz boundary $\partialΩ$,… ▽ More In this paper we introduce a new logarithmic double phase type operator of the form\begin{align*}\mathcal{G}u:=-\operatorname{div}\left(|\nabla u|^{p(x)-2}\nabla u+μ(x)\left[\log(e+|\nabla u|)+\frac{|\nabla u|}{q(x)(e+|\nabla u|)}\right]|\nabla u|^{q(x)-2} \nabla u \right),\end{align*}where $Ω\subseteq\mathbb{R}^N$, $N\geq 2$, is a bounded domain with Lipschitz boundary $\partialΩ$, $p,q\in C(\overlineΩ)$ with $1<p(x)\leq q(x)$ for all $x\in\overlineΩ$ and $μ\in L^1(Ω)$. First, we prove that the logarithmic Musielak-Orlicz Sobolev spaces $W^{1,\mathcal{H}_{\log}}(Ω)$ and $W^{1, \mathcal{H}_{\log}}_0(Ω)$ with $\mathcal{H}_{\log}(x,t)=t^{p(x)}+μ(x)t^{q(x)}\log(e+t)$ for $(x,t)\in \overlineΩ\times [0,\infty)$ are separable, reflexive Banach spaces and $W^{1,\mathcal{H}_{\log}}_0(Ω)$ can be equipped with an equivalent norm. We also prove several embedding results for these spaces and the closedness of these spaces under truncations. In addition we show the density of smooth functions in $W^{1,\mathcal{H}_{\log}}(Ω)$ even in the case of an unbounded domain by supposing Nekvinda's decay condition on $p(\cdot)$. The second part is devoted to the properties of the operator and it turns out that it is bounded, continuous, strictly monotone, of type (S$_+$), coercive and a homeomorphism. As a result of independent interest we also present a new version of Young's inequality for the product of a power-law and a logarithm. In the last part of this work we consider equations driven by our new operator with superlinear right-hand sides. We prove multiplicity results for this type of equation, in particular about sign-changing solutions, by making use of a suitable variation of the corresponding Nehari manifold together with the quantitative deformation lemma and the Poincaré-Miranda existence theorem. △ Less

Submitted 17 September, 2023; originally announced September 2023.

A multistage framework for studying the evolution of jets and high-$p_T$ probes in small collision systems

Authors: Abhijit Majumder, Aaron Angerami, Ritu Arora, Steffen Bass, Shanshan Cao, Yi Chen, Raymond Ehlers, Hannah Elfner, Wenkai Fan, Rainer J. Fries, Charles Gale, Yayun He, Ulrich Heinz, Barbara Jacak, Peter Jacobs, Sangyong Jeon, Yi Ji, Lauren Kasper, Michael Kordell II, Amit Kumar, Joseph Latessa, Yen-Jie Lee, Roy Lemmon, Dananjaya Liyanage, Arthur Lopez , et al. (26 additional authors not shown)

Abstract: Understanding the modification of jets and high-$p_T$ probes in small systems requires the integration of soft and hard physics. We present recent developments in extending the JETSCAPE framework to build an event generator, which includes correlations between soft and hard partons, to study jet observables in small systems. The multi-scale physics of the collision is separated into different stag… ▽ More Understanding the modification of jets and high-$p_T$ probes in small systems requires the integration of soft and hard physics. We present recent developments in extending the JETSCAPE framework to build an event generator, which includes correlations between soft and hard partons, to study jet observables in small systems. The multi-scale physics of the collision is separated into different stages. Hard scatterings are first sampled at binary collision positions provided by the Glauber geometry. They are then propagated backward in space-time following an initial-state shower to obtain the initiating partons' energies and momenta before the collision. These energies and momenta are then subtracted from the incoming colliding nucleons for soft-particle production, modeled by the 3D-Glauber + hydrodynamics + hadronic transport framework. This new hybrid approach (X-SCAPE) includes non-trivial correlations between jet and soft particle productions in small systems. We calibrate this framework with the final state hadrons' $p_T$-spectra from low to high $p_T$ in $p$-$p$, and and then compare with the spectra in $p$-$Pb$ collisions from the LHC. We also present results for additional observables such as the distributions of event activity as a function of the hardest jet $p_T$ in forward and mid-rapidity for both $p$-$p$ and $p$-$Pb$ collisions. △ Less

Submitted 1 November, 2023; v1 submitted 4 August, 2023; originally announced August 2023.

Comments: 6 pages, 6 figures, Proceedings of Hard Probes 2023, 26-31 March 2023 Aschaffenburg, Germany

Journal ref: Proceedings of Science (Hard Probes 2023) 2023

From Adaptive Query Release to Machine Unlearning

Authors: Enayat Ullah, Raman Arora

Abstract: We formalize the problem of machine unlearning as design of efficient unlearning algorithms corresponding to learning algorithms which perform a selection of adaptive queries from structured query classes. We give efficient unlearning algorithms for linear and prefix-sum query classes. As applications, we show that unlearning in many problems, in particular, stochastic convex optimization (SCO), c… ▽ More We formalize the problem of machine unlearning as design of efficient unlearning algorithms corresponding to learning algorithms which perform a selection of adaptive queries from structured query classes. We give efficient unlearning algorithms for linear and prefix-sum query classes. As applications, we show that unlearning in many problems, in particular, stochastic convex optimization (SCO), can be reduced to the above, yielding improved guarantees for the problem. In particular, for smooth Lipschitz losses and any $ρ>0$, our results yield an unlearning algorithm with excess population risk of $\tilde O\big(\frac{1}{\sqrt{n}}+\frac{\sqrt{d}}{nρ}\big)$ with unlearning query (gradient) complexity $\tilde O(ρ\cdot \text{Retraining Complexity})$, where $d$ is the model dimensionality and $n$ is the initial number of samples. For non-smooth Lipschitz losses, we give an unlearning algorithm with excess population risk $\tilde O\big(\frac{1}{\sqrt{n}}+\big(\frac{\sqrt{d}}{nρ}\big)^{1/2}\big)$ with the same unlearning query (gradient) complexity. Furthermore, in the special case of Generalized Linear Models (GLMs), such as those in linear and logistic regression, we get dimension-independent rates of $\tilde O\big(\frac{1}{\sqrt{n}} +\frac{1}{(nρ)^{2/3}}\big)$ and $\tilde O\big(\frac{1}{\sqrt{n}} +\frac{1}{(nρ)^{1/3}}\big)$ for smooth Lipschitz and non-smooth Lipschitz losses respectively. Finally, we give generalizations of the above from one unlearning request to \textit{dynamic} streams consisting of insertions and deletions. △ Less

Submitted 20 July, 2023; originally announced July 2023.

Comments: Accepted to ICML 2023

A new metric improving Bayesian calibration of a multistage approach studying hadron and inclusive jet suppression

Authors: W. Fan, G. Vujanovic, S. A. Bass, A. Angerami, R. Arora, S. Cao, Y. Chen, T. Dai, L. Du, R. Ehlers, H. Elfner, R. J. Fries, C. Gale, Y. He, M. Heffernan, U. Heinz, B. V. Jacak, P. M. Jacobs, S. Jeon, Y. Ji, L. Kasper, M. Kordell II, A. Kumar, J. Latessa, Y. -J. Lee , et al. (30 additional authors not shown)

Abstract: We study parton energy-momentum exchange with the quark gluon plasma (QGP) within a multistage approach composed of in-medium DGLAP evolution at high virtuality, and (linearized) Boltzmann Transport formalism at lower virtuality. This multistage simulation is then calibrated in comparison with high $p_T$ charged hadrons, D-mesons, and the inclusive jet nuclear modification factors, using Bayesian… ▽ More We study parton energy-momentum exchange with the quark gluon plasma (QGP) within a multistage approach composed of in-medium DGLAP evolution at high virtuality, and (linearized) Boltzmann Transport formalism at lower virtuality. This multistage simulation is then calibrated in comparison with high $p_T$ charged hadrons, D-mesons, and the inclusive jet nuclear modification factors, using Bayesian model-to-data comparison, to extract the virtuality-dependent transverse momentum broadening transport coefficient $\hat{q}$. To facilitate this undertaking, we develop a quantitative metric for validating the Bayesian workflow, which is used to analyze the sensitivity of various model parameters to individual observables. The usefulness of this new metric in improving Bayesian model emulation is shown to be highly beneficial for future such analyses. △ Less

Submitted 27 October, 2023; v1 submitted 18 July, 2023; originally announced July 2023.

Comments: 24 pages, 16 figures

Multiscale evolution of heavy flavor in the QGP

Authors: G. Vujanovic, A. Angerami, R. Arora, S. A. Bass, S. Cao, Y. Chen, T. Dai, L. Du, R. Ehlers, H. Elfner, W. Fan, R. J. Fries, C. Gale, Y. He, M. Heffernan, U. Heinz, B. V. Jacak, P. M. Jacobs, S. Jeon, Y. Ji, L. Kasper, M. Kordell II, A. Kumar, J. Latessa, Y. -J. Lee , et al. (30 additional authors not shown)

Abstract: Shower development dynamics for a jet traveling through the quark-gluon plasma (QGP) is a multiscale process, where the heavy flavor mass is an important scale. During the high virtuality portion of the jet evolution in the QGP, emission of gluons from a heavy flavor is modified owing to heavy quark mass. Medium-induced radiation of heavy flavor is sensitive to microscopic processes (e.g. diffusio… ▽ More Shower development dynamics for a jet traveling through the quark-gluon plasma (QGP) is a multiscale process, where the heavy flavor mass is an important scale. During the high virtuality portion of the jet evolution in the QGP, emission of gluons from a heavy flavor is modified owing to heavy quark mass. Medium-induced radiation of heavy flavor is sensitive to microscopic processes (e.g. diffusion), whose virtuality dependence is phenomenologically explored in this study. In the lower virtuality part of shower evolution, i.e. when the mass is comparable to the virtuality of the parton, scattering and radiation processes of heavy quarks differ from light quarks. The effects of these mechanisms on shower development in heavy flavor tagged showers in the QGP is explored here. Furthermore, this multiscale study examines dynamical pair production of heavy flavor (via virtual gluon splittings) and their subsequent evolution in the QGP, which is not possible otherwise. A realistic event-by-event simulation is performed using the JETSCAPE framework. Energy-momentum exchange with the medium proceeds using a weak coupling recoil approach. Using leading hadron and open heavy flavor observables, differences in heavy versus light quark energy-loss mechanisms are explored, while the importance of heavy flavor pair production is highlighted along with future directions to study. △ Less

Submitted 27 October, 2023; v1 submitted 18 July, 2023; originally announced July 2023.

Comments: 6 pages, 3 figures, contribution to the Hard Probes 2023 proceedings

Effects of multi-scale jet-medium interactions on jet substructures

Authors: JETSCAPE Collaboration, Y. Tachibana, A. Angerami, R. Arora, S. A. Bass, S. Cao, Y. Chen, T. Dai, L. Du, R. Ehlers, H. Elfner, W. Fan, R. J. Fries, C. Gale, Y. He, M. Heffernan, U. Heinz, B. V. Jacak, P. M. Jacobs, S. Jeon, Y. Ji, K. Kauder, L. Kasper, W. Ke, M. Kelsey , et al. (35 additional authors not shown)

Abstract: We utilize event-by-event Monte Carlo simulations within the JETSCAPE framework to examine scale-dependent jet-medium interactions in heavy-ion collisions. The reduction in jet-medium interaction during the early high-virtuality stage, where the medium is resolved at a short distance scale, is emphasized as a key element in explaining multiple jet observables, particularly substructures, simultane… ▽ More We utilize event-by-event Monte Carlo simulations within the JETSCAPE framework to examine scale-dependent jet-medium interactions in heavy-ion collisions. The reduction in jet-medium interaction during the early high-virtuality stage, where the medium is resolved at a short distance scale, is emphasized as a key element in explaining multiple jet observables, particularly substructures, simultaneously. By employing the MATTER+LBT setup, which incorporates this explicit reduction of medium effects at high virtuality, we investigate jet substructure observables, such as Soft Drop groomed observables. When contrasted with existing data, our findings spotlight the significant influence of the reduction at the early high-virtuality stages. Furthermore, we study the substructure of gamma-tagged jets, providing predictive insights for future experimental analyses. This broadens our understanding of the various contributing factors involved in modifying jet substructures. △ Less

Submitted 16 July, 2023; originally announced July 2023.

Comments: 6 pages, 4 figures, contribution to the Hard Probes 2023 proceedings

A Deep Learning Framework for Solving Hyperbolic Partial Differential Equations: Part I

Authors: Rajat Arora

Abstract: Physics informed neural networks (PINNs) have emerged as a powerful tool to provide robust and accurate approximations of solutions to partial differential equations (PDEs). However, PINNs face serious difficulties and challenges when trying to approximate PDEs with dominant hyperbolic character. This research focuses on the development of a physics informed deep learning framework to approximate… ▽ More Physics informed neural networks (PINNs) have emerged as a powerful tool to provide robust and accurate approximations of solutions to partial differential equations (PDEs). However, PINNs face serious difficulties and challenges when trying to approximate PDEs with dominant hyperbolic character. This research focuses on the development of a physics informed deep learning framework to approximate solutions to nonlinear PDEs that can develop shocks or discontinuities without any a-priori knowledge of the solution or the location of the discontinuities. The work takes motivation from finite element method that solves for solution values at nodes in the discretized domain and use these nodal values to obtain a globally defined solution field. Built on the rigorous mathematical foundations of the discontinuous Galerkin method, the framework naturally handles imposition of boundary conditions (Neumann/Dirichlet), entropy conditions, and regularity requirements. Several numerical experiments and validation with analytical solutions demonstrate the accuracy, robustness, and effectiveness of the proposed framework. △ Less

Submitted 9 July, 2023; originally announced July 2023.

On the Dynamics of Learning Time-Aware Behavior with Recurrent Neural Networks

Authors: Peter DelMastro, Rushiv Arora, Edward Rietman, Hava T. Siegelmann

Abstract: Recurrent Neural Networks (RNNs) have shown great success in modeling time-dependent patterns, but there is limited research on their learned representations of latent temporal features and the emergence of these representations during training. To address this gap, we use timed automata (TA) to introduce a family of supervised learning tasks modeling behavior dependent on hidden temporal variable… ▽ More Recurrent Neural Networks (RNNs) have shown great success in modeling time-dependent patterns, but there is limited research on their learned representations of latent temporal features and the emergence of these representations during training. To address this gap, we use timed automata (TA) to introduce a family of supervised learning tasks modeling behavior dependent on hidden temporal variables whose complexity is directly controllable. Building upon past studies from the perspective of dynamical systems, we train RNNs to emulate temporal flipflops, a new collection of TA that emphasizes the need for time-awareness over long-term memory. We find that these RNNs learn in phases: they quickly perfect any time-independent behavior, but they initially struggle to discover the hidden time-dependent features. In the case of periodic "time-of-day" aware automata, we show that the RNNs learn to switch between periodic orbits that encode time modulo the period of the transition rules. We subsequently apply fixed point stability analysis to monitor changes in the RNN dynamics during training, and we observe that the learning phases are separated by a bifurcation from which the periodic behavior emerges. In this way, we demonstrate how dynamical systems theory can provide insights into not only the learned representations of these models, but also the dynamics of the learning process itself. We argue that this style of analysis may provide insights into the training pathologies of recurrent architectures in contexts outside of time-awareness. △ Less

Submitted 12 June, 2023; originally announced June 2023.

Comments: Main paper: 11 pages, 8 figures. Supplemental Material: 6 pages, 5 figures, 1 table

Approximate Analytical Solution using Power Series Method for the Propagation of Blast Waves in a Rotational Axisymmetric non-ideal Gas

Authors: Nandita, Rajan Arora

Abstract: In this paper, the propagation of the blast (shock) waves in non-ideal gas atmosphere in rotational medium is studied using a power series method in cylindrical geometry. The flow variables are assumed to be varying according to the power law in the undisturbed medium with distance from the symmetry axis. To obtain the similarity solution, the initial density is considered as constant in the undis… ▽ More In this paper, the propagation of the blast (shock) waves in non-ideal gas atmosphere in rotational medium is studied using a power series method in cylindrical geometry. The flow variables are assumed to be varying according to the power law in the undisturbed medium with distance from the symmetry axis. To obtain the similarity solution, the initial density is considered as constant in the undisturbed medium. Approximate analytical solutions are obtained using Sakurai's method by extending the power series of the flow variables in power of ${\left( {\frac{a_0}{U}} \right)^2}$, where $U$ and $a_0$ are the speeds of the shock and sound, respectively, in undisturbed fluid. The strong shock wave is considered for the ratio ${\left( {\frac{a_0}{U}} \right)^2}$ which is considered to be a small quantity. With the aid of that method, the closed-form solutions for the zeroth-order approximation is given as well as first-order approximate solutions are discussed. Also, with the help of graphs behind the blast wave for the zeroth-order approximation, the distributions of variables such as density, radial velocity, pressure and azimuthal fluid velocity are analyzed. The results for the rotationally axisymmetric non-ideal gas environment are compared to those for the ideal gas atmosphere. △ Less

Submitted 8 June, 2023; originally announced June 2023.

CLIPGraphs: Multimodal Graph Networks to Infer Object-Room Affinities

Authors: Ayush Agrawal, Raghav Arora, Ahana Datta, Snehasis Banerjee, Brojeshwar Bhowmick, Krishna Murthy Jatavallabhula, Mohan Sridharan, Madhava Krishna

Abstract: This paper introduces a novel method for determining the best room to place an object in, for embodied scene rearrangement. While state-of-the-art approaches rely on large language models (LLMs) or reinforcement learned (RL) policies for this task, our approach, CLIPGraphs, efficiently combines commonsense domain knowledge, data-driven methods, and recent advances in multimodal learning. Specifica… ▽ More This paper introduces a novel method for determining the best room to place an object in, for embodied scene rearrangement. While state-of-the-art approaches rely on large language models (LLMs) or reinforcement learned (RL) policies for this task, our approach, CLIPGraphs, efficiently combines commonsense domain knowledge, data-driven methods, and recent advances in multimodal learning. Specifically, it (a)encodes a knowledge graph of prior human preferences about the room location of different objects in home environments, (b) incorporates vision-language features to support multimodal queries based on images or text, and (c) uses a graph network to learn object-room affinities based on embeddings of the prior knowledge and the vision-language features. We demonstrate that our approach provides better estimates of the most appropriate location of objects from a benchmark set of object categories in comparison with state-of-the-art baselines △ Less

Submitted 2 June, 2023; originally announced June 2023.

Journal ref: RO-MAN 2023 Conference

Modeling of experimentally observed topological defects inside bulk polycrystals

Authors: Siddharth Singh, He Liu, Rajat Arora, Robert M. Suter, Amit Acharya

Abstract: A rigorous methodology is developed for computing elastic fields generated by experimentally observed defect structures within grains in a polycrystal that has undergone tensile extension. An example application is made using a near-field High Energy X-ray Diffraction Microscope measurement of a zirconium sample that underwent $13.6\%$ tensile extension from an initially well-annealed state. (Sub)… ▽ More A rigorous methodology is developed for computing elastic fields generated by experimentally observed defect structures within grains in a polycrystal that has undergone tensile extension. An example application is made using a near-field High Energy X-ray Diffraction Microscope measurement of a zirconium sample that underwent $13.6\%$ tensile extension from an initially well-annealed state. (Sub)grain boundary features are identified with apparent disclination line defects in them. The elastic fields of these features identified from the experiment are calculated. △ Less

Submitted 7 October, 2023; v1 submitted 25 May, 2023; originally announced May 2023.

Optimal global second-order regularity and improved integrability for parabolic equations with variable growth

Authors: Rakesh Arora, Sergey Shmarev

Abstract: We consider the homogeneous Dirichlet problem for the parabolic equation \[ u_t- \operatorname{div} \left(|\nabla u|^{p(x,t)-2} \nabla u\right)= f(x,t) + F(x,t, u, \nabla u) \] in the cylinder $Q_T:=Ω\times (0,T)$, where $Ω\subset \mathbb{R}^N$, $N\geq 2$, is a $C^{2}$-smooth or convex bounded domain. It is assumed that $p\in C^{0,1}(\overline{Q}_T)$ is a given function, and that the nonlinear s… ▽ More We consider the homogeneous Dirichlet problem for the parabolic equation \[ u_t- \operatorname{div} \left(|\nabla u|^{p(x,t)-2} \nabla u\right)= f(x,t) + F(x,t, u, \nabla u) \] in the cylinder $Q_T:=Ω\times (0,T)$, where $Ω\subset \mathbb{R}^N$, $N\geq 2$, is a $C^{2}$-smooth or convex bounded domain. It is assumed that $p\in C^{0,1}(\overline{Q}_T)$ is a given function, and that the nonlinear source $F(x,t,s, ξ)$ has a proper power growth with respect to $s$ and $ξ$. It is shown that if $p(x,t)>\frac{2(N+1)}{N+2}$, $f\in L^2(Q_T)$, $|\nabla u_0|^{p(x,0)}\in L^1(Ω)$, then the problem has a solution $u\in C^0([0,T];L^2(Ω))$ with $|\nabla u|^{p(x,t)} \in L^{\infty}(0,T;L^1(Ω))$, $u_t\in L^2(Q_T)$, obtained as the limit of solutions to the regularized problems in the parabolic Hölder space. The solution possesses the following global regularity properties: \[ \begin{split} & |\nabla u|^{2(p(x,t)-1)+r}\in L^1(Q_T)\quad \text{for any $0 < r < \frac{4}{N+2}$}, \\ & |\nabla u|^{p(x,t)-2} \nabla u \in W^{1,2}(Q_T)^N. \end{split} \] △ Less

Submitted 20 October, 2023; v1 submitted 18 May, 2023; originally announced May 2023.

Semiclassical Moser-Trudinger inequalities

Authors: Rakesh Arora, Phan Thành Nam, Phuoc-Tai Nguyen

Abstract: We extend the Moser-Trudinger inequality of one function to systems of orthogonal functions. Our results are asymptotically sharp when applied to the collective behavior of eigenfunctions of Schrödinger operators on bounded domains. We extend the Moser-Trudinger inequality of one function to systems of orthogonal functions. Our results are asymptotically sharp when applied to the collective behavior of eigenfunctions of Schrödinger operators on bounded domains. △ Less

Submitted 26 January, 2024; v1 submitted 2 May, 2023; originally announced May 2023.

Comments: Final version to appear in Trans. Amer. Math. Soc., 18 pages

MSC Class: 26D10; 26D15; 35A23

Interface-dominated plasticity and kink bands in metallic nanolaminates

Authors: Abhishek Arora, Rajat Arora, Amit Acharya

Abstract: The theoretical and computational framework of finite deformation mesoscale field dislocation mechanics (MFDM) is used to understand the salient aspects of kink-band formation in Cu-Nb nano-metallic laminates (NMLs). A conceptually minimal, plane-strain idealization of the three-dimensional geometry, including crystalline orientation, of additively manufactured NML is used to model NMLs. Important… ▽ More The theoretical and computational framework of finite deformation mesoscale field dislocation mechanics (MFDM) is used to understand the salient aspects of kink-band formation in Cu-Nb nano-metallic laminates (NMLs). A conceptually minimal, plane-strain idealization of the three-dimensional geometry, including crystalline orientation, of additively manufactured NML is used to model NMLs. Importantly, the natural jump/interface condition of MFDM imposing continuity of (certain components) of plastic strain rates across interfaces allows theory-driven `communication' of plastic flow across the laminate boundaries in our finite element implementation. Kink bands under layer parallel compression of NMLs in accord with experimental observations arise in our numerical simulations. The possible mechanisms for the formation and orientation of kink bands are discussed, within the scope of our idealized framework. We also report results corresponding to various parametric studies that provide preliminary insights and clear questions for future work on understanding the intricate underlying mechanisms for the formation of kink bands. △ Less

Submitted 8 May, 2023; v1 submitted 5 April, 2023; originally announced April 2023.

Comments: Keywords: mesoscale plasticity, kink bands, nanometallic laminates, strain gradient plasticity

CapsFlow: Optical Flow Estimation with Capsule Networks

Authors: Rahul Chand, Rajat Arora, K Ram Prabhakar, R Venkatesh Babu

Abstract: We present a framework to use recently introduced Capsule Networks for solving the problem of Optical Flow, one of the fundamental computer vision tasks. Most of the existing state of the art deep architectures either uses a correlation oepration to match features from them. While correlation layer is sensitive to the choice of hyperparameters and does not put a prior on the underlying structure o… ▽ More We present a framework to use recently introduced Capsule Networks for solving the problem of Optical Flow, one of the fundamental computer vision tasks. Most of the existing state of the art deep architectures either uses a correlation oepration to match features from them. While correlation layer is sensitive to the choice of hyperparameters and does not put a prior on the underlying structure of the object, spatio temporal features will be limited by the network's receptive field. Also, we as humans look at moving objects as whole, something which cannot be encoded by correlation or spatio temporal features. Capsules, on the other hand, are specialized to model seperate entities and their pose as a continuous matrix. Thus, we show that a simpler linear operation over poses of the objects detected by the capsules in enough to model flow. We show reslts on a small toy dataset where we outperform FlowNetC and PWC-Net models. △ Less

Submitted 1 December, 2023; v1 submitted 1 April, 2023; originally announced April 2023.

Comments: Newer version added to correct issue in the conference name of the previous version uploaded on April 1st

VIPeR: Provably Efficient Algorithm for Offline RL with Neural Function Approximation

Authors: Thanh Nguyen-Tang, Raman Arora

Abstract: We propose a novel algorithm for offline reinforcement learning called Value Iteration with Perturbed Rewards (VIPeR), which amalgamates the pessimism principle with random perturbations of the value function. Most current offline RL algorithms explicitly construct statistical confidence regions to obtain pessimism via lower confidence bounds (LCB), which cannot easily scale to complex problems wh… ▽ More We propose a novel algorithm for offline reinforcement learning called Value Iteration with Perturbed Rewards (VIPeR), which amalgamates the pessimism principle with random perturbations of the value function. Most current offline RL algorithms explicitly construct statistical confidence regions to obtain pessimism via lower confidence bounds (LCB), which cannot easily scale to complex problems where a neural network is used to estimate the value functions. Instead, VIPeR implicitly obtains pessimism by simply perturbing the offline data multiple times with carefully-designed i.i.d. Gaussian noises to learn an ensemble of estimated state-action {value functions} and acting greedily with respect to the minimum of the ensemble. The estimated state-action values are obtained by fitting a parametric model (e.g., neural networks) to the perturbed datasets using gradient descent. As a result, VIPeR only needs $\mathcal{O}(1)$ time complexity for action selection, while LCB-based algorithms require at least $Ω(K^2)$, where $K$ is the total number of trajectories in the offline data. We also propose a novel data-splitting technique that helps remove a factor involving the log of the covering number in our bound. We prove that VIPeR yields a provable uncertainty quantifier with overparameterized neural networks and enjoys a bound on sub-optimality of $\tilde{\mathcal{O}}( { κH^{5/2} \tilde{d} }/{\sqrt{K}})$, where $\tilde{d}$ is the effective dimension, $H$ is the horizon length and $κ$ measures the distributional shift. We corroborate the statistical and computational efficiency of VIPeR with an empirical evaluation on a wide set of synthetic and real-world datasets. To the best of our knowledge, VIPeR is the first algorithm for offline RL that is provably efficient for general Markov decision processes (MDPs) with neural network function approximation. △ Less

Submitted 3 March, 2023; v1 submitted 24 February, 2023; originally announced February 2023.

Comments: top-25%-noble ICLR'23; code: https://github.com/thanhnguyentang/neural-offline-rl; v2: change title

Hard Jet Substructure in a Multi-stage Approach

Authors: Y. Tachibana, A. Kumar, A. Majumder, A. Angerami, R. Arora, S. A. Bass, S. Cao, Y. Chen, T. Dai, L. Du, R. Ehlers, H. Elfner, W. Fan, R. J. Fries, C. Gale, Y. He, M. Heffernan, U. Heinz, B. V. Jacak, P. M. Jacobs, S. Jeon, Y. Ji, K. Kauder, L. Kasper, W. Ke , et al. (34 additional authors not shown)

Abstract: We present predictions and postdictions for a wide variety of hard jet-substructure observables using a multi-stage model within the JETSCAPE framework. The details of the multi-stage model and the various parameter choices are described in [A. Kumar et al., arXiv:2204.01163]. A novel feature of this model is the presence of two stages of jet modification: a high virtuality phase (modeled using MA… ▽ More We present predictions and postdictions for a wide variety of hard jet-substructure observables using a multi-stage model within the JETSCAPE framework. The details of the multi-stage model and the various parameter choices are described in [A. Kumar et al., arXiv:2204.01163]. A novel feature of this model is the presence of two stages of jet modification: a high virtuality phase (modeled using MATTER), where coherence effects diminish medium-induced radiation, and a lower virtuality phase (modeled using LBT), where parton splits are fully resolved by the medium as they endure multiple scattering induced energy loss. Energy loss calculations are carried out on event-by-event viscous fluid dynamic backgrounds constrained by experimental data. The uniformed and consistent descriptions of multiple experimental observables demonstrate the essential role of coherence effects and the multi-stage modeling of the jet evolution. Using the best choice of parameters from [A. Kumar et al., arXiv:2204.01163], and with no further tuning, we present calculations for the medium modified jet fragmentation function, the groomed jet momentum fraction $z_g$ and angular separation $r_g$ distributions, as well as the nuclear modification factor of groomed jets. These calculations provide accurate descriptions of published and preliminary data from experiments at RHIC and LHC. Furthermore, we provide predictions from the multi-stage model for future measurements at RHIC. △ Less

Submitted 6 January, 2023; originally announced January 2023.

Comments: 20 pages, 12 figures

Comprehensive Study of Multi-scale Jet-medium Interaction

Authors: Y. Tachibana, A. Angerami, R. Arora, S. A. Bass, S. Cao, Y. Chen, T. Dai, L. Du, R. Ehlers, H. Elfner, W. Fan, R. J. Fries, C. Gale, Y. He, M. Heffernan, U. Heinz, B. V. Jacak, P. M. Jacobs, S. Jeon, Y. Ji, L. Kasper, W. Ke, M. Kelsey, M. Kordell II, A. Kumar , et al. (33 additional authors not shown)

Abstract: We explore jet-medium interactions at various scales in high-energy heavy-ion collisions using the JETSCAPE framework. The physics of the multi-stage modeling and the coherence effect at high virtuality is discussed through the results of multiple jet and high-$p_{\mathrm{T}}$ particle observables, compared with experimental data. Furthermore, we investigate the jet-medium interaction involved in… ▽ More We explore jet-medium interactions at various scales in high-energy heavy-ion collisions using the JETSCAPE framework. The physics of the multi-stage modeling and the coherence effect at high virtuality is discussed through the results of multiple jet and high-$p_{\mathrm{T}}$ particle observables, compared with experimental data. Furthermore, we investigate the jet-medium interaction involved in the hadronization process. △ Less

Submitted 23 December, 2022; originally announced December 2022.

Comments: 6 pages, 5 figures, contribution to the Quark Matter 2022 proceedings

Journal ref: Acta Phys. Pol. B Proc. Suppl. 16, 1-A50 (2023)

Spatio-Temporal Super-Resolution of Dynamical Systems using Physics-Informed Deep-Learning

Authors: Rajat Arora, Ankit Shrivastava

Abstract: This work presents a physics-informed deep learning-based super-resolution framework to enhance the spatio-temporal resolution of the solution of time-dependent partial differential equations (PDE). Prior works on deep learning-based super-resolution models have shown promise in accelerating engineering design by reducing the computational expense of traditional numerical schemes. However, these m… ▽ More This work presents a physics-informed deep learning-based super-resolution framework to enhance the spatio-temporal resolution of the solution of time-dependent partial differential equations (PDE). Prior works on deep learning-based super-resolution models have shown promise in accelerating engineering design by reducing the computational expense of traditional numerical schemes. However, these models heavily rely on the availability of high-resolution (HR) labeled data needed during training. In this work, we propose a physics-informed deep learning-based framework to enhance the spatial and temporal resolution of coarse-scale (both in space and time) PDE solutions without requiring any HR data. The framework consists of two trainable modules independently super-resolving the PDE solution, first in spatial and then in temporal direction. The physics based losses are implemented in a novel way to ensure tight coupling between the spatio-temporally refined outputs at different times and improve framework accuracy. We analyze the capability of the developed framework by investigating its performance on an elastodynamics problem. It is observed that the proposed framework can successfully super-resolve (both in space and time) the low-resolution PDE solutions while satisfying physics-based constraints and yielding high accuracy. Furthermore, the analysis and obtained speed-up show that the proposed framework is well-suited for integration with traditional numerical methods to reduce computational complexity during engineering design. △ Less

Submitted 8 December, 2022; originally announced December 2022.

Comments: Accepted in AAAI 2023: Workshop on AI to Accelerate Science and Engineering (AI2ASE)

A Search and Detection Autonomous Drone System: from Design to Implementation

Authors: Mohammadjavad Khosravi, Rushiv Arora, Saeede Enayati, Hossein Pishro-Nik

Abstract: Utilizing autonomous drones or unmanned aerial vehicles (UAVs) has shown great advantages over preceding methods in support of urgent scenarios such as search and rescue (SAR) and wildfire detection. In these operations, search efficiency in terms of the amount of time spent to find the target is crucial since with the passing of time the survivability of the missing person decreases or wildfire m… ▽ More Utilizing autonomous drones or unmanned aerial vehicles (UAVs) has shown great advantages over preceding methods in support of urgent scenarios such as search and rescue (SAR) and wildfire detection. In these operations, search efficiency in terms of the amount of time spent to find the target is crucial since with the passing of time the survivability of the missing person decreases or wildfire management becomes more difficult with disastrous consequences. In this work, it is considered a scenario where a drone is intended to search and detect a missing person (e.g., a hiker or a mountaineer) or a potential fire spot in a given area. In order to obtain the shortest path to the target, a general framework is provided to model the problem of target detection when the target's location is probabilistically known. To this end, two algorithms are proposed: Path planning and target detection. The path planning algorithm is based on Bayesian inference and the target detection is accomplished by means of a residual neural network (ResNet) trained on the image dataset captured by the drone as well as existing pictures and datasets on the web. Through simulation and experiment, the proposed path planning algorithm is compared with two benchmark algorithms. It is shown that the proposed algorithm significantly decreases the average time of the mission. △ Less

Submitted 28 November, 2022; originally announced November 2022.

On Instance-Dependent Bounds for Offline Reinforcement Learning with Linear Function Approximation

Authors: Thanh Nguyen-Tang, Ming Yin, Sunil Gupta, Svetha Venkatesh, Raman Arora

Abstract: Sample-efficient offline reinforcement learning (RL) with linear function approximation has recently been studied extensively. Much of prior work has yielded the minimax-optimal bound of $\tilde{\mathcal{O}}(\frac{1}{\sqrt{K}})$, with $K$ being the number of episodes in the offline data. In this work, we seek to understand instance-dependent bounds for offline RL with function approximation. We pr… ▽ More Sample-efficient offline reinforcement learning (RL) with linear function approximation has recently been studied extensively. Much of prior work has yielded the minimax-optimal bound of $\tilde{\mathcal{O}}(\frac{1}{\sqrt{K}})$, with $K$ being the number of episodes in the offline data. In this work, we seek to understand instance-dependent bounds for offline RL with function approximation. We present an algorithm called Bootstrapped and Constrained Pessimistic Value Iteration (BCP-VI), which leverages data bootstrapping and constrained optimization on top of pessimism. We show that under a partial data coverage assumption, that of \emph{concentrability} with respect to an optimal policy, the proposed algorithm yields a fast rate of $\tilde{\mathcal{O}}(\frac{1}{K})$ for offline RL when there is a positive gap in the optimal Q-value functions, even when the offline data were adaptively collected. Moreover, when the linear features of the optimal actions in the states reachable by an optimal policy span those reachable by the behavior policy and the optimal actions are unique, offline RL achieves absolute zero sub-optimality error when $K$ exceeds a (finite) instance-dependent threshold. To the best of our knowledge, these are the first $\tilde{\mathcal{O}}(\frac{1}{K})$ bound and absolute zero sub-optimality bound respectively for offline RL with linear function approximation from adaptive data with partial coverage. We also provide instance-agnostic and instance-dependent information-theoretical lower bounds to complement our upper bounds. △ Less

Submitted 27 January, 2023; v1 submitted 23 November, 2022; originally announced November 2022.

Comments: AAAI'23

Giving RSEs a Larger Stage through the Better Scientific Software Fellowship

Authors: William F. Godoy, Ritu Arora, Keith Beattie, David E. Bernholdt, Sarah E. Bratt, Daniel S. Katz, Ignacio Laguna, Amiya K. Maji, Addi Malviya Thakur, Rafael M. Mudafort, Nitin Sukhija, Damian Rouson, Cindy Rubio-González, Karan Vahi

Abstract: The Better Scientific Software Fellowship (BSSwF) was launched in 2018 to foster and promote practices, processes, and tools to improve developer productivity and software sustainability of scientific codes. BSSwF's vision is to grow the community with practitioners, leaders, mentors, and consultants to increase the visibility of scientific software production and sustainability. Over the last fiv… ▽ More The Better Scientific Software Fellowship (BSSwF) was launched in 2018 to foster and promote practices, processes, and tools to improve developer productivity and software sustainability of scientific codes. BSSwF's vision is to grow the community with practitioners, leaders, mentors, and consultants to increase the visibility of scientific software production and sustainability. Over the last five years, many fellowship recipients and honorable mentions have identified as research software engineers (RSEs). This paper provides case studies from several of the program's participants to illustrate some of the diverse ways BSSwF has benefited both the RSE and scientific communities. In an environment where the contributions of RSEs are too often undervalued, we believe that programs such as BSSwF can be a valuable means to recognize and encourage community members to step outside of their regular commitments and expand on their work, collaborations and ideas for a larger audience. △ Less

Submitted 14 November, 2022; v1 submitted 14 November, 2022; originally announced November 2022.

Comments: submitted to Computing in Science & Engineering (CiSE), Special Issue on the Future of Research Software Engineers in the US

A large class of nonlocal elliptic equations with singular nonlinearities

Authors: Rakesh Arora, Phuoc-Tai Nguyen, Vicentiu D. Radulescu

Abstract: In this work, we address the questions of existence, uniqueness, and boundary behavior of the positive weak-dual solution of equation $\mathbb{L}_γ^s u = \mathcal{F}(u)$, posed in a $C^2$ bounded domain $Ω\subset \mathbb{R}^N$, with appropriate homogeneous boundary or exterior Dirichlet conditions. The operator $\mathbb{L}_γ^s$ belongs to a general class of nonlocal operators including typical fra… ▽ More In this work, we address the questions of existence, uniqueness, and boundary behavior of the positive weak-dual solution of equation $\mathbb{L}_γ^s u = \mathcal{F}(u)$, posed in a $C^2$ bounded domain $Ω\subset \mathbb{R}^N$, with appropriate homogeneous boundary or exterior Dirichlet conditions. The operator $\mathbb{L}_γ^s$ belongs to a general class of nonlocal operators including typical fractional Laplacians such as restricted fractional Laplacian, censored fractional Laplacian and spectral fractional Laplacian. The nonlinear term $\mathcal{F}(u)$ covers three different amalgamation of nonlinearities: a purely singular nonlinearity $\mathcal{F}(u) = u^{-q}$ ($q>0$), a singular nonlinearity with a source term $\mathcal{F}(u) = u^{-q} + f(u)$, and a singular nonlinearity with an absorption term $\mathcal{F}(u) = u^{-q}-g(u)$. Based on a delicate analysis of the Green kernel associated to $\mathbb{L}_γ^s$, we develop a new unifying approach that empowered us to construct a theory for equation $\mathbb{L}_γ^s u = \mathcal{F}(u)$. In particular, we show the existence of two critical exponents $q^{\ast}_{s, γ}$ and $q^{\ast \ast}_{s, γ}$ which provides a fairly complete classification of the weak-dual solutions via their boundary behavior. Various types of nonlocal operators are discussed to exemplify the wide applicability of our theory. △ Less

Submitted 12 November, 2022; originally announced November 2022.

Comments: 41 Pages

Existence of ground state solutions for a Choquard double phase problem

Authors: Rakesh Arora, Alessio Fiscella, Tuhina Mukherjee, Patrick Winkert

Abstract: In this paper we study quasilinear elliptic equations driven by the double phase operator involving a Choquard term of the form \begin{align*} -\mathcal{L}_{p,q}^{a}(u) + |u|^{p-2}u+ a(x) |u|^{q-2}u = \left( \int_{\mathbb{R}^N} \frac{F(y, u)}{|x-y|^μ}\,\mathrm{d} y\right)f(x,u) \quad\text{in } \mathbb{R}^N, \end{align*} where $\mathcal{L}_{p,q}^{a}$ is the double phase operator given by… ▽ More In this paper we study quasilinear elliptic equations driven by the double phase operator involving a Choquard term of the form \begin{align*} -\mathcal{L}_{p,q}^{a}(u) + |u|^{p-2}u+ a(x) |u|^{q-2}u = \left( \int_{\mathbb{R}^N} \frac{F(y, u)}{|x-y|^μ}\,\mathrm{d} y\right)f(x,u) \quad\text{in } \mathbb{R}^N, \end{align*} where $\mathcal{L}_{p,q}^{a}$ is the double phase operator given by \begin{align*} \mathcal{L}_{p,q}^{a}(u):= \operatorname{div}\big(|\nabla u|^{p-2}\nabla u + a(x) |\nabla u|^{q-2}\nabla u \big), \quad u\in W^{1,\mathcal{H}}(\mathbb{R}^N), \end{align*} $0<μ<N$, $1<p<N$, $p<q<p+ \frac{αp}{N}$, $0 \leq a(\cdot)\in C^{0,α}(\mathbb{R}^N)$ with $α\in (0,1]$ and $f\colon\mathbb{R}^N\times\mathbb{R}\to\mathbb{R}$ is a continuous function that satisfies a subcritical growth. Based on the Hardy-Littlewood-Sobolev inequality, the Nehari manifold and variational tools, we prove the existence of ground state solutions of such problems under different assumptions on the data. △ Less

Submitted 25 October, 2022; originally announced October 2022.

Locally Constrained Representations in Reinforcement Learning

Authors: Somjit Nath, Rushiv Arora, Samira Ebrahimi Kahou

Abstract: The success of Reinforcement Learning (RL) heavily relies on the ability to learn robust representations from the observations of the environment. In most cases, the representations learned purely by the reinforcement learning loss can differ vastly across states depending on how the value functions change. However, the representations learned need not be very specific to the task at hand. Relying… ▽ More The success of Reinforcement Learning (RL) heavily relies on the ability to learn robust representations from the observations of the environment. In most cases, the representations learned purely by the reinforcement learning loss can differ vastly across states depending on how the value functions change. However, the representations learned need not be very specific to the task at hand. Relying only on the RL objective may yield representations that vary greatly across successive time steps. In addition, since the RL loss has a changing target, the representations learned would depend on how good the current values/policies are. Thus, disentangling the representations from the main task would allow them to focus not only on the task-specific features but also the environment dynamics. To this end, we propose locally constrained representations, where an auxiliary loss forces the state representations to be predictable by the representations of the neighboring states. This encourages the representations to be driven not only by the value/policy learning but also by an additional loss that constrains the representations from over-fitting to the value loss. We evaluate the proposed method on several known benchmarks and observe strong performance. Especially in continuous control tasks, our experiments show a significant performance improvement. △ Less

Submitted 8 February, 2024; v1 submitted 19 September, 2022; originally announced September 2022.

Model-Based Reinforcement Learning with SINDy

Authors: Rushiv Arora, Bruno Castro da Silva, Eliot Moss

Abstract: We draw on the latest advancements in the physics community to propose a novel method for discovering the governing non-linear dynamics of physical systems in reinforcement learning (RL). We establish that this method is capable of discovering the underlying dynamics using significantly fewer trajectories (as little as one rollout with $\leq 30$ time steps) than state of the art model learning alg… ▽ More We draw on the latest advancements in the physics community to propose a novel method for discovering the governing non-linear dynamics of physical systems in reinforcement learning (RL). We establish that this method is capable of discovering the underlying dynamics using significantly fewer trajectories (as little as one rollout with $\leq 30$ time steps) than state of the art model learning algorithms. Further, the technique learns a model that is accurate enough to induce near-optimal policies given significantly fewer trajectories than those required by model-free algorithms. It brings the benefits of model-based RL without requiring a model to be developed in advance, for systems that have physics-based dynamics. To establish the validity and applicability of this algorithm, we conduct experiments on four classic control tasks. We found that an optimal policy trained on the discovered dynamics of the underlying system can generalize well. Further, the learned policy performs well when deployed on the actual physical system, thus bridging the model to real system gap. We further compare our method to state-of-the-art model-based and model-free approaches, and show that our method requires fewer trajectories sampled on the true physical system compared other methods. Additionally, we explored approximate dynamics models and found that they also can perform well. △ Less

Submitted 30 August, 2022; originally announced August 2022.

Comments: 8 pages, 1 figure, 1 table, 1 algorithm, presented at the Decision Awareness in Reinforcement Learning workshop held at the International Conference on Machine Learning, 22 July 2022, Baltimore MD, USA

A Risk-Sensitive Approach to Policy Optimization

Authors: Jared Markowitz, Ryan W. Gardner, Ashley Llorens, Raman Arora, I-Jeng Wang

Abstract: Standard deep reinforcement learning (DRL) aims to maximize expected reward, considering collected experiences equally in formulating a policy. This differs from human decision-making, where gains and losses are valued differently and outlying outcomes are given increased consideration. It also fails to capitalize on opportunities to improve safety and/or performance through the incorporation of d… ▽ More Standard deep reinforcement learning (DRL) aims to maximize expected reward, considering collected experiences equally in formulating a policy. This differs from human decision-making, where gains and losses are valued differently and outlying outcomes are given increased consideration. It also fails to capitalize on opportunities to improve safety and/or performance through the incorporation of distributional context. Several approaches to distributional DRL have been investigated, with one popular strategy being to evaluate the projected distribution of returns for possible actions. We propose a more direct approach whereby risk-sensitive objectives, specified in terms of the cumulative distribution function (CDF) of the distribution of full-episode rewards, are optimized. This approach allows for outcomes to be weighed based on relative quality, can be used for both continuous and discrete action spaces, and may naturally be applied in both constrained and unconstrained settings. We show how to compute an asymptotically consistent estimate of the policy gradient for a broad class of risk-sensitive objectives via sampling, subsequently incorporating variance reduction and regularization measures to facilitate effective on-policy learning. We then demonstrate that the use of moderately "pessimistic" risk profiles, which emphasize scenarios where the agent performs poorly, leads to enhanced exploration and a continual focus on addressing deficiencies. We test the approach using different risk profiles in six OpenAI Safety Gym environments, comparing to state of the art on-policy methods. Without cost constraints, we find that pessimistic risk profiles can be used to reduce cost while improving total reward accumulation. With cost constraints, they are seen to provide higher positive rewards than risk-neutral approaches at the prescribed allowable cost. △ Less

Submitted 15 November, 2023; v1 submitted 18 August, 2022; originally announced August 2022.

Comments: 16 pages, 13 figures. AAAI 2023 (Special Track on Safe and Robust AI)