-
Representation of continuum equations in physical components for arbitrary curved surfaces
Authors:
Sujit Kumar Nath
Abstract:
Continuum equations are ubiquitous in physical modelling of elastic, viscous, and viscoelastic systems. The equations of continuum mechanics take nontrivial forms on curved surfaces. Although the curved surface formulation of the continuum equations are derived in many excellent references available in the literature, they are not readily usable for solving physical problems due to the covariant,…
▽ More
Continuum equations are ubiquitous in physical modelling of elastic, viscous, and viscoelastic systems. The equations of continuum mechanics take nontrivial forms on curved surfaces. Although the curved surface formulation of the continuum equations are derived in many excellent references available in the literature, they are not readily usable for solving physical problems due to the covariant, contravariant or mixed nature of the stress and strain tensors in the equations. We present the continuum equations in terms of physical components in a general differentiable manifold. This general formulation of the continuum equations can be used readily for modelling physical problems on arbitrary curved surfaces. We demonstrate this with the help of some examples.
△ Less
Submitted 27 July, 2024; v1 submitted 17 July, 2024;
originally announced July 2024.
-
Building AI Agents for Autonomous Clouds: Challenges and Design Principles
Authors:
Manish Shetty,
Yinfang Chen,
Gagan Somashekar,
Minghua Ma,
Yogesh Simmhan,
Xuchao Zhang,
Jonathan Mace,
Dax Vandevoorde,
Pedro Las-Casas,
Shachee Mishra Gupta,
Suman Nath,
Chetan Bansal,
Saravan Rajmohan
Abstract:
The rapid growth in the use of Large Language Models (LLMs) and AI Agents as part of software development and deployment is revolutionizing the information technology landscape. While code generation receives significant attention, a higher-impact application lies in using AI agents for operational resilience of cloud services, which currently require significant human effort and domain knowledge.…
▽ More
The rapid growth in the use of Large Language Models (LLMs) and AI Agents as part of software development and deployment is revolutionizing the information technology landscape. While code generation receives significant attention, a higher-impact application lies in using AI agents for operational resilience of cloud services, which currently require significant human effort and domain knowledge. There is a growing interest in AI for IT Operations (AIOps) which aims to automate complex operational tasks, like fault localization and root cause analysis, thereby reducing human intervention and customer impact. However, achieving the vision of autonomous and self-healing clouds through AIOps is hampered by the lack of standardized frameworks for building, evaluating, and improving AIOps agents. This vision paper lays the groundwork for such a framework by first framing the requirements and then discussing design decisions that satisfy them. We also propose AIOpsLab, a prototype implementation leveraging agent-cloud-interface that orchestrates an application, injects real-time faults using chaos engineering, and interfaces with an agent to localize and resolve the faults. We report promising results and lay the groundwork to build a modular and robust framework for building, evaluating, and improving agents for autonomous clouds.
△ Less
Submitted 31 July, 2024; v1 submitted 16 July, 2024;
originally announced July 2024.
-
Distilling Opinions at Scale: Incremental Opinion Summarization using XL-OPSUMM
Authors:
Sri Raghava Muddu,
Rupasai Rangaraju,
Tejpalsingh Siledar,
Swaroop Nath,
Pushpak Bhattacharyya,
Swaprava Nath,
Suman Banerjee,
Amey Patil,
Muthusamy Chelliah,
Sudhanshu Shekhar Singh,
Nikesh Garera
Abstract:
Opinion summarization in e-commerce encapsulates the collective views of numerous users about a product based on their reviews. Typically, a product on an e-commerce platform has thousands of reviews, each review comprising around 10-15 words. While Large Language Models (LLMs) have shown proficiency in summarization tasks, they struggle to handle such a large volume of reviews due to context limi…
▽ More
Opinion summarization in e-commerce encapsulates the collective views of numerous users about a product based on their reviews. Typically, a product on an e-commerce platform has thousands of reviews, each review comprising around 10-15 words. While Large Language Models (LLMs) have shown proficiency in summarization tasks, they struggle to handle such a large volume of reviews due to context limitations. To mitigate, we propose a scalable framework called Xl-OpSumm that generates summaries incrementally. However, the existing test set, AMASUM has only 560 reviews per product on average. Due to the lack of a test set with thousands of reviews, we created a new test set called Xl-Flipkart by gathering data from the Flipkart website and generating summaries using GPT-4. Through various automatic evaluations and extensive analysis, we evaluated the framework's efficiency on two datasets, AMASUM and Xl-Flipkart. Experimental results show that our framework, Xl-OpSumm powered by Llama-3-8B-8k, achieves an average ROUGE-1 F1 gain of 4.38% and a ROUGE-L F1 gain of 3.70% over the next best-performing model.
△ Less
Submitted 16 June, 2024;
originally announced June 2024.
-
Primitive normal pairs with prescribed traces over finite fields
Authors:
Shikhamoni Nath,
Arpan Chandra Mazumder,
Dhiren Kumar Basnet
Abstract:
Let $q$ be a positive integral power of some prime $p$ and $\mathbb{F}_{q^m}$ be a finite field with $q^m$ elements for some $m \in \mathbb{N}$. Here we establish a sufficient condition for the existence of primitive normal pairs of the type $(ε, f(ε))$ in $\mathbb{F}_{q^m}$ over $\mathbb{F}_{q}$ with two prescribed traces, $Tr_{{\mathbb{F}_{q^m}}/{\mathbb{F}_q}}(ε)=a$ and…
▽ More
Let $q$ be a positive integral power of some prime $p$ and $\mathbb{F}_{q^m}$ be a finite field with $q^m$ elements for some $m \in \mathbb{N}$. Here we establish a sufficient condition for the existence of primitive normal pairs of the type $(ε, f(ε))$ in $\mathbb{F}_{q^m}$ over $\mathbb{F}_{q}$ with two prescribed traces, $Tr_{{\mathbb{F}_{q^m}}/{\mathbb{F}_q}}(ε)=a$ and $Tr_{{\mathbb{F}_{q^m}}/{\mathbb{F}_q}}(f(ε))=b$, where $f(x) \in \mathbb{F}_{q^m}(x)$ is a rational function with some restrictions and $a, b \in \mathbb{F}_q$. Furthermore, for $q=5^k$, $m \geq 9$ and rational functions with degree sum 4, we explicitly find at most 12 fields in which the desired pair may not exist.
△ Less
Submitted 7 June, 2024; v1 submitted 29 May, 2024;
originally announced May 2024.
-
Statistical Context Detection for Deep Lifelong Reinforcement Learning
Authors:
Jeffery Dick,
Saptarshi Nath,
Christos Peridis,
Eseoghene Benjamin,
Soheil Kolouri,
Andrea Soltoggio
Abstract:
Context detection involves labeling segments of an online stream of data as belonging to different tasks. Task labels are used in lifelong learning algorithms to perform consolidation or other procedures that prevent catastrophic forgetting. Inferring task labels from online experiences remains a challenging problem. Most approaches assume finite and low-dimension observation spaces or a prelimina…
▽ More
Context detection involves labeling segments of an online stream of data as belonging to different tasks. Task labels are used in lifelong learning algorithms to perform consolidation or other procedures that prevent catastrophic forgetting. Inferring task labels from online experiences remains a challenging problem. Most approaches assume finite and low-dimension observation spaces or a preliminary training phase during which task labels are learned. Moreover, changes in the transition or reward functions can be detected only in combination with a policy, and therefore are more difficult to detect than changes in the input distribution. This paper presents an approach to learning both policies and labels in an online deep reinforcement learning setting. The key idea is to use distance metrics, obtained via optimal transport methods, i.e., Wasserstein distance, on suitable latent action-reward spaces to measure distances between sets of data points from past and current streams. Such distances can then be used for statistical tests based on an adapted Kolmogorov-Smirnov calculation to assign labels to sequences of experiences. A rollback procedure is introduced to learn multiple policies by ensuring that only the appropriate data is used to train the corresponding policy. The combination of task detection and policy deployment allows for the optimization of lifelong reinforcement learning agents without an oracle that provides task labels. The approach is tested using two benchmarks and the results show promising performance when compared with related context detection algorithms. The results suggest that optimal transport statistical methods provide an explainable and justifiable procedure for online context detection and reward optimization in lifelong reinforcement learning.
△ Less
Submitted 29 May, 2024;
originally announced May 2024.
-
Survival probability and position distribution of a run and tumble particle in $U(x)=α|x|$ potential with an absorbing boundary
Authors:
Sujit Kumar Nath,
Sanjib Sabhapandit
Abstract:
We study the late time exponential decay of the survival probability $S_\pm(t,a|x_0)\sim e^{-θ(a)t}$, of a one-dimensional run and tumble particle starting from $x_0<a$ with an initial orientation $σ(0)=\pm 1$, under a confining potential $U(x)=α|x|$ with an absorbing boundary at $x=a>0$. We find that the decay rate $θ(a)$ of the survival probability has strong dependence on the location $a$ of th…
▽ More
We study the late time exponential decay of the survival probability $S_\pm(t,a|x_0)\sim e^{-θ(a)t}$, of a one-dimensional run and tumble particle starting from $x_0<a$ with an initial orientation $σ(0)=\pm 1$, under a confining potential $U(x)=α|x|$ with an absorbing boundary at $x=a>0$. We find that the decay rate $θ(a)$ of the survival probability has strong dependence on the location $a$ of the absorbing boundary, which undergoes a freezing transition at a critical value $a=a_c=(v_0-α)\sqrt{v_0^2-α^2}/(2αγ)$, where $v_0>α$ is the self-propulsion speed and $γ$ is the tumbling rate of the particle. For $a>a_c$, the value of $θ(a)$ increases monotonically from zero, as $a$ decreases from infinity, till it attains the maximum value $θ(a_c)$ at $a=a_c$. For $0<a<a_c$, the value of $θ(a)$ freezes to the value $θ(a)=θ(a_c)$. We also obtain the propagator with the absorbing boundary condition at $x=a$. Our analytical results are supported by numerical simulations.
△ Less
Submitted 29 May, 2024;
originally announced May 2024.
-
Instability of a dusty shear flow
Authors:
Anu V. S. Nath,
Anubhab Roy,
M. Houssem Kasbaoui
Abstract:
We study the instability of a dusty simple shear flow where the dust particles are distributed non-uniformly. A simple shear flow is modally stable to infinitesimal perturbations. Also, a band of particles remains unaffected in the absence of any background flow. However, we demonstrate that the combined scenario -- comprising a simple shear flow with a localised band of particles -- can exhibit d…
▽ More
We study the instability of a dusty simple shear flow where the dust particles are distributed non-uniformly. A simple shear flow is modally stable to infinitesimal perturbations. Also, a band of particles remains unaffected in the absence of any background flow. However, we demonstrate that the combined scenario -- comprising a simple shear flow with a localised band of particles -- can exhibit destabilisation due to their two-way interaction. The instability originates solely from the momentum feedback from the particle phase to the fluid phase. Eulerian-Lagrangian simulations are employed to illustrate the existence of this instability. Furthermore, the results are compared with a linear stability analysis of the system using an Eulerian-Eulerian model. Our findings indicate that the instability has an inviscid origin and is characterised by a critical wavelength below which it is not persistent. We have observed that increasing particle inertia dampens the unstable modes, whereas the strength of the instability increases with the strength of the coupling between the fluid and particle phases.
△ Less
Submitted 9 May, 2024;
originally announced May 2024.
-
Characterising the Creative Process in Humans and Large Language Models
Authors:
Surabhi S. Nath,
Peter Dayan,
Claire Stevenson
Abstract:
Large language models appear quite creative, often performing on par with the average human on creative tasks. However, research on LLM creativity has focused solely on \textit{products}, with little attention on the creative \textit{process}. Process analyses of human creativity often require hand-coded categories or exploit response times, which do not apply to LLMs. We provide an automated meth…
▽ More
Large language models appear quite creative, often performing on par with the average human on creative tasks. However, research on LLM creativity has focused solely on \textit{products}, with little attention on the creative \textit{process}. Process analyses of human creativity often require hand-coded categories or exploit response times, which do not apply to LLMs. We provide an automated method to characterise how humans and LLMs explore semantic spaces on the Alternate Uses Task, and contrast with behaviour in a Verbal Fluency Task. We use sentence embeddings to identify response categories and compute semantic similarities, which we use to generate jump profiles. Our results corroborate earlier work in humans reporting both persistent (deep search in few semantic spaces) and flexible (broad search across multiple semantic spaces) pathways to creativity, where both pathways lead to similar creativity scores. LLMs were found to be biased towards either persistent or flexible paths, that varied across tasks. Though LLMs as a population match human profiles, their relationship with creativity is different, where the more flexible models score higher on creativity. Our dataset and scripts are available on \href{https://github.com/surabhisnath/Creative_Process}{GitHub}.
△ Less
Submitted 5 June, 2024; v1 submitted 1 May, 2024;
originally announced May 2024.
-
Learning Strategies For Successful Crowd Navigation
Authors:
Rajshree Daulatabad,
Serena Nath
Abstract:
Teaching autonomous mobile robots to successfully navigate human crowds is a challenging task. Not only does it require planning, but it requires maintaining social norms which may differ from one context to another. Here we focus on crowd navigation, using a neural network to learn specific strategies in-situ with a robot. This allows us to take into account human behavior and reactions toward a…
▽ More
Teaching autonomous mobile robots to successfully navigate human crowds is a challenging task. Not only does it require planning, but it requires maintaining social norms which may differ from one context to another. Here we focus on crowd navigation, using a neural network to learn specific strategies in-situ with a robot. This allows us to take into account human behavior and reactions toward a real robot as well as learn strategies that are specific to various scenarios in that context. A CNN takes a top-down image of the scene as input and outputs the next action for the robot to take in terms of speed and angle. Here we present the method, experimental results, and quantitatively evaluate our approach.
△ Less
Submitted 9 April, 2024;
originally announced April 2024.
-
Product Description and QA Assisted Self-Supervised Opinion Summarization
Authors:
Tejpalsingh Siledar,
Rupasai Rangaraju,
Sankara Sri Raghava Ravindra Muddu,
Suman Banerjee,
Amey Patil,
Sudhanshu Shekhar Singh,
Muthusamy Chelliah,
Nikesh Garera,
Swaprava Nath,
Pushpak Bhattacharyya
Abstract:
In e-commerce, opinion summarization is the process of summarizing the consensus opinions found in product reviews. However, the potential of additional sources such as product description and question-answers (QA) has been considered less often. Moreover, the absence of any supervised training data makes this task challenging. To address this, we propose a novel synthetic dataset creation (SDC) s…
▽ More
In e-commerce, opinion summarization is the process of summarizing the consensus opinions found in product reviews. However, the potential of additional sources such as product description and question-answers (QA) has been considered less often. Moreover, the absence of any supervised training data makes this task challenging. To address this, we propose a novel synthetic dataset creation (SDC) strategy that leverages information from reviews as well as additional sources for selecting one of the reviews as a pseudo-summary to enable supervised training. Our Multi-Encoder Decoder framework for Opinion Summarization (MEDOS) employs a separate encoder for each source, enabling effective selection of information while generating the summary. For evaluation, due to the unavailability of test sets with additional sources, we extend the Amazon, Oposum+, and Flipkart test sets and leverage ChatGPT to annotate summaries. Experiments across nine test sets demonstrate that the combination of our SDC approach and MEDOS model achieves on average a 14.5% improvement in ROUGE-1 F1 over the SOTA. Moreover, comparative analysis underlines the significance of incorporating additional sources for generating more informative summaries. Human evaluations further indicate that MEDOS scores relatively higher in coherence and fluency with 0.41 and 0.5 (-1 to 1) respectively, compared to existing models. To the best of our knowledge, we are the first to generate opinion summaries leveraging additional sources in a self-supervised setting.
△ Less
Submitted 8 April, 2024;
originally announced April 2024.
-
Tuning superconductivity in nanosecond laser annealed boron doped $Si_{1-x}Ge_{x}$ epilayers
Authors:
S. Nath,
I. Turan,
L. Desvignes,
L. Largeau,
O. Mauguin,
M. Túnica,
M. Amato,
C. Renard,
G. Hallais,
D. Débarre,
F. Chiodi
Abstract:
Superconductivity in ultra-doped $Si_{1-x}Ge_{x}:B$ epilayers is demonstrated by nanosecond laser doping, which allows introducing substitutional B concentrations well above the solubility limit and up to $7\,at.\%$. A Ge fraction $x$ ranging from 0 to 0.21 is incorporated in $Si:B$ : 1) through a precursor gas by Gas Immersion Laser Doping; 2) by ion implantation, followed by nanosecond laser ann…
▽ More
Superconductivity in ultra-doped $Si_{1-x}Ge_{x}:B$ epilayers is demonstrated by nanosecond laser doping, which allows introducing substitutional B concentrations well above the solubility limit and up to $7\,at.\%$. A Ge fraction $x$ ranging from 0 to 0.21 is incorporated in $Si:B$ : 1) through a precursor gas by Gas Immersion Laser Doping; 2) by ion implantation, followed by nanosecond laser annealing; 3) by UHV-CVD growth of a thin Ge layer, followed by nanosecond laser annealing. The 30 nm and 80 nm thick $Si_{1-x}Ge_{x}:B$ epilayers display superconducting critical temperatures $T_c$ tuned by B and Ge between 0 and 0.6 K. Within BCS weak-coupling theory, $T_c$ evolves exponentially with both the density of states and the electron-phonon potential. While B doping affects both, through the increase of the carrier density and the tensile strain, Ge incorporation allows addressing independently the lattice deformation influence on superconductivity. To estimate the lattice parameter modulation with B and Ge, Vegard's law is validated for the ternary $SiGeB$ bulk alloy by Density Functional Theory calculations. Its validity is furthermore confirmed experimentally by X-Ray Diffraction. We highlight a global linear dependence of $T_c$ vs. lattice parameter, common for both $Si:B$ and $Si_{1-x}Ge_{x}:B$, with $δT_c/T_c \sim 50\,\%$ for $δa/a \sim 1\,\%$.
△ Less
Submitted 3 April, 2024;
originally announced April 2024.
-
Investigation of magnetic order influenced phonon and electron dynamics in MnBi$_{2}$Te$_{4}$ and Sb doped MnBi$_{2}$Te$_{4}$ through terahertz time-domain spectroscopy
Authors:
Soumya Mukherjee,
Anjan Kumar NM,
Subhadip Manna,
Sambhu G Nath,
Radha Krishna Gopal,
Chiranjib Mitra,
N. Kamaraju
Abstract:
MnBi$_{2}$Te$_{4}$, the first topological insulator with inherent magnetic ordering, has attracted significant attention recently for providing a platform to realize several exotic quantum phenomena at relatively higher temperatures. In this work, we have carried out an exhaustive investigation of MnBi$_{2}$Te$_{4}$ and Sb doped MnBi$_{2}$Te$_{4}$ thin films using THz time-domain spectroscopy. The…
▽ More
MnBi$_{2}$Te$_{4}$, the first topological insulator with inherent magnetic ordering, has attracted significant attention recently for providing a platform to realize several exotic quantum phenomena at relatively higher temperatures. In this work, we have carried out an exhaustive investigation of MnBi$_{2}$Te$_{4}$ and Sb doped MnBi$_{2}$Te$_{4}$ thin films using THz time-domain spectroscopy. The extracted real THz conductivity displays a strong IR active E$_u$ phonon absorption peak (at $\sim$1.5 THz) merged on top of the Drude-like contributions from bulk and surface electrons. The extracted parameters from the THz conductivity data fitted to the Drude-Fano-Lorentz model, show significant changes in their temperature dependence around the magnetic ordering Néel temperature of $\sim$ 25K, which is suggestive of the coupling between magnetic ordering and electronic band structure. The frequency of the E$_u$ phonon displays an anomalous blue-shift with increasing temperatures by $\sim$ 0.1 THz ($\sim$7 %) for MnBi$_{2}$Te$_{4}$ and $\sim$0.2 THz ($\sim$13 %) for Sb doped MnBi$_{2}$Te$_{4}$ between 7K and 250K. The line-shape of the E$_u$ phonon mode in Sb doped MnBi$_{2}$Te$_{4}$ shows significant Fano asymmetry compared to that of MnBi$_{2}$Te$_{4}$, indicating that Sb doping plays an important role in the Fano interference between the phonons and the electrons, in this system. These results indicate that the anomalous phonon behaviour seen in MBT arise mainly from positive cubic anharmonicity induced self energy parameter, whereas both anharmonicity and the electron phonon coupling are at play in making the relatively higher anomalous blue shift of phonons in MBST. Our studies provide the first comprehensive understanding of the phonon and electron dynamics of MnBi$_{2}$Te$_{4}$ and Sb doped MnBi$_{2}$Te$_{4}$ in the THz range using time-domain THz spectroscopy.
△ Less
Submitted 18 March, 2024;
originally announced March 2024.
-
Anisotropic magneto-photothermal voltage in Sb2Te3 topological insulator thin films
Authors:
Subhadip Manna,
Sambhu G Nath,
Samrat Roy,
Soumik Aon,
Sayani Pal,
Kanav Sharma,
Dhananjaya Mahapatra,
Partha Mitra,
Sourin Das,
Bipul Pal,
Chiranjib Mitra
Abstract:
We studied longitudinal and Hall photothermal voltages under a planar magnetic field scan in epitaxial thin films of the Topological Insulator (TI) Sb2Te3, grown using pulsed laser deposition (PLD). Unlike prior research that utilised polarised light-induced photocurrent to investigate the TI, our study introduces advancements based on unpolarized light-induced local heating. This method yields a…
▽ More
We studied longitudinal and Hall photothermal voltages under a planar magnetic field scan in epitaxial thin films of the Topological Insulator (TI) Sb2Te3, grown using pulsed laser deposition (PLD). Unlike prior research that utilised polarised light-induced photocurrent to investigate the TI, our study introduces advancements based on unpolarized light-induced local heating. This method yields a thermoelectric response exhibiting a direct signature of strong spin-orbit coupling. Our analysis reveals three distinct contributions when fitting the photothermal voltage data to the angular dependence of the planar magnetic field. The interaction between the applied magnetic field and the thermal gradient on the bulk band orbitals enables the differentiation between the ordinary Nernst effect from the out-of-plane thermal gradient and an extraordinary magneto-thermal contribution from the planar thermal gradient. The fitting of our data to theoretical models indicates that these effects primarily arise from the bulk states of the TI rather than the surface states. These findings highlight PLD-grown epitaxial topological insulator thin films as promising candidates for optoelectronic devices, including sensors and actuators. Such devices offer controllable responses through position-dependent, non-invasive local heating via focused incident light and variations in the applied magnetic field direction.
△ Less
Submitted 15 March, 2024;
originally announced March 2024.
-
Clustering and chaotic motion of heavy inertial particles in an isolated non-axisymmetric vortex
Authors:
Anu V. S. Nath,
Anubhab Roy
Abstract:
We investigate the dynamics of heavy inertial particles in a flow field due to an isolated, non-axisymmetric vortex. For our study, we consider a canonical elliptical vortex - the Kirchhoff vortex and its strained variant, the Kida vortex. Contrary to the anticipated centrifugal dispersion of inertial particles, which is typical in open vortical flows, we observe the clustering of particles around…
▽ More
We investigate the dynamics of heavy inertial particles in a flow field due to an isolated, non-axisymmetric vortex. For our study, we consider a canonical elliptical vortex - the Kirchhoff vortex and its strained variant, the Kida vortex. Contrary to the anticipated centrifugal dispersion of inertial particles, which is typical in open vortical flows, we observe the clustering of particles around co-rotating attractors near the Kirchhoff vortex due to its non-axisymmetric nature. We analyze the inertia-modified stability characteristics of the fixed points, highlighting how some of the fixed points migrate in physical space, collide and then annihilate with increasing particle inertia. The introduction of external straining, the Kida vortex being an example, introduces chaotic tracer transport. Using a Melnikov analysis, we show that particle inertia and external straining can compete, where chaotic transport can be suppressed beyond a critical value of particle inertia.
△ Less
Submitted 15 March, 2024;
originally announced March 2024.
-
Correction and standardisation of lung oscillometry techniques using parameter inference: A study group report
Authors:
Bindi S. Brook,
Graeham R. Douglas,
Oliver E. Jensen,
Sonal Mistry,
Sujit Kumar Nath,
Matthew J. Russell,
Sina Saffaran,
James Shemilt,
Liam Weaver,
Carl A. Whitfield
Abstract:
This report relates to a study group hosted by the EPSRC funded network, Integrating data-driven BIOphysical models into REspiratory MEdicine (BIOREME), and supported by The Insigneo Institute and The Knowledge Transfer Network. The BIOREME network hosts events, including this study group, to bring together multi-disciplinary researchers, clinicians, companies and charities to catalyse research in…
▽ More
This report relates to a study group hosted by the EPSRC funded network, Integrating data-driven BIOphysical models into REspiratory MEdicine (BIOREME), and supported by The Insigneo Institute and The Knowledge Transfer Network. The BIOREME network hosts events, including this study group, to bring together multi-disciplinary researchers, clinicians, companies and charities to catalyse research in the applications of mathematical modelling for respiratory medicine. The goal of this study group was to provide an interface between companies, clinicians, and mathematicians to develop mathematical tools to the problems presented. The study group was held at The University of Sheffield on the 17 - 20 April 2023 and was attended by 24 researchers from 13 different institutions.
This report relates to a challenge presented by Arete Medical Technologies relating to impulse oscillometry (IOS), whereby a short pressure oscillation is imposed at a person's mouth during normal breathing, usually by a loudspeaker. The resulting pressure and flow rate changes can be used to the impedance of the airways, which in turn can provide proxy measurements for (patho)physiological changes in the small airways. Disentangling the signal so that airway mechanics can be measured accurately (and device properties/environmental effects can be accounted for) remains an open challenge that has the potential to significantly improve the device and its translation to clinic. In this report, several approaches to this problem, and the wider problem of interpreting oscillometry resuts are explored.
△ Less
Submitted 7 March, 2024;
originally announced March 2024.
-
Simplicity in Complexity : Explaining Visual Complexity using Deep Segmentation Models
Authors:
Tingke Shen,
Surabhi S Nath,
Aenne Brielmann,
Peter Dayan
Abstract:
The complexity of visual stimuli plays an important role in many cognitive phenomena, including attention, engagement, memorability, time perception and aesthetic evaluation. Despite its importance, complexity is poorly understood and ironically, previous models of image complexity have been quite complex. There have been many attempts to find handcrafted features that explain complexity, but thes…
▽ More
The complexity of visual stimuli plays an important role in many cognitive phenomena, including attention, engagement, memorability, time perception and aesthetic evaluation. Despite its importance, complexity is poorly understood and ironically, previous models of image complexity have been quite complex. There have been many attempts to find handcrafted features that explain complexity, but these features are usually dataset specific, and hence fail to generalise. On the other hand, more recent work has employed deep neural networks to predict complexity, but these models remain difficult to interpret, and do not guide a theoretical understanding of the problem. Here we propose to model complexity using segment-based representations of images. We use state-of-the-art segmentation models, SAM and FC-CLIP, to quantify the number of segments at multiple granularities, and the number of classes in an image respectively. We find that complexity is well-explained by a simple linear model with these two features across six diverse image-sets of naturalistic scene and art images. This suggests that the complexity of images can be surprisingly simple.
△ Less
Submitted 6 May, 2024; v1 submitted 5 March, 2024;
originally announced March 2024.
-
Transformers are Expressive, But Are They Expressive Enough for Regression?
Authors:
Swaroop Nath,
Harshad Khadilkar,
Pushpak Bhattacharyya
Abstract:
Transformers have become pivotal in Natural Language Processing, demonstrating remarkable success in applications like Machine Translation and Summarization. Given their widespread adoption, several works have attempted to analyze the expressivity of Transformers. Expressivity of a neural network is the class of functions it can approximate. A neural network is fully expressive if it can act as a…
▽ More
Transformers have become pivotal in Natural Language Processing, demonstrating remarkable success in applications like Machine Translation and Summarization. Given their widespread adoption, several works have attempted to analyze the expressivity of Transformers. Expressivity of a neural network is the class of functions it can approximate. A neural network is fully expressive if it can act as a universal function approximator. We attempt to analyze the same for Transformers. Contrary to existing claims, our findings reveal that Transformers struggle to reliably approximate smooth functions, relying on piecewise constant approximations with sizable intervals. The central question emerges as: ''Are Transformers truly Universal Function Approximators?'' To address this, we conduct a thorough investigation, providing theoretical insights and supporting evidence through experiments. Theoretically, we prove that Transformer Encoders cannot approximate smooth functions. Experimentally, we complement our theory and show that the full Transformer architecture cannot approximate smooth functions. By shedding light on these challenges, we advocate a refined understanding of Transformers' capabilities. Code Link: https://github.com/swaroop-nath/transformer-expressivity.
△ Less
Submitted 30 August, 2024; v1 submitted 23 February, 2024;
originally announced February 2024.
-
Leveraging Domain Knowledge for Efficient Reward Modelling in RLHF: A Case-Study in E-Commerce Opinion Summarization
Authors:
Swaroop Nath,
Tejpalsingh Siledar,
Sankara Sri Raghava Ravindra Muddu,
Rupasai Rangaraju,
Harshad Khadilkar,
Pushpak Bhattacharyya,
Suman Banerjee,
Amey Patil,
Sudhanshu Shekhar Singh,
Muthusamy Chelliah,
Nikesh Garera
Abstract:
Reinforcement Learning from Human Feedback (RLHF) has become a dominating strategy in aligning Language Models (LMs) with human values/goals. The key to the strategy is learning a reward model ($\varphi$), which can reflect the latent reward model of humans. While this strategy has proven effective, the training methodology requires a lot of human preference annotation (usually in the order of ten…
▽ More
Reinforcement Learning from Human Feedback (RLHF) has become a dominating strategy in aligning Language Models (LMs) with human values/goals. The key to the strategy is learning a reward model ($\varphi$), which can reflect the latent reward model of humans. While this strategy has proven effective, the training methodology requires a lot of human preference annotation (usually in the order of tens of thousands) to train $\varphi$. Such a large-scale annotation is justifiable when it's a one-time effort, and the reward model is universally applicable. However, human goals are subjective and depend on the task, requiring task-specific preference annotations, which can be impractical to fulfill. To address this challenge, we propose a novel approach to infuse domain knowledge into $\varphi$, which reduces the amount of preference annotation required ($21\times$), omits Alignment Tax, and provides some interpretability. We validate our approach in E-Commerce Opinion Summarization, with a significant reduction in dataset size (to just $940$ samples) while advancing the SOTA ($\sim4$ point ROUGE-L improvement, $68\%$ of times preferred by humans over SOTA). Our contributions include a novel Reward Modeling technique and two new datasets: PromptOpinSumm (supervised data for Opinion Summarization) and OpinPref (a gold-standard human preference dataset). The proposed methodology opens up avenues for efficient RLHF, making it more adaptable to applications with varying human values. We release the artifacts (Code: github.com/efficient-rlhf. PromptOpinSumm: hf.co/prompt-opin-summ. OpinPref: hf.co/opin-pref) for usage under MIT License.
△ Less
Submitted 18 April, 2024; v1 submitted 23 February, 2024;
originally announced February 2024.
-
Complexity Growth and the Krylov-Wigner function
Authors:
Ritam Basu,
Anirban Ganguly,
Souparna Nath,
Onkar Parrikar
Abstract:
For any state in a $D$-dimensional Hilbert space with a choice of basis, one can define a discrete version of the Wigner function -- a quasi-probability distribution which represents the state on a discrete phase space. The Wigner function can, in general, take on negative values, and the amount of negativity in the Wigner function has an operational meaning as a resource for quantum computation.…
▽ More
For any state in a $D$-dimensional Hilbert space with a choice of basis, one can define a discrete version of the Wigner function -- a quasi-probability distribution which represents the state on a discrete phase space. The Wigner function can, in general, take on negative values, and the amount of negativity in the Wigner function has an operational meaning as a resource for quantum computation. In this note, we study the growth of Wigner negativity for a generic initial state under time evolution with chaotic Hamiltonians. We introduce the Krylov-Wigner function, i.e., the Wigner function defined with respect to the Krylov basis (with appropriate phases), and show that this choice of basis minimizes the early time growth of Wigner negativity in the large $D$ limit. We take this as evidence that the Krylov basis (with appropriate phases) is ideally suited for a dual, semi-classical description of chaotic quantum dynamics at large $D$. We also numerically study the time evolution of the Krylov-Wigner function and its negativity in random matrix theory for an initial pure state. We observe that the negativity broadly shows three phases: it rises gradually for a time of $O(\sqrt{D})$, then hits a sharp ramp and finally saturates close to its upper bound of $\sqrt{D}$.
△ Less
Submitted 21 February, 2024;
originally announced February 2024.
-
One Prompt To Rule Them All: LLMs for Opinion Summary Evaluation
Authors:
Tejpalsingh Siledar,
Swaroop Nath,
Sankara Sri Raghava Ravindra Muddu,
Rupasai Rangaraju,
Swaprava Nath,
Pushpak Bhattacharyya,
Suman Banerjee,
Amey Patil,
Sudhanshu Shekhar Singh,
Muthusamy Chelliah,
Nikesh Garera
Abstract:
Evaluation of opinion summaries using conventional reference-based metrics rarely provides a holistic evaluation and has been shown to have a relatively low correlation with human judgments. Recent studies suggest using Large Language Models (LLMs) as reference-free metrics for NLG evaluation, however, they remain unexplored for opinion summary evaluation. Moreover, limited opinion summary evaluat…
▽ More
Evaluation of opinion summaries using conventional reference-based metrics rarely provides a holistic evaluation and has been shown to have a relatively low correlation with human judgments. Recent studies suggest using Large Language Models (LLMs) as reference-free metrics for NLG evaluation, however, they remain unexplored for opinion summary evaluation. Moreover, limited opinion summary evaluation datasets inhibit progress. To address this, we release the SUMMEVAL-OP dataset covering 7 dimensions related to the evaluation of opinion summaries: fluency, coherence, relevance, faithfulness, aspect coverage, sentiment consistency, and specificity. We investigate Op-I-Prompt a dimension-independent prompt, and Op-Prompts, a dimension-dependent set of prompts for opinion summary evaluation. Experiments indicate that Op-I-Prompt emerges as a good alternative for evaluating opinion summaries achieving an average Spearman correlation of 0.70 with humans, outperforming all previous approaches. To the best of our knowledge, we are the first to investigate LLMs as evaluators on both closed-source and open-source models in the opinion summarization domain.
△ Less
Submitted 9 June, 2024; v1 submitted 18 February, 2024;
originally announced February 2024.
-
Spatial autoregressive model with measurement error in covariates
Authors:
Subhadeep Paul,
Shanjukta Nath
Abstract:
The Spatial AutoRegressive model (SAR) is commonly used in studies involving spatial and network data to estimate the spatial or network peer influence and the effects of covariates on the response, taking into account the dependence among units. While the model can be efficiently estimated with a Quasi maximum likelihood approach (QMLE), the detrimental effect of covariate measurement error on th…
▽ More
The Spatial AutoRegressive model (SAR) is commonly used in studies involving spatial and network data to estimate the spatial or network peer influence and the effects of covariates on the response, taking into account the dependence among units. While the model can be efficiently estimated with a Quasi maximum likelihood approach (QMLE), the detrimental effect of covariate measurement error on the QMLE and how to remedy it is currently unknown. If covariates are measured with error, then the QMLE may not have the $\sqrt{n}$ convergence and may even be inconsistent even when a node is influenced by only a limited number of other nodes or spatial units. We develop a measurement error-corrected ML estimator (ME-QMLE) for the parameters of the SAR model when covariates are measured with error. The ME-QMLE possesses statistical consistency and asymptotic normality properties and we derive its limiting covariance. We consider two types of applications. The first is when the true covariate is imprecisely measured with replicated measurements or cannot be measured directly, and a proxy is observed instead. The second one involves including latent homophily factors estimated with error from the network for estimating peer influence. Our numerical results verify the bias correction property of the estimator and the accuracy of the standard error estimates in finite samples. We illustrate the method on two real datasets; i) peer influence in GPA for middle school students in New Jersey and ii) county-level death rates from the COVID-19 pandemic.
△ Less
Submitted 6 August, 2024; v1 submitted 7 February, 2024;
originally announced February 2024.
-
Fair Interval Scheduling of Indivisible Chores
Authors:
Sarfaraz Equbal,
Rohit Gurjar,
Yatharth Kumar,
Swaprava Nath,
Rohit Vaish
Abstract:
We study the problem of fairly assigning a set of discrete tasks (or chores) among a set of agents with additive valuations. Each chore is associated with a start and finish time, and each agent can perform at most one chore at any given time. The goal is to find a fair and efficient schedule of the chores, where fairness pertains to satisfying envy-freeness up to one chore (EF1) and efficiency pe…
▽ More
We study the problem of fairly assigning a set of discrete tasks (or chores) among a set of agents with additive valuations. Each chore is associated with a start and finish time, and each agent can perform at most one chore at any given time. The goal is to find a fair and efficient schedule of the chores, where fairness pertains to satisfying envy-freeness up to one chore (EF1) and efficiency pertains to maximality (i.e., no unallocated chore can be feasibly assigned to any agent). Our main result is a polynomial-time algorithm for computing an EF1 and maximal schedule for two agents under monotone valuations when the conflict constraints constitute an arbitrary interval graph. The algorithm uses a coloring technique in interval graphs that may be of independent interest. For an arbitrary number of agents, we provide an algorithm for finding a fair schedule under identical dichotomous valuations when the constraints constitute a path graph. We also show that stronger fairness and efficiency properties, including envy-freeness up to any chore (EFX) along with maximality and EF1 along with Pareto optimality, cannot be achieved.
△ Less
Submitted 6 February, 2024;
originally announced February 2024.
-
Deep Learning Based Cyberbullying Detection in Bangla Language
Authors:
Sristy Shidul Nath,
Razuan Karim,
Mahdi H. Miraz
Abstract:
The Internet is currently the largest platform for global communication including expressions of opinions, reviews, contents, images, videos and so forth. Moreover, social media has now become a very broad and highly engaging platform due to its immense popularity and swift adoption trend. Increased social networking, however, also has detrimental impacts on the society leading to a range of unwan…
▽ More
The Internet is currently the largest platform for global communication including expressions of opinions, reviews, contents, images, videos and so forth. Moreover, social media has now become a very broad and highly engaging platform due to its immense popularity and swift adoption trend. Increased social networking, however, also has detrimental impacts on the society leading to a range of unwanted phenomena, such as online assault, intimidation, digital bullying, criminality and trolling. Hence, cyberbullying has become a pervasive and worrying problem that poses considerable psychological and emotional harm to the people, particularly amongst the teens and the young adults. In order to lessen its negative effects and provide victims with prompt support, a great deal of research to identify cyberbullying instances at various online platforms is emerging. In comparison to other languages, Bangla (also known as Bengali) has fewer research studies in this domain. This study demonstrates a deep learning strategy for identifying cyberbullying in Bengali, using a dataset of 12282 versatile comments from multiple social media sites. In this study, a two-layer bidirectional long short-term memory (Bi-LSTM) model has been built to identify cyberbullying, using a variety of optimisers as well as 5-fold cross validation. To evaluate the functionality and efficacy of the proposed system, rigorous assessment and validation procedures have been employed throughout the project. The results of this study reveals that the proposed model's accuracy, using momentum-based stochastic gradient descent (SGD) optimiser, is 94.46%. It also reflects a higher accuracy of 95.08% and a F1 score of 95.23% using Adam optimiser as well as a better accuracy of 94.31% in 5-fold cross validation.
△ Less
Submitted 6 January, 2024;
originally announced January 2024.
-
Spectral Temporal Contrastive Learning
Authors:
Sacha Morin,
Somjit Nath,
Samira Ebrahimi Kahou,
Guy Wolf
Abstract:
Learning useful data representations without requiring labels is a cornerstone of modern deep learning. Self-supervised learning methods, particularly contrastive learning (CL), have proven successful by leveraging data augmentations to define positive pairs. This success has prompted a number of theoretical studies to better understand CL and investigate theoretical bounds for downstream linear p…
▽ More
Learning useful data representations without requiring labels is a cornerstone of modern deep learning. Self-supervised learning methods, particularly contrastive learning (CL), have proven successful by leveraging data augmentations to define positive pairs. This success has prompted a number of theoretical studies to better understand CL and investigate theoretical bounds for downstream linear probing tasks. This work is concerned with the temporal contrastive learning (TCL) setting where the sequential structure of the data is used instead to define positive pairs, which is more commonly used in RL and robotics contexts. In this paper, we adapt recent work on Spectral CL to formulate Spectral Temporal Contrastive Learning (STCL). We discuss a population loss based on a state graph derived from a time-homogeneous reversible Markov chain with uniform stationary distribution. The STCL loss enables to connect the linear probing performance to the spectral properties of the graph, and can be estimated by considering previously observed data sequences as an ensemble of MCMC chains.
△ Less
Submitted 7 December, 2023; v1 submitted 1 December, 2023;
originally announced December 2023.
-
First results of evaporation residue cross-section measurements of $^{32}$S+$^{208}$Pb system
Authors:
R. Sariyal,
I. Mazumdar,
D. Mehta,
N. Madhavan,
S. Nath,
J. Gehlot,
Gonika,
S. M. Patel,
P. B. Chavan,
S. Panwar,
V. Ranga,
A. Parihari
Abstract:
The dynamics of heavy ion-induced reactions play a critical role in forming super heavy elements (SHE), and one clear signature of the SHE formation is the evaporation residue (ER). In our pursuit of SHE, we present the heaviest element populated in India for ER cross-section measurements. These are the first-ever measurements of the Evaporation Residue (ER) cross-sections for the nuclear reaction…
▽ More
The dynamics of heavy ion-induced reactions play a critical role in forming super heavy elements (SHE), and one clear signature of the SHE formation is the evaporation residue (ER). In our pursuit of SHE, we present the heaviest element populated in India for ER cross-section measurements. These are the first-ever measurements of the Evaporation Residue (ER) cross-sections for the nuclear reactions between $^{32}$S and $^{208}$Pb. These measurements were conducted above the Coulomb barrier at four distinct beam energies in the laboratory frame, ranging from 176 to 191 MeV at the pelletron Linac facility at the Inter-University Accelerator Centre (IUAC), New Delhi. The Hybrid Recoil Mass Analyzer (HYRA) in a gas-filled mode was employed for these experiments. The obtained range of ER cross-sections enriches our knowledge and helps advance the field of heavy ion-induced reactions, especially in the context of super heavy element formation.
△ Less
Submitted 29 November, 2023; v1 submitted 29 November, 2023;
originally announced November 2023.
-
Reinforcement Replaces Supervision: Query focused Summarization using Deep Reinforcement Learning
Authors:
Swaroop Nath,
Harshad Khadilkar,
Pushpak Bhattacharyya
Abstract:
Query-focused Summarization (QfS) deals with systems that generate summaries from document(s) based on a query. Motivated by the insight that Reinforcement Learning (RL) provides a generalization to Supervised Learning (SL) for Natural Language Generation, and thereby performs better (empirically) than SL, we use an RL-based approach for this task of QfS. Additionally, we also resolve the conflict…
▽ More
Query-focused Summarization (QfS) deals with systems that generate summaries from document(s) based on a query. Motivated by the insight that Reinforcement Learning (RL) provides a generalization to Supervised Learning (SL) for Natural Language Generation, and thereby performs better (empirically) than SL, we use an RL-based approach for this task of QfS. Additionally, we also resolve the conflict of employing RL in Transformers with Teacher Forcing. We develop multiple Policy Gradient networks, trained on various reward signals: ROUGE, BLEU, and Semantic Similarity, which lead to a 10-point improvement over the State-of-the-Art approach on the ROUGE-L metric for a benchmark dataset (ELI5). We also show performance of our approach in zero-shot setting for another benchmark dataset (DebatePedia) -- our approach leads to results comparable to baselines, which were specifically trained on DebatePedia. To aid the RL training, we propose a better semantic similarity reward, enabled by a novel Passage Embedding scheme developed using Cluster Hypothesis. Lastly, we contribute a gold-standard test dataset to further research in QfS and Long-form Question Answering (LfQA).
△ Less
Submitted 29 November, 2023;
originally announced November 2023.
-
Enhancement of spin to charge conversion efficiency at the topological surface state by inserting normal metal spacer layer in the topological insulator based heterostructure
Authors:
Sayani Pal,
Anuvab Nandi,
Shambhu G. Nath,
Pratap Kumar Pal,
Kanav Sharma,
Subhadip Manna,
Anjan Barman,
Chiranjib Mitra
Abstract:
We report efficient spin to charge conversion (SCC) in the topological insulator (TI) based heterostructure ($BiSbTe_{1.5}Se_{1.5}/Cu/Ni_{80}Fe_{20}$) by using spin-pumping technique where $BiSbTe_{1.5}Se_{1.5}$ is the TI and $Ni_{80}Fe_{20}$ is the ferromagnetic layer. The SCC, characterized by inverse Edelstein effect length ($λ_{IEE}$) in the TI material gets altered with an intervening Copper…
▽ More
We report efficient spin to charge conversion (SCC) in the topological insulator (TI) based heterostructure ($BiSbTe_{1.5}Se_{1.5}/Cu/Ni_{80}Fe_{20}$) by using spin-pumping technique where $BiSbTe_{1.5}Se_{1.5}$ is the TI and $Ni_{80}Fe_{20}$ is the ferromagnetic layer. The SCC, characterized by inverse Edelstein effect length ($λ_{IEE}$) in the TI material gets altered with an intervening Copper (Cu) layer and it depends on the interlayer thickness. The introduction of Cu layer at the interface of TI and ferromagnetic metal (FM) provides a new degree of freedom for tuning the SCC efficiency of the topological surface states. The significant enhancement of the measured spin-pumping voltage and the linewidth of ferromagnetic resonance (FMR) absorption spectra due to the insertion of Cu layer at the interface indicates a reduction in spin memory loss at the interface that resulted from the presence of exchange coupling between the surface states of TI and the local moments of ferromagnetic metal. The temperature dependence (from 8K to 300K) of the evaluated $λ_{IEE}$ data for all the trilayer systems, TI/Cu/FM with different Cu thickness confirms the effect of exchange coupling between the TI and FM layer on the spin to charge conversion efficiency of the topological surface state.
△ Less
Submitted 17 November, 2023;
originally announced November 2023.
-
Measurements of evaporation residue cross-sections and evaporation residue-gated $γ$-ray fold distributions for $^{32}$S+$^{154}$Sm system
Authors:
R. Sariyal,
I. Mazumdar,
D. Mehta,
N. Madhvan,
S. Nath,
J. Gehlot,
Gonika,
S. M. Patel,
P. B. Chavan,
S. Panwar,
V. Ranga,
A. Parihari,
A. K. Nasirov,
B. M. Kayumov
Abstract:
Evaporation Residue (ER) cross-sections and ER-gated $γ$-ray fold distributions are measured for the $^{32}$S + $^{154}$Sm nuclear reaction above the Coulomb barrier at six different beam energies from 148 to 191 MeV. $γ$-ray multiplicities and spin distributions are extracted from the ER-gated fold distributions. The ER cross-sections measured in the present work are found to be much higher than…
▽ More
Evaporation Residue (ER) cross-sections and ER-gated $γ$-ray fold distributions are measured for the $^{32}$S + $^{154}$Sm nuclear reaction above the Coulomb barrier at six different beam energies from 148 to 191 MeV. $γ$-ray multiplicities and spin distributions are extracted from the ER-gated fold distributions. The ER cross-sections measured in the present work are found to be much higher than what was reported in a previous work using a very different target-projectile ($^{48}$Ti + $^{138}$Ba) combination, leading to the same compound nucleus $^{186}$Pt, with much less mass asymmetry in the entrance channel than the present reaction. This clearly demonstrates the effect of the entrance channel on ER production cross-section. The ER cross-sections measured in the present work are compared with the results of both the statistical model calculations and the dynamical model calculations. Statistical model calculations have been performed to generate a range of parameter space for both the barrier height and Kramers' viscosity parameter over which the ER cross-section data can be reproduced. The calculations performed using the dinuclear system (DNS) model reproduce the data considering both complete and incomplete fusion processes. DNS calculations indicate the need for the inclusion of incomplete fusion channel at higher energies to reproduce the ER cross-sections.
△ Less
Submitted 15 November, 2023;
originally announced November 2023.
-
A Gale-Shapley View of Unique Stable Marriages
Authors:
Kartik Gokhale,
Amit Kumar Mallik,
Ankit Kumar Misra,
Swaprava Nath
Abstract:
Stable marriage of a two-sided market with unit demand is a classic problem that arises in many real-world scenarios. In addition, a unique stable marriage in this market simplifies a host of downstream desiderata. In this paper, we explore a new set of sufficient conditions for unique stable matching (USM) under this setup. Unlike other approaches that also address this question using the structu…
▽ More
Stable marriage of a two-sided market with unit demand is a classic problem that arises in many real-world scenarios. In addition, a unique stable marriage in this market simplifies a host of downstream desiderata. In this paper, we explore a new set of sufficient conditions for unique stable matching (USM) under this setup. Unlike other approaches that also address this question using the structure of preference profiles, we use an algorithmic viewpoint and investigate if this question can be answered using the lens of the deferred acceptance (DA) algorithm (Gale and Shapley, 1962). Our results yield a set of sufficient conditions for USM (viz., MaxProp and MaxRou) and show that these are disjoint from the previously known sufficiency conditions like sequential preference and no crossing. We also provide a characterization of MaxProp that makes it efficiently verifiable, and shows the gap between MaxProp and the entire USM class. These results give a more detailed view of the sub-structures of the USM class.
△ Less
Submitted 2 August, 2024; v1 submitted 28 October, 2023;
originally announced October 2023.
-
MAXI J0637-430: A Possible Candidate for Bulk Motion Comptonization?
Authors:
Kaushik Chatterjee,
Dipak Debnath,
Sujoy Kumar Nath,
Hsiang-Kuang Chang
Abstract:
The transient Galactic black hole candidate MAXI J0637-430 went through an outburst in 2019--20 for the very first time. This outburst was active for almost 6 months from November 2019 to May 2020. We study the spectral properties of this source during that outburst using archival data from NICER, Swift, and NuSTAR satellites/instruments. We have analyzed the source during 6 epochs on which simult…
▽ More
The transient Galactic black hole candidate MAXI J0637-430 went through an outburst in 2019--20 for the very first time. This outburst was active for almost 6 months from November 2019 to May 2020. We study the spectral properties of this source during that outburst using archival data from NICER, Swift, and NuSTAR satellites/instruments. We have analyzed the source during 6 epochs on which simultaneous NICER--NuSTAR and Swift/XRT--NuSTAR data were available. Using both phenomenological and physical model fitting approaches, we analyzed the spectral data in the broad $0.7-70$ keV energy band. We first used a combination of disk blackbody with power-law, disk blackbody with broken power-law, and disk blackbody with power-law and bmc models. For a better understanding of the accretion picture, e.g., understanding how the accretion rates change with the changing size of the perceived Compton cloud, we used the two-component advective flow (TCAF) model with broken power-law, TCAF with power-law and bmc models. For last 3 epochs, the diskbb+power-law and TCAF models were able to spectrally fit the data for acceptable $χ^2/DOF$. However, for the first 3 epochs, we needed an additional component to fit spectra for acceptable $χ^2/DOF$. From our analysis, we reported about the possible presence of another component during these first 3 epochs when the source was in the high soft state. This additional component in this state is best described by the bulk motion Comptonization phenomenon. From the TCAF model fitting, we estimated the average mass of the source as $8.1^{+1.3}_{-2.7}~M_\odot$.
△ Less
Submitted 8 September, 2023;
originally announced September 2023.
-
Is the glassy dynamics same in 2D as in 3D? The Adam Gibbs relation test
Authors:
Santu Nath,
Shiladitya Sengupta
Abstract:
It has been recognized of late that even amorphous, glass-forming materials in two dimensions (2D) are significantly affected by Mermin-Wagner type long wavelength thermal fluctuation which is inconsequential in three (3D) and higher dimensions. Thus any study of glassy dynamics in 2D should first remove the effect of such fluctuations. The present work considers the question of whether the role o…
▽ More
It has been recognized of late that even amorphous, glass-forming materials in two dimensions (2D) are significantly affected by Mermin-Wagner type long wavelength thermal fluctuation which is inconsequential in three (3D) and higher dimensions. Thus any study of glassy dynamics in 2D should first remove the effect of such fluctuations. The present work considers the question of whether the role of spatial dimension on glassy dynamics is only limited to such fluctuations, or whether the nature of glassy dynamics is intrinsically different in 2D. We address this issue by studying the relationship between dynamics and thermodynamics within the framework of the Adam-Gibbs (AG) relation and its generalization the Random First Order Transition (RFOT) theory. Using two model glass-forming liquids we find that even after removing the effect of long wavelength fluctuations, the AG relation breaks down in two dimensions. Then we consider the effect of anharmonicity of vibrational entropy - a second factor highlighted recently that can qualitatively change the nature of dynamics. We explicitly compute the configurational entropy both with and without the anharmonic correction. We show that the anharmonic correction reduces the extent of deviation from the AG relation, but even after taking into account its effects, the AG relation still breaks down in 2D. It is also more prominent if one considers diffusion coefficient rather than $α$-relaxation time. Overall, the impact of the anharmonicity of vibration is larger than the long wavelength fluctuation in determining the qualitative relation between timescales and entropy. The extent and nature of deviation from the AG relation crucially depends on the attractive vs. repulsive nature of the inter-particle interaction. Thus our results suggest that the glassy dynamics in 2D may be intrinsically different from that in 3D.
△ Less
Submitted 16 August, 2023;
originally announced August 2023.
-
The free energy of the large-$N$ fermionic Chern$\small-$Simons theory in the 'temporal' gauge
Authors:
Shiraz Minwalla,
Souparna Nath,
Nikhil Tanwar,
Vatsal
Abstract:
Most of the computational evidence for the Bose$\small-$Fermi duality of fundamental fields coupled to $U(N)$ Chern$\small-$Simons theories originates in the large-$N$ calculations performed in the light-cone gauge. In this paper, we use another gauge, the 'temporal' gauge, to evaluate the finite temperature partition function of $U(N)$ coupled regular and critical fermions on $\mathbb{R}^2$ at la…
▽ More
Most of the computational evidence for the Bose$\small-$Fermi duality of fundamental fields coupled to $U(N)$ Chern$\small-$Simons theories originates in the large-$N$ calculations performed in the light-cone gauge. In this paper, we use another gauge, the 'temporal' gauge, to evaluate the finite temperature partition function of $U(N)$ coupled regular and critical fermions on $\mathbb{R}^2$ at large $N$. We first set up the finite temperature gap equations, and then use tricks explored in arXiv:1410.0558 to solve these equations and evaluate the partition function. Our final results are in perfect agreement with earlier light-cone gauge results. The success of our 'temporal' gauge calculation potentially opens a path to computations that are awkward in light-cone gauge but more natural in the 'temporal' gauge, e.g. the evaluation of the thermal free energy on a finite-sized sphere.
△ Less
Submitted 20 July, 2023;
originally announced July 2023.
-
Disentangling Societal Inequality from Model Biases: Gender Inequality in Divorce Court Proceedings
Authors:
Sujan Dutta,
Parth Srivastava,
Vaishnavi Solunke,
Swaprava Nath,
Ashiqur R. KhudaBukhsh
Abstract:
Divorce is the legal dissolution of a marriage by a court. Since this is usually an unpleasant outcome of a marital union, each party may have reasons to call the decision to quit which is generally documented in detail in the court proceedings. Via a substantial corpus of 17,306 court proceedings, this paper investigates gender inequality through the lens of divorce court proceedings. While emerg…
▽ More
Divorce is the legal dissolution of a marriage by a court. Since this is usually an unpleasant outcome of a marital union, each party may have reasons to call the decision to quit which is generally documented in detail in the court proceedings. Via a substantial corpus of 17,306 court proceedings, this paper investigates gender inequality through the lens of divorce court proceedings. While emerging data sources (e.g., public court records) on sensitive societal issues hold promise in aiding social science research, biases present in cutting-edge natural language processing (NLP) methods may interfere with or affect such studies. We thus require a thorough analysis of potential gaps and limitations present in extant NLP resources. In this paper, on the methodological side, we demonstrate that existing NLP resources required several non-trivial modifications to quantify societal inequalities. On the substantive side, we find that while a large number of court cases perhaps suggest changing norms in India where women are increasingly challenging patriarchy, AI-powered analyses of these court proceedings indicate striking gender inequality with women often subjected to domestic violence.
△ Less
Submitted 8 July, 2023;
originally announced July 2023.
-
Accretion Flow Properties of EXO 1846-031 During its Multi-Peaked Outburst After Long Quiescence
Authors:
Sujoy Kumar Nath,
Dipak Debnath,
Kaushik Chatterjee,
Riya Bhowmick,
Hsiang-Kuang Chang,
Sandip K. Chakrabarti
Abstract:
We study the recent outburst of the black hole candidate EXO 1846-031 which went into an outburst in 2019 after almost 34 years in quiescence. We use archival data from Swift/XRT, MAXI/GSC, NICER/XTI and NuSTAR/FPM satellites/instruments to study the evolution of the spectral and temporal properties of the source during the outburst. Low energy (2-10 keV) X-ray flux of the outburst shows multiple…
▽ More
We study the recent outburst of the black hole candidate EXO 1846-031 which went into an outburst in 2019 after almost 34 years in quiescence. We use archival data from Swift/XRT, MAXI/GSC, NICER/XTI and NuSTAR/FPM satellites/instruments to study the evolution of the spectral and temporal properties of the source during the outburst. Low energy (2-10 keV) X-ray flux of the outburst shows multiple peaks making it a multipeak outburst. Evolving type-C quasi-periodic oscillations (QPOs) are observed in the NICER data in the hard, hard intermediate and soft intermediate states. We use the physical Two Component Advective Flow (TCAF) model to analyze the combined spectra of multiple satellite instruments. According to the TCAF model, the accreting matter is divided into Keplerian and sub-Keplerian parts, and the variation in the observed spectra in different spectral states arises out of the variable contributions of these two types of accreting matter in the total accretion rate. Studying the evolution of the accretion rates and other properties of the accretion flow obtained from the spectral analysis, we show how the multiple peaks in the outburst flux arises out of variable supply of accreting matter from the pile-up radius. We determine the probable mass of the black hole to be $10.4^{+0.1}_{-0.2}~M_\odot$ from the spectral analysis with the TCAF model. We also estimate viscous time scale of the source in this outburst to be $\sim 8$ days from the peak difference of the Keplerian and sub-Keplerian mass accretion rates.
△ Less
Submitted 6 June, 2024; v1 submitted 10 July, 2023;
originally announced July 2023.
-
CAMMARL: Conformal Action Modeling in Multi Agent Reinforcement Learning
Authors:
Nikunj Gupta,
Somjit Nath,
Samira Ebrahimi Kahou
Abstract:
Before taking actions in an environment with more than one intelligent agent, an autonomous agent may benefit from reasoning about the other agents and utilizing a notion of a guarantee or confidence about the behavior of the system. In this article, we propose a novel multi-agent reinforcement learning (MARL) algorithm CAMMARL, which involves modeling the actions of other agents in different situ…
▽ More
Before taking actions in an environment with more than one intelligent agent, an autonomous agent may benefit from reasoning about the other agents and utilizing a notion of a guarantee or confidence about the behavior of the system. In this article, we propose a novel multi-agent reinforcement learning (MARL) algorithm CAMMARL, which involves modeling the actions of other agents in different situations in the form of confident sets, i.e., sets containing their true actions with a high probability. We then use these estimates to inform an agent's decision-making. For estimating such sets, we use the concept of conformal predictions, by means of which, we not only obtain an estimate of the most probable outcome but get to quantify the operable uncertainty as well. For instance, we can predict a set that provably covers the true predictions with high probabilities (e.g., 95%). Through several experiments in two fully cooperative multi-agent tasks, we show that CAMMARL elevates the capabilities of an autonomous agent in MARL by modeling conformal prediction sets over the behavior of other agents in the environment and utilizing such estimates to enhance its policy learning.
△ Less
Submitted 8 February, 2024; v1 submitted 19 June, 2023;
originally announced June 2023.
-
Sharing Lifelong Reinforcement Learning Knowledge via Modulating Masks
Authors:
Saptarshi Nath,
Christos Peridis,
Eseoghene Ben-Iwhiwhu,
Xinran Liu,
Shirin Dora,
Cong Liu,
Soheil Kolouri,
Andrea Soltoggio
Abstract:
Lifelong learning agents aim to learn multiple tasks sequentially over a lifetime. This involves the ability to exploit previous knowledge when learning new tasks and to avoid forgetting. Modulating masks, a specific type of parameter isolation approach, have recently shown promise in both supervised and reinforcement learning. While lifelong learning algorithms have been investigated mainly withi…
▽ More
Lifelong learning agents aim to learn multiple tasks sequentially over a lifetime. This involves the ability to exploit previous knowledge when learning new tasks and to avoid forgetting. Modulating masks, a specific type of parameter isolation approach, have recently shown promise in both supervised and reinforcement learning. While lifelong learning algorithms have been investigated mainly within a single-agent approach, a question remains on how multiple agents can share lifelong learning knowledge with each other. We show that the parameter isolation mechanism used by modulating masks is particularly suitable for exchanging knowledge among agents in a distributed and decentralized system of lifelong learners. The key idea is that the isolation of specific task knowledge to specific masks allows agents to transfer only specific knowledge on-demand, resulting in robust and effective distributed lifelong learning. We assume fully distributed and asynchronous scenarios with dynamic agent numbers and connectivity. An on-demand communication protocol ensures agents query their peers for specific masks to be transferred and integrated into their policies when facing each task. Experiments indicate that on-demand mask communication is an effective way to implement distributed lifelong reinforcement learning and provides a lifelong learning benefit with respect to distributed RL baselines such as DD-PPO, IMPALA, and PPO+EWC. The system is particularly robust to connection drops and demonstrates rapid learning due to knowledge exchange.
△ Less
Submitted 18 May, 2023;
originally announced May 2023.
-
On the Collaborative Object Transportation Using Leader Follower Approach
Authors:
Sumanta Ghosh,
Subhajit Nath,
Sarvesh Sortee,
Lokesh Kumar,
Titas Bera
Abstract:
In this paper we address the multi-agent collaborative object transportation problem in a partially known environment with obstacles under a specified goal condition. We propose a leader follower approach for two mobile manipulators collaboratively transporting an object along specified desired trajectories. The proposed approach treats the mobile manipulation system as two independent subsystems:…
▽ More
In this paper we address the multi-agent collaborative object transportation problem in a partially known environment with obstacles under a specified goal condition. We propose a leader follower approach for two mobile manipulators collaboratively transporting an object along specified desired trajectories. The proposed approach treats the mobile manipulation system as two independent subsystems: a mobile platform and a manipulator arm and uses their kinematics model for trajectory tracking. In this work we considered that the mobile platform is subject to non-holonomic constraints, with a manipulator carrying a rigid load. The desired trajectories of the end points of the load are obtained from Probabilistic RoadMap-based planning approach. Our method combines Proportional Navigation Guidance-based approach with a proposed Stop-and-Sync algorithm to reach sufficiently close to the desired trajectory, the deviation due to the non-holonomic constraints is compensated by the manipulator arm. A leader follower approach for computing inverse kinematics solution for the position of the end-effector of the manipulator arm is proposed to maintain the load rigidity. Further, we compare the proposed approach with other approaches to analyse the efficacy of our algorithm.
△ Less
Submitted 2 May, 2023;
originally announced May 2023.
-
Discovering Object-Centric Generalized Value Functions From Pixels
Authors:
Somjit Nath,
Gopeshh Raaj Subbaraj,
Khimya Khetarpal,
Samira Ebrahimi Kahou
Abstract:
Deep Reinforcement Learning has shown significant progress in extracting useful representations from high-dimensional inputs albeit using hand-crafted auxiliary tasks and pseudo rewards. Automatically learning such representations in an object-centric manner geared towards control and fast adaptation remains an open research problem. In this paper, we introduce a method that tries to discover mean…
▽ More
Deep Reinforcement Learning has shown significant progress in extracting useful representations from high-dimensional inputs albeit using hand-crafted auxiliary tasks and pseudo rewards. Automatically learning such representations in an object-centric manner geared towards control and fast adaptation remains an open research problem. In this paper, we introduce a method that tries to discover meaningful features from objects, translating them to temporally coherent "question" functions and leveraging the subsequent learned general value functions for control. We compare our approach with state-of-the-art techniques alongside other ablations and show competitive performance in both stationary and non-stationary settings. Finally, we also investigate the discovered general value functions and through qualitative analysis show that the learned representations are not only interpretable but also, centered around objects that are invariant to changes across tasks facilitating fast adaptation.
△ Less
Submitted 27 June, 2023; v1 submitted 26 April, 2023;
originally announced April 2023.
-
Irregular dependence on Stokes number and non-ergodic transport of heavy inertial particles in steady laminar flows
Authors:
Anu V. S. Nath,
Anubhab Roy,
S. Ravichandran,
Rama Govindarajan
Abstract:
Small heavy particles in a fluid flow respond to the flow on a time-scale proportional to their inertia, or Stokes number St. Their behaviour is thought to be gradually modified as St increases. We show, in the steady spatially-periodic laminar Taylor-Green flow, that particle dynamics, and their effective diffusivity, actually change in an irregular, non-monotonic and sometimes discontinuous mann…
▽ More
Small heavy particles in a fluid flow respond to the flow on a time-scale proportional to their inertia, or Stokes number St. Their behaviour is thought to be gradually modified as St increases. We show, in the steady spatially-periodic laminar Taylor-Green flow, that particle dynamics, and their effective diffusivity, actually change in an irregular, non-monotonic and sometimes discontinuous manner, with increasing St. At Stokes of order one, we show chaotic particle motion, contrasting earlier conclusions for heavy particles in the same flow (Wang et al. 1992). Particles may display trapped orbits, or unbounded diffusive or ballistic dispersion, with the vortices behaving like scatterers in a soft Lorentz gas (Klages et al. 2019). The dynamics is non-ergodic. We discuss the possible consequences of our findings for particulate turbulent flows.
△ Less
Submitted 19 April, 2023;
originally announced April 2023.
-
Experimental investigation of the effect of topological insulator on the magnetization dynamics of ferromagnetic metal: $BiSbTe_{1.5}Se_{1.5}$ and $Ni_{80}Fe_{20}$ heterostructure
Authors:
Sayani Pal,
Soumik Aon,
Subhadip Manna,
Sambhu G Nath,
Kanav Sharma,
Chiranjib Mitra
Abstract:
We have studied ferromagnetic metal/topological insulator bilayer system to understand magnetization dynamics of ferromagnetic metal (FM) in contact with a topological insulator (TI). At magnetic resonance condition, the precessing magnetization in the metallic ferromagnet ($Ni_{80}Fe_{20}$) injects spin current into the topological insulator ($BiSbTe_{1.5}Se_{1.5}$), a phenomenon known as spin-pu…
▽ More
We have studied ferromagnetic metal/topological insulator bilayer system to understand magnetization dynamics of ferromagnetic metal (FM) in contact with a topological insulator (TI). At magnetic resonance condition, the precessing magnetization in the metallic ferromagnet ($Ni_{80}Fe_{20}$) injects spin current into the topological insulator ($BiSbTe_{1.5}Se_{1.5}$), a phenomenon known as spin-pumping. Due to the spin pumping effect, fast relaxation in the ferromagnet results in the broadening of ferromagnetic resonance linewidth ($ΔH$). We evaluated the parameters like effective Gilbert damping coefficient ($α_{eff}$), spin-mixing conductance ($g_{eff}^{\uparrow \downarrow}$) and spin current density ($j_S^0$) to confirm a successful spin injection due to spin-pumping into the $BiSbTe_{1.5}Se_{1.5}$ layer. TIs embody a spin-momentum locked surface state that span the bulk band-gap. It can act differently to the FM magnetization than the other normal metals. To probe the effect of topological surface state, a systematic low temperature study is crucial as surface state of TI dominates at lower temperatures. The exponential growth of $ΔH$ for all different thickness combination of FM/TI bilayers and effective Gilbert damping coefficient ($α_{eff}$) with lowering temperature confirms the prediction that spin chemical bias generated from spin-pumping induces surface current in TI due to spin-momentum locking. The hump-like feature of magnetic anisotropy field ($H_K$)of the bilayer around 60K suggests that the decrease of interfacial in-plane magnetic anisotropy can result from exchange coupling between the TI surface state and the local moments of FM layer.
△ Less
Submitted 24 November, 2023; v1 submitted 13 March, 2023;
originally announced March 2023.
-
Lifelong Reinforcement Learning with Modulating Masks
Authors:
Eseoghene Ben-Iwhiwhu,
Saptarshi Nath,
Praveen K. Pilly,
Soheil Kolouri,
Andrea Soltoggio
Abstract:
Lifelong learning aims to create AI systems that continuously and incrementally learn during a lifetime, similar to biological learning. Attempts so far have met problems, including catastrophic forgetting, interference among tasks, and the inability to exploit previous knowledge. While considerable research has focused on learning multiple supervised classification tasks that involve changes in t…
▽ More
Lifelong learning aims to create AI systems that continuously and incrementally learn during a lifetime, similar to biological learning. Attempts so far have met problems, including catastrophic forgetting, interference among tasks, and the inability to exploit previous knowledge. While considerable research has focused on learning multiple supervised classification tasks that involve changes in the input distribution, lifelong reinforcement learning (LRL) must deal with variations in the state and transition distributions, and in the reward functions. Modulating masks with a fixed backbone network, recently developed for classification, are particularly suitable to deal with such a large spectrum of task variations. In this paper, we adapted modulating masks to work with deep LRL, specifically PPO and IMPALA agents. The comparison with LRL baselines in both discrete and continuous RL tasks shows superior performance. We further investigated the use of a linear combination of previously learned masks to exploit previous knowledge when learning new tasks: not only is learning faster, the algorithm solves tasks that we could not otherwise solve from scratch due to extremely sparse rewards. The results suggest that RL with modulating masks is a promising approach to lifelong learning, to the composition of knowledge to learn increasingly complex tasks, and to knowledge reuse for efficient and faster learning.
△ Less
Submitted 1 August, 2023; v1 submitted 21 December, 2022;
originally announced December 2022.
-
Locally Constrained Representations in Reinforcement Learning
Authors:
Somjit Nath,
Rushiv Arora,
Samira Ebrahimi Kahou
Abstract:
The success of Reinforcement Learning (RL) heavily relies on the ability to learn robust representations from the observations of the environment. In most cases, the representations learned purely by the reinforcement learning loss can differ vastly across states depending on how the value functions change. However, the representations learned need not be very specific to the task at hand. Relying…
▽ More
The success of Reinforcement Learning (RL) heavily relies on the ability to learn robust representations from the observations of the environment. In most cases, the representations learned purely by the reinforcement learning loss can differ vastly across states depending on how the value functions change. However, the representations learned need not be very specific to the task at hand. Relying only on the RL objective may yield representations that vary greatly across successive time steps. In addition, since the RL loss has a changing target, the representations learned would depend on how good the current values/policies are. Thus, disentangling the representations from the main task would allow them to focus not only on the task-specific features but also the environment dynamics. To this end, we propose locally constrained representations, where an auxiliary loss forces the state representations to be predictable by the representations of the neighboring states. This encourages the representations to be driven not only by the value/policy learning but also by an additional loss that constrains the representations from over-fitting to the value loss. We evaluate the proposed method on several known benchmarks and observe strong performance. Especially in continuous control tasks, our experiments show a significant performance improvement.
△ Less
Submitted 8 February, 2024; v1 submitted 19 September, 2022;
originally announced September 2022.
-
Properties of MAXI J1348-630 during Its Second Outburst in 2019
Authors:
Riya Bhowmick,
Dipak Debnath,
Kaushik Chatterjee,
Arghajit Jana,
Sujoy Kumar Nath
Abstract:
The newly discovered galactic black hole candidate (BHC) MAXI~J1348-630 showed two major outbursts in 2019, just after its discovery. Here, we provide a detailed spectral and temporal analysis of the less-studied second outburst using archive data from multiple satellites, namely Swift, MAXI, NICER, NuSTAR and AstroSat. The outburst continued for around two and a half months. Unlike the first outb…
▽ More
The newly discovered galactic black hole candidate (BHC) MAXI~J1348-630 showed two major outbursts in 2019, just after its discovery. Here, we provide a detailed spectral and temporal analysis of the less-studied second outburst using archive data from multiple satellites, namely Swift, MAXI, NICER, NuSTAR and AstroSat. The outburst continued for around two and a half months. Unlike the first outburst from this source, this second outburst was a `failed' one. The source did not transition to soft or intermediate spectral states. During the entire outburst, the source was in the hard state with high dominance of non-thermal photons. The presence of strong shocks are inferred from spectral fitting using a TCAF model. In NuSTAR spectra, weak reflection is observed from spectral fitting. Low-frequency quasi-periodic oscillations are also detected in AstroSat data.
△ Less
Submitted 6 September, 2022;
originally announced September 2022.
-
Prioritizing Samples in Reinforcement Learning with Reducible Loss
Authors:
Shivakanth Sujit,
Somjit Nath,
Pedro H. M. Braga,
Samira Ebrahimi Kahou
Abstract:
Most reinforcement learning algorithms take advantage of an experience replay buffer to repeatedly train on samples the agent has observed in the past. Not all samples carry the same amount of significance and simply assigning equal importance to each of the samples is a naïve strategy. In this paper, we propose a method to prioritize samples based on how much we can learn from a sample. We define…
▽ More
Most reinforcement learning algorithms take advantage of an experience replay buffer to repeatedly train on samples the agent has observed in the past. Not all samples carry the same amount of significance and simply assigning equal importance to each of the samples is a naïve strategy. In this paper, we propose a method to prioritize samples based on how much we can learn from a sample. We define the learn-ability of a sample as the steady decrease of the training loss associated with this sample over time. We develop an algorithm to prioritize samples with high learn-ability, while assigning lower priority to those that are hard-to-learn, typically caused by noise or stochasticity. We empirically show that our method is more robust than random sampling and also better than just prioritizing with respect to the training loss, i.e. the temporal difference loss, which is used in prioritized experience replay.
△ Less
Submitted 1 November, 2023; v1 submitted 22 August, 2022;
originally announced August 2022.
-
Optimal Referral Auction Design
Authors:
Rangeet Bhattacharyya,
Parvik Dave,
Palash Dey,
Swaprava Nath
Abstract:
The auction of a single indivisible item is one of the most celebrated problems in mechanism design with transfers. Despite its simplicity, it provides arguably the cleanest and most insightful results in the literature. When the information that the auction is running is available to every participant, Myerson [20] provided a seminal result to characterize the incentive-compatible auctions along…
▽ More
The auction of a single indivisible item is one of the most celebrated problems in mechanism design with transfers. Despite its simplicity, it provides arguably the cleanest and most insightful results in the literature. When the information that the auction is running is available to every participant, Myerson [20] provided a seminal result to characterize the incentive-compatible auctions along with revenue optimality. However, such a result does not hold in an auction on a network, where the information of the auction is spread via the agents, and they need incentives to forward the information. In recent times, a few auctions (e.g., [13, 18]) were designed that appropriately incentivized the intermediate nodes on the network to promulgate the information to potentially more valuable bidders. In this paper, we provide a Myerson-like characterization of incentive-compatible auctions on a network and show that the currently known auctions fall within this class of randomized auctions. We then consider a special class called the referral auctions that are inspired by the multi-level marketing mechanisms [1, 6, 7] and obtain the structure of a revenue optimal referral auction for i.i.d. bidders. Through experiments, we show that even for non-i.i.d. bidders there exist auctions following this characterization that can provide a higher revenue than the currently known auctions on networks.
△ Less
Submitted 1 July, 2023; v1 submitted 19 August, 2022;
originally announced August 2022.
-
Identical Image Retrieval using Deep Learning
Authors:
Sayan Nath,
Nikhil Nayak
Abstract:
In recent years, we know that the interaction with images has increased. Image similarity involves fetching similar-looking images abiding by a given reference image. The target is to find out whether the image searched as a query can result in similar pictures. We are using the BigTransfer Model, which is a state-of-art model itself. BigTransfer(BiT) is essentially a ResNet but pre-trained on a l…
▽ More
In recent years, we know that the interaction with images has increased. Image similarity involves fetching similar-looking images abiding by a given reference image. The target is to find out whether the image searched as a query can result in similar pictures. We are using the BigTransfer Model, which is a state-of-art model itself. BigTransfer(BiT) is essentially a ResNet but pre-trained on a larger dataset like ImageNet and ImageNet-21k with additional modifications. Using the fine-tuned pre-trained Convolution Neural Network Model, we extract the key features and train on the K-Nearest Neighbor model to obtain the nearest neighbor. The application of our model is to find similar images, which are hard to achieve through text queries within a low inference time. We analyse the benchmark of our model based on this application.
△ Less
Submitted 18 May, 2022; v1 submitted 10 May, 2022;
originally announced May 2022.
-
Exploring Relevant Artifacts of Release Notes: The Practitioners' Perspective
Authors:
Sristy Sumana Nath,
Banani Roy
Abstract:
A software release note is one of the essential documents in the software development life cycle. The software release contains a set of information, e.g., bug fixes and security fixes. Release notes are used in different phases, e.g., requirement engineering, software testing and release management. Different types of practitioners (e.g., project managers and clients) get benefited from the relea…
▽ More
A software release note is one of the essential documents in the software development life cycle. The software release contains a set of information, e.g., bug fixes and security fixes. Release notes are used in different phases, e.g., requirement engineering, software testing and release management. Different types of practitioners (e.g., project managers and clients) get benefited from the release notes to understand the overview of the latest release. As a result, several studies have been done about release notes production and usage in practice. However, two significant problems (e.g., duplication and inconsistency in release notes contents) exist in producing well-written & well-structured release notes and organizing appropriate information regarding different targeted users' needs. For that reason, practitioners face difficulties in writing and reading the release notes using existing tools. To mitigate these problems, we execute two different studies in our paper. First, we execute an exploratory study by analyzing 3,347 release notes of 21 GitHub repositories to understand the documented contents of the release notes. As a result, we find relevant key artifacts, e.g., issues (29%), pull-requests (32%), commits (19%), and common vulnerabilities and exposures (CVE) issues (6%) in the release note contents. Second, we conduct a survey study with 32 professionals to understand the key information that is included in release notes regarding users' roles. For example, project managers are more interested in learning about new features than less critical bug fixes. Our study can guide future research directions to help practitioners produce the release notes with relevant content and improve the documentation quality.
△ Less
Submitted 11 April, 2022;
originally announced April 2022.
-
Towards Automatically Generating Release Notes using Extractive Summarization Technique
Authors:
Sristy Sumana Nath,
Banani Roy
Abstract:
Release notes are admitted as an essential document by practitioners. They contain the summary of the source code changes for the software releases, such as issue fixes, added new features, and performance improvements. Manually producing release notes is a time-consuming and challenging task. For that reason, sometimes developers neglect to write release notes. For example, we collect data from G…
▽ More
Release notes are admitted as an essential document by practitioners. They contain the summary of the source code changes for the software releases, such as issue fixes, added new features, and performance improvements. Manually producing release notes is a time-consuming and challenging task. For that reason, sometimes developers neglect to write release notes. For example, we collect data from GitHub with over 1,900 releases, among them 37% of the release notes are empty. We propose an automatic generate release notes approach based on the commit messages and merge pull-request (PR) titles to mitigate this problem. We implement one of the popular extractive text summarization techniques, i.e., the TextRank algorithm. However, accurate keyword extraction is a vital issue in text processing. The keyword matching and topic extraction process of the TextRank algorithm ignores the semantic similarity among texts. To improve the keyword extraction method, we integrate the GloVe word embedding technique with TextRank. We develop a dataset with 1,213 release notes (after null filtering) and evaluate the generated release notes through the ROUGE metric and human evaluation. We also compare the performance of our technique with another popular extractive algorithm, latent semantic analysis (LSA). Our evaluation results show that the improved TextRank method outperforms LSA.
△ Less
Submitted 11 April, 2022;
originally announced April 2022.
-
Identifying Peer Influence in Therapeutic Communities Adjusting for Latent Homophily
Authors:
Shanjukta Nath,
Keith Warren,
Subhadeep Paul
Abstract:
We investigate peer role model influence on successful graduation from Therapeutic Communities (TCs) for substance abuse and criminal behavior. We use data from 3 TCs that kept records of exchanges of affirmations among residents and their precise entry and exit dates, allowing us to form peer networks and define a causal effect of interest. The role model effect measures the difference in the exp…
▽ More
We investigate peer role model influence on successful graduation from Therapeutic Communities (TCs) for substance abuse and criminal behavior. We use data from 3 TCs that kept records of exchanges of affirmations among residents and their precise entry and exit dates, allowing us to form peer networks and define a causal effect of interest. The role model effect measures the difference in the expected outcome of a resident (ego) who can observe one of their peers graduate before the ego's exit vs not graduating. To identify peer influence in the presence of unobserved homophily in observational data, we model the network with a latent variable model. We show that our peer influence estimator is asymptotically unbiased when the unobserved latent positions are estimated from the observed network. We additionally propose a measurement error bias correction method to further reduce bias due to estimating latent positions. Our simulations show the proposed latent homophily adjustment and bias correction perform well in finite samples. We also extend the methodology to the case of binary response with a probit model. Our results indicate a positive effect of peers' graduation on residents' graduation and that it differs based on gender, race, and the definition of the role model effect. A counterfactual exercise quantifies the potential benefits of an intervention directly on the treated resident and indirectly on their peers through network propagation.
△ Less
Submitted 10 June, 2024; v1 submitted 27 March, 2022;
originally announced March 2022.
-
A Learning Based Framework for Handling Uncertain Lead Times in Multi-Product Inventory Management
Authors:
Hardik Meisheri,
Somjit Nath,
Mayank Baranwal,
Harshad Khadilkar
Abstract:
Most existing literature on supply chain and inventory management consider stochastic demand processes with zero or constant lead times. While it is true that in certain niche scenarios, uncertainty in lead times can be ignored, most real-world scenarios exhibit stochasticity in lead times. These random fluctuations can be caused due to uncertainty in arrival of raw materials at the manufacturer's…
▽ More
Most existing literature on supply chain and inventory management consider stochastic demand processes with zero or constant lead times. While it is true that in certain niche scenarios, uncertainty in lead times can be ignored, most real-world scenarios exhibit stochasticity in lead times. These random fluctuations can be caused due to uncertainty in arrival of raw materials at the manufacturer's end, delay in transportation, an unforeseen surge in demands, and switching to a different vendor, to name a few. Stochasticity in lead times is known to severely degrade the performance in an inventory management system, and it is only fair to abridge this gap in supply chain system through a principled approach. Motivated by the recently introduced delay-resolved deep Q-learning (DRDQN) algorithm, this paper develops a reinforcement learning based paradigm for handling uncertainty in lead times (\emph{action delay}). Through empirical evaluations, it is further shown that the inventory management with uncertain lead times is not only equivalent to that of delay in information sharing across multiple echelons (\emph{observation delay}), a model trained to handle one kind of delay is capable to handle delays of another kind without requiring to be retrained. Finally, we apply the delay-resolved framework to scenarios comprising of multiple products subjected to stochasticity in lead times, and elucidate how the delay-resolved framework negates the effect of any delay to achieve near-optimal performance.
△ Less
Submitted 8 March, 2022; v1 submitted 2 March, 2022;
originally announced March 2022.