Showing 1–50 of 138 results for author: Nath, S

Representation of continuum equations in physical components for arbitrary curved surfaces

Authors: Sujit Kumar Nath

Abstract: Continuum equations are ubiquitous in physical modelling of elastic, viscous, and viscoelastic systems. The equations of continuum mechanics take nontrivial forms on curved surfaces. Although the curved surface formulation of the continuum equations are derived in many excellent references available in the literature, they are not readily usable for solving physical problems due to the covariant,… ▽ More Continuum equations are ubiquitous in physical modelling of elastic, viscous, and viscoelastic systems. The equations of continuum mechanics take nontrivial forms on curved surfaces. Although the curved surface formulation of the continuum equations are derived in many excellent references available in the literature, they are not readily usable for solving physical problems due to the covariant, contravariant or mixed nature of the stress and strain tensors in the equations. We present the continuum equations in terms of physical components in a general differentiable manifold. This general formulation of the continuum equations can be used readily for modelling physical problems on arbitrary curved surfaces. We demonstrate this with the help of some examples. △ Less

Submitted 27 July, 2024; v1 submitted 17 July, 2024; originally announced July 2024.

Comments: Only the correct affiliation string and the funding acknowledgement has been added in the newer version

Building AI Agents for Autonomous Clouds: Challenges and Design Principles

Authors: Manish Shetty, Yinfang Chen, Gagan Somashekar, Minghua Ma, Yogesh Simmhan, Xuchao Zhang, Jonathan Mace, Dax Vandevoorde, Pedro Las-Casas, Shachee Mishra Gupta, Suman Nath, Chetan Bansal, Saravan Rajmohan

Abstract: The rapid growth in the use of Large Language Models (LLMs) and AI Agents as part of software development and deployment is revolutionizing the information technology landscape. While code generation receives significant attention, a higher-impact application lies in using AI agents for operational resilience of cloud services, which currently require significant human effort and domain knowledge.… ▽ More The rapid growth in the use of Large Language Models (LLMs) and AI Agents as part of software development and deployment is revolutionizing the information technology landscape. While code generation receives significant attention, a higher-impact application lies in using AI agents for operational resilience of cloud services, which currently require significant human effort and domain knowledge. There is a growing interest in AI for IT Operations (AIOps) which aims to automate complex operational tasks, like fault localization and root cause analysis, thereby reducing human intervention and customer impact. However, achieving the vision of autonomous and self-healing clouds through AIOps is hampered by the lack of standardized frameworks for building, evaluating, and improving AIOps agents. This vision paper lays the groundwork for such a framework by first framing the requirements and then discussing design decisions that satisfy them. We also propose AIOpsLab, a prototype implementation leveraging agent-cloud-interface that orchestrates an application, injects real-time faults using chaos engineering, and interfaces with an agent to localize and resolve the faults. We report promising results and lay the groundwork to build a modular and robust framework for building, evaluating, and improving agents for autonomous clouds. △ Less

Submitted 31 July, 2024; v1 submitted 16 July, 2024; originally announced July 2024.

Distilling Opinions at Scale: Incremental Opinion Summarization using XL-OPSUMM

Authors: Sri Raghava Muddu, Rupasai Rangaraju, Tejpalsingh Siledar, Swaroop Nath, Pushpak Bhattacharyya, Swaprava Nath, Suman Banerjee, Amey Patil, Muthusamy Chelliah, Sudhanshu Shekhar Singh, Nikesh Garera

Abstract: Opinion summarization in e-commerce encapsulates the collective views of numerous users about a product based on their reviews. Typically, a product on an e-commerce platform has thousands of reviews, each review comprising around 10-15 words. While Large Language Models (LLMs) have shown proficiency in summarization tasks, they struggle to handle such a large volume of reviews due to context limi… ▽ More Opinion summarization in e-commerce encapsulates the collective views of numerous users about a product based on their reviews. Typically, a product on an e-commerce platform has thousands of reviews, each review comprising around 10-15 words. While Large Language Models (LLMs) have shown proficiency in summarization tasks, they struggle to handle such a large volume of reviews due to context limitations. To mitigate, we propose a scalable framework called Xl-OpSumm that generates summaries incrementally. However, the existing test set, AMASUM has only 560 reviews per product on average. Due to the lack of a test set with thousands of reviews, we created a new test set called Xl-Flipkart by gathering data from the Flipkart website and generating summaries using GPT-4. Through various automatic evaluations and extensive analysis, we evaluated the framework's efficiency on two datasets, AMASUM and Xl-Flipkart. Experimental results show that our framework, Xl-OpSumm powered by Llama-3-8B-8k, achieves an average ROUGE-1 F1 gain of 4.38% and a ROUGE-L F1 gain of 3.70% over the next best-performing model. △ Less

Submitted 16 June, 2024; originally announced June 2024.

Primitive normal pairs with prescribed traces over finite fields

Authors: Shikhamoni Nath, Arpan Chandra Mazumder, Dhiren Kumar Basnet

Abstract: Let $q$ be a positive integral power of some prime $p$ and $\mathbb{F}_{q^m}$ be a finite field with $q^m$ elements for some $m \in \mathbb{N}$. Here we establish a sufficient condition for the existence of primitive normal pairs of the type $(ε, f(ε))$ in $\mathbb{F}_{q^m}$ over $\mathbb{F}_{q}$ with two prescribed traces, $Tr_{{\mathbb{F}_{q^m}}/{\mathbb{F}_q}}(ε)=a$ and… ▽ More Let $q$ be a positive integral power of some prime $p$ and $\mathbb{F}_{q^m}$ be a finite field with $q^m$ elements for some $m \in \mathbb{N}$. Here we establish a sufficient condition for the existence of primitive normal pairs of the type $(ε, f(ε))$ in $\mathbb{F}_{q^m}$ over $\mathbb{F}_{q}$ with two prescribed traces, $Tr_{{\mathbb{F}_{q^m}}/{\mathbb{F}_q}}(ε)=a$ and $Tr_{{\mathbb{F}_{q^m}}/{\mathbb{F}_q}}(f(ε))=b$, where $f(x) \in \mathbb{F}_{q^m}(x)$ is a rational function with some restrictions and $a, b \in \mathbb{F}_q$. Furthermore, for $q=5^k$, $m \geq 9$ and rational functions with degree sum 4, we explicitly find at most 12 fields in which the desired pair may not exist. △ Less

Submitted 7 June, 2024; v1 submitted 29 May, 2024; originally announced May 2024.

MSC Class: 12E20; 11T23

Statistical Context Detection for Deep Lifelong Reinforcement Learning

Authors: Jeffery Dick, Saptarshi Nath, Christos Peridis, Eseoghene Benjamin, Soheil Kolouri, Andrea Soltoggio

Abstract: Context detection involves labeling segments of an online stream of data as belonging to different tasks. Task labels are used in lifelong learning algorithms to perform consolidation or other procedures that prevent catastrophic forgetting. Inferring task labels from online experiences remains a challenging problem. Most approaches assume finite and low-dimension observation spaces or a prelimina… ▽ More Context detection involves labeling segments of an online stream of data as belonging to different tasks. Task labels are used in lifelong learning algorithms to perform consolidation or other procedures that prevent catastrophic forgetting. Inferring task labels from online experiences remains a challenging problem. Most approaches assume finite and low-dimension observation spaces or a preliminary training phase during which task labels are learned. Moreover, changes in the transition or reward functions can be detected only in combination with a policy, and therefore are more difficult to detect than changes in the input distribution. This paper presents an approach to learning both policies and labels in an online deep reinforcement learning setting. The key idea is to use distance metrics, obtained via optimal transport methods, i.e., Wasserstein distance, on suitable latent action-reward spaces to measure distances between sets of data points from past and current streams. Such distances can then be used for statistical tests based on an adapted Kolmogorov-Smirnov calculation to assign labels to sequences of experiences. A rollback procedure is introduced to learn multiple policies by ensuring that only the appropriate data is used to train the corresponding policy. The combination of task detection and policy deployment allows for the optimization of lifelong reinforcement learning agents without an oracle that provides task labels. The approach is tested using two benchmarks and the results show promising performance when compared with related context detection algorithms. The results suggest that optimal transport statistical methods provide an explainable and justifiable procedure for online context detection and reward optimization in lifelong reinforcement learning. △ Less

Submitted 29 May, 2024; originally announced May 2024.

Comments: 10 pages excluding references and bibliography. Submitted to CoLLAs 2024

Survival probability and position distribution of a run and tumble particle in $U(x)=α|x|$ potential with an absorbing boundary

Authors: Sujit Kumar Nath, Sanjib Sabhapandit

Abstract: We study the late time exponential decay of the survival probability $S_\pm(t,a|x_0)\sim e^{-θ(a)t}$, of a one-dimensional run and tumble particle starting from $x_0<a$ with an initial orientation $σ(0)=\pm 1$, under a confining potential $U(x)=α|x|$ with an absorbing boundary at $x=a>0$. We find that the decay rate $θ(a)$ of the survival probability has strong dependence on the location $a$ of th… ▽ More We study the late time exponential decay of the survival probability $S_\pm(t,a|x_0)\sim e^{-θ(a)t}$, of a one-dimensional run and tumble particle starting from $x_0<a$ with an initial orientation $σ(0)=\pm 1$, under a confining potential $U(x)=α|x|$ with an absorbing boundary at $x=a>0$. We find that the decay rate $θ(a)$ of the survival probability has strong dependence on the location $a$ of the absorbing boundary, which undergoes a freezing transition at a critical value $a=a_c=(v_0-α)\sqrt{v_0^2-α^2}/(2αγ)$, where $v_0>α$ is the self-propulsion speed and $γ$ is the tumbling rate of the particle. For $a>a_c$, the value of $θ(a)$ increases monotonically from zero, as $a$ decreases from infinity, till it attains the maximum value $θ(a_c)$ at $a=a_c$. For $0<a<a_c$, the value of $θ(a)$ freezes to the value $θ(a)=θ(a_c)$. We also obtain the propagator with the absorbing boundary condition at $x=a$. Our analytical results are supported by numerical simulations. △ Less

Submitted 29 May, 2024; originally announced May 2024.

Comments: 23 pages, 8 figures

Instability of a dusty shear flow

Authors: Anu V. S. Nath, Anubhab Roy, M. Houssem Kasbaoui

Abstract: We study the instability of a dusty simple shear flow where the dust particles are distributed non-uniformly. A simple shear flow is modally stable to infinitesimal perturbations. Also, a band of particles remains unaffected in the absence of any background flow. However, we demonstrate that the combined scenario -- comprising a simple shear flow with a localised band of particles -- can exhibit d… ▽ More We study the instability of a dusty simple shear flow where the dust particles are distributed non-uniformly. A simple shear flow is modally stable to infinitesimal perturbations. Also, a band of particles remains unaffected in the absence of any background flow. However, we demonstrate that the combined scenario -- comprising a simple shear flow with a localised band of particles -- can exhibit destabilisation due to their two-way interaction. The instability originates solely from the momentum feedback from the particle phase to the fluid phase. Eulerian-Lagrangian simulations are employed to illustrate the existence of this instability. Furthermore, the results are compared with a linear stability analysis of the system using an Eulerian-Eulerian model. Our findings indicate that the instability has an inviscid origin and is characterised by a critical wavelength below which it is not persistent. We have observed that increasing particle inertia dampens the unstable modes, whereas the strength of the instability increases with the strength of the coupling between the fluid and particle phases. △ Less

Submitted 9 May, 2024; originally announced May 2024.

Comments: 37 pages, 13 figures

Characterising the Creative Process in Humans and Large Language Models

Authors: Surabhi S. Nath, Peter Dayan, Claire Stevenson

Abstract: Large language models appear quite creative, often performing on par with the average human on creative tasks. However, research on LLM creativity has focused solely on \textit{products}, with little attention on the creative \textit{process}. Process analyses of human creativity often require hand-coded categories or exploit response times, which do not apply to LLMs. We provide an automated meth… ▽ More Large language models appear quite creative, often performing on par with the average human on creative tasks. However, research on LLM creativity has focused solely on \textit{products}, with little attention on the creative \textit{process}. Process analyses of human creativity often require hand-coded categories or exploit response times, which do not apply to LLMs. We provide an automated method to characterise how humans and LLMs explore semantic spaces on the Alternate Uses Task, and contrast with behaviour in a Verbal Fluency Task. We use sentence embeddings to identify response categories and compute semantic similarities, which we use to generate jump profiles. Our results corroborate earlier work in humans reporting both persistent (deep search in few semantic spaces) and flexible (broad search across multiple semantic spaces) pathways to creativity, where both pathways lead to similar creativity scores. LLMs were found to be biased towards either persistent or flexible paths, that varied across tasks. Though LLMs as a population match human profiles, their relationship with creativity is different, where the more flexible models score higher on creativity. Our dataset and scripts are available on \href{https://github.com/surabhisnath/Creative_Process}{GitHub}. △ Less

Submitted 5 June, 2024; v1 submitted 1 May, 2024; originally announced May 2024.

Learning Strategies For Successful Crowd Navigation

Authors: Rajshree Daulatabad, Serena Nath

Abstract: Teaching autonomous mobile robots to successfully navigate human crowds is a challenging task. Not only does it require planning, but it requires maintaining social norms which may differ from one context to another. Here we focus on crowd navigation, using a neural network to learn specific strategies in-situ with a robot. This allows us to take into account human behavior and reactions toward a… ▽ More Teaching autonomous mobile robots to successfully navigate human crowds is a challenging task. Not only does it require planning, but it requires maintaining social norms which may differ from one context to another. Here we focus on crowd navigation, using a neural network to learn specific strategies in-situ with a robot. This allows us to take into account human behavior and reactions toward a real robot as well as learn strategies that are specific to various scenarios in that context. A CNN takes a top-down image of the scene as input and outputs the next action for the robot to take in terms of speed and angle. Here we present the method, experimental results, and quantitatively evaluate our approach. △ Less

Submitted 9 April, 2024; originally announced April 2024.

Comments: 8 pages

Product Description and QA Assisted Self-Supervised Opinion Summarization

Authors: Tejpalsingh Siledar, Rupasai Rangaraju, Sankara Sri Raghava Ravindra Muddu, Suman Banerjee, Amey Patil, Sudhanshu Shekhar Singh, Muthusamy Chelliah, Nikesh Garera, Swaprava Nath, Pushpak Bhattacharyya

Abstract: In e-commerce, opinion summarization is the process of summarizing the consensus opinions found in product reviews. However, the potential of additional sources such as product description and question-answers (QA) has been considered less often. Moreover, the absence of any supervised training data makes this task challenging. To address this, we propose a novel synthetic dataset creation (SDC) s… ▽ More In e-commerce, opinion summarization is the process of summarizing the consensus opinions found in product reviews. However, the potential of additional sources such as product description and question-answers (QA) has been considered less often. Moreover, the absence of any supervised training data makes this task challenging. To address this, we propose a novel synthetic dataset creation (SDC) strategy that leverages information from reviews as well as additional sources for selecting one of the reviews as a pseudo-summary to enable supervised training. Our Multi-Encoder Decoder framework for Opinion Summarization (MEDOS) employs a separate encoder for each source, enabling effective selection of information while generating the summary. For evaluation, due to the unavailability of test sets with additional sources, we extend the Amazon, Oposum+, and Flipkart test sets and leverage ChatGPT to annotate summaries. Experiments across nine test sets demonstrate that the combination of our SDC approach and MEDOS model achieves on average a 14.5% improvement in ROUGE-1 F1 over the SOTA. Moreover, comparative analysis underlines the significance of incorporating additional sources for generating more informative summaries. Human evaluations further indicate that MEDOS scores relatively higher in coherence and fluency with 0.41 and 0.5 (-1 to 1) respectively, compared to existing models. To the best of our knowledge, we are the first to generate opinion summaries leveraging additional sources in a self-supervised setting. △ Less

Submitted 8 April, 2024; originally announced April 2024.

Tuning superconductivity in nanosecond laser annealed boron doped $Si_{1-x}Ge_{x}$ epilayers

Authors: S. Nath, I. Turan, L. Desvignes, L. Largeau, O. Mauguin, M. Túnica, M. Amato, C. Renard, G. Hallais, D. Débarre, F. Chiodi

Abstract: Superconductivity in ultra-doped $Si_{1-x}Ge_{x}:B$ epilayers is demonstrated by nanosecond laser doping, which allows introducing substitutional B concentrations well above the solubility limit and up to $7\,at.\%$. A Ge fraction $x$ ranging from 0 to 0.21 is incorporated in $Si:B$ : 1) through a precursor gas by Gas Immersion Laser Doping; 2) by ion implantation, followed by nanosecond laser ann… ▽ More Superconductivity in ultra-doped $Si_{1-x}Ge_{x}:B$ epilayers is demonstrated by nanosecond laser doping, which allows introducing substitutional B concentrations well above the solubility limit and up to $7\,at.\%$. A Ge fraction $x$ ranging from 0 to 0.21 is incorporated in $Si:B$ : 1) through a precursor gas by Gas Immersion Laser Doping; 2) by ion implantation, followed by nanosecond laser annealing; 3) by UHV-CVD growth of a thin Ge layer, followed by nanosecond laser annealing. The 30 nm and 80 nm thick $Si_{1-x}Ge_{x}:B$ epilayers display superconducting critical temperatures $T_c$ tuned by B and Ge between 0 and 0.6 K. Within BCS weak-coupling theory, $T_c$ evolves exponentially with both the density of states and the electron-phonon potential. While B doping affects both, through the increase of the carrier density and the tensile strain, Ge incorporation allows addressing independently the lattice deformation influence on superconductivity. To estimate the lattice parameter modulation with B and Ge, Vegard's law is validated for the ternary $SiGeB$ bulk alloy by Density Functional Theory calculations. Its validity is furthermore confirmed experimentally by X-Ray Diffraction. We highlight a global linear dependence of $T_c$ vs. lattice parameter, common for both $Si:B$ and $Si_{1-x}Ge_{x}:B$, with $δT_c/T_c \sim 50\,\%$ for $δa/a \sim 1\,\%$. △ Less

Submitted 3 April, 2024; originally announced April 2024.

Investigation of magnetic order influenced phonon and electron dynamics in MnBi$_{2}$Te$_{4}$ and Sb doped MnBi$_{2}$Te$_{4}$ through terahertz time-domain spectroscopy

Authors: Soumya Mukherjee, Anjan Kumar NM, Subhadip Manna, Sambhu G Nath, Radha Krishna Gopal, Chiranjib Mitra, N. Kamaraju

Abstract: MnBi$_{2}$Te$_{4}$, the first topological insulator with inherent magnetic ordering, has attracted significant attention recently for providing a platform to realize several exotic quantum phenomena at relatively higher temperatures. In this work, we have carried out an exhaustive investigation of MnBi$_{2}$Te$_{4}$ and Sb doped MnBi$_{2}$Te$_{4}$ thin films using THz time-domain spectroscopy. The… ▽ More MnBi$_{2}$Te$_{4}$, the first topological insulator with inherent magnetic ordering, has attracted significant attention recently for providing a platform to realize several exotic quantum phenomena at relatively higher temperatures. In this work, we have carried out an exhaustive investigation of MnBi$_{2}$Te$_{4}$ and Sb doped MnBi$_{2}$Te$_{4}$ thin films using THz time-domain spectroscopy. The extracted real THz conductivity displays a strong IR active E$_u$ phonon absorption peak (at $\sim$1.5 THz) merged on top of the Drude-like contributions from bulk and surface electrons. The extracted parameters from the THz conductivity data fitted to the Drude-Fano-Lorentz model, show significant changes in their temperature dependence around the magnetic ordering Néel temperature of $\sim$ 25K, which is suggestive of the coupling between magnetic ordering and electronic band structure. The frequency of the E$_u$ phonon displays an anomalous blue-shift with increasing temperatures by $\sim$ 0.1 THz ($\sim$7 %) for MnBi$_{2}$Te$_{4}$ and $\sim$0.2 THz ($\sim$13 %) for Sb doped MnBi$_{2}$Te$_{4}$ between 7K and 250K. The line-shape of the E$_u$ phonon mode in Sb doped MnBi$_{2}$Te$_{4}$ shows significant Fano asymmetry compared to that of MnBi$_{2}$Te$_{4}$, indicating that Sb doping plays an important role in the Fano interference between the phonons and the electrons, in this system. These results indicate that the anomalous phonon behaviour seen in MBT arise mainly from positive cubic anharmonicity induced self energy parameter, whereas both anharmonicity and the electron phonon coupling are at play in making the relatively higher anomalous blue shift of phonons in MBST. Our studies provide the first comprehensive understanding of the phonon and electron dynamics of MnBi$_{2}$Te$_{4}$ and Sb doped MnBi$_{2}$Te$_{4}$ in the THz range using time-domain THz spectroscopy. △ Less

Submitted 18 March, 2024; originally announced March 2024.

Anisotropic magneto-photothermal voltage in Sb2Te3 topological insulator thin films

Authors: Subhadip Manna, Sambhu G Nath, Samrat Roy, Soumik Aon, Sayani Pal, Kanav Sharma, Dhananjaya Mahapatra, Partha Mitra, Sourin Das, Bipul Pal, Chiranjib Mitra

Abstract: We studied longitudinal and Hall photothermal voltages under a planar magnetic field scan in epitaxial thin films of the Topological Insulator (TI) Sb2Te3, grown using pulsed laser deposition (PLD). Unlike prior research that utilised polarised light-induced photocurrent to investigate the TI, our study introduces advancements based on unpolarized light-induced local heating. This method yields a… ▽ More We studied longitudinal and Hall photothermal voltages under a planar magnetic field scan in epitaxial thin films of the Topological Insulator (TI) Sb2Te3, grown using pulsed laser deposition (PLD). Unlike prior research that utilised polarised light-induced photocurrent to investigate the TI, our study introduces advancements based on unpolarized light-induced local heating. This method yields a thermoelectric response exhibiting a direct signature of strong spin-orbit coupling. Our analysis reveals three distinct contributions when fitting the photothermal voltage data to the angular dependence of the planar magnetic field. The interaction between the applied magnetic field and the thermal gradient on the bulk band orbitals enables the differentiation between the ordinary Nernst effect from the out-of-plane thermal gradient and an extraordinary magneto-thermal contribution from the planar thermal gradient. The fitting of our data to theoretical models indicates that these effects primarily arise from the bulk states of the TI rather than the surface states. These findings highlight PLD-grown epitaxial topological insulator thin films as promising candidates for optoelectronic devices, including sensors and actuators. Such devices offer controllable responses through position-dependent, non-invasive local heating via focused incident light and variations in the applied magnetic field direction. △ Less

Submitted 15 March, 2024; originally announced March 2024.

Clustering and chaotic motion of heavy inertial particles in an isolated non-axisymmetric vortex

Authors: Anu V. S. Nath, Anubhab Roy

Abstract: We investigate the dynamics of heavy inertial particles in a flow field due to an isolated, non-axisymmetric vortex. For our study, we consider a canonical elliptical vortex - the Kirchhoff vortex and its strained variant, the Kida vortex. Contrary to the anticipated centrifugal dispersion of inertial particles, which is typical in open vortical flows, we observe the clustering of particles around… ▽ More We investigate the dynamics of heavy inertial particles in a flow field due to an isolated, non-axisymmetric vortex. For our study, we consider a canonical elliptical vortex - the Kirchhoff vortex and its strained variant, the Kida vortex. Contrary to the anticipated centrifugal dispersion of inertial particles, which is typical in open vortical flows, we observe the clustering of particles around co-rotating attractors near the Kirchhoff vortex due to its non-axisymmetric nature. We analyze the inertia-modified stability characteristics of the fixed points, highlighting how some of the fixed points migrate in physical space, collide and then annihilate with increasing particle inertia. The introduction of external straining, the Kida vortex being an example, introduces chaotic tracer transport. Using a Melnikov analysis, we show that particle inertia and external straining can compete, where chaotic transport can be suppressed beyond a critical value of particle inertia. △ Less

Submitted 15 March, 2024; originally announced March 2024.

Comments: 36 pages, 18 figures

Correction and standardisation of lung oscillometry techniques using parameter inference: A study group report

Authors: Bindi S. Brook, Graeham R. Douglas, Oliver E. Jensen, Sonal Mistry, Sujit Kumar Nath, Matthew J. Russell, Sina Saffaran, James Shemilt, Liam Weaver, Carl A. Whitfield

Abstract: This report relates to a study group hosted by the EPSRC funded network, Integrating data-driven BIOphysical models into REspiratory MEdicine (BIOREME), and supported by The Insigneo Institute and The Knowledge Transfer Network. The BIOREME network hosts events, including this study group, to bring together multi-disciplinary researchers, clinicians, companies and charities to catalyse research in… ▽ More This report relates to a study group hosted by the EPSRC funded network, Integrating data-driven BIOphysical models into REspiratory MEdicine (BIOREME), and supported by The Insigneo Institute and The Knowledge Transfer Network. The BIOREME network hosts events, including this study group, to bring together multi-disciplinary researchers, clinicians, companies and charities to catalyse research in the applications of mathematical modelling for respiratory medicine. The goal of this study group was to provide an interface between companies, clinicians, and mathematicians to develop mathematical tools to the problems presented. The study group was held at The University of Sheffield on the 17 - 20 April 2023 and was attended by 24 researchers from 13 different institutions. This report relates to a challenge presented by Arete Medical Technologies relating to impulse oscillometry (IOS), whereby a short pressure oscillation is imposed at a person's mouth during normal breathing, usually by a loudspeaker. The resulting pressure and flow rate changes can be used to the impedance of the airways, which in turn can provide proxy measurements for (patho)physiological changes in the small airways. Disentangling the signal so that airway mechanics can be measured accurately (and device properties/environmental effects can be accounted for) remains an open challenge that has the potential to significantly improve the device and its translation to clinic. In this report, several approaches to this problem, and the wider problem of interpreting oscillometry resuts are explored. △ Less

Submitted 7 March, 2024; originally announced March 2024.

Comments: 17 pages, 9 figures, Study group report

Simplicity in Complexity : Explaining Visual Complexity using Deep Segmentation Models

Authors: Tingke Shen, Surabhi S Nath, Aenne Brielmann, Peter Dayan

Abstract: The complexity of visual stimuli plays an important role in many cognitive phenomena, including attention, engagement, memorability, time perception and aesthetic evaluation. Despite its importance, complexity is poorly understood and ironically, previous models of image complexity have been quite complex. There have been many attempts to find handcrafted features that explain complexity, but thes… ▽ More The complexity of visual stimuli plays an important role in many cognitive phenomena, including attention, engagement, memorability, time perception and aesthetic evaluation. Despite its importance, complexity is poorly understood and ironically, previous models of image complexity have been quite complex. There have been many attempts to find handcrafted features that explain complexity, but these features are usually dataset specific, and hence fail to generalise. On the other hand, more recent work has employed deep neural networks to predict complexity, but these models remain difficult to interpret, and do not guide a theoretical understanding of the problem. Here we propose to model complexity using segment-based representations of images. We use state-of-the-art segmentation models, SAM and FC-CLIP, to quantify the number of segments at multiple granularities, and the number of classes in an image respectively. We find that complexity is well-explained by a simple linear model with these two features across six diverse image-sets of naturalistic scene and art images. This suggests that the complexity of images can be surprisingly simple. △ Less

Submitted 6 May, 2024; v1 submitted 5 March, 2024; originally announced March 2024.

Transformers are Expressive, But Are They Expressive Enough for Regression?

Authors: Swaroop Nath, Harshad Khadilkar, Pushpak Bhattacharyya

Abstract: Transformers have become pivotal in Natural Language Processing, demonstrating remarkable success in applications like Machine Translation and Summarization. Given their widespread adoption, several works have attempted to analyze the expressivity of Transformers. Expressivity of a neural network is the class of functions it can approximate. A neural network is fully expressive if it can act as a… ▽ More Transformers have become pivotal in Natural Language Processing, demonstrating remarkable success in applications like Machine Translation and Summarization. Given their widespread adoption, several works have attempted to analyze the expressivity of Transformers. Expressivity of a neural network is the class of functions it can approximate. A neural network is fully expressive if it can act as a universal function approximator. We attempt to analyze the same for Transformers. Contrary to existing claims, our findings reveal that Transformers struggle to reliably approximate smooth functions, relying on piecewise constant approximations with sizable intervals. The central question emerges as: ''Are Transformers truly Universal Function Approximators?'' To address this, we conduct a thorough investigation, providing theoretical insights and supporting evidence through experiments. Theoretically, we prove that Transformer Encoders cannot approximate smooth functions. Experimentally, we complement our theory and show that the full Transformer architecture cannot approximate smooth functions. By shedding light on these challenges, we advocate a refined understanding of Transformers' capabilities. Code Link: https://github.com/swaroop-nath/transformer-expressivity. △ Less

Submitted 30 August, 2024; v1 submitted 23 February, 2024; originally announced February 2024.

Comments: 18 pages, 17 figures, 6 tables

Leveraging Domain Knowledge for Efficient Reward Modelling in RLHF: A Case-Study in E-Commerce Opinion Summarization

Authors: Swaroop Nath, Tejpalsingh Siledar, Sankara Sri Raghava Ravindra Muddu, Rupasai Rangaraju, Harshad Khadilkar, Pushpak Bhattacharyya, Suman Banerjee, Amey Patil, Sudhanshu Shekhar Singh, Muthusamy Chelliah, Nikesh Garera

Abstract: Reinforcement Learning from Human Feedback (RLHF) has become a dominating strategy in aligning Language Models (LMs) with human values/goals. The key to the strategy is learning a reward model ($\varphi$), which can reflect the latent reward model of humans. While this strategy has proven effective, the training methodology requires a lot of human preference annotation (usually in the order of ten… ▽ More Reinforcement Learning from Human Feedback (RLHF) has become a dominating strategy in aligning Language Models (LMs) with human values/goals. The key to the strategy is learning a reward model ($\varphi$), which can reflect the latent reward model of humans. While this strategy has proven effective, the training methodology requires a lot of human preference annotation (usually in the order of tens of thousands) to train $\varphi$. Such a large-scale annotation is justifiable when it's a one-time effort, and the reward model is universally applicable. However, human goals are subjective and depend on the task, requiring task-specific preference annotations, which can be impractical to fulfill. To address this challenge, we propose a novel approach to infuse domain knowledge into $\varphi$, which reduces the amount of preference annotation required ($21\times$), omits Alignment Tax, and provides some interpretability. We validate our approach in E-Commerce Opinion Summarization, with a significant reduction in dataset size (to just $940$ samples) while advancing the SOTA ($\sim4$ point ROUGE-L improvement, $68\%$ of times preferred by humans over SOTA). Our contributions include a novel Reward Modeling technique and two new datasets: PromptOpinSumm (supervised data for Opinion Summarization) and OpinPref (a gold-standard human preference dataset). The proposed methodology opens up avenues for efficient RLHF, making it more adaptable to applications with varying human values. We release the artifacts (Code: github.com/efficient-rlhf. PromptOpinSumm: hf.co/prompt-opin-summ. OpinPref: hf.co/opin-pref) for usage under MIT License. △ Less

Submitted 18 April, 2024; v1 submitted 23 February, 2024; originally announced February 2024.

Comments: 19 pages, 6 figures, 21 tables

Complexity Growth and the Krylov-Wigner function

Authors: Ritam Basu, Anirban Ganguly, Souparna Nath, Onkar Parrikar

Abstract: For any state in a $D$-dimensional Hilbert space with a choice of basis, one can define a discrete version of the Wigner function -- a quasi-probability distribution which represents the state on a discrete phase space. The Wigner function can, in general, take on negative values, and the amount of negativity in the Wigner function has an operational meaning as a resource for quantum computation.… ▽ More For any state in a $D$-dimensional Hilbert space with a choice of basis, one can define a discrete version of the Wigner function -- a quasi-probability distribution which represents the state on a discrete phase space. The Wigner function can, in general, take on negative values, and the amount of negativity in the Wigner function has an operational meaning as a resource for quantum computation. In this note, we study the growth of Wigner negativity for a generic initial state under time evolution with chaotic Hamiltonians. We introduce the Krylov-Wigner function, i.e., the Wigner function defined with respect to the Krylov basis (with appropriate phases), and show that this choice of basis minimizes the early time growth of Wigner negativity in the large $D$ limit. We take this as evidence that the Krylov basis (with appropriate phases) is ideally suited for a dual, semi-classical description of chaotic quantum dynamics at large $D$. We also numerically study the time evolution of the Krylov-Wigner function and its negativity in random matrix theory for an initial pure state. We observe that the negativity broadly shows three phases: it rises gradually for a time of $O(\sqrt{D})$, then hits a sharp ramp and finally saturates close to its upper bound of $\sqrt{D}$. △ Less

Submitted 21 February, 2024; originally announced February 2024.

Comments: 30 pages, 6 figures

One Prompt To Rule Them All: LLMs for Opinion Summary Evaluation

Authors: Tejpalsingh Siledar, Swaroop Nath, Sankara Sri Raghava Ravindra Muddu, Rupasai Rangaraju, Swaprava Nath, Pushpak Bhattacharyya, Suman Banerjee, Amey Patil, Sudhanshu Shekhar Singh, Muthusamy Chelliah, Nikesh Garera

Abstract: Evaluation of opinion summaries using conventional reference-based metrics rarely provides a holistic evaluation and has been shown to have a relatively low correlation with human judgments. Recent studies suggest using Large Language Models (LLMs) as reference-free metrics for NLG evaluation, however, they remain unexplored for opinion summary evaluation. Moreover, limited opinion summary evaluat… ▽ More Evaluation of opinion summaries using conventional reference-based metrics rarely provides a holistic evaluation and has been shown to have a relatively low correlation with human judgments. Recent studies suggest using Large Language Models (LLMs) as reference-free metrics for NLG evaluation, however, they remain unexplored for opinion summary evaluation. Moreover, limited opinion summary evaluation datasets inhibit progress. To address this, we release the SUMMEVAL-OP dataset covering 7 dimensions related to the evaluation of opinion summaries: fluency, coherence, relevance, faithfulness, aspect coverage, sentiment consistency, and specificity. We investigate Op-I-Prompt a dimension-independent prompt, and Op-Prompts, a dimension-dependent set of prompts for opinion summary evaluation. Experiments indicate that Op-I-Prompt emerges as a good alternative for evaluating opinion summaries achieving an average Spearman correlation of 0.70 with humans, outperforming all previous approaches. To the best of our knowledge, we are the first to investigate LLMs as evaluators on both closed-source and open-source models in the opinion summarization domain. △ Less

Submitted 9 June, 2024; v1 submitted 18 February, 2024; originally announced February 2024.

Spatial autoregressive model with measurement error in covariates

Authors: Subhadeep Paul, Shanjukta Nath

Abstract: The Spatial AutoRegressive model (SAR) is commonly used in studies involving spatial and network data to estimate the spatial or network peer influence and the effects of covariates on the response, taking into account the dependence among units. While the model can be efficiently estimated with a Quasi maximum likelihood approach (QMLE), the detrimental effect of covariate measurement error on th… ▽ More The Spatial AutoRegressive model (SAR) is commonly used in studies involving spatial and network data to estimate the spatial or network peer influence and the effects of covariates on the response, taking into account the dependence among units. While the model can be efficiently estimated with a Quasi maximum likelihood approach (QMLE), the detrimental effect of covariate measurement error on the QMLE and how to remedy it is currently unknown. If covariates are measured with error, then the QMLE may not have the $\sqrt{n}$ convergence and may even be inconsistent even when a node is influenced by only a limited number of other nodes or spatial units. We develop a measurement error-corrected ML estimator (ME-QMLE) for the parameters of the SAR model when covariates are measured with error. The ME-QMLE possesses statistical consistency and asymptotic normality properties and we derive its limiting covariance. We consider two types of applications. The first is when the true covariate is imprecisely measured with replicated measurements or cannot be measured directly, and a proxy is observed instead. The second one involves including latent homophily factors estimated with error from the network for estimating peer influence. Our numerical results verify the bias correction property of the estimator and the accuracy of the standard error estimates in finite samples. We illustrate the method on two real datasets; i) peer influence in GPA for middle school students in New Jersey and ii) county-level death rates from the COVID-19 pandemic. △ Less

Submitted 6 August, 2024; v1 submitted 7 February, 2024; originally announced February 2024.

Fair Interval Scheduling of Indivisible Chores

Authors: Sarfaraz Equbal, Rohit Gurjar, Yatharth Kumar, Swaprava Nath, Rohit Vaish

Abstract: We study the problem of fairly assigning a set of discrete tasks (or chores) among a set of agents with additive valuations. Each chore is associated with a start and finish time, and each agent can perform at most one chore at any given time. The goal is to find a fair and efficient schedule of the chores, where fairness pertains to satisfying envy-freeness up to one chore (EF1) and efficiency pe… ▽ More We study the problem of fairly assigning a set of discrete tasks (or chores) among a set of agents with additive valuations. Each chore is associated with a start and finish time, and each agent can perform at most one chore at any given time. The goal is to find a fair and efficient schedule of the chores, where fairness pertains to satisfying envy-freeness up to one chore (EF1) and efficiency pertains to maximality (i.e., no unallocated chore can be feasibly assigned to any agent). Our main result is a polynomial-time algorithm for computing an EF1 and maximal schedule for two agents under monotone valuations when the conflict constraints constitute an arbitrary interval graph. The algorithm uses a coloring technique in interval graphs that may be of independent interest. For an arbitrary number of agents, we provide an algorithm for finding a fair schedule under identical dichotomous valuations when the constraints constitute a path graph. We also show that stronger fairness and efficiency properties, including envy-freeness up to any chore (EFX) along with maximality and EF1 along with Pareto optimality, cannot be achieved. △ Less

Submitted 6 February, 2024; originally announced February 2024.

Deep Learning Based Cyberbullying Detection in Bangla Language

Authors: Sristy Shidul Nath, Razuan Karim, Mahdi H. Miraz

Abstract: The Internet is currently the largest platform for global communication including expressions of opinions, reviews, contents, images, videos and so forth. Moreover, social media has now become a very broad and highly engaging platform due to its immense popularity and swift adoption trend. Increased social networking, however, also has detrimental impacts on the society leading to a range of unwan… ▽ More The Internet is currently the largest platform for global communication including expressions of opinions, reviews, contents, images, videos and so forth. Moreover, social media has now become a very broad and highly engaging platform due to its immense popularity and swift adoption trend. Increased social networking, however, also has detrimental impacts on the society leading to a range of unwanted phenomena, such as online assault, intimidation, digital bullying, criminality and trolling. Hence, cyberbullying has become a pervasive and worrying problem that poses considerable psychological and emotional harm to the people, particularly amongst the teens and the young adults. In order to lessen its negative effects and provide victims with prompt support, a great deal of research to identify cyberbullying instances at various online platforms is emerging. In comparison to other languages, Bangla (also known as Bengali) has fewer research studies in this domain. This study demonstrates a deep learning strategy for identifying cyberbullying in Bengali, using a dataset of 12282 versatile comments from multiple social media sites. In this study, a two-layer bidirectional long short-term memory (Bi-LSTM) model has been built to identify cyberbullying, using a variety of optimisers as well as 5-fold cross validation. To evaluate the functionality and efficacy of the proposed system, rigorous assessment and validation procedures have been employed throughout the project. The results of this study reveals that the proposed model's accuracy, using momentum-based stochastic gradient descent (SGD) optimiser, is 94.46%. It also reflects a higher accuracy of 95.08% and a F1 score of 95.23% using Adam optimiser as well as a better accuracy of 94.31% in 5-fold cross validation. △ Less

Submitted 6 January, 2024; originally announced January 2024.

Journal ref: Annals of Emerging Technologies in Computing (AETiC), Print ISSN: 2516-0281, Online ISSN: 2516-029X, pp. 50-65, Vol. 8, No. 1, 1st January 2024, Available: http://aetic.theiaer.org/archive/v8/v8n1/p5.html

Spectral Temporal Contrastive Learning

Authors: Sacha Morin, Somjit Nath, Samira Ebrahimi Kahou, Guy Wolf

Abstract: Learning useful data representations without requiring labels is a cornerstone of modern deep learning. Self-supervised learning methods, particularly contrastive learning (CL), have proven successful by leveraging data augmentations to define positive pairs. This success has prompted a number of theoretical studies to better understand CL and investigate theoretical bounds for downstream linear p… ▽ More Learning useful data representations without requiring labels is a cornerstone of modern deep learning. Self-supervised learning methods, particularly contrastive learning (CL), have proven successful by leveraging data augmentations to define positive pairs. This success has prompted a number of theoretical studies to better understand CL and investigate theoretical bounds for downstream linear probing tasks. This work is concerned with the temporal contrastive learning (TCL) setting where the sequential structure of the data is used instead to define positive pairs, which is more commonly used in RL and robotics contexts. In this paper, we adapt recent work on Spectral CL to formulate Spectral Temporal Contrastive Learning (STCL). We discuss a population loss based on a state graph derived from a time-homogeneous reversible Markov chain with uniform stationary distribution. The STCL loss enables to connect the linear probing performance to the spectral properties of the graph, and can be estimated by considering previously observed data sequences as an ensemble of MCMC chains. △ Less

Submitted 7 December, 2023; v1 submitted 1 December, 2023; originally announced December 2023.

Comments: Accepted to Self-Supervised Learning - Theory and Practice, NeurIPS Workshop, 2023

First results of evaporation residue cross-section measurements of $^{32}$S+$^{208}$Pb system

Authors: R. Sariyal, I. Mazumdar, D. Mehta, N. Madhavan, S. Nath, J. Gehlot, Gonika, S. M. Patel, P. B. Chavan, S. Panwar, V. Ranga, A. Parihari

Abstract: The dynamics of heavy ion-induced reactions play a critical role in forming super heavy elements (SHE), and one clear signature of the SHE formation is the evaporation residue (ER). In our pursuit of SHE, we present the heaviest element populated in India for ER cross-section measurements. These are the first-ever measurements of the Evaporation Residue (ER) cross-sections for the nuclear reaction… ▽ More The dynamics of heavy ion-induced reactions play a critical role in forming super heavy elements (SHE), and one clear signature of the SHE formation is the evaporation residue (ER). In our pursuit of SHE, we present the heaviest element populated in India for ER cross-section measurements. These are the first-ever measurements of the Evaporation Residue (ER) cross-sections for the nuclear reactions between $^{32}$S and $^{208}$Pb. These measurements were conducted above the Coulomb barrier at four distinct beam energies in the laboratory frame, ranging from 176 to 191 MeV at the pelletron Linac facility at the Inter-University Accelerator Centre (IUAC), New Delhi. The Hybrid Recoil Mass Analyzer (HYRA) in a gas-filled mode was employed for these experiments. The obtained range of ER cross-sections enriches our knowledge and helps advance the field of heavy ion-induced reactions, especially in the context of super heavy element formation. △ Less

Submitted 29 November, 2023; v1 submitted 29 November, 2023; originally announced November 2023.

Comments: 12 pages, 10 figures. arXiv admin note: text overlap with arXiv:2311.09046

Reinforcement Replaces Supervision: Query focused Summarization using Deep Reinforcement Learning

Authors: Swaroop Nath, Harshad Khadilkar, Pushpak Bhattacharyya

Abstract: Query-focused Summarization (QfS) deals with systems that generate summaries from document(s) based on a query. Motivated by the insight that Reinforcement Learning (RL) provides a generalization to Supervised Learning (SL) for Natural Language Generation, and thereby performs better (empirically) than SL, we use an RL-based approach for this task of QfS. Additionally, we also resolve the conflict… ▽ More Query-focused Summarization (QfS) deals with systems that generate summaries from document(s) based on a query. Motivated by the insight that Reinforcement Learning (RL) provides a generalization to Supervised Learning (SL) for Natural Language Generation, and thereby performs better (empirically) than SL, we use an RL-based approach for this task of QfS. Additionally, we also resolve the conflict of employing RL in Transformers with Teacher Forcing. We develop multiple Policy Gradient networks, trained on various reward signals: ROUGE, BLEU, and Semantic Similarity, which lead to a 10-point improvement over the State-of-the-Art approach on the ROUGE-L metric for a benchmark dataset (ELI5). We also show performance of our approach in zero-shot setting for another benchmark dataset (DebatePedia) -- our approach leads to results comparable to baselines, which were specifically trained on DebatePedia. To aid the RL training, we propose a better semantic similarity reward, enabled by a novel Passage Embedding scheme developed using Cluster Hypothesis. Lastly, we contribute a gold-standard test dataset to further research in QfS and Long-form Question Answering (LfQA). △ Less

Submitted 29 November, 2023; originally announced November 2023.

Enhancement of spin to charge conversion efficiency at the topological surface state by inserting normal metal spacer layer in the topological insulator based heterostructure

Authors: Sayani Pal, Anuvab Nandi, Shambhu G. Nath, Pratap Kumar Pal, Kanav Sharma, Subhadip Manna, Anjan Barman, Chiranjib Mitra

Abstract: We report efficient spin to charge conversion (SCC) in the topological insulator (TI) based heterostructure ($BiSbTe_{1.5}Se_{1.5}/Cu/Ni_{80}Fe_{20}$) by using spin-pumping technique where $BiSbTe_{1.5}Se_{1.5}$ is the TI and $Ni_{80}Fe_{20}$ is the ferromagnetic layer. The SCC, characterized by inverse Edelstein effect length ($λ_{IEE}$) in the TI material gets altered with an intervening Copper… ▽ More We report efficient spin to charge conversion (SCC) in the topological insulator (TI) based heterostructure ($BiSbTe_{1.5}Se_{1.5}/Cu/Ni_{80}Fe_{20}$) by using spin-pumping technique where $BiSbTe_{1.5}Se_{1.5}$ is the TI and $Ni_{80}Fe_{20}$ is the ferromagnetic layer. The SCC, characterized by inverse Edelstein effect length ($λ_{IEE}$) in the TI material gets altered with an intervening Copper (Cu) layer and it depends on the interlayer thickness. The introduction of Cu layer at the interface of TI and ferromagnetic metal (FM) provides a new degree of freedom for tuning the SCC efficiency of the topological surface states. The significant enhancement of the measured spin-pumping voltage and the linewidth of ferromagnetic resonance (FMR) absorption spectra due to the insertion of Cu layer at the interface indicates a reduction in spin memory loss at the interface that resulted from the presence of exchange coupling between the surface states of TI and the local moments of ferromagnetic metal. The temperature dependence (from 8K to 300K) of the evaluated $λ_{IEE}$ data for all the trilayer systems, TI/Cu/FM with different Cu thickness confirms the effect of exchange coupling between the TI and FM layer on the spin to charge conversion efficiency of the topological surface state. △ Less

Submitted 17 November, 2023; originally announced November 2023.

Measurements of evaporation residue cross-sections and evaporation residue-gated $γ$-ray fold distributions for $^{32}$S+$^{154}$Sm system

Authors: R. Sariyal, I. Mazumdar, D. Mehta, N. Madhvan, S. Nath, J. Gehlot, Gonika, S. M. Patel, P. B. Chavan, S. Panwar, V. Ranga, A. Parihari, A. K. Nasirov, B. M. Kayumov

Abstract: Evaporation Residue (ER) cross-sections and ER-gated $γ$-ray fold distributions are measured for the $^{32}$S + $^{154}$Sm nuclear reaction above the Coulomb barrier at six different beam energies from 148 to 191 MeV. $γ$-ray multiplicities and spin distributions are extracted from the ER-gated fold distributions. The ER cross-sections measured in the present work are found to be much higher than… ▽ More Evaporation Residue (ER) cross-sections and ER-gated $γ$-ray fold distributions are measured for the $^{32}$S + $^{154}$Sm nuclear reaction above the Coulomb barrier at six different beam energies from 148 to 191 MeV. $γ$-ray multiplicities and spin distributions are extracted from the ER-gated fold distributions. The ER cross-sections measured in the present work are found to be much higher than what was reported in a previous work using a very different target-projectile ($^{48}$Ti + $^{138}$Ba) combination, leading to the same compound nucleus $^{186}$Pt, with much less mass asymmetry in the entrance channel than the present reaction. This clearly demonstrates the effect of the entrance channel on ER production cross-section. The ER cross-sections measured in the present work are compared with the results of both the statistical model calculations and the dynamical model calculations. Statistical model calculations have been performed to generate a range of parameter space for both the barrier height and Kramers' viscosity parameter over which the ER cross-section data can be reproduced. The calculations performed using the dinuclear system (DNS) model reproduce the data considering both complete and incomplete fusion processes. DNS calculations indicate the need for the inclusion of incomplete fusion channel at higher energies to reproduce the ER cross-sections. △ Less

Submitted 15 November, 2023; originally announced November 2023.

Comments: 13 pages, 18 figures

A Gale-Shapley View of Unique Stable Marriages

Authors: Kartik Gokhale, Amit Kumar Mallik, Ankit Kumar Misra, Swaprava Nath

Abstract: Stable marriage of a two-sided market with unit demand is a classic problem that arises in many real-world scenarios. In addition, a unique stable marriage in this market simplifies a host of downstream desiderata. In this paper, we explore a new set of sufficient conditions for unique stable matching (USM) under this setup. Unlike other approaches that also address this question using the structu… ▽ More Stable marriage of a two-sided market with unit demand is a classic problem that arises in many real-world scenarios. In addition, a unique stable marriage in this market simplifies a host of downstream desiderata. In this paper, we explore a new set of sufficient conditions for unique stable matching (USM) under this setup. Unlike other approaches that also address this question using the structure of preference profiles, we use an algorithmic viewpoint and investigate if this question can be answered using the lens of the deferred acceptance (DA) algorithm (Gale and Shapley, 1962). Our results yield a set of sufficient conditions for USM (viz., MaxProp and MaxRou) and show that these are disjoint from the previously known sufficiency conditions like sequential preference and no crossing. We also provide a characterization of MaxProp that makes it efficiently verifiable, and shows the gap between MaxProp and the entire USM class. These results give a more detailed view of the sub-structures of the USM class. △ Less

Submitted 2 August, 2024; v1 submitted 28 October, 2023; originally announced October 2023.

Comments: 20 pages, 1 figure, In Proceedings, ECAI 2024

MAXI J0637-430: A Possible Candidate for Bulk Motion Comptonization?

Authors: Kaushik Chatterjee, Dipak Debnath, Sujoy Kumar Nath, Hsiang-Kuang Chang

Abstract: The transient Galactic black hole candidate MAXI J0637-430 went through an outburst in 2019--20 for the very first time. This outburst was active for almost 6 months from November 2019 to May 2020. We study the spectral properties of this source during that outburst using archival data from NICER, Swift, and NuSTAR satellites/instruments. We have analyzed the source during 6 epochs on which simult… ▽ More The transient Galactic black hole candidate MAXI J0637-430 went through an outburst in 2019--20 for the very first time. This outburst was active for almost 6 months from November 2019 to May 2020. We study the spectral properties of this source during that outburst using archival data from NICER, Swift, and NuSTAR satellites/instruments. We have analyzed the source during 6 epochs on which simultaneous NICER--NuSTAR and Swift/XRT--NuSTAR data were available. Using both phenomenological and physical model fitting approaches, we analyzed the spectral data in the broad $0.7-70$ keV energy band. We first used a combination of disk blackbody with power-law, disk blackbody with broken power-law, and disk blackbody with power-law and bmc models. For a better understanding of the accretion picture, e.g., understanding how the accretion rates change with the changing size of the perceived Compton cloud, we used the two-component advective flow (TCAF) model with broken power-law, TCAF with power-law and bmc models. For last 3 epochs, the diskbb+power-law and TCAF models were able to spectrally fit the data for acceptable $χ^2/DOF$. However, for the first 3 epochs, we needed an additional component to fit spectra for acceptable $χ^2/DOF$. From our analysis, we reported about the possible presence of another component during these first 3 epochs when the source was in the high soft state. This additional component in this state is best described by the bulk motion Comptonization phenomenon. From the TCAF model fitting, we estimated the average mass of the source as $8.1^{+1.3}_{-2.7}~M_\odot$. △ Less

Submitted 8 September, 2023; originally announced September 2023.

Comments: 16 pages, 5 figures

Is the glassy dynamics same in 2D as in 3D? The Adam Gibbs relation test

Authors: Santu Nath, Shiladitya Sengupta

Abstract: It has been recognized of late that even amorphous, glass-forming materials in two dimensions (2D) are significantly affected by Mermin-Wagner type long wavelength thermal fluctuation which is inconsequential in three (3D) and higher dimensions. Thus any study of glassy dynamics in 2D should first remove the effect of such fluctuations. The present work considers the question of whether the role o… ▽ More It has been recognized of late that even amorphous, glass-forming materials in two dimensions (2D) are significantly affected by Mermin-Wagner type long wavelength thermal fluctuation which is inconsequential in three (3D) and higher dimensions. Thus any study of glassy dynamics in 2D should first remove the effect of such fluctuations. The present work considers the question of whether the role of spatial dimension on glassy dynamics is only limited to such fluctuations, or whether the nature of glassy dynamics is intrinsically different in 2D. We address this issue by studying the relationship between dynamics and thermodynamics within the framework of the Adam-Gibbs (AG) relation and its generalization the Random First Order Transition (RFOT) theory. Using two model glass-forming liquids we find that even after removing the effect of long wavelength fluctuations, the AG relation breaks down in two dimensions. Then we consider the effect of anharmonicity of vibrational entropy - a second factor highlighted recently that can qualitatively change the nature of dynamics. We explicitly compute the configurational entropy both with and without the anharmonic correction. We show that the anharmonic correction reduces the extent of deviation from the AG relation, but even after taking into account its effects, the AG relation still breaks down in 2D. It is also more prominent if one considers diffusion coefficient rather than $α$-relaxation time. Overall, the impact of the anharmonicity of vibration is larger than the long wavelength fluctuation in determining the qualitative relation between timescales and entropy. The extent and nature of deviation from the AG relation crucially depends on the attractive vs. repulsive nature of the inter-particle interaction. Thus our results suggest that the glassy dynamics in 2D may be intrinsically different from that in 3D. △ Less

Submitted 16 August, 2023; originally announced August 2023.

Journal ref: J. Chem. Phys. 161, 034504 (2024)

The free energy of the large-$N$ fermionic Chern$\small-$Simons theory in the 'temporal' gauge

Authors: Shiraz Minwalla, Souparna Nath, Nikhil Tanwar, Vatsal

Abstract: Most of the computational evidence for the Bose$\small-$Fermi duality of fundamental fields coupled to $U(N)$ Chern$\small-$Simons theories originates in the large-$N$ calculations performed in the light-cone gauge. In this paper, we use another gauge, the 'temporal' gauge, to evaluate the finite temperature partition function of $U(N)$ coupled regular and critical fermions on $\mathbb{R}^2$ at la… ▽ More Most of the computational evidence for the Bose$\small-$Fermi duality of fundamental fields coupled to $U(N)$ Chern$\small-$Simons theories originates in the large-$N$ calculations performed in the light-cone gauge. In this paper, we use another gauge, the 'temporal' gauge, to evaluate the finite temperature partition function of $U(N)$ coupled regular and critical fermions on $\mathbb{R}^2$ at large $N$. We first set up the finite temperature gap equations, and then use tricks explored in arXiv:1410.0558 to solve these equations and evaluate the partition function. Our final results are in perfect agreement with earlier light-cone gauge results. The success of our 'temporal' gauge calculation potentially opens a path to computations that are awkward in light-cone gauge but more natural in the 'temporal' gauge, e.g. the evaluation of the thermal free energy on a finite-sized sphere. △ Less

Submitted 20 July, 2023; originally announced July 2023.

Comments: 75 pages

Disentangling Societal Inequality from Model Biases: Gender Inequality in Divorce Court Proceedings

Authors: Sujan Dutta, Parth Srivastava, Vaishnavi Solunke, Swaprava Nath, Ashiqur R. KhudaBukhsh

Abstract: Divorce is the legal dissolution of a marriage by a court. Since this is usually an unpleasant outcome of a marital union, each party may have reasons to call the decision to quit which is generally documented in detail in the court proceedings. Via a substantial corpus of 17,306 court proceedings, this paper investigates gender inequality through the lens of divorce court proceedings. While emerg… ▽ More Divorce is the legal dissolution of a marriage by a court. Since this is usually an unpleasant outcome of a marital union, each party may have reasons to call the decision to quit which is generally documented in detail in the court proceedings. Via a substantial corpus of 17,306 court proceedings, this paper investigates gender inequality through the lens of divorce court proceedings. While emerging data sources (e.g., public court records) on sensitive societal issues hold promise in aiding social science research, biases present in cutting-edge natural language processing (NLP) methods may interfere with or affect such studies. We thus require a thorough analysis of potential gaps and limitations present in extant NLP resources. In this paper, on the methodological side, we demonstrate that existing NLP resources required several non-trivial modifications to quantify societal inequalities. On the substantive side, we find that while a large number of court cases perhaps suggest changing norms in India where women are increasingly challenging patriarchy, AI-powered analyses of these court proceedings indicate striking gender inequality with women often subjected to domestic violence. △ Less

Submitted 8 July, 2023; originally announced July 2023.

Comments: This paper is accepted at IJCAI 2023 (AI for good track)

Accretion Flow Properties of EXO 1846-031 During its Multi-Peaked Outburst After Long Quiescence

Authors: Sujoy Kumar Nath, Dipak Debnath, Kaushik Chatterjee, Riya Bhowmick, Hsiang-Kuang Chang, Sandip K. Chakrabarti

Abstract: We study the recent outburst of the black hole candidate EXO 1846-031 which went into an outburst in 2019 after almost 34 years in quiescence. We use archival data from Swift/XRT, MAXI/GSC, NICER/XTI and NuSTAR/FPM satellites/instruments to study the evolution of the spectral and temporal properties of the source during the outburst. Low energy (2-10 keV) X-ray flux of the outburst shows multiple… ▽ More We study the recent outburst of the black hole candidate EXO 1846-031 which went into an outburst in 2019 after almost 34 years in quiescence. We use archival data from Swift/XRT, MAXI/GSC, NICER/XTI and NuSTAR/FPM satellites/instruments to study the evolution of the spectral and temporal properties of the source during the outburst. Low energy (2-10 keV) X-ray flux of the outburst shows multiple peaks making it a multipeak outburst. Evolving type-C quasi-periodic oscillations (QPOs) are observed in the NICER data in the hard, hard intermediate and soft intermediate states. We use the physical Two Component Advective Flow (TCAF) model to analyze the combined spectra of multiple satellite instruments. According to the TCAF model, the accreting matter is divided into Keplerian and sub-Keplerian parts, and the variation in the observed spectra in different spectral states arises out of the variable contributions of these two types of accreting matter in the total accretion rate. Studying the evolution of the accretion rates and other properties of the accretion flow obtained from the spectral analysis, we show how the multiple peaks in the outburst flux arises out of variable supply of accreting matter from the pile-up radius. We determine the probable mass of the black hole to be $10.4^{+0.1}_{-0.2}~M_\odot$ from the spectral analysis with the TCAF model. We also estimate viscous time scale of the source in this outburst to be $\sim 8$ days from the peak difference of the Keplerian and sub-Keplerian mass accretion rates. △ Less

Submitted 6 June, 2024; v1 submitted 10 July, 2023; originally announced July 2023.

Comments: 16 pages, 8 Figures, 2 Tables

Journal ref: 2024, ApJ, 960, 5

CAMMARL: Conformal Action Modeling in Multi Agent Reinforcement Learning

Authors: Nikunj Gupta, Somjit Nath, Samira Ebrahimi Kahou

Abstract: Before taking actions in an environment with more than one intelligent agent, an autonomous agent may benefit from reasoning about the other agents and utilizing a notion of a guarantee or confidence about the behavior of the system. In this article, we propose a novel multi-agent reinforcement learning (MARL) algorithm CAMMARL, which involves modeling the actions of other agents in different situ… ▽ More Before taking actions in an environment with more than one intelligent agent, an autonomous agent may benefit from reasoning about the other agents and utilizing a notion of a guarantee or confidence about the behavior of the system. In this article, we propose a novel multi-agent reinforcement learning (MARL) algorithm CAMMARL, which involves modeling the actions of other agents in different situations in the form of confident sets, i.e., sets containing their true actions with a high probability. We then use these estimates to inform an agent's decision-making. For estimating such sets, we use the concept of conformal predictions, by means of which, we not only obtain an estimate of the most probable outcome but get to quantify the operable uncertainty as well. For instance, we can predict a set that provably covers the true predictions with high probabilities (e.g., 95%). Through several experiments in two fully cooperative multi-agent tasks, we show that CAMMARL elevates the capabilities of an autonomous agent in MARL by modeling conformal prediction sets over the behavior of other agents in the environment and utilizing such estimates to enhance its policy learning. △ Less

Submitted 8 February, 2024; v1 submitted 19 June, 2023; originally announced June 2023.

Sharing Lifelong Reinforcement Learning Knowledge via Modulating Masks

Authors: Saptarshi Nath, Christos Peridis, Eseoghene Ben-Iwhiwhu, Xinran Liu, Shirin Dora, Cong Liu, Soheil Kolouri, Andrea Soltoggio

Abstract: Lifelong learning agents aim to learn multiple tasks sequentially over a lifetime. This involves the ability to exploit previous knowledge when learning new tasks and to avoid forgetting. Modulating masks, a specific type of parameter isolation approach, have recently shown promise in both supervised and reinforcement learning. While lifelong learning algorithms have been investigated mainly withi… ▽ More Lifelong learning agents aim to learn multiple tasks sequentially over a lifetime. This involves the ability to exploit previous knowledge when learning new tasks and to avoid forgetting. Modulating masks, a specific type of parameter isolation approach, have recently shown promise in both supervised and reinforcement learning. While lifelong learning algorithms have been investigated mainly within a single-agent approach, a question remains on how multiple agents can share lifelong learning knowledge with each other. We show that the parameter isolation mechanism used by modulating masks is particularly suitable for exchanging knowledge among agents in a distributed and decentralized system of lifelong learners. The key idea is that the isolation of specific task knowledge to specific masks allows agents to transfer only specific knowledge on-demand, resulting in robust and effective distributed lifelong learning. We assume fully distributed and asynchronous scenarios with dynamic agent numbers and connectivity. An on-demand communication protocol ensures agents query their peers for specific masks to be transferred and integrated into their policies when facing each task. Experiments indicate that on-demand mask communication is an effective way to implement distributed lifelong reinforcement learning and provides a lifelong learning benefit with respect to distributed RL baselines such as DD-PPO, IMPALA, and PPO+EWC. The system is particularly robust to connection drops and demonstrates rapid learning due to knowledge exchange. △ Less

Submitted 18 May, 2023; originally announced May 2023.

Comments: 25 pages, 14 figures, 9 tables, to be published in the Second Conference on Lifelong Learning Agents (CoLLAs 2023), code can be found at https://github.com/DMIU-ShELL/deeprl-shell

On the Collaborative Object Transportation Using Leader Follower Approach

Authors: Sumanta Ghosh, Subhajit Nath, Sarvesh Sortee, Lokesh Kumar, Titas Bera

Abstract: In this paper we address the multi-agent collaborative object transportation problem in a partially known environment with obstacles under a specified goal condition. We propose a leader follower approach for two mobile manipulators collaboratively transporting an object along specified desired trajectories. The proposed approach treats the mobile manipulation system as two independent subsystems:… ▽ More In this paper we address the multi-agent collaborative object transportation problem in a partially known environment with obstacles under a specified goal condition. We propose a leader follower approach for two mobile manipulators collaboratively transporting an object along specified desired trajectories. The proposed approach treats the mobile manipulation system as two independent subsystems: a mobile platform and a manipulator arm and uses their kinematics model for trajectory tracking. In this work we considered that the mobile platform is subject to non-holonomic constraints, with a manipulator carrying a rigid load. The desired trajectories of the end points of the load are obtained from Probabilistic RoadMap-based planning approach. Our method combines Proportional Navigation Guidance-based approach with a proposed Stop-and-Sync algorithm to reach sufficiently close to the desired trajectory, the deviation due to the non-holonomic constraints is compensated by the manipulator arm. A leader follower approach for computing inverse kinematics solution for the position of the end-effector of the manipulator arm is proposed to maintain the load rigidity. Further, we compare the proposed approach with other approaches to analyse the efficacy of our algorithm. △ Less

Submitted 2 May, 2023; originally announced May 2023.

Discovering Object-Centric Generalized Value Functions From Pixels

Authors: Somjit Nath, Gopeshh Raaj Subbaraj, Khimya Khetarpal, Samira Ebrahimi Kahou

Abstract: Deep Reinforcement Learning has shown significant progress in extracting useful representations from high-dimensional inputs albeit using hand-crafted auxiliary tasks and pseudo rewards. Automatically learning such representations in an object-centric manner geared towards control and fast adaptation remains an open research problem. In this paper, we introduce a method that tries to discover mean… ▽ More Deep Reinforcement Learning has shown significant progress in extracting useful representations from high-dimensional inputs albeit using hand-crafted auxiliary tasks and pseudo rewards. Automatically learning such representations in an object-centric manner geared towards control and fast adaptation remains an open research problem. In this paper, we introduce a method that tries to discover meaningful features from objects, translating them to temporally coherent "question" functions and leveraging the subsequent learned general value functions for control. We compare our approach with state-of-the-art techniques alongside other ablations and show competitive performance in both stationary and non-stationary settings. Finally, we also investigate the discovered general value functions and through qualitative analysis show that the learned representations are not only interpretable but also, centered around objects that are invariant to changes across tasks facilitating fast adaptation. △ Less

Submitted 27 June, 2023; v1 submitted 26 April, 2023; originally announced April 2023.

Comments: Accepted at ICML 2023

Irregular dependence on Stokes number and non-ergodic transport of heavy inertial particles in steady laminar flows

Authors: Anu V. S. Nath, Anubhab Roy, S. Ravichandran, Rama Govindarajan

Abstract: Small heavy particles in a fluid flow respond to the flow on a time-scale proportional to their inertia, or Stokes number St. Their behaviour is thought to be gradually modified as St increases. We show, in the steady spatially-periodic laminar Taylor-Green flow, that particle dynamics, and their effective diffusivity, actually change in an irregular, non-monotonic and sometimes discontinuous mann… ▽ More Small heavy particles in a fluid flow respond to the flow on a time-scale proportional to their inertia, or Stokes number St. Their behaviour is thought to be gradually modified as St increases. We show, in the steady spatially-periodic laminar Taylor-Green flow, that particle dynamics, and their effective diffusivity, actually change in an irregular, non-monotonic and sometimes discontinuous manner, with increasing St. At Stokes of order one, we show chaotic particle motion, contrasting earlier conclusions for heavy particles in the same flow (Wang et al. 1992). Particles may display trapped orbits, or unbounded diffusive or ballistic dispersion, with the vortices behaving like scatterers in a soft Lorentz gas (Klages et al. 2019). The dynamics is non-ergodic. We discuss the possible consequences of our findings for particulate turbulent flows. △ Less

Submitted 19 April, 2023; originally announced April 2023.

Experimental investigation of the effect of topological insulator on the magnetization dynamics of ferromagnetic metal: $BiSbTe_{1.5}Se_{1.5}$ and $Ni_{80}Fe_{20}$ heterostructure

Authors: Sayani Pal, Soumik Aon, Subhadip Manna, Sambhu G Nath, Kanav Sharma, Chiranjib Mitra

Abstract: We have studied ferromagnetic metal/topological insulator bilayer system to understand magnetization dynamics of ferromagnetic metal (FM) in contact with a topological insulator (TI). At magnetic resonance condition, the precessing magnetization in the metallic ferromagnet ($Ni_{80}Fe_{20}$) injects spin current into the topological insulator ($BiSbTe_{1.5}Se_{1.5}$), a phenomenon known as spin-pu… ▽ More We have studied ferromagnetic metal/topological insulator bilayer system to understand magnetization dynamics of ferromagnetic metal (FM) in contact with a topological insulator (TI). At magnetic resonance condition, the precessing magnetization in the metallic ferromagnet ($Ni_{80}Fe_{20}$) injects spin current into the topological insulator ($BiSbTe_{1.5}Se_{1.5}$), a phenomenon known as spin-pumping. Due to the spin pumping effect, fast relaxation in the ferromagnet results in the broadening of ferromagnetic resonance linewidth ($ΔH$). We evaluated the parameters like effective Gilbert damping coefficient ($α_{eff}$), spin-mixing conductance ($g_{eff}^{\uparrow \downarrow}$) and spin current density ($j_S^0$) to confirm a successful spin injection due to spin-pumping into the $BiSbTe_{1.5}Se_{1.5}$ layer. TIs embody a spin-momentum locked surface state that span the bulk band-gap. It can act differently to the FM magnetization than the other normal metals. To probe the effect of topological surface state, a systematic low temperature study is crucial as surface state of TI dominates at lower temperatures. The exponential growth of $ΔH$ for all different thickness combination of FM/TI bilayers and effective Gilbert damping coefficient ($α_{eff}$) with lowering temperature confirms the prediction that spin chemical bias generated from spin-pumping induces surface current in TI due to spin-momentum locking. The hump-like feature of magnetic anisotropy field ($H_K$)of the bilayer around 60K suggests that the decrease of interfacial in-plane magnetic anisotropy can result from exchange coupling between the TI surface state and the local moments of FM layer. △ Less

Submitted 24 November, 2023; v1 submitted 13 March, 2023; originally announced March 2023.

Lifelong Reinforcement Learning with Modulating Masks

Authors: Eseoghene Ben-Iwhiwhu, Saptarshi Nath, Praveen K. Pilly, Soheil Kolouri, Andrea Soltoggio

Abstract: Lifelong learning aims to create AI systems that continuously and incrementally learn during a lifetime, similar to biological learning. Attempts so far have met problems, including catastrophic forgetting, interference among tasks, and the inability to exploit previous knowledge. While considerable research has focused on learning multiple supervised classification tasks that involve changes in t… ▽ More Lifelong learning aims to create AI systems that continuously and incrementally learn during a lifetime, similar to biological learning. Attempts so far have met problems, including catastrophic forgetting, interference among tasks, and the inability to exploit previous knowledge. While considerable research has focused on learning multiple supervised classification tasks that involve changes in the input distribution, lifelong reinforcement learning (LRL) must deal with variations in the state and transition distributions, and in the reward functions. Modulating masks with a fixed backbone network, recently developed for classification, are particularly suitable to deal with such a large spectrum of task variations. In this paper, we adapted modulating masks to work with deep LRL, specifically PPO and IMPALA agents. The comparison with LRL baselines in both discrete and continuous RL tasks shows superior performance. We further investigated the use of a linear combination of previously learned masks to exploit previous knowledge when learning new tasks: not only is learning faster, the algorithm solves tasks that we could not otherwise solve from scratch due to extremely sparse rewards. The results suggest that RL with modulating masks is a promising approach to lifelong learning, to the composition of knowledge to learn increasingly complex tasks, and to knowledge reuse for efficient and faster learning. △ Less

Submitted 1 August, 2023; v1 submitted 21 December, 2022; originally announced December 2022.

Comments: Code available at https://github.com/dlpbc/mask-lrl

Journal ref: Transactions on Machine Learning Research (2023)

Locally Constrained Representations in Reinforcement Learning

Authors: Somjit Nath, Rushiv Arora, Samira Ebrahimi Kahou

Abstract: The success of Reinforcement Learning (RL) heavily relies on the ability to learn robust representations from the observations of the environment. In most cases, the representations learned purely by the reinforcement learning loss can differ vastly across states depending on how the value functions change. However, the representations learned need not be very specific to the task at hand. Relying… ▽ More The success of Reinforcement Learning (RL) heavily relies on the ability to learn robust representations from the observations of the environment. In most cases, the representations learned purely by the reinforcement learning loss can differ vastly across states depending on how the value functions change. However, the representations learned need not be very specific to the task at hand. Relying only on the RL objective may yield representations that vary greatly across successive time steps. In addition, since the RL loss has a changing target, the representations learned would depend on how good the current values/policies are. Thus, disentangling the representations from the main task would allow them to focus not only on the task-specific features but also the environment dynamics. To this end, we propose locally constrained representations, where an auxiliary loss forces the state representations to be predictable by the representations of the neighboring states. This encourages the representations to be driven not only by the value/policy learning but also by an additional loss that constrains the representations from over-fitting to the value loss. We evaluate the proposed method on several known benchmarks and observe strong performance. Especially in continuous control tasks, our experiments show a significant performance improvement. △ Less

Submitted 8 February, 2024; v1 submitted 19 September, 2022; originally announced September 2022.

Properties of MAXI J1348-630 during Its Second Outburst in 2019

Authors: Riya Bhowmick, Dipak Debnath, Kaushik Chatterjee, Arghajit Jana, Sujoy Kumar Nath

Abstract: The newly discovered galactic black hole candidate (BHC) MAXI~J1348-630 showed two major outbursts in 2019, just after its discovery. Here, we provide a detailed spectral and temporal analysis of the less-studied second outburst using archive data from multiple satellites, namely Swift, MAXI, NICER, NuSTAR and AstroSat. The outburst continued for around two and a half months. Unlike the first outb… ▽ More The newly discovered galactic black hole candidate (BHC) MAXI~J1348-630 showed two major outbursts in 2019, just after its discovery. Here, we provide a detailed spectral and temporal analysis of the less-studied second outburst using archive data from multiple satellites, namely Swift, MAXI, NICER, NuSTAR and AstroSat. The outburst continued for around two and a half months. Unlike the first outburst from this source, this second outburst was a `failed' one. The source did not transition to soft or intermediate spectral states. During the entire outburst, the source was in the hard state with high dominance of non-thermal photons. The presence of strong shocks are inferred from spectral fitting using a TCAF model. In NuSTAR spectra, weak reflection is observed from spectral fitting. Low-frequency quasi-periodic oscillations are also detected in AstroSat data. △ Less

Submitted 6 September, 2022; originally announced September 2022.

Comments: 22 Pages, 9 Figures, 6 Tables (accepted for publication in Galaxies MDPI Journal)

Prioritizing Samples in Reinforcement Learning with Reducible Loss

Authors: Shivakanth Sujit, Somjit Nath, Pedro H. M. Braga, Samira Ebrahimi Kahou

Abstract: Most reinforcement learning algorithms take advantage of an experience replay buffer to repeatedly train on samples the agent has observed in the past. Not all samples carry the same amount of significance and simply assigning equal importance to each of the samples is a naïve strategy. In this paper, we propose a method to prioritize samples based on how much we can learn from a sample. We define… ▽ More Most reinforcement learning algorithms take advantage of an experience replay buffer to repeatedly train on samples the agent has observed in the past. Not all samples carry the same amount of significance and simply assigning equal importance to each of the samples is a naïve strategy. In this paper, we propose a method to prioritize samples based on how much we can learn from a sample. We define the learn-ability of a sample as the steady decrease of the training loss associated with this sample over time. We develop an algorithm to prioritize samples with high learn-ability, while assigning lower priority to those that are hard-to-learn, typically caused by noise or stochasticity. We empirically show that our method is more robust than random sampling and also better than just prioritizing with respect to the training loss, i.e. the temporal difference loss, which is used in prioritized experience replay. △ Less

Submitted 1 November, 2023; v1 submitted 22 August, 2022; originally announced August 2022.

Comments: NeurIPS 2023

Optimal Referral Auction Design

Authors: Rangeet Bhattacharyya, Parvik Dave, Palash Dey, Swaprava Nath

Abstract: The auction of a single indivisible item is one of the most celebrated problems in mechanism design with transfers. Despite its simplicity, it provides arguably the cleanest and most insightful results in the literature. When the information that the auction is running is available to every participant, Myerson [20] provided a seminal result to characterize the incentive-compatible auctions along… ▽ More The auction of a single indivisible item is one of the most celebrated problems in mechanism design with transfers. Despite its simplicity, it provides arguably the cleanest and most insightful results in the literature. When the information that the auction is running is available to every participant, Myerson [20] provided a seminal result to characterize the incentive-compatible auctions along with revenue optimality. However, such a result does not hold in an auction on a network, where the information of the auction is spread via the agents, and they need incentives to forward the information. In recent times, a few auctions (e.g., [13, 18]) were designed that appropriately incentivized the intermediate nodes on the network to promulgate the information to potentially more valuable bidders. In this paper, we provide a Myerson-like characterization of incentive-compatible auctions on a network and show that the currently known auctions fall within this class of randomized auctions. We then consider a special class called the referral auctions that are inspired by the multi-level marketing mechanisms [1, 6, 7] and obtain the structure of a revenue optimal referral auction for i.i.d. bidders. Through experiments, we show that even for non-i.i.d. bidders there exist auctions following this characterization that can provide a higher revenue than the currently known auctions on networks. △ Less

Submitted 1 July, 2023; v1 submitted 19 August, 2022; originally announced August 2022.

Comments: 26 pages, version 2

Identical Image Retrieval using Deep Learning

Authors: Sayan Nath, Nikhil Nayak

Abstract: In recent years, we know that the interaction with images has increased. Image similarity involves fetching similar-looking images abiding by a given reference image. The target is to find out whether the image searched as a query can result in similar pictures. We are using the BigTransfer Model, which is a state-of-art model itself. BigTransfer(BiT) is essentially a ResNet but pre-trained on a l… ▽ More In recent years, we know that the interaction with images has increased. Image similarity involves fetching similar-looking images abiding by a given reference image. The target is to find out whether the image searched as a query can result in similar pictures. We are using the BigTransfer Model, which is a state-of-art model itself. BigTransfer(BiT) is essentially a ResNet but pre-trained on a larger dataset like ImageNet and ImageNet-21k with additional modifications. Using the fine-tuned pre-trained Convolution Neural Network Model, we extract the key features and train on the K-Nearest Neighbor model to obtain the nearest neighbor. The application of our model is to find similar images, which are hard to achieve through text queries within a low inference time. We analyse the benchmark of our model based on this application. △ Less

Submitted 18 May, 2022; v1 submitted 10 May, 2022; originally announced May 2022.

Exploring Relevant Artifacts of Release Notes: The Practitioners' Perspective

Authors: Sristy Sumana Nath, Banani Roy

Abstract: A software release note is one of the essential documents in the software development life cycle. The software release contains a set of information, e.g., bug fixes and security fixes. Release notes are used in different phases, e.g., requirement engineering, software testing and release management. Different types of practitioners (e.g., project managers and clients) get benefited from the relea… ▽ More A software release note is one of the essential documents in the software development life cycle. The software release contains a set of information, e.g., bug fixes and security fixes. Release notes are used in different phases, e.g., requirement engineering, software testing and release management. Different types of practitioners (e.g., project managers and clients) get benefited from the release notes to understand the overview of the latest release. As a result, several studies have been done about release notes production and usage in practice. However, two significant problems (e.g., duplication and inconsistency in release notes contents) exist in producing well-written & well-structured release notes and organizing appropriate information regarding different targeted users' needs. For that reason, practitioners face difficulties in writing and reading the release notes using existing tools. To mitigate these problems, we execute two different studies in our paper. First, we execute an exploratory study by analyzing 3,347 release notes of 21 GitHub repositories to understand the documented contents of the release notes. As a result, we find relevant key artifacts, e.g., issues (29%), pull-requests (32%), commits (19%), and common vulnerabilities and exposures (CVE) issues (6%) in the release note contents. Second, we conduct a survey study with 32 professionals to understand the key information that is included in release notes regarding users' roles. For example, project managers are more interested in learning about new features than less critical bug fixes. Our study can guide future research directions to help practitioners produce the release notes with relevant content and improve the documentation quality. △ Less

Submitted 11 April, 2022; originally announced April 2022.

Journal ref: 29th IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER 2022)

Towards Automatically Generating Release Notes using Extractive Summarization Technique

Authors: Sristy Sumana Nath, Banani Roy

Abstract: Release notes are admitted as an essential document by practitioners. They contain the summary of the source code changes for the software releases, such as issue fixes, added new features, and performance improvements. Manually producing release notes is a time-consuming and challenging task. For that reason, sometimes developers neglect to write release notes. For example, we collect data from G… ▽ More Release notes are admitted as an essential document by practitioners. They contain the summary of the source code changes for the software releases, such as issue fixes, added new features, and performance improvements. Manually producing release notes is a time-consuming and challenging task. For that reason, sometimes developers neglect to write release notes. For example, we collect data from GitHub with over 1,900 releases, among them 37% of the release notes are empty. We propose an automatic generate release notes approach based on the commit messages and merge pull-request (PR) titles to mitigate this problem. We implement one of the popular extractive text summarization techniques, i.e., the TextRank algorithm. However, accurate keyword extraction is a vital issue in text processing. The keyword matching and topic extraction process of the TextRank algorithm ignores the semantic similarity among texts. To improve the keyword extraction method, we integrate the GloVe word embedding technique with TextRank. We develop a dataset with 1,213 release notes (after null filtering) and evaluate the generated release notes through the ROUGE metric and human evaluation. We also compare the performance of our technique with another popular extractive algorithm, latent semantic analysis (LSA). Our evaluation results show that the improved TextRank method outperforms LSA. △ Less

Submitted 11 April, 2022; originally announced April 2022.

Comments: arXiv admin note: text overlap with arXiv:1909.06987 by other authors

Journal ref: The 33rd International Conference on Software Engineering & Knowledge Engineering (SEKE 2021)

Identifying Peer Influence in Therapeutic Communities Adjusting for Latent Homophily

Authors: Shanjukta Nath, Keith Warren, Subhadeep Paul

Abstract: We investigate peer role model influence on successful graduation from Therapeutic Communities (TCs) for substance abuse and criminal behavior. We use data from 3 TCs that kept records of exchanges of affirmations among residents and their precise entry and exit dates, allowing us to form peer networks and define a causal effect of interest. The role model effect measures the difference in the exp… ▽ More We investigate peer role model influence on successful graduation from Therapeutic Communities (TCs) for substance abuse and criminal behavior. We use data from 3 TCs that kept records of exchanges of affirmations among residents and their precise entry and exit dates, allowing us to form peer networks and define a causal effect of interest. The role model effect measures the difference in the expected outcome of a resident (ego) who can observe one of their peers graduate before the ego's exit vs not graduating. To identify peer influence in the presence of unobserved homophily in observational data, we model the network with a latent variable model. We show that our peer influence estimator is asymptotically unbiased when the unobserved latent positions are estimated from the observed network. We additionally propose a measurement error bias correction method to further reduce bias due to estimating latent positions. Our simulations show the proposed latent homophily adjustment and bias correction perform well in finite samples. We also extend the methodology to the case of binary response with a probit model. Our results indicate a positive effect of peers' graduation on residents' graduation and that it differs based on gender, race, and the definition of the role model effect. A counterfactual exercise quantifies the potential benefits of an intervention directly on the treated resident and indirectly on their peers through network propagation. △ Less

Submitted 10 June, 2024; v1 submitted 27 March, 2022; originally announced March 2022.

A Learning Based Framework for Handling Uncertain Lead Times in Multi-Product Inventory Management

Authors: Hardik Meisheri, Somjit Nath, Mayank Baranwal, Harshad Khadilkar

Abstract: Most existing literature on supply chain and inventory management consider stochastic demand processes with zero or constant lead times. While it is true that in certain niche scenarios, uncertainty in lead times can be ignored, most real-world scenarios exhibit stochasticity in lead times. These random fluctuations can be caused due to uncertainty in arrival of raw materials at the manufacturer's… ▽ More Most existing literature on supply chain and inventory management consider stochastic demand processes with zero or constant lead times. While it is true that in certain niche scenarios, uncertainty in lead times can be ignored, most real-world scenarios exhibit stochasticity in lead times. These random fluctuations can be caused due to uncertainty in arrival of raw materials at the manufacturer's end, delay in transportation, an unforeseen surge in demands, and switching to a different vendor, to name a few. Stochasticity in lead times is known to severely degrade the performance in an inventory management system, and it is only fair to abridge this gap in supply chain system through a principled approach. Motivated by the recently introduced delay-resolved deep Q-learning (DRDQN) algorithm, this paper develops a reinforcement learning based paradigm for handling uncertainty in lead times (\emph{action delay}). Through empirical evaluations, it is further shown that the inventory management with uncertain lead times is not only equivalent to that of delay in information sharing across multiple echelons (\emph{observation delay}), a model trained to handle one kind of delay is capable to handle delays of another kind without requiring to be retrained. Finally, we apply the delay-resolved framework to scenarios comprising of multiple products subjected to stochasticity in lead times, and elucidate how the delay-resolved framework negates the effect of any delay to achieve near-optimal performance. △ Less

Submitted 8 March, 2022; v1 submitted 2 March, 2022; originally announced March 2022.