Showing 1–50 of 263 results for author: Sen, P

SiCo: A Size-Controllable Virtual Try-On Approach for Informed Decision-Making

Authors: Sherry X. Chen, Alex Christopher Lim, Yimeng Liu, Pradeep Sen, Misha Sra

Abstract: Virtual try-on (VTO) applications aim to improve the online shopping experience by allowing users to preview garments, before making purchase decisions. However, many VTO tools fail to consider the crucial relationship between a garment's size and the user's body size, often employing a one-size-fits-all approach when visualizing a clothing item. This results in poor size recommendations and purch… ▽ More Virtual try-on (VTO) applications aim to improve the online shopping experience by allowing users to preview garments, before making purchase decisions. However, many VTO tools fail to consider the crucial relationship between a garment's size and the user's body size, often employing a one-size-fits-all approach when visualizing a clothing item. This results in poor size recommendations and purchase decisions leading to increased return rates. To address this limitation, we introduce SiCo, an online VTO system, where users can upload images of themselves and visualize how different sizes of clothing would look on their body to help make better-informed purchase decisions. Our user study shows SiCo's superiority over baseline VTO. The results indicate that our approach significantly enhances user ability to gauge the appearance of outfits on their bodies and boosts their confidence in selecting clothing sizes that match desired goals. Based on our evaluation, we believe our VTO design has the potential to reduce return rates and enhance the online clothes shopping experience. Our code is available at https://github.com/SherryXTChen/SiCo. △ Less

Submitted 5 August, 2024; originally announced August 2024.

Adaptive Retrieval-Augmented Generation for Conversational Systems

Authors: Xi Wang, Procheta Sen, Ruizhe Li, Emine Yilmaz

Abstract: Despite the success of integrating large language models into the development of conversational systems, many studies have shown the effectiveness of retrieving and augmenting external knowledge for informative responses. Hence, many existing studies commonly assume the always need for Retrieval Augmented Generation (RAG) in a conversational system without explicit control. This raises a research… ▽ More Despite the success of integrating large language models into the development of conversational systems, many studies have shown the effectiveness of retrieving and augmenting external knowledge for informative responses. Hence, many existing studies commonly assume the always need for Retrieval Augmented Generation (RAG) in a conversational system without explicit control. This raises a research question about such a necessity. In this study, we propose to investigate the need for each turn of system response to be augmented with external knowledge. In particular, by leveraging human judgements on the binary choice of adaptive augmentation, we develop RAGate, a gating model, which models conversation context and relevant inputs to predict if a conversational system requires RAG for improved responses. We conduct extensive experiments on devising and applying RAGate to conversational models and well-rounded analyses of different conversational scenarios. Our experimental results and analysis indicate the effective application of RAGate in RAG-based conversational systems in identifying system responses for appropriate RAG with high-quality responses and a high generation confidence. This study also identifies the correlation between the generation's confidence level and the relevance of the augmented knowledge. △ Less

Submitted 31 July, 2024; originally announced July 2024.

Comments: 12 pages, under review

AID-AppEAL: Automatic Image Dataset and Algorithm for Content Appeal Enhancement and Assessment Labeling

Authors: Sherry X. Chen, Yaron Vaxman, Elad Ben Baruch, David Asulin, Aviad Moreshet, Misha Sra, Pradeep Sen

Abstract: We propose Image Content Appeal Assessment (ICAA), a novel metric that quantifies the level of positive interest an image's content generates for viewers, such as the appeal of food in a photograph. This is fundamentally different from traditional Image-Aesthetics Assessment (IAA), which judges an image's artistic quality. While previous studies often confuse the concepts of ``aesthetics'' and ``a… ▽ More We propose Image Content Appeal Assessment (ICAA), a novel metric that quantifies the level of positive interest an image's content generates for viewers, such as the appeal of food in a photograph. This is fundamentally different from traditional Image-Aesthetics Assessment (IAA), which judges an image's artistic quality. While previous studies often confuse the concepts of ``aesthetics'' and ``appeal,'' our work addresses this by being the first to study ICAA explicitly. To do this, we propose a novel system that automates dataset creation and implements algorithms to estimate and boost content appeal. We use our pipeline to generate two large-scale datasets (70K+ images each) in diverse domains (food and room interior design) to train our models, which revealed little correlation between content appeal and aesthetics. Our user study, with more than 76% of participants preferring the appeal-enhanced images, confirms that our appeal ratings accurately reflect user preferences, establishing ICAA as a unique evaluative criterion. Our code and datasets are available at https://github.com/SherryXTChen/AID-Appeal. △ Less

Submitted 18 July, 2024; v1 submitted 7 July, 2024; originally announced July 2024.

Comments: European Conference on Computer Vision (ECCV) 2024

NLO thermal corrections to dark matter annihilation cross sections: a novel approach

Authors: Prabhat Butola, D. Indumathi, Pritam Sen

Abstract: The dark matter relic density has been increasingly accurately measured by successive generations of experiments. The Boltzmann equation determines the yields using the dark matter annihilation cross section as one of the inputs; the accurate computation of the latter including thermal contributions thus assumes importance. We report here the next-to-leading order (NLO) thermal corrections to the… ▽ More The dark matter relic density has been increasingly accurately measured by successive generations of experiments. The Boltzmann equation determines the yields using the dark matter annihilation cross section as one of the inputs; the accurate computation of the latter including thermal contributions thus assumes importance. We report here the next-to-leading order (NLO) thermal corrections to the cross sections for (Majorana) dark matter annihilation to standard model fermions: $χχ\to f \overline{f}$, via charged scalars. We use a novel approach, utilising the technique of Grammer and Yennie, extended to thermal field theories, where the cancellation of soft infra-red divergences occurs naturally. We present the NLO thermal cross sections in full detail for both the relativistic case as well as in the non-relativistic limit. Our independent calculation verifies earlier results where the leading contribution at order ${\cal{O}}(T^2)$ was shown to be proportional to the square of the fermion mass in the non-relativistic limit, just as at leading order. We find that the ${\cal{O}}(T^4)$ contributions have the same dependence on the fermion mass as well. △ Less

Submitted 4 July, 2024; v1 submitted 24 April, 2024; originally announced April 2024.

Comments: 36 pages, 4 figures, version accepted in Phys Rev D

TiNO-Edit: Timestep and Noise Optimization for Robust Diffusion-Based Image Editing

Authors: Sherry X. Chen, Yaron Vaxman, Elad Ben Baruch, David Asulin, Aviad Moreshet, Kuo-Chin Lien, Misha Sra, Pradeep Sen

Abstract: Despite many attempts to leverage pre-trained text-to-image models (T2I) like Stable Diffusion (SD) for controllable image editing, producing good predictable results remains a challenge. Previous approaches have focused on either fine-tuning pre-trained T2I models on specific datasets to generate certain kinds of images (e.g., with a specific object or person), or on optimizing the weights, text… ▽ More Despite many attempts to leverage pre-trained text-to-image models (T2I) like Stable Diffusion (SD) for controllable image editing, producing good predictable results remains a challenge. Previous approaches have focused on either fine-tuning pre-trained T2I models on specific datasets to generate certain kinds of images (e.g., with a specific object or person), or on optimizing the weights, text prompts, and/or learning features for each input image in an attempt to coax the image generator to produce the desired result. However, these approaches all have shortcomings and fail to produce good results in a predictable and controllable manner. To address this problem, we present TiNO-Edit, an SD-based method that focuses on optimizing the noise patterns and diffusion timesteps during editing, something previously unexplored in the literature. With this simple change, we are able to generate results that both better align with the original images and reflect the desired result. Furthermore, we propose a set of new loss functions that operate in the latent domain of SD, greatly speeding up the optimization when compared to prior approaches, which operate in the pixel domain. Our method can be easily applied to variations of SD including Textual Inversion and DreamBooth that encode new concepts and incorporate them into the edited results. We present a host of image-editing capabilities enabled by our approach. Our code is publicly available at https://github.com/SherryXTChen/TiNO-Edit. △ Less

Submitted 17 April, 2024; originally announced April 2024.

Comments: Conference on Computer Vision and Pattern Recognition (CVPR) 2024

One-Shot Non-Catalytic Distributed Purity Distillation

Authors: Sayantan Chakraborty, Rahul Jain, Pranab Sen

Abstract: Pure states are an important resource in many quantum information processing protocols. However, even making a fixed pure state, say $|0\rangle$, in the laboratory requires a considerable amount of effort. Often one ends up with a mixed state $ρ$ whose classical description is nevertheless known. Hence it is important to develop protocols that extract a fixed pure state from a known mixed state. I… ▽ More Pure states are an important resource in many quantum information processing protocols. However, even making a fixed pure state, say $|0\rangle$, in the laboratory requires a considerable amount of effort. Often one ends up with a mixed state $ρ$ whose classical description is nevertheless known. Hence it is important to develop protocols that extract a fixed pure state from a known mixed state. In this work, we study the problem of extracting a fixed pure state $|0\rangle^{A'} |0\rangle^{B'}$ from a known pure state $ρ^{AB}$ distributed between two parties $A$ and $B$. Here, $A'$, $B'$ are subspaces of $A$, $B$ and the total amount of purity extracted is $\log |A'| + \log |B'|$. The parties can borrow local pure ancilla, apply local unitary operations and send a message from $A$ to $B$ through a dephasing channel. If local pure ancilla is borrowed, it must be subtracted in order to properly account for the purity extracted. We obtain the most efficient achievable bounds on one shot distributed purity extraction, in terms of the rate of local ancilla borrowed by the protocol, while distilling pure qubits at the best known rate. Our protocols borrow little to no local pure ancilla. Our bounds improve upon the existing bounds for this problem in both one shot as well as asymptotic iid settings. In particular they subsume all the asymptotic iid results of Devetak and Krovi-Devetak. In addition, we derive upper bounds for the rate of distillation in the one shot setting, which nearly match our achievable bounds. △ Less

Submitted 25 March, 2024; originally announced March 2024.

Quantum Entanglement in a Diluted Magnetic Semiconductor Quantum Dot

Authors: Manish Kumar Mehta, Joseph Thomas Andrews, Pratima Sen

Abstract: We investigated the entanglement in a diluted magnetic semiconductor quantum dot, crucial for quantum technologies. Despite their potential, these systems exhibit low extraction rates. We explore self-assembled InGaAs quantum dots, focusing on entanglement between them based on spin states. Our analysis involves defining wavefunctions, employing density matrix operators, and measuring entanglement… ▽ More We investigated the entanglement in a diluted magnetic semiconductor quantum dot, crucial for quantum technologies. Despite their potential, these systems exhibit low extraction rates. We explore self-assembled InGaAs quantum dots, focusing on entanglement between them based on spin states. Our analysis involves defining wavefunctions, employing density matrix operators, and measuring entanglement entropy. Numerical assessments reveal few promising pairs among various quantum dot combinations that exhibit significant entanglement. Additionally, this work discusses theoretical developments and statistical evaluations of entanglement in diluted magnetic semiconductor quantum dots, providing insights into their potential for quantum applications. △ Less

Submitted 11 March, 2024; originally announced March 2024.

Comments: 9 pages 4 figures

Impact of the Antenna on the Sub-Terahertz Indoor Channel Characteristics: An Experimental Approach

Authors: Priyangshu Sen, Sherif Badran, Vitaly Petrov, Arjun Singh, Josep M. Jornet

Abstract: Terahertz-band (100 GHz-10 THz) communication is a promising radio technology envisioned to enable ultra-high data rate, reliable and low-latency wireless connectivity in next-generation wireless systems. However, the low transmission power of THz transmitters, the need for high gain directional antennas, and the complex interaction of THz radiation with common objects along the propagation path m… ▽ More Terahertz-band (100 GHz-10 THz) communication is a promising radio technology envisioned to enable ultra-high data rate, reliable and low-latency wireless connectivity in next-generation wireless systems. However, the low transmission power of THz transmitters, the need for high gain directional antennas, and the complex interaction of THz radiation with common objects along the propagation path make crucial the understanding of the THz channel. In this paper, we conduct an extensive channel measurement campaign in an indoor setting (i.e., a conference room) through a channel sounder with 0.1 ns time resolution and 20 GHz bandwidth at 140 GHz. Particularly, the impact of different antenna directivities (and, thus, beam widths) on the channel characteristics is extensively studied. The experimentally obtained dataset is processed to develop the path loss model and, subsequently, derive key channel metrics such as the path loss exponent, delay spread, and K-factor. The results highlight the multi-faceted impact of the antenna gain on the channel and, by extension, the wireless system and, thus, show that an antenna-agnostic channel model cannot capture the propagation characteristics of the THz channel. △ Less

Submitted 6 March, 2024; originally announced March 2024.

Comments: Accepted and to be published in IEEE ICC 2024. Copyright © 2024 by the Institute of Electrical and Electronics Engineers (IEEE). Permission to make digital or hard copies of portions of this work for personal or classroom use is granted without fee provided that the copies are not made or distributed for profit or commercial advantage

Journal ref: ICC 2024 - IEEE International Conference on Communications, Denver, CO, USA, 2024, pp. 2537-2542

Virtual walks and phase transitions in two dimensional BChS model with extreme switches

Authors: Kathakali Biswas, Parongama Sen

Abstract: We have studied a walk in a one-dimensional virtual space corresponding to an extended version of the three-state BChS model of opinion formation, originally proposed in Physica A {\bf 391}, 3257 (2012), in which the agents are located on a two dimensional lattice. The opinions are designated by the values $\pm1$ and zero. Here we also consider switches between the extreme states $\pm 1$. The mode… ▽ More We have studied a walk in a one-dimensional virtual space corresponding to an extended version of the three-state BChS model of opinion formation, originally proposed in Physica A {\bf 391}, 3257 (2012), in which the agents are located on a two dimensional lattice. The opinions are designated by the values $\pm1$ and zero. Here we also consider switches between the extreme states $\pm 1$. The model involves two noise parameters representing the fraction of negative interactions $p$ and the probability of extreme switch denoted by $q$. The study shows that the nature of the walks changes drastically as the noise parameters exceed certain threshold values. The order-disorder phase transitions are independently obtained using the finite size scaling method showing that these threshold values are indeed consistent with those values of the parameters where a phase transition exists. The criticality is found to be Ising-like even when extreme switches are allowed. A new critical exponent associated with the probability distribution of the displacement is also obtained independent of the values of the critical parameters. The nature of the walks is compared to similar virtual walks studied earlier. △ Less

Submitted 6 March, 2024; originally announced March 2024.

Comments: 6 pages, 10 figures

Dimension-Dependent Critical Scaling Analysis and Emergent Competing Interaction Scales in a 2D Van der Waals magnet Cr$_{2}$Ge$_{2}$Te$_{6}$

Authors: P. C. Mahato, Suprotim Saha, Bikash Das, Subhadeep Datta, Rajib Mondal, Sourav Mal, Ashish Garg, Prasenjit Sen, S. S. Banerjee

Abstract: We investigate thickness-dependent transformation from a paramagnetic to ferromagnetic phase in Cr$_{2}$Ge$_{2}$Te$_{6}$ (CGT) in bulk and few-layer flake forms. 2D Ising-like critical transition in bulk CGT occurs at $T_{c}$ = 67 K with out-of-plane magnetic anisotropy. Few-layer CGT on hBN/SiO$_{2}$/Si substrate displays the same $T_{c}$ but also exhibits a new critical transition at… ▽ More We investigate thickness-dependent transformation from a paramagnetic to ferromagnetic phase in Cr$_{2}$Ge$_{2}$Te$_{6}$ (CGT) in bulk and few-layer flake forms. 2D Ising-like critical transition in bulk CGT occurs at $T_{c}$ = 67 K with out-of-plane magnetic anisotropy. Few-layer CGT on hBN/SiO$_{2}$/Si substrate displays the same $T_{c}$ but also exhibits a new critical transition at $T^{\prime}_c$ = 14.2 K. Here, critical scaling analysis reveals the critical exponents differ significantly from those in bulk and do not align with the known universality classes. Our Density Functional Theory (DFT) and classical calculations indicate competition between magnetocrystalline and dipolar anisotropy emerges with reduced dimensions. The observed behavior is due to minor structural distortions in low dimensional CGT, which modify the balance between spin-orbit coupling, exchange interactions and dipolar anisotropy. This triggers a critical crossover at $T^{\prime}_c$. Our study shows the emergence of a complex interplay of short- and long-range interactions below $T^{\prime}_c$ as CGT approaches the 2D limit. △ Less

Submitted 15 February, 2024; originally announced February 2024.

Comments: Paper to appear in Physical Review B (in press, 2024)

Journal ref: Physical Review B 109, 165405 (2024)

Graph database while computationally efficient filters out quickly the ESG integrated equities in investment management

Authors: Partha Sen, Sumana Sen

Abstract: Design/methodology/approach This research evaluated the databases of SQL, No-SQL and graph databases to compare and contrast efficiency and performance. To perform this experiment the data were collected from multiple sources including stock price and financial news. Python is used as an interface to connect and query databases (to create database structures according to the feed file structure, t… ▽ More Design/methodology/approach This research evaluated the databases of SQL, No-SQL and graph databases to compare and contrast efficiency and performance. To perform this experiment the data were collected from multiple sources including stock price and financial news. Python is used as an interface to connect and query databases (to create database structures according to the feed file structure, to load data into tables, objects, to read data , to connect PostgreSQL, ElasticSearch, Neo4j. Purpose Modern applications of LLM (Large language model) including RAG (Retrieval Augmented Generation) with Machine Learning, deep learning, NLP (natural language processing) or Decision Analytics are computationally expensive. Finding a better option to consume less resources and time to get the result. Findings The Graph database of ESG (Environmental, Social and Governance) is comparatively better and can be considered for extended analytics to integrate ESG in business and investment. Practical implications A graph ML with a RAG architecture model can be introduced as a new framework with less computationally expensive LLM application in the equity filtering process for portfolio management. Originality/value Filtering out selective stocks out of two thousand or more listed companies in any stock exchange for active investment, consuming less resource consumption especially memory and energy to integrate artificial intelligence and ESG in business and investment. △ Less

Submitted 15 January, 2024; originally announced January 2024.

Comments: 10 pages, 17 figures

Multi-messenger astronomy in the new physics modality with GPS constellation

Authors: Arko P. Sen, Kalia Pfeffer, Paul Ries, Geoffrey Blewitt, Andrei Derevianko

Abstract: We explore a novel, exotic physics, modality in multi-messenger astronomy. We are interested in exotic fields emitted by the mergers and their direct detection with a network of atomic clocks. We specifically focus on the rubidium clocks onboard satellites of the Global Positioning System. Bursts of exotic fields may be produced during the coalescence of black hole singularities, releasing quantum… ▽ More We explore a novel, exotic physics, modality in multi-messenger astronomy. We are interested in exotic fields emitted by the mergers and their direct detection with a network of atomic clocks. We specifically focus on the rubidium clocks onboard satellites of the Global Positioning System. Bursts of exotic fields may be produced during the coalescence of black hole singularities, releasing quantum gravity messengers. To be detectable such fields must be ultralight and ultra-relativistic and we refer to them as exotic low-mass fields (ELFs). Since such fields possess non-zero mass, the ELF bursts lag behind the gravitational waves emitted by the very same merger. Then the gravitational wave observatories provide a detection trigger for the atomic clock networks searching for the feeble ELF signals. ELFs would imprint an anti-chirp transient across the sensor network. ELFs can be detectable by atomic clocks if they cause variations in fundamental constants. We report our progress in the development of techniques to search for ELF bursts with clocks onboard GPS satellites. We focus on the binary neutron star merger GW170817 of August 17, 2017. We find an intriguing excess in the clock noise post LIGO gravitational wave trigger. Potentially the excess noise could be explained away by the increased solar electron flux post LIGO trigger. △ Less

Submitted 19 December, 2023; originally announced December 2023.

Comments: 9th Symposium on Frequency Standards and Metrology

MagGen: A graph aided deep generative model for inverse design of stable, permanent magnets

Authors: Sourav Mal, Gaurav Seal, Prasenjit Sen

Abstract: A significant development towards inverse design of materials with well-defined target properties is reported. A deep generative model based on variational autoencoder (VAE), conditioned simultaneously by two target properties, is developed to inverse design stable magnetic materials. Structure of the physics informed, property embedded latent space of the model is analyzed using graph theory, bas… ▽ More A significant development towards inverse design of materials with well-defined target properties is reported. A deep generative model based on variational autoencoder (VAE), conditioned simultaneously by two target properties, is developed to inverse design stable magnetic materials. Structure of the physics informed, property embedded latent space of the model is analyzed using graph theory, based on the idea of similarity index. The graph idea is shown to be useful for generating new materials that are likely to satisfy target properties. An impressive ~96% of the generated materials is found to satisfy the target properties as per predictions from the target learning branches. This is a huge improvement over approaches that do not condition the VAE latent space by target properties, or do not consider connectivity of the parent materials perturbing which the new materials are generated. In such models, the fraction of materials satisfying targets can be as low as ~5%. This impressive feat is achieved using a simple real-space only representation called Invertible Real-space Crystallographic Representation (IRCR), that can be directly read from material cif files. Model predictions are finally validated by performing DFT calculations on a randomly chosen subset of materials. Performance of the present model using IRCR is comparable or superior to that of the models reported earlier. This model for magnetic material generation, MagGen, is applied to the problem of designing rare earth free permanent magnets with promising results. △ Less

Submitted 22 November, 2023; originally announced November 2023.

Automated Attribute Extraction from Legal Proceedings

Authors: Subinay Adhikary, Sagnik Das, Sagnik Saha, Procheta Sen, Dwaipayan Roy, Kripabandhu Ghosh

Abstract: The escalating number of pending cases is a growing concern world-wide. Recent advancements in digitization have opened up possibilities for leveraging artificial intelligence (AI) tools in the processing of legal documents. Adopting a structured representation for legal documents, as opposed to a mere bag-of-words flat text representation, can significantly enhance processing capabilities. With t… ▽ More The escalating number of pending cases is a growing concern world-wide. Recent advancements in digitization have opened up possibilities for leveraging artificial intelligence (AI) tools in the processing of legal documents. Adopting a structured representation for legal documents, as opposed to a mere bag-of-words flat text representation, can significantly enhance processing capabilities. With the aim of achieving this objective, we put forward a set of diverse attributes for criminal case proceedings. We use a state-of-the-art sequence labeling framework to automatically extract attributes from the legal documents. Moreover, we demonstrate the efficacy of the extracted attributes in a downstream task, namely legal judgment prediction. △ Less

Submitted 18 October, 2023; originally announced October 2023.

Comments: Presented in Mining and Learning in the Legal Domain (MLLD) workshop 2023

Can Word Sense Distribution Detect Semantic Changes of Words?

Authors: Xiaohang Tang, Yi Zhou, Taichi Aida, Procheta Sen, Danushka Bollegala

Abstract: Semantic Change Detection (SCD) of words is an important task for various NLP applications that must make time-sensitive predictions. Some words are used over time in novel ways to express new meanings, and these new meanings establish themselves as novel senses of existing words. On the other hand, Word Sense Disambiguation (WSD) methods associate ambiguous words with sense ids, depending on the… ▽ More Semantic Change Detection (SCD) of words is an important task for various NLP applications that must make time-sensitive predictions. Some words are used over time in novel ways to express new meanings, and these new meanings establish themselves as novel senses of existing words. On the other hand, Word Sense Disambiguation (WSD) methods associate ambiguous words with sense ids, depending on the context in which they occur. Given this relationship between WSD and SCD, we explore the possibility of predicting whether a target word has its meaning changed between two corpora collected at different time steps, by comparing the distributions of senses of that word in each corpora. For this purpose, we use pretrained static sense embeddings to automatically annotate each occurrence of the target word in a corpus with a sense id. Next, we compute the distribution of sense ids of a target word in a given corpus. Finally, we use different divergence or distance measures to quantify the semantic change of the target word across the two given corpora. Our experimental results on SemEval 2020 Task 1 dataset show that word sense distributions can be accurately used to predict semantic changes of words in English, German, Swedish and Latin. △ Less

Submitted 16 October, 2023; originally announced October 2023.

Comments: Accepted to Findings of EMNLP 2023

Journal ref: EMNLP 2023

Lexical Entrainment for Conversational Systems

Authors: Zhengxiang Shi, Procheta Sen, Aldo Lipani

Abstract: Conversational agents have become ubiquitous in assisting with daily tasks, and are expected to possess human-like features. One such feature is lexical entrainment (LE), a phenomenon in which speakers in human-human conversations tend to naturally and subconsciously align their lexical choices with those of their interlocutors, leading to more successful and engaging conversations. As an example,… ▽ More Conversational agents have become ubiquitous in assisting with daily tasks, and are expected to possess human-like features. One such feature is lexical entrainment (LE), a phenomenon in which speakers in human-human conversations tend to naturally and subconsciously align their lexical choices with those of their interlocutors, leading to more successful and engaging conversations. As an example, if a digital assistant replies 'Your appointment for Jinling Noodle Pub is at 7 pm' to the question 'When is my reservation for Jinling Noodle Bar today?', it may feel as though the assistant is trying to correct the speaker, whereas a response of 'Your reservation for Jinling Noodle Bar is at 7 pm' would likely be perceived as more positive. This highlights the importance of LE in establishing a shared terminology for maximum clarity and reducing ambiguity in conversations. However, we demonstrate in this work that current response generation models do not adequately address this crucial humanlike phenomenon. To address this, we propose a new dataset, named MULTIWOZ-ENTR, and a measure for LE for conversational systems. Additionally, we suggest a way to explicitly integrate LE into conversational systems with two new tasks, a LE extraction task and a LE generation task. We also present two baseline approaches for the LE extraction task, which aim to detect LE expressions from dialogue contexts. △ Less

Submitted 14 October, 2023; originally announced October 2023.

Comments: Findings of EMNLP 2023

Automated Argument Generation from Legal Facts

Authors: Oscar Tuvey, Procheta Sen

Abstract: The count of pending cases has shown an exponential rise across nations (e.g., with more than 10 million pending cases in India alone). The main issue lies in the fact that the number of cases submitted to the law system is far greater than the available number of legal professionals present in a country. Given this worldwide context, the utilization of AI technology has gained paramount importanc… ▽ More The count of pending cases has shown an exponential rise across nations (e.g., with more than 10 million pending cases in India alone). The main issue lies in the fact that the number of cases submitted to the law system is far greater than the available number of legal professionals present in a country. Given this worldwide context, the utilization of AI technology has gained paramount importance to enhance the efficiency and speed of legal procedures. In this study we partcularly focus on helping legal professionals in the process of analyzing a legal case. Our specific investigation delves into harnessing the generative capabilities of open-sourced large language models to create arguments derived from the facts present in legal cases. Experimental results show that the generated arguments from the best performing method have on average 63% overlap with the benchmark set gold standard annotations. △ Less

Submitted 12 October, 2023; v1 submitted 9 October, 2023; originally announced October 2023.

Avalanche shapes in fiber bundle model

Authors: Narendra Kumar Bodaballa, Soumyajyoti Biswas, Parongama Sen

Abstract: We study the temporal evolution of avalanches in the fiber bundle model of disordered solids, when the model is gradually driven towards the critical breakdown point. We use two types of loading protocols: (i) the quasi-static loading, and (ii) loading by a discrete amount. In the quasi-static loading, where the load is increased by the minimum amount needed to initiate an avalanche, the temporal… ▽ More We study the temporal evolution of avalanches in the fiber bundle model of disordered solids, when the model is gradually driven towards the critical breakdown point. We use two types of loading protocols: (i) the quasi-static loading, and (ii) loading by a discrete amount. In the quasi-static loading, where the load is increased by the minimum amount needed to initiate an avalanche, the temporal shapes of avalanches are asymmetric away from the critical point and become symmetric as the critical point is approached. A measure of asymmetry follows a universal form $A\sim (σ-σ_c)^θ$, with $θ\approx 0.25$, where $σ$ is the load per fiber and $σ_c$ is the critical load per fiber. This behavior is independent of the disorder present in the system in terms of the individual failure threshold values. Thus it is possible to use this asymmetry measure as a precursor to imminent failure. For the case of discrete loading, the load is always increased by a fixed amount. The dynamics of the model in this case can be solved in the mean field limit. It shows that the avalanche shapes always remain asymmetric. We also present a variable range load sharing version of this case, where the results remain qualitatively similar. △ Less

Submitted 9 October, 2023; originally announced October 2023.

Comments: 7 pages, 8 figures

LIPEx-Locally Interpretable Probabilistic Explanations-To Look Beyond The True Class

Authors: Hongbo Zhu, Angelo Cangelosi, Procheta Sen, Anirbit Mukherjee

Abstract: In this work, we instantiate a novel perturbation-based multi-class explanation framework, LIPEx (Locally Interpretable Probabilistic Explanation). We demonstrate that LIPEx not only locally replicates the probability distributions output by the widely used complex classification models but also provides insight into how every feature deemed to be important affects the prediction probability for e… ▽ More In this work, we instantiate a novel perturbation-based multi-class explanation framework, LIPEx (Locally Interpretable Probabilistic Explanation). We demonstrate that LIPEx not only locally replicates the probability distributions output by the widely used complex classification models but also provides insight into how every feature deemed to be important affects the prediction probability for each of the possible classes. We achieve this by defining the explanation as a matrix obtained via regression with respect to the Hellinger distance in the space of probability distributions. Ablation tests on text and image data, show that LIPEx-guided removal of important features from the data causes more change in predictions for the underlying model than similar tests based on other saliency-based or feature importance-based Explainable AI (XAI) methods. It is also shown that compared to LIME, LIPEx is more data efficient in terms of using a lesser number of perturbations of the data to obtain a reliable explanation. This data-efficiency is seen to manifest as LIPEx being able to compute its explanation matrix around 53% faster than all-class LIME, for classification experiments with text data. △ Less

Submitted 7 December, 2023; v1 submitted 7 October, 2023; originally announced October 2023.

Comments: 19 pages, 9 figures

Learning Symbolic Rules over Abstract Meaning Representations for Textual Reinforcement Learning

Authors: Subhajit Chaudhury, Sarathkrishna Swaminathan, Daiki Kimura, Prithviraj Sen, Keerthiram Murugesan, Rosario Uceda-Sosa, Michiaki Tatsubori, Achille Fokoue, Pavan Kapanipathi, Asim Munawar, Alexander Gray

Abstract: Text-based reinforcement learning agents have predominantly been neural network-based models with embeddings-based representation, learning uninterpretable policies that often do not generalize well to unseen games. On the other hand, neuro-symbolic methods, specifically those that leverage an intermediate formal representation, are gaining significant attention in language understanding tasks. Th… ▽ More Text-based reinforcement learning agents have predominantly been neural network-based models with embeddings-based representation, learning uninterpretable policies that often do not generalize well to unseen games. On the other hand, neuro-symbolic methods, specifically those that leverage an intermediate formal representation, are gaining significant attention in language understanding tasks. This is because of their advantages ranging from inherent interpretability, the lesser requirement of training data, and being generalizable in scenarios with unseen data. Therefore, in this paper, we propose a modular, NEuro-Symbolic Textual Agent (NESTA) that combines a generic semantic parser with a rule induction system to learn abstract interpretable rules as policies. Our experiments on established text-based game benchmarks show that the proposed NESTA method outperforms deep reinforcement learning-based techniques by achieving better generalization to unseen test games and learning from fewer training interactions. △ Less

Submitted 5 July, 2023; originally announced July 2023.

Comments: ACL 2023

Are Human Explanations Always Helpful? Towards Objective Evaluation of Human Natural Language Explanations

Authors: Bingsheng Yao, Prithviraj Sen, Lucian Popa, James Hendler, Dakuo Wang

Abstract: Human-annotated labels and explanations are critical for training explainable NLP models. However, unlike human-annotated labels whose quality is easier to calibrate (e.g., with a majority vote), human-crafted free-form explanations can be quite subjective. Before blindly using them as ground truth to train ML models, a vital question needs to be asked: How do we evaluate a human-annotated explana… ▽ More Human-annotated labels and explanations are critical for training explainable NLP models. However, unlike human-annotated labels whose quality is easier to calibrate (e.g., with a majority vote), human-crafted free-form explanations can be quite subjective. Before blindly using them as ground truth to train ML models, a vital question needs to be asked: How do we evaluate a human-annotated explanation's quality? In this paper, we build on the view that the quality of a human-annotated explanation can be measured based on its helpfulness (or impairment) to the ML models' performance for the desired NLP tasks for which the annotations were collected. In comparison to the commonly used Simulatability score, we define a new metric that can take into consideration the helpfulness of an explanation for model performance at both fine-tuning and inference. With the help of a unified dataset format, we evaluated the proposed metric on five datasets (e.g., e-SNLI) against two model architectures (T5 and BART), and the results show that our proposed metric can objectively evaluate the quality of human-annotated explanations, while Simulatability falls short. △ Less

Submitted 22 May, 2023; v1 submitted 4 May, 2023; originally announced May 2023.

Comments: Accepted to ACL2023

Social dynamics through kinetic exchange: The BChS model

Authors: Soumyajyoti Biswas, Arnab Chatterjee, Parongama Sen, Sudip Mukherjee, Bikas K. Chakrabarti

Abstract: This review presents an overview of the current research in kinetic exchange models for opinion formation in a society. The review begins with a brief introduction to previous models and subsequently provides an in-depth discussion of the progress achieved in the Biswas-Chatterjee-Sen model proposed in 2012, also known as the BChS model in some later research publications. The unique feature of th… ▽ More This review presents an overview of the current research in kinetic exchange models for opinion formation in a society. The review begins with a brief introduction to previous models and subsequently provides an in-depth discussion of the progress achieved in the Biswas-Chatterjee-Sen model proposed in 2012, also known as the BChS model in some later research publications. The unique feature of the model is its inclusion of negative interaction between agents. The review covers various topics, including phase transitions between different opinion states, critical behavior dependent on various parameters, and applications in realistic scenarios such as the United States presidential election and Brexit. △ Less

Submitted 7 May, 2023; v1 submitted 7 April, 2023; originally announced April 2023.

Comments: 31 pages, 7 figures; Invited Review, Theme issue of Frontiers in Physics on Reviews in Social Physics

Laser Etch Enabled Active Embedded Microfluidic Cooling in $β$-Ga$_2$O$_3$

Authors: Shonkho Shuvro, Roopa Jayaramaiah, Rangarajan Muralidharan, Digbijoy N. Nath, Prosenjit Sen

Abstract: We demonstrate active embedded microfluidic cooling in $β$-Ga$_2$O$_3$. We employ a cost-effective infra-red laser etch setup to achieve controlled etching of micro-channels in 500 um thick $β$-Ga$_2$O$_3$ substrate. The micro-channels are about 210 um deep and 340 um wide. Resistive heating is used as proof-of-concept. At a water flow rate of 50 ml/min, a 50% reduction in surface temperature from… ▽ More We demonstrate active embedded microfluidic cooling in $β$-Ga$_2$O$_3$. We employ a cost-effective infra-red laser etch setup to achieve controlled etching of micro-channels in 500 um thick $β$-Ga$_2$O$_3$ substrate. The micro-channels are about 210 um deep and 340 um wide. Resistive heating is used as proof-of-concept. At a water flow rate of 50 ml/min, a 50% reduction in surface temperature from ~140$^\circ$C to ~72$^\circ$C is achieved for 3.5 W of input power. The experimental observations are backed by thermal simulation. This work is expected to lead to a new paradigm in thermal management in emerging $β$-Ga$_2$O$_3$ devices. △ Less

Submitted 18 March, 2023; originally announced April 2023.

Comments: 10 pages, 5 figures

Task2KB: A Public Task-Oriented Knowledge Base

Authors: Procheta Sen, Xi Wang, Ruiqing Xu, Emine Yilmaz

Abstract: Search engines and conversational assistants are commonly used to help users complete their every day tasks such as booking travel, cooking, etc. While there are some existing datasets that can be used for this purpose, their coverage is limited to very few domains. In this paper, we propose a novel knowledge base, 'Task2KB', which is constructed using data crawled from WikiHow, an online knowledg… ▽ More Search engines and conversational assistants are commonly used to help users complete their every day tasks such as booking travel, cooking, etc. While there are some existing datasets that can be used for this purpose, their coverage is limited to very few domains. In this paper, we propose a novel knowledge base, 'Task2KB', which is constructed using data crawled from WikiHow, an online knowledge resource offering instructional articles on a wide range of tasks. Task2KB encapsulates various types of task-related information and attributes, such as requirements, detailed step description, and available methods to complete tasks. Due to its higher coverage compared to existing related knowledge graphs, Task2KB can be highly useful in the development of general purpose task completion assistants △ Less

Submitted 24 January, 2023; originally announced February 2023.

Opinion formation models with extreme switches and disorder: critical behaviour and dynamics

Authors: Kathakali Biswas, Parongama Sen

Abstract: In a three state kinetic exchange opinion formation model, the effect of extreme switches was considered in a recent paper. In the present work, we study the same model with disorder. Here disorder implies that negative interactions may occur with a probability $p$. In absence of extreme switches, the known critical point is at $p_c =1/4$ in the mean field model. With a nonzero value of $q$ that d… ▽ More In a three state kinetic exchange opinion formation model, the effect of extreme switches was considered in a recent paper. In the present work, we study the same model with disorder. Here disorder implies that negative interactions may occur with a probability $p$. In absence of extreme switches, the known critical point is at $p_c =1/4$ in the mean field model. With a nonzero value of $q$ that denotes the probability of such switches, the critical point is found to occur at $ p = \frac{1-q}{4}$ where the order parameter vanishes with a universal value of the exponent $β=1/2$. Stability analysis of initially ordered states near the phase boundary reveals the exponential growth/decay of the order parameter in the ordered/disordered phase with a timescale diverging with exponent $1$. The fully ordered state also relaxes exponentially to its equilibrium value with a similar behaviour of the associated timescale. Exactly at the critical points, the order parameter shows a power law decay with time with exponent $1/2$. Although the critical behaviour remains mean field like, the system behaves more like a two state model as $q \to 1$. At $q=1$ the model behaves like a binary voter model with random flipping occurring with probability $p$. △ Less

Submitted 23 December, 2022; originally announced December 2022.

Comments: 7 pages, 7 figures

Deep Appearance Prefiltering

Authors: Steve Bako, Pradeep Sen, Anton Kaplanyan

Abstract: Physically based rendering of complex scenes can be prohibitively costly with a potentially unbounded and uneven distribution of complexity across the rendered image. The goal of an ideal level of detail (LoD) method is to make rendering costs independent of the 3D scene complexity, while preserving the appearance of the scene. However, current prefiltering LoD methods are limited in the appearanc… ▽ More Physically based rendering of complex scenes can be prohibitively costly with a potentially unbounded and uneven distribution of complexity across the rendered image. The goal of an ideal level of detail (LoD) method is to make rendering costs independent of the 3D scene complexity, while preserving the appearance of the scene. However, current prefiltering LoD methods are limited in the appearances they can support due to their reliance of approximate models and other heuristics. We propose the first comprehensive multi-scale LoD framework for prefiltering 3D environments with complex geometry and materials (e.g., the Disney BRDF), while maintaining the appearance with respect to the ray-traced reference. Using a multi-scale hierarchy of the scene, we perform a data-driven prefiltering step to obtain an appearance phase function and directional coverage mask at each scale. At the heart of our approach is a novel neural representation that encodes this information into a compact latent form that is easy to decode inside a physically based renderer. Once a scene is baked out, our method requires no original geometry, materials, or textures at render time. We demonstrate that our approach compares favorably to state-of-the-art prefiltering methods and achieves considerable savings in memory for complex scenes. △ Less

Submitted 8 November, 2022; originally announced November 2022.

Comments: Accepted to ACM Transactions on Graphics (Oct. 2022)

A Closer Look at the Calibration of Differentially Private Learners

Authors: Hanlin Zhang, Xuechen Li, Prithviraj Sen, Salim Roukos, Tatsunori Hashimoto

Abstract: We systematically study the calibration of classifiers trained with differentially private stochastic gradient descent (DP-SGD) and observe miscalibration across a wide range of vision and language tasks. Our analysis identifies per-example gradient clipping in DP-SGD as a major cause of miscalibration, and we show that existing approaches for improving calibration with differential privacy only p… ▽ More We systematically study the calibration of classifiers trained with differentially private stochastic gradient descent (DP-SGD) and observe miscalibration across a wide range of vision and language tasks. Our analysis identifies per-example gradient clipping in DP-SGD as a major cause of miscalibration, and we show that existing approaches for improving calibration with differential privacy only provide marginal improvements in calibration error while occasionally causing large degradations in accuracy. As a solution, we show that differentially private variants of post-processing calibration methods such as temperature scaling and Platt scaling are surprisingly effective and have negligible utility cost to the overall model. Across 7 tasks, temperature scaling and Platt scaling with DP-SGD result in an average 3.1-fold reduction in the in-domain expected calibration error and only incur at most a minor percent drop in accuracy. △ Less

Submitted 14 November, 2022; v1 submitted 15 October, 2022; originally announced October 2022.

Comments: NeurIPS 2022 Workshop on Algorithmic Fairness through the Lens of Causality and Privacy

Non-equilibrium dynamics in a three state opinion formation model with stochastic extreme switches

Authors: Kathakali Biswas, Parongama Sen

Abstract: We investigate the non-equilibrium dynamics of a three state kinetic exchange model of opinion formation, where switches between extreme states are possible, depending on the value of a parameter $q$. The mean field dynamical equations are derived and analysed for any $q$. The fate of the system under the evolutionary rules used in \cite{BCS} shows that it is dependent on the value of $q$ and the… ▽ More We investigate the non-equilibrium dynamics of a three state kinetic exchange model of opinion formation, where switches between extreme states are possible, depending on the value of a parameter $q$. The mean field dynamical equations are derived and analysed for any $q$. The fate of the system under the evolutionary rules used in \cite{BCS} shows that it is dependent on the value of $q$ and the initial state in general. For $q=1$, which allows the extreme switches maximally, a quasi-conservation in the dynamics is obtained which renders it equivalent to the voter model. For general $q$ values, a "frozen" disordered fixed point is obtained which acts as an attractor for all initially disordered states. For other initial states, the order parameter grows with time $t$ as $\exp[α(q) t]$ where $α= \frac{1-q}{3-q}$ for $q\neq 1$ and follows a power law behaviour for $q=1$. Numerical simulations using a fully connected agent based model provide additional results like the system size dependence of the exit probability and consensus times that further accentuate the different behaviour of the model for $q=1$ and $q\neq 1$. The results are compared with the non-equilibrium phenomena in other well known dynamical systems. △ Less

Submitted 27 February, 2023; v1 submitted 5 October, 2022; originally announced October 2022.

Comments: 9 pages, 11 figures; new references and text added; some figures changed

Journal ref: Phys. Rev. E 106, 054311 (2022)

Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answering

Authors: Priyanka Sen, Alham Fikri Aji, Amir Saffari

Abstract: We introduce Mintaka, a complex, natural, and multilingual dataset designed for experimenting with end-to-end question-answering models. Mintaka is composed of 20,000 question-answer pairs collected in English, annotated with Wikidata entities, and translated into Arabic, French, German, Hindi, Italian, Japanese, Portuguese, and Spanish for a total of 180,000 samples. Mintaka includes 8 types of c… ▽ More We introduce Mintaka, a complex, natural, and multilingual dataset designed for experimenting with end-to-end question-answering models. Mintaka is composed of 20,000 question-answer pairs collected in English, annotated with Wikidata entities, and translated into Arabic, French, German, Hindi, Italian, Japanese, Portuguese, and Spanish for a total of 180,000 samples. Mintaka includes 8 types of complex questions, including superlative, intersection, and multi-hop questions, which were naturally elicited from crowd workers. We run baselines over Mintaka, the best of which achieves 38% hits@1 in English and 31% hits@1 multilingually, showing that existing models have room for improvement. We release Mintaka at https://github.com/amazon-research/mintaka. △ Less

Submitted 4 October, 2022; originally announced October 2022.

Comments: Accepted at COLING 2022

Terahertz Communications Can Work in Rain and Snow: Impact of Adverse Weather Conditions on Channels at 140 GHz

Authors: Priyangshu Sen, Jacob Hall, Michele Polese, Vitaly Petrov, Duschia Bodet, Francesco Restuccia, Tommaso Melodia, Josep M. Jornet

Abstract: Next-generation wireless networks will leverage the spectrum above 100 GHz to enable ultra-high data rate communications over multi-GHz-wide bandwidths. The propagation environment at such high frequencies, however, introduces challenges throughout the whole protocol stack design, from physical layer signal processing to application design. Therefore, it is fundamental to develop a holistic unders… ▽ More Next-generation wireless networks will leverage the spectrum above 100 GHz to enable ultra-high data rate communications over multi-GHz-wide bandwidths. The propagation environment at such high frequencies, however, introduces challenges throughout the whole protocol stack design, from physical layer signal processing to application design. Therefore, it is fundamental to develop a holistic understanding of the channel propagation and fading characteristics over realistic deployment scenarios and ultra-wide bands. In this paper, we conduct an extensive measurement campaign to evaluate the impact of weather conditions on a wireless link in the 130-150 GHz band through a channel sounding campaign with clear weather, rain, and snow in a typical urban backhaul scenario. We present a novel channel sounder design that captures signals with -82 dBm sensitivity and 20 GHz of bandwidth. We analyze link budget, capacity, as well as channel parameters such as the delay spread and the K-factor. Our experimental results indicate that in the considered context the adverse weather does not interrupt the link, but introduces some additional constraints (e.g., high delay spread and increase in path loss in snow conditions) that need to be accounted for in the design of reliable Sixth Generation (6G) communication links above 100 GHz. △ Less

Submitted 29 August, 2022; originally announced August 2022.

Comments: P. Sen, J. Hall, M. Polese, V. Petrov, D. Bodet, F. Restuccia, T. Melodia, J. M. Jornet. 2022. Terahertz Communications Can Work in Rain and Snow: Impact of Adverse Weather Conditions on Channels at 140 GHz. In 6th ACM Workshop on Millimeter-Wave and Terahertz Networks and Sensing Systems (mmNets'22), October 17, 2022, Sydney, NSW, Australia. ACM, New York, NY, USA, 6 pages

$XX^T$ Matrices With Independent Entries

Authors: Arup Bose, Priyanka Sen

Abstract: Let $S=XX^T$ be the (unscaled) sample covariance matrix where $X$ is a real $p \times n$ matrix with independent entries. It is well known that if the entries of $X$ are independent and identically distributed (i.i.d.) with enough moments and $p/n \to y\neq 0$, then the limiting spectral distribution (LSD) of $\frac{1}{n}S$ converges to a Mar$\check{\text{c}}$enko-Pastur law. Several extensions of… ▽ More Let $S=XX^T$ be the (unscaled) sample covariance matrix where $X$ is a real $p \times n$ matrix with independent entries. It is well known that if the entries of $X$ are independent and identically distributed (i.i.d.) with enough moments and $p/n \to y\neq 0$, then the limiting spectral distribution (LSD) of $\frac{1}{n}S$ converges to a Mar$\check{\text{c}}$enko-Pastur law. Several extensions of this result are also known. We prove a general result on the existence of the LSD of $S$ in probability or almost surely, and in particular, many of the above results follow as special cases. At the same time several new LSD results also follow from our general result. The moments of the LSD are quite involved but can be described via a set of partitions. Unlike in the i.i.d. entries case, these partitions are not necessarily non-crossing, but are related to the special symmetric partitions which are known to appear in the LSD of (generalised) Wigner matrices with independent entries. We also investigate the existence of the LSD of $S_{A}=AA^T$ when $A$ is the $p\times n$ symmetric or the asymmetric version of any of the following four random matrices: reverse circulant, circulant, Toeplitz and Hankel. The LSD of $\frac{1}{n}S_{A}$ for the above four cases have been studied by Bose, Gangopadhyay and Sen in 2010, when the entries are i.i.d. We show that under some general assumptions on the entries of $A$, the LSD of $S_{A}$ exists and this result generalises the existing results significantly. △ Less

Submitted 22 May, 2022; originally announced May 2022.

Comments: arXiv admin note: text overlap with arXiv:2112.15030

MSC Class: 60B10; 60B20

Interactive Segmentation and Visualization for Tiny Objects in Multi-megapixel Images

Authors: Chengyuan Xu, Boning Dong, Noah Stier, Curtis McCully, D. Andrew Howell, Pradeep Sen, Tobias Höllerer

Abstract: We introduce an interactive image segmentation and visualization framework for identifying, inspecting, and editing tiny objects (just a few pixels wide) in large multi-megapixel high-dynamic-range (HDR) images. Detecting cosmic rays (CRs) in astronomical observations is a cumbersome workflow that requires multiple tools, so we developed an interactive toolkit that unifies model inference, HDR ima… ▽ More We introduce an interactive image segmentation and visualization framework for identifying, inspecting, and editing tiny objects (just a few pixels wide) in large multi-megapixel high-dynamic-range (HDR) images. Detecting cosmic rays (CRs) in astronomical observations is a cumbersome workflow that requires multiple tools, so we developed an interactive toolkit that unifies model inference, HDR image visualization, segmentation mask inspection and editing into a single graphical user interface. The feature set, initially designed for astronomical data, makes this work a useful research-supporting tool for human-in-the-loop tiny-object segmentation in scientific areas like biomedicine, materials science, remote sensing, etc., as well as computer vision. Our interface features mouse-controlled, synchronized, dual-window visualization of the image and the segmentation mask, a critical feature for locating tiny objects in multi-megapixel images. The browser-based tool can be readily hosted on the web to provide multi-user access and GPU acceleration for any device. The toolkit can also be used as a high-precision annotation tool, or adapted as the frontend for an interactive machine learning framework. Our open-source dataset, CR detection model, and visualization toolkit are available at https://github.com/cy-xu/cosmic-conn. △ Less

Submitted 21 April, 2022; originally announced April 2022.

Comments: 6 pages, 4 figures. Accepted by CVPR 2022 Demo Program

ACM Class: I.4

Centralised multi link measurement compression with side information

Authors: Sayantan Chakraborty, Arun Padakandla, Pranab Sen

Abstract: We prove new one shot achievability results for measurement compression of quantum instruments with side information at the receiver. Unlike previous one shot results for this problem, our one shot bounds are nearly optimal and do not need catalytic randomness. In fact, we state a more general problem called centralised multi link measurement compression with quantum side information and provide o… ▽ More We prove new one shot achievability results for measurement compression of quantum instruments with side information at the receiver. Unlike previous one shot results for this problem, our one shot bounds are nearly optimal and do not need catalytic randomness. In fact, we state a more general problem called centralised multi link measurement compression with quantum side information and provide one shot achievability results for it. As a simple corollary, we obtain one shot measurement compression results for quantum instruments with side information that we mentioned earlier. All our one shot results lead to the standard results for this problem in the asymptotic iid setting. We prove our achievability bounds by first proving a novel sequential classical quantum multipartite covering lemma, which should be of independent interest. △ Less

Submitted 30 March, 2022; originally announced March 2022.

Comments: 37 pages, 1 figure

Some patterned matrices with independent entries

Authors: Arup Bose, Koushik Saha, Priyanka Sen

Abstract: Patterned random matrices such as the reverse circulant, the symmetric circulant, the Toeplitz and the Hankel matrices and their almost sure limiting spectral distribution (LSD), have attracted much attention. Under the assumption that the entries are taken from an i.i.d. sequence with finite variance, the LSD are tied together by a common thread -- the $2k$th moment of the limit equals a weighted… ▽ More Patterned random matrices such as the reverse circulant, the symmetric circulant, the Toeplitz and the Hankel matrices and their almost sure limiting spectral distribution (LSD), have attracted much attention. Under the assumption that the entries are taken from an i.i.d. sequence with finite variance, the LSD are tied together by a common thread -- the $2k$th moment of the limit equals a weighted sum over different types of pair-partitions of the set $\{1, 2, \ldots, 2k\}$ and are universal. Some results are also known for the sparse case. In this paper we generalise these results by relaxing significantly the i.i.d. assumption. For our models, the limits are defined via a larger class of partitions and are also not universal. Several existing and new results for patterned matrices, their band and sparse versions, as well as for matrices with continuous and discrete variance profile follow as special cases. △ Less

Submitted 11 March, 2022; originally announced March 2022.

Comments: updated version of the paper

MSC Class: 60B20; 60B10

Journal ref: Random Matrices: Theory and Applications 10, 2150030 (2021)

Virtual walks inspired by a mean field kinetic exchange model of opinion dynamics

Authors: Surajit Saha, Parongama Sen

Abstract: We propose two different schemes of realizing a virtual walk corresponding to a kinetic exchange model of opinion dynamics. The walks are either Markovian or non-Markovian in nature. The opinion dynamics model is characterized by a parameter $p$ which drives an order disorder transition at a critical value $p_c$. The distribution $S(X,t)$ of the displacements $X$ from the origin of the walkers is… ▽ More We propose two different schemes of realizing a virtual walk corresponding to a kinetic exchange model of opinion dynamics. The walks are either Markovian or non-Markovian in nature. The opinion dynamics model is characterized by a parameter $p$ which drives an order disorder transition at a critical value $p_c$. The distribution $S(X,t)$ of the displacements $X$ from the origin of the walkers is computed at different times. Below $p_c$, two time scales associated with a crossover behavior in time are detected, which diverge in a power law manner at criticality with different exponent values. $S(X,t)$ also carries the signature of the phase transition as it changes its form at $p_c$. The walks show the features of a biased random walk below $p_c$, and above $p_c$, the walks are like unbiased random walks. The bias vanishes in a power law manner at $p_c$ and the width of the resulting Gaussian function shows a discontinuity. Some of the features of the walks are argued to be comparable to the critical quantities associated with the mean field Ising model, to which class the opinion dynamics model belongs. The results for the Markovian and non-Markovian walks are almost identical which is justified by considering the different fluxes. We compare the present results with some earlier similar studies. △ Less

Submitted 4 March, 2022; v1 submitted 23 February, 2022; originally announced February 2022.

Sample covariance matrices and special symmetric partitions

Authors: Arup Bose, Priyanka Sen

Abstract: Suppose $X_p$ is a real $p \times n$ matrix with independent entries and consider the (unscaled) sample covariance matrix $S_p=X_pX_p^T$. The Marchenko-Pastur law was discovered as the limit of the bulk distribution of the sample covariance matrix in 1967. There have been extensions of this result in several directions. In this paper, we consider an extension that handles several of the existing o… ▽ More Suppose $X_p$ is a real $p \times n$ matrix with independent entries and consider the (unscaled) sample covariance matrix $S_p=X_pX_p^T$. The Marchenko-Pastur law was discovered as the limit of the bulk distribution of the sample covariance matrix in 1967. There have been extensions of this result in several directions. In this paper, we consider an extension that handles several of the existing ones as well as generates new results. We show that under suitable assumptions on the entries of $X_p$, the limiting spectral distribution exists in probability or almost surely. The moments are described by a set of partitions that are beyond pair partitions and non-crossing partitions and are also related to special symmetric partitions, which are known to appear in the limiting spectral distribution of Wigner-type matrices. Similar results hold for other patterned matrices such as reverse circulant, circulant, Toeplitz, and Hankel matrices. △ Less

Submitted 3 January, 2022; v1 submitted 30 December, 2021; originally announced December 2021.

Comments: 23 pages, typos corrected

MSC Class: 60B20; 60B10

Neuro-Symbolic Inductive Logic Programming with Logical Neural Networks

Authors: Prithviraj Sen, Breno W. S. R. de Carvalho, Ryan Riegel, Alexander Gray

Abstract: Recent work on neuro-symbolic inductive logic programming has led to promising approaches that can learn explanatory rules from noisy, real-world data. While some proposals approximate logical operators with differentiable operators from fuzzy or real-valued logic that are parameter-free thus diminishing their capacity to fit the data, other approaches are only loosely based on logic making it dif… ▽ More Recent work on neuro-symbolic inductive logic programming has led to promising approaches that can learn explanatory rules from noisy, real-world data. While some proposals approximate logical operators with differentiable operators from fuzzy or real-valued logic that are parameter-free thus diminishing their capacity to fit the data, other approaches are only loosely based on logic making it difficult to interpret the learned "rules". In this paper, we propose learning rules with the recently proposed logical neural networks (LNN). Compared to others, LNNs offer strong connection to classical Boolean logic thus allowing for precise interpretation of learned rules while harboring parameters that can be trained with gradient-based optimization to effectively fit the data. We extend LNNs to induce rules in first-order logic. Our experiments on standard benchmarking tasks confirm that LNN rules are highly interpretable and can achieve comparable or higher accuracy due to their flexible parameterization. △ Less

Submitted 6 December, 2021; originally announced December 2021.

VoRTX: Volumetric 3D Reconstruction With Transformers for Voxelwise View Selection and Fusion

Authors: Noah Stier, Alexander Rich, Pradeep Sen, Tobias Höllerer

Abstract: Recent volumetric 3D reconstruction methods can produce very accurate results, with plausible geometry even for unobserved surfaces. However, they face an undesirable trade-off when it comes to multi-view fusion. They can fuse all available view information by global averaging, thus losing fine detail, or they can heuristically cluster views for local fusion, thus restricting their ability to cons… ▽ More Recent volumetric 3D reconstruction methods can produce very accurate results, with plausible geometry even for unobserved surfaces. However, they face an undesirable trade-off when it comes to multi-view fusion. They can fuse all available view information by global averaging, thus losing fine detail, or they can heuristically cluster views for local fusion, thus restricting their ability to consider all views jointly. Our key insight is that greater detail can be retained without restricting view diversity by learning a view-fusion function conditioned on camera pose and image content. We propose to learn this multi-view fusion using a transformer. To this end, we introduce VoRTX, an end-to-end volumetric 3D reconstruction network using transformers for wide-baseline, multi-view feature fusion. Our model is occlusion-aware, leveraging the transformer architecture to predict an initial, projective scene geometry estimate. This estimate is used to avoid backprojecting image features through surfaces into occluded regions. We train our model on ScanNet and show that it produces better reconstructions than state-of-the-art methods. We also demonstrate generalization without any fine-tuning, outperforming the same state-of-the-art methods on two other datasets, TUM-RGBD and ICL-NUIM. △ Less

Submitted 30 November, 2021; originally announced December 2021.

Comments: 3DV 2021

3DVNet: Multi-View Depth Prediction and Volumetric Refinement

Authors: Alexander Rich, Noah Stier, Pradeep Sen, Tobias Höllerer

Abstract: We present 3DVNet, a novel multi-view stereo (MVS) depth-prediction method that combines the advantages of previous depth-based and volumetric MVS approaches. Our key idea is the use of a 3D scene-modeling network that iteratively updates a set of coarse depth predictions, resulting in highly accurate predictions which agree on the underlying scene geometry. Unlike existing depth-prediction techni… ▽ More We present 3DVNet, a novel multi-view stereo (MVS) depth-prediction method that combines the advantages of previous depth-based and volumetric MVS approaches. Our key idea is the use of a 3D scene-modeling network that iteratively updates a set of coarse depth predictions, resulting in highly accurate predictions which agree on the underlying scene geometry. Unlike existing depth-prediction techniques, our method uses a volumetric 3D convolutional neural network (CNN) that operates in world space on all depth maps jointly. The network can therefore learn meaningful scene-level priors. Furthermore, unlike existing volumetric MVS techniques, our 3D CNN operates on a feature-augmented point cloud, allowing for effective aggregation of multi-view information and flexible iterative refinement of depth maps. Experimental results show our method exceeds state-of-the-art accuracy in both depth prediction and 3D reconstruction metrics on the ScanNet dataset, as well as a selection of scenes from the TUM-RGBD and ICL-NUIM datasets. This shows that our method is both effective and generalizes to new settings. △ Less

Submitted 30 November, 2021; originally announced December 2021.

Comments: 10 pages, 6 figures, 3 tables. Accepted to 3DV 2021

Sparse Fusion for Multimodal Transformers

Authors: Yi Ding, Alex Rich, Mason Wang, Noah Stier, Matthew Turk, Pradeep Sen, Tobias Höllerer

Abstract: Multimodal classification is a core task in human-centric machine learning. We observe that information is highly complementary across modalities, thus unimodal information can be drastically sparsified prior to multimodal fusion without loss of accuracy. To this end, we present Sparse Fusion Transformers (SFT), a novel multimodal fusion method for transformers that performs comparably to existing… ▽ More Multimodal classification is a core task in human-centric machine learning. We observe that information is highly complementary across modalities, thus unimodal information can be drastically sparsified prior to multimodal fusion without loss of accuracy. To this end, we present Sparse Fusion Transformers (SFT), a novel multimodal fusion method for transformers that performs comparably to existing state-of-the-art methods while having greatly reduced memory footprint and computation cost. Key to our idea is a sparse-pooling block that reduces unimodal token sets prior to cross-modality modeling. Evaluations are conducted on multiple multimodal benchmark datasets for a wide range of classification tasks. State-of-the-art performance is obtained on multiple benchmarks under similar experiment conditions, while reporting up to six-fold reduction in computational cost and memory requirements. Extensive ablation studies showcase our benefits of combining sparsification and multimodal learning over naive approaches. This paves the way for enabling multimodal learning on low-resource devices. △ Less

Submitted 24 November, 2021; v1 submitted 23 November, 2021; originally announced November 2021.

Comments: 11 pages, 4 figures, 5 tables, Yi Ding and Alex Rich contributed equally

Efficient Decoding of Surface Code Syndromes for Error Correction in Quantum Computing

Authors: Debasmita Bhoumik, Pinaki Sen, Ritajit Majumdar, Susmita Sur-Kolay, Latesh Kumar K J, Sundaraja Sitharama Iyengar

Abstract: Errors in surface code have typically been decoded by Minimum Weight Perfect Matching (MWPM) based method. Recently, neural-network-based Machine Learning (ML) techniques have been employed for this purpose. Here we propose a two-level (low and high) ML-based decoding scheme, where the first level corrects errors on physical qubits and the second one corrects any existing logical errors, for diffe… ▽ More Errors in surface code have typically been decoded by Minimum Weight Perfect Matching (MWPM) based method. Recently, neural-network-based Machine Learning (ML) techniques have been employed for this purpose. Here we propose a two-level (low and high) ML-based decoding scheme, where the first level corrects errors on physical qubits and the second one corrects any existing logical errors, for different noise models. Our results show that our proposed decoding method achieves $\sim10 \times$ and $\sim2 \times$ higher values of pseudo-threshold and threshold respectively, than for MWPM. We show that usage of more sophisticated ML models with higher training/testing time, do not provide significant improvement in the decoder performance. Finally, data generation for training the ML decoder requires significant overhead hence lower volume of training data is desirable. We have shown that our decoder maintains a good performance with the train-test-ratio as low as $40:60$. △ Less

Submitted 21 October, 2021; originally announced October 2021.

Suppression of Droplet Breakage by Early Onset of Interfacial Instability

Authors: Rutvik Lathia, Chandantaru Dey Modak, Prosenjit Sen

Abstract: Hypothesis: Interfacial instabilities cause undesirable droplet breakage during impact. Such breakage affects many applications, such as printing, spraying, etc. Particle coating over a droplet can significantly change the impact process and stabilize it against breakage. This work investigates the impact dynamics of particle-coated droplets, which mostly remains unexplored. Experiments: Particle-… ▽ More Hypothesis: Interfacial instabilities cause undesirable droplet breakage during impact. Such breakage affects many applications, such as printing, spraying, etc. Particle coating over a droplet can significantly change the impact process and stabilize it against breakage. This work investigates the impact dynamics of particle-coated droplets, which mostly remains unexplored. Experiments: Particle-coated droplets of different mass loading were formed using a volume addition. Then the prepared droplets were impacted on superhydrophobic surfaces, and their dynamics were recorded using a high-speed camera. Findings: We report an intriguing phenomenon where interfacial fingering instability helps suppress breakage in particle-coated droplets. This island of breakage suppression, where the droplet maintains its intactness upon impact, appears within a regime of Weber numbers where droplet breakage is inevitable. The onset of fingering instability in particle-coated droplets is observed at much lower impact energy, around two times less than the bare droplet. The instability is characterized using the rim Bond number. The instability suppresses breakage because of the higher losses associated with the formation of stable fingers. Such instability can also be seen in Leidenfrost surfaces and dust/pollen-covered surfaces, making it useful in many applications related to self-cleaning. △ Less

Submitted 25 September, 2022; v1 submitted 14 October, 2021; originally announced October 2021.

Comments: Revising the mechanism reported in the paper which changes the article significantly

Multi-Objective Few-shot Learning for Fair Classification

Authors: Ishani Mondal, Procheta Sen, Debasis Ganguly

Abstract: In this paper, we propose a general framework for mitigating the disparities of the predicted classes with respect to secondary attributes within the data (e.g., race, gender etc.). Our proposed method involves learning a multi-objective function that in addition to learning the primary objective of predicting the primary class labels from the data, also employs a clustering-based heuristic to min… ▽ More In this paper, we propose a general framework for mitigating the disparities of the predicted classes with respect to secondary attributes within the data (e.g., race, gender etc.). Our proposed method involves learning a multi-objective function that in addition to learning the primary objective of predicting the primary class labels from the data, also employs a clustering-based heuristic to minimize the disparities of the class label distribution with respect to the cluster memberships, with the assumption that each cluster should ideally map to a distinct combination of attribute values. Experiments demonstrate effective mitigation of cognitive biases on a benchmark dataset without the use of annotations of secondary attribute values (the zero-shot case) or with the use of a small number of attribute value annotations (the few-shot case). △ Less

Submitted 5 October, 2021; originally announced October 2021.

Comments: Accepted as a short paper in CIKM 2021

Combining Rules and Embeddings via Neuro-Symbolic AI for Knowledge Base Completion

Authors: Prithviraj Sen, Breno W. S. R. Carvalho, Ibrahim Abdelaziz, Pavan Kapanipathi, Francois Luus, Salim Roukos, Alexander Gray

Abstract: Recent interest in Knowledge Base Completion (KBC) has led to a plethora of approaches based on reinforcement learning, inductive logic programming and graph embeddings. In particular, rule-based KBC has led to interpretable rules while being comparable in performance with graph embeddings. Even within rule-based KBC, there exist different approaches that lead to rules of varying quality and previ… ▽ More Recent interest in Knowledge Base Completion (KBC) has led to a plethora of approaches based on reinforcement learning, inductive logic programming and graph embeddings. In particular, rule-based KBC has led to interpretable rules while being comparable in performance with graph embeddings. Even within rule-based KBC, there exist different approaches that lead to rules of varying quality and previous work has not always been precise in highlighting these differences. Another issue that plagues most rule-based KBC is the non-uniformity of relation paths: some relation sequences occur in very few paths while others appear very frequently. In this paper, we show that not all rule-based KBC models are the same and propose two distinct approaches that learn in one case: 1) a mixture of relations and the other 2) a mixture of paths. When implemented on top of neuro-symbolic AI, which learns rules by extending Boolean logic to real-valued logic, the latter model leads to superior KBC accuracy outperforming state-of-the-art rule-based KBC by 2-10% in terms of mean reciprocal rank. Furthermore, to address the non-uniformity of relation paths, we combine rule-based KBC with graph embeddings thus improving our results even further and achieving the best of both worlds. △ Less

Submitted 16 September, 2021; originally announced September 2021.

End-to-End Entity Resolution and Question Answering Using Differentiable Knowledge Graphs

Authors: Armin Oliya, Amir Saffari, Priyanka Sen, Tom Ayoola

Abstract: Recently, end-to-end (E2E) trained models for question answering over knowledge graphs (KGQA) have delivered promising results using only a weakly supervised dataset. However, these models are trained and evaluated in a setting where hand-annotated question entities are supplied to the model, leaving the important and non-trivial task of entity resolution (ER) outside the scope of E2E learning. In… ▽ More Recently, end-to-end (E2E) trained models for question answering over knowledge graphs (KGQA) have delivered promising results using only a weakly supervised dataset. However, these models are trained and evaluated in a setting where hand-annotated question entities are supplied to the model, leaving the important and non-trivial task of entity resolution (ER) outside the scope of E2E learning. In this work, we extend the boundaries of E2E learning for KGQA to include the training of an ER component. Our model only needs the question text and the answer entities to train, and delivers a stand-alone QA model that does not require an additional ER component to be supplied during runtime. Our approach is fully differentiable, thanks to its reliance on a recent method for building differentiable KGs (Cohen et al., 2020). We evaluate our E2E trained model on two public datasets and show that it comes close to baseline models that use hand-annotated entities. △ Less

Submitted 13 September, 2021; originally announced September 2021.

Comments: Accepted at EMNLP 2021

Expanding End-to-End Question Answering on Differentiable Knowledge Graphs with Intersection

Authors: Priyanka Sen, Amir Saffari, Armin Oliya

Abstract: End-to-end question answering using a differentiable knowledge graph is a promising technique that requires only weak supervision, produces interpretable results, and is fully differentiable. Previous implementations of this technique (Cohen et al., 2020) have focused on single-entity questions using a relation following operation. In this paper, we propose a model that explicitly handles multiple… ▽ More End-to-end question answering using a differentiable knowledge graph is a promising technique that requires only weak supervision, produces interpretable results, and is fully differentiable. Previous implementations of this technique (Cohen et al., 2020) have focused on single-entity questions using a relation following operation. In this paper, we propose a model that explicitly handles multiple-entity questions by implementing a new intersection operation, which identifies the shared elements between two sets of entities. We find that introducing intersection improves performance over a baseline model on two datasets, WebQuestionsSP (69.6% to 73.3% Hits@1) and ComplexWebQuestions (39.8% to 48.7% Hits@1), and in particular, improves performance on questions with multiple entities by over 14% on WebQuestionsSP and by 19% on ComplexWebQuestions. △ Less

Submitted 13 September, 2021; originally announced September 2021.

Comments: Accepted at EMNLP 2021

Cosmic-CoNN: A Cosmic Ray Detection Deep-Learning Framework, Dataset, and Toolkit

Authors: Chengyuan Xu, Curtis McCully, Boning Dong, D. Andrew Howell, Pradeep Sen

Abstract: Rejecting cosmic rays (CRs) is essential for the scientific interpretation of CCD-captured data, but detecting CRs in single-exposure images has remained challenging. Conventional CR detectors require experimental parameter tuning for different instruments, and recent deep learning methods only produce instrument-specific models that suffer from performance loss on telescopes not included in the t… ▽ More Rejecting cosmic rays (CRs) is essential for the scientific interpretation of CCD-captured data, but detecting CRs in single-exposure images has remained challenging. Conventional CR detectors require experimental parameter tuning for different instruments, and recent deep learning methods only produce instrument-specific models that suffer from performance loss on telescopes not included in the training data. We present Cosmic-CoNN, a generic CR detector deployed for 24 telescopes at the Las Cumbres Observatory, which is made possible by the three contributions in this work: 1) We build a large and diverse ground-based CR dataset leveraging thousands of images from a global telescope network. 2) We propose a novel loss function and a neural network optimized for telescope imaging data to train generic CR detection models. At 95% recall, our model achieves a precision of 93.70% on Las Cumbres imaging data and maintains a consistent performance on new ground-based instruments never used for training. Specifically, the Cosmic-CoNN model trained on the Las Cumbres CR dataset maintains high precisions of 92.03% and 96.69% on Gemini GMOS-N/S 1x1 and 2x2 binning images, respectively. 3) We build a suite of tools including an interactive CR mask visualization and editing interface, console commands, and Python APIs to make automatic, robust CR detection widely accessible by the community of astronomers. Our dataset, open-source codebase, and trained models are available at https://github.com/cy-xu/cosmic-conn. △ Less

Submitted 6 October, 2022; v1 submitted 28 June, 2021; originally announced June 2021.

Comments: 17 pages, 10 figures, 4 tables. Submitted to AAS Journals. See https://github.com/cy-xu/cosmic-conn for the open-source software and https://zenodo.org/record/5034763 for the dataset

Non-equilibrium dynamics in Ising like models with biased initial condition

Authors: Reshmi Roy, Parongama Sen

Abstract: We investigate the dynamical fixed points of the zero temperature Glauber dynamics in Ising-like models. The stability analysis of the fixed points in the mean field calculation shows the existence of an exponent that depends on the coordination number $z$ in the Ising model. For the generalised voter model, a phase diagram is obtained based on this study. Numerical results for the Ising model for… ▽ More We investigate the dynamical fixed points of the zero temperature Glauber dynamics in Ising-like models. The stability analysis of the fixed points in the mean field calculation shows the existence of an exponent that depends on the coordination number $z$ in the Ising model. For the generalised voter model, a phase diagram is obtained based on this study. Numerical results for the Ising model for both the mean field case and short ranged models on lattices with different values of $z$ are also obtained. A related study is the behaviour of the exit probability $E(x_0)$, defined as the probability that a configuration ends up with all spins up starting with $x_0$ fraction of up spins. An interesting result is $E(x_0) = x_0$ in the mean field approximation when $z=2$, which is consistent with the conserved magnetisation in the system. For larger values of $z$, $E(x_0)$ shows the usual finite size dependent non linear behaviour both in the mean field model and in Ising model with nearest neighbour interaction on different two dimensional lattices. For such a behaviour, a data collapse of $E(x_0)$ is obtained using $y = \frac{(x_0 - x_c)}{x_c}L^{1/ν}$ as the scaling variable and $f(y)=\frac{1+\tanh(λy)}{2}$ appears as the scaling function. The universality of the exponent and the scaling factor is investigated. △ Less

Submitted 18 September, 2021; v1 submitted 24 June, 2021; originally announced June 2021.

Comments: 9 pages, 14 figures

Journal ref: Phys. Rev. E 104, 034123 (2021)

LNN-EL: A Neuro-Symbolic Approach to Short-text Entity Linking

Authors: Hang Jiang, Sairam Gurajada, Qiuhao Lu, Sumit Neelam, Lucian Popa, Prithviraj Sen, Yunyao Li, Alexander Gray

Abstract: Entity linking (EL), the task of disambiguating mentions in text by linking them to entities in a knowledge graph, is crucial for text understanding, question answering or conversational systems. Entity linking on short text (e.g., single sentence or question) poses particular challenges due to limited context. While prior approaches use either heuristics or black-box neural methods, here we propo… ▽ More Entity linking (EL), the task of disambiguating mentions in text by linking them to entities in a knowledge graph, is crucial for text understanding, question answering or conversational systems. Entity linking on short text (e.g., single sentence or question) poses particular challenges due to limited context. While prior approaches use either heuristics or black-box neural methods, here we propose LNN-EL, a neuro-symbolic approach that combines the advantages of using interpretable rules based on first-order logic with the performance of neural learning. Even though constrained to using rules, LNN-EL performs competitively against SotA black-box neural approaches, with the added benefits of extensibility and transferability. In particular, we show that we can easily blend existing rule templates given by a human expert, with multiple types of features (priors, BERT encodings, box embeddings, etc), and even scores resulting from previous EL methods, thus improving on such methods. For instance, on the LC-QuAD-1.0 dataset, we show more than $4$\% increase in F1 score over previous SotA. Finally, we show that the inductive bias offered by using logic results in learned rules that transfer well across datasets, even without fine tuning, while maintaining high accuracy. △ Less

Submitted 17 June, 2021; originally announced June 2021.

Comments: Accepted to ACL 2021

Variational Quantum Classifiers Through the Lens of the Hessian

Authors: Pinaki Sen, Amandeep Singh Bhatia, Kamalpreet Singh Bhangu, Ahmed Elbeltagi

Abstract: In quantum computing, the variational quantum algorithms (VQAs) are well suited for finding optimal combinations of things in specific applications ranging from chemistry all the way to finance. The training of VQAs with gradient descent optimization algorithm has shown a good convergence. At an early stage, the simulation of variational quantum circuits on noisy intermediate-scale quantum (NISQ)… ▽ More In quantum computing, the variational quantum algorithms (VQAs) are well suited for finding optimal combinations of things in specific applications ranging from chemistry all the way to finance. The training of VQAs with gradient descent optimization algorithm has shown a good convergence. At an early stage, the simulation of variational quantum circuits on noisy intermediate-scale quantum (NISQ) devices suffers from noisy outputs. Just like classical deep learning, it also suffers from vanishing gradient problems. It is a realistic goal to study the topology of loss landscape, to visualize the curvature information and trainability of these circuits in the existence of vanishing gradients. In this paper, we calculate the Hessian and visualize the loss landscape of variational quantum classifiers at different points in parameter space. The curvature information of variational quantum classifiers (VQC) is interpreted and the loss function's convergence is shown. It helps us better understand the behavior of variational quantum circuits to tackle optimization problems efficiently. We investigated the variational quantum classifiers via Hessian on quantum computers, starting with a simple 4-bit parity problem to gain insight into the practical behavior of Hessian, then thoroughly analyzed the behavior of Hessian's eigenvalues on training the variational quantum classifier for the Diabetes dataset. Finally, we show how the adaptive Hessian learning rate can influence the convergence while training the variational circuits. △ Less

Submitted 24 December, 2021; v1 submitted 21 May, 2021; originally announced May 2021.

Comments: 13 pages, 9 figures