Showing 1–50 of 409 results for author: Singh, G

Using linear and nonlinear entanglement witnesses to generate and detect bound entangled states on an IBM quantum processor

Authors: Vaishali Gulati, Gayatri Singh, Kavita Dorai

Abstract: We investigate bound entanglement in three-qubit mixed states which are diagonal in the Greenberger-Horne-Zeilinger (GHZ) basis. Entanglement in these states is detected using entanglement witnesses and the analysis focuses on states exhibiting positive partial transpose (PPT). We then compare the detection capabilities of optimal linear and nonlinear entanglement witnesses. In theory, both linear… ▽ More We investigate bound entanglement in three-qubit mixed states which are diagonal in the Greenberger-Horne-Zeilinger (GHZ) basis. Entanglement in these states is detected using entanglement witnesses and the analysis focuses on states exhibiting positive partial transpose (PPT). We then compare the detection capabilities of optimal linear and nonlinear entanglement witnesses. In theory, both linear and nonlinear witnesses produce non-negative values for separable states and negative values for some entangled GHZ diagonal states with PPT, indicating the presence of entanglement. Our experimental results reveal that in cases where linear entanglement witnesses fail to detect entanglement, nonlinear witnesses are consistently able to identify its presence. Optimal linear and nonlinear witnesses were generated on an IBM quantum computer and their performance was evaluated using two bound entangled states (Kay and Kye states) from the literature, and randomly generated entangled states in the GHZ diagonal form. Additionally, we propose a general quantum circuit for generating a three-qubit GHZ diagonal mixed state using a six-qubit pure state on the IBM quantum processor. We experimentally implemented the circuit to obtain expectation values for three-qubit mixed states and compute the corresponding entanglement witnesses. △ Less

Submitted 14 August, 2024; originally announced August 2024.

Comments: 8 pages, 3 figures

SABER-6D: Shape Representation Based Implicit Object Pose Estimation

Authors: Shishir Reddy Vutukur, Mengkejiergeli Ba, Benjamin Busam, Matthias Kayser, Gurprit Singh

Abstract: In this paper, we propose a novel encoder-decoder architecture, named SABER, to learn the 6D pose of the object in the embedding space by learning shape representation at a given pose. This model enables us to learn pose by performing shape representation at a target pose from RGB image input. We perform shape representation as an auxiliary task which helps us in learning rotations space for an ob… ▽ More In this paper, we propose a novel encoder-decoder architecture, named SABER, to learn the 6D pose of the object in the embedding space by learning shape representation at a given pose. This model enables us to learn pose by performing shape representation at a target pose from RGB image input. We perform shape representation as an auxiliary task which helps us in learning rotations space for an object based on 2D images. An image encoder predicts the rotation in the embedding space and the DeepSDF based decoder learns to represent the object's shape at the given pose. As our approach is shape based, the pipeline is suitable for any type of object irrespective of the symmetry. Moreover, we need only a CAD model of the objects to train SABER. Our pipeline is synthetic data based and can also handle symmetric objects without symmetry labels and, thus, no additional labeled training data is needed. The experimental evaluation shows that our method achieves close to benchmark results for both symmetric objects and asymmetric objects on Occlusion-LineMOD, and T-LESS datasets. △ Less

Submitted 11 August, 2024; originally announced August 2024.

Investigating the rate of $^{10}$Be(n,$γ$)$^{11}$Be radiative capture reaction within the FRDWBA framework

Authors: M. Dan, Shubhchintak, G. Singh, V. Choudhary, Jagjit Singh

Abstract: This study examines the radiative capture of a neutron by $^{10}$Be using the Coulomb dissociation approach within the FRDWBA theory. We analyze the elastic Coulomb breakup of $^{11}$Be on a $^{208}$Pb target at 72 MeV/A to determine the photodisintegration cross-section and radiative capture cross-section. Utilizing the Maxwell-averaged velocity distribution, we calculate the resulting radiative… ▽ More This study examines the radiative capture of a neutron by $^{10}$Be using the Coulomb dissociation approach within the FRDWBA theory. We analyze the elastic Coulomb breakup of $^{11}$Be on a $^{208}$Pb target at 72 MeV/A to determine the photodisintegration cross-section and radiative capture cross-section. Utilizing the Maxwell-averaged velocity distribution, we calculate the resulting radiative neutron capture reaction rate for the $^{10}$Be(n,$γ$)$^{11}$Be reaction. Comparative analyses are conducted with experimental data, theoretical results from direct radiative capture methods, and transfer reaction calculations. Additionally, we contrast our findings with the existing $^{10}$Be($α$,$γ$)$^{14}$C reaction rate and conclude the dominance of neutron capture over $α$ capture by $^{10}$Be. △ Less

Submitted 23 July, 2024; originally announced July 2024.

Comments: 20 pages, 5 figures, accepted for publication in The European Physical Journal Special Topics "Nuclear Astrophysics: Recent Progress in Understanding Element Formation in the Universe"

Journal ref: Eur. Phys. J. Spec. Top. (2024)

Multiple importance sampling for stochastic gradient estimation

Authors: Corentin Salaün, Xingchang Huang, Iliyan Georgiev, Niloy J. Mitra, Gurprit Singh

Abstract: We introduce a theoretical and practical framework for efficient importance sampling of mini-batch samples for gradient estimation from single and multiple probability distributions. To handle noisy gradients, our framework dynamically evolves the importance distribution during training by utilizing a self-adaptive metric. Our framework combines multiple, diverse sampling distributions, each tailo… ▽ More We introduce a theoretical and practical framework for efficient importance sampling of mini-batch samples for gradient estimation from single and multiple probability distributions. To handle noisy gradients, our framework dynamically evolves the importance distribution during training by utilizing a self-adaptive metric. Our framework combines multiple, diverse sampling distributions, each tailored to specific parameter gradients. This approach facilitates the importance sampling of vector-valued gradient estimation. Rather than naively combining multiple distributions, our framework involves optimally weighting data contribution across multiple distributions. This adapted combination of multiple importance yields superior gradient estimates, leading to faster training convergence. We demonstrate the effectiveness of our approach through empirical evaluations across a range of optimization tasks like classification and regression on both image and point cloud datasets. △ Less

Submitted 22 July, 2024; originally announced July 2024.

Comments: 13 pages, 11 figures

Fabrication of n+ contact on p-type high pure Ge by cathodic electrodeposition of Li and impedance analysis of n+/p diode at low temperatures

Authors: Manoranjan Ghosh, Pravahan Salunke, Shreyas Pitale, S. G. Singh, G. D. Patra, Shashwati Sen

Abstract: Fabrication of diode by forming n-type electrical contact on germanium (Ge) and its AC impedance analysis is important for radiation detection in the form of pulses. In this work lithium (Li) metal has been electro-deposited on p-type Ge single crystal from molten lithium nitrate at 260°C. The depth of Li diffusion in Ge was successfully varied by changing the electroplating time as determined by… ▽ More Fabrication of diode by forming n-type electrical contact on germanium (Ge) and its AC impedance analysis is important for radiation detection in the form of pulses. In this work lithium (Li) metal has been electro-deposited on p-type Ge single crystal from molten lithium nitrate at 260°C. The depth of Li diffusion in Ge was successfully varied by changing the electroplating time as determined by sheet resistance (SR) measurement after successive lapping of Ge surface. Li is found to diffuse up to 500 micron inside Ge by heat treatment of as deposited Li/Ge at 350°C for 1 hour. A stable n-type electrical contact on Ge with SR ~1 ohm/square and impurity concentration ~3.7x10^15/cm^3 is developed by Li incorporation in p-type Ge crystal showing net carrier concentration ~3.4x10^10/cm^3 and SR ~100 Kohm/square. Acceptor concentration determined from the 1/C^2 vs V plot shows similar temperature dependence as found by Hall measurement. The fabricated n+/p junction exhibit ideal diode characteristics with gradual increase in cut off voltage at low temperatures. Under forward bias, junction capacitance mainly comprises of diffusion capacitance (~10 micro.F) showing strong frequency dependence and the impedance is partly resistive resulting in semicircular Cole-Cole plot. Imaginary impedance spectra reveal that the relaxation time for the diffusion of majority carriers decreases at higher temperatures and increased forward voltages. The diode is purely capacitive under reverse bias showing a line parallel to the y-axis in the Cole-Cole plot with frequency independent (100Hz-100MHz) depletion capacitance ~10pF. △ Less

Submitted 8 July, 2024; originally announced July 2024.

Comments: Keywords: High Pure Germanium; p-n diode; Semiconductor detector; n-type contact; Lithium electrodeposition; Diode characteristics; Hall measurement; Capacitance vs. voltage; Depletion and diffusion capacitance; Cole-Cole plot; Impedance spectra; Relaxation time

Reflectance measurements of mm-wave absorbers using frequency-domain continuous wave THz spectroscopy

Authors: Gaganpreet Singh, Rustam Balafendiev, Zeshen Bao, Thomas J. L. J. Gascard, Jon E. Gudmundsson, Gagandeep Kaur, Vid Primožič

Abstract: Due to high dynamic range and ease of use, continuous wave terahertz spectroscopy is an increasingly popular method for optical characterization of components used in cosmic microwave background (CMB) experiments. In this work, we describe an optical testbed that enables simultaneous measurements of transmission and reflection properties of various radiation absorbing dielectric materials, essenti… ▽ More Due to high dynamic range and ease of use, continuous wave terahertz spectroscopy is an increasingly popular method for optical characterization of components used in cosmic microwave background (CMB) experiments. In this work, we describe an optical testbed that enables simultaneous measurements of transmission and reflection properties of various radiation absorbing dielectric materials, essential components in the reduction of undesired optical loading. To demonstrate the performance of the testbed, we have measured the reflection response of five absorbers commonly used for such applications: TKRAM, carbon- and iron-loaded Stycast, HR10, AN72, and an in-house 3D printed absorber across a frequency range of 100 to 500 GHz, for both S- and P-polarization, with incident angles varying from 15 to 45 degrees. We present results on both the specular and scattered reflection response of these absorbers. △ Less

Submitted 7 July, 2024; originally announced July 2024.

Comments: to be published in the proceedings of SPIE Astronomical Telescopes + Instrumentation 2024

The infrastructure powering IBM's Gen AI model development

Authors: Talia Gershon, Seetharami Seelam, Brian Belgodere, Milton Bonilla, Lan Hoang, Danny Barnett, I-Hsin Chung, Apoorve Mohan, Ming-Hung Chen, Lixiang Luo, Robert Walkup, Constantinos Evangelinos, Shweta Salaria, Marc Dombrowa, Yoonho Park, Apo Kayi, Liran Schour, Alim Alim, Ali Sydney, Pavlos Maniotis, Laurent Schares, Bernard Metzler, Bengi Karacali-Akyamac, Sophia Wen, Tatsuhiro Chiba , et al. (121 additional authors not shown)

Abstract: AI Infrastructure plays a key role in the speed and cost-competitiveness of developing and deploying advanced AI models. The current demand for powerful AI infrastructure for model training is driven by the emergence of generative AI and foundational models, where on occasion thousands of GPUs must cooperate on a single training job for the model to be trained in a reasonable time. Delivering effi… ▽ More AI Infrastructure plays a key role in the speed and cost-competitiveness of developing and deploying advanced AI models. The current demand for powerful AI infrastructure for model training is driven by the emergence of generative AI and foundational models, where on occasion thousands of GPUs must cooperate on a single training job for the model to be trained in a reasonable time. Delivering efficient and high-performing AI training requires an end-to-end solution that combines hardware, software and holistic telemetry to cater for multiple types of AI workloads. In this report, we describe IBM's hybrid cloud infrastructure that powers our generative AI model development. This infrastructure includes (1) Vela: an AI-optimized supercomputing capability directly integrated into the IBM Cloud, delivering scalable, dynamic, multi-tenant and geographically distributed infrastructure for large-scale model training and other AI workflow steps and (2) Blue Vela: a large-scale, purpose-built, on-premises hosting environment that is optimized to support our largest and most ambitious AI model training tasks. Vela provides IBM with the dual benefit of high performance for internal use along with the flexibility to adapt to an evolving commercial landscape. Blue Vela provides us with the benefits of rapid development of our largest and most ambitious models, as well as future-proofing against the evolving model landscape in the industry. Taken together, they provide IBM with the ability to rapidly innovate in the development of both AI models and commercial offerings. △ Less

Submitted 7 July, 2024; originally announced July 2024.

Comments: Corresponding Authors: Talia Gershon, Seetharami Seelam,Brian Belgodere, Milton Bonilla

Fine-tuning of Geospatial Foundation Models for Aboveground Biomass Estimation

Authors: Michal Muszynski, Levente Klein, Ademir Ferreira da Silva, Anjani Prasad Atluri, Carlos Gomes, Daniela Szwarcman, Gurkanwar Singh, Kewen Gu, Maciel Zortea, Naomi Simumba, Paolo Fraccaro, Shraddha Singh, Steve Meliksetian, Campbell Watson, Daiki Kimura, Harini Srinivasan

Abstract: Global vegetation structure mapping is critical for understanding the global carbon cycle and maximizing the efficacy of nature-based carbon sequestration initiatives. Moreover, vegetation structure mapping can help reduce the impacts of climate change by, for example, guiding actions to improve water security, increase biodiversity and reduce flood risk. Global satellite measurements provide an i… ▽ More Global vegetation structure mapping is critical for understanding the global carbon cycle and maximizing the efficacy of nature-based carbon sequestration initiatives. Moreover, vegetation structure mapping can help reduce the impacts of climate change by, for example, guiding actions to improve water security, increase biodiversity and reduce flood risk. Global satellite measurements provide an important set of observations for monitoring and managing deforestation and degradation of existing forests, natural forest regeneration, reforestation, biodiversity restoration, and the implementation of sustainable agricultural practices. In this paper, we explore the effectiveness of fine-tuning of a geospatial foundation model to estimate above-ground biomass (AGB) using space-borne data collected across different eco-regions in Brazil. The fine-tuned model architecture consisted of a Swin-B transformer as the encoder (i.e., backbone) and a single convolutional layer for the decoder head. All results were compared to a U-Net which was trained as the baseline model Experimental results of this sparse-label prediction task demonstrate that the fine-tuned geospatial foundation model with a frozen encoder has comparable performance to a U-Net trained from scratch. This is despite the fine-tuned model having 13 times less parameters requiring optimization, which saves both time and compute resources. Further, we explore the transfer-learning capabilities of the geospatial foundation models by fine-tuning on satellite imagery with sparse labels from different eco-regions in Brazil. △ Less

Submitted 28 June, 2024; originally announced June 2024.

Slot State Space Models

Authors: Jindong Jiang, Fei Deng, Gautam Singh, Minseung Lee, Sungjin Ahn

Abstract: Recent State Space Models (SSMs) such as S4, S5, and Mamba have shown remarkable computational benefits in long-range temporal dependency modeling. However, in many sequence modeling problems, the underlying process is inherently modular and it is of interest to have inductive biases that mimic this modular structure. In this paper, we introduce SlotSSMs, a novel framework for incorporating indepe… ▽ More Recent State Space Models (SSMs) such as S4, S5, and Mamba have shown remarkable computational benefits in long-range temporal dependency modeling. However, in many sequence modeling problems, the underlying process is inherently modular and it is of interest to have inductive biases that mimic this modular structure. In this paper, we introduce SlotSSMs, a novel framework for incorporating independent mechanisms into SSMs to preserve or encourage separation of information. Unlike conventional SSMs that maintain a monolithic state vector, SlotSSMs maintains the state as a collection of multiple vectors called slots. Crucially, the state transitions are performed independently per slot with sparse interactions across slots implemented via the bottleneck of self-attention. In experiments, we evaluate our model in object-centric video understanding, 3D visual reasoning, and video prediction tasks, which involve modeling multiple objects and their long-range temporal dependencies. We find that our proposed design offers substantial performance gains over existing sequence modeling methods. Project page is available at https://slotssms.github.io/ △ Less

Submitted 21 August, 2024; v1 submitted 18 June, 2024; originally announced June 2024.

Development and Validation of Fully Automatic Deep Learning-Based Algorithms for Immunohistochemistry Reporting of Invasive Breast Ductal Carcinoma

Authors: Sumit Kumar Jha, Purnendu Mishra, Shubham Mathur, Gursewak Singh, Rajiv Kumar, Kiran Aatre, Suraj Rengarajan

Abstract: Immunohistochemistry (IHC) analysis is a well-accepted and widely used method for molecular subtyping, a procedure for prognosis and targeted therapy of breast carcinoma, the most common type of tumor affecting women. There are four molecular biomarkers namely progesterone receptor (PR), estrogen receptor (ER), antigen Ki67, and human epidermal growth factor receptor 2 (HER2) whose assessment is n… ▽ More Immunohistochemistry (IHC) analysis is a well-accepted and widely used method for molecular subtyping, a procedure for prognosis and targeted therapy of breast carcinoma, the most common type of tumor affecting women. There are four molecular biomarkers namely progesterone receptor (PR), estrogen receptor (ER), antigen Ki67, and human epidermal growth factor receptor 2 (HER2) whose assessment is needed under IHC procedure to decide prognosis as well as predictors of response to therapy. However, IHC scoring is based on subjective microscopic examination of tumor morphology and suffers from poor reproducibility, high subjectivity, and often incorrect scoring in low-score cases. In this paper, we present, a deep learning-based semi-supervised trained, fully automatic, decision support system (DSS) for IHC scoring of invasive ductal carcinoma. Our system automatically detects the tumor region removing artifacts and scores based on Allred standard. The system is developed using 3 million pathologist-annotated image patches from 300 slides, fifty thousand in-house cell annotations, and forty thousand pixels marking of HER2 membrane. We have conducted multicentric trials at four centers with three different types of digital scanners in terms of percentage agreement with doctors. And achieved agreements of 95, 92, 88 and 82 percent for Ki67, HER2, ER, and PR stain categories, respectively. In addition to overall accuracy, we found that there is 5 percent of cases where pathologist have changed their score in favor of algorithm score while reviewing with detailed algorithmic analysis. Our approach could improve the accuracy of IHC scoring and subsequent therapy decisions, particularly where specialist expertise is unavailable. Our system is highly modular. The proposed algorithm modules can be used to develop DSS for other cancer types. △ Less

Submitted 16 June, 2024; originally announced June 2024.

Optimal Reward Labeling: Bridging Offline Preference and Reward-Based Reinforcement Learning

Authors: Yinglun Xu, David Zhu, Rohan Gumaste, Gagandeep Singh

Abstract: Offline reinforcement learning has become one of the most practical RL settings. A recent success story has been RLHF, offline preference-based RL (PBRL) with preference from humans. However, most existing works on offline RL focus on the standard setting with scalar reward feedback. It remains unknown how to universally transfer the existing rich understanding of offline RL from the reward-based… ▽ More Offline reinforcement learning has become one of the most practical RL settings. A recent success story has been RLHF, offline preference-based RL (PBRL) with preference from humans. However, most existing works on offline RL focus on the standard setting with scalar reward feedback. It remains unknown how to universally transfer the existing rich understanding of offline RL from the reward-based to the preference-based setting. In this work, we propose a general framework to bridge this gap. Our key insight is transforming preference feedback to scalar rewards via optimal reward labeling (ORL), and then any reward-based offline RL algorithms can be applied to the dataset with the reward labels. We theoretically show the connection between several recent PBRL techniques and our framework combined with specific offline RL algorithms in terms of how they utilize the preference signals. By combining reward labeling with different algorithms, our framework can lead to new and potentially more efficient offline PBRL algorithms. We empirically test our framework on preference datasets based on the standard D4RL benchmark. When combined with a variety of efficient reward-based offline RL algorithms, the learning result achieved under our framework is comparable to training the same algorithm on the dataset with actual rewards in many cases and better than the recent PBRL baselines in most cases. △ Less

Submitted 6 July, 2024; v1 submitted 14 June, 2024; originally announced June 2024.

Multi-Stain Multi-Level Convolutional Network for Multi-Tissue Breast Cancer Image Segmentation

Authors: Akash Modi, Sumit Kumar Jha, Purnendu Mishra, Rajiv Kumar, Kiran Aatre, Gursewak Singh, Shubham Mathur

Abstract: Digital pathology and microscopy image analysis are widely employed in the segmentation of digitally scanned IHC slides, primarily to identify cancer and pinpoint regions of interest (ROI) indicative of tumor presence. However, current ROI segmentation models are either stain-specific or suffer from the issues of stain and scanner variance due to different staining protocols or modalities across m… ▽ More Digital pathology and microscopy image analysis are widely employed in the segmentation of digitally scanned IHC slides, primarily to identify cancer and pinpoint regions of interest (ROI) indicative of tumor presence. However, current ROI segmentation models are either stain-specific or suffer from the issues of stain and scanner variance due to different staining protocols or modalities across multiple labs. Also, tissues like Ductal Carcinoma in Situ (DCIS), acini, etc. are often classified as Tumors due to their structural similarities and color compositions. In this paper, we proposed a novel convolutional neural network (CNN) based Multi-class Tissue Segmentation model for histopathology whole-slide Breast slides which classify tumors and segments other tissue regions such as Ducts, acini, DCIS, Squamous epithelium, Blood Vessels, Necrosis, etc. as a separate class. Our unique pixel-aligned non-linear merge across spatial resolutions empowers models with both local and global fields of view for accurate detection of various classes. Our proposed model is also able to separate bad regions such as folds, artifacts, blurry regions, bubbles, etc. from tissue regions using multi-level context from different resolutions of WSI. Multi-phase iterative training with context-aware augmentation and increasing noise was used to efficiently train a multi-stain generic model with partial and noisy annotations from 513 slides. Our training pipeline used 12 million patches generated using context-aware augmentations which made our model stain and scanner invariant across data sources. To extrapolate stain and scanner invariance, our model was evaluated on 23000 patches which were for a completely new stain (Hematoxylin and Eosin) from a completely new scanner (Motic) from a different lab. The mean IOU was 0.72 which is on par with model performance on other data sources and scanners. △ Less

Submitted 9 June, 2024; originally announced June 2024.

Enhancing Sign Language Detection through Mediapipe and Convolutional Neural Networks (CNN)

Authors: Aditya Raj Verma, Gagandeep Singh, Karnim Meghwal, Banawath Ramji, Praveen Kumar Dadheech

Abstract: This research combines MediaPipe and CNNs for the efficient and accurate interpretation of ASL dataset for the real-time detection of sign language. The system presented here captures and processes hands' gestures in real time. the intended purpose was to create a very easy, accurate, and fast way of entering commands without the necessity of touching something.MediaPipe supports one of the powerf… ▽ More This research combines MediaPipe and CNNs for the efficient and accurate interpretation of ASL dataset for the real-time detection of sign language. The system presented here captures and processes hands' gestures in real time. the intended purpose was to create a very easy, accurate, and fast way of entering commands without the necessity of touching something.MediaPipe supports one of the powerful frameworks in real-time hand tracking capabilities for the ability to capture and preprocess hand movements, which increases the accuracy of the gesture recognition system. Actually, the integration of CNN with the MediaPipe results in higher efficiency in using the model of real-time processing.The accuracy achieved by the model on ASL datasets is 99.12\%.The model was tested using American Sign Language (ASL) datasets. The results were then compared to those of existing methods to evaluate how well it performed, using established evaluation techniques. The system will have applications in the communication, education, and accessibility domains. Making systems such as described in this paper even better will assist people with hearing impairment and make things accessible to them. We tested the recognition and translation performance on an ASL dataset and achieved better accuracy over previous models.It is meant to the research is to identify the characters that American signs recognize using hand images taken from a web camera by based on mediapipe and CNNs △ Less

Submitted 27 August, 2024; v1 submitted 6 June, 2024; originally announced June 2024.

Comments: We have decided to withdraw our paper due to significant revisions and improvements that need to be made based on new findings. After further analysis, we believe these changes are necessary to ensure the accuracy and completeness of our work. We plan to resubmit the revised version in the future once the updates are complete

Learning to Recover from Plan Execution Errors during Robot Manipulation: A Neuro-symbolic Approach

Authors: Namasivayam Kalithasan, Arnav Tuli, Vishal Bindal, Himanshu Gaurav Singh, Parag Singla, Rohan Paul

Abstract: Automatically detecting and recovering from failures is an important but challenging problem for autonomous robots. Most of the recent work on learning to plan from demonstrations lacks the ability to detect and recover from errors in the absence of an explicit state representation and/or a (sub-) goal check function. We propose an approach (blending learning with symbolic search) for automated er… ▽ More Automatically detecting and recovering from failures is an important but challenging problem for autonomous robots. Most of the recent work on learning to plan from demonstrations lacks the ability to detect and recover from errors in the absence of an explicit state representation and/or a (sub-) goal check function. We propose an approach (blending learning with symbolic search) for automated error discovery and recovery, without needing annotated data of failures. Central to our approach is a neuro-symbolic state representation, in the form of dense scene graph, structured based on the objects present within the environment. This enables efficient learning of the transition function and a discriminator that not only identifies failures but also localizes them facilitating fast re-planning via computation of heuristic distance function. We also present an anytime version of our algorithm, where instead of recovering to the last correct state, we search for a sub-goal in the original plan minimizing the total distance to the goal given a re-planning budget. Experiments on a physics simulator with a variety of simulated failures show the effectiveness of our approach compared to existing baselines, both in terms of efficiency as well as accuracy of our recovery mechanism. △ Less

Submitted 29 May, 2024; originally announced May 2024.

Comments: This work has been submitted to the IEEE for possible publication

Quantitative Certification of Bias in Large Language Models

Authors: Isha Chaudhary, Qian Hu, Manoj Kumar, Morteza Ziyadi, Rahul Gupta, Gagandeep Singh

Abstract: Large Language Models (LLMs) can produce responses that exhibit social biases and support stereotypes. However, conventional benchmarking is insufficient to thoroughly evaluate LLM bias, as it can not scale to large sets of prompts and provides no guarantees. Therefore, we propose a novel certification framework QuaCer-B (Quantitative Certification of Bias) that provides formal guarantees on obtai… ▽ More Large Language Models (LLMs) can produce responses that exhibit social biases and support stereotypes. However, conventional benchmarking is insufficient to thoroughly evaluate LLM bias, as it can not scale to large sets of prompts and provides no guarantees. Therefore, we propose a novel certification framework QuaCer-B (Quantitative Certification of Bias) that provides formal guarantees on obtaining unbiased responses from target LLMs under large sets of prompts. A certificate consists of high-confidence bounds on the probability of obtaining biased responses from the LLM for any set of prompts containing sensitive attributes, sampled from a distribution. We illustrate the bias certification in LLMs for prompts with various prefixes drawn from given distributions. We consider distributions of random token sequences, mixtures of manual jailbreaks, and jailbreaks in the LLM's embedding space to certify its bias. We certify popular LLMs with QuaCer-B and present novel insights into their biases. △ Less

Submitted 29 May, 2024; originally announced May 2024.

A generalized $Λ$CDM model with parameterized Hubble parameter in particle creation, viscous and $f(R)$ model framework

Authors: G. P. Singh, Romanshu Garg, Ashutosh Singh

Abstract: In this study, we construct a theoretical framework based on the generalized Hubble parameter form which may arise within the particle creation, viscous and $f(R)$ gravity theory. The Hubble parameter is scrutinized for its compatibility with the observational data relevant to the late-time universe. By using Bayesian statistical techniques based on $χ^{2}$ minimization method, we determine model… ▽ More In this study, we construct a theoretical framework based on the generalized Hubble parameter form which may arise within the particle creation, viscous and $f(R)$ gravity theory. The Hubble parameter is scrutinized for its compatibility with the observational data relevant to the late-time universe. By using Bayesian statistical techniques based on $χ^{2}$ minimization method, we determine model parameters's best fit values for the cosmic chronometer and supernovae Pantheon datasets. For the best fit values, the cosmographic and physical parameters are analyzed to understand the cosmic dynamics in model. △ Less

Submitted 24 May, 2024; originally announced May 2024.

Comments: 16 pages, 10 figures

On Hardware-efficient Inference in Probabilistic Circuits

Authors: Lingyun Yao, Martin Trapp, Jelin Leslin, Gaurav Singh, Peng Zhang, Karthekeyan Periasamy, Martin Andraud

Abstract: Probabilistic circuits (PCs) offer a promising avenue to perform embedded reasoning under uncertainty. They support efficient and exact computation of various probabilistic inference tasks by design. Hence, hardware-efficient computation of PCs is highly interesting for edge computing applications. As computations in PCs are based on arithmetic with probability values, they are typically performed… ▽ More Probabilistic circuits (PCs) offer a promising avenue to perform embedded reasoning under uncertainty. They support efficient and exact computation of various probabilistic inference tasks by design. Hence, hardware-efficient computation of PCs is highly interesting for edge computing applications. As computations in PCs are based on arithmetic with probability values, they are typically performed in the log domain to avoid underflow. Unfortunately, performing the log operation on hardware is costly. Hence, prior work has focused on computations in the linear domain, resulting in high resolution and energy requirements. This work proposes the first dedicated approximate computing framework for PCs that allows for low-resolution logarithm computations. We leverage Addition As Int, resulting in linear PC computation with simple hardware elements. Further, we provide a theoretical approximation error analysis and present an error compensation mechanism. Empirically, our method obtains up to 357x and 649x energy reduction on custom hardware for evidence and MAP queries respectively with little or no computational error. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Relational DNN Verification With Cross Executional Bound Refinement

Authors: Debangshu Banerjee, Gagandeep Singh

Abstract: We focus on verifying relational properties defined over deep neural networks (DNNs) such as robustness against universal adversarial perturbations (UAP), certified worst-case hamming distance for binary string classifications, etc. Precise verification of these properties requires reasoning about multiple executions of the same DNN. However, most of the existing works in DNN verification only han… ▽ More We focus on verifying relational properties defined over deep neural networks (DNNs) such as robustness against universal adversarial perturbations (UAP), certified worst-case hamming distance for binary string classifications, etc. Precise verification of these properties requires reasoning about multiple executions of the same DNN. However, most of the existing works in DNN verification only handle properties defined over single executions and as a result, are imprecise for relational properties. Though few recent works for relational DNN verification, capture linear dependencies between the inputs of multiple executions, they do not leverage dependencies between the outputs of hidden layers producing imprecise results. We develop a scalable relational verifier RACoon that utilizes cross-execution dependencies at all layers of the DNN gaining substantial precision over SOTA baselines on a wide range of datasets, networks, and relational properties. △ Less

Submitted 16 May, 2024; originally announced May 2024.

Cross-Input Certified Training for Universal Perturbations

Authors: Changming Xu, Gagandeep Singh

Abstract: Existing work in trustworthy machine learning primarily focuses on single-input adversarial perturbations. In many real-world attack scenarios, input-agnostic adversarial attacks, e.g. universal adversarial perturbations (UAPs), are much more feasible. Current certified training methods train models robust to single-input perturbations but achieve suboptimal clean and UAP accuracy, thereby limitin… ▽ More Existing work in trustworthy machine learning primarily focuses on single-input adversarial perturbations. In many real-world attack scenarios, input-agnostic adversarial attacks, e.g. universal adversarial perturbations (UAPs), are much more feasible. Current certified training methods train models robust to single-input perturbations but achieve suboptimal clean and UAP accuracy, thereby limiting their applicability in practical applications. We propose a novel method, CITRUS, for certified training of networks robust against UAP attackers. We show in an extensive evaluation across different datasets, architectures, and perturbation magnitudes that our method outperforms traditional certified training methods on standard accuracy (up to 10.3\%) and achieves SOTA performance on the more practical certified UAP accuracy metric. △ Less

Submitted 15 May, 2024; originally announced May 2024.

Comments: 21 pages, 5 figures

Incorporating Physical Priors into Weakly-Supervised Anomaly Detection

Authors: Chi Lung Cheng, Gurpreet Singh, Benjamin Nachman

Abstract: We propose a new machine-learning-based anomaly detection strategy for comparing data with a background-only reference (a form of weak supervision). The sensitivity of previous strategies degrades significantly when the signal is too rare or there are many unhelpful features. Our Prior-Assisted Weak Supervision (PAWS) method incorporates information from a class of signal models in order to signif… ▽ More We propose a new machine-learning-based anomaly detection strategy for comparing data with a background-only reference (a form of weak supervision). The sensitivity of previous strategies degrades significantly when the signal is too rare or there are many unhelpful features. Our Prior-Assisted Weak Supervision (PAWS) method incorporates information from a class of signal models in order to significantly enhance the search sensitivity of weakly supervised approaches. As long as the true signal is in the pre-specified class, PAWS matches the sensitivity of a dedicated, fully supervised method without specifying the exact parameters ahead of time. On the benchmark LHC Olympics anomaly detection dataset, our mix of semi-supervised and weakly supervised learning is able to extend the sensitivity over previous methods by a factor of 10 in cross section. Furthermore, if we add irrelevant (noise) dimensions to the inputs, classical methods degrade by another factor of 10 in cross section while PAWS remains insensitive to noise. This new approach could be applied in a number of scenarios and pushes the frontier of sensitivity between completely model-agnostic approaches and fully model-specific searches. △ Less

Submitted 14 May, 2024; originally announced May 2024.

Comments: 7 pages, 2 figures

Enhancing Decision-Making in Optimization through LLM-Assisted Inference: A Neural Networks Perspective

Authors: Gaurav Singh, Kavitesh Kumar Bali

Abstract: This paper explores the seamless integration of Generative AI (GenAI) and Evolutionary Algorithms (EAs) within the domain of large-scale multi-objective optimization. Focusing on the transformative role of Large Language Models (LLMs), our study investigates the potential of LLM-Assisted Inference to automate and enhance decision-making processes. Specifically, we highlight its effectiveness in il… ▽ More This paper explores the seamless integration of Generative AI (GenAI) and Evolutionary Algorithms (EAs) within the domain of large-scale multi-objective optimization. Focusing on the transformative role of Large Language Models (LLMs), our study investigates the potential of LLM-Assisted Inference to automate and enhance decision-making processes. Specifically, we highlight its effectiveness in illuminating key decision variables in evolutionarily optimized solutions while articulating contextual trade-offs. Tailored to address the challenges inherent in inferring complex multi-objective optimization solutions at scale, our approach emphasizes the adaptive nature of LLMs, allowing them to provide nuanced explanations and align their language with diverse stakeholder expertise levels and domain preferences. Empirical studies underscore the practical applicability and impact of LLM-Assisted Inference in real-world decision-making scenarios. △ Less

Submitted 12 May, 2024; originally announced May 2024.

Comments: Accepted IJCNN

Coronal modulation in the ultra-fast rotator LO Peg

Authors: Gurpreet Singh, Jeewan Chandra Pandey, Umesh Yadava

Abstract: We present coronal imaging of the ultra-fast rotator, LO Peg, using the X-ray observations from XMM-Newton. The X-ray light curves show one strong flare at the end of observation, as reported in an earlier study. On removal of flaring events, the quiescent state light curve shows rotational modulations, which are modelled using a maximum likelihood model. The results obtained from modelling show t… ▽ More We present coronal imaging of the ultra-fast rotator, LO Peg, using the X-ray observations from XMM-Newton. The X-ray light curves show one strong flare at the end of observation, as reported in an earlier study. On removal of flaring events, the quiescent state light curve shows rotational modulations, which are modelled using a maximum likelihood model. The results obtained from modelling show the corona of LO Peg is not uniform. Active regions are concentrated around two longitudes, where one active region appears to be compact. The large coronal area that covers almost 60 degrees along longitude from the poles to the equator does not consist of active regions. △ Less

Submitted 8 May, 2024; originally announced May 2024.

Comments: Accepted for publication in Bulletin de la Société Royale des Sciences de Liège (BSRSL)

Star Proper Motions Based on Two-epoch Observations from the SDSS and DESI Imaging Surveys

Authors: Yun-Ao Xiao, Hu Zou, Xin Xu, Lu Feng, Wei-Jian Guo, Wenxiong Li, Zhixia Shen, Gaurav Singh, Jipeng Sui, Jiali Wang, Suijian Xue

Abstract: In this study, we present the construction of a new proper motion catalog utilizing the photometric data from the Sloan Digital Sky Survey (SDSS) and Dark Energy Spectroscopic Instrument (DESI) imaging surveys, with a median time baseline of about 13 years. To mitigate systematic errors, the DESI galaxy positions are employed to establish a reference frame and to correct the position-, magnitude-,… ▽ More In this study, we present the construction of a new proper motion catalog utilizing the photometric data from the Sloan Digital Sky Survey (SDSS) and Dark Energy Spectroscopic Instrument (DESI) imaging surveys, with a median time baseline of about 13 years. To mitigate systematic errors, the DESI galaxy positions are employed to establish a reference frame and to correct the position-, magnitude-, and color-dependent discrepancies between SDSS and DESI imaging datasets. Spanning 12,589 square degrees, the catalog encompasses about 206.6 million non-Gaia objects down to $m_r \sim$ 23. Based on 734k quasars, the assessment of the global systematic errors in DESI-SDSS proper motion catalog yields values of 0.14 mas yr$^{-1}$ for $μ_{α*}$ and 0.11 mas yr$^{-1}$ for $μ_δ$. The catalog exhibits a precision surpassing 3.7 mas yr$^{-1}$, albeit varying with position, color, and magnitude. An additional evaluation employing approximately 5,300 distant star samples yields an overall precision of approximately 3.0 and 2.9 mas yr$^{-1}$ for $μ_{α*}$ and $μ_δ$, respectively. Further comparisons with proper motions from SDSS Stripe 82 reveal a strong consistency between the two datasets. As a practical application, we utilize fainter non-Gaia objects in our catalog to update the proper motions of 17 star clusters. The resulting proper motions for these clusters exhibit excellent consistency with those derived from Gaia data. Our proper motion measurements, characterized by a deeper limiting magnitude, stands as a valuable complement to the Gaia dataset. The catalog is publicly available at \url{https://www.scidb.cn/s/YzaIv2}. △ Less

Submitted 7 May, 2024; originally announced May 2024.

MP-DPD: Low-Complexity Mixed-Precision Neural Networks for Energy-Efficient Digital Predistortion of Wideband Power Amplifiers

Authors: Yizhuo Wu, Ang Li, Mohammadreza Beikmirza, Gagan Deep Singh, Qinyu Chen, Leo C. N. de Vreede, Morteza Alavi, Chang Gao

Abstract: Digital Pre-Distortion (DPD) enhances signal quality in wideband RF power amplifiers (PAs). As signal bandwidths expand in modern radio systems, DPD's energy consumption increasingly impacts overall system efficiency. Deep Neural Networks (DNNs) offer promising advancements in DPD, yet their high complexity hinders their practical deployment. This paper introduces open-source mixed-precision (MP)… ▽ More Digital Pre-Distortion (DPD) enhances signal quality in wideband RF power amplifiers (PAs). As signal bandwidths expand in modern radio systems, DPD's energy consumption increasingly impacts overall system efficiency. Deep Neural Networks (DNNs) offer promising advancements in DPD, yet their high complexity hinders their practical deployment. This paper introduces open-source mixed-precision (MP) neural networks that employ quantized low-precision fixed-point parameters for energy-efficient DPD. This approach reduces computational complexity and memory footprint, thereby lowering power consumption without compromising linearization efficacy. Applied to a 160MHz-BW 1024-QAM OFDM signal from a digital RF PA, MP-DPD gives no performance loss against 32-bit floating-point precision DPDs, while achieving -43.75 (L)/-45.27 (R) dBc in Adjacent Channel Power Ratio (ACPR) and -38.72 dB in Error Vector Magnitude (EVM). A 16-bit fixed-point-precision MP-DPD enables a 2.8X reduction in estimated inference power. The PyTorch learning and testing code is publicly available at \url{https://github.com/lab-emi/OpenDPD}. △ Less

Submitted 18 April, 2024; originally announced April 2024.

Comments: Accepted to IEEE Microwave and Wireless Technology Letters (MWTL)

Sketch-Plan-Generalize: Continual Few-Shot Learning of Inductively Generalizable Spatial Concepts

Authors: Namasivayam Kalithasan, Sachit Sachdeva, Himanshu Gaurav Singh, Vishal Bindal, Arnav Tuli, Gurarmaan Singh Panjeta, Divyanshu Aggarwal, Rohan Paul, Parag Singla

Abstract: Our goal is to enable embodied agents to learn inductively generalizable spatial concepts, e.g., learning staircase as an inductive composition of towers of increasing height. Given a human demonstration, we seek a learning architecture that infers a succinct ${program}$ representation that explains the observed instance. Additionally, the approach should generalize inductively to novel structures… ▽ More Our goal is to enable embodied agents to learn inductively generalizable spatial concepts, e.g., learning staircase as an inductive composition of towers of increasing height. Given a human demonstration, we seek a learning architecture that infers a succinct ${program}$ representation that explains the observed instance. Additionally, the approach should generalize inductively to novel structures of different sizes or complex structures expressed as a hierarchical composition of previously learned concepts. Existing approaches that use code generation capabilities of pre-trained large (visual) language models, as well as purely neural models, show poor generalization to a-priori unseen complex concepts. Our key insight is to factor inductive concept learning as (i) ${\it Sketch:}$ detecting and inferring a coarse signature of a new concept (ii) ${\it Plan:}$ performing MCTS search over grounded action sequences (iii) ${\it Generalize:}$ abstracting out grounded plans as inductive programs. Our pipeline facilitates generalization and modular reuse, enabling continual concept learning. Our approach combines the benefits of the code generation ability of large language models (LLM) along with grounded neural representations, resulting in neuro-symbolic programs that show stronger inductive generalization on the task of constructing complex structures in relation to LLM-only and neural-only approaches. Furthermore, we demonstrate reasoning and planning capabilities with learned concepts for embodied instruction following. △ Less

Submitted 29 May, 2024; v1 submitted 11 April, 2024; originally announced April 2024.

Hook length biases in ordinary and $t$-regular partitions

Authors: Gurinder Singh, Rupam Barman

Abstract: In this article, we study hook lengths of ordinary partitions and $t$-regular partitions. We establish hook length biases for the ordinary partitions and motivated by them we find a few interesting hook length biases in $2$-regular partitions. For a positive integer $k$, let $p_{(k)}(n)$ denote the number of hooks of length $k$ in all the partitions of $n$. We prove that… ▽ More In this article, we study hook lengths of ordinary partitions and $t$-regular partitions. We establish hook length biases for the ordinary partitions and motivated by them we find a few interesting hook length biases in $2$-regular partitions. For a positive integer $k$, let $p_{(k)}(n)$ denote the number of hooks of length $k$ in all the partitions of $n$. We prove that $p_{(k)}(n)\geq p_{(k+1)}(n)$ for all $n\geq0$ and $n\ne k+1$; and $p_{(k)}(k+1)- p_{(k+1)}(k+1)=-1$ for $k\geq 2$. For integers $t\geq2$ and $k\geq1$, let $b_{t,k}(n)$ denote the number of hooks of length $k$ in all the $t$-regular partitions of $n$. We find generating functions of $b_{t,k}(n)$ for certain values of $t$ and $k$. Exploring hook length biases for $b_{t,k}(n)$, we observe that in certain cases biases are opposite to the biases for ordinary partitions. We prove that $b_{2,2}(n)\geq b_{2,1}(n)$ for all $n>4$, whereas $b_{2,2}(n)\geq b_{2,3}(n)$ for all $n\geq 0$. We also propose some conjectures on biases among $b_{t,k}(n)$. △ Less

Submitted 29 May, 2024; v1 submitted 11 April, 2024; originally announced April 2024.

Comments: To appear at Journal of Number Theory

Highly reflective and high-$Q$ thin resonant subwavelength gratings

Authors: Gurpreet Singh, Trishala Mitra, Søren P. Madsen, Aurélien Dantan

Abstract: We theoretically investigate the design of thin subwavelength gratings possessing high-reflectivity and high-$Q$ resonances when illuminated at normal incidence by a Gaussian beam. We compare the performances of single-period and dual-period rectangular gratings using Finite Element Method-based optimization and predict one to two orders of magnitude improvement in their transmission loss-linewidt… ▽ More We theoretically investigate the design of thin subwavelength gratings possessing high-reflectivity and high-$Q$ resonances when illuminated at normal incidence by a Gaussian beam. We compare the performances of single-period and dual-period rectangular gratings using Finite Element Method-based optimization and predict one to two orders of magnitude improvement in their transmission loss-linewidth product, which is the relevant figure of merit for e.g. resonant mirror-based microcavity applications. △ Less

Submitted 9 April, 2024; originally announced April 2024.

Syndicate: Synergistic Synthesis of Ranking Function and Invariants for Termination Analysis

Authors: Yasmin Sarita, Avaljot Singh, Shaurya Gomber, Gagandeep Singh, Mahesh Vishwanathan

Abstract: Several techniques have been developed to prove the termination of programs. Finding ranking functions is one of the common approaches to do so. A ranking function must be bounded and must reduce at every iteration for all the reachable program states. Since the set of reachable states is often unknown, invariants serve as an over-approximation. Further, in the case of nested loops, the initial se… ▽ More Several techniques have been developed to prove the termination of programs. Finding ranking functions is one of the common approaches to do so. A ranking function must be bounded and must reduce at every iteration for all the reachable program states. Since the set of reachable states is often unknown, invariants serve as an over-approximation. Further, in the case of nested loops, the initial set of program states for the nested loop can be determined by the invariant of the outer loop. So, invariants play an important role in proving the validity of a ranking function in the absence of the exact reachable states. However, in the existing techniques, either the invariants are synthesized independently, or combined with ranking function synthesis into a single query, both of which are inefficient. We observe that a guided search for invariants and ranking functions can have benefits in terms of the number of programs that can be proved to terminate and the time needed to identify a proof of termination. So, in this work, we develop Syndicate, a novel framework that synergistically guides the search for both the ranking function and an invariant that together constitute a proof of termination. Owing to our synergistic approach, Syndicate can not only prove the termination of more benchmarks but also achieves a reduction ranging from 17% to 70% in the average runtime as compared to existing state-of-the-art termination analysis tools. We also prove that Syndicate is relatively complete, i.e., if there exists a ranking function and an invariant in their respective templates that can be used to prove the termination of a program, then Syndicate will always find it if there exist complete procedures for the template-specific functions in our framework. △ Less

Submitted 8 April, 2024; originally announced April 2024.

Constrained 6-DoF Grasp Generation on Complex Shapes for Improved Dual-Arm Manipulation

Authors: Gaurav Singh, Sanket Kalwar, Md Faizal Karim, Bipasha Sen, Nagamanikandan Govindan, Srinath Sridhar, K Madhava Krishna

Abstract: Efficiently generating grasp poses tailored to specific regions of an object is vital for various robotic manipulation tasks, especially in a dual-arm setup. This scenario presents a significant challenge due to the complex geometries involved, requiring a deep understanding of the local geometry to generate grasps efficiently on the specified constrained regions. Existing methods only explore set… ▽ More Efficiently generating grasp poses tailored to specific regions of an object is vital for various robotic manipulation tasks, especially in a dual-arm setup. This scenario presents a significant challenge due to the complex geometries involved, requiring a deep understanding of the local geometry to generate grasps efficiently on the specified constrained regions. Existing methods only explore settings involving table-top/small objects and require augmented datasets to train, limiting their performance on complex objects. We propose CGDF: Constrained Grasp Diffusion Fields, a diffusion-based grasp generative model that generalizes to objects with arbitrary geometries, as well as generates dense grasps on the target regions. CGDF uses a part-guided diffusion approach that enables it to get high sample efficiency in constrained grasping without explicitly training on massive constraint-augmented datasets. We provide qualitative and quantitative comparisons using analytical metrics and in simulation, in both unconstrained and constrained settings to show that our method can generalize to generate stable grasps on complex objects, especially useful for dual-arm manipulation settings, while existing methods struggle to do so. △ Less

Submitted 15 July, 2024; v1 submitted 6 April, 2024; originally announced April 2024.

Comments: Project Page: https://constrained-grasp-diffusion.github.io/

Real-time Geoinformation Systems to Improve the Quality, Scalability, and Cost of Internet of Things for Agri-environment Research

Authors: Bryan C. Runck, Bobby Schulz, Jeff Bishop, Nathan Carlson, Bryan Chantigian, Gary Deters, Jesse Erdmann, Patrick M. Ewing, Michael Felzan, Xiao Fu, Jan Greyling, Christopher J. Hogan, Andrew Hollman, Ali Joglekar, Kris Junker, Michael Kantar, Lumbani Kaunda, Mohana Krishna, Benjamin Lynch, Peter Marchetto, Megan Marsolek, Troy McKay, Brad Morris, Ali Rashid Niaghi, Keerthi Pamulaparthy , et al. (19 additional authors not shown)

Abstract: With the increasing emphasis on machine learning and artificial intelligence to drive knowledge discovery in the agricultural sciences, spatial internet of things (IoT) technologies have become increasingly important for collecting real-time, high resolution data for these models. However, managing large fleets of devices while maintaining high data quality remains an ongoing challenge as scientis… ▽ More With the increasing emphasis on machine learning and artificial intelligence to drive knowledge discovery in the agricultural sciences, spatial internet of things (IoT) technologies have become increasingly important for collecting real-time, high resolution data for these models. However, managing large fleets of devices while maintaining high data quality remains an ongoing challenge as scientists iterate from prototype to mature end-to-end applications. Here, we provide a set of case studies using the framework of technology readiness levels for an open source spatial IoT system. The spatial IoT systems underwent 3 major and 14 minor system versions, had over 2,727 devices manufactured both in academic and commercial contexts, and are either in active or planned deployment across four continents. Our results show the evolution of a generalizable, open source spatial IoT system designed for agricultural scientists, and provide a model for academic researchers to overcome the challenges that exist in going from one-off prototypes to thousands of internet-connected devices. △ Less

Submitted 2 April, 2024; v1 submitted 28 March, 2024; originally announced March 2024.

Comments: 20 pages, 5 figures, 1 table

ConstraintFlow: A DSL for Specification and Verification of Neural Network Analyses

Authors: Avaljot Singh, Yasmin Sarita, Charith Mendis, Gagandeep Singh

Abstract: The uninterpretability of DNNs hinders their deployment to safety-critical applications. Recent works have shown that Abstract-Interpretation-based formal certification techniques provide promising avenues for building trust in DNNs to some extent. The intricate mathematical background of Abstract Interpretation poses two challenges: (i) easily designing the algorithms that capture the intricate D… ▽ More The uninterpretability of DNNs hinders their deployment to safety-critical applications. Recent works have shown that Abstract-Interpretation-based formal certification techniques provide promising avenues for building trust in DNNs to some extent. The intricate mathematical background of Abstract Interpretation poses two challenges: (i) easily designing the algorithms that capture the intricate DNN behavior by balancing cost vs. precision tradeoff, and (ii) maintaining the over-approximation-based soundness of these certifiers. General-purpose programming languages like C++ provide extensive functionality, however, verifying the soundness of the algorithms written in them can be impractical. The most commonly used DNN certification libraries like auto_LiRPA and ERAN prove the correctness of their analyses. However, they consist of only a few hard-coded abstract domains and abstract transformers (or transfer functions) and do not allow the user to define new analyses. Further, these libraries can handle only specific DNN architectures. To address these issues, we develop a declarative DSL -- ConstraintFlow -- that can be used to specify Abstract Interpretation-based DNN certifiers. In ConstraintFlow, programmers can easily define various existing and new abstract domains and transformers, all within just a few 10s of Lines of Code as opposed to 1000s of LOCs of existing libraries. We also provide lightweight automatic verification, which can be used to ensure the over-approximation-based soundness of the certifier code written in ConstraintFlow for arbitrary (but bounded) DNN architectures. Using this automated verification procedure, for the first time, we can verify the soundness of state-of-the-art DNN certifiers for arbitrary DNN architectures, all within a few minutes. We prove the soundness of our verification procedure and the completeness of a subset of ConstraintFlow. △ Less

Submitted 27 March, 2024; originally announced March 2024.

Is Watermarking LLM-Generated Code Robust?

Authors: Tarun Suresh, Shubham Ugare, Gagandeep Singh, Sasa Misailovic

Abstract: We present the first study of the robustness of existing watermarking techniques on Python code generated by large language models. Although existing works showed that watermarking can be robust for natural language, we show that it is easy to remove these watermarks on code by semantic-preserving transformations. We present the first study of the robustness of existing watermarking techniques on Python code generated by large language models. Although existing works showed that watermarking can be robust for natural language, we show that it is easy to remove these watermarks on code by semantic-preserving transformations. △ Less

Submitted 28 June, 2024; v1 submitted 24 March, 2024; originally announced March 2024.

SynCode: LLM Generation with Grammar Augmentation

Authors: Shubham Ugare, Tarun Suresh, Hangoo Kang, Sasa Misailovic, Gagandeep Singh

Abstract: LLMs are widely used in complex AI applications. These applications underscore the need for LLM outputs to adhere to a specific format, for their integration with other components in the systems. Typically the format rules e.g., for data serialization formats such as JSON, YAML, or Code in Programming Language are expressed as context-free grammar (CFG). Due to the hallucinations and unreliability… ▽ More LLMs are widely used in complex AI applications. These applications underscore the need for LLM outputs to adhere to a specific format, for their integration with other components in the systems. Typically the format rules e.g., for data serialization formats such as JSON, YAML, or Code in Programming Language are expressed as context-free grammar (CFG). Due to the hallucinations and unreliability of LLMs, instructing LLMs to adhere to specified syntax becomes an increasingly important challenge. We present SynCode, a novel framework for efficient and general syntactical decoding with LLMs, to address this challenge. SynCode ensures soundness and completeness with respect to the CFG of a formal language, effectively retaining valid tokens while filtering out invalid ones. SynCode uses an offline-constructed, efficient lookup table, the DFA mask store, derived from the DFA of the language's grammar for efficient generation. SynCode seamlessly integrates with any language defined by CFG, as evidenced by experiments focusing on generating JSON, Python, and Go outputs. Our experiments evaluating the effectiveness of SynCode for JSON generation demonstrate that SynCode eliminates all syntax errors and significantly outperforms state-of-the-art baselines. Furthermore, our results underscore how SynCode significantly reduces 96.07% of syntax errors in generated Python and Go code, showcasing its substantial impact on enhancing syntactical precision in LLM generation. Our code is available at https://github.com/uiuc-focal-lab/syncode △ Less

Submitted 14 July, 2024; v1 submitted 3 March, 2024; originally announced March 2024.

AB Dor: Coronal imaging and activity cycles

Authors: Gurpreet Singh, Jeewan C. Pandey

Abstract: Using long-term X-ray observations, we present the short-term and long-term X-ray variability analysis of the ultra-fast rotating active star AB Dor. Flaring events are common in X-ray observations of AB Dor and occupy a substantial portion of the total observation time, averaging around 57$\pm$23\%. The flare-free X-ray light curves show rotational modulation, indicating the presence of highly ac… ▽ More Using long-term X-ray observations, we present the short-term and long-term X-ray variability analysis of the ultra-fast rotating active star AB Dor. Flaring events are common in X-ray observations of AB Dor and occupy a substantial portion of the total observation time, averaging around 57$\pm$23\%. The flare-free X-ray light curves show rotational modulation, indicating the presence of highly active regions in its corona. We have developed a light curve inversion code to image the corona of active fast rotating stars. The results of coronal imaging reveal the presence of two active regions of different brightness that are separated by $\sim$180°in longitude. These active regions are also found to migrate along the longitude and also show variation in their brightness. Our analysis of long-term X-ray data spanning from 1979 to 2022 shows multiple periodicities. The existence of a $\sim$19.2 yr cycle and its first harmonic indicates the presence of a Solar-like, long-term pattern. In comparison, the periodicities of $\sim$3.6 and $\sim$5.4 yr are possibly due to the presence of a flip-flop cycle in X-rays, which is also supported by similar periods findings from the optical data in the earlier studies. Further confirmation of the existence of the X-ray flip-flop cycle requires long-term observations at regular intervals in the quiescent state. △ Less

Submitted 29 February, 2024; originally announced February 2024.

Comments: Accepted for publication in ApJ

Parallelized Spatiotemporal Binding

Authors: Gautam Singh, Yue Wang, Jiawei Yang, Boris Ivanovic, Sungjin Ahn, Marco Pavone, Tong Che

Abstract: While modern best practices advocate for scalable architectures that support long-range interactions, object-centric models are yet to fully embrace these architectures. In particular, existing object-centric models for handling sequential inputs, due to their reliance on RNN-based implementation, show poor stability and capacity and are slow to train on long sequences. We introduce Parallelizable… ▽ More While modern best practices advocate for scalable architectures that support long-range interactions, object-centric models are yet to fully embrace these architectures. In particular, existing object-centric models for handling sequential inputs, due to their reliance on RNN-based implementation, show poor stability and capacity and are slow to train on long sequences. We introduce Parallelizable Spatiotemporal Binder or PSB, the first temporally-parallelizable slot learning architecture for sequential inputs. Unlike conventional RNN-based approaches, PSB produces object-centric representations, known as slots, for all time-steps in parallel. This is achieved by refining the initial slots across all time-steps through a fixed number of layers equipped with causal attention. By capitalizing on the parallelism induced by our architecture, the proposed model exhibits a significant boost in efficiency. In experiments, we test PSB extensively as an encoder within an auto-encoding framework paired with a wide variety of decoder options. Compared to the state-of-the-art, our architecture demonstrates stable training on longer sequences, achieves parallelization that results in a 60% increase in training speed, and yields performance that is on par with or better on unsupervised 2D and 3D object-centric scene decomposition and understanding. △ Less

Submitted 26 February, 2024; originally announced February 2024.

Comments: See project page at https://parallel-st-binder.github.io

QuaCer-C: Quantitative Certification of Knowledge Comprehension in LLMs

Authors: Isha Chaudhary, Vedaant V. Jain, Gagandeep Singh

Abstract: Large Language Models (LLMs) have demonstrated impressive performance on several benchmarks. However, traditional studies do not provide formal guarantees on the performance of LLMs. In this work, we propose a novel certification framework for LLM, QuaCer-C, wherein we formally certify the knowledge-comprehension capabilities of popular LLMs. Our certificates are quantitative - they consist of hig… ▽ More Large Language Models (LLMs) have demonstrated impressive performance on several benchmarks. However, traditional studies do not provide formal guarantees on the performance of LLMs. In this work, we propose a novel certification framework for LLM, QuaCer-C, wherein we formally certify the knowledge-comprehension capabilities of popular LLMs. Our certificates are quantitative - they consist of high-confidence, tight bounds on the probability that the target LLM gives the correct answer on any relevant knowledge comprehension prompt. Our certificates for the Llama, Vicuna, and Mistral LLMs indicate that the knowledge comprehension capability improves with an increase in the number of parameters and that the Mistral model is less performant than the rest in this evaluation. △ Less

Submitted 24 February, 2024; originally announced February 2024.

Pairing enhancement through the photography of the intermediate nucleus spectrum in a two-nucleon transfer process

Authors: G. Singh

Abstract: While forming an ($A$+2) nucleus from a nucleus $A$ via a two-neutron transfer reaction, the constructive interference of the many possible reaction channels favors significant pairing enhancement through the continuum of the intermediate ($A$+1) nucleus [Phys. Lett. B 834, 137413 (2022)]. I analyse this situation in more detail, from the point of view of a varying pairing field leading to the for… ▽ More While forming an ($A$+2) nucleus from a nucleus $A$ via a two-neutron transfer reaction, the constructive interference of the many possible reaction channels favors significant pairing enhancement through the continuum of the intermediate ($A$+1) nucleus [Phys. Lett. B 834, 137413 (2022)]. I analyse this situation in more detail, from the point of view of a varying pairing field leading to the formation of ($A$+2) nucleus $^6$He, described as housing two-neutrons in orbitals of $^5$He. The naturally unbound scenario of the intermediate $^5$He is compared with two hypothetically bound cases. The different possible situations manifest that the continuum correlations are extremely crucial to the extension of the pairing enhancement observed in the system. △ Less

Submitted 22 February, 2024; originally announced February 2024.

Comments: 8 pages, 5 figures

Reward Poisoning Attack Against Offline Reinforcement Learning

Authors: Yinglun Xu, Rohan Gumaste, Gagandeep Singh

Abstract: We study the problem of reward poisoning attacks against general offline reinforcement learning with deep neural networks for function approximation. We consider a black-box threat model where the attacker is completely oblivious to the learning algorithm and its budget is limited by constraining both the amount of corruption at each data point, and the total perturbation. We propose an attack str… ▽ More We study the problem of reward poisoning attacks against general offline reinforcement learning with deep neural networks for function approximation. We consider a black-box threat model where the attacker is completely oblivious to the learning algorithm and its budget is limited by constraining both the amount of corruption at each data point, and the total perturbation. We propose an attack strategy called `policy contrast attack'. The high-level idea is to make some low-performing policies appear as high-performing while making high-performing policies appear as low-performing. To the best of our knowledge, we propose the first black-box reward poisoning attack in the general offline RL setting. We provide theoretical insights on the attack design and empirically show that our attack is efficient against current state-of-the-art offline RL algorithms in different kinds of learning datasets. △ Less

Submitted 14 February, 2024; originally announced February 2024.

FESS Loss: Feature-Enhanced Spatial Segmentation Loss for Optimizing Medical Image Analysis

Authors: Charulkumar Chodvadiya, Navyansh Mahla, Kinshuk Gaurav Singh, Kshitij Sharad Jadhav

Abstract: Medical image segmentation is a critical process in the field of medical imaging, playing a pivotal role in diagnosis, treatment, and research. It involves partitioning of an image into multiple regions, representing distinct anatomical or pathological structures. Conventional methods often grapple with the challenge of balancing spatial precision and comprehensive feature representation due to th… ▽ More Medical image segmentation is a critical process in the field of medical imaging, playing a pivotal role in diagnosis, treatment, and research. It involves partitioning of an image into multiple regions, representing distinct anatomical or pathological structures. Conventional methods often grapple with the challenge of balancing spatial precision and comprehensive feature representation due to their reliance on traditional loss functions. To overcome this, we propose Feature-Enhanced Spatial Segmentation Loss (FESS Loss), that integrates the benefits of contrastive learning (which extracts intricate features, particularly in the nuanced domain of medical imaging) with the spatial accuracy inherent in the Dice loss. The objective is to augment both spatial precision and feature-based representation in the segmentation of medical images. FESS Loss signifies a notable advancement, offering a more accurate and refined segmentation process, ultimately contributing to heightened precision in the analysis of medical images. Further, FESS loss demonstrates superior performance in limited annotated data availability scenarios often present in the medical domain. △ Less

Submitted 26 February, 2024; v1 submitted 13 February, 2024; originally announced February 2024.

Comments: 5 Pages, 3 figures

Arboreal Obstructed Atomic Insulating and Metallic Phases of Fermions

Authors: Gurkirat Singh, Surajit Bera, Vijay B. Shenoy

Abstract: We explore phases of free fermions on arenas that do not tessellate a manifold. Specializing to arboreal arenas described by tree graphs which possess a notion of translation symmetry, we study possible fermionic phases in the BDI symmetry class on the $p$-coordinated Bethe lattice. We find that there are $p$ distinct obstructed atomic insulating phases that are characterized by distinct edge stat… ▽ More We explore phases of free fermions on arenas that do not tessellate a manifold. Specializing to arboreal arenas described by tree graphs which possess a notion of translation symmetry, we study possible fermionic phases in the BDI symmetry class on the $p$-coordinated Bethe lattice. We find that there are $p$ distinct obstructed atomic insulating phases that are characterized by distinct edge states, pattern of entanglement, and a winding characteristic that we define here. These distinct insulting phases are always separated by a metallic region in the parameter space rather than isolated quantum critical points. The metallic region itself comprises several distinct metallic phases that are distinguished by the winding characteristic and correlation functions. The correlation functions of distinct subsystems display non-analytic behavior at distinct points in the metallic region, signaling a cascade of subsystem transitions. An intriguing feature of these arboreal metals is the presence of truncated subsystems with zero energy boundary modes despite being gapless. This work suggests new opportunities for synthetic quantum systems to realize these novel phases. △ Less

Submitted 12 February, 2024; originally announced February 2024.

Comments: 12 pages, 6 figures, Supplemental Material (20 pages, 12 figures)

RAMP: Boosting Adversarial Robustness Against Multiple $l_p$ Perturbations

Authors: Enyi Jiang, Gagandeep Singh

Abstract: There is considerable work on improving robustness against adversarial attacks bounded by a single $l_p$ norm using adversarial training (AT). However, the multiple-norm robustness (union accuracy) of AT models is still low. We observe that simultaneously obtaining good union and clean accuracy is hard since there are tradeoffs between robustness against multiple $l_p$ perturbations, and accuracy/… ▽ More There is considerable work on improving robustness against adversarial attacks bounded by a single $l_p$ norm using adversarial training (AT). However, the multiple-norm robustness (union accuracy) of AT models is still low. We observe that simultaneously obtaining good union and clean accuracy is hard since there are tradeoffs between robustness against multiple $l_p$ perturbations, and accuracy/robustness/efficiency. By analyzing the tradeoffs from the lens of distribution shifts, we identify the key tradeoff pair among $l_p$ attacks to boost efficiency and design a logit pairing loss to improve the union accuracy. Next, we connect natural training with AT via gradient projection, to find and incorporate useful information from natural training into AT, which moderates the accuracy/robustness tradeoff. Combining our contributions, we propose a framework called \textbf{RAMP}, to boost the robustness against multiple $l_p$ perturbations. We show \textbf{RAMP} can be easily adapted for both robust fine-tuning and full AT. For robust fine-tuning, \textbf{RAMP} obtains a union accuracy up to $53.5\%$ on CIFAR-10, and $29.7\%$ on ImageNet. For training from scratch, \textbf{RAMP} achieves SOTA union accuracy of $44.6\%$ and relatively good clean accuracy of $81.2\%$ on ResNet-18 against AutoAttack on CIFAR-10. △ Less

Submitted 9 February, 2024; originally announced February 2024.

Radiative neutron capture rate of $^{11}$B$(n,γ)^{12}$B reaction from the Coulomb dissociation of $^{12}$B

Authors: Shubhchintak, G. Singh, R. Chatterjee, M. Dan

Abstract: We calculate the $^{11}$B$(n,γ)^{12}$B reaction rate, an important constituent in nucleosynthesis networks, contributed by resonant as well as non-resonant capture. For the resonant rate, we use the narrow resonance approximation whereas the non-resonant contribution is calculated with the Coulomb dissociation method for which we use finite-range distorted wave Born approximation theory. We then c… ▽ More We calculate the $^{11}$B$(n,γ)^{12}$B reaction rate, an important constituent in nucleosynthesis networks, contributed by resonant as well as non-resonant capture. For the resonant rate, we use the narrow resonance approximation whereas the non-resonant contribution is calculated with the Coulomb dissociation method for which we use finite-range distorted wave Born approximation theory. We then compare our calculated rate of $^{11}$B$(n,γ)^{12}$B reaction with those reported earlier and with other charged particle reactions on $^{11}$B. △ Less

Submitted 9 February, 2024; originally announced February 2024.

Narrow-linewidth Fano microcavities with resonant subwavelength grating mirror

Authors: Trishala Mitra, Gurpreet Singh, Ali Akbar Darki, Søren Peder Madsen, Aurélien Dantan

Abstract: We report on the theoretical and experimental investigations of optical microcavities consisting in the plane-plane arrangement of a broadband high-reflectivity mirror and a suspended one-dimensional grating mirror possessing a high-quality factor Fano resonance. By varying the length of these cavities from the millimeter to the few-micron range, we observe at short lengths the reduction of the sp… ▽ More We report on the theoretical and experimental investigations of optical microcavities consisting in the plane-plane arrangement of a broadband high-reflectivity mirror and a suspended one-dimensional grating mirror possessing a high-quality factor Fano resonance. By varying the length of these cavities from the millimeter to the few-micron range, we observe at short lengths the reduction of the spectral linewidth predicted to occur for such a Fano cavity as compared to a conventional broadband mirror cavity with the same length and internal losses. Such narrow linewidth and small modevolume microcavities with high-mechanical quality ultrathin mirrors will be attractive for a wide range of applications within optomechanics and sensing. △ Less

Submitted 8 February, 2024; originally announced February 2024.

Journal ref: Optics Express 32, 15667 (2024)

Blue noise for diffusion models

Authors: Xingchang Huang, Corentin Salaün, Cristina Vasconcelos, Christian Theobalt, Cengiz Öztireli, Gurprit Singh

Abstract: Most of the existing diffusion models use Gaussian noise for training and sampling across all time steps, which may not optimally account for the frequency contents reconstructed by the denoising network. Despite the diverse applications of correlated noise in computer graphics, its potential for improving the training process has been underexplored. In this paper, we introduce a novel and general… ▽ More Most of the existing diffusion models use Gaussian noise for training and sampling across all time steps, which may not optimally account for the frequency contents reconstructed by the denoising network. Despite the diverse applications of correlated noise in computer graphics, its potential for improving the training process has been underexplored. In this paper, we introduce a novel and general class of diffusion models taking correlated noise within and across images into account. More specifically, we propose a time-varying noise model to incorporate correlated noise into the training process, as well as a method for fast generation of correlated noise mask. Our model is built upon deterministic diffusion models and utilizes blue noise to help improve the generation quality compared to using Gaussian white (random) noise only. Further, our framework allows introducing correlation across images within a single mini-batch to improve gradient flow. We perform both qualitative and quantitative evaluations on a variety of datasets using our method, achieving improvements on different tasks over existing deterministic diffusion models in terms of FID metric. △ Less

Submitted 2 May, 2024; v1 submitted 7 February, 2024; originally announced February 2024.

Comments: SIGGRAPH 2024 Conference Proceedings; Project page: https://xchhuang.github.io/bndm

Symmetry breaking and spin-orbit coupling for individual vacancy-induced in-gap states in MoS2 monolayers

Authors: Thasneem Aliyar, Hongyang Ma, Radha Krishnan, Gagandeep Singh, Bi Qi Chong, Yitao Wang, Ivan Verzhbitskiy, Calvin Pei Yu Wong, Kuan Eng Johnson Goh, Ze Xiang Shen, Teck Seng Koh, Rajib Rahman, Bent Weber

Abstract: Spins confined to point defects in atomically-thin semiconductors constitute well-defined atomic-scale quantum systems that are being explored as single photon emitters and spin qubits. Here, we investigate the in-gap electronic structure of individual sulphur vacancies in molybdenum disulphide (MoS2) monolayers using resonant tunneling scanning probe spectroscopy in the Coulomb blockade regime. S… ▽ More Spins confined to point defects in atomically-thin semiconductors constitute well-defined atomic-scale quantum systems that are being explored as single photon emitters and spin qubits. Here, we investigate the in-gap electronic structure of individual sulphur vacancies in molybdenum disulphide (MoS2) monolayers using resonant tunneling scanning probe spectroscopy in the Coulomb blockade regime. Spectroscopic mapping of defect wavefunctions reveals an interplay of local symmetry breaking by a charge-state dependent Jahn-Teller lattice distortion that, when combined with strong (~100 meV) spin-orbit coupling, leads to a locking of an unpaired spin-1/2 magnetic moment to the lattice at low temperature, susceptible to lattice strain. Our results provide new insights into spin and electronic structure of vacancy induced in-gap states towards their application as electrically and optically addressable quantum systems. △ Less

Submitted 20 February, 2024; v1 submitted 2 February, 2024; originally announced February 2024.

Ultrafast measurements under anisotropic strain reveal near equivalence of competing charge orders in TbTe$_3$

Authors: Soyeun Kim, Gal Orenstein, Anisha G. Singh, Ian R. Fisher, David A. Reis, Mariano Trigo

Abstract: We report ultrafast reflectivity measurements of the dynamics of the order parameter of the charge density wave (CDW) in TbTe$_3$ under anisotropic strain. We observe an increase in the frequency of the amplitude mode with increasing tensile strain along the $a$-axis (which drives the lattice into $a>c$, with $a$ and $c$ the lattice constants), and similar behavior for tensile strain along $c$ (… ▽ More We report ultrafast reflectivity measurements of the dynamics of the order parameter of the charge density wave (CDW) in TbTe$_3$ under anisotropic strain. We observe an increase in the frequency of the amplitude mode with increasing tensile strain along the $a$-axis (which drives the lattice into $a>c$, with $a$ and $c$ the lattice constants), and similar behavior for tensile strain along $c$ ($c>a$). This suggests that both strains stabilize the corresponding CDW order and further support the near equivalence of the CDW phases oriented in $a$- and $c$-axis, in spite of the orthorhombic space group. The results were analyzed within the time-dependent Ginzburg-Landau framework, which agrees well with the reflectivity dynamics. △ Less

Submitted 9 May, 2024; v1 submitted 30 January, 2024; originally announced January 2024.

Comments: 7 pages, 4 figures

Stoichiometric control of electron mobility and 2D superconductivity at LaAlO$_3$-SrTiO$_3$ interfaces

Authors: Gyanendra Singh, Roger Guzman, Guilhem Saïz, Wu Zhou, Jaume Gazquez, Jordi Fraxedas, Fereshteh Masoudinia, Dag Winkler, Tord Claeson, Nicolas Bergeal, Gervasi Herranz, Alexei Kalaboukhov

Abstract: SrTiO$_3$-based conducting interfaces, which exhibit coexistence of gate-tunable 2D superconductivity and strong Rashba spin-orbit coupling (RSOC), are candidates to host topological superconductive phases. Yet, superconductivity is usually in the dirty limit, which tends to suppress nonconventional pairing and therefore challenges these expectations. Here we report on LaAlO$_3$/SrTiO$_3$ (LAO/STO… ▽ More SrTiO$_3$-based conducting interfaces, which exhibit coexistence of gate-tunable 2D superconductivity and strong Rashba spin-orbit coupling (RSOC), are candidates to host topological superconductive phases. Yet, superconductivity is usually in the dirty limit, which tends to suppress nonconventional pairing and therefore challenges these expectations. Here we report on LaAlO$_3$/SrTiO$_3$ (LAO/STO) interfaces with remarkably large mobility and mean free paths comparable to the superconducting coherence length, approaching the clean limit for superconductivity. We further show that the carrier density, mobility, and formation of the superconducting condensate are controlled by the fine-tuning of La/Al chemical ratio in the LAO film. Interestingly, we find a region in the superconducting phase diagram where the critical temperature is not suppressed below the Lifshitz transition, at odds with previous experimental investigations. These findings point out the relevance of achieving a clean-limit regime to enhance the observation of unconventional pairing mechanisms in these systems △ Less

Submitted 25 January, 2024; originally announced January 2024.

OpenDPD: An Open-Source End-to-End Learning & Benchmarking Framework for Wideband Power Amplifier Modeling and Digital Pre-Distortion

Authors: Yizhuo Wu, Gagan Deep Singh, Mohammadreza Beikmirza, Leo C. N. de Vreede, Morteza Alavi, Chang Gao

Abstract: With the rise in communication capacity, deep neural networks (DNN) for digital pre-distortion (DPD) to correct non-linearity in wideband power amplifiers (PAs) have become prominent. Yet, there is a void in open-source and measurement-setup-independent platforms for fast DPD exploration and objective DPD model comparison. This paper presents an open-source framework, OpenDPD, crafted in PyTorch,… ▽ More With the rise in communication capacity, deep neural networks (DNN) for digital pre-distortion (DPD) to correct non-linearity in wideband power amplifiers (PAs) have become prominent. Yet, there is a void in open-source and measurement-setup-independent platforms for fast DPD exploration and objective DPD model comparison. This paper presents an open-source framework, OpenDPD, crafted in PyTorch, with an associated dataset for PA modeling and DPD learning. We introduce a Dense Gated Recurrent Unit (DGRU)-DPD, trained via a novel end-to-end learning architecture, outperforming previous DPD models on a digital PA (DPA) in the new digital transmitter (DTX) architecture with unconventional transfer characteristics compared to analog PAs. Measurements show our DGRU-DPD achieves an ACPR of -44.69/-44.47 dBc and an EVM of -35.22 dB for 200 MHz OFDM signals. OpenDPD code, datasets, and documentation are publicly available at https://github.com/lab-emi/OpenDPD. △ Less

Submitted 24 January, 2024; v1 submitted 16 January, 2024; originally announced January 2024.

Comments: To be published at the 2024 IEEE International Symposium on Circuits and Systems (ISCAS), Singapore

Uncertainty quantification for probabilistic machine learning in earth observation using conformal prediction

Authors: Geethen Singh, Glenn Moncrieff, Zander Venter, Kerry Cawse-Nicholson, Jasper Slingsby, Tamara B Robinson

Abstract: Unreliable predictions can occur when using artificial intelligence (AI) systems with negative consequences for downstream applications, particularly when employed for decision-making. Conformal prediction provides a model-agnostic framework for uncertainty quantification that can be applied to any dataset, irrespective of its distribution, post hoc. In contrast to other pixel-level uncertainty qu… ▽ More Unreliable predictions can occur when using artificial intelligence (AI) systems with negative consequences for downstream applications, particularly when employed for decision-making. Conformal prediction provides a model-agnostic framework for uncertainty quantification that can be applied to any dataset, irrespective of its distribution, post hoc. In contrast to other pixel-level uncertainty quantification methods, conformal prediction operates without requiring access to the underlying model and training dataset, concurrently offering statistically valid and informative prediction regions, all while maintaining computational efficiency. In response to the increased need to report uncertainty alongside point predictions, we bring attention to the promise of conformal prediction within the domain of Earth Observation (EO) applications. To accomplish this, we assess the current state of uncertainty quantification in the EO domain and found that only 20% of the reviewed Google Earth Engine (GEE) datasets incorporated a degree of uncertainty information, with unreliable methods prevalent. Next, we introduce modules that seamlessly integrate into existing GEE predictive modelling workflows and demonstrate the application of these tools for datasets spanning local to global scales, including the Dynamic World and Global Ecosystem Dynamics Investigation (GEDI) datasets. These case studies encompass regression and classification tasks, featuring both traditional and deep learning-based workflows. Subsequently, we discuss the opportunities arising from the use of conformal prediction in EO. We anticipate that the increased availability of easy-to-use implementations of conformal predictors, such as those provided here, will drive wider adoption of rigorous uncertainty quantification in EO, thereby enhancing the reliability of uses such as operational monitoring and decision making. △ Less

Submitted 12 January, 2024; originally announced January 2024.

Efficient Two-Phase Offline Deep Reinforcement Learning from Preference Feedback

Authors: Yinglun Xu, Gagandeep Singh

Abstract: In this work, we consider the offline preference-based reinforcement learning problem. We focus on the two-phase learning approach that is prevalent in previous reinforcement learning from human preference works. We find a challenge in applying two-phase learning in the offline PBRL setting that the learned utility model can be too hard for the learning agent to optimize during the second learning… ▽ More In this work, we consider the offline preference-based reinforcement learning problem. We focus on the two-phase learning approach that is prevalent in previous reinforcement learning from human preference works. We find a challenge in applying two-phase learning in the offline PBRL setting that the learned utility model can be too hard for the learning agent to optimize during the second learning phase. To overcome the challenge, we propose a two-phasing learning approach under behavior regularization through action clipping. The insight is that the state-actions which are poorly covered by the dataset can only provide limited information and increase the complexity of the problem in the second learning phase. Our method ignores such state-actions during the second learning phase to achieve higher learning efficiency. We empirically verify that our method has high learning efficiency on a variety of datasets in robotic control environments. △ Less

Submitted 30 December, 2023; originally announced January 2024.