Showing 201–250 of 731 results for author: Jain, A

ComplETR: Reducing the cost of annotations for object detection in dense scenes with vision transformers

Authors: Achin Jain, Kibok Lee, Gurumurthy Swaminathan, Hao Yang, Bernt Schiele, Avinash Ravichandran, Onkar Dabeer

Abstract: Annotating bounding boxes for object detection is expensive, time-consuming, and error-prone. In this work, we propose a DETR based framework called ComplETR that is designed to explicitly complete missing annotations in partially annotated dense scene datasets. This reduces the need to annotate every object instance in the scene thereby reducing annotation cost. ComplETR augments object queries i… ▽ More Annotating bounding boxes for object detection is expensive, time-consuming, and error-prone. In this work, we propose a DETR based framework called ComplETR that is designed to explicitly complete missing annotations in partially annotated dense scene datasets. This reduces the need to annotate every object instance in the scene thereby reducing annotation cost. ComplETR augments object queries in DETR decoder with patch information of objects in the image. Combined with a matching loss, it can effectively find objects that are similar to the input patch and complete the missing annotations. We show that our framework outperforms the state-of-the-art methods such as Soft Sampling and Unbiased Teacher by itself, while at the same time can be used in conjunction with these methods to further improve their performance. Our framework is also agnostic to the choice of the downstream object detectors; we show performance improvement for several popular detectors such as Faster R-CNN, Cascade R-CNN, CenterNet2, and Deformable DETR on multiple dense scene datasets. △ Less

Submitted 12 September, 2022; originally announced September 2022.

The Reduced Bergman Kernel and its Properties

Authors: Sahil Gehlawat, Aakanksha Jain, Amar Deep Sarkar

Abstract: In this article, we study some properties of the $n$-th order weighted reduced Bergman kernels for planar domains, $n\geq 1$. Specifically, we look at Ramadanov type theorems, localization, and boundary behaviour of the weighted reduced Bergman kernel and its higher-order counterparts. We also give a transformation formula for these kernels under biholomorphisms. In this article, we study some properties of the $n$-th order weighted reduced Bergman kernels for planar domains, $n\geq 1$. Specifically, we look at Ramadanov type theorems, localization, and boundary behaviour of the weighted reduced Bergman kernel and its higher-order counterparts. We also give a transformation formula for these kernels under biholomorphisms. △ Less

Submitted 12 September, 2023; v1 submitted 11 September, 2022; originally announced September 2022.

Comments: 18 pages

MSC Class: 30H20; 46E22 (Primary); 30C40 (Secondary)

Journal ref: International Journal of Mathematics 34 (2023), no. 3, Paper No. 2350015, 23 pp

Hardware Software Co-design of Statistical and Deep Learning Frameworks for Wideband Sensing on Zynq System on Chip

Authors: Rohith Rajesh, Sumit J. Darak, Akshay Jain, Shivam Chandhok, Animesh Sharma

Abstract: With the introduction of spectrum sharing and heterogeneous services in next-generation networks, the base stations need to sense the wideband spectrum and identify the spectrum resources to meet the quality-of-service, bandwidth, and latency constraints. Sub-Nyquist sampling (SNS) enables digitization for sparse wideband spectrum without needing Nyquist speed analog-to-digital converters. However… ▽ More With the introduction of spectrum sharing and heterogeneous services in next-generation networks, the base stations need to sense the wideband spectrum and identify the spectrum resources to meet the quality-of-service, bandwidth, and latency constraints. Sub-Nyquist sampling (SNS) enables digitization for sparse wideband spectrum without needing Nyquist speed analog-to-digital converters. However, SNS demands additional signal processing algorithms for spectrum reconstruction, such as the well-known orthogonal matching pursuit (OMP) algorithm. OMP is also widely used in other compressed sensing applications. The first contribution of this work is efficiently mapping the OMP algorithm on the Zynq system-on-chip (ZSoC) consisting of an ARM processor and FPGA. Experimental analysis shows a significant degradation in OMP performance for sparse spectrum. Also, OMP needs prior knowledge of spectrum sparsity. We address these challenges via deep-learning-based architectures and efficiently map them on the ZSoC platform as second contribution. Via hardware-software co-design, different versions of the proposed architecture obtained by partitioning between software (ARM processor) and hardware (FPGA) are considered. The resource, power, and execution time comparisons for given memory constraints and a wide range of word lengths are presented for these architectures. △ Less

Submitted 6 September, 2022; originally announced September 2022.

Learning an Ensemble of Deep Fingerprint Representations

Authors: Akash Godbole, Karthik Nandakumar, Anil K. Jain

Abstract: Deep neural networks (DNNs) have shown incredible promise in learning fixed-length representations from fingerprints. Since the representation learning is often focused on capturing specific prior knowledge (e.g., minutiae), there is no universal representation that comprehensively encapsulates all the discriminatory information available in a fingerprint. While learning an ensemble of representat… ▽ More Deep neural networks (DNNs) have shown incredible promise in learning fixed-length representations from fingerprints. Since the representation learning is often focused on capturing specific prior knowledge (e.g., minutiae), there is no universal representation that comprehensively encapsulates all the discriminatory information available in a fingerprint. While learning an ensemble of representations can mitigate this problem, two critical challenges need to be addressed: (i) How to extract multiple diverse representations from the same fingerprint image? and (ii) How to optimally exploit these representations during the matching process? In this work, we train multiple instances of DeepPrint (a state-of-the-art DNN-based fingerprint encoder) on different transformations of the input image to generate an ensemble of fingerprint embeddings. We also propose a feature fusion technique that distills these multiple representations into a single embedding, which faithfully captures the diversity present in the ensemble without increasing the computational complexity. The proposed approach has been comprehensively evaluated on five databases containing rolled, plain, and latent fingerprints (NIST SD4, NIST SD14, NIST SD27, NIST SD302, and FVC2004 DB2A) and statistically significant improvements in accuracy have been consistently demonstrated across a range of verification as well as closed- and open-set identification settings. The proposed approach serves as a wrapper capable of improving the accuracy of any DNN-based recognition system. △ Less

Submitted 2 September, 2022; originally announced September 2022.

Subject-independent trajectory prediction using pre-movement EEG during grasp and lift task

Authors: Anant Jain, Lalan Kumar

Abstract: Brain-computer interface (BCI) systems can be utilized for kinematics decoding from scalp brain activation to control rehabilitation or power-augmenting devices. In this study, the hand kinematics decoding for grasp and lift task is performed in three-dimensional (3D) space using scalp electroencephalogram (EEG) signals. Twelve subjects from the publicly available database WAY-EEG-GAL, has been ut… ▽ More Brain-computer interface (BCI) systems can be utilized for kinematics decoding from scalp brain activation to control rehabilitation or power-augmenting devices. In this study, the hand kinematics decoding for grasp and lift task is performed in three-dimensional (3D) space using scalp electroencephalogram (EEG) signals. Twelve subjects from the publicly available database WAY-EEG-GAL, has been utilized in this study. In particular, multi-layer perceptron (MLP) and convolutional neural network-long short-term memory (CNN-LSTM) based deep learning frameworks are proposed that utilize the motor-neural information encoded in the pre-movement EEG data. Spectral features are analyzed for hand kinematics decoding using EEG data filtered in seven frequency ranges. The best performing frequency band spectral features has been considered for further analysis with different EEG window sizes and lag windows. Appropriate lag windows from movement onset, make the approach pre-movement in true sense. Additionally, inter-subject hand trajectory decoding analysis is performed using leave-one-subject-out (LOSO) approach. The Pearson correlation coefficient and hand trajectory are considered as performance metric to evaluate decoding performance for the neural decoders. This study explores the feasibility of inter-subject 3-D hand trajectory decoding using EEG signals only during reach and grasp task, probably for the first time. The results may provide the viable information to decode 3D hand kinematics using pre-movement EEG signals for practical BCI applications such as exoskeleton/exosuit and prosthesis. △ Less

Submitted 18 June, 2024; v1 submitted 5 September, 2022; originally announced September 2022.

Synthetic Latent Fingerprint Generator

Authors: Andre Brasil Vieira Wyzykowski, Anil K. Jain

Abstract: Given a full fingerprint image (rolled or slap), we present CycleGAN models to generate multiple latent impressions of the same identity as the full print. Our models can control the degree of distortion, noise, blurriness and occlusion in the generated latent print images to obtain Good, Bad and Ugly latent image categories as introduced in the NIST SD27 latent database. The contributions of our… ▽ More Given a full fingerprint image (rolled or slap), we present CycleGAN models to generate multiple latent impressions of the same identity as the full print. Our models can control the degree of distortion, noise, blurriness and occlusion in the generated latent print images to obtain Good, Bad and Ugly latent image categories as introduced in the NIST SD27 latent database. The contributions of our work are twofold: (i) demonstrate the similarity of synthetically generated latent fingerprint images to crime scene latents in NIST SD27 and MSP databases as evaluated by the NIST NFIQ 2 quality measure and ROC curves obtained by a SOTA fingerprint matcher, and (ii) use of synthetic latents to augment small-size latent training databases in the public domain to improve the performance of DeepPrint, a SOTA fingerprint matcher designed for rolled to rolled fingerprint matching on three latent databases (NIST SD27, NIST SD302, and IIITD-SLF). As an example, with synthetic latent data augmentation, the Rank-1 retrieval performance of DeepPrint is improved from 15.50% to 29.07% on challenging NIST SD27 latent database. Our approach for generating synthetic latent fingerprints can be used to improve the recognition performance of any latent matcher and its individual components (e.g., enhancement, segmentation and feature extraction). △ Less

Submitted 29 August, 2022; originally announced August 2022.

Multi-domain Learning for Updating Face Anti-spoofing Models

Authors: Xiao Guo, Yaojie Liu, Anil Jain, Xiaoming Liu

Abstract: In this work, we study multi-domain learning for face anti-spoofing(MD-FAS), where a pre-trained FAS model needs to be updated to perform equally well on both source and target domains while only using target domain data for updating. We present a new model for MD-FAS, which addresses the forgetting issue when learning new domain data, while possessing a high level of adaptability. First, we devis… ▽ More In this work, we study multi-domain learning for face anti-spoofing(MD-FAS), where a pre-trained FAS model needs to be updated to perform equally well on both source and target domains while only using target domain data for updating. We present a new model for MD-FAS, which addresses the forgetting issue when learning new domain data, while possessing a high level of adaptability. First, we devise a simple yet effective module, called spoof region estimator(SRE), to identify spoof traces in the spoof image. Such spoof traces reflect the source pre-trained model's responses that help upgraded models combat catastrophic forgetting during updating. Unlike prior works that estimate spoof traces which generate multiple outputs or a low-resolution binary mask, SRE produces one single, detailed pixel-wise estimate in an unsupervised manner. Secondly, we propose a novel framework, named FAS-wrapper, which transfers knowledge from the pre-trained models and seamlessly integrates with different FAS models. Lastly, to help the community further advance MD-FAS, we construct a new benchmark based on SIW, SIW-Mv2 and Oulu-NPU, and introduce four distinct protocols for evaluation, where source and target domains are different in terms of spoof type, age, ethnicity, and illumination. Our proposed method achieves superior performance on the MD-FAS benchmark than previous methods. Our code and newly curated SIW-Mv2 are publicly available. △ Less

Submitted 16 April, 2023; v1 submitted 23 August, 2022; originally announced August 2022.

Comments: To appear at ECCV 2022 as an oral presentation. The SiW-Mv2 dataset is detailed in the Appendix

[Reproducibility Report] Path Planning using Neural A* Search

Authors: Shreya Bhatt, Aayush Jain, Parv Maheshwari, Animesh Jha, Debashish Chakravarty

Abstract: The following paper is a reproducibility report for "Path Planning using Neural A* Search" published in ICML2 2021 as part of the ML Reproducibility Challenge 2021. The original paper proposes the Neural A* planner, and claims it achieves an optimal balance between the reduction of node expansions and path accuracy. We verify this claim by reimplementing the model in a different framework and repr… ▽ More The following paper is a reproducibility report for "Path Planning using Neural A* Search" published in ICML2 2021 as part of the ML Reproducibility Challenge 2021. The original paper proposes the Neural A* planner, and claims it achieves an optimal balance between the reduction of node expansions and path accuracy. We verify this claim by reimplementing the model in a different framework and reproduce the data published in the original paper. We have also provided a code-flow diagram to aid comprehension of the code structure. As extensions to the original paper, we explore the effects of (1) generalizing the model by training it on a shuffled dataset, (2) introducing dropout, (3) implementing empirically chosen hyperparameters as trainable parameters in the model, (4) altering the network model to Generative Adversarial Networks (GANs) to introduce stochasticity, (5) modifying the encoder from Unet to Unet++, (6) incorporating cost maps obtained from the Neural A* module in other variations of A* search. △ Less

Submitted 16 July, 2022; originally announced August 2022.

AdaCat: Adaptive Categorical Discretization for Autoregressive Models

Authors: Qiyang Li, Ajay Jain, Pieter Abbeel

Abstract: Autoregressive generative models can estimate complex continuous data distributions, like trajectory rollouts in an RL environment, image intensities, and audio. Most state-of-the-art models discretize continuous data into several bins and use categorical distributions over the bins to approximate the continuous data distribution. The advantage is that the categorical distribution can easily expre… ▽ More Autoregressive generative models can estimate complex continuous data distributions, like trajectory rollouts in an RL environment, image intensities, and audio. Most state-of-the-art models discretize continuous data into several bins and use categorical distributions over the bins to approximate the continuous data distribution. The advantage is that the categorical distribution can easily express multiple modes and are straightforward to optimize. However, such approximation cannot express sharp changes in density without using significantly more bins, making it parameter inefficient. We propose an efficient, expressive, multimodal parameterization called Adaptive Categorical Discretization (AdaCat). AdaCat discretizes each dimension of an autoregressive model adaptively, which allows the model to allocate density to fine intervals of interest, improving parameter efficiency. AdaCat generalizes both categoricals and quantile-based regression. AdaCat is a simple add-on to any discretization-based distribution estimator. In experiments, AdaCat improves density estimation for real-world tabular data, images, audio, and trajectories, and improves planning in model-based offline RL. △ Less

Submitted 3 August, 2022; originally announced August 2022.

Comments: Uncertainty in Artificial Intelligence (UAI) 2022 13 pages, 4 figures

Atlas of Nuclear Isomers -- Second Edition

Authors: Swati Garg, Bhoomika Maheshwari, Balraj Singh, Yang Sun, Alpana Goel, Ashok Kumar Jain

Abstract: We present an updated version of the 2015-Atlas of Nuclear Isomers \cite{jain2015}, compiling and evaluating experimental data for the isomers with half-life $\ge 10$ $\it{ns}$, together with their spectroscopic properties such as excitation-energies, half-lives, decay modes, spins and parities, energies and multipolarities of isomeric transitions, along with the relevant original references in li… ▽ More We present an updated version of the 2015-Atlas of Nuclear Isomers \cite{jain2015}, compiling and evaluating experimental data for the isomers with half-life $\ge 10$ $\it{ns}$, together with their spectroscopic properties such as excitation-energies, half-lives, decay modes, spins and parities, energies and multipolarities of isomeric transitions, along with the relevant original references in literature. The current version of Atlas presents many re-evaluated half-lives as compared to the 2015 edition, where values were referred to Nuclear Data Sheets publications, when no new data existed. The ENSDF database \cite{Ensdf}, together with the XUNDL \cite{Xundl} and the NUBASE2020 \cite{Kondev2021} databases have been consulted for completeness, yet, data from original papers from journals were considered in the present evaluation, and the NSR bibliographic database \cite{Nsr} has been searched to ensure that this work is as complete and current as possible. Several useful systematic features of nuclear isomers covered in this Atlas have been discussed. Literature cutoff date for the extraction of data is October 31, 2022. △ Less

Submitted 12 December, 2022; v1 submitted 1 August, 2022; originally announced August 2022.

Comments: To appear in ADNDT

Modelling Social Context for Fake News Detection: A Graph Neural Network Based Approach

Authors: Pallabi Saikia, Kshitij Gundale, Ankit Jain, Dev Jadeja, Harvi Patel, Mohendra Roy

Abstract: Detection of fake news is crucial to ensure the authenticity of information and maintain the news ecosystems reliability. Recently, there has been an increase in fake news content due to the recent proliferation of social media and fake content generation techniques such as Deep Fake. The majority of the existing modalities of fake news detection focus on content based approaches. However, most of… ▽ More Detection of fake news is crucial to ensure the authenticity of information and maintain the news ecosystems reliability. Recently, there has been an increase in fake news content due to the recent proliferation of social media and fake content generation techniques such as Deep Fake. The majority of the existing modalities of fake news detection focus on content based approaches. However, most of these techniques fail to deal with ultra realistic synthesized media produced by generative models. Our recent studies find that the propagation characteristics of authentic and fake news are distinguishable, irrespective of their modalities. In this regard, we have investigated the auxiliary information based on social context to detect fake news. This paper has analyzed the social context of fake news detection with a hybrid graph neural network based approach. This hybrid model is based on integrating a graph neural network on the propagation of news and bi directional encoder representations from the transformers model on news content to learn the text features. Thus this proposed approach learns the content as well as the context features and hence able to outperform the baseline models with an f1 score of 0.91 on PolitiFact and 0.93 on the Gossipcop dataset, respectively △ Less

Submitted 27 July, 2022; originally announced July 2022.

Journal ref: copyright with IEEE, Paper No: 834, IJCNN, 2022 IEEE World Congress on Computational Intelligence

Controllable and Guided Face Synthesis for Unconstrained Face Recognition

Authors: Feng Liu, Minchul Kim, Anil Jain, Xiaoming Liu

Abstract: Although significant advances have been made in face recognition (FR), FR in unconstrained environments remains challenging due to the domain gap between the semi-constrained training datasets and unconstrained testing scenarios. To address this problem, we propose a controllable face synthesis model (CFSM) that can mimic the distribution of target datasets in a style latent space. CFSM learns a l… ▽ More Although significant advances have been made in face recognition (FR), FR in unconstrained environments remains challenging due to the domain gap between the semi-constrained training datasets and unconstrained testing scenarios. To address this problem, we propose a controllable face synthesis model (CFSM) that can mimic the distribution of target datasets in a style latent space. CFSM learns a linear subspace with orthogonal bases in the style latent space with precise control over the diversity and degree of synthesis. Furthermore, the pre-trained synthesis model can be guided by the FR model, making the resulting images more beneficial for FR model training. Besides, target dataset distributions are characterized by the learned orthogonal bases, which can be utilized to measure the distributional similarity among face datasets. Our approach yields significant performance gains on unconstrained benchmarks, such as IJB-B, IJB-C, TinyFace and IJB-S (+5.76% Rank1). △ Less

Submitted 20 July, 2022; originally announced July 2022.

Comments: to be published in ECCV 2022

A Comprehensive Review on Digital Image Watermarking

Authors: Shweta Wadhera, Deepa Kamra, Ankit Rajpal, Aruna Jain, Vishal Jain

Abstract: The advent of the Internet led to the easy availability of digital data like images, audio, and video. Easy access to multimedia gives rise to the issues such as content authentication, security, copyright protection, and ownership identification. Here, we discuss the concept of digital image watermarking with a focus on the technique used in image watermark embedding and extraction of the waterma… ▽ More The advent of the Internet led to the easy availability of digital data like images, audio, and video. Easy access to multimedia gives rise to the issues such as content authentication, security, copyright protection, and ownership identification. Here, we discuss the concept of digital image watermarking with a focus on the technique used in image watermark embedding and extraction of the watermark. The detailed classification along with the basic characteristics, namely visual imperceptibility, robustness, capacity, security of digital watermarking is also presented in this work. Further, we have also discussed the recent application areas of digital watermarking such as healthcare, remote education, electronic voting systems, and the military. The robustness is evaluated by examining the effect of image processing attacks on the signed content and the watermark recoverability. The authors believe that the comprehensive survey presented in this paper will help the new researchers to gather knowledge in this domain. Further, the comparative analysis can enkindle ideas to improve upon the already mentioned techniques. △ Less

Submitted 7 July, 2022; originally announced July 2022.

Respiration driven CO2 pulses dominate Australia's flux variability

Authors: Eva-Marie Metz, Sanam N. Vardag, Sourish Basu, Martin Jung, Bernhard Ahrens, Tarek El-Madany, Stephen Sitch, Vivek K. Arora, Peter R. Briggs, Pierre Friedlingstein, Daniel S. Goll, Atul K. Jain, Etsushi Kato, Danica Lombardozzi, Julia E. M. S. Nabel, Benjamin Poulter, Roland Séférian, Hanqin Tian, Andrew Wiltshire, Wenping Yuan, Xu Yue, Sönke Zaehle, Nicholas M. Deutscher, David W. T. Griffith, André Butz

Abstract: The Australian continent contributes substantially to the year-to-year variability of the global terrestrial carbon dioxide (CO2) sink. However, the scarcity of in-situ observations in remote areas prevents deciphering the processes that force the CO2 flux variability. Here, examining atmospheric CO2 measurements from satellites in the period 2009-2018, we find recurrent end-of-dry-season CO2 puls… ▽ More The Australian continent contributes substantially to the year-to-year variability of the global terrestrial carbon dioxide (CO2) sink. However, the scarcity of in-situ observations in remote areas prevents deciphering the processes that force the CO2 flux variability. Here, examining atmospheric CO2 measurements from satellites in the period 2009-2018, we find recurrent end-of-dry-season CO2 pulses over the Australian continent. These pulses largely control the year-to-year variability of Australia's CO2 balance, due to 2-3 times higher seasonal variations compared to previous top-down inversions and bottom-up estimates. The CO2 pulses occur shortly after the onset of rainfall and are driven by enhanced soil respiration preceding photosynthetic uptake in Australia's semi-arid regions. The suggested continental-scale relevance of soil rewetting processes has large implications for our understanding and modelling of global climate-carbon cycle feedbacks. △ Less

Submitted 30 November, 2022; v1 submitted 14 July, 2022; originally announced July 2022.

Comments: 28 pages (including supplementary materials), 3 main figures, 7 supplementary figures; v2 changes: Last name of first author changed

Cluster Resource Management for Dynamic Workloads by Online Optimization

Authors: Nader Alfares, George Kesidis, Ata Fatahi Baarzi, Aman Jain

Abstract: Over the past ten years, many different approaches have been proposed for different aspects of the problem of resources management for long running, dynamic and diverse workloads such as processing query streams or distributed deep learning. Particularly for applications consisting of containerized microservices, researchers have attempted to address problems of dynamic selection of, for example:… ▽ More Over the past ten years, many different approaches have been proposed for different aspects of the problem of resources management for long running, dynamic and diverse workloads such as processing query streams or distributed deep learning. Particularly for applications consisting of containerized microservices, researchers have attempted to address problems of dynamic selection of, for example: types and quantities of virtualized services (e.g., IaaS/VMs), vertical and horizontal scaling of different microservices, assigning microservices to VMs, task scheduling, or some combination thereof. In this context, we argue that frameworks like simulated annealing are highly suitable for online navigation of trade-offs between performance (SLO) and cost, particularly when the complex workloads and cloud-service offerings vary over time. Based on a macroscopic objective that combines both performance and cost terms, annealing facilitates light-weight and coherent policies of exploration and exploitation. In this paper, we first give some background on simulated annealing and then experimentally demonstrate its usefulness for different case studies, including service selection for both a single type of workload (e.g., distributed deep learning) and a mixture of workload types (exploring a partially categorical set of options), and container sizing for microservice benchmarks. We conclude with a discussion of how the basic annealing platform can be applied to other resource-management problems, hybridized with other methods, and accommodate user-specified rules of thumb. △ Less

Submitted 22 August, 2023; v1 submitted 10 July, 2022; originally announced July 2022.

Adaptive Virtual Neuroarchitecture

Authors: Abhinandan Jain, Pattie Maes, Misha Sra

Abstract: Our surrounding environment impacts our cognitive-emotional processes on a daily basis and shapes our physical, psychological and social wellbeing. Although the effects of the built environment on our psycho-physiological processes are well studied, virtual environment design with a potentially similar impact on the user, has received limited attention. Based on the influence of space design on a… ▽ More Our surrounding environment impacts our cognitive-emotional processes on a daily basis and shapes our physical, psychological and social wellbeing. Although the effects of the built environment on our psycho-physiological processes are well studied, virtual environment design with a potentially similar impact on the user, has received limited attention. Based on the influence of space design on a user and combining that with the dynamic affordances of virtual spaces, we present the idea of adaptive virtual neuroarchitecture (AVN), where virtual environments respond to the user and the user's real world context while simultaneously influencing them both in realtime. To show how AVN has been explored in current research, we present a sampling of recent work that demonstrates reciprocal relationships using physical affordances (space, objects), the user's state (physiological, cognitive, emotional), and the virtual world used in the design of novel virtual reality experiences. We believe AVN has the potential to help us learn how to design spaces and environments that can enhance the wellbeing of their inhabitants. △ Less

Submitted 10 July, 2022; originally announced July 2022.

QUIDAM: A Framework for Quantization-Aware DNN Accelerator and Model Co-Exploration

Authors: Ahmet Inci, Siri Garudanagiri Virupaksha, Aman Jain, Ting-Wu Chin, Venkata Vivek Thallam, Ruizhou Ding, Diana Marculescu

Abstract: As the machine learning and systems communities strive to achieve higher energy-efficiency through custom deep neural network (DNN) accelerators, varied precision or quantization levels, and model compression techniques, there is a need for design space exploration frameworks that incorporate quantization-aware processing elements into the accelerator design space while having accurate and fast po… ▽ More As the machine learning and systems communities strive to achieve higher energy-efficiency through custom deep neural network (DNN) accelerators, varied precision or quantization levels, and model compression techniques, there is a need for design space exploration frameworks that incorporate quantization-aware processing elements into the accelerator design space while having accurate and fast power, performance, and area models. In this work, we present QUIDAM, a highly parameterized quantization-aware DNN accelerator and model co-exploration framework. Our framework can facilitate future research on design space exploration of DNN accelerators for various design choices such as bit precision, processing element type, scratchpad sizes of processing elements, global buffer size, number of total processing elements, and DNN configurations. Our results show that different bit precisions and processing element types lead to significant differences in terms of performance per area and energy. Specifically, our framework identifies a wide range of design points where performance per area and energy varies more than 5x and 35x, respectively. With the proposed framework, we show that lightweight processing elements achieve on par accuracy results and up to 5.7x more performance per area and energy improvement when compared to the best INT16 based implementation. Finally, due to the efficiency of the pre-characterized power, performance, and area models, QUIDAM can speed up the design exploration process by 3-4 orders of magnitude as it removes the need for expensive synthesis and characterization of each design. △ Less

Submitted 30 June, 2022; originally announced June 2022.

Comments: 25 pages, 12 figures. arXiv admin note: substantial text overlap with arXiv:2205.13045, arXiv:2205.08648

The Astropy Project: Sustaining and Growing a Community-oriented Open-source Project and the Latest Major Release (v5.0) of the Core Package

Authors: The Astropy Collaboration, Adrian M. Price-Whelan, Pey Lian Lim, Nicholas Earl, Nathaniel Starkman, Larry Bradley, David L. Shupe, Aarya A. Patil, Lia Corrales, C. E. Brasseur, Maximilian Nöthe, Axel Donath, Erik Tollerud, Brett M. Morris, Adam Ginsburg, Eero Vaher, Benjamin A. Weaver, James Tocknell, William Jamieson, Marten H. van Kerkwijk, Thomas P. Robitaille, Bruce Merry, Matteo Bachetti, H. Moritz Günther, Thomas L. Aldcroft , et al. (111 additional authors not shown)

Abstract: The Astropy Project supports and fosters the development of open-source and openly-developed Python packages that provide commonly needed functionality to the astronomical community. A key element of the Astropy Project is the core package $\texttt{astropy}$, which serves as the foundation for more specialized projects and packages. In this article, we summarize key features in the core package as… ▽ More The Astropy Project supports and fosters the development of open-source and openly-developed Python packages that provide commonly needed functionality to the astronomical community. A key element of the Astropy Project is the core package $\texttt{astropy}$, which serves as the foundation for more specialized projects and packages. In this article, we summarize key features in the core package as of the recent major release, version 5.0, and provide major updates for the Project. We then discuss supporting a broader ecosystem of interoperable packages, including connections with several astronomical observatories and missions. We also revisit the future outlook of the Astropy Project and the current status of Learn Astropy. We conclude by raising and discussing the current and future challenges facing the Project. △ Less

Submitted 28 June, 2022; originally announced June 2022.

Comments: 43 pages, 5 figures. To appear in ApJ. The author list has two parts: the authors that made significant contributions to the writing and/or coordination of the paper, followed by maintainers of and contributors to the Astropy Project. The position in the author list does not correspond to contributions to the Astropy Project as a whole

muBoost: An Effective Method for Solving Indic Multilingual Text Classification Problem

Authors: Manish Pathak, Aditya Jain

Abstract: Text Classification is an integral part of many Natural Language Processing tasks such as sarcasm detection, sentiment analysis and many more such applications. Many e-commerce websites, social-media/entertainment platforms use such models to enhance user-experience to generate traffic and thus, revenue on their platforms. In this paper, we are presenting our solution to Multilingual Abusive Comme… ▽ More Text Classification is an integral part of many Natural Language Processing tasks such as sarcasm detection, sentiment analysis and many more such applications. Many e-commerce websites, social-media/entertainment platforms use such models to enhance user-experience to generate traffic and thus, revenue on their platforms. In this paper, we are presenting our solution to Multilingual Abusive Comment Identification Problem on Moj, an Indian video-sharing social networking service, powered by ShareChat. The problem dealt with detecting abusive comments, in 13 regional Indic languages such as Hindi, Telugu, Kannada etc., on the videos on Moj platform. Our solution utilizes the novel muBoost, an ensemble of CatBoost classifier models and Multilingual Representations for Indian Languages (MURIL) model, to produce SOTA performance on Indic text classification tasks. We were able to achieve a mean F1-score of 89.286 on the test data, an improvement over baseline MURIL model with a F1-score of 87.48. △ Less

Submitted 21 June, 2022; originally announced June 2022.

Machine Learning in Sports: A Case Study on Using Explainable Models for Predicting Outcomes of Volleyball Matches

Authors: Abhinav Lalwani, Aman Saraiya, Apoorv Singh, Aditya Jain, Tirtharaj Dash

Abstract: Machine Learning has become an integral part of engineering design and decision making in several domains, including sports. Deep Neural Networks (DNNs) have been the state-of-the-art methods for predicting outcomes of professional sports events. However, apart from getting highly accurate predictions on these sports events outcomes, it is necessary to answer questions such as "Why did the model p… ▽ More Machine Learning has become an integral part of engineering design and decision making in several domains, including sports. Deep Neural Networks (DNNs) have been the state-of-the-art methods for predicting outcomes of professional sports events. However, apart from getting highly accurate predictions on these sports events outcomes, it is necessary to answer questions such as "Why did the model predict that Team A would win Match X against Team B?" DNNs are inherently black-box in nature. Therefore, it is required to provide high-quality interpretable, and understandable explanations for a model's prediction in sports. This paper explores a two-phased Explainable Artificial Intelligence(XAI) approach to predict outcomes of matches in the Brazilian volleyball League (SuperLiga). In the first phase, we directly use the interpretable rule-based ML models that provide a global understanding of the model's behaviors based on Boolean Rule Column Generation (BRCG; extracts simple AND-OR classification rules) and Logistic Regression (LogReg; allows to estimate the feature importance scores). In the second phase, we construct non-linear models such as Support Vector Machine (SVM) and Deep Neural Network (DNN) to obtain predictive performance on the volleyball matches' outcomes. We construct the "post-hoc" explanations for each data instance using ProtoDash, a method that finds prototypes in the training dataset that are most similar to the test instance, and SHAP, a method that estimates the contribution of each feature on the model's prediction. We evaluate the SHAP explanations using the faithfulness metric. Our results demonstrate the effectiveness of the explanations for the model's predictions. △ Less

Submitted 18 June, 2022; originally announced June 2022.

Comments: 9 pages, 1 figure, accepted to 2nd International Conference on Sports Engineering (ICSE 2021)

High Density Vertical Optical Interconnects for Passive Assembly

Authors: Drew Weninger, Samuel Serna, Achint Jain, Lionel Kimerling, Anuradha Agarwal

Abstract: The co-packaging of optics and electronics provides a potential path forward to achieving beyond 50 Tbps top of rack switch packages. In a co-packaged design, the scaling of bandwidth, cost, and energy is governed by the number of optical transceivers (TxRx) per package as opposed to transistor shrink. Due to the large footprint of optical components relative to their electronic counterparts, the… ▽ More The co-packaging of optics and electronics provides a potential path forward to achieving beyond 50 Tbps top of rack switch packages. In a co-packaged design, the scaling of bandwidth, cost, and energy is governed by the number of optical transceivers (TxRx) per package as opposed to transistor shrink. Due to the large footprint of optical components relative to their electronic counterparts, the vertical stacking of optical TxRx chips in a co-packaged optics design will become a necessity. As a result, development of efficient, dense, and wide alignment tolerance chip-to-chip optical couplers will be an enabling technology for continued TxRx scaling. In this paper, we propose a novel scheme to vertically couple into standard 220 nm silicon on insulator waveguides from 220 nm silicon nitride on glass waveguides using overlapping, inverse double tapers. Simulation results using Lumerical's 3D Finite Difference Time Domain solver solver are presented, demonstrating insertion losses below -0.13 dB for an inter-chip spacing of 1 $μ$m, 1 dB vertical and lateral alignment tolerances of approximately $\pm$ 2.7 $μ$m, a greater than 300 nm 1 dB bandwidth, and 1 dB twist and tilt tolerance of approximately 2.3 degrees and 0.4 degrees, respectively. These results demonstrate the potential of our coupler for use in co-packaged designs requiring high performance, high density, CMOS compatible out of plane optical connections. △ Less

Submitted 18 June, 2022; originally announced June 2022.

Comments: 14 pages, 7 figures, 3 tables, US patent no. 11067754

XLCoST: A Benchmark Dataset for Cross-lingual Code Intelligence

Authors: Ming Zhu, Aneesh Jain, Karthik Suresh, Roshan Ravindran, Sindhu Tipirneni, Chandan K. Reddy

Abstract: Recent advances in machine learning have significantly improved the understanding of source code data and achieved good performance on a number of downstream tasks. Open source repositories like GitHub enable this process with rich unlabeled code data. However, the lack of high quality labeled data has largely hindered the progress of several code related tasks, such as program translation, summar… ▽ More Recent advances in machine learning have significantly improved the understanding of source code data and achieved good performance on a number of downstream tasks. Open source repositories like GitHub enable this process with rich unlabeled code data. However, the lack of high quality labeled data has largely hindered the progress of several code related tasks, such as program translation, summarization, synthesis, and code search. This paper introduces XLCoST, Cross-Lingual Code SnippeT dataset, a new benchmark dataset for cross-lingual code intelligence. Our dataset contains fine-grained parallel data from 8 languages (7 commonly used programming languages and English), and supports 10 cross-lingual code tasks. To the best of our knowledge, it is the largest parallel dataset for source code both in terms of size and the number of languages. We also provide the performance of several state-of-the-art baseline models for each task. We believe this new dataset can be a valuable asset for the research community and facilitate the development and validation of new methods for cross-lingual code intelligence. △ Less

Submitted 16 June, 2022; originally announced June 2022.

Comments: 20 pages, 11 tables, 2 figures

A Closer Look at Smoothness in Domain Adversarial Training

Authors: Harsh Rangwani, Sumukh K Aithal, Mayank Mishra, Arihant Jain, R. Venkatesh Babu

Abstract: Domain adversarial training has been ubiquitous for achieving invariant representations and is used widely for various domain adaptation tasks. In recent times, methods converging to smooth optima have shown improved generalization for supervised learning tasks like classification. In this work, we analyze the effect of smoothness enhancing formulations on domain adversarial training, the objectiv… ▽ More Domain adversarial training has been ubiquitous for achieving invariant representations and is used widely for various domain adaptation tasks. In recent times, methods converging to smooth optima have shown improved generalization for supervised learning tasks like classification. In this work, we analyze the effect of smoothness enhancing formulations on domain adversarial training, the objective of which is a combination of task loss (eg. classification, regression, etc.) and adversarial terms. We find that converging to a smooth minima with respect to (w.r.t.) task loss stabilizes the adversarial training leading to better performance on target domain. In contrast to task loss, our analysis shows that converging to smooth minima w.r.t. adversarial loss leads to sub-optimal generalization on the target domain. Based on the analysis, we introduce the Smooth Domain Adversarial Training (SDAT) procedure, which effectively enhances the performance of existing domain adversarial methods for both classification and object detection tasks. Our analysis also provides insight into the extensive usage of SGD over Adam in the community for domain adversarial training. △ Less

Submitted 16 June, 2022; originally announced June 2022.

Comments: ICML 2022. Code: https://github.com/val-iisc/SDAT

Compositional noise in nozzles with dissipation

Authors: Animesh Jain, Luca Magri

Abstract: We propose a physical model to predict indirect noise generated by the acceleration of compositional inhomogeneities in nozzles with viscous dissipation (non-isentropic nozzles). First, we derive the quasi-one-dimensional equations from the conservation laws of multicomponent flows. Second, we validate the proposed model with the experimental data available in the literature for binary mixtures of… ▽ More We propose a physical model to predict indirect noise generated by the acceleration of compositional inhomogeneities in nozzles with viscous dissipation (non-isentropic nozzles). First, we derive the quasi-one-dimensional equations from the conservation laws of multicomponent flows. Second, we validate the proposed model with the experimental data available in the literature for binary mixtures of four gases. Third, we calculate the nozzle transfer functions for different Helmholtz numbers and friction factors, in both subsonic and supersonic flows with/without shock waves. We show that friction has a significant effect on the generation of indirect noise, for which the physical mechanism is identified and explained. Fourth, we find a semi-analytical solution with path integrals, which provide an asymptotic expansion with respect to the Helmholtz number. Fifth, we introduce the compositional noise scaling factor, which is applied to quickly estimate compositional noise from the knowledge of only one single-component gas transfer function. The approximation error is less than $1\%$. The proposed low-order model provides accurate estimates of the transfer functions and physical insight into indirect noise for multicomponent gases. This opens up new possibilities to accurately predict, and understand, sound generation in gas turbines. △ Less

Submitted 4 May, 2023; v1 submitted 14 June, 2022; originally announced June 2022.

Creep in Rotating Composite Disk having Variable Thickness Subjected to Thermal as well as Particle Gradient

Authors: Harjot Kaur, Nishi Gupta, Anjali Jain

Abstract: The motivation behind this paper is to present the effect of thermal and particle gradient in rotating composite disk with variable thickness using Sherby law. The values of tangential, radial stresses and strain rates are calculated at different radius using mathematical modeling. It has been observed that with increase in the variable thickness and particle gradient the stresses and strain rates… ▽ More The motivation behind this paper is to present the effect of thermal and particle gradient in rotating composite disk with variable thickness using Sherby law. The values of tangential, radial stresses and strain rates are calculated at different radius using mathematical modeling. It has been observed that with increase in the variable thickness and particle gradient the stresses and strain rates decrease and determined that the creep deformation decreases with fluctuating thickness. △ Less

Submitted 1 June, 2022; originally announced June 2022.

Comments: this article contant 16 figures that shows the effect of variable thickness with thermal gradient on rotating composite disk

MSC Class: 74Dxx

AFIA: ATPG-Guided Fault Injection Attack on Secure Logic Locking

Authors: Yadi Zhong, Ayush Jain, M. Tanjidur Rahman, Navid Asadizanjani, Jiafeng Xie, Ujjwal Guin

Abstract: The outsourcing of the design and manufacturing of integrated circuits has raised severe concerns about the piracy of Intellectual Properties and illegal overproduction. Logic locking has emerged as an obfuscation technique to protect outsourced chip designs, where the circuit netlist is locked and can only be functional once a secure key is programmed. However, Boolean Satisfiability-based attack… ▽ More The outsourcing of the design and manufacturing of integrated circuits has raised severe concerns about the piracy of Intellectual Properties and illegal overproduction. Logic locking has emerged as an obfuscation technique to protect outsourced chip designs, where the circuit netlist is locked and can only be functional once a secure key is programmed. However, Boolean Satisfiability-based attacks have shown to break logic locking, simultaneously motivating researchers to develop more secure countermeasures. In this paper, we present a novel fault injection attack to break any locking technique that relies on a stored secret key, and denote this attack as AFIA, ATPG-guided Fault Injection Attack. The proposed attack is based on sensitizing a key bit to the primary output while injecting faults at a few other key lines that block the propagation of the targeted key bit. AIFA is very effective in determining a key bit as there exists a stuck-at fault pattern that detects a stuck-at 1 (or stuck-at 0) fault at any key line. The average complexity of number of injected faults for AFIA is linear with the key size and requires only |K| test patterns to determine a secret key, K. AFIA requires a fewer number of injected faults to sensitize a bit to the primary output, compared to 2|K|-1 faults for the differential fault analysis attack [26]. △ Less

Submitted 12 October, 2022; v1 submitted 9 June, 2022; originally announced June 2022.

Comments: arXiv admin note: text overlap with arXiv:2007.10512

New Strong Gravitational Lenses from the DESI Legacy Imaging Surveys Data Release 9

Authors: C. Storfer, X. Huang, A. Gu, W. Sheu, S. Banka, A. Dey, A. Jain, J. Kwon, D. Lang, V. Lee, A. Meisner, J. Moustakas, A. D. Myers, S. Tabares-Tarquinio, E. F. Schlafly, D. J. Schlegel

Abstract: We have conducted a search for strong gravitational lensing systems in the Dark Energy Spectroscopic Instrument (DESI) Legacy Imaging Surveys Data Release 9. This is the third paper in a series (following Huang et al. 2020; Huang et al. 2021, Paper I & II, respectively). These surveys together cover $\sim$ 19,000 deg$^2$ visible from the northern hemisphere, reaching a z-band AB magnitude of… ▽ More We have conducted a search for strong gravitational lensing systems in the Dark Energy Spectroscopic Instrument (DESI) Legacy Imaging Surveys Data Release 9. This is the third paper in a series (following Huang et al. 2020; Huang et al. 2021, Paper I & II, respectively). These surveys together cover $\sim$ 19,000 deg$^2$ visible from the northern hemisphere, reaching a z-band AB magnitude of $\sim$ 22.5. We use a deep residual neural network, trained on a compilation of known lensing systems and candidates as well as non-lenses in the same footprint. After applying our trained neural networks to the survey data, we visually inspect and rank images with probabilities above a threshold. We have found 1895 lens candidates. Out of these, 1512 are identified for the first time. Combining the discoveries from this work, Paper I (335) and II (1210), the total number of strong lens candidates from the Legacy Surveys that we have discovered is 3057. △ Less

Submitted 26 April, 2023; v1 submitted 6 June, 2022; originally announced June 2022.

Comments: 19 pages, 10 figures, 4 tables. arXiv admin note: text overlap with arXiv:2005.04730

Benchmark of DNN Model Search at Deployment Time

Authors: Lixi Zhou, Arindam Jain, Zijie Wang, Amitabh Das, Yingzhen Yang, Jia Zou

Abstract: Deep learning has become the most popular direction in machine learning and artificial intelligence. However, the preparation of training data, as well as model training, are often time-consuming and become the bottleneck of the end-to-end machine learning lifecycle. Reusing models for inferring a dataset can avoid the costs of retraining. However, when there are multiple candidate models, it is c… ▽ More Deep learning has become the most popular direction in machine learning and artificial intelligence. However, the preparation of training data, as well as model training, are often time-consuming and become the bottleneck of the end-to-end machine learning lifecycle. Reusing models for inferring a dataset can avoid the costs of retraining. However, when there are multiple candidate models, it is challenging to discover the right model for reuse. Although there exist a number of model sharing platforms such as ModelDB, TensorFlow Hub, PyTorch Hub, and DLHub, most of these systems require model uploaders to manually specify the details of each model and model downloaders to screen keyword search results for selecting a model. We are lacking a highly productive model search tool that selects models for deployment without the need for any manual inspection and/or labeled data from the target domain. This paper proposes multiple model search strategies including various similarity-based approaches and non-similarity-based approaches. We design, implement, and evaluate these approaches on multiple model inference scenarios, including activity recognition, image recognition, text classification, natural language processing, and entity matching. The experimental evaluation showed that our proposed asymmetric similarity-based measurement, adaptivity, outperformed symmetric similarity-based measurements and non-similarity-based measurements in most of the workloads. △ Less

Submitted 31 May, 2022; originally announced June 2022.

Comments: arXiv admin note: text overlap with arXiv:2010.09474

QADAM: Quantization-Aware DNN Accelerator Modeling for Pareto-Optimality

Authors: Ahmet Inci, Siri Garudanagiri Virupaksha, Aman Jain, Venkata Vivek Thallam, Ruizhou Ding, Diana Marculescu

Abstract: As the machine learning and systems communities strive to achieve higher energy-efficiency through custom deep neural network (DNN) accelerators, varied bit precision or quantization levels, there is a need for design space exploration frameworks that incorporate quantization-aware processing elements (PE) into the accelerator design space while having accurate and fast power, performance, and are… ▽ More As the machine learning and systems communities strive to achieve higher energy-efficiency through custom deep neural network (DNN) accelerators, varied bit precision or quantization levels, there is a need for design space exploration frameworks that incorporate quantization-aware processing elements (PE) into the accelerator design space while having accurate and fast power, performance, and area models. In this work, we present QADAM, a highly parameterized quantization-aware power, performance, and area modeling framework for DNN accelerators. Our framework can facilitate future research on design space exploration and Pareto-efficiency of DNN accelerators for various design choices such as bit precision, PE type, scratchpad sizes of PEs, global buffer size, number of total PEs, and DNN configurations. Our results show that different bit precisions and PE types lead to significant differences in terms of performance per area and energy. Specifically, our framework identifies a wide range of design points where performance per area and energy varies more than 5x and 35x, respectively. We also show that the proposed lightweight processing elements (LightPEs) consistently achieve Pareto-optimal results in terms of accuracy and hardware-efficiency. With the proposed framework, we show that LightPEs achieve on par accuracy results and up to 5.7x more performance per area and energy improvement when compared to the best INT16 based design. △ Less

Submitted 20 May, 2022; originally announced May 2022.

Comments: Accepted paper at the Machine Learning for Computer Architecture and Systems (MLArchSys) Workshop in conjunction with ISCA 2021. This is an extended version of arXiv:2205.08648

Superconformal invariants and spinning correlators in 3d $\cal{N}=2$ SCFTs

Authors: Aditya Jain, Amin A. Nizami

Abstract: We construct superconformal invariants in superspace which are used to build 3-point correlators of spinning operators in general $\cal{N}=2$ superconformal field theories in three dimensions. Our systematic analysis includes various relations between these invariants and provides a minimal set of parity-even and parity-odd invariants which is further used to construct general 3-point functions in… ▽ More We construct superconformal invariants in superspace which are used to build 3-point correlators of spinning operators in general $\cal{N}=2$ superconformal field theories in three dimensions. Our systematic analysis includes various relations between these invariants and provides a minimal set of parity-even and parity-odd invariants which is further used to construct general 3-point functions in any 3d $\cal{N}=2$ SCFT. For conserved (super)currents, we explicitly compute various 3-point functions using Wick contractions in the free field case, and express them in terms of the constructed parity-even invariants. We give evidence through examples for the claim that the 3-point function of conserved currents generally comprises of two parts - a parity-even piece coming from the free theory, and a parity-odd piece. △ Less

Submitted 21 December, 2022; v1 submitted 23 May, 2022; originally announced May 2022.

Comments: v3, 27 pages; a few typos corrected and a footnote added; final version published in EPJC (Particles and Fields)

Journal ref: Eur.Phys.J.C 82 (2022) 11, 1065

Unsupervised Learning of Depth, Camera Pose and Optical Flow from Monocular Video

Authors: Dipan Mandal, Abhilash Jain

Abstract: We propose DFPNet -- an unsupervised, joint learning system for monocular Depth, Optical Flow and egomotion (Camera Pose) estimation from monocular image sequences. Due to the nature of 3D scene geometry these three components are coupled. We leverage this fact to jointly train all the three components in an end-to-end manner. A single composite loss function -- which involves image reconstruction… ▽ More We propose DFPNet -- an unsupervised, joint learning system for monocular Depth, Optical Flow and egomotion (Camera Pose) estimation from monocular image sequences. Due to the nature of 3D scene geometry these three components are coupled. We leverage this fact to jointly train all the three components in an end-to-end manner. A single composite loss function -- which involves image reconstruction-based loss for depth & optical flow, bidirectional consistency checks and smoothness loss components -- is used to train the network. Using hyperparameter tuning, we are able to reduce the model size to less than 5% (8.4M parameters) of state-of-the-art DFP models. Evaluation on KITTI and Cityscapes driving datasets reveals that our model achieves results comparable to state-of-the-art in all of the three tasks, even with the significantly smaller model size. △ Less

Submitted 11 October, 2022; v1 submitted 19 May, 2022; originally announced May 2022.

Comments: 8 pages, 2 figures. arXiv admin note: text overlap with arXiv:1803.02276 by other authors

SDS-200: A Swiss German Speech to Standard German Text Corpus

Authors: Michel Plüss, Manuela Hürlimann, Marc Cuny, Alla Stöckli, Nikolaos Kapotis, Julia Hartmann, Malgorzata Anna Ulasik, Christian Scheller, Yanick Schraner, Amit Jain, Jan Deriu, Mark Cieliebak, Manfred Vogel

Abstract: We present SDS-200, a corpus of Swiss German dialectal speech with Standard German text translations, annotated with dialect, age, and gender information of the speakers. The dataset allows for training speech translation, dialect recognition, and speech synthesis systems, among others. The data was collected using a web recording tool that is open to the public. Each participant was given a text… ▽ More We present SDS-200, a corpus of Swiss German dialectal speech with Standard German text translations, annotated with dialect, age, and gender information of the speakers. The dataset allows for training speech translation, dialect recognition, and speech synthesis systems, among others. The data was collected using a web recording tool that is open to the public. Each participant was given a text in Standard German and asked to translate it to their Swiss German dialect before recording it. To increase the corpus quality, recordings were validated by other participants. The data consists of 200 hours of speech by around 4000 different speakers and covers a large part of the Swiss-German dialect landscape. We release SDS-200 alongside a baseline speech translation model, which achieves a word error rate (WER) of 30.3 and a BLEU score of 53.1 on the SDS-200 test set. Furthermore, we use SDS-200 to fine-tune a pre-trained XLS-R model, achieving 21.6 WER and 64.0 BLEU. △ Less

Submitted 19 May, 2022; originally announced May 2022.

On Demographic Bias in Fingerprint Recognition

Authors: Akash Godbole, Steven A. Grosz, Karthik Nandakumar, Anil K. Jain

Abstract: Fingerprint recognition systems have been deployed globally in numerous applications including personal devices, forensics, law enforcement, banking, and national identity systems. For these systems to be socially acceptable and trustworthy, it is critical that they perform equally well across different demographic groups. In this work, we propose a formal statistical framework to test for the exi… ▽ More Fingerprint recognition systems have been deployed globally in numerous applications including personal devices, forensics, law enforcement, banking, and national identity systems. For these systems to be socially acceptable and trustworthy, it is critical that they perform equally well across different demographic groups. In this work, we propose a formal statistical framework to test for the existence of bias (demographic differentials) in fingerprint recognition across four major demographic groups (white male, white female, black male, and black female) for two state-of-the-art (SOTA) fingerprint matchers operating in verification and identification modes. Experiments on two different fingerprint databases (with 15,468 and 1,014 subjects) show that demographic differentials in SOTA fingerprint recognition systems decrease as the matcher accuracy increases and any small bias that may be evident is likely due to certain outlier, low-quality fingerprint images. △ Less

Submitted 19 May, 2022; originally announced May 2022.

QAPPA: Quantization-Aware Power, Performance, and Area Modeling of DNN Accelerators

Authors: Ahmet Inci, Siri Garudanagiri Virupaksha, Aman Jain, Venkata Vivek Thallam, Ruizhou Ding, Diana Marculescu

Abstract: As the machine learning and systems community strives to achieve higher energy-efficiency through custom DNN accelerators and model compression techniques, there is a need for a design space exploration framework that incorporates quantization-aware processing elements into the accelerator design space while having accurate and fast power, performance, and area models. In this work, we present QAP… ▽ More As the machine learning and systems community strives to achieve higher energy-efficiency through custom DNN accelerators and model compression techniques, there is a need for a design space exploration framework that incorporates quantization-aware processing elements into the accelerator design space while having accurate and fast power, performance, and area models. In this work, we present QAPPA, a highly parameterized quantization-aware power, performance, and area modeling framework for DNN accelerators. Our framework can facilitate the future research on design space exploration of DNN accelerators for various design choices such as bit precision, processing element type, scratchpad sizes of processing elements, global buffer size, device bandwidth, number of total processing elements in the the design, and DNN workloads. Our results show that different bit precisions and processing element types lead to significant differences in terms of performance per area and energy. Specifically, our proposed lightweight processing elements achieve up to 4.9x more performance per area and energy improvement when compared to INT16 based implementation. △ Less

Submitted 17 May, 2022; originally announced May 2022.

Comments: Accepted paper at the On-Device Intelligence Workshop in conjunction with MLSys Conference 2021

Renormalization-group improved Higgs to two gluons decay rate

Authors: Gauhar Abbas, Astha Jain, Vartika Singh, Neelam Singh

Abstract: We investigate the renormalization-group scale and scheme dependence of the $H \rightarrow gg$ decay rate at the order N$^4$LO in the renormalization-group summed perturbative theory, which employs the summation of all renormalization-group accessible logarithms including the leading and subsequent four sub-leading logarithmic contributions to the full perturbative series expansion. Moreover, we s… ▽ More We investigate the renormalization-group scale and scheme dependence of the $H \rightarrow gg$ decay rate at the order N$^4$LO in the renormalization-group summed perturbative theory, which employs the summation of all renormalization-group accessible logarithms including the leading and subsequent four sub-leading logarithmic contributions to the full perturbative series expansion. Moreover, we study the higher-order behaviour of the $H \rightarrow gg$ decay width using the asymptotic Padé approximant method in four different renormalization schemes. Furthermore, the higher-order behaviour is independently investigated in the framework of the asymptotic Padé-Borel approximant method where generalized Borel-transform is used as an analytic continuation of the original perturbative expansion. The predictions of the asymptotic Padé-Borel approximant method are found to be in agreement with that of the asymptotic Padé approximant method. Finally, we provide the $H \rightarrow gg$ decay rate at the order N$^5$LO in the fixed-order $ Γ_{\rm N^5LO} \,=\, Γ_0 (1.8375 \pm 0.047 _{α_s(M_Z),1\%}\pm 0.0004_{M_t} \pm 0.0066_{M_H} \pm 0.0036_{\rm P} \pm 0.007_{\text{s}} \pm 0.0005_{sc} ),$ and $Γ_{\rm RGSN^5LO} \,=\, Γ_0 (1.841 \pm 0.047 _{α_s(M_Z),1\%} \pm 0.0005_{M_t}\pm 0.0066_{M_H} \pm 0.0002_μ \pm 0.0027_{\rm P} \pm 0.001_{sc} )$ in the renormalization-group summed perturbative theories. △ Less

Submitted 19 January, 2024; v1 submitted 12 May, 2022; originally announced May 2022.

Comments: 34 pages, 19 figures, accepted version in EPJP

Journal ref: Eur. Phys. J. Plus (2024) 139:114

NER-MQMRC: Formulating Named Entity Recognition as Multi Question Machine Reading Comprehension

Authors: Anubhav Shrimal, Avi Jain, Kartik Mehta, Promod Yenigalla

Abstract: NER has been traditionally formulated as a sequence labeling task. However, there has been recent trend in posing NER as a machine reading comprehension task (Wang et al., 2020; Mengge et al., 2020), where entity name (or other information) is considered as a question, text as the context and entity value in text as answer snippet. These works consider MRC based on a single question (entity) at a… ▽ More NER has been traditionally formulated as a sequence labeling task. However, there has been recent trend in posing NER as a machine reading comprehension task (Wang et al., 2020; Mengge et al., 2020), where entity name (or other information) is considered as a question, text as the context and entity value in text as answer snippet. These works consider MRC based on a single question (entity) at a time. We propose posing NER as a multi-question MRC task, where multiple questions (one question per entity) are considered at the same time for a single text. We propose a novel BERT-based multi-question MRC (NER-MQMRC) architecture for this formulation. NER-MQMRC architecture considers all entities as input to BERT for learning token embeddings with self-attention and leverages BERT-based entity representation for further improving these token embeddings for NER task. Evaluation on three NER datasets show that our proposed architecture leads to average 2.5 times faster training and 2.3 times faster inference as compared to NER-SQMRC framework based models by considering all entities together in a single pass. Further, we show that our model performance does not degrade compared to single-question based MRC (NER-SQMRC) (Devlin et al., 2019) leading to F1 gain of +0.41%, +0.32% and +0.27% for AE-Pub, Ecommerce5PT and Twitter datasets respectively. We propose this architecture primarily to solve large scale e-commerce attribute (or entity) extraction from unstructured text of a magnitude of 50k+ attributes to be extracted on a scalable production environment with high performance and optimised training and inference runtimes. △ Less

Submitted 12 May, 2022; originally announced May 2022.

Comments: NAACL 2022 Industry Track

International cooperation and competition in orbit-use management

Authors: Aditya Jain, Akhil Rao

Abstract: Orbit-use management efforts can be structured as binding national regulatory policies or as self-enforcing international treaties. New treaties to control space debris growth appear unlikely in the near future. Spacefaring nations can pursue national regulatory policies, though regulatory competition and open access to orbit make their effectiveness unclear. We develop a game-theoretic model of n… ▽ More Orbit-use management efforts can be structured as binding national regulatory policies or as self-enforcing international treaties. New treaties to control space debris growth appear unlikely in the near future. Spacefaring nations can pursue national regulatory policies, though regulatory competition and open access to orbit make their effectiveness unclear. We develop a game-theoretic model of national regulatory policies and self-enforcing international treaties for orbit-use management in the face of open access, regulatory competition, and catastrophe. While open access limits the effectiveness of national policies, market-access control ensures the policies can improve environmental quality. A large enough stock of legacy debris ensures existence of a global regulatory equilibrium where all nations choose to levy environmental regulations on all satellites. The global regulatory equilibrium supports a self-enforcing treaty to avert catastrophe by making it costlier to leave the treaty and free ride. △ Less

Submitted 10 September, 2022; v1 submitted 8 May, 2022; originally announced May 2022.

Comments: PDF includes appendix. JEL codes: F53, H77, Q53, Q54, Q58. Keywords: open-access commons, satellites, space debris, international treaty, regulatory competition

Fingerprint Template Invertibility: Minutiae vs. Deep Templates

Authors: Kanishka P. Wijewardena, Steven A. Grosz, Kai Cao, Anil K. Jain

Abstract: Much of the success of fingerprint recognition is attributed to minutiae-based fingerprint representation. It was believed that minutiae templates could not be inverted to obtain a high fidelity fingerprint image, but this assumption has been shown to be false. The success of deep learning has resulted in alternative fingerprint representations (embeddings), in the hope that they might offer bette… ▽ More Much of the success of fingerprint recognition is attributed to minutiae-based fingerprint representation. It was believed that minutiae templates could not be inverted to obtain a high fidelity fingerprint image, but this assumption has been shown to be false. The success of deep learning has resulted in alternative fingerprint representations (embeddings), in the hope that they might offer better recognition accuracy as well as non-invertibility of deep network-based templates. We evaluate whether deep fingerprint templates suffer from the same reconstruction attacks as the minutiae templates. We show that while a deep template can be inverted to produce a fingerprint image that could be matched to its source image, deep templates are more resistant to reconstruction attacks than minutiae templates. In particular, reconstructed fingerprint images from minutiae templates yield a TAR of about 100.0% (98.3%) @ FAR of 0.01% for type-I (type-II) attacks using a state-of-the-art commercial fingerprint matcher, when tested on NIST SD4. The corresponding attack performance for reconstructed fingerprint images from deep templates using the same commercial matcher yields a TAR of less than 1% for both type-I and type-II attacks; however, when the reconstructed images are matched using the same deep network, they achieve a TAR of 85.95% (68.10%) for type-I (type-II) attacks. Furthermore, what is missing from previous fingerprint template inversion studies is an evaluation of the black-box attack performance, which we perform using 3 different state-of-the-art fingerprint matchers. We conclude that fingerprint images generated by inverting minutiae templates are highly susceptible to both white-box and black-box attack evaluations, while fingerprint images generated by deep templates are resistant to black-box evaluations and comparatively less susceptible to white-box evaluations. △ Less

Submitted 8 May, 2022; originally announced May 2022.

Synthetic Point Cloud Generation for Class Segmentation Applications

Authors: Maria Gonzalez Stefanelli, Avi Rajesh Jain, Sandeep Kamal Jalui, Eva Agapaki

Abstract: Maintenance of industrial facilities is a growing hazard due to the cumbersome process needed to identify infrastructure degradation. Digital Twins have the potential to improve maintenance by monitoring the continuous digital representation of infrastructure. However, the time needed to map the existing geometry makes their use prohibitive. We previously developed class segmentation algorithms to… ▽ More Maintenance of industrial facilities is a growing hazard due to the cumbersome process needed to identify infrastructure degradation. Digital Twins have the potential to improve maintenance by monitoring the continuous digital representation of infrastructure. However, the time needed to map the existing geometry makes their use prohibitive. We previously developed class segmentation algorithms to automate digital twinning, however a vast amount of annotated point clouds is needed. Currently, synthetic data generation for automated segmentation is non-existent. We used Helios++ to automatically segment point clouds from 3D models. Our research has the potential to pave the ground for efficient industrial class segmentation. △ Less

Submitted 7 May, 2022; originally announced May 2022.

COGMEN: COntextualized GNN based Multimodal Emotion recognitioN

Authors: Abhinav Joshi, Ashwani Bhat, Ayush Jain, Atin Vikram Singh, Ashutosh Modi

Abstract: Emotions are an inherent part of human interactions, and consequently, it is imperative to develop AI systems that understand and recognize human emotions. During a conversation involving various people, a person's emotions are influenced by the other speaker's utterances and their own emotional state over the utterances. In this paper, we propose COntextualized Graph Neural Network based Multimod… ▽ More Emotions are an inherent part of human interactions, and consequently, it is imperative to develop AI systems that understand and recognize human emotions. During a conversation involving various people, a person's emotions are influenced by the other speaker's utterances and their own emotional state over the utterances. In this paper, we propose COntextualized Graph Neural Network based Multimodal Emotion recognitioN (COGMEN) system that leverages local information (i.e., inter/intra dependency between speakers) and global information (context). The proposed model uses Graph Neural Network (GNN) based architecture to model the complex dependencies (local and global information) in a conversation. Our model gives state-of-the-art (SOTA) results on IEMOCAP and MOSEI datasets, and detailed ablation experiments show the importance of modeling information at both levels. △ Less

Submitted 5 May, 2022; originally announced May 2022.

Comments: 17 pages (9 main + 8 appendix). Accepted at NAACL 2022

PreMovNet: Pre-Movement EEG-based Hand Kinematics Estimation for Grasp and Lift task

Authors: Anant Jain, Lalan Kumar

Abstract: Kinematics decoding from brain activity helps in developing rehabilitation or power-augmenting brain-computer interface devices. Low-frequency signals recorded from non-invasive electroencephalography (EEG) are associated with the neural motor correlation utilised for motor trajectory decoding (MTD). In this communication, the ability to decode motor kinematics trajectory from pre-movement delta-b… ▽ More Kinematics decoding from brain activity helps in developing rehabilitation or power-augmenting brain-computer interface devices. Low-frequency signals recorded from non-invasive electroencephalography (EEG) are associated with the neural motor correlation utilised for motor trajectory decoding (MTD). In this communication, the ability to decode motor kinematics trajectory from pre-movement delta-band (0.5-3 Hz) EEG is investigated for the healthy participants. In particular, two deep learning-based neural decoders called PreMovNet-I and PreMovNet-II, are proposed that make use of motor-related neural information existing in the pre-movement EEG data. EEG data segments with various time lags of 150 ms, 200 ms, 250 ms, 300 ms, and 350 ms before the movement onset are utilised for the same. The MTD is presented for grasp-and-lift task (WAY-EEG-GAL dataset) using EEG with the various lags taken as input to the neural decoders. The performance of the proposed decoders are compared with the state-of-the-art multi-variable linear regression (mLR) model. Pearson correlation coefficient and hand trajectory are utilised as performance metric. The results demonstrate the viability of decoding 3D hand kinematics using pre-movement EEG data, enabling better control of BCI-based external devices such as exoskeleton/exosuit. △ Less

Submitted 14 June, 2022; v1 submitted 2 May, 2022; originally announced May 2022.

Journal ref: Volume: 6, Issue: 7, July 2022

Dropout Inference with Non-Uniform Weight Scaling

Authors: Zhaoyuan Yang, Arpit Jain

Abstract: Dropout as regularization has been used extensively to prevent overfitting for training neural networks. During training, units and their connections are randomly dropped, which could be considered as sampling many different submodels from the original model. At test time, weight scaling and Monte Carlo approximation are two widely applied approaches to approximate the outputs. Both approaches wor… ▽ More Dropout as regularization has been used extensively to prevent overfitting for training neural networks. During training, units and their connections are randomly dropped, which could be considered as sampling many different submodels from the original model. At test time, weight scaling and Monte Carlo approximation are two widely applied approaches to approximate the outputs. Both approaches work well practically when all submodels are low-bias complex learners. However, in this work, we demonstrate scenarios where some submodels behave closer to high-bias models and a non-uniform weight scaling is a better approximation for inference. △ Less

Submitted 27 April, 2022; originally announced April 2022.

Dictionary Attacks on Speaker Verification

Authors: Mirko Marras, Pawel Korus, Anubhav Jain, Nasir Memon

Abstract: In this paper, we propose dictionary attacks against speaker verification - a novel attack vector that aims to match a large fraction of speaker population by chance. We introduce a generic formulation of the attack that can be used with various speech representations and threat models. The attacker uses adversarial optimization to maximize raw similarity of speaker embeddings between a seed speec… ▽ More In this paper, we propose dictionary attacks against speaker verification - a novel attack vector that aims to match a large fraction of speaker population by chance. We introduce a generic formulation of the attack that can be used with various speech representations and threat models. The attacker uses adversarial optimization to maximize raw similarity of speaker embeddings between a seed speech sample and a proxy population. The resulting master voice successfully matches a non-trivial fraction of people in an unknown population. Adversarial waveforms obtained with our approach can match on average 69% of females and 38% of males enrolled in the target system at a strict decision threshold calibrated to yield false alarm rate of 1%. By using the attack with a black-box voice cloning system, we obtain master voices that are effective in the most challenging conditions and transferable between speaker encoders. We also show that, combined with multiple attempts, this attack opens even more to serious issues on the security of these systems. △ Less

Submitted 12 December, 2022; v1 submitted 24 April, 2022; originally announced April 2022.

Comments: Accepted in IEEE Transactions on Information Forensics and Security

Text-mined dataset of gold nanoparticle synthesis procedures, morphologies, and size entities

Authors: Kevin Cruse, Amalie Trewartha, Sanghoon Lee, Zheren Wang, Haoyan Huo, Tanjin He, Olga Kononova, Anubhav Jain, Gerbrand Ceder

Abstract: Gold nanoparticles are highly desired for a range of technological applications due to their tunable properties, which are dictated by the size and shape of the constituent particles. Many heuristic methods for controlling the morphological characteristics of gold nanoparticles are well known. However, the underlying mechanisms controlling their size and shape remain poorly understood, partly due… ▽ More Gold nanoparticles are highly desired for a range of technological applications due to their tunable properties, which are dictated by the size and shape of the constituent particles. Many heuristic methods for controlling the morphological characteristics of gold nanoparticles are well known. However, the underlying mechanisms controlling their size and shape remain poorly understood, partly due to the immense range of possible combinations of synthesis parameters. Data-driven methods can offer insight to help guide understanding of these underlying mechanisms, so long as sufficient synthesis data are available. To facilitate data mining in this direction, we have constructed and made publicly available a dataset of codified gold nanoparticle synthesis protocols and outcomes extracted directly from the nanoparticle materials science literature using natural language processing and text-mining techniques. This dataset contains 5,154 data records, each representing a single gold nanoparticle synthesis article, filtered from a database of 4,973,165 publications. Each record contains codified synthesis protocols and extracted morphological information from a total of 7,608 experimental and 12,519 characterization paragraphs. △ Less

Submitted 21 April, 2022; originally announced April 2022.

Comments: 40 pages; 4 figures; 4 tables; to be published in Scientific Data; for associated dataset, see https://doi.org/10.6084/m9.figshare.16614262.v3

Machine-learning rationalization and prediction of solid-state synthesis conditions

Authors: Haoyan Huo, Christopher J. Bartel, Tanjin He, Amalie Trewartha, Alexander Dunn, Bin Ouyang, Anubhav Jain, Gerbrand Ceder

Abstract: There currently exist no quantitative methods to determine the appropriate conditions for solid-state synthesis. This not only hinders the experimental realization of novel materials but also complicates the interpretation and understanding of solid-state reaction mechanisms. Here, we demonstrate a machine-learning approach that predicts synthesis conditions using large solid-state synthesis datas… ▽ More There currently exist no quantitative methods to determine the appropriate conditions for solid-state synthesis. This not only hinders the experimental realization of novel materials but also complicates the interpretation and understanding of solid-state reaction mechanisms. Here, we demonstrate a machine-learning approach that predicts synthesis conditions using large solid-state synthesis datasets text-mined from scientific journal articles. Using feature importance ranking analysis, we discovered that optimal heating temperatures have strong correlations with the stability of precursor materials quantified using melting points and formation energies ($ΔG_f$, $ΔH_f$). In contrast, features derived from the thermodynamics of synthesis-related reactions did not directly correlate to the chosen heating temperatures. This correlation between optimal solid-state heating temperature and precursor stability extends Tamman's rule from intermetallics to oxide systems, suggesting the importance of reaction kinetics in determining synthesis conditions. Heating times are shown to be strongly correlated with the chosen experimental procedures and instrument setups, which may be indicative of human bias in the dataset. Using these predictive features, we constructed machine-learning models with good performance and general applicability to predict the conditions required to synthesize diverse chemical systems. Codes and data used in this work can be found at: https://github.com/CederGroupHub/s4. △ Less

Submitted 5 August, 2022; v1 submitted 17 April, 2022; originally announced April 2022.

Journal ref: Chemistry of Materials, 2022

Evaluating the Effectiveness of Corrective Demonstrations and a Low-Cost Sensor for Dexterous Manipulation

Authors: Abhineet Jain, Jack Kolb, J. M. Abbess IV, Harish Ravichandar

Abstract: Imitation learning is a promising approach to help robots acquire dexterous manipulation capabilities without the need for a carefully-designed reward or a significant computational effort. However, existing imitation learning approaches require sophisticated data collection infrastructure and struggle to generalize beyond the training distribution. One way to address this limitation is to gather… ▽ More Imitation learning is a promising approach to help robots acquire dexterous manipulation capabilities without the need for a carefully-designed reward or a significant computational effort. However, existing imitation learning approaches require sophisticated data collection infrastructure and struggle to generalize beyond the training distribution. One way to address this limitation is to gather additional data that better represents the full operating conditions. In this work, we investigate characteristics of such additional demonstrations and their impact on performance. Specifically, we study the effects of corrective and randomly-sampled additional demonstrations on learning a policy that guides a five-fingered robot hand through a pick-and-place task. Our results suggest that corrective demonstrations considerably outperform randomly-sampled demonstrations, when the proportion of additional demonstrations sampled from the full task distribution is larger than the number of original demonstrations sampled from a restrictive training distribution. Conversely, when the number of original demonstrations are higher than that of additional demonstrations, we find no significant differences between corrective and randomly-sampled additional demonstrations. These results provide insights into the inherent trade-off between the effort required to collect corrective demonstrations and their relative benefits over randomly-sampled demonstrations. Additionally, we show that inexpensive vision-based sensors, such as LeapMotion, can be used to dramatically reduce the cost of providing demonstrations for dexterous manipulation tasks. Our code is available at https://github.com/GT-STAR-Lab/corrective-demos-dexterous-manipulation. △ Less

Submitted 15 April, 2022; originally announced April 2022.

Comments: Accepted in the Machine Learning in Human-Robot Collaboration Workshop at the 17th Annual ACM/IEEE International Conference on Human-Robot Interaction (HRI 2022). The first two authors contributed equally. 6 pages, 7 figures

SpoofGAN: Synthetic Fingerprint Spoof Images

Authors: Steven A. Grosz, Anil K. Jain

Abstract: A major limitation to advances in fingerprint spoof detection is the lack of publicly available, large-scale fingerprint spoof datasets, a problem which has been compounded by increased concerns surrounding privacy and security of biometric data. Furthermore, most state-of-the-art spoof detection algorithms rely on deep networks which perform best in the presence of a large amount of training data… ▽ More A major limitation to advances in fingerprint spoof detection is the lack of publicly available, large-scale fingerprint spoof datasets, a problem which has been compounded by increased concerns surrounding privacy and security of biometric data. Furthermore, most state-of-the-art spoof detection algorithms rely on deep networks which perform best in the presence of a large amount of training data. This work aims to demonstrate the utility of synthetic (both live and spoof) fingerprints in supplying these algorithms with sufficient data to improve the performance of fingerprint spoof detection algorithms beyond the capabilities when training on a limited amount of publicly available real datasets. First, we provide details of our approach in modifying a state-of-the-art generative architecture to synthesize high quality live and spoof fingerprints. Then, we provide quantitative and qualitative analysis to verify the quality of our synthetic fingerprints in mimicking the distribution of real data samples. We showcase the utility of our synthetic live and spoof fingerprints in training a deep network for fingerprint spoof detection, which dramatically boosts the performance across three different evaluation datasets compared to an identical model trained on real data alone. Finally, we demonstrate that only 25% of the original (real) dataset is required to obtain similar detection performance when augmenting the training dataset with synthetic data. △ Less

Submitted 15 April, 2022; v1 submitted 13 April, 2022; originally announced April 2022.

Towards Painless Policy Optimization for Constrained MDPs

Authors: Arushi Jain, Sharan Vaswani, Reza Babanezhad, Csaba Szepesvari, Doina Precup

Abstract: We study policy optimization in an infinite horizon, $γ$-discounted constrained Markov decision process (CMDP). Our objective is to return a policy that achieves large expected reward with a small constraint violation. We consider the online setting with linear function approximation and assume global access to the corresponding features. We propose a generic primal-dual framework that allows us t… ▽ More We study policy optimization in an infinite horizon, $γ$-discounted constrained Markov decision process (CMDP). Our objective is to return a policy that achieves large expected reward with a small constraint violation. We consider the online setting with linear function approximation and assume global access to the corresponding features. We propose a generic primal-dual framework that allows us to bound the reward sub-optimality and constraint violation for arbitrary algorithms in terms of their primal and dual regret on online linear optimization problems. We instantiate this framework to use coin-betting algorithms and propose the Coin Betting Politex (CBP) algorithm. Assuming that the action-value functions are $\varepsilon_b$-close to the span of the $d$-dimensional state-action features and no sampling errors, we prove that $T$ iterations of CBP result in an $O\left(\frac{1}{(1 - γ)^3 \sqrt{T}} + \frac{\varepsilon_b\sqrt{d}}{(1 - γ)^2} \right)$ reward sub-optimality and an $O\left(\frac{1}{(1 - γ)^2 \sqrt{T}} + \frac{\varepsilon_b \sqrt{d}}{1 - γ} \right)$ constraint violation. Importantly, unlike gradient descent-ascent and other recent methods, CBP does not require extensive hyperparameter tuning. Via experiments on synthetic and Cartpole environments, we demonstrate the effectiveness and robustness of CBP. △ Less

Submitted 11 April, 2022; originally announced April 2022.

Comments: Paper under submission. 27 pages, 12 figures

High-throughput computational discovery of 40 ultralow thermal conductivity and 20 highly anisotropic crystalline materials

Authors: Ankit Jain, Harish P Veeravenkata, Shravan Godse, Yagyank Srivastava

Abstract: We performed ab-initio driven density functional theory-based high throughput computations to search for materials with low thermal conductivity and high thermal transport anisotropy. We shortlisted a pool of 429 stable ternary semiconductors from the Materials Project and obtained phonon thermal conductivity by solving the Boltzmann transport equation on 225 materials. We found the lowest thermal… ▽ More We performed ab-initio driven density functional theory-based high throughput computations to search for materials with low thermal conductivity and high thermal transport anisotropy. We shortlisted a pool of 429 stable ternary semiconductors from the Materials Project and obtained phonon thermal conductivity by solving the Boltzmann transport equation on 225 materials. We found the lowest thermal conductivity of 0.16 W/m-K in SbRbK 2 and 40 materials with a thermal conductivity lower than 1 W/m-K at 300 K. For anisotropic thermal transport, we have identified six materials with anisotropy larger than 5 and 20 with thermal transport anisotropy higher than the largest reported literature value. △ Less

Submitted 9 April, 2022; v1 submitted 7 April, 2022; originally announced April 2022.

AdaFace: Quality Adaptive Margin for Face Recognition

Authors: Minchul Kim, Anil K. Jain, Xiaoming Liu

Abstract: Recognition in low quality face datasets is challenging because facial attributes are obscured and degraded. Advances in margin-based loss functions have resulted in enhanced discriminability of faces in the embedding space. Further, previous studies have studied the effect of adaptive losses to assign more importance to misclassified (hard) examples. In this work, we introduce another aspect of a… ▽ More Recognition in low quality face datasets is challenging because facial attributes are obscured and degraded. Advances in margin-based loss functions have resulted in enhanced discriminability of faces in the embedding space. Further, previous studies have studied the effect of adaptive losses to assign more importance to misclassified (hard) examples. In this work, we introduce another aspect of adaptiveness in the loss function, namely the image quality. We argue that the strategy to emphasize misclassified samples should be adjusted according to their image quality. Specifically, the relative importance of easy or hard samples should be based on the sample's image quality. We propose a new loss function that emphasizes samples of different difficulties based on their image quality. Our method achieves this in the form of an adaptive margin function by approximating the image quality with feature norms. Extensive experiments show that our method, AdaFace, improves the face recognition performance over the state-of-the-art (SoTA) on four datasets (IJB-B, IJB-C, IJB-S and TinyFace). Code and models are released in https://github.com/mk-minchul/AdaFace. △ Less

Submitted 15 February, 2023; v1 submitted 2 April, 2022; originally announced April 2022.

Comments: Published in CVPR2022 (Oral)