-
ComplETR: Reducing the cost of annotations for object detection in dense scenes with vision transformers
Authors:
Achin Jain,
Kibok Lee,
Gurumurthy Swaminathan,
Hao Yang,
Bernt Schiele,
Avinash Ravichandran,
Onkar Dabeer
Abstract:
Annotating bounding boxes for object detection is expensive, time-consuming, and error-prone. In this work, we propose a DETR based framework called ComplETR that is designed to explicitly complete missing annotations in partially annotated dense scene datasets. This reduces the need to annotate every object instance in the scene thereby reducing annotation cost. ComplETR augments object queries i…
▽ More
Annotating bounding boxes for object detection is expensive, time-consuming, and error-prone. In this work, we propose a DETR based framework called ComplETR that is designed to explicitly complete missing annotations in partially annotated dense scene datasets. This reduces the need to annotate every object instance in the scene thereby reducing annotation cost. ComplETR augments object queries in DETR decoder with patch information of objects in the image. Combined with a matching loss, it can effectively find objects that are similar to the input patch and complete the missing annotations. We show that our framework outperforms the state-of-the-art methods such as Soft Sampling and Unbiased Teacher by itself, while at the same time can be used in conjunction with these methods to further improve their performance. Our framework is also agnostic to the choice of the downstream object detectors; we show performance improvement for several popular detectors such as Faster R-CNN, Cascade R-CNN, CenterNet2, and Deformable DETR on multiple dense scene datasets.
△ Less
Submitted 12 September, 2022;
originally announced September 2022.
-
The Reduced Bergman Kernel and its Properties
Authors:
Sahil Gehlawat,
Aakanksha Jain,
Amar Deep Sarkar
Abstract:
In this article, we study some properties of the $n$-th order weighted reduced Bergman kernels for planar domains, $n\geq 1$. Specifically, we look at Ramadanov type theorems, localization, and boundary behaviour of the weighted reduced Bergman kernel and its higher-order counterparts. We also give a transformation formula for these kernels under biholomorphisms.
In this article, we study some properties of the $n$-th order weighted reduced Bergman kernels for planar domains, $n\geq 1$. Specifically, we look at Ramadanov type theorems, localization, and boundary behaviour of the weighted reduced Bergman kernel and its higher-order counterparts. We also give a transformation formula for these kernels under biholomorphisms.
△ Less
Submitted 12 September, 2023; v1 submitted 11 September, 2022;
originally announced September 2022.
-
Hardware Software Co-design of Statistical and Deep Learning Frameworks for Wideband Sensing on Zynq System on Chip
Authors:
Rohith Rajesh,
Sumit J. Darak,
Akshay Jain,
Shivam Chandhok,
Animesh Sharma
Abstract:
With the introduction of spectrum sharing and heterogeneous services in next-generation networks, the base stations need to sense the wideband spectrum and identify the spectrum resources to meet the quality-of-service, bandwidth, and latency constraints. Sub-Nyquist sampling (SNS) enables digitization for sparse wideband spectrum without needing Nyquist speed analog-to-digital converters. However…
▽ More
With the introduction of spectrum sharing and heterogeneous services in next-generation networks, the base stations need to sense the wideband spectrum and identify the spectrum resources to meet the quality-of-service, bandwidth, and latency constraints. Sub-Nyquist sampling (SNS) enables digitization for sparse wideband spectrum without needing Nyquist speed analog-to-digital converters. However, SNS demands additional signal processing algorithms for spectrum reconstruction, such as the well-known orthogonal matching pursuit (OMP) algorithm. OMP is also widely used in other compressed sensing applications. The first contribution of this work is efficiently mapping the OMP algorithm on the Zynq system-on-chip (ZSoC) consisting of an ARM processor and FPGA. Experimental analysis shows a significant degradation in OMP performance for sparse spectrum. Also, OMP needs prior knowledge of spectrum sparsity. We address these challenges via deep-learning-based architectures and efficiently map them on the ZSoC platform as second contribution. Via hardware-software co-design, different versions of the proposed architecture obtained by partitioning between software (ARM processor) and hardware (FPGA) are considered. The resource, power, and execution time comparisons for given memory constraints and a wide range of word lengths are presented for these architectures.
△ Less
Submitted 6 September, 2022;
originally announced September 2022.
-
Learning an Ensemble of Deep Fingerprint Representations
Authors:
Akash Godbole,
Karthik Nandakumar,
Anil K. Jain
Abstract:
Deep neural networks (DNNs) have shown incredible promise in learning fixed-length representations from fingerprints. Since the representation learning is often focused on capturing specific prior knowledge (e.g., minutiae), there is no universal representation that comprehensively encapsulates all the discriminatory information available in a fingerprint. While learning an ensemble of representat…
▽ More
Deep neural networks (DNNs) have shown incredible promise in learning fixed-length representations from fingerprints. Since the representation learning is often focused on capturing specific prior knowledge (e.g., minutiae), there is no universal representation that comprehensively encapsulates all the discriminatory information available in a fingerprint. While learning an ensemble of representations can mitigate this problem, two critical challenges need to be addressed: (i) How to extract multiple diverse representations from the same fingerprint image? and (ii) How to optimally exploit these representations during the matching process? In this work, we train multiple instances of DeepPrint (a state-of-the-art DNN-based fingerprint encoder) on different transformations of the input image to generate an ensemble of fingerprint embeddings. We also propose a feature fusion technique that distills these multiple representations into a single embedding, which faithfully captures the diversity present in the ensemble without increasing the computational complexity. The proposed approach has been comprehensively evaluated on five databases containing rolled, plain, and latent fingerprints (NIST SD4, NIST SD14, NIST SD27, NIST SD302, and FVC2004 DB2A) and statistically significant improvements in accuracy have been consistently demonstrated across a range of verification as well as closed- and open-set identification settings. The proposed approach serves as a wrapper capable of improving the accuracy of any DNN-based recognition system.
△ Less
Submitted 2 September, 2022;
originally announced September 2022.
-
Subject-independent trajectory prediction using pre-movement EEG during grasp and lift task
Authors:
Anant Jain,
Lalan Kumar
Abstract:
Brain-computer interface (BCI) systems can be utilized for kinematics decoding from scalp brain activation to control rehabilitation or power-augmenting devices. In this study, the hand kinematics decoding for grasp and lift task is performed in three-dimensional (3D) space using scalp electroencephalogram (EEG) signals. Twelve subjects from the publicly available database WAY-EEG-GAL, has been ut…
▽ More
Brain-computer interface (BCI) systems can be utilized for kinematics decoding from scalp brain activation to control rehabilitation or power-augmenting devices. In this study, the hand kinematics decoding for grasp and lift task is performed in three-dimensional (3D) space using scalp electroencephalogram (EEG) signals. Twelve subjects from the publicly available database WAY-EEG-GAL, has been utilized in this study. In particular, multi-layer perceptron (MLP) and convolutional neural network-long short-term memory (CNN-LSTM) based deep learning frameworks are proposed that utilize the motor-neural information encoded in the pre-movement EEG data. Spectral features are analyzed for hand kinematics decoding using EEG data filtered in seven frequency ranges. The best performing frequency band spectral features has been considered for further analysis with different EEG window sizes and lag windows. Appropriate lag windows from movement onset, make the approach pre-movement in true sense. Additionally, inter-subject hand trajectory decoding analysis is performed using leave-one-subject-out (LOSO) approach. The Pearson correlation coefficient and hand trajectory are considered as performance metric to evaluate decoding performance for the neural decoders. This study explores the feasibility of inter-subject 3-D hand trajectory decoding using EEG signals only during reach and grasp task, probably for the first time. The results may provide the viable information to decode 3D hand kinematics using pre-movement EEG signals for practical BCI applications such as exoskeleton/exosuit and prosthesis.
△ Less
Submitted 18 June, 2024; v1 submitted 5 September, 2022;
originally announced September 2022.
-
Synthetic Latent Fingerprint Generator
Authors:
Andre Brasil Vieira Wyzykowski,
Anil K. Jain
Abstract:
Given a full fingerprint image (rolled or slap), we present CycleGAN models to generate multiple latent impressions of the same identity as the full print. Our models can control the degree of distortion, noise, blurriness and occlusion in the generated latent print images to obtain Good, Bad and Ugly latent image categories as introduced in the NIST SD27 latent database. The contributions of our…
▽ More
Given a full fingerprint image (rolled or slap), we present CycleGAN models to generate multiple latent impressions of the same identity as the full print. Our models can control the degree of distortion, noise, blurriness and occlusion in the generated latent print images to obtain Good, Bad and Ugly latent image categories as introduced in the NIST SD27 latent database. The contributions of our work are twofold: (i) demonstrate the similarity of synthetically generated latent fingerprint images to crime scene latents in NIST SD27 and MSP databases as evaluated by the NIST NFIQ 2 quality measure and ROC curves obtained by a SOTA fingerprint matcher, and (ii) use of synthetic latents to augment small-size latent training databases in the public domain to improve the performance of DeepPrint, a SOTA fingerprint matcher designed for rolled to rolled fingerprint matching on three latent databases (NIST SD27, NIST SD302, and IIITD-SLF). As an example, with synthetic latent data augmentation, the Rank-1 retrieval performance of DeepPrint is improved from 15.50% to 29.07% on challenging NIST SD27 latent database. Our approach for generating synthetic latent fingerprints can be used to improve the recognition performance of any latent matcher and its individual components (e.g., enhancement, segmentation and feature extraction).
△ Less
Submitted 29 August, 2022;
originally announced August 2022.
-
Multi-domain Learning for Updating Face Anti-spoofing Models
Authors:
Xiao Guo,
Yaojie Liu,
Anil Jain,
Xiaoming Liu
Abstract:
In this work, we study multi-domain learning for face anti-spoofing(MD-FAS), where a pre-trained FAS model needs to be updated to perform equally well on both source and target domains while only using target domain data for updating. We present a new model for MD-FAS, which addresses the forgetting issue when learning new domain data, while possessing a high level of adaptability. First, we devis…
▽ More
In this work, we study multi-domain learning for face anti-spoofing(MD-FAS), where a pre-trained FAS model needs to be updated to perform equally well on both source and target domains while only using target domain data for updating. We present a new model for MD-FAS, which addresses the forgetting issue when learning new domain data, while possessing a high level of adaptability. First, we devise a simple yet effective module, called spoof region estimator(SRE), to identify spoof traces in the spoof image. Such spoof traces reflect the source pre-trained model's responses that help upgraded models combat catastrophic forgetting during updating. Unlike prior works that estimate spoof traces which generate multiple outputs or a low-resolution binary mask, SRE produces one single, detailed pixel-wise estimate in an unsupervised manner. Secondly, we propose a novel framework, named FAS-wrapper, which transfers knowledge from the pre-trained models and seamlessly integrates with different FAS models. Lastly, to help the community further advance MD-FAS, we construct a new benchmark based on SIW, SIW-Mv2 and Oulu-NPU, and introduce four distinct protocols for evaluation, where source and target domains are different in terms of spoof type, age, ethnicity, and illumination. Our proposed method achieves superior performance on the MD-FAS benchmark than previous methods. Our code and newly curated SIW-Mv2 are publicly available.
△ Less
Submitted 16 April, 2023; v1 submitted 23 August, 2022;
originally announced August 2022.
-
[Reproducibility Report] Path Planning using Neural A* Search
Authors:
Shreya Bhatt,
Aayush Jain,
Parv Maheshwari,
Animesh Jha,
Debashish Chakravarty
Abstract:
The following paper is a reproducibility report for "Path Planning using Neural A* Search" published in ICML2 2021 as part of the ML Reproducibility Challenge 2021. The original paper proposes the Neural A* planner, and claims it achieves an optimal balance between the reduction of node expansions and path accuracy. We verify this claim by reimplementing the model in a different framework and repr…
▽ More
The following paper is a reproducibility report for "Path Planning using Neural A* Search" published in ICML2 2021 as part of the ML Reproducibility Challenge 2021. The original paper proposes the Neural A* planner, and claims it achieves an optimal balance between the reduction of node expansions and path accuracy. We verify this claim by reimplementing the model in a different framework and reproduce the data published in the original paper. We have also provided a code-flow diagram to aid comprehension of the code structure. As extensions to the original paper, we explore the effects of (1) generalizing the model by training it on a shuffled dataset, (2) introducing dropout, (3) implementing empirically chosen hyperparameters as trainable parameters in the model, (4) altering the network model to Generative Adversarial Networks (GANs) to introduce stochasticity, (5) modifying the encoder from Unet to Unet++, (6) incorporating cost maps obtained from the Neural A* module in other variations of A* search.
△ Less
Submitted 16 July, 2022;
originally announced August 2022.
-
AdaCat: Adaptive Categorical Discretization for Autoregressive Models
Authors:
Qiyang Li,
Ajay Jain,
Pieter Abbeel
Abstract:
Autoregressive generative models can estimate complex continuous data distributions, like trajectory rollouts in an RL environment, image intensities, and audio. Most state-of-the-art models discretize continuous data into several bins and use categorical distributions over the bins to approximate the continuous data distribution. The advantage is that the categorical distribution can easily expre…
▽ More
Autoregressive generative models can estimate complex continuous data distributions, like trajectory rollouts in an RL environment, image intensities, and audio. Most state-of-the-art models discretize continuous data into several bins and use categorical distributions over the bins to approximate the continuous data distribution. The advantage is that the categorical distribution can easily express multiple modes and are straightforward to optimize. However, such approximation cannot express sharp changes in density without using significantly more bins, making it parameter inefficient. We propose an efficient, expressive, multimodal parameterization called Adaptive Categorical Discretization (AdaCat). AdaCat discretizes each dimension of an autoregressive model adaptively, which allows the model to allocate density to fine intervals of interest, improving parameter efficiency. AdaCat generalizes both categoricals and quantile-based regression. AdaCat is a simple add-on to any discretization-based distribution estimator. In experiments, AdaCat improves density estimation for real-world tabular data, images, audio, and trajectories, and improves planning in model-based offline RL.
△ Less
Submitted 3 August, 2022;
originally announced August 2022.
-
Atlas of Nuclear Isomers -- Second Edition
Authors:
Swati Garg,
Bhoomika Maheshwari,
Balraj Singh,
Yang Sun,
Alpana Goel,
Ashok Kumar Jain
Abstract:
We present an updated version of the 2015-Atlas of Nuclear Isomers \cite{jain2015}, compiling and evaluating experimental data for the isomers with half-life $\ge 10$ $\it{ns}$, together with their spectroscopic properties such as excitation-energies, half-lives, decay modes, spins and parities, energies and multipolarities of isomeric transitions, along with the relevant original references in li…
▽ More
We present an updated version of the 2015-Atlas of Nuclear Isomers \cite{jain2015}, compiling and evaluating experimental data for the isomers with half-life $\ge 10$ $\it{ns}$, together with their spectroscopic properties such as excitation-energies, half-lives, decay modes, spins and parities, energies and multipolarities of isomeric transitions, along with the relevant original references in literature. The current version of Atlas presents many re-evaluated half-lives as compared to the 2015 edition, where values were referred to Nuclear Data Sheets publications, when no new data existed. The ENSDF database \cite{Ensdf}, together with the XUNDL \cite{Xundl} and the NUBASE2020 \cite{Kondev2021} databases have been consulted for completeness, yet, data from original papers from journals were considered in the present evaluation, and the NSR bibliographic database \cite{Nsr} has been searched to ensure that this work is as complete and current as possible. Several useful systematic features of nuclear isomers covered in this Atlas have been discussed. Literature cutoff date for the extraction of data is October 31, 2022.
△ Less
Submitted 12 December, 2022; v1 submitted 1 August, 2022;
originally announced August 2022.
-
Modelling Social Context for Fake News Detection: A Graph Neural Network Based Approach
Authors:
Pallabi Saikia,
Kshitij Gundale,
Ankit Jain,
Dev Jadeja,
Harvi Patel,
Mohendra Roy
Abstract:
Detection of fake news is crucial to ensure the authenticity of information and maintain the news ecosystems reliability. Recently, there has been an increase in fake news content due to the recent proliferation of social media and fake content generation techniques such as Deep Fake. The majority of the existing modalities of fake news detection focus on content based approaches. However, most of…
▽ More
Detection of fake news is crucial to ensure the authenticity of information and maintain the news ecosystems reliability. Recently, there has been an increase in fake news content due to the recent proliferation of social media and fake content generation techniques such as Deep Fake. The majority of the existing modalities of fake news detection focus on content based approaches. However, most of these techniques fail to deal with ultra realistic synthesized media produced by generative models. Our recent studies find that the propagation characteristics of authentic and fake news are distinguishable, irrespective of their modalities. In this regard, we have investigated the auxiliary information based on social context to detect fake news. This paper has analyzed the social context of fake news detection with a hybrid graph neural network based approach. This hybrid model is based on integrating a graph neural network on the propagation of news and bi directional encoder representations from the transformers model on news content to learn the text features. Thus this proposed approach learns the content as well as the context features and hence able to outperform the baseline models with an f1 score of 0.91 on PolitiFact and 0.93 on the Gossipcop dataset, respectively
△ Less
Submitted 27 July, 2022;
originally announced July 2022.
-
Controllable and Guided Face Synthesis for Unconstrained Face Recognition
Authors:
Feng Liu,
Minchul Kim,
Anil Jain,
Xiaoming Liu
Abstract:
Although significant advances have been made in face recognition (FR), FR in unconstrained environments remains challenging due to the domain gap between the semi-constrained training datasets and unconstrained testing scenarios. To address this problem, we propose a controllable face synthesis model (CFSM) that can mimic the distribution of target datasets in a style latent space. CFSM learns a l…
▽ More
Although significant advances have been made in face recognition (FR), FR in unconstrained environments remains challenging due to the domain gap between the semi-constrained training datasets and unconstrained testing scenarios. To address this problem, we propose a controllable face synthesis model (CFSM) that can mimic the distribution of target datasets in a style latent space. CFSM learns a linear subspace with orthogonal bases in the style latent space with precise control over the diversity and degree of synthesis. Furthermore, the pre-trained synthesis model can be guided by the FR model, making the resulting images more beneficial for FR model training. Besides, target dataset distributions are characterized by the learned orthogonal bases, which can be utilized to measure the distributional similarity among face datasets. Our approach yields significant performance gains on unconstrained benchmarks, such as IJB-B, IJB-C, TinyFace and IJB-S (+5.76% Rank1).
△ Less
Submitted 20 July, 2022;
originally announced July 2022.
-
A Comprehensive Review on Digital Image Watermarking
Authors:
Shweta Wadhera,
Deepa Kamra,
Ankit Rajpal,
Aruna Jain,
Vishal Jain
Abstract:
The advent of the Internet led to the easy availability of digital data like images, audio, and video. Easy access to multimedia gives rise to the issues such as content authentication, security, copyright protection, and ownership identification. Here, we discuss the concept of digital image watermarking with a focus on the technique used in image watermark embedding and extraction of the waterma…
▽ More
The advent of the Internet led to the easy availability of digital data like images, audio, and video. Easy access to multimedia gives rise to the issues such as content authentication, security, copyright protection, and ownership identification. Here, we discuss the concept of digital image watermarking with a focus on the technique used in image watermark embedding and extraction of the watermark. The detailed classification along with the basic characteristics, namely visual imperceptibility, robustness, capacity, security of digital watermarking is also presented in this work. Further, we have also discussed the recent application areas of digital watermarking such as healthcare, remote education, electronic voting systems, and the military. The robustness is evaluated by examining the effect of image processing attacks on the signed content and the watermark recoverability. The authors believe that the comprehensive survey presented in this paper will help the new researchers to gather knowledge in this domain. Further, the comparative analysis can enkindle ideas to improve upon the already mentioned techniques.
△ Less
Submitted 7 July, 2022;
originally announced July 2022.
-
Respiration driven CO2 pulses dominate Australia's flux variability
Authors:
Eva-Marie Metz,
Sanam N. Vardag,
Sourish Basu,
Martin Jung,
Bernhard Ahrens,
Tarek El-Madany,
Stephen Sitch,
Vivek K. Arora,
Peter R. Briggs,
Pierre Friedlingstein,
Daniel S. Goll,
Atul K. Jain,
Etsushi Kato,
Danica Lombardozzi,
Julia E. M. S. Nabel,
Benjamin Poulter,
Roland Séférian,
Hanqin Tian,
Andrew Wiltshire,
Wenping Yuan,
Xu Yue,
Sönke Zaehle,
Nicholas M. Deutscher,
David W. T. Griffith,
André Butz
Abstract:
The Australian continent contributes substantially to the year-to-year variability of the global terrestrial carbon dioxide (CO2) sink. However, the scarcity of in-situ observations in remote areas prevents deciphering the processes that force the CO2 flux variability. Here, examining atmospheric CO2 measurements from satellites in the period 2009-2018, we find recurrent end-of-dry-season CO2 puls…
▽ More
The Australian continent contributes substantially to the year-to-year variability of the global terrestrial carbon dioxide (CO2) sink. However, the scarcity of in-situ observations in remote areas prevents deciphering the processes that force the CO2 flux variability. Here, examining atmospheric CO2 measurements from satellites in the period 2009-2018, we find recurrent end-of-dry-season CO2 pulses over the Australian continent. These pulses largely control the year-to-year variability of Australia's CO2 balance, due to 2-3 times higher seasonal variations compared to previous top-down inversions and bottom-up estimates. The CO2 pulses occur shortly after the onset of rainfall and are driven by enhanced soil respiration preceding photosynthetic uptake in Australia's semi-arid regions. The suggested continental-scale relevance of soil rewetting processes has large implications for our understanding and modelling of global climate-carbon cycle feedbacks.
△ Less
Submitted 30 November, 2022; v1 submitted 14 July, 2022;
originally announced July 2022.
-
Cluster Resource Management for Dynamic Workloads by Online Optimization
Authors:
Nader Alfares,
George Kesidis,
Ata Fatahi Baarzi,
Aman Jain
Abstract:
Over the past ten years, many different approaches have been proposed for different aspects of the problem of resources management for long running, dynamic and diverse workloads such as processing query streams or distributed deep learning. Particularly for applications consisting of containerized microservices, researchers have attempted to address problems of dynamic selection of, for example:…
▽ More
Over the past ten years, many different approaches have been proposed for different aspects of the problem of resources management for long running, dynamic and diverse workloads such as processing query streams or distributed deep learning. Particularly for applications consisting of containerized microservices, researchers have attempted to address problems of dynamic selection of, for example: types and quantities of virtualized services (e.g., IaaS/VMs), vertical and horizontal scaling of different microservices, assigning microservices to VMs, task scheduling, or some combination thereof. In this context, we argue that frameworks like simulated annealing are highly suitable for online navigation of trade-offs between performance (SLO) and cost, particularly when the complex workloads and cloud-service offerings vary over time. Based on a macroscopic objective that combines both performance and cost terms, annealing facilitates light-weight and coherent policies of exploration and exploitation. In this paper, we first give some background on simulated annealing and then experimentally demonstrate its usefulness for different case studies, including service selection for both a single type of workload (e.g., distributed deep learning) and a mixture of workload types (exploring a partially categorical set of options), and container sizing for microservice benchmarks. We conclude with a discussion of how the basic annealing platform can be applied to other resource-management problems, hybridized with other methods, and accommodate user-specified rules of thumb.
△ Less
Submitted 22 August, 2023; v1 submitted 10 July, 2022;
originally announced July 2022.
-
Adaptive Virtual Neuroarchitecture
Authors:
Abhinandan Jain,
Pattie Maes,
Misha Sra
Abstract:
Our surrounding environment impacts our cognitive-emotional processes on a daily basis and shapes our physical, psychological and social wellbeing. Although the effects of the built environment on our psycho-physiological processes are well studied, virtual environment design with a potentially similar impact on the user, has received limited attention. Based on the influence of space design on a…
▽ More
Our surrounding environment impacts our cognitive-emotional processes on a daily basis and shapes our physical, psychological and social wellbeing. Although the effects of the built environment on our psycho-physiological processes are well studied, virtual environment design with a potentially similar impact on the user, has received limited attention. Based on the influence of space design on a user and combining that with the dynamic affordances of virtual spaces, we present the idea of adaptive virtual neuroarchitecture (AVN), where virtual environments respond to the user and the user's real world context while simultaneously influencing them both in realtime. To show how AVN has been explored in current research, we present a sampling of recent work that demonstrates reciprocal relationships using physical affordances (space, objects), the user's state (physiological, cognitive, emotional), and the virtual world used in the design of novel virtual reality experiences. We believe AVN has the potential to help us learn how to design spaces and environments that can enhance the wellbeing of their inhabitants.
△ Less
Submitted 10 July, 2022;
originally announced July 2022.
-
QUIDAM: A Framework for Quantization-Aware DNN Accelerator and Model Co-Exploration
Authors:
Ahmet Inci,
Siri Garudanagiri Virupaksha,
Aman Jain,
Ting-Wu Chin,
Venkata Vivek Thallam,
Ruizhou Ding,
Diana Marculescu
Abstract:
As the machine learning and systems communities strive to achieve higher energy-efficiency through custom deep neural network (DNN) accelerators, varied precision or quantization levels, and model compression techniques, there is a need for design space exploration frameworks that incorporate quantization-aware processing elements into the accelerator design space while having accurate and fast po…
▽ More
As the machine learning and systems communities strive to achieve higher energy-efficiency through custom deep neural network (DNN) accelerators, varied precision or quantization levels, and model compression techniques, there is a need for design space exploration frameworks that incorporate quantization-aware processing elements into the accelerator design space while having accurate and fast power, performance, and area models. In this work, we present QUIDAM, a highly parameterized quantization-aware DNN accelerator and model co-exploration framework. Our framework can facilitate future research on design space exploration of DNN accelerators for various design choices such as bit precision, processing element type, scratchpad sizes of processing elements, global buffer size, number of total processing elements, and DNN configurations. Our results show that different bit precisions and processing element types lead to significant differences in terms of performance per area and energy. Specifically, our framework identifies a wide range of design points where performance per area and energy varies more than 5x and 35x, respectively. With the proposed framework, we show that lightweight processing elements achieve on par accuracy results and up to 5.7x more performance per area and energy improvement when compared to the best INT16 based implementation. Finally, due to the efficiency of the pre-characterized power, performance, and area models, QUIDAM can speed up the design exploration process by 3-4 orders of magnitude as it removes the need for expensive synthesis and characterization of each design.
△ Less
Submitted 30 June, 2022;
originally announced June 2022.
-
The Astropy Project: Sustaining and Growing a Community-oriented Open-source Project and the Latest Major Release (v5.0) of the Core Package
Authors:
The Astropy Collaboration,
Adrian M. Price-Whelan,
Pey Lian Lim,
Nicholas Earl,
Nathaniel Starkman,
Larry Bradley,
David L. Shupe,
Aarya A. Patil,
Lia Corrales,
C. E. Brasseur,
Maximilian Nöthe,
Axel Donath,
Erik Tollerud,
Brett M. Morris,
Adam Ginsburg,
Eero Vaher,
Benjamin A. Weaver,
James Tocknell,
William Jamieson,
Marten H. van Kerkwijk,
Thomas P. Robitaille,
Bruce Merry,
Matteo Bachetti,
H. Moritz Günther,
Thomas L. Aldcroft
, et al. (111 additional authors not shown)
Abstract:
The Astropy Project supports and fosters the development of open-source and openly-developed Python packages that provide commonly needed functionality to the astronomical community. A key element of the Astropy Project is the core package $\texttt{astropy}$, which serves as the foundation for more specialized projects and packages. In this article, we summarize key features in the core package as…
▽ More
The Astropy Project supports and fosters the development of open-source and openly-developed Python packages that provide commonly needed functionality to the astronomical community. A key element of the Astropy Project is the core package $\texttt{astropy}$, which serves as the foundation for more specialized projects and packages. In this article, we summarize key features in the core package as of the recent major release, version 5.0, and provide major updates for the Project. We then discuss supporting a broader ecosystem of interoperable packages, including connections with several astronomical observatories and missions. We also revisit the future outlook of the Astropy Project and the current status of Learn Astropy. We conclude by raising and discussing the current and future challenges facing the Project.
△ Less
Submitted 28 June, 2022;
originally announced June 2022.
-
muBoost: An Effective Method for Solving Indic Multilingual Text Classification Problem
Authors:
Manish Pathak,
Aditya Jain
Abstract:
Text Classification is an integral part of many Natural Language Processing tasks such as sarcasm detection, sentiment analysis and many more such applications. Many e-commerce websites, social-media/entertainment platforms use such models to enhance user-experience to generate traffic and thus, revenue on their platforms. In this paper, we are presenting our solution to Multilingual Abusive Comme…
▽ More
Text Classification is an integral part of many Natural Language Processing tasks such as sarcasm detection, sentiment analysis and many more such applications. Many e-commerce websites, social-media/entertainment platforms use such models to enhance user-experience to generate traffic and thus, revenue on their platforms. In this paper, we are presenting our solution to Multilingual Abusive Comment Identification Problem on Moj, an Indian video-sharing social networking service, powered by ShareChat. The problem dealt with detecting abusive comments, in 13 regional Indic languages such as Hindi, Telugu, Kannada etc., on the videos on Moj platform. Our solution utilizes the novel muBoost, an ensemble of CatBoost classifier models and Multilingual Representations for Indian Languages (MURIL) model, to produce SOTA performance on Indic text classification tasks. We were able to achieve a mean F1-score of 89.286 on the test data, an improvement over baseline MURIL model with a F1-score of 87.48.
△ Less
Submitted 21 June, 2022;
originally announced June 2022.
-
Machine Learning in Sports: A Case Study on Using Explainable Models for Predicting Outcomes of Volleyball Matches
Authors:
Abhinav Lalwani,
Aman Saraiya,
Apoorv Singh,
Aditya Jain,
Tirtharaj Dash
Abstract:
Machine Learning has become an integral part of engineering design and decision making in several domains, including sports. Deep Neural Networks (DNNs) have been the state-of-the-art methods for predicting outcomes of professional sports events. However, apart from getting highly accurate predictions on these sports events outcomes, it is necessary to answer questions such as "Why did the model p…
▽ More
Machine Learning has become an integral part of engineering design and decision making in several domains, including sports. Deep Neural Networks (DNNs) have been the state-of-the-art methods for predicting outcomes of professional sports events. However, apart from getting highly accurate predictions on these sports events outcomes, it is necessary to answer questions such as "Why did the model predict that Team A would win Match X against Team B?" DNNs are inherently black-box in nature. Therefore, it is required to provide high-quality interpretable, and understandable explanations for a model's prediction in sports. This paper explores a two-phased Explainable Artificial Intelligence(XAI) approach to predict outcomes of matches in the Brazilian volleyball League (SuperLiga). In the first phase, we directly use the interpretable rule-based ML models that provide a global understanding of the model's behaviors based on Boolean Rule Column Generation (BRCG; extracts simple AND-OR classification rules) and Logistic Regression (LogReg; allows to estimate the feature importance scores). In the second phase, we construct non-linear models such as Support Vector Machine (SVM) and Deep Neural Network (DNN) to obtain predictive performance on the volleyball matches' outcomes. We construct the "post-hoc" explanations for each data instance using ProtoDash, a method that finds prototypes in the training dataset that are most similar to the test instance, and SHAP, a method that estimates the contribution of each feature on the model's prediction. We evaluate the SHAP explanations using the faithfulness metric. Our results demonstrate the effectiveness of the explanations for the model's predictions.
△ Less
Submitted 18 June, 2022;
originally announced June 2022.
-
High Density Vertical Optical Interconnects for Passive Assembly
Authors:
Drew Weninger,
Samuel Serna,
Achint Jain,
Lionel Kimerling,
Anuradha Agarwal
Abstract:
The co-packaging of optics and electronics provides a potential path forward to achieving beyond 50 Tbps top of rack switch packages. In a co-packaged design, the scaling of bandwidth, cost, and energy is governed by the number of optical transceivers (TxRx) per package as opposed to transistor shrink. Due to the large footprint of optical components relative to their electronic counterparts, the…
▽ More
The co-packaging of optics and electronics provides a potential path forward to achieving beyond 50 Tbps top of rack switch packages. In a co-packaged design, the scaling of bandwidth, cost, and energy is governed by the number of optical transceivers (TxRx) per package as opposed to transistor shrink. Due to the large footprint of optical components relative to their electronic counterparts, the vertical stacking of optical TxRx chips in a co-packaged optics design will become a necessity. As a result, development of efficient, dense, and wide alignment tolerance chip-to-chip optical couplers will be an enabling technology for continued TxRx scaling. In this paper, we propose a novel scheme to vertically couple into standard 220 nm silicon on insulator waveguides from 220 nm silicon nitride on glass waveguides using overlapping, inverse double tapers. Simulation results using Lumerical's 3D Finite Difference Time Domain solver solver are presented, demonstrating insertion losses below -0.13 dB for an inter-chip spacing of 1 $μ$m, 1 dB vertical and lateral alignment tolerances of approximately $\pm$ 2.7 $μ$m, a greater than 300 nm 1 dB bandwidth, and 1 dB twist and tilt tolerance of approximately 2.3 degrees and 0.4 degrees, respectively. These results demonstrate the potential of our coupler for use in co-packaged designs requiring high performance, high density, CMOS compatible out of plane optical connections.
△ Less
Submitted 18 June, 2022;
originally announced June 2022.
-
XLCoST: A Benchmark Dataset for Cross-lingual Code Intelligence
Authors:
Ming Zhu,
Aneesh Jain,
Karthik Suresh,
Roshan Ravindran,
Sindhu Tipirneni,
Chandan K. Reddy
Abstract:
Recent advances in machine learning have significantly improved the understanding of source code data and achieved good performance on a number of downstream tasks. Open source repositories like GitHub enable this process with rich unlabeled code data. However, the lack of high quality labeled data has largely hindered the progress of several code related tasks, such as program translation, summar…
▽ More
Recent advances in machine learning have significantly improved the understanding of source code data and achieved good performance on a number of downstream tasks. Open source repositories like GitHub enable this process with rich unlabeled code data. However, the lack of high quality labeled data has largely hindered the progress of several code related tasks, such as program translation, summarization, synthesis, and code search. This paper introduces XLCoST, Cross-Lingual Code SnippeT dataset, a new benchmark dataset for cross-lingual code intelligence. Our dataset contains fine-grained parallel data from 8 languages (7 commonly used programming languages and English), and supports 10 cross-lingual code tasks. To the best of our knowledge, it is the largest parallel dataset for source code both in terms of size and the number of languages. We also provide the performance of several state-of-the-art baseline models for each task. We believe this new dataset can be a valuable asset for the research community and facilitate the development and validation of new methods for cross-lingual code intelligence.
△ Less
Submitted 16 June, 2022;
originally announced June 2022.
-
A Closer Look at Smoothness in Domain Adversarial Training
Authors:
Harsh Rangwani,
Sumukh K Aithal,
Mayank Mishra,
Arihant Jain,
R. Venkatesh Babu
Abstract:
Domain adversarial training has been ubiquitous for achieving invariant representations and is used widely for various domain adaptation tasks. In recent times, methods converging to smooth optima have shown improved generalization for supervised learning tasks like classification. In this work, we analyze the effect of smoothness enhancing formulations on domain adversarial training, the objectiv…
▽ More
Domain adversarial training has been ubiquitous for achieving invariant representations and is used widely for various domain adaptation tasks. In recent times, methods converging to smooth optima have shown improved generalization for supervised learning tasks like classification. In this work, we analyze the effect of smoothness enhancing formulations on domain adversarial training, the objective of which is a combination of task loss (eg. classification, regression, etc.) and adversarial terms. We find that converging to a smooth minima with respect to (w.r.t.) task loss stabilizes the adversarial training leading to better performance on target domain. In contrast to task loss, our analysis shows that converging to smooth minima w.r.t. adversarial loss leads to sub-optimal generalization on the target domain. Based on the analysis, we introduce the Smooth Domain Adversarial Training (SDAT) procedure, which effectively enhances the performance of existing domain adversarial methods for both classification and object detection tasks. Our analysis also provides insight into the extensive usage of SGD over Adam in the community for domain adversarial training.
△ Less
Submitted 16 June, 2022;
originally announced June 2022.
-
Compositional noise in nozzles with dissipation
Authors:
Animesh Jain,
Luca Magri
Abstract:
We propose a physical model to predict indirect noise generated by the acceleration of compositional inhomogeneities in nozzles with viscous dissipation (non-isentropic nozzles). First, we derive the quasi-one-dimensional equations from the conservation laws of multicomponent flows. Second, we validate the proposed model with the experimental data available in the literature for binary mixtures of…
▽ More
We propose a physical model to predict indirect noise generated by the acceleration of compositional inhomogeneities in nozzles with viscous dissipation (non-isentropic nozzles). First, we derive the quasi-one-dimensional equations from the conservation laws of multicomponent flows. Second, we validate the proposed model with the experimental data available in the literature for binary mixtures of four gases. Third, we calculate the nozzle transfer functions for different Helmholtz numbers and friction factors, in both subsonic and supersonic flows with/without shock waves. We show that friction has a significant effect on the generation of indirect noise, for which the physical mechanism is identified and explained. Fourth, we find a semi-analytical solution with path integrals, which provide an asymptotic expansion with respect to the Helmholtz number. Fifth, we introduce the compositional noise scaling factor, which is applied to quickly estimate compositional noise from the knowledge of only one single-component gas transfer function. The approximation error is less than $1\%$. The proposed low-order model provides accurate estimates of the transfer functions and physical insight into indirect noise for multicomponent gases. This opens up new possibilities to accurately predict, and understand, sound generation in gas turbines.
△ Less
Submitted 4 May, 2023; v1 submitted 14 June, 2022;
originally announced June 2022.
-
Creep in Rotating Composite Disk having Variable Thickness Subjected to Thermal as well as Particle Gradient
Authors:
Harjot Kaur,
Nishi Gupta,
Anjali Jain
Abstract:
The motivation behind this paper is to present the effect of thermal and particle gradient in rotating composite disk with variable thickness using Sherby law. The values of tangential, radial stresses and strain rates are calculated at different radius using mathematical modeling. It has been observed that with increase in the variable thickness and particle gradient the stresses and strain rates…
▽ More
The motivation behind this paper is to present the effect of thermal and particle gradient in rotating composite disk with variable thickness using Sherby law. The values of tangential, radial stresses and strain rates are calculated at different radius using mathematical modeling. It has been observed that with increase in the variable thickness and particle gradient the stresses and strain rates decrease and determined that the creep deformation decreases with fluctuating thickness.
△ Less
Submitted 1 June, 2022;
originally announced June 2022.
-
AFIA: ATPG-Guided Fault Injection Attack on Secure Logic Locking
Authors:
Yadi Zhong,
Ayush Jain,
M. Tanjidur Rahman,
Navid Asadizanjani,
Jiafeng Xie,
Ujjwal Guin
Abstract:
The outsourcing of the design and manufacturing of integrated circuits has raised severe concerns about the piracy of Intellectual Properties and illegal overproduction. Logic locking has emerged as an obfuscation technique to protect outsourced chip designs, where the circuit netlist is locked and can only be functional once a secure key is programmed. However, Boolean Satisfiability-based attack…
▽ More
The outsourcing of the design and manufacturing of integrated circuits has raised severe concerns about the piracy of Intellectual Properties and illegal overproduction. Logic locking has emerged as an obfuscation technique to protect outsourced chip designs, where the circuit netlist is locked and can only be functional once a secure key is programmed. However, Boolean Satisfiability-based attacks have shown to break logic locking, simultaneously motivating researchers to develop more secure countermeasures. In this paper, we present a novel fault injection attack to break any locking technique that relies on a stored secret key, and denote this attack as AFIA, ATPG-guided Fault Injection Attack. The proposed attack is based on sensitizing a key bit to the primary output while injecting faults at a few other key lines that block the propagation of the targeted key bit. AIFA is very effective in determining a key bit as there exists a stuck-at fault pattern that detects a stuck-at 1 (or stuck-at 0) fault at any key line. The average complexity of number of injected faults for AFIA is linear with the key size and requires only |K| test patterns to determine a secret key, K. AFIA requires a fewer number of injected faults to sensitize a bit to the primary output, compared to 2|K|-1 faults for the differential fault analysis attack [26].
△ Less
Submitted 12 October, 2022; v1 submitted 9 June, 2022;
originally announced June 2022.
-
New Strong Gravitational Lenses from the DESI Legacy Imaging Surveys Data Release 9
Authors:
C. Storfer,
X. Huang,
A. Gu,
W. Sheu,
S. Banka,
A. Dey,
A. Jain,
J. Kwon,
D. Lang,
V. Lee,
A. Meisner,
J. Moustakas,
A. D. Myers,
S. Tabares-Tarquinio,
E. F. Schlafly,
D. J. Schlegel
Abstract:
We have conducted a search for strong gravitational lensing systems in the Dark Energy Spectroscopic Instrument (DESI) Legacy Imaging Surveys Data Release 9. This is the third paper in a series (following Huang et al. 2020; Huang et al. 2021, Paper I & II, respectively). These surveys together cover $\sim$ 19,000 deg$^2$ visible from the northern hemisphere, reaching a z-band AB magnitude of…
▽ More
We have conducted a search for strong gravitational lensing systems in the Dark Energy Spectroscopic Instrument (DESI) Legacy Imaging Surveys Data Release 9. This is the third paper in a series (following Huang et al. 2020; Huang et al. 2021, Paper I & II, respectively). These surveys together cover $\sim$ 19,000 deg$^2$ visible from the northern hemisphere, reaching a z-band AB magnitude of $\sim$ 22.5. We use a deep residual neural network, trained on a compilation of known lensing systems and candidates as well as non-lenses in the same footprint. After applying our trained neural networks to the survey data, we visually inspect and rank images with probabilities above a threshold. We have found 1895 lens candidates. Out of these, 1512 are identified for the first time. Combining the discoveries from this work, Paper I (335) and II (1210), the total number of strong lens candidates from the Legacy Surveys that we have discovered is 3057.
△ Less
Submitted 26 April, 2023; v1 submitted 6 June, 2022;
originally announced June 2022.
-
Benchmark of DNN Model Search at Deployment Time
Authors:
Lixi Zhou,
Arindam Jain,
Zijie Wang,
Amitabh Das,
Yingzhen Yang,
Jia Zou
Abstract:
Deep learning has become the most popular direction in machine learning and artificial intelligence. However, the preparation of training data, as well as model training, are often time-consuming and become the bottleneck of the end-to-end machine learning lifecycle. Reusing models for inferring a dataset can avoid the costs of retraining. However, when there are multiple candidate models, it is c…
▽ More
Deep learning has become the most popular direction in machine learning and artificial intelligence. However, the preparation of training data, as well as model training, are often time-consuming and become the bottleneck of the end-to-end machine learning lifecycle. Reusing models for inferring a dataset can avoid the costs of retraining. However, when there are multiple candidate models, it is challenging to discover the right model for reuse. Although there exist a number of model sharing platforms such as ModelDB, TensorFlow Hub, PyTorch Hub, and DLHub, most of these systems require model uploaders to manually specify the details of each model and model downloaders to screen keyword search results for selecting a model. We are lacking a highly productive model search tool that selects models for deployment without the need for any manual inspection and/or labeled data from the target domain. This paper proposes multiple model search strategies including various similarity-based approaches and non-similarity-based approaches. We design, implement, and evaluate these approaches on multiple model inference scenarios, including activity recognition, image recognition, text classification, natural language processing, and entity matching. The experimental evaluation showed that our proposed asymmetric similarity-based measurement, adaptivity, outperformed symmetric similarity-based measurements and non-similarity-based measurements in most of the workloads.
△ Less
Submitted 31 May, 2022;
originally announced June 2022.
-
QADAM: Quantization-Aware DNN Accelerator Modeling for Pareto-Optimality
Authors:
Ahmet Inci,
Siri Garudanagiri Virupaksha,
Aman Jain,
Venkata Vivek Thallam,
Ruizhou Ding,
Diana Marculescu
Abstract:
As the machine learning and systems communities strive to achieve higher energy-efficiency through custom deep neural network (DNN) accelerators, varied bit precision or quantization levels, there is a need for design space exploration frameworks that incorporate quantization-aware processing elements (PE) into the accelerator design space while having accurate and fast power, performance, and are…
▽ More
As the machine learning and systems communities strive to achieve higher energy-efficiency through custom deep neural network (DNN) accelerators, varied bit precision or quantization levels, there is a need for design space exploration frameworks that incorporate quantization-aware processing elements (PE) into the accelerator design space while having accurate and fast power, performance, and area models. In this work, we present QADAM, a highly parameterized quantization-aware power, performance, and area modeling framework for DNN accelerators. Our framework can facilitate future research on design space exploration and Pareto-efficiency of DNN accelerators for various design choices such as bit precision, PE type, scratchpad sizes of PEs, global buffer size, number of total PEs, and DNN configurations. Our results show that different bit precisions and PE types lead to significant differences in terms of performance per area and energy. Specifically, our framework identifies a wide range of design points where performance per area and energy varies more than 5x and 35x, respectively. We also show that the proposed lightweight processing elements (LightPEs) consistently achieve Pareto-optimal results in terms of accuracy and hardware-efficiency. With the proposed framework, we show that LightPEs achieve on par accuracy results and up to 5.7x more performance per area and energy improvement when compared to the best INT16 based design.
△ Less
Submitted 20 May, 2022;
originally announced May 2022.
-
Superconformal invariants and spinning correlators in 3d $\cal{N}=2$ SCFTs
Authors:
Aditya Jain,
Amin A. Nizami
Abstract:
We construct superconformal invariants in superspace which are used to build 3-point correlators of spinning operators in general $\cal{N}=2$ superconformal field theories in three dimensions. Our systematic analysis includes various relations between these invariants and provides a minimal set of parity-even and parity-odd invariants which is further used to construct general 3-point functions in…
▽ More
We construct superconformal invariants in superspace which are used to build 3-point correlators of spinning operators in general $\cal{N}=2$ superconformal field theories in three dimensions. Our systematic analysis includes various relations between these invariants and provides a minimal set of parity-even and parity-odd invariants which is further used to construct general 3-point functions in any 3d $\cal{N}=2$ SCFT. For conserved (super)currents, we explicitly compute various 3-point functions using Wick contractions in the free field case, and express them in terms of the constructed parity-even invariants. We give evidence through examples for the claim that the 3-point function of conserved currents generally comprises of two parts - a parity-even piece coming from the free theory, and a parity-odd piece.
△ Less
Submitted 21 December, 2022; v1 submitted 23 May, 2022;
originally announced May 2022.
-
Unsupervised Learning of Depth, Camera Pose and Optical Flow from Monocular Video
Authors:
Dipan Mandal,
Abhilash Jain
Abstract:
We propose DFPNet -- an unsupervised, joint learning system for monocular Depth, Optical Flow and egomotion (Camera Pose) estimation from monocular image sequences. Due to the nature of 3D scene geometry these three components are coupled. We leverage this fact to jointly train all the three components in an end-to-end manner. A single composite loss function -- which involves image reconstruction…
▽ More
We propose DFPNet -- an unsupervised, joint learning system for monocular Depth, Optical Flow and egomotion (Camera Pose) estimation from monocular image sequences. Due to the nature of 3D scene geometry these three components are coupled. We leverage this fact to jointly train all the three components in an end-to-end manner. A single composite loss function -- which involves image reconstruction-based loss for depth & optical flow, bidirectional consistency checks and smoothness loss components -- is used to train the network. Using hyperparameter tuning, we are able to reduce the model size to less than 5% (8.4M parameters) of state-of-the-art DFP models. Evaluation on KITTI and Cityscapes driving datasets reveals that our model achieves results comparable to state-of-the-art in all of the three tasks, even with the significantly smaller model size.
△ Less
Submitted 11 October, 2022; v1 submitted 19 May, 2022;
originally announced May 2022.
-
SDS-200: A Swiss German Speech to Standard German Text Corpus
Authors:
Michel Plüss,
Manuela Hürlimann,
Marc Cuny,
Alla Stöckli,
Nikolaos Kapotis,
Julia Hartmann,
Malgorzata Anna Ulasik,
Christian Scheller,
Yanick Schraner,
Amit Jain,
Jan Deriu,
Mark Cieliebak,
Manfred Vogel
Abstract:
We present SDS-200, a corpus of Swiss German dialectal speech with Standard German text translations, annotated with dialect, age, and gender information of the speakers. The dataset allows for training speech translation, dialect recognition, and speech synthesis systems, among others. The data was collected using a web recording tool that is open to the public. Each participant was given a text…
▽ More
We present SDS-200, a corpus of Swiss German dialectal speech with Standard German text translations, annotated with dialect, age, and gender information of the speakers. The dataset allows for training speech translation, dialect recognition, and speech synthesis systems, among others. The data was collected using a web recording tool that is open to the public. Each participant was given a text in Standard German and asked to translate it to their Swiss German dialect before recording it. To increase the corpus quality, recordings were validated by other participants. The data consists of 200 hours of speech by around 4000 different speakers and covers a large part of the Swiss-German dialect landscape. We release SDS-200 alongside a baseline speech translation model, which achieves a word error rate (WER) of 30.3 and a BLEU score of 53.1 on the SDS-200 test set. Furthermore, we use SDS-200 to fine-tune a pre-trained XLS-R model, achieving 21.6 WER and 64.0 BLEU.
△ Less
Submitted 19 May, 2022;
originally announced May 2022.
-
On Demographic Bias in Fingerprint Recognition
Authors:
Akash Godbole,
Steven A. Grosz,
Karthik Nandakumar,
Anil K. Jain
Abstract:
Fingerprint recognition systems have been deployed globally in numerous applications including personal devices, forensics, law enforcement, banking, and national identity systems. For these systems to be socially acceptable and trustworthy, it is critical that they perform equally well across different demographic groups. In this work, we propose a formal statistical framework to test for the exi…
▽ More
Fingerprint recognition systems have been deployed globally in numerous applications including personal devices, forensics, law enforcement, banking, and national identity systems. For these systems to be socially acceptable and trustworthy, it is critical that they perform equally well across different demographic groups. In this work, we propose a formal statistical framework to test for the existence of bias (demographic differentials) in fingerprint recognition across four major demographic groups (white male, white female, black male, and black female) for two state-of-the-art (SOTA) fingerprint matchers operating in verification and identification modes. Experiments on two different fingerprint databases (with 15,468 and 1,014 subjects) show that demographic differentials in SOTA fingerprint recognition systems decrease as the matcher accuracy increases and any small bias that may be evident is likely due to certain outlier, low-quality fingerprint images.
△ Less
Submitted 19 May, 2022;
originally announced May 2022.
-
QAPPA: Quantization-Aware Power, Performance, and Area Modeling of DNN Accelerators
Authors:
Ahmet Inci,
Siri Garudanagiri Virupaksha,
Aman Jain,
Venkata Vivek Thallam,
Ruizhou Ding,
Diana Marculescu
Abstract:
As the machine learning and systems community strives to achieve higher energy-efficiency through custom DNN accelerators and model compression techniques, there is a need for a design space exploration framework that incorporates quantization-aware processing elements into the accelerator design space while having accurate and fast power, performance, and area models. In this work, we present QAP…
▽ More
As the machine learning and systems community strives to achieve higher energy-efficiency through custom DNN accelerators and model compression techniques, there is a need for a design space exploration framework that incorporates quantization-aware processing elements into the accelerator design space while having accurate and fast power, performance, and area models. In this work, we present QAPPA, a highly parameterized quantization-aware power, performance, and area modeling framework for DNN accelerators. Our framework can facilitate the future research on design space exploration of DNN accelerators for various design choices such as bit precision, processing element type, scratchpad sizes of processing elements, global buffer size, device bandwidth, number of total processing elements in the the design, and DNN workloads. Our results show that different bit precisions and processing element types lead to significant differences in terms of performance per area and energy. Specifically, our proposed lightweight processing elements achieve up to 4.9x more performance per area and energy improvement when compared to INT16 based implementation.
△ Less
Submitted 17 May, 2022;
originally announced May 2022.
-
Renormalization-group improved Higgs to two gluons decay rate
Authors:
Gauhar Abbas,
Astha Jain,
Vartika Singh,
Neelam Singh
Abstract:
We investigate the renormalization-group scale and scheme dependence of the $H \rightarrow gg$ decay rate at the order N$^4$LO in the renormalization-group summed perturbative theory, which employs the summation of all renormalization-group accessible logarithms including the leading and subsequent four sub-leading logarithmic contributions to the full perturbative series expansion. Moreover, we s…
▽ More
We investigate the renormalization-group scale and scheme dependence of the $H \rightarrow gg$ decay rate at the order N$^4$LO in the renormalization-group summed perturbative theory, which employs the summation of all renormalization-group accessible logarithms including the leading and subsequent four sub-leading logarithmic contributions to the full perturbative series expansion. Moreover, we study the higher-order behaviour of the $H \rightarrow gg$ decay width using the asymptotic Padé approximant method in four different renormalization schemes. Furthermore, the higher-order behaviour is independently investigated in the framework of the asymptotic Padé-Borel approximant method where generalized Borel-transform is used as an analytic continuation of the original perturbative expansion. The predictions of the asymptotic Padé-Borel approximant method are found to be in agreement with that of the asymptotic Padé approximant method. Finally, we provide the $H \rightarrow gg$ decay rate at the order N$^5$LO in the fixed-order $ Γ_{\rm N^5LO} \,=\, Γ_0 (1.8375 \pm 0.047 _{α_s(M_Z),1\%}\pm 0.0004_{M_t} \pm 0.0066_{M_H}
\pm 0.0036_{\rm P} \pm 0.007_{\text{s}} \pm 0.0005_{sc} ),$ and $Γ_{\rm RGSN^5LO} \,=\, Γ_0 (1.841 \pm 0.047 _{α_s(M_Z),1\%} \pm 0.0005_{M_t}\pm 0.0066_{M_H} \pm 0.0002_μ \pm 0.0027_{\rm P} \pm 0.001_{sc} )$ in the renormalization-group summed perturbative theories.
△ Less
Submitted 19 January, 2024; v1 submitted 12 May, 2022;
originally announced May 2022.
-
NER-MQMRC: Formulating Named Entity Recognition as Multi Question Machine Reading Comprehension
Authors:
Anubhav Shrimal,
Avi Jain,
Kartik Mehta,
Promod Yenigalla
Abstract:
NER has been traditionally formulated as a sequence labeling task. However, there has been recent trend in posing NER as a machine reading comprehension task (Wang et al., 2020; Mengge et al., 2020), where entity name (or other information) is considered as a question, text as the context and entity value in text as answer snippet. These works consider MRC based on a single question (entity) at a…
▽ More
NER has been traditionally formulated as a sequence labeling task. However, there has been recent trend in posing NER as a machine reading comprehension task (Wang et al., 2020; Mengge et al., 2020), where entity name (or other information) is considered as a question, text as the context and entity value in text as answer snippet. These works consider MRC based on a single question (entity) at a time. We propose posing NER as a multi-question MRC task, where multiple questions (one question per entity) are considered at the same time for a single text. We propose a novel BERT-based multi-question MRC (NER-MQMRC) architecture for this formulation. NER-MQMRC architecture considers all entities as input to BERT for learning token embeddings with self-attention and leverages BERT-based entity representation for further improving these token embeddings for NER task. Evaluation on three NER datasets show that our proposed architecture leads to average 2.5 times faster training and 2.3 times faster inference as compared to NER-SQMRC framework based models by considering all entities together in a single pass. Further, we show that our model performance does not degrade compared to single-question based MRC (NER-SQMRC) (Devlin et al., 2019) leading to F1 gain of +0.41%, +0.32% and +0.27% for AE-Pub, Ecommerce5PT and Twitter datasets respectively. We propose this architecture primarily to solve large scale e-commerce attribute (or entity) extraction from unstructured text of a magnitude of 50k+ attributes to be extracted on a scalable production environment with high performance and optimised training and inference runtimes.
△ Less
Submitted 12 May, 2022;
originally announced May 2022.
-
International cooperation and competition in orbit-use management
Authors:
Aditya Jain,
Akhil Rao
Abstract:
Orbit-use management efforts can be structured as binding national regulatory policies or as self-enforcing international treaties. New treaties to control space debris growth appear unlikely in the near future. Spacefaring nations can pursue national regulatory policies, though regulatory competition and open access to orbit make their effectiveness unclear. We develop a game-theoretic model of n…
▽ More
Orbit-use management efforts can be structured as binding national regulatory policies or as self-enforcing international treaties. New treaties to control space debris growth appear unlikely in the near future. Spacefaring nations can pursue national regulatory policies, though regulatory competition and open access to orbit make their effectiveness unclear. We develop a game-theoretic model of national regulatory policies and self-enforcing international treaties for orbit-use management in the face of open access, regulatory competition, and catastrophe. While open access limits the effectiveness of national policies, market-access control ensures the policies can improve environmental quality. A large enough stock of legacy debris ensures existence of a global regulatory equilibrium where all nations choose to levy environmental regulations on all satellites. The global regulatory equilibrium supports a self-enforcing treaty to avert catastrophe by making it costlier to leave the treaty and free ride.
△ Less
Submitted 10 September, 2022; v1 submitted 8 May, 2022;
originally announced May 2022.
-
Fingerprint Template Invertibility: Minutiae vs. Deep Templates
Authors:
Kanishka P. Wijewardena,
Steven A. Grosz,
Kai Cao,
Anil K. Jain
Abstract:
Much of the success of fingerprint recognition is attributed to minutiae-based fingerprint representation. It was believed that minutiae templates could not be inverted to obtain a high fidelity fingerprint image, but this assumption has been shown to be false. The success of deep learning has resulted in alternative fingerprint representations (embeddings), in the hope that they might offer bette…
▽ More
Much of the success of fingerprint recognition is attributed to minutiae-based fingerprint representation. It was believed that minutiae templates could not be inverted to obtain a high fidelity fingerprint image, but this assumption has been shown to be false. The success of deep learning has resulted in alternative fingerprint representations (embeddings), in the hope that they might offer better recognition accuracy as well as non-invertibility of deep network-based templates. We evaluate whether deep fingerprint templates suffer from the same reconstruction attacks as the minutiae templates. We show that while a deep template can be inverted to produce a fingerprint image that could be matched to its source image, deep templates are more resistant to reconstruction attacks than minutiae templates. In particular, reconstructed fingerprint images from minutiae templates yield a TAR of about 100.0% (98.3%) @ FAR of 0.01% for type-I (type-II) attacks using a state-of-the-art commercial fingerprint matcher, when tested on NIST SD4. The corresponding attack performance for reconstructed fingerprint images from deep templates using the same commercial matcher yields a TAR of less than 1% for both type-I and type-II attacks; however, when the reconstructed images are matched using the same deep network, they achieve a TAR of 85.95% (68.10%) for type-I (type-II) attacks. Furthermore, what is missing from previous fingerprint template inversion studies is an evaluation of the black-box attack performance, which we perform using 3 different state-of-the-art fingerprint matchers. We conclude that fingerprint images generated by inverting minutiae templates are highly susceptible to both white-box and black-box attack evaluations, while fingerprint images generated by deep templates are resistant to black-box evaluations and comparatively less susceptible to white-box evaluations.
△ Less
Submitted 8 May, 2022;
originally announced May 2022.
-
Synthetic Point Cloud Generation for Class Segmentation Applications
Authors:
Maria Gonzalez Stefanelli,
Avi Rajesh Jain,
Sandeep Kamal Jalui,
Eva Agapaki
Abstract:
Maintenance of industrial facilities is a growing hazard due to the cumbersome process needed to identify infrastructure degradation. Digital Twins have the potential to improve maintenance by monitoring the continuous digital representation of infrastructure. However, the time needed to map the existing geometry makes their use prohibitive. We previously developed class segmentation algorithms to…
▽ More
Maintenance of industrial facilities is a growing hazard due to the cumbersome process needed to identify infrastructure degradation. Digital Twins have the potential to improve maintenance by monitoring the continuous digital representation of infrastructure. However, the time needed to map the existing geometry makes their use prohibitive. We previously developed class segmentation algorithms to automate digital twinning, however a vast amount of annotated point clouds is needed. Currently, synthetic data generation for automated segmentation is non-existent. We used Helios++ to automatically segment point clouds from 3D models. Our research has the potential to pave the ground for efficient industrial class segmentation.
△ Less
Submitted 7 May, 2022;
originally announced May 2022.
-
COGMEN: COntextualized GNN based Multimodal Emotion recognitioN
Authors:
Abhinav Joshi,
Ashwani Bhat,
Ayush Jain,
Atin Vikram Singh,
Ashutosh Modi
Abstract:
Emotions are an inherent part of human interactions, and consequently, it is imperative to develop AI systems that understand and recognize human emotions. During a conversation involving various people, a person's emotions are influenced by the other speaker's utterances and their own emotional state over the utterances. In this paper, we propose COntextualized Graph Neural Network based Multimod…
▽ More
Emotions are an inherent part of human interactions, and consequently, it is imperative to develop AI systems that understand and recognize human emotions. During a conversation involving various people, a person's emotions are influenced by the other speaker's utterances and their own emotional state over the utterances. In this paper, we propose COntextualized Graph Neural Network based Multimodal Emotion recognitioN (COGMEN) system that leverages local information (i.e., inter/intra dependency between speakers) and global information (context). The proposed model uses Graph Neural Network (GNN) based architecture to model the complex dependencies (local and global information) in a conversation. Our model gives state-of-the-art (SOTA) results on IEMOCAP and MOSEI datasets, and detailed ablation experiments show the importance of modeling information at both levels.
△ Less
Submitted 5 May, 2022;
originally announced May 2022.
-
PreMovNet: Pre-Movement EEG-based Hand Kinematics Estimation for Grasp and Lift task
Authors:
Anant Jain,
Lalan Kumar
Abstract:
Kinematics decoding from brain activity helps in developing rehabilitation or power-augmenting brain-computer interface devices. Low-frequency signals recorded from non-invasive electroencephalography (EEG) are associated with the neural motor correlation utilised for motor trajectory decoding (MTD). In this communication, the ability to decode motor kinematics trajectory from pre-movement delta-b…
▽ More
Kinematics decoding from brain activity helps in developing rehabilitation or power-augmenting brain-computer interface devices. Low-frequency signals recorded from non-invasive electroencephalography (EEG) are associated with the neural motor correlation utilised for motor trajectory decoding (MTD). In this communication, the ability to decode motor kinematics trajectory from pre-movement delta-band (0.5-3 Hz) EEG is investigated for the healthy participants. In particular, two deep learning-based neural decoders called PreMovNet-I and PreMovNet-II, are proposed that make use of motor-related neural information existing in the pre-movement EEG data. EEG data segments with various time lags of 150 ms, 200 ms, 250 ms, 300 ms, and 350 ms before the movement onset are utilised for the same. The MTD is presented for grasp-and-lift task (WAY-EEG-GAL dataset) using EEG with the various lags taken as input to the neural decoders. The performance of the proposed decoders are compared with the state-of-the-art multi-variable linear regression (mLR) model. Pearson correlation coefficient and hand trajectory are utilised as performance metric. The results demonstrate the viability of decoding 3D hand kinematics using pre-movement EEG data, enabling better control of BCI-based external devices such as exoskeleton/exosuit.
△ Less
Submitted 14 June, 2022; v1 submitted 2 May, 2022;
originally announced May 2022.
-
Dropout Inference with Non-Uniform Weight Scaling
Authors:
Zhaoyuan Yang,
Arpit Jain
Abstract:
Dropout as regularization has been used extensively to prevent overfitting for training neural networks. During training, units and their connections are randomly dropped, which could be considered as sampling many different submodels from the original model. At test time, weight scaling and Monte Carlo approximation are two widely applied approaches to approximate the outputs. Both approaches wor…
▽ More
Dropout as regularization has been used extensively to prevent overfitting for training neural networks. During training, units and their connections are randomly dropped, which could be considered as sampling many different submodels from the original model. At test time, weight scaling and Monte Carlo approximation are two widely applied approaches to approximate the outputs. Both approaches work well practically when all submodels are low-bias complex learners. However, in this work, we demonstrate scenarios where some submodels behave closer to high-bias models and a non-uniform weight scaling is a better approximation for inference.
△ Less
Submitted 27 April, 2022;
originally announced April 2022.
-
Dictionary Attacks on Speaker Verification
Authors:
Mirko Marras,
Pawel Korus,
Anubhav Jain,
Nasir Memon
Abstract:
In this paper, we propose dictionary attacks against speaker verification - a novel attack vector that aims to match a large fraction of speaker population by chance. We introduce a generic formulation of the attack that can be used with various speech representations and threat models. The attacker uses adversarial optimization to maximize raw similarity of speaker embeddings between a seed speec…
▽ More
In this paper, we propose dictionary attacks against speaker verification - a novel attack vector that aims to match a large fraction of speaker population by chance. We introduce a generic formulation of the attack that can be used with various speech representations and threat models. The attacker uses adversarial optimization to maximize raw similarity of speaker embeddings between a seed speech sample and a proxy population. The resulting master voice successfully matches a non-trivial fraction of people in an unknown population. Adversarial waveforms obtained with our approach can match on average 69% of females and 38% of males enrolled in the target system at a strict decision threshold calibrated to yield false alarm rate of 1%. By using the attack with a black-box voice cloning system, we obtain master voices that are effective in the most challenging conditions and transferable between speaker encoders. We also show that, combined with multiple attempts, this attack opens even more to serious issues on the security of these systems.
△ Less
Submitted 12 December, 2022; v1 submitted 24 April, 2022;
originally announced April 2022.
-
Text-mined dataset of gold nanoparticle synthesis procedures, morphologies, and size entities
Authors:
Kevin Cruse,
Amalie Trewartha,
Sanghoon Lee,
Zheren Wang,
Haoyan Huo,
Tanjin He,
Olga Kononova,
Anubhav Jain,
Gerbrand Ceder
Abstract:
Gold nanoparticles are highly desired for a range of technological applications due to their tunable properties, which are dictated by the size and shape of the constituent particles. Many heuristic methods for controlling the morphological characteristics of gold nanoparticles are well known. However, the underlying mechanisms controlling their size and shape remain poorly understood, partly due…
▽ More
Gold nanoparticles are highly desired for a range of technological applications due to their tunable properties, which are dictated by the size and shape of the constituent particles. Many heuristic methods for controlling the morphological characteristics of gold nanoparticles are well known. However, the underlying mechanisms controlling their size and shape remain poorly understood, partly due to the immense range of possible combinations of synthesis parameters. Data-driven methods can offer insight to help guide understanding of these underlying mechanisms, so long as sufficient synthesis data are available. To facilitate data mining in this direction, we have constructed and made publicly available a dataset of codified gold nanoparticle synthesis protocols and outcomes extracted directly from the nanoparticle materials science literature using natural language processing and text-mining techniques. This dataset contains 5,154 data records, each representing a single gold nanoparticle synthesis article, filtered from a database of 4,973,165 publications. Each record contains codified synthesis protocols and extracted morphological information from a total of 7,608 experimental and 12,519 characterization paragraphs.
△ Less
Submitted 21 April, 2022;
originally announced April 2022.
-
Machine-learning rationalization and prediction of solid-state synthesis conditions
Authors:
Haoyan Huo,
Christopher J. Bartel,
Tanjin He,
Amalie Trewartha,
Alexander Dunn,
Bin Ouyang,
Anubhav Jain,
Gerbrand Ceder
Abstract:
There currently exist no quantitative methods to determine the appropriate conditions for solid-state synthesis. This not only hinders the experimental realization of novel materials but also complicates the interpretation and understanding of solid-state reaction mechanisms. Here, we demonstrate a machine-learning approach that predicts synthesis conditions using large solid-state synthesis datas…
▽ More
There currently exist no quantitative methods to determine the appropriate conditions for solid-state synthesis. This not only hinders the experimental realization of novel materials but also complicates the interpretation and understanding of solid-state reaction mechanisms. Here, we demonstrate a machine-learning approach that predicts synthesis conditions using large solid-state synthesis datasets text-mined from scientific journal articles. Using feature importance ranking analysis, we discovered that optimal heating temperatures have strong correlations with the stability of precursor materials quantified using melting points and formation energies ($ΔG_f$, $ΔH_f$). In contrast, features derived from the thermodynamics of synthesis-related reactions did not directly correlate to the chosen heating temperatures. This correlation between optimal solid-state heating temperature and precursor stability extends Tamman's rule from intermetallics to oxide systems, suggesting the importance of reaction kinetics in determining synthesis conditions. Heating times are shown to be strongly correlated with the chosen experimental procedures and instrument setups, which may be indicative of human bias in the dataset. Using these predictive features, we constructed machine-learning models with good performance and general applicability to predict the conditions required to synthesize diverse chemical systems. Codes and data used in this work can be found at: https://github.com/CederGroupHub/s4.
△ Less
Submitted 5 August, 2022; v1 submitted 17 April, 2022;
originally announced April 2022.
-
Evaluating the Effectiveness of Corrective Demonstrations and a Low-Cost Sensor for Dexterous Manipulation
Authors:
Abhineet Jain,
Jack Kolb,
J. M. Abbess IV,
Harish Ravichandar
Abstract:
Imitation learning is a promising approach to help robots acquire dexterous manipulation capabilities without the need for a carefully-designed reward or a significant computational effort. However, existing imitation learning approaches require sophisticated data collection infrastructure and struggle to generalize beyond the training distribution. One way to address this limitation is to gather…
▽ More
Imitation learning is a promising approach to help robots acquire dexterous manipulation capabilities without the need for a carefully-designed reward or a significant computational effort. However, existing imitation learning approaches require sophisticated data collection infrastructure and struggle to generalize beyond the training distribution. One way to address this limitation is to gather additional data that better represents the full operating conditions. In this work, we investigate characteristics of such additional demonstrations and their impact on performance. Specifically, we study the effects of corrective and randomly-sampled additional demonstrations on learning a policy that guides a five-fingered robot hand through a pick-and-place task. Our results suggest that corrective demonstrations considerably outperform randomly-sampled demonstrations, when the proportion of additional demonstrations sampled from the full task distribution is larger than the number of original demonstrations sampled from a restrictive training distribution. Conversely, when the number of original demonstrations are higher than that of additional demonstrations, we find no significant differences between corrective and randomly-sampled additional demonstrations. These results provide insights into the inherent trade-off between the effort required to collect corrective demonstrations and their relative benefits over randomly-sampled demonstrations. Additionally, we show that inexpensive vision-based sensors, such as LeapMotion, can be used to dramatically reduce the cost of providing demonstrations for dexterous manipulation tasks. Our code is available at https://github.com/GT-STAR-Lab/corrective-demos-dexterous-manipulation.
△ Less
Submitted 15 April, 2022;
originally announced April 2022.
-
SpoofGAN: Synthetic Fingerprint Spoof Images
Authors:
Steven A. Grosz,
Anil K. Jain
Abstract:
A major limitation to advances in fingerprint spoof detection is the lack of publicly available, large-scale fingerprint spoof datasets, a problem which has been compounded by increased concerns surrounding privacy and security of biometric data. Furthermore, most state-of-the-art spoof detection algorithms rely on deep networks which perform best in the presence of a large amount of training data…
▽ More
A major limitation to advances in fingerprint spoof detection is the lack of publicly available, large-scale fingerprint spoof datasets, a problem which has been compounded by increased concerns surrounding privacy and security of biometric data. Furthermore, most state-of-the-art spoof detection algorithms rely on deep networks which perform best in the presence of a large amount of training data. This work aims to demonstrate the utility of synthetic (both live and spoof) fingerprints in supplying these algorithms with sufficient data to improve the performance of fingerprint spoof detection algorithms beyond the capabilities when training on a limited amount of publicly available real datasets. First, we provide details of our approach in modifying a state-of-the-art generative architecture to synthesize high quality live and spoof fingerprints. Then, we provide quantitative and qualitative analysis to verify the quality of our synthetic fingerprints in mimicking the distribution of real data samples. We showcase the utility of our synthetic live and spoof fingerprints in training a deep network for fingerprint spoof detection, which dramatically boosts the performance across three different evaluation datasets compared to an identical model trained on real data alone. Finally, we demonstrate that only 25% of the original (real) dataset is required to obtain similar detection performance when augmenting the training dataset with synthetic data.
△ Less
Submitted 15 April, 2022; v1 submitted 13 April, 2022;
originally announced April 2022.
-
Towards Painless Policy Optimization for Constrained MDPs
Authors:
Arushi Jain,
Sharan Vaswani,
Reza Babanezhad,
Csaba Szepesvari,
Doina Precup
Abstract:
We study policy optimization in an infinite horizon, $γ$-discounted constrained Markov decision process (CMDP). Our objective is to return a policy that achieves large expected reward with a small constraint violation. We consider the online setting with linear function approximation and assume global access to the corresponding features. We propose a generic primal-dual framework that allows us t…
▽ More
We study policy optimization in an infinite horizon, $γ$-discounted constrained Markov decision process (CMDP). Our objective is to return a policy that achieves large expected reward with a small constraint violation. We consider the online setting with linear function approximation and assume global access to the corresponding features. We propose a generic primal-dual framework that allows us to bound the reward sub-optimality and constraint violation for arbitrary algorithms in terms of their primal and dual regret on online linear optimization problems. We instantiate this framework to use coin-betting algorithms and propose the Coin Betting Politex (CBP) algorithm. Assuming that the action-value functions are $\varepsilon_b$-close to the span of the $d$-dimensional state-action features and no sampling errors, we prove that $T$ iterations of CBP result in an $O\left(\frac{1}{(1 - γ)^3 \sqrt{T}} + \frac{\varepsilon_b\sqrt{d}}{(1 - γ)^2} \right)$ reward sub-optimality and an $O\left(\frac{1}{(1 - γ)^2 \sqrt{T}} + \frac{\varepsilon_b \sqrt{d}}{1 - γ} \right)$ constraint violation. Importantly, unlike gradient descent-ascent and other recent methods, CBP does not require extensive hyperparameter tuning. Via experiments on synthetic and Cartpole environments, we demonstrate the effectiveness and robustness of CBP.
△ Less
Submitted 11 April, 2022;
originally announced April 2022.
-
High-throughput computational discovery of 40 ultralow thermal conductivity and 20 highly anisotropic crystalline materials
Authors:
Ankit Jain,
Harish P Veeravenkata,
Shravan Godse,
Yagyank Srivastava
Abstract:
We performed ab-initio driven density functional theory-based high throughput computations to search for materials with low thermal conductivity and high thermal transport anisotropy. We shortlisted a pool of 429 stable ternary semiconductors from the Materials Project and obtained phonon thermal conductivity by solving the Boltzmann transport equation on 225 materials. We found the lowest thermal…
▽ More
We performed ab-initio driven density functional theory-based high throughput computations to search for materials with low thermal conductivity and high thermal transport anisotropy. We shortlisted a pool of 429 stable ternary semiconductors from the Materials Project and obtained phonon thermal conductivity by solving the Boltzmann transport equation on 225 materials. We found the lowest thermal conductivity of 0.16 W/m-K in SbRbK 2 and 40 materials with a thermal conductivity lower than 1 W/m-K at 300 K. For anisotropic thermal transport, we have identified six materials with anisotropy larger than 5 and 20 with thermal transport anisotropy higher than the largest reported literature value.
△ Less
Submitted 9 April, 2022; v1 submitted 7 April, 2022;
originally announced April 2022.
-
AdaFace: Quality Adaptive Margin for Face Recognition
Authors:
Minchul Kim,
Anil K. Jain,
Xiaoming Liu
Abstract:
Recognition in low quality face datasets is challenging because facial attributes are obscured and degraded. Advances in margin-based loss functions have resulted in enhanced discriminability of faces in the embedding space. Further, previous studies have studied the effect of adaptive losses to assign more importance to misclassified (hard) examples. In this work, we introduce another aspect of a…
▽ More
Recognition in low quality face datasets is challenging because facial attributes are obscured and degraded. Advances in margin-based loss functions have resulted in enhanced discriminability of faces in the embedding space. Further, previous studies have studied the effect of adaptive losses to assign more importance to misclassified (hard) examples. In this work, we introduce another aspect of adaptiveness in the loss function, namely the image quality. We argue that the strategy to emphasize misclassified samples should be adjusted according to their image quality. Specifically, the relative importance of easy or hard samples should be based on the sample's image quality. We propose a new loss function that emphasizes samples of different difficulties based on their image quality. Our method achieves this in the form of an adaptive margin function by approximating the image quality with feature norms. Extensive experiments show that our method, AdaFace, improves the face recognition performance over the state-of-the-art (SoTA) on four datasets (IJB-B, IJB-C, IJB-S and TinyFace). Code and models are released in https://github.com/mk-minchul/AdaFace.
△ Less
Submitted 15 February, 2023; v1 submitted 2 April, 2022;
originally announced April 2022.