Showing 151–200 of 485 results for author: Jain, P

Near-optimal Offline and Streaming Algorithms for Learning Non-Linear Dynamical Systems

Authors: Prateek Jain, Suhas S Kowshik, Dheeraj Nagaraj, Praneeth Netrapalli

Abstract: We consider the setting of vector valued non-linear dynamical systems $X_{t+1} = φ(A^* X_t) + η_t$, where $η_t$ is unbiased noise and $φ: \mathbb{R} \to \mathbb{R}$ is a known link function that satisfies certain {\em expansivity property}. The goal is to learn $A^*$ from a single trajectory $X_1,\cdots,X_T$ of {\em dependent or correlated} samples. While the problem is well-studied in the linear… ▽ More We consider the setting of vector valued non-linear dynamical systems $X_{t+1} = φ(A^* X_t) + η_t$, where $η_t$ is unbiased noise and $φ: \mathbb{R} \to \mathbb{R}$ is a known link function that satisfies certain {\em expansivity property}. The goal is to learn $A^*$ from a single trajectory $X_1,\cdots,X_T$ of {\em dependent or correlated} samples. While the problem is well-studied in the linear case, where $φ$ is identity, with optimal error rates even for non-mixing systems, existing results in the non-linear case hold only for mixing systems. In this work, we improve existing results for learning nonlinear systems in a number of ways: a) we provide the first offline algorithm that can learn non-linear dynamical systems without the mixing assumption, b) we significantly improve upon the sample complexity of existing results for mixing systems, c) in the much harder one-pass, streaming setting we study a SGD with Reverse Experience Replay ($\mathsf{SGD-RER}$) method, and demonstrate that for mixing systems, it achieves the same sample complexity as our offline algorithm, d) we justify the expansivity assumption by showing that for the popular ReLU link function -- a non-expansive but easy to learn link function with i.i.d. samples -- any method would require exponentially many samples (with respect to dimension of $X_t$) from the dynamical system. We validate our results via. simulations and demonstrate that a naive application of SGD can be highly sub-optimal. Indeed, our work demonstrates that for correlated data, specialized methods designed for the dependency structure in data can significantly outperform standard SGD based methods. △ Less

Submitted 1 December, 2021; v1 submitted 24 May, 2021; originally announced May 2021.

Sample Efficient Linear Meta-Learning by Alternating Minimization

Authors: Kiran Koshy Thekumparampil, Prateek Jain, Praneeth Netrapalli, Sewoong Oh

Abstract: Meta-learning synthesizes and leverages the knowledge from a given set of tasks to rapidly learn new tasks using very little data. Meta-learning of linear regression tasks, where the regressors lie in a low-dimensional subspace, is an extensively-studied fundamental problem in this domain. However, existing results either guarantee highly suboptimal estimation errors, or require $Ω(d)$ samples per… ▽ More Meta-learning synthesizes and leverages the knowledge from a given set of tasks to rapidly learn new tasks using very little data. Meta-learning of linear regression tasks, where the regressors lie in a low-dimensional subspace, is an extensively-studied fundamental problem in this domain. However, existing results either guarantee highly suboptimal estimation errors, or require $Ω(d)$ samples per task (where $d$ is the data dimensionality) thus providing little gain over separately learning each task. In this work, we study a simple alternating minimization method (MLLAM), which alternately learns the low-dimensional subspace and the regressors. We show that, for a constant subspace dimension MLLAM obtains nearly-optimal estimation error, despite requiring only $Ω(\log d)$ samples per task. However, the number of samples required per task grows logarithmically with the number of tasks. To remedy this in the low-noise regime, we propose a novel task subset selection scheme that ensures the same strong statistical guarantee as MLLAM, even with bounded number of samples per task for arbitrarily large number of tasks. △ Less

Submitted 18 May, 2021; originally announced May 2021.

Multilingual Knowledge Graph Completion with Joint Relation and Entity Alignment

Authors: Harkanwar Singh, Prachi Jain, Mausam, Soumen Chakrabarti

Abstract: Knowledge Graph Completion (KGC) predicts missing facts in an incomplete Knowledge Graph. Almost all of existing KGC research is applicable to only one KG at a time, and in one language only. However, different language speakers may maintain separate KGs in their language and no individual KG is expected to be complete. Moreover, common entities or relations in these KGs have different surface for… ▽ More Knowledge Graph Completion (KGC) predicts missing facts in an incomplete Knowledge Graph. Almost all of existing KGC research is applicable to only one KG at a time, and in one language only. However, different language speakers may maintain separate KGs in their language and no individual KG is expected to be complete. Moreover, common entities or relations in these KGs have different surface forms and IDs, leading to ID proliferation. Entity alignment (EA) and relation alignment (RA) tasks resolve this by recognizing pairs of entity (relation) IDs in different KGs that represent the same entity (relation). This can further help prediction of missing facts, since knowledge from one KG is likely to benefit completion of another. High confidence predictions may also add valuable information for the alignment tasks. In response, we study the novel task of jointly training multilingual KGC, relation alignment and entity alignment models. We present ALIGNKGC, which uses some seed alignments to jointly optimize all three of KGC, EA and RA losses. A key component of ALIGNKGC is an embedding based soft notion of asymmetric overlap defined on the (subject, object) set signatures of relations this aids in better predicting relations that are equivalent to or implied by other relations. Extensive experiments with DBPedia in five languages establish the benefits of joint training for all tasks, achieving 10-32 MRR improvements of ALIGNKGC over a strong state-of-the-art single-KGC system completion model over each monolingual KG . Further, ALIGNKGC achieves reasonable gains in EA and RA tasks over a vanilla completion model over a KG that combines all facts without alignment, underscoring the value of joint training for these tasks. △ Less

Submitted 18 April, 2021; originally announced April 2021.

Streaming Linear System Identification with Reverse Experience Replay

Authors: Prateek Jain, Suhas S Kowshik, Dheeraj Nagaraj, Praneeth Netrapalli

Abstract: We consider the problem of estimating a linear time-invariant (LTI) dynamical system from a single trajectory via streaming algorithms, which is encountered in several applications including reinforcement learning (RL) and time-series analysis. While the LTI system estimation problem is well-studied in the {\em offline} setting, the practically important streaming/online setting has received littl… ▽ More We consider the problem of estimating a linear time-invariant (LTI) dynamical system from a single trajectory via streaming algorithms, which is encountered in several applications including reinforcement learning (RL) and time-series analysis. While the LTI system estimation problem is well-studied in the {\em offline} setting, the practically important streaming/online setting has received little attention. Standard streaming methods like stochastic gradient descent (SGD) are unlikely to work since streaming points can be highly correlated. In this work, we propose a novel streaming algorithm, SGD with Reverse Experience Replay ($\mathsf{SGD}-\mathsf{RER}$), that is inspired by the experience replay (ER) technique popular in the RL literature. $\mathsf{SGD}-\mathsf{RER}$ divides data into small buffers and runs SGD backwards on the data stored in the individual buffers. We show that this algorithm exactly deconstructs the dependency structure and obtains information theoretically optimal guarantees for both parameter error and prediction error. Thus, we provide the first -- to the best of our knowledge -- optimal SGD-style algorithm for the classical problem of linear system identification with a first order oracle. Furthermore, $\mathsf{SGD}-\mathsf{RER}$ can be applied to more general settings like sparse LTI identification with known sparsity pattern, and non-linear dynamical systems. Our work demonstrates that the knowledge of data dependency structure can aid us in designing statistically and computationally efficient algorithms which can "decorrelate" streaming samples. △ Less

Submitted 1 December, 2021; v1 submitted 10 March, 2021; originally announced March 2021.

Log to log-log crossover of entanglement in $(1+1)-$ dimensional massive scalar field

Authors: Parul Jain, S. Mahesh Chandran, S. Shankaranarayanan

Abstract: We study three different measures of quantum correlations -- entanglement spectrum, entanglement entropy, and logarithmic negativity -- for (1+1)-dimensional massive scalar field in flat spacetime. The entanglement spectrum for the discretized scalar field in the ground state indicates a cross-over in the zero-mode regime, which is further substantiated by an analytical treatment of both entanglem… ▽ More We study three different measures of quantum correlations -- entanglement spectrum, entanglement entropy, and logarithmic negativity -- for (1+1)-dimensional massive scalar field in flat spacetime. The entanglement spectrum for the discretized scalar field in the ground state indicates a cross-over in the zero-mode regime, which is further substantiated by an analytical treatment of both entanglement entropy and logarithmic negativity. The exact nature of this cross-over depends on the boundary conditions used -- the leading order term switches from a $\log$ to $\log-\log$ behavior for the Periodic and Neumann boundary conditions. In contrast, for Dirichlet, it is the parameters within the leading $\log-\log$ term that are switched. We show that this cross-over manifests as a change in the behavior of the leading order divergent term for entanglement entropy and logarithmic negativity close to the zero-mode limit. We thus show that the two regimes have fundamentally different information content. Furthermore, an analysis of the ground state fidelity shows us that the region between critical point $Λ=0$ and the crossover point is dominated by zero-mode effects, featuring an explicit dependence on the IR cutoff of the system. For the reduced state of a single oscillator, we show that this cross-over occurs in the region $Nam_f\sim \mathscr{O}(1)$. △ Less

Submitted 19 May, 2021; v1 submitted 2 March, 2021; originally announced March 2021.

Comments: Version 2: 30 pages, 6 figures, 2 tables. One new section on ground state fidelity added. Conclusions unchanged. Version accepted in Phy. Rev. D

Journal ref: Phys. Rev. D 103, 125008 (2021)

Do Input Gradients Highlight Discriminative Features?

Authors: Harshay Shah, Prateek Jain, Praneeth Netrapalli

Abstract: Post-hoc gradient-based interpretability methods [Simonyan et al., 2013, Smilkov et al., 2017] that provide instance-specific explanations of model predictions are often based on assumption (A): magnitude of input gradients -- gradients of logits with respect to input -- noisily highlight discriminative task-relevant features. In this work, we test the validity of assumption (A) using a three-pron… ▽ More Post-hoc gradient-based interpretability methods [Simonyan et al., 2013, Smilkov et al., 2017] that provide instance-specific explanations of model predictions are often based on assumption (A): magnitude of input gradients -- gradients of logits with respect to input -- noisily highlight discriminative task-relevant features. In this work, we test the validity of assumption (A) using a three-pronged approach. First, we develop an evaluation framework, DiffROAR, to test assumption (A) on four image classification benchmarks. Our results suggest that (i) input gradients of standard models (i.e., trained on original data) may grossly violate (A), whereas (ii) input gradients of adversarially robust models satisfy (A). Second, we introduce BlockMNIST, an MNIST-based semi-real dataset, that by design encodes a priori knowledge of discriminative features. Our analysis on BlockMNIST leverages this information to validate as well as characterize differences between input gradient attributions of standard and robust models. Finally, we theoretically prove that our empirical findings hold on a simplified version of the BlockMNIST dataset. Specifically, we prove that input gradients of standard one-hidden-layer MLPs trained on this dataset do not highlight instance-specific signal coordinates, thus grossly violating assumption (A). Our findings motivate the need to formalize and test common assumptions in interpretability in a falsifiable manner [Leavitt and Morcos, 2020]. We believe that the DiffROAR evaluation framework and BlockMNIST-based datasets can serve as sanity checks to audit instance-specific interpretability methods; code and data available at https://github.com/harshays/inputgradients. △ Less

Submitted 26 October, 2021; v1 submitted 25 February, 2021; originally announced February 2021.

Comments: NeurIPS 2021

Gerrymandering on graphs: Computational complexity and parameterized algorithms

Authors: Sushmita Gupta, Pallavi Jain, Fahad Panolan, Sanjukta Roy, Saket Saurabh

Abstract: Partitioning a region into districts to favor a particular candidate or a party is commonly known as gerrymandering. In this paper, we investigate the gerrymandering problem in graph theoretic setting as proposed by Cohen-Zemach et al. [AAMAS 2018]. Our contributions in this article are two-fold, conceptual and computational. We first resolve the open question posed by Ito et al. [AAMAS 2019] abou… ▽ More Partitioning a region into districts to favor a particular candidate or a party is commonly known as gerrymandering. In this paper, we investigate the gerrymandering problem in graph theoretic setting as proposed by Cohen-Zemach et al. [AAMAS 2018]. Our contributions in this article are two-fold, conceptual and computational. We first resolve the open question posed by Ito et al. [AAMAS 2019] about the computational complexity of the problem when the input graph is a path. Next, we propose a generalization of their model, where the input consists of a graph on $n$ vertices representing the set of voters, a set of $m$ candidates $\mathcal{C}$, a weight function $w_v: \mathcal{C}\rightarrow {\mathbb Z}^+$ for each voter $v\in V(G)$ representing the preference of the voter over the candidates, a distinguished candidate $p\in \mathcal{C}$, and a positive integer $k$. The objective is to decide if one can partition the vertex set into $k$ pairwise disjoint connected sets (districts) s.t $p$ wins more districts than any other candidate. The problem is known to be NPC even if $k=2$, $m=2$, and $G$ is either a complete bipartite graph (in fact $K_{2,n}$) or a complete graph. This means that in search for FPT algorithms we need to either focus on the parameter $n$, or subclasses of forest. Circumventing these intractable results, we give a deterministic and a randomized algorithms for the problem on paths running in times $2.619^{k}(n+m)^{O(1)}$ and $2^{k}(n+m)^{O(1)}$, respectively. Additionally, we prove that the problem on general graphs is solvable in time $2^n (n+m)^{O(1)}$. Our algorithmic results use sophisticated technical tools such as representative set family and Fast Fourier transform based polynomial multiplication, and their (possibly first) application to problems arising in social choice theory and/or game theory may be of independent interest to the community. △ Less

Submitted 25 May, 2021; v1 submitted 19 February, 2021; originally announced February 2021.

Learning Accurate Decision Trees with Bandit Feedback via Quantized Gradient Descent

Authors: Ajaykrishna Karthikeyan, Naman Jain, Nagarajan Natarajan, Prateek Jain

Abstract: Decision trees provide a rich family of highly non-linear but efficient models, due to which they continue to be the go-to family of predictive models by practitioners across domains. But learning trees is challenging due to their discrete decision boundaries. The state-of-the-art (SOTA) techniques resort to (a) learning \textit{soft} trees thereby losing logarithmic inference time; or (b) using m… ▽ More Decision trees provide a rich family of highly non-linear but efficient models, due to which they continue to be the go-to family of predictive models by practitioners across domains. But learning trees is challenging due to their discrete decision boundaries. The state-of-the-art (SOTA) techniques resort to (a) learning \textit{soft} trees thereby losing logarithmic inference time; or (b) using methods tailored to specific supervised learning settings, requiring access to labeled examples and loss function. In this work, by leveraging techniques like overparameterization and straight-through estimators, we propose a unified method that enables accurate end-to-end gradient based tree training and can be deployed in a variety of settings like offline supervised learning and online learning with bandit feedback. Using extensive validation on standard benchmarks, we demonstrate that our method provides best of both worlds, i.e., it is competitive to, and in some cases more accurate than methods designed \textit{specifically} for the supervised settings; and in bandit settings, where most existing tree learning techniques are not applicable, our models are still accurate and significantly outperform the applicable SOTA methods. △ Less

Submitted 30 September, 2022; v1 submitted 15 February, 2021; originally announced February 2021.

Comments: Accepted to TMLR

Optimal Regret Algorithm for Pseudo-1d Bandit Convex Optimization

Authors: Aadirupa Saha, Nagarajan Natarajan, Praneeth Netrapalli, Prateek Jain

Abstract: We study online learning with bandit feedback (i.e. learner has access to only zeroth-order oracle) where cost/reward functions $\f_t$ admit a "pseudo-1d" structure, i.e. $\f_t(\w) = \loss_t(\pred_t(\w))$ where the output of $\pred_t$ is one-dimensional. At each round, the learner observes context $\x_t$, plays prediction $\pred_t(\w_t; \x_t)$ (e.g. $\pred_t(\cdot)=\langle \x_t, \cdot\rangle$) for… ▽ More We study online learning with bandit feedback (i.e. learner has access to only zeroth-order oracle) where cost/reward functions $\f_t$ admit a "pseudo-1d" structure, i.e. $\f_t(\w) = \loss_t(\pred_t(\w))$ where the output of $\pred_t$ is one-dimensional. At each round, the learner observes context $\x_t$, plays prediction $\pred_t(\w_t; \x_t)$ (e.g. $\pred_t(\cdot)=\langle \x_t, \cdot\rangle$) for some $\w_t \in \mathbb{R}^d$ and observes loss $\loss_t(\pred_t(\w_t))$ where $\loss_t$ is a convex Lipschitz-continuous function. The goal is to minimize the standard regret metric. This pseudo-1d bandit convex optimization problem (\SBCO) arises frequently in domains such as online decision-making or parameter-tuning in large systems. For this problem, we first show a lower bound of $\min(\sqrt{dT}, T^{3/4})$ for the regret of any algorithm, where $T$ is the number of rounds. We propose a new algorithm \sbcalg that combines randomized online gradient descent with a kernelized exponential weights method to exploit the pseudo-1d structure effectively, guaranteeing the {\em optimal} regret bound mentioned above, up to additional logarithmic factors. In contrast, applying state-of-the-art online convex optimization methods leads to $\tilde{O}\left(\min\left(d^{9.5}\sqrt{T},\sqrt{d}T^{3/4}\right)\right)$ regret, that is significantly suboptimal in $d$. △ Less

Submitted 15 February, 2021; originally announced February 2021.

Explaining Excess Dipole in NVSS Data Using Superhorizon Perturbation

Authors: Kaustav K. Das, Kishan Sankharva, Pankaj Jain

Abstract: Many observations in recent times have shown evidence against the standard assumption of isotropy in the Big Bang model. Introducing a superhorizon scalar metric perturbation has been able to explain some of these anomalies. In this work, we probe the net velocity arising due to the perturbation. We find that this extra component does not contribute to the CMB dipole amplitude while it does contri… ▽ More Many observations in recent times have shown evidence against the standard assumption of isotropy in the Big Bang model. Introducing a superhorizon scalar metric perturbation has been able to explain some of these anomalies. In this work, we probe the net velocity arising due to the perturbation. We find that this extra component does not contribute to the CMB dipole amplitude while it does contribute to the dipole in large scale structures. Thus, within this model's framework, our velocity with respect to the large scale structure is not the same as that extracted from the CMB dipole, assuming it to be of purely kinematic origin. Taking this extra velocity component into account, we study the superhorizon mode's implications for the excess dipole observed in the NRAO VLA Sky Survey (NVSS). We find that the mode can consistently explain both the CMB and NVSS observations. We also find that the model leads to small contributions to the local bulk flow and the dipole in Hubble parameter, which are consistent with observations. The model leads to several predictions which can be tested in future surveys. In particular, it implies that the observed dipole in large scale structure should be redshift dependent and should show an increase in amplitude with redshift. We also find that the Hubble parameter should show a dipole anisotropy whose amplitude must increase with redshift in the CMB frame. Similar anisotropic behaviour is expected for the observed redshift as a function of the luminosity distance. △ Less

Submitted 19 July, 2021; v1 submitted 26 January, 2021; originally announced January 2021.

Comments: 21 pages, 6 figures, Accepted for publication in JCAP

Journal ref: Journal of Cosmology and Astroparticle Physics, Volume 2021, July 2021

Everything You Wanted to Know About Noninvasive Glucose Measurement and Control

Authors: Prateek Jain, Amit M. Joshi, Saraju Mohanty

Abstract: Diabetes is a chronicle disease where the body of a human is irregular to dissolve the blood glucose properly. The diabetes is due to lack of insulin in human body. The continuous monitoring of blood glucose is main important aspect for health care. Most of the successful glucose monitoring devices is based on methodology of pricking of blood. However, such kind of approach may not be advisable fo… ▽ More Diabetes is a chronicle disease where the body of a human is irregular to dissolve the blood glucose properly. The diabetes is due to lack of insulin in human body. The continuous monitoring of blood glucose is main important aspect for health care. Most of the successful glucose monitoring devices is based on methodology of pricking of blood. However, such kind of approach may not be advisable for frequent measurement. The paper presents the extensive review of glucose measurement techniques. The paper covers various non-invasive glucose methods and its control with smart healthcare technology. To fulfill the imperatives for non-invasive blood glucose monitoring system, there is a need to configure an accurate measurement device. Noninvasive glucose-level monitoring device for clinical test overcomes the problem of frequent pricking for blood samples. There is requirement to develop the Internet-Medical-Things (IoMT) integrated Healthcare Cyber-Physical System (H-CPS) based Smart Healthcare framework for glucose measurement with purpose of continuous health monitoring. The paper also covers selective consumer products along with selected state of art glucose measurement approaches. The paper has also listed several challenges and open problems for glucose measurement. △ Less

Submitted 11 February, 2021; v1 submitted 22 January, 2021; originally announced January 2021.

Comments: 51 pages, 31 Figures, 5 Tables

Report number: MCE_Survey_2021

Journal ref: IEEE Consumer Electronics Magazine-2021

Roadmap on quantum nanotechnologies

Authors: Arne Laucht, Frank Hohls, Niels Ubbelohde, M Fernando Gonzalez-Zalba, David J Reilly, Søren Stobbe, Tim Schröder, Pasquale Scarlino, Jonne V Koski, Andrew Dzurak, Chih-Hwan Yang, Jun Yoneda, Ferdinand Kuemmeth, Hendrik Bluhm, Jarryd Pla, Charles Hill, Joe Salfi, Akira Oiwa, Juha T Muhonen, Ewold Verhagen, Matthew D LaHaye, Hyun Ho Kim, Adam W Tsen, Dimitrie Culcer, Attila Geresdi , et al. (4 additional authors not shown)

Abstract: Quantum phenomena are typically observable at length and time scales smaller than those of our everyday experience, often involving individual particles or excitations. The past few decades have seen a revolution in the ability to structure matter at the nanoscale, and experiments at the single particle level have become commonplace. This has opened wide new avenues for exploring and harnessing qu… ▽ More Quantum phenomena are typically observable at length and time scales smaller than those of our everyday experience, often involving individual particles or excitations. The past few decades have seen a revolution in the ability to structure matter at the nanoscale, and experiments at the single particle level have become commonplace. This has opened wide new avenues for exploring and harnessing quantum mechanical effects in condensed matter. These quantum phenomena, in turn, have the potential to revolutionize the way we communicate, compute and probe the nanoscale world. Here, we review developments in key areas of quantum research in light of the nanotechnologies that enable them, with a view to what the future holds. Materials and devices with nanoscale features are used for quantum metrology and sensing, as building blocks for quantum computing, and as sources and detectors for quantum communication. They enable explorations of quantum behaviour and unconventional states in nano- and opto-mechanical systems, low-dimensional systems, molecular devices, nano-plasmonics, quantum electrodynamics, scanning tunnelling microscopy, and more. This rapidly expanding intersection of nanotechnology and quantum science/technology is mutually beneficial to both fields, laying claim to some of the most exciting scientific leaps of the last decade, with more on the horizon. △ Less

Submitted 19 January, 2021; originally announced January 2021.

Comments: Roadmap article with contributed sections and subsections on: 1. Metrology and sensing 2. Quantum light sources, cavities and detectors 3. Quantum computing with spins 4. Nano and opto-mechanics 5. Low-dimensional systems 6. Molecular devices 7. Nanoplasmonics (47 pages, 25 figures). Contains arXiv:1907.02625, arXiv:1907.07087, arXiv:2001.11119, arXiv:2011.13907

Report number: NBI QDev 2021

Journal ref: Nanotechnology 32, 162003 (2021)

Participatory Budgeting with Project Groups

Authors: Pallavi Jain, Krzysztof Sornat, Nimrod Talmon, Meirav Zehavi

Abstract: We study a generalization of the standard approval-based model of participatory budgeting (PB), in which voters are providing approval ballots over a set of predefined projects and -- in addition to a global budget limit, there are several groupings of the projects, each group with its own budget limit. We study the computational complexity of identifying project bundles that maximize voter satisf… ▽ More We study a generalization of the standard approval-based model of participatory budgeting (PB), in which voters are providing approval ballots over a set of predefined projects and -- in addition to a global budget limit, there are several groupings of the projects, each group with its own budget limit. We study the computational complexity of identifying project bundles that maximize voter satisfaction while respecting all budget limits. We show that the problem is generally intractable and describe efficient exact algorithms for several special cases, including instances with only few groups and instances where the group structure is close to be hierarchical, as well as efficient approximation algorithms. Our results could allow, e.g., municipalities to hold richer PB processes that are thematically and geographically inclusive. △ Less

Submitted 9 December, 2020; originally announced December 2020.

Comments: 23 pages, 3 tables

MSC Class: 68Q17; 68Q25; 68W05 (Primary); 68W25; 68T42 (Secondary) ACM Class: F.2.2

Testing evolution of LFQPOs with mass accretion rate in GRS 1915+105 with Insight-HXMT

Authors: Honghui Liu, Long Ji, Cosimo Bambi, Pankaj Jain, Ranjeev Misra, Divya Rawat, J. S. Yadav, Yuexin Zhang

Abstract: Using the Insight-HXMT observations of GRS 1915+105 when it exhibits low frequency quasi-periodic oscillations (QPOs), we measure the evolution of the QPO frequency along with disk inner radius and mass accretion rate. We find a tight positive correlation between the QPO frequency and mass accretion rate. Our results extend the finding of previous work with AstroSat to a larger range of accretion… ▽ More Using the Insight-HXMT observations of GRS 1915+105 when it exhibits low frequency quasi-periodic oscillations (QPOs), we measure the evolution of the QPO frequency along with disk inner radius and mass accretion rate. We find a tight positive correlation between the QPO frequency and mass accretion rate. Our results extend the finding of previous work with AstroSat to a larger range of accretion rate with independent instruments and observations. Treating the QPO frequency of GRS 1915+105 as the relativistic dynamic frequency of a truncated disk, we are able to confirm the high spin nature of the black hole in GRS 1915+105. We also address the potential of our finding to test general relativity in the future. △ Less

Submitted 8 March, 2021; v1 submitted 3 December, 2020; originally announced December 2020.

Comments: 8 pages, 6 figures. v2: refereed version

Journal ref: Astrophys.J. 909: 63 (2021)

Docking two multirotors in midair using relative vision measurements

Authors: Karan P. Jain, Minos Park, Mark W. Mueller

Abstract: Modular robots have been rising in popularity for a variety of applications, and autonomous midair docking is a necessary task for real world deployment of these robots. We present a state estimator based on the extended Kalman filter for relative localization of one multirotor with respect to another using only onboard sensors, specifically an inertial measurement unit and a camera-marker pair. A… ▽ More Modular robots have been rising in popularity for a variety of applications, and autonomous midair docking is a necessary task for real world deployment of these robots. We present a state estimator based on the extended Kalman filter for relative localization of one multirotor with respect to another using only onboard sensors, specifically an inertial measurement unit and a camera-marker pair. Acceleration and angular velocity measurements along with relative pose measurements from a camera on the first multirotor looking at a marker on the second multirotor are used to estimate the relative position and velocity of the first multirotor with respect to the second, and the absolute attitude of the first multirotor. We also present a control architecture to use these onboard state estimates to control the first multirotor at a desired setpoint with respect to the second. The performance of the estimator and control architecture are experimentally validated by successfully and repeatably performing midair docking -- a task that requires relative position precision on the order of a centimeter. △ Less

Submitted 11 November, 2020; originally announced November 2020.

Comments: 7 pages; submitted to ICRA 2021

Towards constraining triple gluon operators through tops

Authors: Debjyoti Bardhan, Diptimoy Ghosh, Prasham Jain, Arun M. Thalapillil

Abstract: Effective field theory techniques provide us important tools to probe for physics beyond the Standard Model in a relatively model-independent way. In this work, we revisit the CP-even dimension-6 purely gluonic operator to investigate the possible constraints on it by studying its effect on top-pair production at the LHC, in particular the high $p_T$ and $m_{t\bar{t}}$ tails of the distribution. C… ▽ More Effective field theory techniques provide us important tools to probe for physics beyond the Standard Model in a relatively model-independent way. In this work, we revisit the CP-even dimension-6 purely gluonic operator to investigate the possible constraints on it by studying its effect on top-pair production at the LHC, in particular the high $p_T$ and $m_{t\bar{t}}$ tails of the distribution. Cut-based analysis reveals that the scale of New Physics when this operator alone contributes to the production process is greater than 3.4 TeV at 95% C.L., which is a much stronger bound compared to the bound of 850 GeV obtained from Run-I data using the same channel. This is reinforced by an analysis using Machine Learning techniques. Our study complements similar studies that have focussed on other collider channels to study this operator. △ Less

Submitted 4 June, 2021; v1 submitted 26 October, 2020; originally announced October 2020.

Comments: 12 pages, 14 figures

Journal ref: Phys. Rev. D 103, 115003 (2021)

Towards End-to-End In-Image Neural Machine Translation

Authors: Elman Mansimov, Mitchell Stern, Mia Chen, Orhan Firat, Jakob Uszkoreit, Puneet Jain

Abstract: In this paper, we offer a preliminary investigation into the task of in-image machine translation: transforming an image containing text in one language into an image containing the same text in another language. We propose an end-to-end neural model for this task inspired by recent approaches to neural machine translation, and demonstrate promising initial results based purely on pixel-level supe… ▽ More In this paper, we offer a preliminary investigation into the task of in-image machine translation: transforming an image containing text in one language into an image containing the same text in another language. We propose an end-to-end neural model for this task inspired by recent approaches to neural machine translation, and demonstrate promising initial results based purely on pixel-level supervision. We then offer a quantitative and qualitative evaluation of our system outputs and discuss some common failure modes. Finally, we conclude with directions for future work. △ Less

Submitted 20 October, 2020; originally announced October 2020.

Comments: Accepted as an oral presentation at EMNLP, NLP Beyond Text workshop, 2020

Mixed state entanglement measures as probe for confinement

Authors: Parul Jain, Subhash Mahapatra

Abstract: We study holographic aspects of mixed state entanglement measures in various large $N$ top-down as well as bottom-up confining models. For the top-down models, we consider wrapped $D3$ and $D4$ branes gravity solutions whereas, for the bottom-up confining model, the Einstein-Maxwell-dilaton gravity solution is considered. We study entanglement entropy, mutual information, entanglement wedge cross-… ▽ More We study holographic aspects of mixed state entanglement measures in various large $N$ top-down as well as bottom-up confining models. For the top-down models, we consider wrapped $D3$ and $D4$ branes gravity solutions whereas, for the bottom-up confining model, the Einstein-Maxwell-dilaton gravity solution is considered. We study entanglement entropy, mutual information, entanglement wedge cross-section and entanglement negativity for the strip subsystems and find model independent features of these entanglement measures in all confining theories. The entanglement negativity and entropy exhibit a phase transition at the same critical strip length $L_{crit}$, at which the order of these measures changes from $\mathcal{O}(N^2)$ to $\mathcal{O}(N^0)$. The entanglement wedge cross-section similarly shows an order change at $L_{crit}$ and exhibits a discontinuous behaviour each time a phase transition between different entangling surfaces occur. We further test the inequality involving mutual information and entanglement wedge cross-section, and find that the latter always exceeds half of the former. △ Less

Submitted 22 December, 2020; v1 submitted 15 October, 2020; originally announced October 2020.

Comments: 36 pages, many figures, published version, reference and discussion added

Journal ref: Phys. Rev. D 102, 126022 (2020)

Projection Efficient Subgradient Method and Optimal Nonsmooth Frank-Wolfe Method

Authors: Kiran Koshy Thekumparampil, Prateek Jain, Praneeth Netrapalli, Sewoong Oh

Abstract: We consider the classical setting of optimizing a nonsmooth Lipschitz continuous convex function over a convex constraint set, when having access to a (stochastic) first-order oracle (FO) for the function and a projection oracle (PO) for the constraint set. It is well known that to achieve $ε$-suboptimality in high-dimensions, $Θ(ε^{-2})$ FO calls are necessary. This is achieved by the projected s… ▽ More We consider the classical setting of optimizing a nonsmooth Lipschitz continuous convex function over a convex constraint set, when having access to a (stochastic) first-order oracle (FO) for the function and a projection oracle (PO) for the constraint set. It is well known that to achieve $ε$-suboptimality in high-dimensions, $Θ(ε^{-2})$ FO calls are necessary. This is achieved by the projected subgradient method (PGD). However, PGD also entails $O(ε^{-2})$ PO calls, which may be computationally costlier than FO calls (e.g. nuclear norm constraints). Improving this PO calls complexity of PGD is largely unexplored, despite the fundamental nature of this problem and extensive literature. We present first such improvement. This only requires a mild assumption that the objective function, when extended to a slightly larger neighborhood of the constraint set, still remains Lipschitz and accessible via FO. In particular, we introduce MOPES method, which carefully combines Moreau-Yosida smoothing and accelerated first-order schemes. This is guaranteed to find a feasible $ε$-suboptimal solution using only $O(ε^{-1})$ PO calls and optimal $O(ε^{-2})$ FO calls. Further, instead of a PO if we only have a linear minimization oracle (LMO, a la Frank-Wolfe) to access the constraint set, an extension of our method, MOLES, finds a feasible $ε$-suboptimal solution using $O(ε^{-2})$ LMO calls and FO calls---both match known lower bounds, resolving a question left open since White (1993). Our experiments confirm that these methods achieve significant speedups over the state-of-the-art, for a problem with costly PO and LMO calls. △ Less

Submitted 5 October, 2020; originally announced October 2020.

AbuseAnalyzer: Abuse Detection, Severity and Target Prediction for Gab Posts

Authors: Mohit Chandra, Ashwin Pathak, Eesha Dutta, Paryul Jain, Manish Gupta, Manish Shrivastava, Ponnurangam Kumaraguru

Abstract: While extensive popularity of online social media platforms has made information dissemination faster, it has also resulted in widespread online abuse of different types like hate speech, offensive language, sexist and racist opinions, etc. Detection and curtailment of such abusive content is critical for avoiding its psychological impact on victim communities, and thereby preventing hate crimes.… ▽ More While extensive popularity of online social media platforms has made information dissemination faster, it has also resulted in widespread online abuse of different types like hate speech, offensive language, sexist and racist opinions, etc. Detection and curtailment of such abusive content is critical for avoiding its psychological impact on victim communities, and thereby preventing hate crimes. Previous works have focused on classifying user posts into various forms of abusive behavior. But there has hardly been any focus on estimating the severity of abuse and the target. In this paper, we present a first of the kind dataset with 7601 posts from Gab which looks at online abuse from the perspective of presence of abuse, severity and target of abusive behavior. We also propose a system to address these tasks, obtaining an accuracy of ~80% for abuse presence, ~82% for abuse target prediction, and ~65% for abuse severity prediction. △ Less

Submitted 8 October, 2020; v1 submitted 30 September, 2020; originally announced October 2020.

Comments: Extended version for our paper accepted at COLING 2020

Square Kilometre Array Science Data Challenge 1: analysis and results

Authors: A. Bonaldi, T. An, M. Bruggen, S. Burkutean, B. Coelho, H. Goodarzi, P. Hartley, P. K. Sandhu, C. Wu, L. Yu, M. H. Zhoolideh Haghighi, S. Anton, Z. Bagheri, D. Barbosa, J. P. Barraca, D. Bartashevich, M. Bergano, M. Bonato, J. Brand, F. de Gasperin, A. Giannetti, R. Dodson, P. Jain, S. Jaiswal, B. Lao , et al. (20 additional authors not shown)

Abstract: As the largest radio telescope in the world, the Square Kilometre Array (SKA) will lead the next generation of radio astronomy. The feats of engineering required to construct the telescope array will be matched only by the techniques developed to exploit the rich scientific value of the data. To drive forward the development of efficient and accurate analysis methods, we are designing a series of… ▽ More As the largest radio telescope in the world, the Square Kilometre Array (SKA) will lead the next generation of radio astronomy. The feats of engineering required to construct the telescope array will be matched only by the techniques developed to exploit the rich scientific value of the data. To drive forward the development of efficient and accurate analysis methods, we are designing a series of data challenges that will provide the scientific community with high-quality datasets for testing and evaluating new techniques. In this paper we present a description and results from the first such Science Data Challenge (SDC1). Based on SKA MID continuum simulated observations and covering three frequencies (560 MHz, 1400MHz and 9200 MHz) at three depths (8 h, 100 h and 1000 h), SDC1 asked participants to apply source detection, characterization and classification methods to simulated data. The challenge opened in November 2018, with nine teams submitting results by the deadline of April 2019. In this work we analyse the results for 8 of those teams, showcasing the variety of approaches that can be successfully used to find, characterise and classify sources in a deep, crowded field. The results also demonstrate the importance of building domain knowledge and expertise on this kind of analysis to obtain the best performance. As high-resolution observations begin revealing the true complexity of the sky, one of the outstanding challenges emerging from this analysis is the ability to deal with highly resolved and complex sources as effectively as the unresolved source population. △ Less

Submitted 28 September, 2020; originally announced September 2020.

Comments: 18 pages, 11 figures, accepted by MNRAS

Thermal and IR Drop Analysis Using Convolutional Encoder-Decoder Networks

Authors: Vidya A. Chhabria, Vipul Ahuja, Ashwath Prabhu, Nikhil Patil, Palkesh Jain, Sachin S. Sapatnekar

Abstract: Computationally expensive temperature and power grid analyses are required during the design cycle to guide IC design. This paper employs encoder-decoder based generative (EDGe) networks to map these analyses to fast and accurate image-to-image and sequence-to-sequence translation tasks. The network takes a power map as input and outputs the corresponding temperature or IR drop map. We propose two… ▽ More Computationally expensive temperature and power grid analyses are required during the design cycle to guide IC design. This paper employs encoder-decoder based generative (EDGe) networks to map these analyses to fast and accurate image-to-image and sequence-to-sequence translation tasks. The network takes a power map as input and outputs the corresponding temperature or IR drop map. We propose two networks: (i) ThermEDGe: a static and dynamic full-chip temperature estimator and (ii) IREDGe: a full-chip static IR drop predictor based on input power, power grid distribution, and power pad distribution patterns. The models are design-independent and must be trained just once for a particular technology and packaging solution. ThermEDGe and IREDGe are demonstrated to rapidly predict the on-chip temperature and IR drop contours in milliseconds (in contrast with commercial tools that require several hours or more) and provide an average error of 0.6% and 0.008% respectively. △ Less

Submitted 18 September, 2020; originally announced September 2020.

Comments: Accepted in ASP-DAC 2021 conference

On Bilinear Hardy Inequality and Corresponding Geometric Mean Inequality

Authors: Amiran Gogatishvili, Pankaj Jain, Saikat Kanjilal

Abstract: The main aim of this paper to provide several scales of equivalent conditions for the bilinear Hardy inequalities in the case $1< q, p_1, p_2<\infty$ with $q \geq \max(p_1,p_2)$. The main aim of this paper to provide several scales of equivalent conditions for the bilinear Hardy inequalities in the case $1< q, p_1, p_2<\infty$ with $q \geq \max(p_1,p_2)$. △ Less

Submitted 11 September, 2020; originally announced September 2020.

MSC Class: 26D10; 46E35

Journal ref: Ricerche mat (2020)

Intelligent Ranking for Dynamic Restoration in Next Generation Wireless Networks

Authors: Navrati Saxena, Prasham Jain, Abhishek Roy, Harman Jit Singh, Sukhdeep Singh, Madhan Raj Kanagarathinam

Abstract: Emerging 5G and next generation 6G wireless are likely to involve myriads of connectivity, consisting of a huge number of relatively smaller cells providing ultra-dense coverage. Guaranteeing seamless connectivity and service level agreements in such a dense wireless system demands efficient network management and fast service recovery. However, restoration of a wireless network, in terms of maxim… ▽ More Emerging 5G and next generation 6G wireless are likely to involve myriads of connectivity, consisting of a huge number of relatively smaller cells providing ultra-dense coverage. Guaranteeing seamless connectivity and service level agreements in such a dense wireless system demands efficient network management and fast service recovery. However, restoration of a wireless network, in terms of maximizing service recovery, typically requires evaluating the service impact of every network element. Unfortunately, unavailability of real-time KPI information, during an outage, enforces most of the existing approaches to rely significantly on context-based manual evaluation. As a consequence, configuring a real-time recovery of the network nodes is almost impossible, thereby resulting in a prolonged outage duration. In this article, we explore deep learning to introduce an intelligent, proactive network recovery management scheme in anticipation of an eminent network outage. Our proposed method introduces a novel utilization-based ranking scheme of different wireless nodes to minimize the service downtime and enable a fast recovery. Efficient prediction of network KPI (Key Performance Index), based on actual wireless data demonstrates up to ~54% improvement in service outage. △ Less

Submitted 24 June, 2022; v1 submitted 10 September, 2020; originally announced September 2020.

Comments: Further research evaluation is required

A systematic literature review on machine learning applications for consumer sentiment analysis using online reviews

Authors: Praphula Kumar Jain, Rajendra Pamula

Abstract: Consumer sentiment analysis is a recent fad for social media related applications such as healthcare, crime, finance, travel, and academics. Disentangling consumer perception to gain insight into the desired objective and reviews is significant. With the advancement of technology, a massive amount of social web-data increasing in terms of volume, subjectivity, and heterogeneity, becomes challengin… ▽ More Consumer sentiment analysis is a recent fad for social media related applications such as healthcare, crime, finance, travel, and academics. Disentangling consumer perception to gain insight into the desired objective and reviews is significant. With the advancement of technology, a massive amount of social web-data increasing in terms of volume, subjectivity, and heterogeneity, becomes challenging to process it manually. Machine learning techniques have been utilized to handle this difficulty in real-life applications. This paper presents the study to find out the usefulness, scope, and applicability of this alliance of Machine Learning techniques for consumer sentiment analysis on online reviews in the domain of hospitality and tourism. We have shown a systematic literature review to compare, analyze, explore, and understand the attempts and direction in a proper way to find research gaps to illustrating the future scope of this pairing. This work is contributing to the extant literature in two ways; firstly, the primary objective is to read and analyze the use of machine learning techniques for consumer sentiment analysis on online reviews in the domain of hospitality and tourism. Secondly, in this work, we presented a systematic approach to identify, collect observational evidence, results from the analysis, and assimilate observations of all related high-quality research to address particular research queries referring to the described research area. △ Less

Submitted 24 August, 2020; originally announced August 2020.

Vertical sediment concentration distribution revisited with shear-induced diffusivity: An explicit series solution based on homotopy analysis method

Authors: Punit Jain, Manotosh Kumbhakar, Koeli Ghoshal

Abstract: The present study revisits the vertical distribution of suspended sediment concentration in an open channel flow with a special attention to sediment diffusion coefficient. If turbulent diffusivity is considered to follow a parabolic-type profile, the diffusivity coefficient is zero at the bed and very small near the bed; so alone it may not be enough to diffuse the particles from bed-load layer t… ▽ More The present study revisits the vertical distribution of suspended sediment concentration in an open channel flow with a special attention to sediment diffusion coefficient. If turbulent diffusivity is considered to follow a parabolic-type profile, the diffusivity coefficient is zero at the bed and very small near the bed; so alone it may not be enough to diffuse the particles from bed-load layer to suspension region. Leighton & Acrivos (J. Fluid Mech., vol. 181, 1987, pp. 415-439) introduced the idea of shear-induced diffusion that arises due to the hydrodynamic interactions between solid particles. This work considers the Hunt diffusion equation incorporating the concept of shear-induced diffusion and reinvestigates the vertical sediment concentration profile. Analytical solution is derived using a non-perturbation approach, namely Homotopy Analysis Method (HAM), and is verified with numerical solution as well as compared with available experimental data. The behaviour of the shear-induced diffusion coefficient with vertical distance and varying particle diameters have been interpreted physically. In addition, the effects of important turbulent factors such as inverse of Schmidt number, hindered settling velocity on concentration profile, have been investigated considering relevant sets of experimental data. △ Less

Submitted 17 August, 2020; originally announced August 2020.

Comments: 25 pages, 24 figures

Boundedness of Dunkl-Hausdorff operator in Lebesgue spaces

Authors: Sandhya Jain, Alberto Fiorenza, Pankaj Jain

Abstract: In this paper, the $L^p_v(\R)$-boundedness of the Dunkl-Hausdorff operator $\displaystyle H_{\al,φ} f(x)=\ent\frac{ |φ(t)|}{|t|^{2\al+2}}f\lf(\frac{x}{t}\rh) dt $ has been characterized and for a certain type of weight $v$, the precise value of the norm $\|H_{\al,φ}\|_{L^p_v(\R)\to L^p_v(\R)}$ has been obtained. This covers several of the existing results. Analogous results in two dimensions have… ▽ More In this paper, the $L^p_v(\R)$-boundedness of the Dunkl-Hausdorff operator $\displaystyle H_{\al,φ} f(x)=\ent\frac{ |φ(t)|}{|t|^{2\al+2}}f\lf(\frac{x}{t}\rh) dt $ has been characterized and for a certain type of weight $v$, the precise value of the norm $\|H_{\al,φ}\|_{L^p_v(\R)\to L^p_v(\R)}$ has been obtained. This covers several of the existing results. Analogous results in two dimensions have also been proved. △ Less

Submitted 22 July, 2020; originally announced July 2020.

Comments: 15 Pages

MSC Class: 47B38; 26D10; 26D15

Programming by Rewards

Authors: Nagarajan Natarajan, Ajaykrishna Karthikeyan, Prateek Jain, Ivan Radicek, Sriram Rajamani, Sumit Gulwani, Johannes Gehrke

Abstract: We formalize and study ``programming by rewards'' (PBR), a new approach for specifying and synthesizing subroutines for optimizing some quantitative metric such as performance, resource utilization, or correctness over a benchmark. A PBR specification consists of (1) input features $x$, and (2) a reward function $r$, modeled as a black-box component (which we can only run), that assigns a reward f… ▽ More We formalize and study ``programming by rewards'' (PBR), a new approach for specifying and synthesizing subroutines for optimizing some quantitative metric such as performance, resource utilization, or correctness over a benchmark. A PBR specification consists of (1) input features $x$, and (2) a reward function $r$, modeled as a black-box component (which we can only run), that assigns a reward for each execution. The goal of the synthesizer is to synthesize a "decision function" $f$ which transforms the features to a decision value for the black-box component so as to maximize the expected reward $E[r \circ f (x)]$ for executing decisions $f(x)$ for various values of $x$. We consider a space of decision functions in a DSL of loop-free if-then-else programs, which can branch on linear functions of the input features in a tree-structure and compute a linear function of the inputs in the leaves of the tree. We find that this DSL captures decision functions that are manually written in practice by programmers. Our technical contribution is the use of continuous-optimization techniques to perform synthesis of such decision functions as if-then-else programs. We also show that the framework is theoretically-founded ---in cases when the rewards satisfy nice properties, the synthesized code is optimal in a precise sense. We have leveraged PBR to synthesize non-trivial decision functions related to search and ranking heuristics in the PROSE codebase (an industrial strength program synthesis framework) and achieve competitive results to manually written procedures over multiple man years of tuning. We present empirical evaluation against other baseline techniques over real-world case studies (including PROSE) as well on simple synthetic benchmarks. △ Less

Submitted 14 July, 2020; originally announced July 2020.

Contrastive Code Representation Learning

Authors: Paras Jain, Ajay Jain, Tianjun Zhang, Pieter Abbeel, Joseph E. Gonzalez, Ion Stoica

Abstract: Recent work learns contextual representations of source code by reconstructing tokens from their context. For downstream semantic understanding tasks like summarizing code in English, these representations should ideally capture program functionality. However, we show that the popular reconstruction-based BERT model is sensitive to source code edits, even when the edits preserve semantics. We prop… ▽ More Recent work learns contextual representations of source code by reconstructing tokens from their context. For downstream semantic understanding tasks like summarizing code in English, these representations should ideally capture program functionality. However, we show that the popular reconstruction-based BERT model is sensitive to source code edits, even when the edits preserve semantics. We propose ContraCode: a contrastive pre-training task that learns code functionality, not form. ContraCode pre-trains a neural network to identify functionally similar variants of a program among many non-equivalent distractors. We scalably generate these variants using an automated source-to-source compiler as a form of data augmentation. Contrastive pre-training improves JavaScript summarization and TypeScript type inference accuracy by 2% to 13%. We also propose a new zero-shot JavaScript code clone detection dataset, showing that ContraCode is both more robust and semantically meaningful. On it, we outperform RoBERTa by 39% AUROC in an adversarial setting and up to 5% on natural code. △ Less

Submitted 6 January, 2022; v1 submitted 9 July, 2020; originally announced July 2020.

Comments: In Proceedings of EMNLP 2021. 19 pages, 16 figures, 9 tables. Code available at https://github.com/parasj/contracode

Dynamics of mosquito swarms over a moving marker

Authors: Puneet Jain, Om Prakash Singh, Sachit Butail

Abstract: Insect swarms are a model system for understanding collective behavior where the collective motion appears in disorder. To initiate and maintain a swarm in place, flying insects often use a visual external cue called a marker. In mosquitoes, understanding the swarming behavior and its relation to the marker has an additional medical relevance since swarming often precedes mating in the wild, thus… ▽ More Insect swarms are a model system for understanding collective behavior where the collective motion appears in disorder. To initiate and maintain a swarm in place, flying insects often use a visual external cue called a marker. In mosquitoes, understanding the swarming behavior and its relation to the marker has an additional medical relevance since swarming often precedes mating in the wild, thus constituting an important stage to intercept for controlling mosquito population. In this paper, we conduct preliminary experiments to characterize the visual coupling between a swarm of mosquitoes and a marker. A laboratory microcosm with artificial lighting was built to stimulate consistent swarming in the malarial mosquito Anopheles stephensi. The experimental setup was used to film a mosquito swarm with a stereo camera system as a marker was moved back-and-forth with different frequencies. System identification analysis of the frequency response shows that the relationship between the swarm and the marker can be described by delayed second order dynamics in a feedback loop. Further, the length of the internal time delay appears to correlate with the number of mosquitoes swarming on the marker indicating that such a delay may be able capture social interactions within swarming systems. For insect swarms, model fitting of trajectory data provides a way to numerically compare swarming behaviors of different species with respect to marker characteristics. These preliminary results motivate investigating linear dynamic system in feedback as a framework for modeling insect swarms and set the stage for future studies. △ Less

Submitted 25 August, 2020; v1 submitted 8 July, 2020; originally announced July 2020.

Comments: 13 pages, 5 figures

Three Dimensional Moving Path Following Control for Robotic Vehicles with Minimum Positive Forward Speed

Authors: R. Praveen Jain, Joao Borges de Sousa, A. Pedro Aguiar

Abstract: This paper addresses the problem of steering a robotic vehicle along a geometric path specified with respect to a reference frame moving in three dimensions, termed the Moving Path Following (MPF) motion control problem. The MPF motion control problem is solved for a large class of robotic vehicles that require a minimum positive forward speed to operate, which poses additional constraints, and is… ▽ More This paper addresses the problem of steering a robotic vehicle along a geometric path specified with respect to a reference frame moving in three dimensions, termed the Moving Path Following (MPF) motion control problem. The MPF motion control problem is solved for a large class of robotic vehicles that require a minimum positive forward speed to operate, which poses additional constraints, and is developed using geometric concepts, wherein the attitude control problem is formulated on Special Orthogonal group SO(3). Furthermore, the proposed control law is derived from a novel MPF error model formulation that allows to exclude the conservative constraints on the initial position of the vehicle with respect to the reference path by enabling the explicit control of the progression of a virtual point moving along the reference path. The task of the MPF control law is then to steer the vehicle towards the moving path and converge to the virtual point. Formal stability and convergence guarantees are provided using the Input-to-State Stability concept. In particular, we show that the proposed controller is robust to imperfect tracking errors by the autopilot and wind gusts. Simulation results are presented to illustrate the efficacy of the proposed MPF control law. △ Less

Submitted 15 September, 2020; v1 submitted 4 July, 2020; originally announced July 2020.

Comments: Technical Report. Longer version of the paper to be submitted to the relevant conference/letters

Globally-convergent Iteratively Reweighted Least Squares for Robust Regression Problems

Authors: Bhaskar Mukhoty, Govind Gopakumar, Prateek Jain, Purushottam Kar

Abstract: We provide the first global model recovery results for the IRLS (iteratively reweighted least squares) heuristic for robust regression problems. IRLS is known to offer excellent performance, despite bad initializations and data corruption, for several parameter estimation problems. Existing analyses of IRLS frequently require careful initialization, thus offering only local convergence guarantees.… ▽ More We provide the first global model recovery results for the IRLS (iteratively reweighted least squares) heuristic for robust regression problems. IRLS is known to offer excellent performance, despite bad initializations and data corruption, for several parameter estimation problems. Existing analyses of IRLS frequently require careful initialization, thus offering only local convergence guarantees. We remedy this by proposing augmentations to the basic IRLS routine that not only offer guaranteed global recovery, but in practice also outperform state-of-the-art algorithms for robust regression. Our routines are more immune to hyperparameter misspecification in basic regression tasks, as well as applied tasks such as linear-armed bandit problems. Our theoretical analyses rely on a novel extension of the notions of strong convexity and smoothness to weighted strong convexity and smoothness, and establishing that sub-Gaussian designs offer bounded weighted condition numbers. These notions may be useful in analyzing other algorithms as well. △ Less

Submitted 25 June, 2020; originally announced June 2020.

Comments: 30 pages, 5 figures, appeared as a publication in the 22nd International Conference on Artificial Intelligence and Statistics (AISTATS), 2019

Journal ref: Proceedings of Machine Learning Research (PMLR) 89:313-322, 2019

On the Parameterized Approximability of Contraction to Classes of Chordal Graphs

Authors: Spoorthy Gunda, Pallavi Jain, Daniel Lokshtanov, Saket Saurabh, Prafullkumar Tale

Abstract: A graph operation that {\em contracts edges} is one of the fundamental operations in the theory of graph minors. Parameterized Complexity of editing to a family of graphs by contracting $k$ edges has recently gained substantial scientific attention, and several new results have been obtained. Some important families of graphs, namely the subfamilies of chordal graphs, in the context of edge contra… ▽ More A graph operation that {\em contracts edges} is one of the fundamental operations in the theory of graph minors. Parameterized Complexity of editing to a family of graphs by contracting $k$ edges has recently gained substantial scientific attention, and several new results have been obtained. Some important families of graphs, namely the subfamilies of chordal graphs, in the context of edge contractions, have proven to be significantly difficult than one might expect. In this paper, we study the \textsc{$\cal F$-Contraction} problem, where $\cal F$ is a subfamily of chordal graphs, in the realm of parameterized approximation. Formally, given a graph $G$ and an integer $k$, \textsc{ $\cal F$-Contraction} asks whether there exists $X \subseteq E(G)$ such that $G/X \in \cal F$ and $|X| \leq k$. Here, $G/X$ is the graph obtained from $G$ by contracting edges in $X$. We obtain the following results for the \textsc{ $\cal F$-Contraction} problem. $(1)$ We show that \textsc{Clique Contraction} admits a polynomial-size approximate kernelization scheme (\textsf{PSAKS}). $(2)$ We give a $(2+ε)$-approximate polynomial kernel for \textsc{Split Contraction} (which also implies a factor $(2+ε)$-\FPT-approximation algorithm for \textsc{ Split Contraction}). Furthermore, we show that, assuming \textsf{ Gap-ETH}, there is no $\left(\frac{5}{4}-δ\right)$-\FPT-approximation algorithm for \textsc{Split Contraction}. Here, $ε, δ>0$ are fixed constants. $(3)$ \textsc{Chordal Contraction} is known to be \WTH. We complement this result by observing that the existing \textsf{W[2]-hardness} reduction can be adapted to show that, assuming \FPT $\neq$ \textsf{W[1]}, there is no $F(k)$-\FPT-approximation algorithm for \textsc{Chordal Contraction}. Here, $F(k)$ is an arbitrary function depending on $k$ alone. △ Less

Submitted 18 June, 2020; originally announced June 2020.

Alignment of Radio Galaxy Axes using FIRST Catalogue

Authors: Mohit Panwar, Prabhakar, Pritpal Kaur Sandhu, Yogesh Wadadekar, Pankaj Jain

Abstract: We study the alignment of radio galaxies axes using the FIRST catalogue. we impose several cuts in order to select the candidates which are most likely to be free of systematic bias. In our study we primarily focus on testing for alignment among sources within a certain angular separation from one another since for most sources redshift information is not available. We find a very significant effe… ▽ More We study the alignment of radio galaxies axes using the FIRST catalogue. we impose several cuts in order to select the candidates which are most likely to be free of systematic bias. In our study we primarily focus on testing for alignment among sources within a certain angular separation from one another since for most sources redshift information is not available. We find a very significant effect for angular distances less than 1 degrees. The distance scale of alignment is found to be roughly 28 Mpc, in agreement with earlier estimates, assuming that these sources are dominantly at redshift of 0.8. However we are not able to entirely rule out the possibility of systematic bias in data. We also perform a full three dimensional analysis using a smaller data sample for which redshift information is available. In this case we only find a very weak signal at much larger distances. △ Less

Submitted 26 September, 2020; v1 submitted 17 June, 2020; originally announced June 2020.

Comments: 7 pages, 10 figures, to appear in MNRAS

Least Squares Regression with Markovian Data: Fundamental Limits and Algorithms

Authors: Guy Bresler, Prateek Jain, Dheeraj Nagaraj, Praneeth Netrapalli, Xian Wu

Abstract: We study the problem of least squares linear regression where the data-points are dependent and are sampled from a Markov chain. We establish sharp information theoretic minimax lower bounds for this problem in terms of $τ_{\mathsf{mix}}$, the mixing time of the underlying Markov chain, under different noise settings. Our results establish that in general, optimization with Markovian data is stric… ▽ More We study the problem of least squares linear regression where the data-points are dependent and are sampled from a Markov chain. We establish sharp information theoretic minimax lower bounds for this problem in terms of $τ_{\mathsf{mix}}$, the mixing time of the underlying Markov chain, under different noise settings. Our results establish that in general, optimization with Markovian data is strictly harder than optimization with independent data and a trivial algorithm (SGD-DD) that works with only one in every $\tildeΘ(τ_{\mathsf{mix}})$ samples, which are approximately independent, is minimax optimal. In fact, it is strictly better than the popular Stochastic Gradient Descent (SGD) method with constant step-size which is otherwise minimax optimal in the regression with independent data setting. Beyond a worst case analysis, we investigate whether structured datasets seen in practice such as Gaussian auto-regressive dynamics can admit more efficient optimization schemes. Surprisingly, even in this specific and natural setting, Stochastic Gradient Descent (SGD) with constant step-size is still no better than SGD-DD. Instead, we propose an algorithm based on experience replay--a popular reinforcement learning technique--that achieves a significantly better error rate. Our improved rate serves as one of the first results where an algorithm outperforms SGD-DD on an interesting Markov chain and also provides one of the first theoretical analyses to support the use of experience replay in practice. △ Less

Submitted 16 June, 2020; originally announced June 2020.

The Pitfalls of Simplicity Bias in Neural Networks

Authors: Harshay Shah, Kaustav Tamuly, Aditi Raghunathan, Prateek Jain, Praneeth Netrapalli

Abstract: Several works have proposed Simplicity Bias (SB)---the tendency of standard training procedures such as Stochastic Gradient Descent (SGD) to find simple models---to justify why neural networks generalize well [Arpit et al. 2017, Nakkiran et al. 2019, Soudry et al. 2018]. However, the precise notion of simplicity remains vague. Furthermore, previous settings that use SB to theoretically justify why… ▽ More Several works have proposed Simplicity Bias (SB)---the tendency of standard training procedures such as Stochastic Gradient Descent (SGD) to find simple models---to justify why neural networks generalize well [Arpit et al. 2017, Nakkiran et al. 2019, Soudry et al. 2018]. However, the precise notion of simplicity remains vague. Furthermore, previous settings that use SB to theoretically justify why neural networks generalize well do not simultaneously capture the non-robustness of neural networks---a widely observed phenomenon in practice [Goodfellow et al. 2014, Jo and Bengio 2017]. We attempt to reconcile SB and the superior standard generalization of neural networks with the non-robustness observed in practice by designing datasets that (a) incorporate a precise notion of simplicity, (b) comprise multiple predictive features with varying levels of simplicity, and (c) capture the non-robustness of neural networks trained on real data. Through theory and empirics on these datasets, we make four observations: (i) SB of SGD and variants can be extreme: neural networks can exclusively rely on the simplest feature and remain invariant to all predictive complex features. (ii) The extreme aspect of SB could explain why seemingly benign distribution shifts and small adversarial perturbations significantly degrade model performance. (iii) Contrary to conventional wisdom, SB can also hurt generalization on the same data distribution, as SB persists even when the simplest feature has less predictive power than the more complex features. (iv) Common approaches to improve generalization and robustness---ensembles and adversarial training---can fail in mitigating SB and its pitfalls. Given the role of SB in training neural networks, we hope that the proposed datasets and methods serve as an effective testbed to evaluate novel algorithmic approaches aimed at avoiding the pitfalls of SB. △ Less

Submitted 28 October, 2020; v1 submitted 13 June, 2020; originally announced June 2020.

Comments: NeurIPS 2020

Classical inequalities for pseudo-integral

Authors: Pankaj Jain

Abstract: In this paper, we have derived certain classical inequalities, namely, Young's, Hölder's, Minkowski's and Hermite-Hadamard inequalities for pseudo-integral (also known as $g$-integral). For Young's, Hölder's, Minkowski's inequalities, both the cases $p>1$ as well as $p<1,\,p\ne 0$ have been covered. Moreover, in the case of Hermite-Hadamard inequality, a refinement has also been proved and as a sp… ▽ More In this paper, we have derived certain classical inequalities, namely, Young's, Hölder's, Minkowski's and Hermite-Hadamard inequalities for pseudo-integral (also known as $g$-integral). For Young's, Hölder's, Minkowski's inequalities, both the cases $p>1$ as well as $p<1,\,p\ne 0$ have been covered. Moreover, in the case of Hermite-Hadamard inequality, a refinement has also been proved and as a special case, $g$-analogue of geometric-logarithmic-arithmetic inequality has been deduced. △ Less

Submitted 11 June, 2020; originally announced June 2020.

Comments: 17 Pages

MSC Class: 28A15; 28A25

On the (Parameterized) Complexity of Almost Stable Marriage

Authors: Sushmita Gupta, Pallavi Jain, Sanjukta Roy, Saket Saurabh, Meirav Zehavi

Abstract: In the Stable Marriage problem. when the preference lists are complete, all agents of the smaller side can be matched. However, this need not be true when preference lists are incomplete. In most real-life situations, where agents participate in the matching market voluntarily and submit their preferences, it is natural to assume that each agent wants to be matched to someone in his/her preference… ▽ More In the Stable Marriage problem. when the preference lists are complete, all agents of the smaller side can be matched. However, this need not be true when preference lists are incomplete. In most real-life situations, where agents participate in the matching market voluntarily and submit their preferences, it is natural to assume that each agent wants to be matched to someone in his/her preference list as opposed to being unmatched. In light of the Rural Hospital Theorem, we have to relax the "no blocking pair" condition for stable matchings in order to match more agents. In this paper, we study the question of matching more agents with fewest possible blocking edges. In particular, we find a matching whose size exceeds that of stable matching in the graph by at least t and has at most k blocking edges. We study this question in the realm of parameterized complexity with respect to several natural parameters, k,t,d, where d is the maximum length of a preference list. Unfortunately, the problem remains intractable even for the combined parameter k+t+d. Thus, we extend our study to the local search variant of this problem, in which we search for a matching that not only fulfills each of the above conditions but is "closest", in terms of its symmetric difference to the given stable matching, and obtain an FPT algorithm. △ Less

Submitted 16 May, 2020; originally announced May 2020.

Temporal Knowledge Base Completion: New Algorithms and Evaluation Protocols

Authors: Prachi Jain, Sushant Rathi, Mausam, Soumen Chakrabarti

Abstract: Temporal knowledge bases associate relational (s,r,o) triples with a set of times (or a single time instant) when the relation is valid. While time-agnostic KB completion (KBC) has witnessed significant research, temporal KB completion (TKBC) is in its early days. In this paper, we consider predicting missing entities (link prediction) and missing time intervals (time prediction) as joint TKBC tas… ▽ More Temporal knowledge bases associate relational (s,r,o) triples with a set of times (or a single time instant) when the relation is valid. While time-agnostic KB completion (KBC) has witnessed significant research, temporal KB completion (TKBC) is in its early days. In this paper, we consider predicting missing entities (link prediction) and missing time intervals (time prediction) as joint TKBC tasks where entities, relations, and time are all embedded in a uniform, compatible space. We present TIMEPLEX, a novel time-aware KBC method, that also automatically exploits the recurrent nature of some relations and temporal interactions between pairs of relations. TIMEPLEX achieves state-of-the-art performance on both prediction tasks. We also find that existing TKBC models heavily overestimate link prediction performance due to imperfect evaluation mechanisms. In response, we propose improved TKBC evaluation protocols for both link and time prediction tasks, dealing with subtle issues that arise from the partial overlap of time intervals in gold instances and system predictions. △ Less

Submitted 11 October, 2020; v1 submitted 2 May, 2020; originally announced May 2020.

Energy sensitivity of the GRAPES-3 EAS array for primary cosmic ray protons

Authors: B. Hariharan, S. Ahmad, M. Chakraborty, A. Chandra, S. R. Dugad, S. K. Gupta, Y. Hayashi, H. Kojima, S. S. R. Inbanathan, P. Jagadeesan, A. Jain, P. Jain, V. B. Jhansi, S. Kawakami, P. K. Mohanty, S. D. Morris, P. K. Nayak, A. Oshima, D. Pattanaik, P. S. Rakshe, K. Ramesh, B. S. Rao, L. V. Reddy, S. Shibata, F. Varsi , et al. (1 additional authors not shown)

Abstract: Low energy ground-based cosmic ray air shower experiments generally have energy threshold in the range of a few tens to a few hundreds of TeV. The shower observables are measured indirectly with an array of detectors. The atmospheric absorption of low energy secondaries limits their detection frequencies at the Earth's surface. However, due to selection effects, a tiny fraction of low energy showe… ▽ More Low energy ground-based cosmic ray air shower experiments generally have energy threshold in the range of a few tens to a few hundreds of TeV. The shower observables are measured indirectly with an array of detectors. The atmospheric absorption of low energy secondaries limits their detection frequencies at the Earth's surface. However, due to selection effects, a tiny fraction of low energy showers, which are produced in the lower atmosphere can reach the observational level. But, due to less information of shower observables, the reconstruction of these showers are arduous. Hence, it is believed that direct measurements by experiments aboard on satellites and balloon flights are more reliable at low energies. Despite having very small efficiency ($\sim$0.1%) at low energies, the large acceptance ($\sim$5 m$^2$sr) of GRAPES-3 experiment allows observing primary cosmic rays down below to $\sim$1 TeV and opens up the possibility to measure primary energy spectrum spanning from a few TeV to beyond cosmic ray knee (up to 10$^{16}$ eV), covering five orders of magnitude. The GRAPES-3 energy threshold for primary protons through Monte Carlo simulations are calculated, which gives reasonably good agreement with data. Furthermore, the total efficiencies and acceptance are also calculated for protons primaries. The ability of GRAPES-3 experiment to cover such a broader energy range may provide a unique handle to bridge the energy spectrum between direct measurements at low energies and indirect measurements at ultra-high energies. △ Less

Submitted 3 May, 2020; originally announced May 2020.

Comments: 15 pages, 6 figures

Knowledge Base Completion: Baseline strikes back (Again)

Authors: Prachi Jain, Sushant Rathi, Mausam, Soumen Chakrabarti

Abstract: Knowledge Base Completion (KBC) has been a very active area lately. Several recent KBCpapers propose architectural changes, new training methods, or even new formulations. KBC systems are usually evaluated on standard benchmark datasets: FB15k, FB15k-237, WN18, WN18RR, and Yago3-10. Most existing methods train with a small number of negative samples for each positive instance in these datasets to… ▽ More Knowledge Base Completion (KBC) has been a very active area lately. Several recent KBCpapers propose architectural changes, new training methods, or even new formulations. KBC systems are usually evaluated on standard benchmark datasets: FB15k, FB15k-237, WN18, WN18RR, and Yago3-10. Most existing methods train with a small number of negative samples for each positive instance in these datasets to save computational costs. This paper discusses how recent developments allow us to use all available negative samples for training. We show that Complex, when trained using all available negative samples, gives near state-of-the-art performance on all the datasets. We call this approach COMPLEX-V2. We also highlight how various multiplicative KBC methods, recently proposed in the literature, benefit from this train-ing regime and become indistinguishable in terms of performance on most datasets. Our work calls for a reassessment of their individual value, in light of these findings. △ Less

Submitted 25 July, 2022; v1 submitted 2 May, 2020; originally announced May 2020.

On grand Sobolev spaces and pointwise description of Banach function spaces

Authors: Pankaj Jain, Anastasia Molchanova, Monika Singh, Sergey Vodopyanov

Abstract: We obtain a pointwise description of functions belonging to function spaces with the lattice property. In particular, it is valid for Banach function spaces provided that the Hardy-Littlewood maximal operator is bounded. We also study weighted grand Sobolev spaces, defined on arbitrary open sets (of finite or infinite measure), and provide pointwise description of them. We obtain a pointwise description of functions belonging to function spaces with the lattice property. In particular, it is valid for Banach function spaces provided that the Hardy-Littlewood maximal operator is bounded. We also study weighted grand Sobolev spaces, defined on arbitrary open sets (of finite or infinite measure), and provide pointwise description of them. △ Less

Submitted 12 August, 2020; v1 submitted 27 April, 2020; originally announced April 2020.

COVID-19: Strategies for Allocation of Test Kits

Authors: Arpita Biswas, Shruthi Bannur, Prateek Jain, Srujana Merugu

Abstract: With the increasing spread of COVID-19, it is important to systematically test more and more people. The current strategy for test-kit allocation is mostly rule-based, focusing on individuals having (a) symptoms for COVID-19, (b) travel history or (c) contact history with confirmed COVID-19 patients. Such testing strategy may miss out on detecting asymptomatic individuals who got infected via comm… ▽ More With the increasing spread of COVID-19, it is important to systematically test more and more people. The current strategy for test-kit allocation is mostly rule-based, focusing on individuals having (a) symptoms for COVID-19, (b) travel history or (c) contact history with confirmed COVID-19 patients. Such testing strategy may miss out on detecting asymptomatic individuals who got infected via community spread. Thus, it is important to allocate a separate budget of test-kits per day targeted towards preventing community spread and detecting new cases early on. In this report, we consider the problem of allocating test-kits and discuss some solution approaches. We believe that these approaches will be useful to contain community spread and detect new cases early on. Additionally, these approaches would help in collecting unbiased data which can then be used to improve the accuracy of machine learning models trained to predict COVID-19 infections. △ Less

Submitted 3 April, 2020; originally announced April 2020.

Staging energy sources to extend flight time of a multirotor UAV

Authors: Karan P. Jain, Jerry Tang, Koushil Sreenath, Mark W. Mueller

Abstract: Energy sources such as batteries do not decrease in mass after consumption, unlike combustion-based fuels. We present the concept of staging energy sources, i.e. consuming energy in stages and ejecting used stages, to progressively reduce the mass of aerial vehicles in-flight which reduces power consumption, and consequently increases flight time. A flight time vs. energy storage mass analysis is… ▽ More Energy sources such as batteries do not decrease in mass after consumption, unlike combustion-based fuels. We present the concept of staging energy sources, i.e. consuming energy in stages and ejecting used stages, to progressively reduce the mass of aerial vehicles in-flight which reduces power consumption, and consequently increases flight time. A flight time vs. energy storage mass analysis is presented to show the endurance benefit of staging to multirotors. We consider two specific problems in discrete staging -- optimal order of staging given a certain number of energy sources, and optimal partitioning of a given energy storage mass budget into a given number of stages. We then derive results for two continuously staged cases -- an internal combustion engine driving propellers and a rocket engine. Notably, we show that a multicopter powered by internal combustion has an upper limit on achievable flight time independent of the available fuel mass, but no such limit exists for rocket propulsion. Lastly, we validate the analysis with flight experiments on a custom two-stage battery-powered quadcopter. This quadcopter can eject a battery stage after consumption in-flight using a custom-designed mechanism, and continue hovering using the next stage. The experimental flight times match well with those predicted from the analysis for our vehicle. We achieve a 19% increase in flight time using the batteries in two stages as compared to a single stage. △ Less

Submitted 11 November, 2020; v1 submitted 9 March, 2020; originally announced March 2020.

Comments: UPDATE: The paper has been accepted at IROS 2020. The newest version is a post-peer-review version

A review of machine learning applications in wildfire science and management

Authors: Piyush Jain, Sean C P Coogan, Sriram Ganapathi Subramanian, Mark Crowley, Steve Taylor, Mike D Flannigan

Abstract: Artificial intelligence has been applied in wildfire science and management since the 1990s, with early applications including neural networks and expert systems. Since then the field has rapidly progressed congruently with the wide adoption of machine learning (ML) in the environmental sciences. Here, we present a scoping review of ML in wildfire science and management. Our objective is to improv… ▽ More Artificial intelligence has been applied in wildfire science and management since the 1990s, with early applications including neural networks and expert systems. Since then the field has rapidly progressed congruently with the wide adoption of machine learning (ML) in the environmental sciences. Here, we present a scoping review of ML in wildfire science and management. Our objective is to improve awareness of ML among wildfire scientists and managers, as well as illustrate the challenging range of problems in wildfire science available to data scientists. We first present an overview of popular ML approaches used in wildfire science to date, and then review their use in wildfire science within six problem domains: 1) fuels characterization, fire detection, and mapping; 2) fire weather and climate change; 3) fire occurrence, susceptibility, and risk; 4) fire behavior prediction; 5) fire effects; and 6) fire management. We also discuss the advantages and limitations of various ML approaches and identify opportunities for future advances in wildfire science and management within a data science context. We identified 298 relevant publications, where the most frequently used ML methods included random forests, MaxEnt, artificial neural networks, decision trees, support vector machines, and genetic algorithms. There exists opportunities to apply more current ML methods (e.g., deep learning and agent based learning) in wildfire science. However, despite the ability of ML models to learn on their own, expertise in wildfire science is necessary to ensure realistic modelling of fire processes across multiple scales, while the complexity of some ML methods requires sophisticated knowledge for their application. Finally, we stress that the wildfire research and management community plays an active role in providing relevant, high quality data for use by practitioners of ML methods. △ Less

Submitted 19 August, 2020; v1 submitted 1 March, 2020; originally announced March 2020.

Comments: 83 pages, 4 figures, 3 tables

Journal ref: Environmental Reviews. 28(4): 478-505, 2020

DROCC: Deep Robust One-Class Classification

Authors: Sachin Goyal, Aditi Raghunathan, Moksh Jain, Harsha Vardhan Simhadri, Prateek Jain

Abstract: Classical approaches for one-class problems such as one-class SVM and isolation forest require careful feature engineering when applied to structured domains like images. State-of-the-art methods aim to leverage deep learning to learn appropriate features via two main approaches. The first approach based on predicting transformations (Golan & El-Yaniv, 2018; Hendrycks et al., 2019a) while successf… ▽ More Classical approaches for one-class problems such as one-class SVM and isolation forest require careful feature engineering when applied to structured domains like images. State-of-the-art methods aim to leverage deep learning to learn appropriate features via two main approaches. The first approach based on predicting transformations (Golan & El-Yaniv, 2018; Hendrycks et al., 2019a) while successful in some domains, crucially depends on an appropriate domain-specific set of transformations that are hard to obtain in general. The second approach of minimizing a classical one-class loss on the learned final layer representations, e.g., DeepSVDD (Ruff et al., 2018) suffers from the fundamental drawback of representation collapse. In this work, we propose Deep Robust One-Class Classification (DROCC) that is both applicable to most standard domains without requiring any side-information and robust to representation collapse. DROCC is based on the assumption that the points from the class of interest lie on a well-sampled, locally linear low dimensional manifold. Empirical evaluation demonstrates that DROCC is highly effective in two different one-class problem settings and on a range of real-world datasets across different domains: tabular data, images (CIFAR and ImageNet), audio, and time-series, offering up to 20% increase in accuracy over the state-of-the-art in anomaly detection. Code is available at https://github.com/microsoft/EdgeML. △ Less

Submitted 15 August, 2020; v1 submitted 28 February, 2020; originally announced February 2020.

Comments: 16 pages, 9 figures, Published at International Conference on Machine Learning (ICML) 2020

RNNPool: Efficient Non-linear Pooling for RAM Constrained Inference

Authors: Oindrila Saha, Aditya Kusupati, Harsha Vardhan Simhadri, Manik Varma, Prateek Jain

Abstract: Standard Convolutional Neural Networks (CNNs) designed for computer vision tasks tend to have large intermediate activation maps. These require large working memory and are thus unsuitable for deployment on resource-constrained devices typically used for inference on the edge. Aggressively downsampling the images via pooling or strided convolutions can address the problem but leads to a significan… ▽ More Standard Convolutional Neural Networks (CNNs) designed for computer vision tasks tend to have large intermediate activation maps. These require large working memory and are thus unsuitable for deployment on resource-constrained devices typically used for inference on the edge. Aggressively downsampling the images via pooling or strided convolutions can address the problem but leads to a significant decrease in accuracy due to gross aggregation of the feature map by standard pooling operators. In this paper, we introduce RNNPool, a novel pooling operator based on Recurrent Neural Networks (RNNs), that efficiently aggregates features over large patches of an image and rapidly downsamples activation maps. Empirical evaluation indicates that an RNNPool layer can effectively replace multiple blocks in a variety of architectures such as MobileNets, DenseNet when applied to standard vision tasks like image classification and face detection. That is, RNNPool can significantly decrease computational complexity and peak memory usage for inference while retaining comparable accuracy. We use RNNPool with the standard S3FD architecture to construct a face detection method that achieves state-of-the-art MAP for tiny ARM Cortex-M4 class microcontrollers with under 256 KB of RAM. Code is released at https://github.com/Microsoft/EdgeML. △ Less

Submitted 22 October, 2020; v1 submitted 27 February, 2020; originally announced February 2020.

Comments: 25 pages, 8 figures. Published at Advances in Neural Information Processing Systems (NeurIPS) 2020

Soft Threshold Weight Reparameterization for Learnable Sparsity

Authors: Aditya Kusupati, Vivek Ramanujan, Raghav Somani, Mitchell Wortsman, Prateek Jain, Sham Kakade, Ali Farhadi

Abstract: Sparsity in Deep Neural Networks (DNNs) is studied extensively with the focus of maximizing prediction accuracy given an overall parameter budget. Existing methods rely on uniform or heuristic non-uniform sparsity budgets which have sub-optimal layer-wise parameter allocation resulting in a) lower prediction accuracy or b) higher inference cost (FLOPs). This work proposes Soft Threshold Reparamete… ▽ More Sparsity in Deep Neural Networks (DNNs) is studied extensively with the focus of maximizing prediction accuracy given an overall parameter budget. Existing methods rely on uniform or heuristic non-uniform sparsity budgets which have sub-optimal layer-wise parameter allocation resulting in a) lower prediction accuracy or b) higher inference cost (FLOPs). This work proposes Soft Threshold Reparameterization (STR), a novel use of the soft-threshold operator on DNN weights. STR smoothly induces sparsity while learning pruning thresholds thereby obtaining a non-uniform sparsity budget. Our method achieves state-of-the-art accuracy for unstructured sparsity in CNNs (ResNet50 and MobileNetV1 on ImageNet-1K), and, additionally, learns non-uniform budgets that empirically reduce the FLOPs by up to 50%. Notably, STR boosts the accuracy over existing results by up to 10% in the ultra sparse (99%) regime and can also be used to induce low-rank (structured sparsity) in RNNs. In short, STR is a simple mechanism which learns effective sparsity budgets that contrast with popular heuristics. Code, pretrained models and sparsity budgets are at https://github.com/RAIVNLab/STR. △ Less

Submitted 22 June, 2020; v1 submitted 8 February, 2020; originally announced February 2020.

Comments: 19 pages, 10 figures, Published at International Conference on Machine Learning (ICML) 2020

Rich-Item Recommendations for Rich-Users: Exploiting Dynamic and Static Side Information

Authors: Amar Budhiraja, Gaurush Hiranandani, Darshak Chhatbar, Aditya Sinha, Navya Yarrabelly, Ayush Choure, Oluwasanmi Koyejo, Prateek Jain

Abstract: In this paper, we study the problem of recommendation system where the users and items to be recommended are rich data structures with multiple entity types and with multiple sources of side-information in the form of graphs. We provide a general formulation for the problem that captures the complexities of modern real-world recommendations and generalizes many existing formulations. In our formul… ▽ More In this paper, we study the problem of recommendation system where the users and items to be recommended are rich data structures with multiple entity types and with multiple sources of side-information in the form of graphs. We provide a general formulation for the problem that captures the complexities of modern real-world recommendations and generalizes many existing formulations. In our formulation, each user/document that requires a recommendation and each item or tag that is to be recommended, both are modeled by a set of static entities and a dynamic component. The relationships between entities are captured by several weighted bipartite graphs. To effectively exploit these complex interactions and learn the recommendation model, we propose MEDRES- a multiple graph-CNN based novel deep-learning architecture. MEDRES uses AL-GCN, a novel graph convolution network block, that harnesses strong representative features from the underlying graphs. Moreover, in order to capture highly heterogeneous engagement of different users with the system and constraints on the number of items to be recommended, we propose a novel ranking metric pAp@k along with a method to optimize the metric directly. We demonstrate effectiveness of our method on two benchmarks: a) citation data, b) Flickr data. In addition, we present two real-world case studies of our formulation and the MEDRES architecture. We show how our technique can be used to naturally model the message recommendation problem and the teams recommendation problem in the Microsoft Teams (MSTeams) product and demonstrate that it is 5-6% points more accurate than the production-grade models. △ Less

Submitted 26 July, 2020; v1 submitted 28 January, 2020; originally announced January 2020.

Comments: The first two authors contributed equally. 21 pages, 8 figures and 6 tables

iGLU 2.0: A new non-invasive, accurate serum glucometer for smart healthcare

Authors: Prateek Jain, Amit M Joshi, Navneet Agrawal, Saraju Mohanty

Abstract: To best of the authors knowledge, this article presents the first-ever non-invasive glucometer that takes into account serum glucose for high accuracy. In case of blood glucose measurement, serum glucose value has always been considered precise blood glucose value during prandial modes. Serum glucose can be measured in laboratory and more stable glucose level compare to capillary glucose. However,… ▽ More To best of the authors knowledge, this article presents the first-ever non-invasive glucometer that takes into account serum glucose for high accuracy. In case of blood glucose measurement, serum glucose value has always been considered precise blood glucose value during prandial modes. Serum glucose can be measured in laboratory and more stable glucose level compare to capillary glucose. However, this invasive approach is not convenient for frequent measurement. Sometimes, Conventional invasive blood glucose measurement may be responsible for cause of trauma and chance of blood related infections. To overcome this issue, in the current paper, we propose a novel Internet-of-Medical (IoMT) enabled glucometer for non-invasive precise serum glucose measurement. In this work, a near-infrared (NIR) spectroscopic technique has been used for glucose measurement. The novel device called iGLU 2.0 is based on optical detection and precise machine learning (ML) regression models. The optimal multiple polynomial regression and deep neural network models have been presented to analyze the precise measurement. The glucose values of serum are saved on cloud through open IoT platform for endocrinologist at remote location. To validate iGLU 2.0, Mean Absolute Relative Difference (mARD) and Average Error (AvgE) are obtained 6.07% and 6.09%, respectively from predicted blood glucose values for capillary glucose. For serum glucose, mARD and AvgE are found 4.86% and 4.88%, respectively. These results represent that the proposed non-invasive glucose measurement device is more precise for serum glucose compared to capillary glucose. △ Less

Submitted 24 January, 2020; originally announced January 2020.

Comments: 19 pages, 17 Figures

Report number: TCE_iGLU_2020

Journal ref: IEEE Transactions on Consumer Electronics-2020