-
Purcell and collection efficiency enhancement of single NV- center emission coupled to an asymmetric Tamm structure
Authors:
Nitesh Singh,
Rajesh V Nair
Abstract:
The resonant modes associated with engineered photonic structures of different spatial-dimension are essential to obtain bright on-demand single photon sources for quantum technologies. Negatively-charged nitrogen-vacancy (NV-) center in diamond is proposed as an excellent single photon source at room temperature. The possible optical readout of spin states in diamond makes it a good candidate for…
▽ More
The resonant modes associated with engineered photonic structures of different spatial-dimension are essential to obtain bright on-demand single photon sources for quantum technologies. Negatively-charged nitrogen-vacancy (NV-) center in diamond is proposed as an excellent single photon source at room temperature. The possible optical readout of spin states in diamond makes it a good candidate for spin-photon interface. However, the poor light collection, feeble zero-phonon line, low emission rate, and the presence of broad phonon-induced emission limits the use of NV- center in quantum technologies. Here, we present a feasible, easy to fabricate, asymmetric Tamm structure coupled with single NV- center to enhance the emission rate of zero phonon line (ZPL) with better light collection efficiency. The asymmetric Tamm structure shows dual resonant mode with one of the modes coinciding with NV- ZPL wavelength of 640 nm. The quality factor (Q-factor) of the mode is 140 which is far better than the Q-factor of conventional Tamm structure and hence, better field intensity localization. We achieve four times Purcell enhancement along with an enhanced light collection efficiency of five times at 640 nm. The proposed structure is useful for generating bright single photons using NV- center and an efficient spin-photon interface.
△ Less
Submitted 22 October, 2022;
originally announced October 2022.
-
Human Behavioral Models Using Utility Theory and Prospect Theory
Authors:
Anuradha M. Annaswamy,
Vineet Jagadeesan Nair
Abstract:
Several examples of Cyber-physical human systems (CPHS) include real-time decisions from humans as a necessary building block for the successful performance of the overall system. Many of these decision-making problems necessitate an appropriate model of human behavior. Tools from Utility Theory have been used successfully in several problems in transportation for resource allocation and balance o…
▽ More
Several examples of Cyber-physical human systems (CPHS) include real-time decisions from humans as a necessary building block for the successful performance of the overall system. Many of these decision-making problems necessitate an appropriate model of human behavior. Tools from Utility Theory have been used successfully in several problems in transportation for resource allocation and balance of supply and demand \citep{ben1985discrete}. More recently, Prospect Theory has been demonstrated as a useful tool in behavioral economics and cognitive psychology for deriving human behavioral models that characterize their subjective decision-making in the presence of stochastic uncertainties and risks, as an alternative to conventional Utility Theory \citep{kahneman_prospect_2012}. These models will be described in this article. Theoretical implications of Prospect Theory are also discussed. Examples will be drawn from transportation use cases such as shared mobility to illustrate these models as well as the distinctions between Utility Theory and Prospect Theory.
△ Less
Submitted 13 October, 2022;
originally announced October 2022.
-
Uncovering Visually Impaired Gamers' Preferences for Spatial Awareness Tools Within Video Games
Authors:
Vishnu Nair,
Shao-en Ma,
Ricardo E. Gonzalez Penuela,
Yicheng He,
Karen Lin,
Mason Hayes,
Hannah Huddleston,
Matthew Donnelly,
Brian A. Smith
Abstract:
Sighted players gain spatial awareness within video games through sight and spatial awareness tools (SATs) such as minimaps. Visually impaired players (VIPs), however, must often rely heavily on SATs to gain spatial awareness, especially in complex environments where using rich ambient sound design alone may be insufficient. Researchers have developed many SATs for facilitating spatial awareness w…
▽ More
Sighted players gain spatial awareness within video games through sight and spatial awareness tools (SATs) such as minimaps. Visually impaired players (VIPs), however, must often rely heavily on SATs to gain spatial awareness, especially in complex environments where using rich ambient sound design alone may be insufficient. Researchers have developed many SATs for facilitating spatial awareness within VIPs. Yet this abundance disguises a gap in our understanding about how exactly these approaches assist VIPs in gaining spatial awareness and what their relative merits and limitations are. To address this, we investigate four leading approaches to facilitating spatial awareness for VIPs within a 3D video game context. Our findings uncover new insights into SATs for VIPs within video games, including that VIPs value position and orientation information the most from an SAT; that none of the approaches we investigated convey position and orientation effectively; and that VIPs highly value the ability to customize SATs.
△ Less
Submitted 30 August, 2022;
originally announced August 2022.
-
Mitigating Disparity while Maximizing Reward: Tight Anytime Guarantee for Improving Bandits
Authors:
Vishakha Patil,
Vineet Nair,
Ganesh Ghalme,
Arindam Khan
Abstract:
We study the Improving Multi-Armed Bandit (IMAB) problem, where the reward obtained from an arm increases with the number of pulls it receives. This model provides an elegant abstraction for many real-world problems in domains such as education and employment, where decisions about the distribution of opportunities can affect the future capabilities of communities and the disparity between them. A…
▽ More
We study the Improving Multi-Armed Bandit (IMAB) problem, where the reward obtained from an arm increases with the number of pulls it receives. This model provides an elegant abstraction for many real-world problems in domains such as education and employment, where decisions about the distribution of opportunities can affect the future capabilities of communities and the disparity between them. A decision-maker in such settings must consider the impact of her decisions on future rewards in addition to the standard objective of maximizing her cumulative reward at any time. In many of these applications, the time horizon is unknown to the decision-maker beforehand, which motivates the study of the IMAB problem in the technically more challenging horizon-unaware setting. We study the tension that arises between two seemingly conflicting objectives in the horizon-unaware setting: a) maximizing the cumulative reward at any time based on current rewards of the arms, and b) ensuring that arms with better long-term rewards get sufficient opportunities even if they initially have low rewards. We show that, surprisingly, the two objectives are aligned with each other in this setting. Our main contribution is an anytime algorithm for the IMAB problem that achieves the best possible cumulative reward while ensuring that the arms reach their true potential given sufficient time. Our algorithm mitigates the initial disparity due to lack of opportunity and continues pulling an arm till it stops improving. We prove the optimality of our algorithm by showing that a) any algorithm for the IMAB problem, no matter how utilitarian, must suffer $Ω(T)$ policy regret and $Ω(k)$ competitive ratio with respect to the optimal offline policy, and b) the competitive ratio of our algorithm is $O(k)$.
△ Less
Submitted 19 August, 2022;
originally announced August 2022.
-
Comparing Baseline Shapley and Integrated Gradients for Local Explanation: Some Additional Insights
Authors:
Tianshu Feng,
Zhipu Zhou,
Joshi Tarun,
Vijayan N. Nair
Abstract:
There are many different methods in the literature for local explanation of machine learning results. However, the methods differ in their approaches and often do not provide same explanations. In this paper, we consider two recent methods: Integrated Gradients (Sundararajan, Taly, & Yan, 2017) and Baseline Shapley (Sundararajan and Najmi, 2020). The original authors have already studied the axiom…
▽ More
There are many different methods in the literature for local explanation of machine learning results. However, the methods differ in their approaches and often do not provide same explanations. In this paper, we consider two recent methods: Integrated Gradients (Sundararajan, Taly, & Yan, 2017) and Baseline Shapley (Sundararajan and Najmi, 2020). The original authors have already studied the axiomatic properties of the two methods and provided some comparisons. Our work provides some additional insights on their comparative behavior for tabular data. We discuss common situations where the two provide identical explanations and where they differ. We also use simulation studies to examine the differences when neural networks with ReLU activation function is used to fit the models.
△ Less
Submitted 11 August, 2022;
originally announced August 2022.
-
Going Incognito in the Metaverse: Achieving Theoretically Optimal Privacy-Usability Tradeoffs in VR
Authors:
Vivek Nair,
Gonzalo Munilla Garrido,
Dawn Song
Abstract:
Virtual reality (VR) telepresence applications and the so-called "metaverse" promise to be the next major medium of human-computer interaction. However, with recent studies demonstrating the ease at which VR users can be profiled and deanonymized, metaverse platforms carry many of the privacy risks of the conventional internet (and more) while at present offering few of the defensive utilities tha…
▽ More
Virtual reality (VR) telepresence applications and the so-called "metaverse" promise to be the next major medium of human-computer interaction. However, with recent studies demonstrating the ease at which VR users can be profiled and deanonymized, metaverse platforms carry many of the privacy risks of the conventional internet (and more) while at present offering few of the defensive utilities that users are accustomed to having access to. To remedy this, we present the first known method of implementing an "incognito mode" for VR. Our technique leverages local differential privacy to quantifiably obscure sensitive user data attributes, with a focus on intelligently adding noise when and where it is needed most to maximize privacy while minimizing usability impact. Our system is capable of flexibly adapting to the unique needs of each VR application to further optimize this trade-off. We implement our solution as a universal Unity (C#) plugin that we then evaluate using several popular VR applications. Upon faithfully replicating the most well-known VR privacy attack studies, we show a significant degradation of attacker capabilities when using our solution.
△ Less
Submitted 23 October, 2023; v1 submitted 10 August, 2022;
originally announced August 2022.
-
Multi-Factor Key Derivation Function (MFKDF) for Fast, Flexible, Secure, & Practical Key Management
Authors:
Vivek Nair,
Dawn Song
Abstract:
We present the first general construction of a Multi-Factor Key Derivation Function (MFKDF). Our function expands upon password-based key derivation functions (PBKDFs) with support for using other popular authentication factors like TOTP, HOTP, and hardware tokens in the key derivation process. In doing so, it provides an exponential security improvement over PBKDFs with less than 12 ms of additio…
▽ More
We present the first general construction of a Multi-Factor Key Derivation Function (MFKDF). Our function expands upon password-based key derivation functions (PBKDFs) with support for using other popular authentication factors like TOTP, HOTP, and hardware tokens in the key derivation process. In doing so, it provides an exponential security improvement over PBKDFs with less than 12 ms of additional computational overhead in a typical web browser. We further present a threshold MFKDF construction, allowing for client-side key recovery and reconstitution if a factor is lost. Finally, by "stacking" derived keys, we provide a means of cryptographically enforcing arbitrarily specific key derivation policies. The result is a paradigm shift toward direct cryptographic protection of user data using all available authentication factors, with no noticeable change to the user experience. We demonstrate the ability of our solution to not only significantly improve the security of existing systems implementing PBKDFs, but also to enable new applications where PBKDFs would not be considered a feasible approach.
△ Less
Submitted 16 February, 2023; v1 submitted 10 August, 2022;
originally announced August 2022.
-
Learning to Learn to Predict Performance Regressions in Production at Meta
Authors:
Moritz Beller,
Hongyu Li,
Vivek Nair,
Vijayaraghavan Murali,
Imad Ahmad,
Jürgen Cito,
Drew Carlson,
Ari Aye,
Wes Dyer
Abstract:
Catching and attributing code change-induced performance regressions in production is hard; predicting them beforehand, even harder. A primer on automatically learning to predict performance regressions in software, this article gives an account of the experiences we gained when researching and deploying an ML-based regression prediction pipeline at Meta. In this paper, we report on a comparative…
▽ More
Catching and attributing code change-induced performance regressions in production is hard; predicting them beforehand, even harder. A primer on automatically learning to predict performance regressions in software, this article gives an account of the experiences we gained when researching and deploying an ML-based regression prediction pipeline at Meta. In this paper, we report on a comparative study with four ML models of increasing complexity, from (1) code-opaque, over (2) Bag of Words, (3) off-the-shelve Transformer-based, to (4) a bespoke Transformer-based model, coined SuperPerforator. Our investigation shows the inherent difficulty of the performance prediction problem, which is characterized by a large imbalance of benign onto regressing changes. Our results also call into question the general applicability of Transformer-based architectures for performance prediction: an off-the-shelve CodeBERT-based approach had surprisingly poor performance; our highly customized SuperPerforator architecture initially achieved prediction performance that was just on par with simpler Bag of Words models, and only outperformed them for down-stream use cases. This ability of SuperPerforator to transfer to an application with few learning examples afforded an opportunity to deploy it in practice at Meta: it can act as a pre-filter to sort out changes that are unlikely to introduce a regression, truncating the space of changes to search a regression in by up to 43%, a 45x improvement over a random baseline. To gain further insight into SuperPerforator, we explored it via a series of experiments computing counterfactual explanations. These highlight which parts of a code change the model deems important, thereby validating the learned black-box model.
△ Less
Submitted 22 May, 2023; v1 submitted 8 August, 2022;
originally announced August 2022.
-
Exploring the Privacy Risks of Adversarial VR Game Design
Authors:
Vivek Nair,
Gonzalo Munilla Garrido,
Dawn Song,
James F. O'Brien
Abstract:
Fifty study participants playtested an innocent-looking "escape room" game in virtual reality (VR). Within just a few minutes, an adversarial program had accurately inferred over 25 of their personal data attributes, from anthropometrics like height and wingspan to demographics like age and gender. As notoriously data-hungry companies become increasingly involved in VR development, this experiment…
▽ More
Fifty study participants playtested an innocent-looking "escape room" game in virtual reality (VR). Within just a few minutes, an adversarial program had accurately inferred over 25 of their personal data attributes, from anthropometrics like height and wingspan to demographics like age and gender. As notoriously data-hungry companies become increasingly involved in VR development, this experimental scenario may soon represent a typical VR user experience. Since the Cambridge Analytica scandal of 2018, adversarially designed gamified elements have been known to constitute a significant privacy threat in conventional social platforms. In this work, we present a case study of how metaverse environments can similarly be adversarially constructed to covertly infer dozens of personal data attributes from seemingly anonymous users. While existing VR privacy research largely focuses on passive observation, we argue that because individuals subconsciously reveal personal information via their motion in response to specific stimuli, active attacks pose an outsized risk in VR environments.
△ Less
Submitted 13 December, 2023; v1 submitted 26 July, 2022;
originally announced July 2022.
-
Impacts of Dynamic Line Ratings on the ERCOT Transmission System
Authors:
Thomas Lee,
Vineet Jagadeesan Nair,
Andy Sun
Abstract:
Grid regulators and participants are paying increasing attention to Dynamic Line Ratings (DLR) as a new approach to address transmission system bottlenecks. In this paper, a thorough comparison of DLR, Ambient Adjusted Ratings (AAR), and the traditional Static Line Ratings (SLR) are conducted on a synthetic ERCOT grid. Estimates of DLR and AAR are calculated using an equation based on heat balance…
▽ More
Grid regulators and participants are paying increasing attention to Dynamic Line Ratings (DLR) as a new approach to address transmission system bottlenecks. In this paper, a thorough comparison of DLR, Ambient Adjusted Ratings (AAR), and the traditional Static Line Ratings (SLR) are conducted on a synthetic ERCOT grid. Estimates of DLR and AAR are calculated using an equation based on heat balance physics, along with high-resolution weather data of temperature and wind velocities. A constraint generation method for contingency screening is developed for solving security-constrained optimal power flow. Numerical results suggest that employing DLR could double the benefits compared to those of AAR relative to SLR, in terms of system costs, renewable curtailment, and emissions.
△ Less
Submitted 22 July, 2022;
originally announced July 2022.
-
Using Model-Based Trees with Boosting to Fit Low-Order Functional ANOVA Models
Authors:
Linwei Hu,
Jie Chen,
Vijayan N. Nair
Abstract:
Low-order functional ANOVA (fANOVA) models have been rediscovered in the machine learning (ML) community under the guise of inherently interpretable machine learning. Explainable Boosting Machines or EBM (Lou et al. 2013) and GAMI-Net (Yang et al. 2021) are two recently proposed ML algorithms for fitting functional main effects and second-order interactions. We propose a new algorithm, called GAMI…
▽ More
Low-order functional ANOVA (fANOVA) models have been rediscovered in the machine learning (ML) community under the guise of inherently interpretable machine learning. Explainable Boosting Machines or EBM (Lou et al. 2013) and GAMI-Net (Yang et al. 2021) are two recently proposed ML algorithms for fitting functional main effects and second-order interactions. We propose a new algorithm, called GAMI-Tree, that is similar to EBM, but has a number of features that lead to better performance. It uses model-based trees as base learners and incorporates a new interaction filtering method that is better at capturing the underlying interactions. In addition, our iterative training method converges to a model with better predictive performance, and the embedded purification ensures that interactions are hierarchically orthogonal to main effects. The algorithm does not need extensive tuning, and our implementation is fast and efficient. We use simulated and real datasets to compare the performance and interpretability of GAMI-Tree with EBM and GAMI-Net.
△ Less
Submitted 15 December, 2023; v1 submitted 14 July, 2022;
originally announced July 2022.
-
Remarks on Entanglement for Fuzzy Geometry and Gravity
Authors:
V. P. Nair
Abstract:
We consider defining a fuzzy space by a specific state in a fermionic field theory in terms of which all the observables for the space can be evaluated. This allows for a definition of entanglement for a fuzzy space by direct integration of the fields over a certain region. Even though the resulting formula for the entanglement entropy (EE) is similar to what has been used in the quantum Hall effe…
▽ More
We consider defining a fuzzy space by a specific state in a fermionic field theory in terms of which all the observables for the space can be evaluated. This allows for a definition of entanglement for a fuzzy space by direct integration of the fields over a certain region. Even though the resulting formula for the entanglement entropy (EE) is similar to what has been used in the quantum Hall effect, our derivation provides a novel perspective. We also review and strengthen the arguments for the EE to be described by a generalized Chern-Simons form.
△ Less
Submitted 11 July, 2022;
originally announced July 2022.
-
Quantifying Inherent Randomness in Machine Learning Algorithms
Authors:
Soham Raste,
Rahul Singh,
Joel Vaughan,
Vijayan N. Nair
Abstract:
Most machine learning (ML) algorithms have several stochastic elements, and their performances are affected by these sources of randomness. This paper uses an empirical study to systematically examine the effects of two sources: randomness in model training and randomness in the partitioning of a dataset into training and test subsets. We quantify and compare the magnitude of the variation in pred…
▽ More
Most machine learning (ML) algorithms have several stochastic elements, and their performances are affected by these sources of randomness. This paper uses an empirical study to systematically examine the effects of two sources: randomness in model training and randomness in the partitioning of a dataset into training and test subsets. We quantify and compare the magnitude of the variation in predictive performance for the following ML algorithms: Random Forests (RFs), Gradient Boosting Machines (GBMs), and Feedforward Neural Networks (FFNNs). Among the different algorithms, randomness in model training causes larger variation for FFNNs compared to tree-based methods. This is to be expected as FFNNs have more stochastic elements that are part of their model initialization and training. We also found that random splitting of datasets leads to higher variation compared to the inherent randomness from model training. The variation from data splitting can be a major issue if the original dataset has considerable heterogeneity.
Keywords: Model Training, Reproducibility, Variation
△ Less
Submitted 24 June, 2022;
originally announced June 2022.
-
Fractional topological charge in $SU(N)$ gauge theories without dynamical quarks
Authors:
V. P. Nair,
Robert D. Pisarski
Abstract:
In $SU(N)$ gauge theories without dynamical quarks, we discuss how configurations with fractional topological charge, $\sim 1/N$, can arise in the vacuum and dominate in the confining phase. They are not solutions of the classical equations of motion, but arise as quantum solutions of the effective Lagrangian. Their size is essentially fixed, on the order of the confinement scale. We give both a g…
▽ More
In $SU(N)$ gauge theories without dynamical quarks, we discuss how configurations with fractional topological charge, $\sim 1/N$, can arise in the vacuum and dominate in the confining phase. They are not solutions of the classical equations of motion, but arise as quantum solutions of the effective Lagrangian. Their size is essentially fixed, on the order of the confinement scale. We give both a general mathematical analysis and illustrative solutions. Their presence can be measured through numerical simulations on the lattice using known methods. As they carry $\mathbb{Z}_N$ magnetic charge, the introduction of dynamical quarks significantly complicates their dynamics.
△ Less
Submitted 6 September, 2023; v1 submitted 22 June, 2022;
originally announced June 2022.
-
Gauge and Scalar Fields on $\mathbb{CP}^2$: A Gauge-invariant Analysis II. The measure for gauge fields and a 4d WZW theory
Authors:
Dimitra Karabali,
Antonina Maj,
V. P. Nair
Abstract:
We consider the volume of the gauge orbit space for gauge fields on four-dimensional complex projective space. The analysis uses a parametrization of gauge fields where gauge transformations act homogeneously on the fields, facilitating a manifestly gauge-invariant analysis. The volume element contains a four-dimensional Wess-Zumino-Witten (WZW) action for a hermitian matrix-valued field. There is…
▽ More
We consider the volume of the gauge orbit space for gauge fields on four-dimensional complex projective space. The analysis uses a parametrization of gauge fields where gauge transformations act homogeneously on the fields, facilitating a manifestly gauge-invariant analysis. The volume element contains a four-dimensional Wess-Zumino-Witten (WZW) action for a hermitian matrix-valued field. There is also a mass-like term for certain components of the gauge field. We discuss how the mass term could be related to results from lattice simulations as well as Schwinger-Dyson equations. We argue for a kinematic regime where the Yang-Mills theory can be approximated by the 4d-WZW theory. The result is suggestive of the instanton liquid picture of QCD. Further it is also indicative of the mechanism for confinement being similar to what happens in two dimensions.
△ Less
Submitted 16 November, 2022; v1 submitted 20 June, 2022;
originally announced June 2022.
-
Strategic Representation
Authors:
Vineet Nair,
Ganesh Ghalme,
Inbal Talgam-Cohen,
Nir Rosenfeld
Abstract:
Humans have come to rely on machines for reducing excessive information to manageable representations. But this reliance can be abused -- strategic machines might craft representations that manipulate their users. How can a user make good choices based on strategic representations? We formalize this as a learning problem, and pursue algorithms for decision-making that are robust to manipulation. I…
▽ More
Humans have come to rely on machines for reducing excessive information to manageable representations. But this reliance can be abused -- strategic machines might craft representations that manipulate their users. How can a user make good choices based on strategic representations? We formalize this as a learning problem, and pursue algorithms for decision-making that are robust to manipulation. In our main setting of interest, the system represents attributes of an item to the user, who then decides whether or not to consume. We model this interaction through the lens of strategic classification (Hardt et al. 2016), reversed: the user, who learns, plays first; and the system, which responds, plays second. The system must respond with representations that reveal `nothing but the truth' but need not reveal the entire truth. Thus, the user faces the problem of learning set functions under strategic subset selection, which presents distinct algorithmic and statistical challenges. Our main result is a learning algorithm that minimizes error despite strategic representations, and our theoretical analysis sheds light on the trade-off between learning effort and susceptibility to manipulation.
△ Less
Submitted 17 June, 2022;
originally announced June 2022.
-
Interpretable Feature Engineering for Time Series Predictors using Attention Networks
Authors:
Tianjie Wang,
Jie Chen,
Joel Vaughan,
Vijayan N. Nair
Abstract:
Regression problems with time-series predictors are common in banking and many other areas of application. In this paper, we use multi-head attention networks to develop interpretable features and use them to achieve good predictive performance. The customized attention layer explicitly uses multiplicative interactions and builds feature-engineering heads that capture temporal dynamics in a parsim…
▽ More
Regression problems with time-series predictors are common in banking and many other areas of application. In this paper, we use multi-head attention networks to develop interpretable features and use them to achieve good predictive performance. The customized attention layer explicitly uses multiplicative interactions and builds feature-engineering heads that capture temporal dynamics in a parsimonious manner. Convolutional layers are used to combine multivariate time series. We also discuss methods for handling static covariates in the modeling process. Visualization and explanation tools are used to interpret the results and explain the relationship between the inputs and the extracted features. Both simulation and real dataset are used to illustrate the usefulness of the methodology. Keyword: Attention heads, Deep neural networks, Interpretable feature engineering
△ Less
Submitted 23 May, 2022;
originally announced May 2022.
-
ADVISER: AI-Driven Vaccination Intervention Optimiser for Increasing Vaccine Uptake in Nigeria
Authors:
Vineet Nair,
Kritika Prakash,
Michael Wilbur,
Aparna Taneja,
Corinne Namblard,
Oyindamola Adeyemo,
Abhishek Dubey,
Abiodun Adereni,
Milind Tambe,
Ayan Mukhopadhyay
Abstract:
More than 5 million children under five years die from largely preventable or treatable medical conditions every year, with an overwhelmingly large proportion of deaths occurring in under-developed countries with low vaccination uptake. One of the United Nations' sustainable development goals (SDG 3) aims to end preventable deaths of newborns and children under five years of age. We focus on Niger…
▽ More
More than 5 million children under five years die from largely preventable or treatable medical conditions every year, with an overwhelmingly large proportion of deaths occurring in under-developed countries with low vaccination uptake. One of the United Nations' sustainable development goals (SDG 3) aims to end preventable deaths of newborns and children under five years of age. We focus on Nigeria, where the rate of infant mortality is appalling. We collaborate with HelpMum, a large non-profit organization in Nigeria to design and optimize the allocation of heterogeneous health interventions under uncertainty to increase vaccination uptake, the first such collaboration in Nigeria. Our framework, ADVISER: AI-Driven Vaccination Intervention Optimiser, is based on an integer linear program that seeks to maximize the cumulative probability of successful vaccination. Our optimization formulation is intractable in practice. We present a heuristic approach that enables us to solve the problem for real-world use-cases. We also present theoretical bounds for the heuristic method. Finally, we show that the proposed approach outperforms baseline methods in terms of vaccination uptake through experimental evaluation. HelpMum is currently planning a pilot program based on our approach to be deployed in the largest city of Nigeria, which would be the first deployment of an AI-driven vaccination uptake program in the country and hopefully, pave the way for other data-driven programs to improve health outcomes in Nigeria.
△ Less
Submitted 5 July, 2022; v1 submitted 28 April, 2022;
originally announced April 2022.
-
Performance and Interpretability Comparisons of Supervised Machine Learning Algorithms: An Empirical Study
Authors:
Alice J. Liu,
Arpita Mukherjee,
Linwei Hu,
Jie Chen,
Vijayan N. Nair
Abstract:
This paper compares the performances of three supervised machine learning algorithms in terms of predictive ability and model interpretation on structured or tabular data. The algorithms considered were scikit-learn implementations of extreme gradient boosting machines (XGB) and random forests (RFs), and feedforward neural networks (FFNNs) from TensorFlow. The paper is organized in a findings-base…
▽ More
This paper compares the performances of three supervised machine learning algorithms in terms of predictive ability and model interpretation on structured or tabular data. The algorithms considered were scikit-learn implementations of extreme gradient boosting machines (XGB) and random forests (RFs), and feedforward neural networks (FFNNs) from TensorFlow. The paper is organized in a findings-based manner, with each section providing general conclusions supported by empirical results from simulation studies that cover a wide range of model complexity and correlation structures among predictors. We considered both continuous and binary responses of different sample sizes.
Overall, XGB and FFNNs were competitive, with FFNNs showing better performance in smooth models and tree-based boosting algorithms performing better in non-smooth models. This conclusion held generally for predictive performance, identification of important variables, and determining correct input-output relationships as measured by partial dependence plots (PDPs). FFNNs generally had less over-fitting, as measured by the difference in performance between training and testing datasets. However, the difference with XGB was often small. RFs did not perform well in general, confirming the findings in the literature. All models exhibited different degrees of bias seen in PDPs, but the bias was especially problematic for RFs. The extent of the biases varied with correlation among predictors, response type, and data set sample size. In general, tree-based models tended to over-regularize the fitted model in the tails of predictor distributions. Finally, as to be expected, performances were better for continuous responses compared to binary data and with larger samples.
△ Less
Submitted 5 May, 2022; v1 submitted 27 April, 2022;
originally announced April 2022.
-
Explaining Adverse Actions in Credit Decisions Using Shapley Decomposition
Authors:
Vijayan N. Nair,
Tianshu Feng,
Linwei Hu,
Zach Zhang,
Jie Chen,
Agus Sudjianto
Abstract:
When a financial institution declines an application for credit, an adverse action (AA) is said to occur. The applicant is then entitled to an explanation for the negative decision. This paper focuses on credit decisions based on a predictive model for probability of default and proposes a methodology for AA explanation. The problem involves identifying the important predictors responsible for the…
▽ More
When a financial institution declines an application for credit, an adverse action (AA) is said to occur. The applicant is then entitled to an explanation for the negative decision. This paper focuses on credit decisions based on a predictive model for probability of default and proposes a methodology for AA explanation. The problem involves identifying the important predictors responsible for the negative decision and is straightforward when the underlying model is additive. However, it becomes non-trivial even for linear models with interactions. We consider models with low-order interactions and develop a simple and intuitive approach based on first principles. We then show how the methodology generalizes to the well-known Shapely decomposition and the recently proposed concept of Baseline Shapley (B-Shap). Unlike other Shapley techniques in the literature for local interpretability of machine learning results, B-Shap is computationally tractable since it involves just function evaluations. An illustrative case study is used to demonstrate the usefulness of the method. The paper also discusses situations with highly correlated predictors and desirable properties of fitted models in the credit-lending context, such as monotonicity and continuity.
△ Less
Submitted 26 April, 2022;
originally announced April 2022.
-
Entanglement Entropy and Matter-Gravity Couplings for Fuzzy Geometry
Authors:
V. P. Nair
Abstract:
In this talk I discuss some features of the entanglement entropy for fuzzy geometry, focusing on its dependence on the background fields and the spin connection of the emergent continuous manifold in a large $N$ limit. Using the Landau-Hall paradigm for fuzzy geometry, this is argued to be given by a generalized Chern-Simons form, making a point of connection with the thermodynamic view of gravity…
▽ More
In this talk I discuss some features of the entanglement entropy for fuzzy geometry, focusing on its dependence on the background fields and the spin connection of the emergent continuous manifold in a large $N$ limit. Using the Landau-Hall paradigm for fuzzy geometry, this is argued to be given by a generalized Chern-Simons form, making a point of connection with the thermodynamic view of gravity. Matter-gravity couplings are also considered in the same framework; they naturally lead to certain specific nonminimal couplings involving powers of the curvature.
△ Less
Submitted 27 March, 2022;
originally announced March 2022.
-
Topological fluids with boundaries and fractional quantum Hall edge dynamics: A fluid dynamics derivation of the chiral boson action
Authors:
Gustavo M. Monteiro,
V. P. Nair,
Sriram Ganeshan
Abstract:
This paper investigates the bulk and boundary dynamics of Laughlin states, which are modeled using composite boson theory within a fluid dynamics framework. In this work, we adopt an alternative starting point based on a hydrodynamic action with topological terms, which fleshes out the fluid aspects of the Laughlin state manifestly. For a particular choice of the velocity field, the fluid equation…
▽ More
This paper investigates the bulk and boundary dynamics of Laughlin states, which are modeled using composite boson theory within a fluid dynamics framework. In this work, we adopt an alternative starting point based on a hydrodynamic action with topological terms, which fleshes out the fluid aspects of the Laughlin state manifestly. For a particular choice of the velocity field, the fluid equation for this action is akin to first-order hydrodynamic equations, supplemented with an additional constitutive equation known as the Hall constraint. When a hard wall boundary is present, one of the topological terms in the fluid action triggers anomaly inflow, indicating the presence of gauge anomaly at the edge. The first-order hydrodynamic equations require a second boundary condition which, in the absence of dissipation, can be either a no-slip or a no-stress condition. We find that the no-slip condition, where the fluid adheres to the wall is incompatible with the chiral edge dynamics. On the other hand, the no-stress condition, which allows the fluid to move along the wall without friction, is consistent with the expected chiral edge dynamics of the Laughlin state. Furthermore, our work derives this modified no-stress boundary condition within a variational principle. This is accomplished by incorporating a chiral boson action within the boundary action that is non-linearly coupled to the edge density, thus systematically extending the edge chiral Luttinger liquid theory.
△ Less
Submitted 29 March, 2024; v1 submitted 12 March, 2022;
originally announced March 2022.
-
Kerker condition for enhancing emission rate and directivity of single emitter coupled to dielectric metasurfaces
Authors:
Megha Khokhar,
Faraz A Inam,
Rajesh V Nair
Abstract:
Metasurfaces have the ability to control classical and non-classical states of light to achieve controlled emission even at the level of single emitter. Here, we unveil the Kerker condition induced emission rate enhancement with strong directivity from a single emitter integrated within a dielectric metasurface consists of silicon nano-disks. The simulation and analytical calculations attest the K…
▽ More
Metasurfaces have the ability to control classical and non-classical states of light to achieve controlled emission even at the level of single emitter. Here, we unveil the Kerker condition induced emission rate enhancement with strong directivity from a single emitter integrated within a dielectric metasurface consists of silicon nano-disks. The simulation and analytical calculations attest the Kerker condition with unidirectional light scattering evolved by the constructive interference between electric dipole, toroidal dipole, and the magnetic quadrupole. The results evince spatially-dependent enhanced local density of optical states which reciprocates localized field intensity. The rate enhancement of 400 times is achieved at zero phonon line of nitrogen-vacancy center with superior emission directivity and collection efficiency. The results have implications in on-demand single photon generation, spin-photon interface, many-body interactions, and strong coupling.
△ Less
Submitted 15 February, 2022;
originally announced February 2022.
-
Gürsey, Groups & Fluids
Authors:
V. P. Nair
Abstract:
Feza Gürsey was a brilliant physicist who loved symmetries and beautiful mathematical structures such as group theory and division algebras. In this centenary year, I give a brief review of some of his contributions and then zero-in on group theory and discuss how it can give us a new perspective on a centuries-old topic, namely, fluid dynamics, including new facets such as the chiral magnetic eff…
▽ More
Feza Gürsey was a brilliant physicist who loved symmetries and beautiful mathematical structures such as group theory and division algebras. In this centenary year, I give a brief review of some of his contributions and then zero-in on group theory and discuss how it can give us a new perspective on a centuries-old topic, namely, fluid dynamics, including new facets such as the chiral magnetic effect. \vskip .1in \noindent This is a slightly edited and enhanced version of a colloquium at the Middle East Technical University on December 9, 2021, which was organized in celebration of the centenary of Feza Gürsey. The video of the presentation can be accessed by following the link given at http://www.physics.metu.edu.tr/Department/FezaGursey2021 or by clicking https://www.youtube.com/watch?v=DstVVuOlqGk for direct access.
△ Less
Submitted 18 December, 2021;
originally announced December 2021.
-
Superselection, Boundary Algebras and Duality in Gauge Theories
Authors:
A. P. Balachandran,
V. P. Nair,
A. Pinzul,
A. F. Reyes-Lega,
S. Vaidya
Abstract:
We consider the generators of gauge transformations with test functions which do not vanish on the boundary of a spacelike region of interest. These are known to generate the edge degrees of freedom in a gauge theory. In this paper, we augment these by introducing the dual or magnetic analogue of such operators. We then study the algebra of these operators, focusing on implications for the superse…
▽ More
We consider the generators of gauge transformations with test functions which do not vanish on the boundary of a spacelike region of interest. These are known to generate the edge degrees of freedom in a gauge theory. In this paper, we augment these by introducing the dual or magnetic analogue of such operators. We then study the algebra of these operators, focusing on implications for the superselection sectors of the gauge theory. A manifestly duality-invariant action is also considered, from which alternate descriptions which are $SL(2, \mathbb{Z})$ transforms of each other can be obtained. We also comment on a number of issues related to local charges, definition of confinement and the appearance of interesting mathematical structures such as the Drinfel'd double and the Manin triple.
△ Less
Submitted 16 December, 2021;
originally announced December 2021.
-
Uncertainties in Quantum Measurements: A Quantum Tomography
Authors:
A. P. Balachandran,
F. Calderón,
V. P. Nair,
Aleksandr Pinzul,
A. F. Reyes-Lega,
S. Vaidya
Abstract:
The observables associated with a quantum system $S$ form a non-commutative algebra ${\mathcal A}_S$. It is assumed that a density matrix $ρ$ can be determined from the expectation values of observables. But $\mathcal A_S$ admits inner automorphisms $a\mapsto uau^{-1},\; a,u\in {\mathcal A}_S$, $u^*u=u^*u=1$, so that its individual elements can be identified only up to unitary transformations. So…
▽ More
The observables associated with a quantum system $S$ form a non-commutative algebra ${\mathcal A}_S$. It is assumed that a density matrix $ρ$ can be determined from the expectation values of observables. But $\mathcal A_S$ admits inner automorphisms $a\mapsto uau^{-1},\; a,u\in {\mathcal A}_S$, $u^*u=u^*u=1$, so that its individual elements can be identified only up to unitary transformations. So since $\mathrm{Tr} ρ(uau^*)= \mathrm{Tr} (u^*ρu)a$, only the spectrum of $ρ$, or its characteristic polynomial, can be determined in quantum mechanics. In local quantum field theory, $ρ$ cannot be determined at all, as we shall explain. However, abelian algebras do not have inner automorphisms, so the measurement apparatus can determine mean values of observables in abelian algebras ${\mathcal A}_M\subset {\mathcal A}_S$ ($M$ for measurement, $S$ for system). We study the uncertainties in extending $ρ|_{{\mathcal A}_M}$ to $ρ|_{{\mathcal A}_S}$ (the determination of which means measurement of ${\mathcal A}_S$) and devise a protocol to determine $ρ|_{{\mathcal A}_S}\equiv ρ$ by determining $ρ|_{{\mathcal A}_M}$ for different choices of ${\mathcal A}_M$. The problem we formulate and study is a generalization of the Kadison-Singer theorem. We give an example where the system $S$ is a particle on a circle and the experiment measures the abelian algebra of a magnetic field $B$ coupled to $S$. The measurement of $B$ gives information about the state $ρ$ of the system $S$ due to operator mixing. Associated uncertainty principles for von Neumann entropy are discussed in the appendix, adapting the earlier work of Białynicki-Birula and Mycielski to the present case.
△ Less
Submitted 14 December, 2021;
originally announced December 2021.
-
Automap: Towards Ergonomic Automated Parallelism for ML Models
Authors:
Michael Schaarschmidt,
Dominik Grewe,
Dimitrios Vytiniotis,
Adam Paszke,
Georg Stefan Schmid,
Tamara Norman,
James Molloy,
Jonathan Godwin,
Norman Alexander Rink,
Vinod Nair,
Dan Belov
Abstract:
The rapid rise in demand for training large neural network architectures has brought into focus the need for partitioning strategies, for example by using data, model, or pipeline parallelism. Implementing these methods is increasingly supported through program primitives, but identifying efficient partitioning strategies requires expensive experimentation and expertise. We present the prototype o…
▽ More
The rapid rise in demand for training large neural network architectures has brought into focus the need for partitioning strategies, for example by using data, model, or pipeline parallelism. Implementing these methods is increasingly supported through program primitives, but identifying efficient partitioning strategies requires expensive experimentation and expertise. We present the prototype of an automated partitioner that seamlessly integrates into existing compilers and existing user workflows. Our partitioner enables SPMD-style parallelism that encompasses data parallelism and parameter/activation sharding. Through a combination of inductive tactics and search in a platform-independent partitioning IR, automap can recover expert partitioning strategies such as Megatron sharding for transformer layers.
△ Less
Submitted 6 December, 2021;
originally announced December 2021.
-
Training Neural Networks with Fixed Sparse Masks
Authors:
Yi-Lin Sung,
Varun Nair,
Colin Raffel
Abstract:
During typical gradient-based training of deep neural networks, all of the model's parameters are updated at each iteration. Recent work has shown that it is possible to update only a small subset of the model's parameters during training, which can alleviate storage and communication requirements. In this paper, we show that it is possible to induce a fixed sparse mask on the model's parameters t…
▽ More
During typical gradient-based training of deep neural networks, all of the model's parameters are updated at each iteration. Recent work has shown that it is possible to update only a small subset of the model's parameters during training, which can alleviate storage and communication requirements. In this paper, we show that it is possible to induce a fixed sparse mask on the model's parameters that selects a subset to update over many iterations. Our method constructs the mask out of the $k$ parameters with the largest Fisher information as a simple approximation as to which parameters are most important for the task at hand. In experiments on parameter-efficient transfer learning and distributed training, we show that our approach matches or exceeds the performance of other methods for training with sparse updates while being more efficient in terms of memory usage and communication costs. We release our code publicly to promote further applications of our approach.
△ Less
Submitted 18 November, 2021;
originally announced November 2021.
-
Adding more data does not always help: A study in medical conversation summarization with PEGASUS
Authors:
Varun Nair,
Namit Katariya,
Xavier Amatriain,
Ilya Valmianski,
Anitha Kannan
Abstract:
Medical conversation summarization is integral in capturing information gathered during interactions between patients and physicians. Summarized conversations are used to facilitate patient hand-offs between physicians, and as part of providing care in the future. Summaries, however, can be time-consuming to produce and require domain expertise. Modern pre-trained NLP models such as PEGASUS have e…
▽ More
Medical conversation summarization is integral in capturing information gathered during interactions between patients and physicians. Summarized conversations are used to facilitate patient hand-offs between physicians, and as part of providing care in the future. Summaries, however, can be time-consuming to produce and require domain expertise. Modern pre-trained NLP models such as PEGASUS have emerged as capable alternatives to human summarization, reaching state-of-the-art performance on many summarization benchmarks. However, many downstream tasks still require at least moderately sized datasets to achieve satisfactory performance. In this work we (1) explore the effect of dataset size on transfer learning medical conversation summarization using PEGASUS and (2) evaluate various iterative labeling strategies in the low-data regime, following their success in the classification setting. We find that model performance saturates with increase in dataset size and that the various active-learning strategies evaluated all show equivalent performance consistent with simple dataset size increase. We also find that naive iterative pseudo-labeling is on-par or slightly worse than no pseudo-labeling. Our work sheds light on the successes and challenges of translating low-data regime techniques in classification to medical conversation summarization and helps guides future work in this space. Relevant code available at \url{https://github.com/curai/curai-research/tree/main/medical-summarization-ML4H-2021}.
△ Less
Submitted 28 November, 2021; v1 submitted 15 November, 2021;
originally announced November 2021.
-
Gauge and Scalar Fields on $\mathbb{CP}^2$: A Gauge-invariant Analysis I. The effective action from chiral scalars
Authors:
Dimitra Karabali,
Antonina Maj,
V. P. Nair
Abstract:
A parametrization of gauge fields on complex projective spaces of arbitrary dimension is given as a generalization of the two-dimensional case. Gauge transformations act homogeneously on the fields, facilitating a manifestly gauge-invariant analysis. Specializing to four dimensions, we consider the nature of the effective action due to chiral scalars interacting with the gauge fields. The key qual…
▽ More
A parametrization of gauge fields on complex projective spaces of arbitrary dimension is given as a generalization of the two-dimensional case. Gauge transformations act homogeneously on the fields, facilitating a manifestly gauge-invariant analysis. Specializing to four dimensions, we consider the nature of the effective action due to chiral scalars interacting with the gauge fields. The key qualitatively significant terms include a possible gauge-invariant mass term and a finite four-dimensional Wess-Zumino-Witten (WZW) action. We comment on relating the mass term to lattice simulations as well as Schwinger-Dyson analyses, and also on relating the WZW action to the instanton liquid picture of QCD.
△ Less
Submitted 16 November, 2022; v1 submitted 22 October, 2021;
originally announced October 2021.
-
The Life and Science of Thanu Padmanabhan
Authors:
Jasjeet Singh Bagla,
Krishnakanta Bhattacharya,
Sumanta Chakraborty,
Sunu Engineer,
Valerio Faraoni,
Sanved Kolekar,
Dawood Kothawala,
Kinjalk Lochan,
Sujoy Modak,
V. Parameswaran Nair,
Aseem Paranjape,
Krishnamohan Parattu,
Sarada G. Rajeev,
Bibhas Ranjan Majhi,
Tirthankar Roy Choudhury,
Mohammad Sami,
Sudipta Sarkar,
Sandipan Sengupta,
T. R. Seshadri,
S. Shankaranarayanan,
Suprit Singh,
Tejinder P. Singh,
L. Sriramkumar,
Urjit Yajnik
Abstract:
Thanu Padmanabhan was a renowned Indian theoretical physicist known for his research in general relativity, cosmology, and quantum gravity. In an extraordinary career spanning forty-two years, he published more than three hundred research articles, wrote ten highly successful technical and popular books, and mentored nearly thirty graduate students and post-doctoral fellows. He is best known for h…
▽ More
Thanu Padmanabhan was a renowned Indian theoretical physicist known for his research in general relativity, cosmology, and quantum gravity. In an extraordinary career spanning forty-two years, he published more than three hundred research articles, wrote ten highly successful technical and popular books, and mentored nearly thirty graduate students and post-doctoral fellows. He is best known for his deep work investigating gravitation as an emergent thermodynamic phenomenon. He was an outstanding teacher, and an indefatigable populariser of science, who travelled very widely to motivate and inspire young students. Paddy, as he was affectionately known, was also a close friend to his students and collaborators, treating them as part of his extended academic family. On September 17, 2021 Paddy passed away very unexpectedly, at the age of sixty-four and at the height of his research career, while serving as a Distinguished Professor at the Inter-University Centre for Astronomy and Astrophysics, Pune. His untimely demise has come as a shock to his family and friends and colleagues. In this article, several of them have come together to pay their tributes and share their fond memories of Paddy.
△ Less
Submitted 7 October, 2021;
originally announced October 2021.
-
A Hierarchical Local Electricity Market for a DER-rich Grid Edge
Authors:
Vineet Jagadeesan Nair,
Venkatesh Venkataramanan,
Rabab Haider,
Anuradha Annaswamy
Abstract:
With increasing penetration of DERs in the distribution system, it is critical to design market structures that enable smooth integration of DERs. A hierarchical local electricity market (LEM) structure is proposed in this paper with a secondary market (SM) at the lower level representing secondary feeders and a primary market (PM) at the upper level, representing primary feeders, in order to effe…
▽ More
With increasing penetration of DERs in the distribution system, it is critical to design market structures that enable smooth integration of DERs. A hierarchical local electricity market (LEM) structure is proposed in this paper with a secondary market (SM) at the lower level representing secondary feeders and a primary market (PM) at the upper level, representing primary feeders, in order to effectively use DERs to increase grid efficiency and resilience. The lower level SM enforces budget, power balance and flexibility constraints and accounts for costs related to consumers, such as their disutility, flexibility limits, and commitment reliability, while the upper level PM enforces power physics constraints such as power balance and capacity limits, and also minimizes line losses. The hierarchical LEM is extensively evaluated using a modified IEEE-123 bus with high DER penetration, with each primary feeder consisting of at least three secondary feeders. Data from a GridLAB-D model is used to emulate realistic power injections and load profiles over the course of 24 hours. The performance of the LEM is illustrated by delineating the family of power-injection profiles across the primary and secondary feeders as well as corresponding local electricity tariffs that vary across the distribution grid. Together, it represents an overall framework for a Distribution System Operator (DSO) who can provide the oversight for the entire LEM.
△ Less
Submitted 14 March, 2022; v1 submitted 5 October, 2021;
originally announced October 2021.
-
Document Automation Architectures and Technologies: A Survey
Authors:
Mohammad Ahmadi Achachlouei,
Omkar Patil,
Tarun Joshi,
Vijayan N. Nair
Abstract:
This paper surveys the current state of the art in document automation (DA). The objective of DA is to reduce the manual effort during the generation of documents by automatically integrating input from different sources and assembling documents conforming to defined templates. There have been reviews of commercial solutions of DA, particularly in the legal domain, but to date there has been no co…
▽ More
This paper surveys the current state of the art in document automation (DA). The objective of DA is to reduce the manual effort during the generation of documents by automatically integrating input from different sources and assembling documents conforming to defined templates. There have been reviews of commercial solutions of DA, particularly in the legal domain, but to date there has been no comprehensive review of the academic research on DA architectures and technologies. The current survey of DA reviews the academic literature and provides a clearer definition and characterization of DA and its features, identifies state-of-the-art DA architectures and technologies in academic research, and provides ideas that can lead to new research opportunities within the DA field in light of recent advances in artificial intelligence and deep neural networks.
△ Less
Submitted 23 September, 2021;
originally announced September 2021.
-
Supervised Linear Dimension-Reduction Methods: Review, Extensions, and Comparisons
Authors:
Shaojie Xu,
Joel Vaughan,
Jie Chen,
Agus Sudjianto,
Vijayan Nair
Abstract:
Principal component analysis (PCA) is a well-known linear dimension-reduction method that has been widely used in data analysis and modeling. It is an unsupervised learning technique that identifies a suitable linear subspace for the input variable that contains maximal variation and preserves as much information as possible. PCA has also been used in prediction models where the original, high-dim…
▽ More
Principal component analysis (PCA) is a well-known linear dimension-reduction method that has been widely used in data analysis and modeling. It is an unsupervised learning technique that identifies a suitable linear subspace for the input variable that contains maximal variation and preserves as much information as possible. PCA has also been used in prediction models where the original, high-dimensional space of predictors is reduced to a smaller, more manageable, set before conducting regression analysis. However, this approach does not incorporate information in the response during the dimension-reduction stage and hence can have poor predictive performance. To address this concern, several supervised linear dimension-reduction techniques have been proposed in the literature. This paper reviews selected techniques, extends some of them, and compares their performance through simulations. Two of these techniques, partial least squares (PLS) and least-squares PCA (LSPCA), consistently outperform the others in this study.
△ Less
Submitted 9 September, 2021;
originally announced September 2021.
-
NavStick: Making Video Games Blind-Accessible via the Ability to Look Around
Authors:
Vishnu Nair,
Jay L. Karp,
Samuel Silverman,
Mohar Kalra,
Hollis Lehv,
Faizan Jamil,
Brian A. Smith
Abstract:
Video games remain largely inaccessible to visually impaired people (VIPs). Today's blind-accessible games are highly simplified renditions of what sighted players enjoy, and they do not give VIPs the same freedom to look around and explore game worlds on their own terms. In this work, we introduce NavStick, an audio-based tool for looking around within virtual environments, with the aim of making…
▽ More
Video games remain largely inaccessible to visually impaired people (VIPs). Today's blind-accessible games are highly simplified renditions of what sighted players enjoy, and they do not give VIPs the same freedom to look around and explore game worlds on their own terms. In this work, we introduce NavStick, an audio-based tool for looking around within virtual environments, with the aim of making 3D adventure video games more blind-accessible. NavStick repurposes a game controller's thumbstick to allow VIPs to survey what is around them via line-of-sight. In a user study, we compare NavStick with traditional menu-based surveying for different navigation tasks and find that VIPs were able to form more accurate mental maps of their environment with NavStick than with menu-based surveying. In an additional exploratory study, we investigate NavStick in the context of a representative 3D adventure game. Our findings reveal several implications for blind-accessible games, and we close by discussing these.
△ Less
Submitted 2 September, 2021;
originally announced September 2021.
-
Learning a Large Neighborhood Search Algorithm for Mixed Integer Programs
Authors:
Nicolas Sonnerat,
Pengming Wang,
Ira Ktena,
Sergey Bartunov,
Vinod Nair
Abstract:
Large Neighborhood Search (LNS) is a combinatorial optimization heuristic that starts with an assignment of values for the variables to be optimized, and iteratively improves it by searching a large neighborhood around the current assignment. In this paper we consider a learning-based LNS approach for mixed integer programs (MIPs). We train a Neural Diving model to represent a probability distribu…
▽ More
Large Neighborhood Search (LNS) is a combinatorial optimization heuristic that starts with an assignment of values for the variables to be optimized, and iteratively improves it by searching a large neighborhood around the current assignment. In this paper we consider a learning-based LNS approach for mixed integer programs (MIPs). We train a Neural Diving model to represent a probability distribution over assignments, which, together with an off-the-shelf MIP solver, generates an initial assignment. Formulating the subsequent search steps as a Markov Decision Process, we train a Neural Neighborhood Selection policy to select a search neighborhood at each step, which is searched using a MIP solver to find the next assignment. The policy network is trained using imitation learning. We propose a target policy for imitation that, given enough compute resources, is guaranteed to select the neighborhood containing the optimal next assignment amongst all possible choices for the neighborhood of a specified size. Our approach matches or outperforms all the baselines on five real-world MIP datasets with large-scale instances from diverse applications, including two production applications at Google. It achieves $2\times$ to $37.8\times$ better average primal gap than the best baseline on three of the datasets at large running times.
△ Less
Submitted 20 May, 2022; v1 submitted 21 July, 2021;
originally announced July 2021.
-
A Causal Bandit Approach to Learning Good Atomic Interventions in Presence of Unobserved Confounders
Authors:
Aurghya Maiti,
Vineet Nair,
Gaurav Sinha
Abstract:
We study the problem of determining the best intervention in a Causal Bayesian Network (CBN) specified only by its causal graph. We model this as a stochastic multi-armed bandit (MAB) problem with side-information, where the interventions correspond to the arms of the bandit instance. First, we propose a simple regret minimization algorithm that takes as input a semi-Markovian causal graph with at…
▽ More
We study the problem of determining the best intervention in a Causal Bayesian Network (CBN) specified only by its causal graph. We model this as a stochastic multi-armed bandit (MAB) problem with side-information, where the interventions correspond to the arms of the bandit instance. First, we propose a simple regret minimization algorithm that takes as input a semi-Markovian causal graph with atomic interventions and possibly unobservable variables, and achieves $\tilde{O}(\sqrt{M/T})$ expected simple regret, where $M$ is dependent on the input CBN and could be very small compared to the number of arms. We also show that this is almost optimal for CBNs described by causal graphs having an $n$-ary tree structure. Our simple regret minimization results, both upper and lower bound, subsume previous results in the literature, which assumed additional structural restrictions on the input causal graph. In particular, our results indicate that the simple regret guarantee of our proposed algorithm can only be improved by considering more nuanced structural restrictions on the causal graph. Next, we propose a cumulative regret minimization algorithm that takes as input a general causal graph with all observable nodes and atomic interventions and performs better than the optimal MAB algorithm that does not take causal side-information into account. We also experimentally compare both our algorithms with the best known algorithms in the literature. To the best of our knowledge, this work gives the first simple and cumulative regret minimization algorithms for CBNs with general causal graphs under atomic interventions and having unobserved confounders.
△ Less
Submitted 19 May, 2022; v1 submitted 6 July, 2021;
originally announced July 2021.
-
Self-interpretable Convolutional Neural Networks for Text Classification
Authors:
Wei Zhao,
Rahul Singh,
Tarun Joshi,
Agus Sudjianto,
Vijayan N. Nair
Abstract:
Deep learning models for natural language processing (NLP) are inherently complex and often viewed as black box in nature. This paper develops an approach for interpreting convolutional neural networks for text classification problems by exploiting the local-linear models inherent in ReLU-DNNs. The CNN model combines the word embedding through convolutional layers, filters them using max-pooling,…
▽ More
Deep learning models for natural language processing (NLP) are inherently complex and often viewed as black box in nature. This paper develops an approach for interpreting convolutional neural networks for text classification problems by exploiting the local-linear models inherent in ReLU-DNNs. The CNN model combines the word embedding through convolutional layers, filters them using max-pooling, and optimizes using a ReLU-DNN for classification. To get an overall self-interpretable model, the system of local linear models from the ReLU DNN are mapped back through the max-pool filter to the appropriate n-grams. Our results on experimental datasets demonstrate that our proposed technique produce parsimonious models that are self-interpretable and have comparable performance with respect to a more complex CNN model. We also study the impact of the complexity of the convolutional layers and the classification layers on the model performance.
△ Less
Submitted 8 July, 2021; v1 submitted 18 May, 2021;
originally announced May 2021.
-
Bias, Fairness, and Accountability with AI and ML Algorithms
Authors:
Nengfeng Zhou,
Zach Zhang,
Vijayan N. Nair,
Harsh Singhal,
Jie Chen,
Agus Sudjianto
Abstract:
The advent of AI and ML algorithms has led to opportunities as well as challenges. In this paper, we provide an overview of bias and fairness issues that arise with the use of ML algorithms. We describe the types and sources of data bias, and discuss the nature of algorithmic unfairness. This is followed by a review of fairness metrics in the literature, discussion of their limitations, and a desc…
▽ More
The advent of AI and ML algorithms has led to opportunities as well as challenges. In this paper, we provide an overview of bias and fairness issues that arise with the use of ML algorithms. We describe the types and sources of data bias, and discuss the nature of algorithmic unfairness. This is followed by a review of fairness metrics in the literature, discussion of their limitations, and a description of de-biasing (or mitigation) techniques in the model life cycle.
△ Less
Submitted 13 May, 2021;
originally announced May 2021.
-
Sensitivity Analysis of Passenger Behavioral Model for Dynamic Pricing of Shared Mobility on Demand
Authors:
Vineet Jagadeesan Nair,
Yue Guan,
Anuradha M. Annaswamy,
H. Eric Tseng,
Baljeet Singh
Abstract:
This paper provides a framework to quantify the sensitivity associated with behavioral models based on Cumulative Prospect Theory (CPT). These are used to design dynamic pricing strategies aimed at maximizing performance metrics of the Shared Mobility On-Demand Service (SMoDS), as solutions to a constrained nonlinear optimization problem. We analyze the sensitivity of both the optimal tariff as we…
▽ More
This paper provides a framework to quantify the sensitivity associated with behavioral models based on Cumulative Prospect Theory (CPT). These are used to design dynamic pricing strategies aimed at maximizing performance metrics of the Shared Mobility On-Demand Service (SMoDS), as solutions to a constrained nonlinear optimization problem. We analyze the sensitivity of both the optimal tariff as well as the optimal objective function with respect to CPT model parameters. In addition to deriving analytical solutions under certain assumptions, more general numerical results are obtained via computational experiments and simulations to analyze the sensitivity. We find that the model is relatively robust for small to moderate parameter perturbations. Although some of the trends in sensitivity are fairly general, the exact nature of variations in many cases depends heavily on the specific travel scenarios and modes being considered. This is primarily due to the complex nonlinearities in the problem, as well as the significant heterogeneity in passenger preferences across different types of trips.
△ Less
Submitted 18 April, 2021;
originally announced April 2021.
-
Strategic Classification in the Dark
Authors:
Ganesh Ghalme,
Vineet Nair,
Itay Eilat,
Inbal Talgam-Cohen,
Nir Rosenfeld
Abstract:
Strategic classification studies the interaction between a classification rule and the strategic agents it governs. Under the assumption that the classifier is known, rational agents respond to it by manipulating their features. However, in many real-life scenarios of high-stake classification (e.g., credit scoring), the classifier is not revealed to the agents, which leads agents to attempt to le…
▽ More
Strategic classification studies the interaction between a classification rule and the strategic agents it governs. Under the assumption that the classifier is known, rational agents respond to it by manipulating their features. However, in many real-life scenarios of high-stake classification (e.g., credit scoring), the classifier is not revealed to the agents, which leads agents to attempt to learn the classifier and game it too. In this paper we generalize the strategic classification model to such scenarios. We define the price of opacity as the difference in prediction error between opaque and transparent strategy-robust classifiers, characterize it, and give a sufficient condition for this price to be strictly positive, in which case transparency is the recommended policy. Our experiments show how Hardt et al.'s robust classifier is affected by keeping agents in the dark.
△ Less
Submitted 13 June, 2021; v1 submitted 23 February, 2021;
originally announced February 2021.
-
Long-Term Resource Allocation Fairness in Average Markov Decision Process (AMDP) Environment
Authors:
Ganesh Ghalme,
Vineet Nair,
Vishakha Patil,
Yilun Zhou
Abstract:
Fairness has emerged as an important concern in automated decision-making in recent years, especially when these decisions affect human welfare. In this work, we study fairness in temporally extended decision-making settings, specifically those formulated as Markov Decision Processes (MDPs). Our proposed notion of fairness ensures that each state's long-term visitation frequency is at least a spec…
▽ More
Fairness has emerged as an important concern in automated decision-making in recent years, especially when these decisions affect human welfare. In this work, we study fairness in temporally extended decision-making settings, specifically those formulated as Markov Decision Processes (MDPs). Our proposed notion of fairness ensures that each state's long-term visitation frequency is at least a specified fraction. This quota-based notion of fairness is natural in many resource-allocation settings where the dynamics of a single resource being allocated is governed by an MDP and the distribution of the shared resource is captured by its state-visitation frequency. In an average-reward MDP (AMDP) setting, we formulate the problem as a bilinear saddle point program and, for a generative model, solve it using a Stochastic Mirror Descent (SMD) based algorithm. The proposed solution guarantees a simultaneous approximation on the expected average-reward and fairness requirement. We give sample complexity bounds for the proposed algorithm and validate our theoretical results with experiments on simulated data.
△ Less
Submitted 8 February, 2022; v1 submitted 14 February, 2021;
originally announced February 2021.
-
Solving Mixed Integer Programs Using Neural Networks
Authors:
Vinod Nair,
Sergey Bartunov,
Felix Gimeno,
Ingrid von Glehn,
Pawel Lichocki,
Ivan Lobov,
Brendan O'Donoghue,
Nicolas Sonnerat,
Christian Tjandraatmadja,
Pengming Wang,
Ravichandra Addanki,
Tharindi Hapuarachchi,
Thomas Keck,
James Keeling,
Pushmeet Kohli,
Ira Ktena,
Yujia Li,
Oriol Vinyals,
Yori Zwols
Abstract:
Mixed Integer Programming (MIP) solvers rely on an array of sophisticated heuristics developed with decades of research to solve large-scale MIP instances encountered in practice. Machine learning offers to automatically construct better heuristics from data by exploiting shared structure among instances in the data. This paper applies learning to the two key sub-tasks of a MIP solver, generating…
▽ More
Mixed Integer Programming (MIP) solvers rely on an array of sophisticated heuristics developed with decades of research to solve large-scale MIP instances encountered in practice. Machine learning offers to automatically construct better heuristics from data by exploiting shared structure among instances in the data. This paper applies learning to the two key sub-tasks of a MIP solver, generating a high-quality joint variable assignment, and bounding the gap in objective value between that assignment and an optimal one. Our approach constructs two corresponding neural network-based components, Neural Diving and Neural Branching, to use in a base MIP solver such as SCIP. Neural Diving learns a deep neural network to generate multiple partial assignments for its integer variables, and the resulting smaller MIPs for un-assigned variables are solved with SCIP to construct high quality joint assignments. Neural Branching learns a deep neural network to make variable selection decisions in branch-and-bound to bound the objective value gap with a small tree. This is done by imitating a new variant of Full Strong Branching we propose that scales to large instances using GPUs. We evaluate our approach on six diverse real-world datasets, including two Google production datasets and MIPLIB, by training separate neural networks on each. Most instances in all the datasets combined have $10^3-10^6$ variables and constraints after presolve, which is significantly larger than previous learning approaches. Comparing solvers with respect to primal-dual gap averaged over a held-out set of instances, the learning-augmented SCIP is 2x to 10x better on all datasets except one on which it is $10^5$x better, at large time limits. To the best of our knowledge, ours is the first learning approach to demonstrate such large improvements over SCIP on both large-scale real-world application datasets and MIPLIB.
△ Less
Submitted 29 July, 2021; v1 submitted 23 December, 2020;
originally announced December 2020.
-
Budgeted and Non-budgeted Causal Bandits
Authors:
Vineet Nair,
Vishakha Patil,
Gaurav Sinha
Abstract:
Learning good interventions in a causal graph can be modelled as a stochastic multi-armed bandit problem with side-information. First, we study this problem when interventions are more expensive than observations and a budget is specified. If there are no backdoor paths from an intervenable node to the reward node then we propose an algorithm to minimize simple regret that optimally trades-off obs…
▽ More
Learning good interventions in a causal graph can be modelled as a stochastic multi-armed bandit problem with side-information. First, we study this problem when interventions are more expensive than observations and a budget is specified. If there are no backdoor paths from an intervenable node to the reward node then we propose an algorithm to minimize simple regret that optimally trades-off observations and interventions based on the cost of intervention. We also propose an algorithm that accounts for the cost of interventions, utilizes causal side-information, and minimizes the expected cumulative regret without exceeding the budget. Our cumulative-regret minimization algorithm performs better than standard algorithms that do not take side-information into account. Finally, we study the problem of learning best interventions without budget constraint in general graphs and give an algorithm that achieves constant expected cumulative regret in terms of the instance parameters when the parent distribution of the reward variable for each intervention is known. Our results are experimentally validated and compared to the best-known bounds in the current literature.
△ Less
Submitted 13 December, 2020;
originally announced December 2020.
-
Mapping the Space of Chemical Reactions Using Attention-Based Neural Networks
Authors:
Philippe Schwaller,
Daniel Probst,
Alain C. Vaucher,
Vishnu H. Nair,
David Kreutter,
Teodoro Laino,
Jean-Louis Reymond
Abstract:
Organic reactions are usually assigned to classes containing reactions with similar reagents and mechanisms. Reaction classes facilitate the communication of complex concepts and efficient navigation through chemical reaction space. However, the classification process is a tedious task. It requires the identification of the corresponding reaction class template via annotation of the number of mole…
▽ More
Organic reactions are usually assigned to classes containing reactions with similar reagents and mechanisms. Reaction classes facilitate the communication of complex concepts and efficient navigation through chemical reaction space. However, the classification process is a tedious task. It requires the identification of the corresponding reaction class template via annotation of the number of molecules in the reactions, the reaction center, and the distinction between reactants and reagents. This work shows that transformer-based models can infer reaction classes from non-annotated, simple text-based representations of chemical reactions. Our best model reaches a classification accuracy of 98.2%. We also show that the learned representations can be used as reaction fingerprints that capture fine-grained differences between reaction classes better than traditional reaction fingerprints. The insights into chemical reaction space enabled by our learned fingerprints are illustrated by an interactive reaction atlas providing visual clustering and similarity searching.
△ Less
Submitted 9 December, 2020;
originally announced December 2020.
-
Factoring periodic maps into Dehn twists
Authors:
Neeraj K. Dhanwani,
Ajay K. Nair,
Kashyap Rajeevsarathy
Abstract:
Let $\text{Mod}(S_g)$ be the mapping class group of the closed orientable surface $S_g$ of genus $g \geq 1$. In this paper, we develop various methods for factoring periodic mapping classes into Dehn twists, up to conjugacy. As applications, we develop methods for factoring certain roots of Dehn twists as words in Dehn twists. We will also show the existence of conjugates of periodic maps of order…
▽ More
Let $\text{Mod}(S_g)$ be the mapping class group of the closed orientable surface $S_g$ of genus $g \geq 1$. In this paper, we develop various methods for factoring periodic mapping classes into Dehn twists, up to conjugacy. As applications, we develop methods for factoring certain roots of Dehn twists as words in Dehn twists. We will also show the existence of conjugates of periodic maps of order $4g$ and $4g+2$, for $g\geq 2$, whose product is pseudo-Anosov.
△ Less
Submitted 24 June, 2022; v1 submitted 21 October, 2020;
originally announced October 2020.
-
Fast Fourier Transformation for Optimizing Convolutional Neural Networks in Object Recognition
Authors:
Varsha Nair,
Moitrayee Chatterjee,
Neda Tavakoli,
Akbar Siami Namin,
Craig Snoeyink
Abstract:
This paper proposes to use Fast Fourier Transformation-based U-Net (a refined fully convolutional networks) and perform image convolution in neural networks. Leveraging the Fast Fourier Transformation, it reduces the image convolution costs involved in the Convolutional Neural Networks (CNNs) and thus reduces the overall computational costs. The proposed model identifies the object information fro…
▽ More
This paper proposes to use Fast Fourier Transformation-based U-Net (a refined fully convolutional networks) and perform image convolution in neural networks. Leveraging the Fast Fourier Transformation, it reduces the image convolution costs involved in the Convolutional Neural Networks (CNNs) and thus reduces the overall computational costs. The proposed model identifies the object information from the images. We apply the Fast Fourier transform algorithm on an image data set to obtain more accessible information about the image data, before segmenting them through the U-Net architecture. More specifically, we implement the FFT-based convolutional neural network to improve the training time of the network. The proposed approach was applied to publicly available Broad Bioimage Benchmark Collection (BBBC) dataset. Our model demonstrated improvement in training time during convolution from $600-700$ ms/step to $400-500$ ms/step. We evaluated the accuracy of our model using Intersection over Union (IoU) metric showing significant improvements.
△ Less
Submitted 8 October, 2020;
originally announced October 2020.
-
A Study on the Possible Effects of the Implementation of the Nordic Model in India on Crime Rates and Sexually Transmitted Diseases
Authors:
Sabarinath Vinod Nair,
Shreya Sharma,
Swarnava Ghosh
Abstract:
Prostitution is one of the root causes of sex trafficking and the transmission of sexual diseases. The rules and regulations followed by the Indian government to regulate the same, fall under the umbrella of the abolitionism model. Neo-abolitionism (also known as the Nordic model) is a new legislative model that has been introduced by the Nordic countries to regulate prostitution. The purpose of t…
▽ More
Prostitution is one of the root causes of sex trafficking and the transmission of sexual diseases. The rules and regulations followed by the Indian government to regulate the same, fall under the umbrella of the abolitionism model. Neo-abolitionism (also known as the Nordic model) is a new legislative model that has been introduced by the Nordic countries to regulate prostitution. The purpose of this research paper is to examine the possible effects of the application of the Nordic model on the crime rates and the spread of sexually transmitted diseases in India. Further, we also aim to study the effects of the implementation of Neo-abolitionism in Sweden.
△ Less
Submitted 11 September, 2020;
originally announced September 2020.
-
Recent Trends in the Use of Deep Learning Models for Grammar Error Handling
Authors:
Mina Naghshnejad,
Tarun Joshi,
Vijayan N. Nair
Abstract:
Grammar error handling (GEH) is an important topic in natural language processing (NLP). GEH includes both grammar error detection and grammar error correction. Recent advances in computation systems have promoted the use of deep learning (DL) models for NLP problems such as GEH. In this survey we focus on two main DL approaches for GEH: neural machine translation models and editor models. We desc…
▽ More
Grammar error handling (GEH) is an important topic in natural language processing (NLP). GEH includes both grammar error detection and grammar error correction. Recent advances in computation systems have promoted the use of deep learning (DL) models for NLP problems such as GEH. In this survey we focus on two main DL approaches for GEH: neural machine translation models and editor models. We describe the three main stages of the pipeline for these models: data preparation, training, and inference. Additionally, we discuss different techniques to improve the performance of these models at each stage of the pipeline. We compare the performance of different models and conclude with proposed future directions.
△ Less
Submitted 4 September, 2020;
originally announced September 2020.
-
Action similarity judgment based on kinematic primitives
Authors:
Vipul Nair,
Paul Hemeren,
Alessia Vignolo,
Nicoletta Noceti,
Elena Nicora,
Alessandra Sciutti,
Francesco Rea,
Erik Billing,
Francesca Odone,
Giulio Sandini
Abstract:
Understanding which features humans rely on -- in visually recognizing action similarity is a crucial step towards a clearer picture of human action perception from a learning and developmental perspective. In the present work, we investigate to which extent a computational model based on kinematics can determine action similarity and how its performance relates to human similarity judgments of th…
▽ More
Understanding which features humans rely on -- in visually recognizing action similarity is a crucial step towards a clearer picture of human action perception from a learning and developmental perspective. In the present work, we investigate to which extent a computational model based on kinematics can determine action similarity and how its performance relates to human similarity judgments of the same actions. To this aim, twelve participants perform an action similarity task, and their performances are compared to that of a computational model solving the same task. The chosen model has its roots in developmental robotics and performs action classification based on learned kinematic primitives. The comparative experiment results show that both the model and human participants can reliably identify whether two actions are the same or not. However, the model produces more false hits and has a greater selection bias than human participants. A possible reason for this is the particular sensitivity of the model towards kinematic primitives of the presented actions. In a second experiment, human participants' performance on an action identification task indicated that they relied solely on kinematic information rather than on action semantics. The results show that both the model and human performance are highly accurate in an action similarity task based on kinematic-level features, which can provide an essential basis for classifying human actions.
△ Less
Submitted 30 August, 2020;
originally announced August 2020.