Showing 51–100 of 332 results for author: Srinivasan, S

Self-Resolving Prediction Markets for Unverifiable Outcomes

Authors: Siddarth Srinivasan, Ezra Karger, Yiling Chen

Abstract: Prediction markets elicit and aggregate beliefs by paying agents based on how close their predictions are to a verifiable future outcome. However, outcomes of many important questions are difficult to verify or unverifiable, in that the ground truth may be hard or impossible to access. Examples include questions about causal effects where it is infeasible or unethical to run randomized trials; cro… ▽ More Prediction markets elicit and aggregate beliefs by paying agents based on how close their predictions are to a verifiable future outcome. However, outcomes of many important questions are difficult to verify or unverifiable, in that the ground truth may be hard or impossible to access. Examples include questions about causal effects where it is infeasible or unethical to run randomized trials; crowdsourcing and content moderation tasks where it is prohibitively expensive to verify ground truth; and questions asked over long time horizons, where the delay until the realization of the outcome skews agents' incentives to report their true beliefs. We present a novel and unintuitive result showing that it is possible to run an $\varepsilon-$incentive compatible prediction market to elicit and efficiently aggregate information from a pool of agents without observing the outcome by paying agents the negative cross-entropy between their prediction and that of a carefully chosen reference agent. Our key insight is that a reference agent with access to more information can serve as a reasonable proxy for the ground truth. We use this insight to propose self-resolving prediction markets that terminate with some probability after every report and pay all but a few agents based on the final prediction. We show that it is an $\varepsilon-$Perfect Bayesian Equilibrium for all agents to report truthfully in our mechanism and to believe that all other agents report truthfully. Although primarily of interest for unverifiable outcomes, this design is also applicable for verifiable outcomes. △ Less

Submitted 7 June, 2023; originally announced June 2023.

A Short Note on Setting Swap Parameters

Authors: Nihar Shah, Lucas Baker, Suraj Srinivasan, Alex Toberoff

Abstract: This short note illustrates the theoretical solution to a trader determining how to optimally swap her wealth into a target asset through on-chain operations. It offers the framework to solve optimal slippage parameters and optimal trade size. This short note illustrates the theoretical solution to a trader determining how to optimally swap her wealth into a target asset through on-chain operations. It offers the framework to solve optimal slippage parameters and optimal trade size. △ Less

Submitted 17 May, 2023; originally announced May 2023.

Comments: 3 pages

Question-Answering System Extracts Information on Injection Drug Use from Clinical Notes

Authors: Maria Mahbub, Ian Goethert, Ioana Danciu, Kathryn Knight, Sudarshan Srinivasan, Suzanne Tamang, Karine Rozenberg-Ben-Dror, Hugo Solares, Susana Martins, Jodie Trafton, Edmon Begoli, Gregory Peterson

Abstract: Background: Injection drug use (IDU) is a dangerous health behavior that increases mortality and morbidity. Identifying IDU early and initiating harm reduction interventions can benefit individuals at risk. However, extracting IDU behaviors from patients' electronic health records (EHR) is difficult because there is no International Classification of Disease (ICD) code and the only place IDU infor… ▽ More Background: Injection drug use (IDU) is a dangerous health behavior that increases mortality and morbidity. Identifying IDU early and initiating harm reduction interventions can benefit individuals at risk. However, extracting IDU behaviors from patients' electronic health records (EHR) is difficult because there is no International Classification of Disease (ICD) code and the only place IDU information can be indicated is unstructured free-text clinical notes. Although natural language processing can efficiently extract this information from unstructured data, there are no validated tools. Methods: To address this gap in clinical information, we design and demonstrate a question-answering (QA) framework to extract information on IDU from clinical notes. Our framework involves two main steps: (1) generating a gold-standard QA dataset and (2) developing and testing the QA model. We utilize 2323 clinical notes of 1145 patients sourced from the VA Corporate Data Warehouse to construct the gold-standard dataset for developing and evaluating the QA model. We also demonstrate the QA model's ability to extract IDU-related information on temporally out-of-distribution data. Results: Here we show that for a strict match between gold-standard and predicted answers, the QA model achieves 51.65% F1 score. For a relaxed match between the gold-standard and predicted answers, the QA model obtains 78.03% F1 score, along with 85.38% Precision and 79.02% Recall scores. Moreover, the QA model demonstrates consistent performance when subjected to temporally out-of-distribution data. Conclusions: Our study introduces a QA framework designed to extract IDU information from clinical notes, aiming to enhance the accurate and efficient detection of people who inject drugs, extract relevant information, and ultimately facilitate informed patient care. △ Less

Submitted 28 December, 2023; v1 submitted 15 May, 2023; originally announced May 2023.

Comments: 31 pages, 11 tables, 7 figures

Low-Degree Testing Over Grids

Authors: Prashanth Amireddy, Srikanth Srinivasan, Madhu Sudan

Abstract: We study the question of local testability of low (constant) degree functions from a product domain $S_1 \times \dots \times {S}_n$ to a field $\mathbb{F}$, where ${S_i} \subseteq \mathbb{F}$ can be arbitrary constant sized sets. We show that this family is locally testable when the grid is "symmetric". That is, if ${S_i} = {S}$ for all i, there is a probabilistic algorithm using constantly many q… ▽ More We study the question of local testability of low (constant) degree functions from a product domain $S_1 \times \dots \times {S}_n$ to a field $\mathbb{F}$, where ${S_i} \subseteq \mathbb{F}$ can be arbitrary constant sized sets. We show that this family is locally testable when the grid is "symmetric". That is, if ${S_i} = {S}$ for all i, there is a probabilistic algorithm using constantly many queries that distinguishes whether $f$ has a polynomial representation of degree at most $d$ or is $Ω(1)$-far from having this property. In contrast, we show that there exist asymmetric grids with $|{S}_1| =\dots= |{S}_n| = 3$ for which testing requires $ω_n(1)$ queries, thereby establishing that even in the context of polynomials, local testing depends on the structure of the domain and not just the distance of the underlying code. The low-degree testing problem has been studied extensively over the years and a wide variety of tools have been applied to propose and analyze tests. Our work introduces yet another new connection in this rich field, by building low-degree tests out of tests for "junta-degrees". A function $f : {S}_1 \times \dots \times {S}_n \to {G}$, for an abelian group ${G}$ is said to be a junta-degree-$d$ function if it is a sum of $d$-juntas. We derive our low-degree test by giving a new local test for junta-degree-$d$ functions. For the analysis of our tests, we deduce a small-set expansion theorem for spherical noise over large grids, which may be of independent interest. △ Less

Submitted 8 May, 2023; originally announced May 2023.

Near-realtime Facial Animation by Deep 3D Simulation Super-Resolution

Authors: Hyojoon Park, Sangeetha Grama Srinivasan, Matthew Cong, Doyub Kim, Byungsoo Kim, Jonathan Swartz, Ken Museth, Eftychios Sifakis

Abstract: We present a neural network-based simulation super-resolution framework that can efficiently and realistically enhance a facial performance produced by a low-cost, realtime physics-based simulation to a level of detail that closely approximates that of a reference-quality off-line simulator with much higher resolution (26x element count in our examples) and accurate physical modeling. Our approach… ▽ More We present a neural network-based simulation super-resolution framework that can efficiently and realistically enhance a facial performance produced by a low-cost, realtime physics-based simulation to a level of detail that closely approximates that of a reference-quality off-line simulator with much higher resolution (26x element count in our examples) and accurate physical modeling. Our approach is rooted in our ability to construct - via simulation - a training set of paired frames, from the low- and high-resolution simulators respectively, that are in semantic correspondence with each other. We use face animation as an exemplar of such a simulation domain, where creating this semantic congruence is achieved by simply dialing in the same muscle actuation controls and skeletal pose in the two simulators. Our proposed neural network super-resolution framework generalizes from this training set to unseen expressions, compensates for modeling discrepancies between the two simulations due to limited resolution or cost-cutting approximations in the real-time variant, and does not require any semantic descriptors or parameters to be provided as input, other than the result of the real-time simulation. We evaluate the efficacy of our pipeline on a variety of expressive performances and provide comparisons and ablation experiments for plausible variations and alternatives to our proposed scheme. △ Less

Submitted 9 August, 2023; v1 submitted 4 May, 2023; originally announced May 2023.

Synthetic DOmain-Targeted Augmentation (S-DOTA) Improves Model Generalization in Digital Pathology

Authors: Sai Chowdary Gullapally, Yibo Zhang, Nitin Kumar Mittal, Deeksha Kartik, Sandhya Srinivasan, Kevin Rose, Daniel Shenker, Dinkar Juyal, Harshith Padigela, Raymond Biju, Victor Minden, Chirag Maheshwari, Marc Thibault, Zvi Goldstein, Luke Novak, Nidhi Chandra, Justin Lee, Aaditya Prakash, Chintan Shah, John Abel, Darren Fahy, Amaro Taylor-Weiner, Anand Sampat

Abstract: Machine learning algorithms have the potential to improve patient outcomes in digital pathology. However, generalization of these tools is currently limited by sensitivity to variations in tissue preparation, staining procedures and scanning equipment that lead to domain shift in digitized slides. To overcome this limitation and improve model generalization, we studied the effectiveness of two Syn… ▽ More Machine learning algorithms have the potential to improve patient outcomes in digital pathology. However, generalization of these tools is currently limited by sensitivity to variations in tissue preparation, staining procedures and scanning equipment that lead to domain shift in digitized slides. To overcome this limitation and improve model generalization, we studied the effectiveness of two Synthetic DOmain-Targeted Augmentation (S-DOTA) methods, namely CycleGAN-enabled Scanner Transform (ST) and targeted Stain Vector Augmentation (SVA), and compared them against the International Color Consortium (ICC) profile-based color calibration (ICC Cal) method and a baseline method using traditional brightness, color and noise augmentations. We evaluated the ability of these techniques to improve model generalization to various tasks and settings: four models, two model types (tissue segmentation and cell classification), two loss functions, six labs, six scanners, and three indications (hepatocellular carcinoma (HCC), nonalcoholic steatohepatitis (NASH), prostate adenocarcinoma). We compared these methods based on the macro-averaged F1 scores on in-distribution (ID) and out-of-distribution (OOD) test sets across multiple domains, and found that S-DOTA methods (i.e., ST and SVA) led to significant improvements over ICC Cal and baseline on OOD data while maintaining comparable performance on ID data. Thus, we demonstrate that S-DOTA may help address generalization due to domain shift in real world applications. △ Less

Submitted 3 May, 2023; originally announced May 2023.

TACOS: Topology-Aware Collective Algorithm Synthesizer for Distributed Machine Learning

Authors: William Won, Midhilesh Elavazhagan, Sudarshan Srinivasan, Ajaya Durg, Samvit Kaul, Swati Gupta, Tushar Krishna

Abstract: The surge of artificial intelligence, specifically large language models, has led to a rapid advent towards the development of large-scale machine learning training clusters. Collective communications within these clusters tend to be heavily bandwidth-bound, necessitating techniques to optimally utilize the available network bandwidth. This puts the routing algorithm for the collective at the fore… ▽ More The surge of artificial intelligence, specifically large language models, has led to a rapid advent towards the development of large-scale machine learning training clusters. Collective communications within these clusters tend to be heavily bandwidth-bound, necessitating techniques to optimally utilize the available network bandwidth. This puts the routing algorithm for the collective at the forefront of determining the performance. Unfortunately, communication libraries used in distributed machine learning today are limited by a fixed set of routing algorithms. This constraints collective performance within the domain of next-generation training clusters that employ intricate, heterogeneous, and asymmetric, large-scale topologies. Further, the emergence of irregular topologies attributed to runtime phenomena such as device failures serves to compound the complexity of the challenge. To this end, this paper introduces TACOS, an automated synthesizer that generates topology-aware collective algorithms for common distributed machine learning collectives across arbitrary input network topologies. TACOS was able to synthesize All-Reduce algorithm for a heterogeneous 512-NPU system in just 6.09 minutes while achieving performance improvement up to 4.27x over state-of-the-art prior work. TACOS exhibits high scalability, with synthesis time scaling quadratically with the number of NPUs. In contrast to prior works' NP-hard approaches, TACOS with 40K NPUs completes in 2.52 hours. △ Less

Submitted 29 March, 2024; v1 submitted 11 April, 2023; originally announced April 2023.

ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale

Authors: William Won, Taekyung Heo, Saeed Rashidi, Srinivas Sridharan, Sudarshan Srinivasan, Tushar Krishna

Abstract: As deep learning models and input data are scaling at an unprecedented rate, it is inevitable to move towards distributed training platforms to fit the model and increase training throughput. State-of-the-art approaches and techniques, such as wafer-scale nodes, multi-dimensional network topologies, disaggregated memory systems, and parallelization strategies, have been actively adopted by emergin… ▽ More As deep learning models and input data are scaling at an unprecedented rate, it is inevitable to move towards distributed training platforms to fit the model and increase training throughput. State-of-the-art approaches and techniques, such as wafer-scale nodes, multi-dimensional network topologies, disaggregated memory systems, and parallelization strategies, have been actively adopted by emerging distributed training systems. This results in a complex SW/HW co-design stack of distributed training, necessitating a modeling/simulation infrastructure for design-space exploration. In this paper, we extend the open-source ASTRA-sim infrastructure and endow it with the capabilities to model state-of-the-art and emerging distributed training models and platforms. More specifically, (i) we enable ASTRA-sim to support arbitrary model parallelization strategies via a graph-based training-loop implementation, (ii) we implement a parameterizable multi-dimensional heterogeneous topology generation infrastructure with analytical performance estimates enabling simulating target systems at scale, and (iii) we enhance the memory system modeling to support accurate modeling of in-network collective communication and disaggregated memory systems. With such capabilities, we run comprehensive case studies targeting emerging distributed models and platforms. This infrastructure lets system designers swiftly traverse the complex co-design stack and give meaningful insights when designing and deploying distributed training platforms at scale. △ Less

Submitted 24 March, 2023; originally announced March 2023.

Searching for Time-Dependent Axion Dark Matter Signals in Pulsars

Authors: R. A. Battye, M. J. Keith, J. I. McDonald, S. Srinivasan, B. W. Stappers, P. Weltevrede

Abstract: Axion dark matter can be converted into photons in the magnetospheres of neutron stars leading to a spectral line centred on the Compton wavelength of the axion. Due to the rotation of the star and the plasma effects in the magnetosphere the signal is predicted to be periodic with significant time variation - a unique smoking gun for axion dark matter. As a proof of principle and to develop the me… ▽ More Axion dark matter can be converted into photons in the magnetospheres of neutron stars leading to a spectral line centred on the Compton wavelength of the axion. Due to the rotation of the star and the plasma effects in the magnetosphere the signal is predicted to be periodic with significant time variation - a unique smoking gun for axion dark matter. As a proof of principle and to develop the methodology, we carry out the first time domain search of the signal using data from PSR J2144$-$3933 taken as part of the MeerTIME project on MeerKAT telescope. We search for specific signal templates using a matched filter technique and discuss when a time-domain analysis (as is typically the case in pulsar observations) gives greater sensitivity to the axion-coupling to photons in comparison to a simple time-averaged total flux study. We do not find any candidate signals and, hence, impose an upper limit on the axion-to-photon coupling of $g_{aγγ}<4\times 10^{-11}\,{\rm GeV}^{-1}$ over the mass range $m_{\rm a}=3.9-4.7\,μ{\rm eV}$ using this data. This limit relies on PSR J2144$-$3933 not being an extremely aligned rotator, as strongly supported by simple arguments based on the observed pulse profile width. We discuss the possibilities of improving this limit using future observations with MeerKAT and also SKA1-mid and the possibility of using other objects. Finally, to evade modelling uncertainties in axion radio signals, we also carry out a generic ``any periodic-signal search" in the data, finding no evidence for an axion signal. △ Less

Submitted 28 November, 2023; v1 submitted 21 March, 2023; originally announced March 2023.

Comments: 21 pages, 14 figures Published in PRD

Journal ref: Physical Review D vol. 108, no. 6, 2023

Community-developed checklists for publishing images and image analysis

Authors: Christopher Schmied, Michael Nelson, Sergiy Avilov, Gert-Jan Bakker, Cristina Bertocchi, Johanna Bischof, Ulrike Boehm, Jan Brocher, Mariana Carvalho, Catalin Chiritescu, Jana Christopher, Beth Cimini, Eduardo Conde-Sousa, Michael Ebner, Rupert Ecker, Kevin Eliceiri, Julia Fernandez-Rodriguez, Nathalie Gaudreault, Laurent Gelman, David Grunwald, Tingting Gu, Nadia Halidi, Mathias Hammer, Matthew Hartley, Marie Held , et al. (29 additional authors not shown)

Abstract: Images document scientific discoveries and are prevalent in modern biomedical research. Microscopy imaging in particular is currently undergoing rapid technological advancements. However for scientists wishing to publish the obtained images and image analyses results, there are to date no unified guidelines. Consequently, microscopy images and image data in publications may be unclear or difficult… ▽ More Images document scientific discoveries and are prevalent in modern biomedical research. Microscopy imaging in particular is currently undergoing rapid technological advancements. However for scientists wishing to publish the obtained images and image analyses results, there are to date no unified guidelines. Consequently, microscopy images and image data in publications may be unclear or difficult to interpret. Here we present community-developed checklists for preparing light microscopy images and image analysis for publications. These checklists offer authors, readers, and publishers key recommendations for image formatting and annotation, color selection, data availability, and for reporting image analysis workflows. The goal of our guidelines is to increase the clarity and reproducibility of image figures and thereby heighten the quality of microscopy data is in publications. △ Less

Submitted 14 September, 2023; v1 submitted 14 February, 2023; originally announced February 2023.

Comments: 28 pages, 8 Figures, 3 Supplmentary Figures, Manuscript, Essential recommendations for publication of microscopy image data

Towards Optimal Depth-Reductions for Algebraic Formulas

Authors: Hervé Fournier, Nutan Limaye, Guillaume Malod, Srikanth Srinivasan, Sébastien Tavenas

Abstract: Classical results of Brent, Kuck and Maruyama (IEEE Trans. Computers 1973) and Brent (JACM 1974) show that any algebraic formula of size s can be converted to one of depth O(log s) with only a polynomial blow-up in size. In this paper, we consider a fine-grained version of this result depending on the degree of the polynomial computed by the algebraic formula. Given a homogeneous algebraic formula… ▽ More Classical results of Brent, Kuck and Maruyama (IEEE Trans. Computers 1973) and Brent (JACM 1974) show that any algebraic formula of size s can be converted to one of depth O(log s) with only a polynomial blow-up in size. In this paper, we consider a fine-grained version of this result depending on the degree of the polynomial computed by the algebraic formula. Given a homogeneous algebraic formula of size s computing a polynomial P of degree d, we show that P can also be computed by an (unbounded fan-in) algebraic formula of depth O(log d) and size poly(s). Our proof shows that this result also holds in the highly restricted setting of monotone, non-commutative algebraic formulas. This improves on previous results in the regime when d is small (i.e., d<<s). In particular, for the setting of d=O(log s), along with a result of Raz (STOC 2010, JACM 2013), our result implies the same depth reduction even for inhomogeneous formulas. This is particularly interesting in light of recent algebraic formula lower bounds, which work precisely in this ``low-degree" and ``low-depth" setting. We also show that these results cannot be improved in the monotone setting, even for commutative formulas. △ Less

Submitted 14 February, 2023; originally announced February 2023.

Rotational Abstractions for Verification of Quantum Fourier Transform Circuits

Authors: Arun Govindankutty, Sudarshan K. Srinivasan, Nimish Mathure

Abstract: With the race to build large-scale quantum computers and efforts to exploit quantum algorithms for efficient problem solving in science and engineering disciplines, the requirement to have efficient and scalable verification methods are of vital importance. We propose a novel formal verification method that is targeted at Quantum Fourier Transform (QFT) circuits. QFT is a fundamental quantum algor… ▽ More With the race to build large-scale quantum computers and efforts to exploit quantum algorithms for efficient problem solving in science and engineering disciplines, the requirement to have efficient and scalable verification methods are of vital importance. We propose a novel formal verification method that is targeted at Quantum Fourier Transform (QFT) circuits. QFT is a fundamental quantum algorithm that forms the basis of many quantum computing applications. The verification method employs abstractions of quantum gates used in QFT that leads to a reduction of the verification problem from Hilbert space to the quantifier free logic of bit-vectors. Very efficient decision procedures are available to reason about bit-vectors. Therefore, our method is able to scale up to the verification of QFT circuits with 10,000 qubits and 50 million quantum gates, providing a meteoric advance in the size of QFT circuits thus far verified using formal verification methods. △ Less

Submitted 2 January, 2023; originally announced January 2023.

Journal ref: IET Quantum Communication, March 2023

A Continuous Action Space Tree search for INverse desiGn (CASTING) Framework for Materials Discovery

Authors: Suvo Banik, Troy Loefller, Sukriti Manna, Srilok Srinivasan, Pierre Darancet, Henry Chan, Alexander Hexemer, Subramanian KRS Sankaranarayanan

Abstract: Fast and accurate prediction of optimal crystal structure, topology, and microstructures is important for accelerating the design and discovery of new materials. A challenge lies in the exorbitantly large structural and compositional space presented by the various elements and their combinations. Speed, accuracy, and scalability are three desirables for any inverse design tool to sample efficientl… ▽ More Fast and accurate prediction of optimal crystal structure, topology, and microstructures is important for accelerating the design and discovery of new materials. A challenge lies in the exorbitantly large structural and compositional space presented by the various elements and their combinations. Speed, accuracy, and scalability are three desirables for any inverse design tool to sample efficiently across such a vast space. While traditional global optimization approaches (e.g., evolutionary algorithm, random sampling based) have demonstrated the ability to predict new crystal structures that can be used as super-hard materials, semiconductors, and photovoltaic materials to name a few, it is highly desirable to develop approaches that converge faster to the solution, have better solution quality, and are scalable to high dimensionality. Reinforcement learning (RL) approaches are emerging as powerful design tools capable of addressing these issues but primarily operate in discrete action space. In this work, we introduce CASTING, which is an RL-based scalable framework for crystal structure, topology, and potentially microstructure prediction. CASTING employs an RL-based continuous search space decision tree (MCTS -Monte Carlo Tree Search) algorithm with three important modifications (i) a modified rewards scheme for improved search space exploration (ii) a 'windowing' or 'funneling' scheme for improved exploitation and (iii) adaptive sampling during playouts for efficient and scalable search. Using a set of representative examples ranging from metals such as Ag to covalent systems such as C and multicomponent systems (graphane, boron nitride, and complex correlated oxides), we demonstrate the accuracy, the speed of convergence, and the scalability of CASTING to discover new metastable crystal structures and phases that meet the target objective. △ Less

Submitted 22 December, 2022; originally announced December 2022.

Embedding Synthetic Off-Policy Experience for Autonomous Driving via Zero-Shot Curricula

Authors: Eli Bronstein, Sirish Srinivasan, Supratik Paul, Aman Sinha, Matthew O'Kelly, Payam Nikdel, Shimon Whiteson

Abstract: ML-based motion planning is a promising approach to produce agents that exhibit complex behaviors, and automatically adapt to novel environments. In the context of autonomous driving, it is common to treat all available training data equally. However, this approach produces agents that do not perform robustly in safety-critical settings, an issue that cannot be addressed by simply adding more data… ▽ More ML-based motion planning is a promising approach to produce agents that exhibit complex behaviors, and automatically adapt to novel environments. In the context of autonomous driving, it is common to treat all available training data equally. However, this approach produces agents that do not perform robustly in safety-critical settings, an issue that cannot be addressed by simply adding more data to the training set - we show that an agent trained using only a 10% subset of the data performs just as well as an agent trained on the entire dataset. We present a method to predict the inherent difficulty of a driving situation given data collected from a fleet of autonomous vehicles deployed on public roads. We then demonstrate that this difficulty score can be used in a zero-shot transfer to generate curricula for an imitation-learning based planning agent. Compared to training on the entire unbiased training dataset, we show that prioritizing difficult driving scenarios both reduces collisions by 15% and increases route adherence by 14% in closed-loop evaluation, all while using only 10% of the training data. △ Less

Submitted 2 December, 2022; originally announced December 2022.

Comments: Published in CoRL 2022. Main text (8 pages, 3 figures) + acknowledgements and references (3 pages) + appendix (7 pages, 4 figures)

Modeling and Optimization of Steady Flow of Natural Gas and Hydrogen Mixtures in Pipeline Networks

Authors: Saif R. Kazi, Kaarthik Sundar, Shriram Srinivasan, Anatoly Zlotnik

Abstract: We extend the canonical problems of simulation and optimization of steady-state gas flows in pipeline networks with compressors to the transport of mixtures of highly heterogeneous gases injected throughout a network. Our study is motivated by proposed projects to blend hydrogen generated using clean energy into existing natural gas pipeline systems as part of efforts to reduce the reliance of ene… ▽ More We extend the canonical problems of simulation and optimization of steady-state gas flows in pipeline networks with compressors to the transport of mixtures of highly heterogeneous gases injected throughout a network. Our study is motivated by proposed projects to blend hydrogen generated using clean energy into existing natural gas pipeline systems as part of efforts to reduce the reliance of energy systems on fossil fuels. Flow in a pipe is related to endpoint pressures by a basic Weymouth equation model, with an ideal gas equation of state, where the wave speed depends on the hydrogen concentration. At vertices, in addition to mass balance, we also consider mixing of incoming flows of varying hydrogen concentrations. The problems of interest are the heterogeneous gas flow simulation (HGFS), which determines system pressures and flows given fixed boundary conditions and compressor settings, as well as the heterogeneous gas flow optimization (HGFO), which extremizes an objective by determining optimal boundary conditions and compressor settings. We examine conditions for uniqueness of solutions to the HGFS, as well as compare and contrast mixed-integer and continuous nonlinear programming formulations for the HGFO. We develop computational methods to solve both problems, and examine their performance using four test networks of increasing complexity. △ Less

Submitted 1 December, 2022; originally announced December 2022.

Comments: 12 pages

Report number: LA-UR-2232518

Topic Segmentation in the Wild: Towards Segmentation of Semi-structured & Unstructured Chats

Authors: Reshmi Ghosh, Harjeet Singh Kajal, Sharanya Kamath, Dhuri Shrivastava, Samyadeep Basu, Soundararajan Srinivasan

Abstract: Breaking down a document or a conversation into multiple contiguous segments based on its semantic structure is an important and challenging problem in NLP, which can assist many downstream tasks. However, current works on topic segmentation often focus on segmentation of structured texts. In this paper, we comprehensively analyze the generalization capabilities of state-of-the-art topic segmentat… ▽ More Breaking down a document or a conversation into multiple contiguous segments based on its semantic structure is an important and challenging problem in NLP, which can assist many downstream tasks. However, current works on topic segmentation often focus on segmentation of structured texts. In this paper, we comprehensively analyze the generalization capabilities of state-of-the-art topic segmentation models on unstructured texts. We find that: (a) Current strategies of pre-training on a large corpus of structured text such as Wiki-727K do not help in transferability to unstructured texts. (b) Training from scratch with only a relatively small-sized dataset of the target unstructured domain improves the segmentation results by a significant margin. △ Less

Submitted 27 November, 2022; originally announced November 2022.

Comments: NeurIPS 2022 : ENLSP

Device Directedness with Contextual Cues for Spoken Dialog Systems

Authors: Dhanush Bekal, Sundararajan Srinivasan, Sravan Bodapati, Srikanth Ronanki, Katrin Kirchhoff

Abstract: In this work, we define barge-in verification as a supervised learning task where audio-only information is used to classify user spoken dialogue into true and false barge-ins. Following the success of pre-trained models, we use low-level speech representations from a self-supervised representation learning model for our downstream classification task. Further, we propose a novel technique to infu… ▽ More In this work, we define barge-in verification as a supervised learning task where audio-only information is used to classify user spoken dialogue into true and false barge-ins. Following the success of pre-trained models, we use low-level speech representations from a self-supervised representation learning model for our downstream classification task. Further, we propose a novel technique to infuse lexical information directly into speech representations to improve the domain-specific language information implicitly learned during pre-training. Experiments conducted on spoken dialog data show that our proposed model trained to validate barge-in entirely from speech representations is faster by 38% relative and achieves 4.5% relative F1 score improvement over a baseline LSTM model that uses both audio and Automatic Speech Recognition (ASR) 1-best hypotheses. On top of this, our best proposed model with lexically infused representations along with contextual features provides a further relative improvement of 5.7% in the F1 score but only 22% faster than the baseline. △ Less

Submitted 23 November, 2022; originally announced November 2022.

SLATE: A Sequence Labeling Approach for Task Extraction from Free-form Inked Content

Authors: Apurva Gandhi, Ryan Serrao, Biyi Fang, Gilbert Antonius, Jenna Hong, Tra My Nguyen, Sheng Yi, Ehi Nosakhare, Irene Shaffer, Soundararajan Srinivasan, Vivek Gupta

Abstract: We present SLATE, a sequence labeling approach for extracting tasks from free-form content such as digitally handwritten (or "inked") notes on a virtual whiteboard. Our approach allows us to create a single, low-latency model to simultaneously perform sentence segmentation and classification of these sentences into task/non-task sentences. SLATE greatly outperforms a baseline two-model (sentence s… ▽ More We present SLATE, a sequence labeling approach for extracting tasks from free-form content such as digitally handwritten (or "inked") notes on a virtual whiteboard. Our approach allows us to create a single, low-latency model to simultaneously perform sentence segmentation and classification of these sentences into task/non-task sentences. SLATE greatly outperforms a baseline two-model (sentence segmentation followed by classification model) approach, achieving a task F1 score of 84.4%, a sentence segmentation (boundary similarity) score of 88.4% and three times lower latency compared to the baseline. Furthermore, we provide insights into tackling challenges of performing NLP on the inking domain. We release both our code and dataset for this novel task. △ Less

Submitted 17 November, 2022; v1 submitted 8 November, 2022; originally announced November 2022.

Comments: Accepted at EMNLP 2022 as an Industry Track paper

SCA: Streaming Cross-attention Alignment for Echo Cancellation

Authors: Yang Liu, Yangyang Shi, Yun Li, Kaustubh Kalgaonkar, Sriram Srinivasan, Xin Lei

Abstract: End-to-End deep learning has shown promising results for speech enhancement tasks, such as noise suppression, dereverberation, and speech separation. However, most state-of-the-art methods for echo cancellation are either classical DSP-based or hybrid DSP-ML algorithms. Components such as the delay estimator and adaptive linear filter are based on traditional signal processing concepts, and deep l… ▽ More End-to-End deep learning has shown promising results for speech enhancement tasks, such as noise suppression, dereverberation, and speech separation. However, most state-of-the-art methods for echo cancellation are either classical DSP-based or hybrid DSP-ML algorithms. Components such as the delay estimator and adaptive linear filter are based on traditional signal processing concepts, and deep learning algorithms typically only serve to replace the non-linear residual echo suppressor. This paper introduces an end-to-end echo cancellation network with a streaming cross-attention alignment (SCA). Our proposed method can handle unaligned inputs without requiring external alignment and generate high-quality speech without echoes. At the same time, the end-to-end algorithm simplifies the current echo cancellation pipeline for time-variant echo path cases. We test our proposed method on the ICASSP2022 and Interspeech2021 Microsoft deep echo cancellation challenge evaluation dataset, where our method outperforms some of the other hybrid and end-to-end methods. △ Less

Submitted 1 November, 2022; originally announced November 2022.

Scalable Measurement Error Mitigation via Iterative Bayesian Unfolding

Authors: Siddarth Srinivasan, Bibek Pokharel, Gregory Quiroz, Byron Boots

Abstract: Measurement error mitigation (MEM) techniques are postprocessing strategies to counteract systematic read-out errors on quantum computers (QC). Currently used MEM strategies face a tradeoff: methods that scale well with the number of qubits return negative probabilities, while those that guarantee a valid probability distribution are not scalable. Here, we present a scheme that addresses both of t… ▽ More Measurement error mitigation (MEM) techniques are postprocessing strategies to counteract systematic read-out errors on quantum computers (QC). Currently used MEM strategies face a tradeoff: methods that scale well with the number of qubits return negative probabilities, while those that guarantee a valid probability distribution are not scalable. Here, we present a scheme that addresses both of these issues. In particular, we present a scalable implementation of iterative Bayesian unfolding, a standard mitigation technique used in high-energy physics experiments. We demonstrate our method by mitigating QC data from experimental preparation of Greenberger-Horne-Zeilinger (GHZ) states up to 127 qubits and implementation of the Bernstein-Vazirani algorithm on up to 26 qubits. △ Less

Submitted 21 October, 2022; originally announced October 2022.

A modular quantum-classical framework for simulating chemical reaction pathways accurately

Authors: Nirmal M R, Shampa Sarkar, Manoj Nambiar, Sriram Goverapet Srinivasan

Abstract: A lot of progress has been made in recent times for simulating accurately the ground state energy of small molecules and their potential energy surface, using quantum-classical hybrid computing architecture. While these single point energy calculations are a significant milestone for quantum chemistry simulation on quantum hardware, a similarly important application is to trace accurately the reac… ▽ More A lot of progress has been made in recent times for simulating accurately the ground state energy of small molecules and their potential energy surface, using quantum-classical hybrid computing architecture. While these single point energy calculations are a significant milestone for quantum chemistry simulation on quantum hardware, a similarly important application is to trace accurately the reaction pathway of various chemical transformations. Such computations require accurate determination of the equilibrium or lowest energy molecular geometry, either by computing energy gradients with respect to the molecule's nuclear coordinates or perturbative distortion of the molecular configuration. In this work, we present a modular quantum-classical hybrid framework, to accurately simulate chemical reaction pathway of various kinds of molecular reactions. We demonstrate our framework by accurately tracing the isomerization pathway for small organic molecules. This framework can now be readily applied to study other 'active' molecules from the pharma and chemical industries. △ Less

Submitted 17 October, 2022; originally announced October 2022.

Comments: 9 pages, 8 figures

Fluidic Topology Optimization with an Anisotropic Mixture Model

Authors: Yifei Li, Tao Du, Sangeetha Grama Srinivasan, Kui Wu, Bo Zhu, Eftychios Sifakis, Wojciech Matusik

Abstract: Fluidic devices are crucial components in many industrial applications involving fluid mechanics. Computational design of a high-performance fluidic system faces multifaceted challenges regarding its geometric representation and physical accuracy. We present a novel topology optimization method to design fluidic devices in a Stokes flow context. Our approach is featured by its capability in accomm… ▽ More Fluidic devices are crucial components in many industrial applications involving fluid mechanics. Computational design of a high-performance fluidic system faces multifaceted challenges regarding its geometric representation and physical accuracy. We present a novel topology optimization method to design fluidic devices in a Stokes flow context. Our approach is featured by its capability in accommodating a broad spectrum of boundary conditions at the solid-fluid interface. Our key contribution is an anisotropic and differentiable constitutive model that unifies the representation of different phases and boundary conditions in a Stokes model, enabling a topology optimization method that can synthesize novel structures with accurate boundary conditions from a background grid discretization. We demonstrate the efficacy of our approach by conducting several fluidic system design tasks with over four million design parameters. △ Less

Submitted 24 September, 2022; v1 submitted 21 September, 2022; originally announced September 2022.

Comments: Accepted by SIGGRAPH Asia 2022. For low resolution paper see https://people.csail.mit.edu/liyifei/publication/anisotropic-stokes-fluidic-device/

Journal ref: ACM Transactions on Graphics (TOG), 2022

CO line observations of OH/IR stars in the inner Galactic Bulge: Characteristics of stars at the tip of the AGB

Authors: H. Olofsson, T. Khouri, B. A. Sargent, A. Winnberg, J. A. D. L. Blommaert, M. A. T. Groenewegen, S. Muller, J. H. Kastner, M. Meixner, M. Otsuka, N. Patel, N. Ryde, S. Srinivasan

Abstract: 12CO and 13CO lines, as well as a mm-wave continuum, have been observed for a sample of 22 OH/IR stars in directions within 2 degrees of the Galactic Centre. Photometry data have been gathered from the literature to construct SEDs and to determine pulsational variability. Radiative transfer models have been used to interpret the data. All stars in the sample were detected in at least one CO line,… ▽ More 12CO and 13CO lines, as well as a mm-wave continuum, have been observed for a sample of 22 OH/IR stars in directions within 2 degrees of the Galactic Centre. Photometry data have been gathered from the literature to construct SEDs and to determine pulsational variability. Radiative transfer models have been used to interpret the data. All stars in the sample were detected in at least one CO line, and 8 objects were detected in 324 GHz continuum. Based on luminosity criteria, the sample is divided into 17 objects that most likely lie within the inner Galactic Bulge, and 5 objects that are most likely foreground objects. The median luminosity of the inner-Galactic-Bulge objects, 5600 Lsun, corresponds to an initial mass in the range 1.2-1.6 Msun, indicating that these OH/IR stars descend from solar-type stars. The objects in this sub-sample are further divided into two classes based on their SED characteristics: 11 objects have SEDs that are well matched by models invoking dust envelopes extending from a few stellar radii and outwards, while 6 objects are better modelled as having detached dust envelopes with inner radii in the range 200-600 au and warmer central stars. The former objects have periodic variability, while the latter objects are predominantly non-periodic. The median gas-mass-loss rate, gas terminal expansion velocity, gas-to-dust mass ratio, and circumstellar 12CO/13CO abundance ratio have been estimated to be 2x10{-5} Msun/yr, 18 km/s, 200 (excluding the sources with detached dust envelopes, which show markedly lower gas-to-dust ratios), and 5, respectively, for the inner-Galactic-Bulge objects. The inner-Galactic-Bulge OH/IR stars studied here constitute an excellent sample of equidistant objects for the purpose of understanding the evolution of the mass-loss-rate characteristics at the tip of the AGB. △ Less

Submitted 20 July, 2022; originally announced July 2022.

Comments: 32 pages, 17 figures

An Empirical Study of Implicit Regularization in Deep Offline RL

Authors: Caglar Gulcehre, Srivatsan Srinivasan, Jakub Sygnowski, Georg Ostrovski, Mehrdad Farajtabar, Matt Hoffman, Razvan Pascanu, Arnaud Doucet

Abstract: Deep neural networks are the most commonly used function approximators in offline reinforcement learning. Prior works have shown that neural nets trained with TD-learning and gradient descent can exhibit implicit regularization that can be characterized by under-parameterization of these networks. Specifically, the rank of the penultimate feature layer, also called \textit{effective rank}, has bee… ▽ More Deep neural networks are the most commonly used function approximators in offline reinforcement learning. Prior works have shown that neural nets trained with TD-learning and gradient descent can exhibit implicit regularization that can be characterized by under-parameterization of these networks. Specifically, the rank of the penultimate feature layer, also called \textit{effective rank}, has been observed to drastically collapse during the training. In turn, this collapse has been argued to reduce the model's ability to further adapt in later stages of learning, leading to the diminished final performance. Such an association between the effective rank and performance makes effective rank compelling for offline RL, primarily for offline policy evaluation. In this work, we conduct a careful empirical study on the relation between effective rank and performance on three offline RL datasets : bsuite, Atari, and DeepMind lab. We observe that a direct association exists only in restricted settings and disappears in the more extensive hyperparameter sweeps. Also, we empirically identify three phases of learning that explain the impact of implicit regularization on the learning dynamics and found that bootstrapping alone is insufficient to explain the collapse of the effective rank. Further, we show that several other factors could confound the relationship between effective rank and performance and conclude that studying this association under simplistic assumptions could be highly misleading. △ Less

Submitted 7 July, 2022; v1 submitted 5 July, 2022; originally announced July 2022.

Comments: 40 pages, 37 figures, 2 tables

Domain Adaptation for Object Detection using SE Adaptors and Center Loss

Authors: Sushruth Nagesh, Shreyas Rajesh, Asfiya Baig, Savitha Srinivasan

Abstract: Despite growing interest in object detection, very few works address the extremely practical problem of cross-domain robustness especially for automative applications. In order to prevent drops in performance due to domain shift, we introduce an unsupervised domain adaptation method built on the foundation of faster-RCNN with two domain adaptation components addressing the shift at the instance an… ▽ More Despite growing interest in object detection, very few works address the extremely practical problem of cross-domain robustness especially for automative applications. In order to prevent drops in performance due to domain shift, we introduce an unsupervised domain adaptation method built on the foundation of faster-RCNN with two domain adaptation components addressing the shift at the instance and image levels respectively and apply a consistency regularization between them. We also introduce a family of adaptation layers that leverage the squeeze excitation mechanism called SE Adaptors to improve domain attention and thus improves performance without any prior requirement of knowledge of the new target domain. Finally, we incorporate a center loss in the instance and image level representations to improve the intra-class variance. We report all results with Cityscapes as our source domain and Foggy Cityscapes as the target domain outperforming previous baselines. △ Less

Submitted 25 May, 2022; originally announced May 2022.

Structure Aware and Class Balanced 3D Object Detection on nuScenes Dataset

Authors: Sushruth Nagesh, Asfiya Baig, Savitha Srinivasan, Akshay Rangesh, Mohan Trivedi

Abstract: 3-D object detection is pivotal for autonomous driving. Point cloud based methods have become increasingly popular for 3-D object detection, owing to their accurate depth information. NuTonomy's nuScenes dataset greatly extends commonly used datasets such as KITTI in size, sensor modalities, categories, and annotation numbers. However, it suffers from severe class imbalance. The Class-balanced Gro… ▽ More 3-D object detection is pivotal for autonomous driving. Point cloud based methods have become increasingly popular for 3-D object detection, owing to their accurate depth information. NuTonomy's nuScenes dataset greatly extends commonly used datasets such as KITTI in size, sensor modalities, categories, and annotation numbers. However, it suffers from severe class imbalance. The Class-balanced Grouping and Sampling paper addresses this issue and suggests augmentation and sampling strategy. However, the localization precision of this model is affected by the loss of spatial information in the downscaled feature maps. We propose to enhance the performance of the CBGS model by designing an auxiliary network, that makes full use of the structure information of the 3D point cloud, in order to improve the localization accuracy. The detachable auxiliary network is jointly optimized by two point-level supervisions, namely foreground segmentation and center estimation. The auxiliary network does not introduce any extra computation during inference, since it can be detached at test time. △ Less

Submitted 3 October, 2022; v1 submitted 25 May, 2022; originally announced May 2022.

Vanishing Spaces of Random Sets and Applications to Reed-Muller Codes

Authors: Siddharth Bhandari, Prahladh Harsha, Ramprasad Saptharishi, Srikanth Srinivasan

Abstract: We study the following natural question on random sets of points in $\mathbb{F}_2^m$: Given a random set of $k$ points $Z=\{z_1, z_2, \dots, z_k\} \subseteq \mathbb{F}_2^m$, what is the dimension of the space of degree at most $r$ multilinear polynomials that vanish on all points in $Z$? We show that, for $r \leq γm$ (where $γ> 0$ is a small, absolute constant) and… ▽ More We study the following natural question on random sets of points in $\mathbb{F}_2^m$: Given a random set of $k$ points $Z=\{z_1, z_2, \dots, z_k\} \subseteq \mathbb{F}_2^m$, what is the dimension of the space of degree at most $r$ multilinear polynomials that vanish on all points in $Z$? We show that, for $r \leq γm$ (where $γ> 0$ is a small, absolute constant) and $k = (1-ε) \cdot \binom{m}{\leq r}$ for any constant $ε> 0$, the space of degree at most $r$ multilinear polynomials vanishing on a random set $Z = \{z_1,\ldots, z_k\}$ has dimension exactly $\binom{m}{\leq r} - k$ with probability $1 - o(1)$. This bound shows that random sets have a much smaller space of degree at most $r$ multilinear polynomials vanishing on them, compared to the worst-case bound (due to Wei (IEEE Trans. Inform. Theory, 1991)) of $\binom{m}{\leq r} - \binom{\log_2 k}{\leq r} \gg \binom{m}{\leq r} - k$. Using this bound, we show that high-degree Reed-Muller codes ($\text{RM}(m,d)$ with $d > (1-γ) m$) "achieve capacity" under the Binary Erasure Channel in the sense that, for any $ε> 0$, we can recover from $(1 - ε) \cdot \binom{m}{\leq m-d-1}$ random erasures with probability $1 - o(1)$. This also implies that $\text{RM}(m,d)$ is also efficiently decodable from $\approx \binom{m}{\leq m-(d/2)}$ random errors for the same range of parameters. △ Less

Submitted 22 May, 2022; originally announced May 2022.

Comments: 17 pages, In CCC'2022

Journal ref: In Proc. 37th CCC, 2022

Numerical Solution of the Steady-State Network Flow Equations for a Non-Ideal Gas

Authors: Shriram Srinivasan, Kaarthik Sundar, Vitaliy Gyrya, Anatoly Zlotnik

Abstract: We formulate a steady-state network flow problem for non-ideal gas that relates injection rates and nodal pressures in the network to flows in pipes. For this problem, we present and prove a theorem on uniqueness of generalized solution for a broad class of non-ideal pressure-density relations that satisfy a monotonicity property. Further, we develop a Newton-Raphson algorithm for numerical soluti… ▽ More We formulate a steady-state network flow problem for non-ideal gas that relates injection rates and nodal pressures in the network to flows in pipes. For this problem, we present and prove a theorem on uniqueness of generalized solution for a broad class of non-ideal pressure-density relations that satisfy a monotonicity property. Further, we develop a Newton-Raphson algorithm for numerical solution of the steady-state problem, which is made possible by a systematic non-dimensionalization of the equations. The developed algorithm has been extensively tested on benchmark instances and shown to converge robustly to a generalized solution. Previous results indicate that the steady-state network flow equations for an ideal gas are difficult to solve by the Newton-Raphson method because of its extreme sensitivity to the initial guess. In contrast, we find that non-dimensionalization of the steady-state problem is key to robust convergence of the Newton-Raphson method. We identify criteria based on the uniqueness of solutions under which the existence of a non-physical generalized solution found by a non-linear solver implies non-existence of a physical solution, i.e., infeasibility of the problem. Finally, we compare pressure and flow solutions based on ideal and non-ideal equations of state to demonstrate the need to apply the latter in practice. The solver developed in this article is open-source and is made available for both the academic and research communities as well as the industry. △ Less

Submitted 29 November, 2022; v1 submitted 31 March, 2022; originally announced April 2022.

Comments: 12 pages

Report number: LA-UR-22-21789

BioADAPT-MRC: Adversarial Learning-based Domain Adaptation Improves Biomedical Machine Reading Comprehension Task

Authors: Maria Mahbub, Sudarshan Srinivasan, Edmon Begoli, Gregory D Peterson

Abstract: Biomedical machine reading comprehension (biomedical-MRC) aims to comprehend complex biomedical narratives and assist healthcare professionals in retrieving information from them. The high performance of modern neural network-based MRC systems depends on high-quality, large-scale, human-annotated training datasets. In the biomedical domain, a crucial challenge in creating such datasets is the requ… ▽ More Biomedical machine reading comprehension (biomedical-MRC) aims to comprehend complex biomedical narratives and assist healthcare professionals in retrieving information from them. The high performance of modern neural network-based MRC systems depends on high-quality, large-scale, human-annotated training datasets. In the biomedical domain, a crucial challenge in creating such datasets is the requirement for domain knowledge, inducing the scarcity of labeled data and the need for transfer learning from the labeled general-purpose (source) domain to the biomedical (target) domain. However, there is a discrepancy in marginal distributions between the general-purpose and biomedical domains due to the variances in topics. Therefore, direct-transferring of learned representations from a model trained on a general-purpose domain to the biomedical domain can hurt the model's performance. We present an adversarial learning-based domain adaptation framework for the biomedical machine reading comprehension task (BioADAPT-MRC), a neural network-based method to address the discrepancies in the marginal distributions between the general and biomedical domain datasets. BioADAPT-MRC relaxes the need for generating pseudo labels for training a well-performing biomedical-MRC model. We extensively evaluate the performance of BioADAPT-MRC by comparing it with the best existing methods on three widely used benchmark biomedical-MRC datasets -- BioASQ-7b, BioASQ-8b, and BioASQ-9b. Our results suggest that without using any synthetic or human-annotated data from the biomedical domain, BioADAPT-MRC can achieve state-of-the-art performance on these datasets. Availability: BioADAPT-MRC is freely available as an open-source project at \url{https://github.com/mmahbub/BioADAPT-MRC}. △ Less

Submitted 26 July, 2022; v1 submitted 26 February, 2022; originally announced February 2022.

Comments: 31 pages, 9 figures. This is the Authors' Original Version of the article, which has been accepted for publication in Bioinformatics 2022

A Robust Version of Hegedűs's Lemma, with Applications

Authors: Srikanth Srinivasan

Abstract: Hegedűs's lemma is the following combinatorial statement regarding polynomials over finite fields. Over a field $\mathbb{F}$ of characteristic $p > 0$ and for $q$ a power of $p$, the lemma says that any multilinear polynomial $P\in \mathbb{F}[x_1,\ldots,x_n]$ of degree less than $q$ that vanishes at all points in $\{0,1\}^n$ of some fixed Hamming weight $k\in [q,n-q]$ must also vanish at all point… ▽ More Hegedűs's lemma is the following combinatorial statement regarding polynomials over finite fields. Over a field $\mathbb{F}$ of characteristic $p > 0$ and for $q$ a power of $p$, the lemma says that any multilinear polynomial $P\in \mathbb{F}[x_1,\ldots,x_n]$ of degree less than $q$ that vanishes at all points in $\{0,1\}^n$ of some fixed Hamming weight $k\in [q,n-q]$ must also vanish at all points in $\{0,1\}^n$ of weight $k + q$. This lemma was used by Hegedűs (2009) to give a solution to \emph{Galvin's problem}, an extremal problem about set systems; by Alon, Kumar and Volk (2018) to improve the best-known multilinear circuit lower bounds; and by Hrubeš, Ramamoorthy, Rao and Yehudayoff (2019) to prove optimal lower bounds against depth-$2$ threshold circuits for computing some symmetric functions. In this paper, we formulate a robust version of Hegedűs's lemma. Informally, this version says that if a polynomial of degree $o(q)$ vanishes at most points of weight $k$, then it vanishes at many points of weight $k+q$. We prove this lemma and give three different applications. △ Less

Submitted 24 February, 2023; v1 submitted 10 February, 2022; originally announced February 2022.

Comments: Published in STOC 2020. Changed affiliation in v2. v3: Revised in accordance with comments from referees for TheoretiCS

Journal ref: TheoretiCS, Volume 2 (March 1, 2023) theoretics:9143

Detecting Discussions of Technical Debt

Authors: Ipek Ozkaya, Zachary Kurtz, Robert L. Nord, Raghvinder S. Sangwan, Satish M. Srinivasan

Abstract: Technical debt (TD) refers to suboptimal choices during software development that achieve short-term goals at the expense of long-term quality. Although developers often informally discuss TD, the concept has not yet crystalized into a consistently applied label when describing issues in most repositories. We apply machine learning to understand developer insights into TD when discussing tickets i… ▽ More Technical debt (TD) refers to suboptimal choices during software development that achieve short-term goals at the expense of long-term quality. Although developers often informally discuss TD, the concept has not yet crystalized into a consistently applied label when describing issues in most repositories. We apply machine learning to understand developer insights into TD when discussing tickets in an issue tracker. We generate expert labels that indicate whether discussion of TD occurs in the free text associated with each ticket in a sample of more than 1,900 tickets in the Chromium issue tracker. We then use these labels to train a classifier that estimates labels for the remaining 475,000 tickets. We conclude that discussion of TD appears in about 16% of the tracked Chromium issues. If we can effectively classify TD-related issues, we can focus on what practices could be most useful for their timely resolution. △ Less

Submitted 28 January, 2022; originally announced January 2022.

Comments: 12 pages, 5 figures, 5 tables

Report number: DM18-0447

A Census of Thermally-Pulsing AGB stars in the Andromeda Galaxy and a First Estimate of their Contribution to the Global Dust Budget

Authors: Steven R. Goldman, Martha L. Boyer, Julianne Dalcanton, Iain McDonald, Leo Girardi, Benjamin F. Williams, Sundar Srinivasan, Karl Gordon

Abstract: We present a near-complete catalog of the metal-rich population of Thermally-Pulsing Asymptotic Giant Branch stars in the northwest quadrant of M31. This metal-rich sample complements the equally complete metal-poor Magellanic Cloud AGB catalogs produced by the SAGE program. Our catalog includes HST wide-band photometry from the Panchromatic Hubble Andromeda Treasury survey, HST medium-band photom… ▽ More We present a near-complete catalog of the metal-rich population of Thermally-Pulsing Asymptotic Giant Branch stars in the northwest quadrant of M31. This metal-rich sample complements the equally complete metal-poor Magellanic Cloud AGB catalogs produced by the SAGE program. Our catalog includes HST wide-band photometry from the Panchromatic Hubble Andromeda Treasury survey, HST medium-band photometry used to chemically classify a subset of the sample, and Spitzer mid- and far-IR photometry that we have used to isolate dust-producing AGB stars. We have detected 346,623 AGB stars; these include 4,802 AGB candidates producing considerable dust, and 1,356 AGB candidates that lie within clusters with measured ages, and in some cases metallicities. Using the Spitzer data and chemical classifications made with the medium-band data, we have identified both carbon- and oxygen-rich AGB candidates producing significant dust. We have applied color--mass-loss relations based on dusty AGB stars from the LMC to estimate the dust injection by AGB stars in the PHAT footprint. Applying our color relations to a subset of the chemically-classified stars producing the bulk of the dust, we find that ~97.8% of the dust is oxygen-rich. Using several scenarios for the dust lifetime, we have estimated the contribution of AGB stars to the global dust budget of M31 to be 0.9-35.5%, which is in line with previous estimates in the Magellanic Clouds. Follow-up observations of the M31 AGB candidates with the JWST will allow us to further constrain stellar and chemical evolutionary models, and the feedback and dust production of metal-rich evolved stars. △ Less

Submitted 28 December, 2021; originally announced December 2021.

Comments: Accepted for publication in ApJS. 35 pages, 25 Figures

On Optimizing Interventions in Shared Autonomy

Authors: Weihao Tan, David Koleczek, Siddhant Pradhan, Nicholas Perello, Vivek Chettiar, Vishal Rohra, Aaslesha Rajaram, Soundararajan Srinivasan, H M Sajjad Hossain, Yash Chandak

Abstract: Shared autonomy refers to approaches for enabling an autonomous agent to collaborate with a human with the aim of improving human performance. However, besides improving performance, it may often also be beneficial that the agent concurrently accounts for preserving the user's experience or satisfaction of collaboration. In order to address this additional goal, we examine approaches for improving… ▽ More Shared autonomy refers to approaches for enabling an autonomous agent to collaborate with a human with the aim of improving human performance. However, besides improving performance, it may often also be beneficial that the agent concurrently accounts for preserving the user's experience or satisfaction of collaboration. In order to address this additional goal, we examine approaches for improving the user experience by constraining the number of interventions by the autonomous agent. We propose two model-free reinforcement learning methods that can account for both hard and soft constraints on the number of interventions. We show that not only does our method outperform the existing baseline, but also eliminates the need to manually tune a black-box hyperparameter for controlling the level of assistance. We also provide an in-depth analysis of intervention scenarios in order to further illuminate system understanding. △ Less

Submitted 31 December, 2021; v1 submitted 16 December, 2021; originally announced December 2021.

Comments: Accepted by AAAI2022

Directed Speech Separation for Automatic Speech Recognition of Long Form Conversational Speech

Authors: Rohit Paturi, Sundararajan Srinivasan, Katrin Kirchhoff, Daniel Garcia-Romero

Abstract: Many of the recent advances in speech separation are primarily aimed at synthetic mixtures of short audio utterances with high degrees of overlap. Most of these approaches need an additional stitching step to stitch the separated speech chunks for long form audio. Since most of the approaches involve Permutation Invariant training (PIT), the order of separated speech chunks is nondeterministic and… ▽ More Many of the recent advances in speech separation are primarily aimed at synthetic mixtures of short audio utterances with high degrees of overlap. Most of these approaches need an additional stitching step to stitch the separated speech chunks for long form audio. Since most of the approaches involve Permutation Invariant training (PIT), the order of separated speech chunks is nondeterministic and leads to difficulty in accurately stitching homogenous speaker chunks for downstream tasks like Automatic Speech Recognition (ASR). Also, most of these models are trained with synthetic mixtures and do not generalize to real conversational data. In this paper, we propose a speaker conditioned separator trained on speaker embeddings extracted directly from the mixed signal using an over-clustering based approach. This model naturally regulates the order of the separated chunks without the need for an additional stitching step. We also introduce a data sampling strategy with real and synthetic mixtures which generalizes well to real conversation speech. With this model and data sampling technique, we show significant improvements in speaker-attributed word error rate (SA-WER) on Hub5 data. △ Less

Submitted 6 September, 2022; v1 submitted 10 December, 2021; originally announced December 2021.

Comments: Accepted for publication at Interspeech 2022

Representation learning through cross-modal conditional teacher-student training for speech emotion recognition

Authors: Sundararajan Srinivasan, Zhaocheng Huang, Katrin Kirchhoff

Abstract: Generic pre-trained speech and text representations promise to reduce the need for large labeled datasets on specific speech and language tasks. However, it is not clear how to effectively adapt these representations for speech emotion recognition. Recent public benchmarks show the efficacy of several popular self-supervised speech representations for emotion classification. In this study, we show… ▽ More Generic pre-trained speech and text representations promise to reduce the need for large labeled datasets on specific speech and language tasks. However, it is not clear how to effectively adapt these representations for speech emotion recognition. Recent public benchmarks show the efficacy of several popular self-supervised speech representations for emotion classification. In this study, we show that the primary difference between the top-performing representations is in predicting valence while the differences in predicting activation and dominance dimensions are less pronounced. However, we show that even the best-performing HuBERT representation underperforms on valence prediction compared to a multimodal model that also incorporates text representation. We address this shortcoming by injecting lexical information into the speech representation using the multimodal model as a teacher. To improve the efficacy of our approach, we propose a novel estimate of the quality of the emotion predictions, to condition teacher-student training. We report new audio-only state-of-the-art concordance correlation coefficient (CCC) values of 0.757, 0.627, 0.671 for activation, valence and dominance predictions, respectively, on the MSP-Podcast corpus, and also state-of-the-art values of 0.667, 0.582, 0.545 on the IEMOCAP corpus. △ Less

Submitted 27 January, 2022; v1 submitted 30 November, 2021; originally announced December 2021.

Comments: Accepted for publication at IEEE ICASSP 2022

Atomistic Evidence of Nucleation Mechanism for the Direct Graphite-to-Diamond Transformation

Authors: Duan Luo, Liuxiang Yang, Hongxian Xie, Srilok Srinivasan, Jinshou Tian, Subramanian Sankaranarayanan, Ilke Arslan, Wenge Yang, Ho-kwang Mao, Jianguo Wen

Abstract: The direct graphite-to-diamond transformation mechanism has been a subject of intense study and remains debated concerning the initial stages of the conversion, the intermediate phases, and their transformation pathways. Here, we successfully recover samples at early conversion stage by tuning high-pressure/high-temperature conditions and reveal direct evidence supporting the nucleation-growth mec… ▽ More The direct graphite-to-diamond transformation mechanism has been a subject of intense study and remains debated concerning the initial stages of the conversion, the intermediate phases, and their transformation pathways. Here, we successfully recover samples at early conversion stage by tuning high-pressure/high-temperature conditions and reveal direct evidence supporting the nucleation-growth mechanism. Atomistic observations show that intermediate orthorhombic graphite phase mediates the growth of diamond nuclei. Furthermore, we observe that quenchable orthorhombic and rhombohedra graphite are stabilized in buckled graphite at lower temperatures. These intermediate phases are further converted into hexagonal and cubic diamond at higher temperatures following energetically favorable pathways in the order: graphite -> orthorhombic graphite -> hexagonal diamond, graphite -> orthorhombic graphite -> cubic diamond, graphite -> rhombohedra graphite -> cubic diamond. These results significantly improve our understanding of the transformation mechanism, enabling the synthesis of different high-quality forms of diamond from graphite. △ Less

Submitted 26 November, 2021; originally announced November 2021.

Lonsdaleite: The diamond with optimized bond lengths and enhanced hardness

Authors: Liuxiang Yang, Kah Chun Lau, Zhidan Zeng, Dongzhou Zhang, Hu Tang, Bingmin Yan, Huiyang Gou, Yanping Yang, Yuming Xiao, Duan Luo, Srilok Srinivasan, Subramanian Sankaranarayanan, Wenge Yang, Jianguo Wen, Ho-kwang Mao

Abstract: Diamond is known as the hardest substance due to its ultra-strong tetrahedral sp3 carbon bonding framework. The only weak link is its cubic cleavage planes between (111) buckled honeycomb layers. Compressing graphite single crystals and heating to moderate temperatures, we synthesized a bulk, pure, hexagonal diamond (lonsdaleite) with distorted carbon tetrahedrons that shorten the bond between its… ▽ More Diamond is known as the hardest substance due to its ultra-strong tetrahedral sp3 carbon bonding framework. The only weak link is its cubic cleavage planes between (111) buckled honeycomb layers. Compressing graphite single crystals and heating to moderate temperatures, we synthesized a bulk, pure, hexagonal diamond (lonsdaleite) with distorted carbon tetrahedrons that shorten the bond between its hexagonal (001) buckled honeycomb layers, thus strengthening their linkage. We observed direct transformation of graphite (100) to lonsdaleite (002) and graphite (002) to lonsdaleite (100). We find the bulk lonsdaleite has superior mechanical properties of Vicker hardnesses HV = 164+/-11 GPa and 124+/-13 GPa, measured on the surface corresponding to the original graphite (001) and (100) surfaces, respectively. Properties of lonsdaleite as the supreme material can be further enhanced by purifying the starting material graphite carbon and fine-tuning the high pressure-temperature synthesis conditions. △ Less

Submitted 17 November, 2021; originally announced November 2021.

Posetal Games: Efficiency, Existence, and Refinement of Equilibria in Games with Prioritized Metrics

Authors: Alessandro Zanardi, Gioele Zardini, Sirish Srinivasan, Saverio Bolognani, Andrea Censi, Florian Dörfler, Emilio Frazzoli

Abstract: Modern applications require robots to comply with multiple, often conflicting rules and to interact with the other agents. We present Posetal Games as a class of games in which each player expresses a preference over the outcomes via a partially ordered set of metrics. This allows one to combine hierarchical priorities of each player with the interactive nature of the environment. By contextualizi… ▽ More Modern applications require robots to comply with multiple, often conflicting rules and to interact with the other agents. We present Posetal Games as a class of games in which each player expresses a preference over the outcomes via a partially ordered set of metrics. This allows one to combine hierarchical priorities of each player with the interactive nature of the environment. By contextualizing standard game theoretical notions, we provide two sufficient conditions on the preference of the players to prove existence of pure Nash Equilibria in finite action sets. Moreover, we define formal operations on the preference structures and link them to a refinement of the game solutions, showing how the set of equilibria can be systematically shrunk. The presented results are showcased in a driving game where autonomous vehicles select from a finite set of trajectories. The results demonstrate the interpretability of results in terms of minimum-rank-violation for each player. △ Less

Submitted 13 November, 2021; originally announced November 2021.

Comments: 8 pages

Direct calculation of the ZZ-interaction rates in the multi-mode circuit-QED

Authors: Firat Solgun, Srikanth Srinivasan

Abstract: Hamiltonians of the superconducting qubits of Transmon type involve non-zero ZZ-interaction terms due to their finite and small anharmonicities. These terms might lead to the unwanted accumulation of spurious phases during the execution of the two-qubit gates. Exact calculation of the ZZ-interaction rates requires the full diagonalization of the circuit Hamiltonians which very quickly becomes comp… ▽ More Hamiltonians of the superconducting qubits of Transmon type involve non-zero ZZ-interaction terms due to their finite and small anharmonicities. These terms might lead to the unwanted accumulation of spurious phases during the execution of the two-qubit gates. Exact calculation of the ZZ-interaction rates requires the full diagonalization of the circuit Hamiltonians which very quickly becomes computationally demanding as the number of the modes in the coupler circuit increases. Here we propose a direct analytical method for the accurate estimation of the ZZ-interaction rates between low-anharmonicity qubits in the dispersive limit of the multi-mode circuit-QED. We observe very good agreement between the predictions of our method and the measurement data collected from the multi-qubit devices. Our method being an extension of our previous work in [1] is a new addition to the toolbox of the quantum microwave engineers as it relates the ZZ-interaction rates directly to the entries of the impedance matrix defined between the qubit ports. △ Less

Submitted 19 November, 2021; v1 submitted 10 November, 2021; originally announced November 2021.

Comments: Plots slightly updated due to a minor typo in the code

On Vanishing Properties of Polynomials on Symmetric Sets of the Boolean Cube, in Positive Characteristic

Authors: Srikanth Srinivasan, S. Venkitesh

Abstract: The finite-degree Zariski (Z-) closure is a classical algebraic object, that has found a key place in several applications of the polynomial method in combinatorics. In this work, we characterize the finite-degree Z-closures of a subclass of symmetric sets (subsets that are invariant under permutations of coordinates) of the Boolean cube, in positive characteristic. Our results subsume multiple… ▽ More The finite-degree Zariski (Z-) closure is a classical algebraic object, that has found a key place in several applications of the polynomial method in combinatorics. In this work, we characterize the finite-degree Z-closures of a subclass of symmetric sets (subsets that are invariant under permutations of coordinates) of the Boolean cube, in positive characteristic. Our results subsume multiple statements on finite-degree Z-closures that have found applications in extremal combinatorial problems, for instance, pertaining to set systems (Hegedűs, Stud. Sci. Math. Hung. 2010; Hegedűs, arXiv 2021), and Boolean circuits (Hrǔbes et al., ICALP 2019). Our characterization also establishes that for the subclasses of symmetric sets that we consider, the finite-degree Z-closures have low computational complexity. A key ingredient in our characterization is a new variant of finite-degree Z-closures, defined using vanishing conditions on only symmetric polynomials satisfying a degree bound. △ Less

Submitted 9 November, 2021; originally announced November 2021.

Spatial-Temporal Residual Aggregation for High Resolution Video Inpainting

Authors: Vishnu Sanjay Ramiya Srinivasan, Rui Ma, Qiang Tang, Zili Yi, Zhan Xu

Abstract: Recent learning-based inpainting algorithms have achieved compelling results for completing missing regions after removing undesired objects in videos. To maintain the temporal consistency among the frames, 3D spatial and temporal operations are often heavily used in the deep networks. However, these methods usually suffer from memory constraints and can only handle low resolution videos. We propo… ▽ More Recent learning-based inpainting algorithms have achieved compelling results for completing missing regions after removing undesired objects in videos. To maintain the temporal consistency among the frames, 3D spatial and temporal operations are often heavily used in the deep networks. However, these methods usually suffer from memory constraints and can only handle low resolution videos. We propose STRA-Net, a novel spatial-temporal residual aggregation framework for high resolution video inpainting. The key idea is to first learn and apply a spatial and temporal inpainting network on the downsampled low resolution videos. Then, we refine the low resolution results by aggregating the learned spatial and temporal image residuals (details) to the upsampled inpainted frames. Both the quantitative and qualitative evaluations show that we can produce more temporal-coherent and visually appealing results than the state-of-the-art methods on inpainting high resolution videos. △ Less

Submitted 5 November, 2021; originally announced November 2021.

Comments: Accepted by BMVC 2021. Project page: https://github.com/Ascend-Research/STRA_Net

The Nearby Evolved Stars Survey II: Constructing a volume-limited sample and first results from the James Clerk Maxwell Telescope

Authors: P. Scicluna, F. Kemper, I. McDonald, S. Srinivasan, A. Trejo, S. H. J. Wallström, J. G. A. Wouterloot, J. Cami, J. Greaves, Jinhua He, D. T. Hoai, Hyosun Kim, O. C. Jones, H. Shinnaga, C. J. R. Clark, T. Dharmawardena, W. Holland, H. Imai, J. Th. van Loon, K. M. Menten, R. Wesson, H. Chawner, S. Feng, S. Goldman, F. C. Liu , et al. (67 additional authors not shown)

Abstract: The Nearby Evolved Stars Survey (NESS) is a volume-complete sample of $\sim$850 Galactic evolved stars within 3\,kpc at (sub-)mm wavelengths, observed in the CO $J = $ (2$-$1) and (3$-$2) rotational lines, and the sub-mm continuum, using the James Clark Maxwell Telescope and Atacama Pathfinder Experiment. NESS consists of five tiers, based on distances and dust-production rate (DPR). We define a n… ▽ More The Nearby Evolved Stars Survey (NESS) is a volume-complete sample of $\sim$850 Galactic evolved stars within 3\,kpc at (sub-)mm wavelengths, observed in the CO $J = $ (2$-$1) and (3$-$2) rotational lines, and the sub-mm continuum, using the James Clark Maxwell Telescope and Atacama Pathfinder Experiment. NESS consists of five tiers, based on distances and dust-production rate (DPR). We define a new metric for estimating the distances to evolved stars and compare its results to \emph{Gaia} EDR3. Replicating other studies, the most-evolved, highly enshrouded objects in the Galactic Plane dominate the dust returned by our sources, and we initially estimate a total DPR of $4.7\times 10^{-5}$ M$_\odot$ yr$^{-1}$ from our sample. Our sub-mm fluxes are systematically higher and spectral indices are typically shallower than dust models typically predict. The 450/850 $μ$m spectral indices are consistent with the blackbody Rayleigh--Jeans regime, suggesting a large fraction of evolved stars have unexpectedly large envelopes of cold dust. △ Less

Submitted 24 October, 2021; originally announced October 2021.

Comments: 20 pages, 13 figures, 5 tables, accepted for publications in MNRAS

Themis: A Network Bandwidth-Aware Collective Scheduling Policy for Distributed Training of DL Models

Authors: Saeed Rashidi, William Won, Sudarshan Srinivasan, Srinivas Sridharan, Tushar Krishna

Abstract: Distributed training is a solution to reduce DNN training time by splitting the task across multiple NPUs (e.g., GPU/TPU). However, distributed training adds communication overhead between the NPUs in order to synchronize the gradients and/or activation, depending on the parallelization strategy. In next-generation platforms for training at scale, NPUs will be connected through multi-dimensional n… ▽ More Distributed training is a solution to reduce DNN training time by splitting the task across multiple NPUs (e.g., GPU/TPU). However, distributed training adds communication overhead between the NPUs in order to synchronize the gradients and/or activation, depending on the parallelization strategy. In next-generation platforms for training at scale, NPUs will be connected through multi-dimensional networks with diverse, heterogeneous bandwidths. This work identifies a looming challenge of keeping all network dimensions busy and maximizing the network BW within the hybrid environment if we leverage scheduling techniques for collective communication on systems today. We propose Themis, a novel collective scheduling scheme that dynamically schedules collectives (divided into chunks) to balance the communication loads across all dimensions, further improving the network BW utilization. Our results show that on average, Themis can improve the network BW utilization of the single All-Reduce by 1.72X (2.70X max), and improve the end-to-end training iteration performance of real workloads such as ResNet-152, GNMT, DLRM, and Transformer-1T by 1.49X (2.25X max), 1.30X (1.78X max), 1.30X (1.77X max), and 1.25X (1.53X max), respectively. △ Less

Submitted 7 July, 2022; v1 submitted 9 October, 2021; originally announced October 2021.

Calibrated decoders for experimental quantum error correction

Authors: Edward H. Chen, Theodore J. Yoder, Youngseok Kim, Neereja Sundaresan, Srikanth Srinivasan, Muyuan Li, Antonio D. Córcoles, Andrew W. Cross, Maika Takita

Abstract: Arbitrarily long quantum computations require quantum memories that can be repeatedly measured without being corrupted. Here, we preserve the state of a quantum memory, notably with the additional use of flagged error events. All error events were extracted using fast, mid-circuit measurements and resets of the physical qubits. Among the error decoders we considered, we introduce a perfect matchin… ▽ More Arbitrarily long quantum computations require quantum memories that can be repeatedly measured without being corrupted. Here, we preserve the state of a quantum memory, notably with the additional use of flagged error events. All error events were extracted using fast, mid-circuit measurements and resets of the physical qubits. Among the error decoders we considered, we introduce a perfect matching decoder that was calibrated from measurements containing up to size-4 correlated events. To compare the decoders, we used a partial post-selection scheme shown to retain ten times more data than full post-selection. We observed logical errors per round of $2.2\pm0.1\times10^{-2}$ (decoded without post-selection) and $5.1\pm0.7\times10^{-4}$ (full post-selection), which was less than the physical measurement error of $7\times10^{-3}$ and therefore surpasses a pseudo-threshold for repeated logical measurements. △ Less

Submitted 8 October, 2021; originally announced October 2021.

Comments: 16 pages, 14 figures, 5 tables, for peer-review

MSC Class: 81P73 (Primary) 81P73 (Secondary) ACM Class: J.2

Journal ref: Phys. Rev. Lett. 128, 110504 (2022)

COVID-19 Monitoring System using Social Distancing and Face Mask Detection on Surveillance video datasets

Authors: Sahana Srinivasan, Rujula Singh R, Ruchita R Biradar, Revathi SA

Abstract: In the current times, the fear and danger of COVID-19 virus still stands large. Manual monitoring of social distancing norms is impractical with a large population moving about and with insufficient task force and resources to administer them. There is a need for a lightweight, robust and 24X7 video-monitoring system that automates this process. This paper proposes a comprehensive and effective so… ▽ More In the current times, the fear and danger of COVID-19 virus still stands large. Manual monitoring of social distancing norms is impractical with a large population moving about and with insufficient task force and resources to administer them. There is a need for a lightweight, robust and 24X7 video-monitoring system that automates this process. This paper proposes a comprehensive and effective solution to perform person detection, social distancing violation detection, face detection and face mask classification using object detection, clustering and Convolution Neural Network (CNN) based binary classifier. For this, YOLOv3, Density-based spatial clustering of applications with noise (DBSCAN), Dual Shot Face Detector (DSFD) and MobileNetV2 based binary classifier have been employed on surveillance video datasets. This paper also provides a comparative study of different face detection and face mask classification models. Finally, a video dataset labelling method is proposed along with the labelled video dataset to compensate for the lack of dataset in the community and is used for evaluation of the system. The system performance is evaluated in terms of accuracy, F1 score as well as the prediction time, which has to be low for practical applicability. The system performs with an accuracy of 91.2% and F1 score of 90.79% on the labelled video dataset and has an average prediction time of 7.12 seconds for 78 frames of a video. △ Less

Submitted 16 December, 2022; v1 submitted 8 October, 2021; originally announced October 2021.

Comments: I, Rujula Singh R, would like to apologize to the research community for the confusion caused by the inconsistency in author lists between multiple versions of this paper. I take full responsibility for this error and will be more diligent in the future to ensure the accuracy and consistency of our research publications

Journal ref: 2021 International Conference on Emerging Smart Computing and Informatics (ESCI), 2021, pp. 449-455

LIBRA: Enabling Workload-aware Multi-dimensional Network Topology Optimization for Distributed Training of Large AI Models

Authors: William Won, Saeed Rashidi, Sudarshan Srinivasan, Tushar Krishna

Abstract: As model sizes in machine learning continue to scale, distributed training is necessary to accommodate model weights within each device and to reduce training time. However, this comes with the expense of increased communication overhead due to the exchange of gradients and activations, which become the critical bottleneck of the end-to-end training process. In this work, we motivate the design of… ▽ More As model sizes in machine learning continue to scale, distributed training is necessary to accommodate model weights within each device and to reduce training time. However, this comes with the expense of increased communication overhead due to the exchange of gradients and activations, which become the critical bottleneck of the end-to-end training process. In this work, we motivate the design of multi-dimensional networks within machine learning systems as a cost-efficient mechanism to enhance overall network bandwidth. We also identify that optimal bandwidth allocation is pivotal for multi-dimensional networks to ensure efficient resource utilization. We introduce LIBRA, a framework specifically focused on optimizing multi-dimensional fabric architectures. Through case studies, we demonstrate the value of LIBRA, both in architecting optimized fabrics under diverse constraints and in enabling co-optimization opportunities. △ Less

Submitted 5 May, 2024; v1 submitted 24 September, 2021; originally announced September 2021.

Comments: Contains 10 main pages, 21 figures, 3 tables

Journal ref: Proceedings of the 2024 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS '24)

Auctions and Peer Prediction for Academic Peer Review

Authors: Siddarth Srinivasan, Jamie Morgenstern

Abstract: Peer reviewed publications are considered the gold standard in certifying and disseminating ideas that a research community considers valuable. However, we identify two major drawbacks of the current system: (1) the overwhelming demand for reviewers due to a large volume of submissions, and (2) the lack of incentives for reviewers to participate and expend the necessary effort to provide high-qual… ▽ More Peer reviewed publications are considered the gold standard in certifying and disseminating ideas that a research community considers valuable. However, we identify two major drawbacks of the current system: (1) the overwhelming demand for reviewers due to a large volume of submissions, and (2) the lack of incentives for reviewers to participate and expend the necessary effort to provide high-quality reviews. In this work, we adopt a mechanism-design approach to propose improvements to the peer review process, tying together the paper submission and review processes and simultaneously incentivizing high-quality submissions and reviews. In the submission stage, authors participate in a VCG auction for review slots by submitting their papers along with a bid that represents their expected value for having their paper reviewed. For the reviewing stage, we propose a novel peer prediction mechanism (H-DIPP) building on recent work in the information elicitation literature, which incentivizes participating reviewers to provide honest and effortful reviews. The revenue raised in the submission stage auction is used to pay reviewers based on the quality of their reviews in the reviewing stage. △ Less

Submitted 10 May, 2023; v1 submitted 27 August, 2021; originally announced September 2021.

Rapid Automated Analysis of Skull Base Tumor Specimens Using Intraoperative Optical Imaging and Artificial Intelligence

Authors: Cheng Jiang, Abhishek Bhattacharya, Joseph Linzey, Rushikesh S. Joshi, Sung Jik Cha, Sudharsan Srinivasan, Daniel Alber, Akhil Kondepudi, Esteban Urias, Balaji Pandian, Wajd Al-Holou, Steve Sullivan, B. Gregory Thompson, Jason Heth, Chris Freudiger, Siri Khalsa, Donato Pacione, John G. Golfinos, Sandra Camelo-Piragua, Daniel A. Orringer, Honglak Lee, Todd Hollon

Abstract: Background: Accurate diagnosis of skull base tumors is essential for providing personalized surgical treatment strategies. Intraoperative diagnosis can be challenging due to tumor diversity and lack of intraoperative pathology resources. Objective: To develop an independent and parallel intraoperative pathology workflow that can provide rapid and accurate skull base tumor diagnoses using label-f… ▽ More Background: Accurate diagnosis of skull base tumors is essential for providing personalized surgical treatment strategies. Intraoperative diagnosis can be challenging due to tumor diversity and lack of intraoperative pathology resources. Objective: To develop an independent and parallel intraoperative pathology workflow that can provide rapid and accurate skull base tumor diagnoses using label-free optical imaging and artificial intelligence. Method: We used a fiber laser-based, label-free, non-consumptive, high-resolution microscopy method ($<$ 60 sec per 1 $\times$ 1 mm$^\text{2}$), called stimulated Raman histology (SRH), to image a consecutive, multicenter cohort of skull base tumor patients. SRH images were then used to train a convolutional neural network (CNN) model using three representation learning strategies: cross-entropy, self-supervised contrastive learning, and supervised contrastive learning. Our trained CNN models were tested on a held-out, multicenter SRH dataset. Results: SRH was able to image the diagnostic features of both benign and malignant skull base tumors. Of the three representation learning strategies, supervised contrastive learning most effectively learned the distinctive and diagnostic SRH image features for each of the skull base tumor types. In our multicenter testing set, cross-entropy achieved an overall diagnostic accuracy of 91.5%, self-supervised contrastive learning 83.9%, and supervised contrastive learning 96.6%. Our trained model was able to identify tumor-normal margins and detect regions of microscopic tumor infiltration in whole-slide SRH images. Conclusion: SRH with trained artificial intelligence models can provide rapid and accurate intraoperative analysis of skull base tumor specimens to inform surgical decision-making. △ Less

Submitted 19 June, 2022; v1 submitted 7 August, 2021; originally announced August 2021.

Comments: Published as journal article

Journal ref: Neurosurgery 90 (6), 758-767, 2022

Lights, Camera, Action! A Framework to Improve NLP Accuracy over OCR documents

Authors: Amit Gupte, Alexey Romanov, Sahitya Mantravadi, Dalitso Banda, Jianjie Liu, Raza Khan, Lakshmanan Ramu Meenal, Benjamin Han, Soundar Srinivasan

Abstract: Document digitization is essential for the digital transformation of our societies, yet a crucial step in the process, Optical Character Recognition (OCR), is still not perfect. Even commercial OCR systems can produce questionable output depending on the fidelity of the scanned documents. In this paper, we demonstrate an effective framework for mitigating OCR errors for any downstream NLP task, us… ▽ More Document digitization is essential for the digital transformation of our societies, yet a crucial step in the process, Optical Character Recognition (OCR), is still not perfect. Even commercial OCR systems can produce questionable output depending on the fidelity of the scanned documents. In this paper, we demonstrate an effective framework for mitigating OCR errors for any downstream NLP task, using Named Entity Recognition (NER) as an example. We first address the data scarcity problem for model training by constructing a document synthesis pipeline, generating realistic but degraded data with NER labels. We measure the NER accuracy drop at various degradation levels and show that a text restoration model, trained on the degraded data, significantly closes the NER accuracy gaps caused by OCR errors, including on an out-of-domain dataset. For the benefit of the community, we have made the document synthesis pipeline available as an open-source project. △ Less

Submitted 5 August, 2021; originally announced August 2021.

Comments: Accepted to the Document Intelligence Workshop at KDD 2021. The source code of Genalog is available at https://github.com/microsoft/genalog

A Core Mass Function Indistinguishable from the Salpeter Stellar Initial Mass Function Using 1000 au Resolution ALMA Observations

Authors: Genaro Suárez, Roberto Galván-Madrid, Luis Aguilar, Adam Ginsburg, Sundar Srinivasan, Hauyu Baobab Liu, Carlos G. Román-Zúñiga

Abstract: We present the core mass function (CMF) of the massive star-forming clump G33.92+0.11 using 1.3 mm observations obtained with the Atacama Large Millimeter/submillimeter Array (ALMA). With a resolution of 1000 au, this is one of the highest resolution CMF measurements to date. The CMF is corrected by flux and number incompleteness to obtain a sample that is complete for gas masses… ▽ More We present the core mass function (CMF) of the massive star-forming clump G33.92+0.11 using 1.3 mm observations obtained with the Atacama Large Millimeter/submillimeter Array (ALMA). With a resolution of 1000 au, this is one of the highest resolution CMF measurements to date. The CMF is corrected by flux and number incompleteness to obtain a sample that is complete for gas masses $M\gtrsim2.0\ M_\odot$. The resulting CMF is well represented by a power-law function ($dN/d\log M\propto M^Γ$), whose slope is determined using two different approaches: $i)$ by least-squares fitting of power-law functions to the flux- and number-corrected CMF, and $ii)$ by comparing the observed CMF to simulated samples with similar incompleteness. We provide a prescription to quantify and correct a flattening bias affecting the slope fits in the first approach, which is caused by small-sample or edge effects when the data is represented by either classical histograms or a kernel density estimate, respectively. The resulting slopes from both approaches are in good agreement each other, with $Γ=-1.11_{-0.11}^{+0.12}$ being our adopted value. Although this slope appears to be slightly flatter than the Salpeter slope $Γ=-1.35$ for the stellar initial mass function (IMF), we find from Monte Carlo simulations that the CMF in G33.92+0.11 is statistically indistinguishable from the Salpeter representation of the stellar IMF. Our results are consistent with the idea that the form of the IMF is inherited from the CMF, at least at high masses and when the latter is observed at high-enough resolution. △ Less

Submitted 29 July, 2021; originally announced July 2021.

Comments: Accepted for publication in ApJ