Showing 1–50 of 79 results for author: Jindal, A

Automated PMC-based Power Modeling Methodology for Modern Mobile GPUs

Authors: Pranab Dash, Y. Charlie Hu, Abhilash Jindal

Abstract: The rise of machine learning workload on smartphones has propelled GPUs into one of the most power-hungry components of modern smartphones and elevates the need for optimizing the GPU power draw by mobile apps. Optimizing the power consumption of mobile GPUs in turn requires accurate estimation of their power draw during app execution. In this paper, we observe that the prior-art, utilization-freq… ▽ More The rise of machine learning workload on smartphones has propelled GPUs into one of the most power-hungry components of modern smartphones and elevates the need for optimizing the GPU power draw by mobile apps. Optimizing the power consumption of mobile GPUs in turn requires accurate estimation of their power draw during app execution. In this paper, we observe that the prior-art, utilization-frequency based GPU models cannot capture the diverse micro-architectural usage of modern mobile GPUs.We show that these models suffer poor modeling accuracy under diverse GPU workload, and study whether performance monitoring counter (PMC)-based models recently proposed for desktop/server GPUs can be applied to accurately model mobile GPU power. Our study shows that the PMCs that come with dominating mobile GPUs used in modern smartphones are sufficient to model mobile GPU power, but exhibit multicollinearity if used altogether. We present APGPM, the mobile GPU power modeling methodology that automatically selects an optimal set of PMCs that maximizes the GPU power model accuracy. Evaluation on two representative mobile GPUs shows that APGPM-generated GPU power models reduce the MAPE modeling error of prior-art by 1.95x to 2.66x (i.e., by 11.3% to 15.4%) while using only 4.66% to 20.41% of the total number of available PMCs. △ Less

Submitted 9 August, 2024; originally announced August 2024.

Image-GS: Content-Adaptive Image Representation via 2D Gaussians

Authors: Yunxiang Zhang, Alexandr Kuznetsov, Akshay Jindal, Kenneth Chen, Anton Sochenov, Anton Kaplanyan, Qi Sun

Abstract: Neural image representations have recently emerged as a promising technique for storing, streaming, and rendering visual data. Coupled with learning-based workflows, these novel representations have demonstrated remarkable visual fidelity and memory efficiency. However, existing neural image representations often rely on explicit uniform data structures without content adaptivity or computation-in… ▽ More Neural image representations have recently emerged as a promising technique for storing, streaming, and rendering visual data. Coupled with learning-based workflows, these novel representations have demonstrated remarkable visual fidelity and memory efficiency. However, existing neural image representations often rely on explicit uniform data structures without content adaptivity or computation-intensive implicit models, limiting their adoption in real-time graphics applications. Inspired by recent advances in radiance field rendering, we propose Image-GS, a content-adaptive image representation. Using anisotropic 2D Gaussians as the basis, Image-GS shows high memory efficiency, supports fast random access, and offers a natural level of detail stack. Leveraging a tailored differentiable renderer, Image-GS fits a target image by adaptively allocating and progressively optimizing a set of 2D Gaussians. The generalizable efficiency and fidelity of Image-GS are validated against several recent neural image representations and industry-standard texture compressors on a diverse set of images. Notably, its memory and computation requirements solely depend on and linearly scale with the number of 2D Gaussians, providing flexible controls over the trade-off between visual fidelity and run-time efficiency. We hope this research offers insights for developing new applications that require adaptive quality and resource control, such as machine perception, asset streaming, and content generation. △ Less

Submitted 1 July, 2024; originally announced July 2024.

Arithmetic density and congruences of $\ell$-regular bipartitions

Authors: Nabin Kumar Meher, Ankita Jindal

Abstract: Let $ B_{\ell}(n)$ denote the number of $\ell$-regular bipartitions of $n.$ In this article, we prove that $ B_{\ell}(n)$ is always almost divisible by $p_i^j$ if $p_i^{2a_i}\geq \ell,$ where $j$ is a fixed positive integer and $\ell=p_1^{a_1}p_2^{a_2}\ldots p_m^{a_m},$ where $p_i$ are prime numbers $\geq 5.$ Further, we obtain an infinities families of congruences for $B_3(n)$ and $B_5(n)$ by usi… ▽ More Let $ B_{\ell}(n)$ denote the number of $\ell$-regular bipartitions of $n.$ In this article, we prove that $ B_{\ell}(n)$ is always almost divisible by $p_i^j$ if $p_i^{2a_i}\geq \ell,$ where $j$ is a fixed positive integer and $\ell=p_1^{a_1}p_2^{a_2}\ldots p_m^{a_m},$ where $p_i$ are prime numbers $\geq 5.$ Further, we obtain an infinities families of congruences for $B_3(n)$ and $B_5(n)$ by using Hecke eigen form theory and a result of Newman \cite{Newmann1959}. Furthermore, by applying Radu and Seller's approach, we obtain an algorithm from which we get several congruences for $B_{p}(n)$, where $p$ is a prime number. △ Less

Submitted 10 June, 2024; originally announced June 2024.

MSC Class: 05A17; 11P83

Operator Theory on the Pentablock

Authors: Abhay Jindal, Poornendu Kumar

Abstract: The pentablock, denoted as $\cP,$ is defined as follows: $$\cP= \left\{ (a_{21}, {\rm tr}(A), {\rm det}(A)) : A = [a_{ij}]_{2 \times 2} \text{ with } \|A\|<1 \right\}.$$ It originated from the work of Agler--Lykova--Young in connection with a particular case of the $μ$-synthesis problem. It is a non-convex, polynomially convex, $\mathbb{C}$-convex, star-like about the origin, and inhomogeneous dom… ▽ More The pentablock, denoted as $\cP,$ is defined as follows: $$\cP= \left\{ (a_{21}, {\rm tr}(A), {\rm det}(A)) : A = [a_{ij}]_{2 \times 2} \text{ with } \|A\|<1 \right\}.$$ It originated from the work of Agler--Lykova--Young in connection with a particular case of the $μ$-synthesis problem. It is a non-convex, polynomially convex, $\mathbb{C}$-convex, star-like about the origin, and inhomogeneous domain. This paper deals with operator theory on the pentablock. We study pentablock unitaries and isometries, providing an algebraic characterization of pentablock isometries. En route, we provide the Wold-type decomposition for pentablock isometries, which consists of three parts: the unitary part, the pure part, and a new component. We define this novel component as the quasi-pentablock unitary and provide a functional model for it. Additionally, a model for a class of pure pentablock isometries has been found, along with some examples. Furthermore, a representation resembling the Beurling-Lax-Halmos paradigm has been presented for the invariant subspaces of pentablock pure isometries. △ Less

Submitted 6 September, 2024; v1 submitted 9 June, 2024; originally announced June 2024.

MSC Class: 47A13; 47A15; 47A20; 47A25; 93B50; 46L05

Journal ref: J. Math. Anal. Appl. (2024), 128589

Constructing Dynamic Feedback Linearizable Discretizations

Authors: Ashutosh Jindal, Florentina Nicolau, David Martin Diego, Ravi Banavar

Abstract: Dynamic feedback linearization-based methods allow us to design control algorithms for a fairly large class of nonlinear systems in continuous time. However, this feature does not extend to their sampled counterparts, i.e., for a given dynamically feedback linearizable continuous time system, its numerical discretization may fail to be so. In this article, we present a way to construct discretizat… ▽ More Dynamic feedback linearization-based methods allow us to design control algorithms for a fairly large class of nonlinear systems in continuous time. However, this feature does not extend to their sampled counterparts, i.e., for a given dynamically feedback linearizable continuous time system, its numerical discretization may fail to be so. In this article, we present a way to construct discretization schemes (accurate up to first order) that result in schemes that are feedback linearizable. This result is an extension of our previous work, where we had considered only static feedback linearizable systems. The result presented here applies to a fairly general class of nonlinear systems, in particular, our analysis applies to both endogenous and exogenous types of feedback. While the results in this article are presented on a control affine form of nonlinear systems, they can be readily modified to general nonlinear systems. △ Less

Submitted 3 June, 2024; originally announced June 2024.

DaVinci at SemEval-2024 Task 9: Few-shot prompting GPT-3.5 for Unconventional Reasoning

Authors: Suyash Vardhan Mathur, Akshett Rai Jindal, Manish Shrivastava

Abstract: While significant work has been done in the field of NLP on vertical thinking, which involves primarily logical thinking, little work has been done towards lateral thinking, which involves looking at problems from an unconventional perspective and defying existing conceptions and notions. Towards this direction, SemEval 2024 introduces the task of BRAINTEASER, which involves two types of questions… ▽ More While significant work has been done in the field of NLP on vertical thinking, which involves primarily logical thinking, little work has been done towards lateral thinking, which involves looking at problems from an unconventional perspective and defying existing conceptions and notions. Towards this direction, SemEval 2024 introduces the task of BRAINTEASER, which involves two types of questions -- Sentence Puzzles and Word Puzzles that defy conventional common-sense reasoning and constraints. In this paper, we tackle both types of questions using few-shot prompting on GPT-3.5 and gain insights regarding the difference in the nature of the two types. Our prompting strategy placed us 26th on the leaderboard for the Sentence Puzzle and 15th on the Word Puzzle task. △ Less

Submitted 19 May, 2024; originally announced May 2024.

LastResort at SemEval-2024 Task 3: Exploring Multimodal Emotion Cause Pair Extraction as Sequence Labelling Task

Authors: Suyash Vardhan Mathur, Akshett Rai Jindal, Hardik Mittal, Manish Shrivastava

Abstract: Conversation is the most natural form of human communication, where each utterance can range over a variety of possible emotions. While significant work has been done towards the detection of emotions in text, relatively little work has been done towards finding the cause of the said emotions, especially in multimodal settings. SemEval 2024 introduces the task of Multimodal Emotion Cause Analysis… ▽ More Conversation is the most natural form of human communication, where each utterance can range over a variety of possible emotions. While significant work has been done towards the detection of emotions in text, relatively little work has been done towards finding the cause of the said emotions, especially in multimodal settings. SemEval 2024 introduces the task of Multimodal Emotion Cause Analysis in Conversations, which aims to extract emotions reflected in individual utterances in a conversation involving multiple modalities (textual, audio, and visual modalities) along with the corresponding utterances that were the cause for the emotion. In this paper, we propose models that tackle this task as an utterance labeling and a sequence labeling problem and perform a comparative study of these models, involving baselines using different encoders, using BiLSTM for adding contextual information of the conversation, and finally adding a CRF layer to try to model the inter-dependencies between adjacent utterances more effectively. In the official leaderboard for the task, our architecture was ranked 8th, achieving an F1-score of 0.1759 on the leaderboard. △ Less

Submitted 2 April, 2024; originally announced April 2024.

FastSAM3D: An Efficient Segment Anything Model for 3D Volumetric Medical Images

Authors: Yiqing Shen, Jingxing Li, Xinyuan Shao, Blanca Inigo Romillo, Ankush Jindal, David Dreizin, Mathias Unberath

Abstract: Segment anything models (SAMs) are gaining attention for their zero-shot generalization capability in segmenting objects of unseen classes and in unseen domains when properly prompted. Interactivity is a key strength of SAMs, allowing users to iteratively provide prompts that specify objects of interest to refine outputs. However, to realize the interactive use of SAMs for 3D medical imaging tasks… ▽ More Segment anything models (SAMs) are gaining attention for their zero-shot generalization capability in segmenting objects of unseen classes and in unseen domains when properly prompted. Interactivity is a key strength of SAMs, allowing users to iteratively provide prompts that specify objects of interest to refine outputs. However, to realize the interactive use of SAMs for 3D medical imaging tasks, rapid inference times are necessary. High memory requirements and long processing delays remain constraints that hinder the adoption of SAMs for this purpose. Specifically, while 2D SAMs applied to 3D volumes contend with repetitive computation to process all slices independently, 3D SAMs suffer from an exponential increase in model parameters and FLOPS. To address these challenges, we present FastSAM3D which accelerates SAM inference to 8 milliseconds per 128*128*128 3D volumetric image on an NVIDIA A100 GPU. This speedup is accomplished through 1) a novel layer-wise progressive distillation scheme that enables knowledge transfer from a complex 12-layer ViT-B to a lightweight 6-layer ViT-Tiny variant encoder without training from scratch; and 2) a novel 3D sparse flash attention to replace vanilla attention operators, substantially reducing memory needs and improving parallelization. Experiments on three diverse datasets reveal that FastSAM3D achieves a remarkable speedup of 527.38x compared to 2D SAMs and 8.75x compared to 3D SAMs on the same volumes without significant performance decline. Thus, FastSAM3D opens the door for low-cost truly interactive SAM-based 3D medical imaging segmentation with commonly used GPU hardware. Code is available at https://github.com/arcadelab/FastSAM3D. △ Less

Submitted 14 March, 2024; originally announced March 2024.

Birbal: An efficient 7B instruct-model fine-tuned with curated datasets

Authors: Ashvini Kumar Jindal, Pawan Kumar Rajpoot, Ankur Parikh

Abstract: LLMOps incur significant costs due to hardware requirements, hindering their widespread accessibility. Additionally, a lack of transparency in model training methods and data contributes to the majority of models being non-reproducible. To tackle these challenges, the LLM Efficiency Challenge was introduced at NeurIPS Workshop, aiming to adapt foundation models on a diverse set of tasks via fine-t… ▽ More LLMOps incur significant costs due to hardware requirements, hindering their widespread accessibility. Additionally, a lack of transparency in model training methods and data contributes to the majority of models being non-reproducible. To tackle these challenges, the LLM Efficiency Challenge was introduced at NeurIPS Workshop, aiming to adapt foundation models on a diverse set of tasks via fine-tuning on a single GPU (RTX 4090 or A100 with 40GB) within a 24-hour timeframe. In this system description paper, we introduce Birbal, our Mistral-7B based winning model, fine-tuned on a single RTX 4090 for 16 hours. Birbal's success lies in curating high-quality instructions covering diverse tasks, resulting in a 35% performance improvement over second-best Qwen-14B based submission. △ Less

Submitted 4 March, 2024; originally announced March 2024.

Complete Nevanlinna-Pick Kernels and the Curvature Invariant

Authors: Tirthankar Bhattacharyya, Abhay Jindal

Abstract: We consider a unitarily invariant complete Nevanlinna-Pick kernel denoted by $s$ and a commuting $d$-tuple of bounded operators $T = (T_{1}, \dots, T_{d})$ satisfying a natural contractivity condition with respect to $s$. We associate with $T$ its curvature invariant which is a non-negative real number bounded above by the dimension of a defect space of $\bfT$. The instrument which makes this poss… ▽ More We consider a unitarily invariant complete Nevanlinna-Pick kernel denoted by $s$ and a commuting $d$-tuple of bounded operators $T = (T_{1}, \dots, T_{d})$ satisfying a natural contractivity condition with respect to $s$. We associate with $T$ its curvature invariant which is a non-negative real number bounded above by the dimension of a defect space of $\bfT$. The instrument which makes this possible is the characteristic function developed in \cite{BJ}. \medskip We present an asymptotic formula for the curvature invariant. In the special case when $\bfT$ is pure, we provide a notably simpler formula, revealing that in this instance, the curvature invariant is an integer. We further investigate its connection with an algebraic invariant known as fibre dimension. Moreover, we obtain a refined and simplified asymptotic formula for the curvature invariant of $\bfT$ specifically when its characteristic function is a polynomial. △ Less

Submitted 28 January, 2024; originally announced January 2024.

Comments: 16 Pages

MSC Class: 47A13; 47A15; 46E22

Sibyl: Forecasting Time-Evolving Query Workloads

Authors: Hanxian Huang, Tarique Siddiqui, Rana Alotaibi, Carlo Curino, Jyoti Leeka, Alekh Jindal, Jishen Zhao, Jesus Camacho-Rodriguez, Yuanyuan Tian

Abstract: Database systems often rely on historical query traces to perform workload-based performance tuning. However, real production workloads are time-evolving, making historical queries ineffective for optimizing future workloads. To address this challenge, we propose SIBYL, an end-to-end machine learning-based framework that accurately forecasts a sequence of future queries, with the entire query stat… ▽ More Database systems often rely on historical query traces to perform workload-based performance tuning. However, real production workloads are time-evolving, making historical queries ineffective for optimizing future workloads. To address this challenge, we propose SIBYL, an end-to-end machine learning-based framework that accurately forecasts a sequence of future queries, with the entire query statements, in various prediction windows. Drawing insights from real-workloads, we propose template-based featurization techniques and develop a stacked-LSTM with an encoder-decoder architecture for accurate forecasting of query workloads. We also develop techniques to improve forecasting accuracy over large prediction windows and achieve high scalability over large workloads with high variability in arrival rates of queries. Finally, we propose techniques to handle workload drifts. Our evaluation on four real workloads demonstrates that SIBYL can forecast workloads with an $87.3\%$ median F1 score, and can result in $1.7\times$ and $1.3\times$ performance improvement when applied to materialized view selection and index selection applications, respectively. △ Less

Submitted 8 January, 2024; originally announced January 2024.

Comments: The paper has been accepted by SIGMOD 2024

GEqO: ML-Accelerated Semantic Equivalence Detection

Authors: Brandon Haynes, Rana Alotaibi, Anna Pavlenko, Jyoti Leeka, Alekh Jindal, Yuanyuan Tian

Abstract: Large scale analytics engines have become a core dependency for modern data-driven enterprises to derive business insights and drive actions. These engines support a large number of analytic jobs processing huge volumes of data on a daily basis, and workloads are often inundated with overlapping computations across multiple jobs. Reusing common computation is crucial for efficient cluster resource… ▽ More Large scale analytics engines have become a core dependency for modern data-driven enterprises to derive business insights and drive actions. These engines support a large number of analytic jobs processing huge volumes of data on a daily basis, and workloads are often inundated with overlapping computations across multiple jobs. Reusing common computation is crucial for efficient cluster resource utilization and reducing job execution time. Detecting common computation is the first and key step for reducing this computational redundancy. However, detecting equivalence on large-scale analytics engines requires efficient and scalable solutions that are fully automated. In addition, to maximize computation reuse, equivalence needs to be detected at the semantic level instead of just the syntactic level (i.e., the ability to detect semantic equivalence of seemingly different-looking queries). Unfortunately, existing solutions fall short of satisfying these requirements. In this paper, we take a major step towards filling this gap by proposing GEqO, a portable and lightweight machine-learning-based framework for efficiently identifying semantically equivalent computations at scale. GEqO introduces two machine-learning-based filters that quickly prune out nonequivalent subexpressions and employs a semi-supervised learning feedback loop to iteratively improve its model with an intelligent sampling mechanism. Further, with its novel database-agnostic featurization method, GEqO can transfer the learning from one workload and database to another. Our extensive empirical evaluation shows that, on TPC-DS-like queries, GEqO yields significant performance gains-up to 200x faster than automated verifiers-and finds up to 2x more equivalences than optimizer and signature-based equivalence detection approaches. △ Less

Submitted 2 January, 2024; originally announced January 2024.

Journal ref: Proceedings of the ACM on Management of Data (2024) Volume 1 Issue 4

Detecting anxiety from short clips of free-form speech

Authors: Prabhat Agarwal, Akshat Jindal, Shreya Singh

Abstract: Barriers to accessing mental health assessments including cost and stigma continues to be an impediment in mental health diagnosis and treatment. Machine learning approaches based on speech samples could help in this direction. In this work, we develop machine learning solutions to diagnose anxiety disorders from audio journals of patients. We work on a novel anxiety dataset (provided through coll… ▽ More Barriers to accessing mental health assessments including cost and stigma continues to be an impediment in mental health diagnosis and treatment. Machine learning approaches based on speech samples could help in this direction. In this work, we develop machine learning solutions to diagnose anxiety disorders from audio journals of patients. We work on a novel anxiety dataset (provided through collaboration with Kintsugi Mindful Wellness Inc.) and experiment with several models of varying complexity utilizing audio, text and a combination of multiple modalities. We show that the multi-modal and audio embeddings based approaches achieve good performance in the task achieving an AUC ROC score of 0.68-0.69. △ Less

Submitted 23 December, 2023; originally announced December 2023.

Gemini: A Family of Highly Capable Multimodal Models

Authors: Gemini Team, Rohan Anil, Sebastian Borgeaud, Jean-Baptiste Alayrac, Jiahui Yu, Radu Soricut, Johan Schalkwyk, Andrew M. Dai, Anja Hauth, Katie Millican, David Silver, Melvin Johnson, Ioannis Antonoglou, Julian Schrittwieser, Amelia Glaese, Jilin Chen, Emily Pitler, Timothy Lillicrap, Angeliki Lazaridou, Orhan Firat, James Molloy, Michael Isard, Paul R. Barham, Tom Hennigan, Benjamin Lee , et al. (1325 additional authors not shown)

Abstract: This report introduces a new family of multimodal models, Gemini, that exhibit remarkable capabilities across image, audio, video, and text understanding. The Gemini family consists of Ultra, Pro, and Nano sizes, suitable for applications ranging from complex reasoning tasks to on-device memory-constrained use-cases. Evaluation on a broad range of benchmarks shows that our most-capable Gemini Ultr… ▽ More This report introduces a new family of multimodal models, Gemini, that exhibit remarkable capabilities across image, audio, video, and text understanding. The Gemini family consists of Ultra, Pro, and Nano sizes, suitable for applications ranging from complex reasoning tasks to on-device memory-constrained use-cases. Evaluation on a broad range of benchmarks shows that our most-capable Gemini Ultra model advances the state of the art in 30 of 32 of these benchmarks - notably being the first model to achieve human-expert performance on the well-studied exam benchmark MMLU, and improving the state of the art in every one of the 20 multimodal benchmarks we examined. We believe that the new capabilities of the Gemini family in cross-modal reasoning and language understanding will enable a wide variety of use cases. We discuss our approach toward post-training and deploying Gemini models responsibly to users through services including Gemini, Gemini Advanced, Google AI Studio, and Cloud Vertex AI. △ Less

Submitted 17 June, 2024; v1 submitted 18 December, 2023; originally announced December 2023.

Classification for everyone : Building geography agnostic models for fairer recognition

Authors: Akshat Jindal, Shreya Singh, Soham Gadgil

Abstract: In this paper, we analyze different methods to mitigate inherent geographical biases present in state of the art image classification models. We first quantitatively present this bias in two datasets - The Dollar Street Dataset and ImageNet, using images with location information. We then present different methods which can be employed to reduce this bias. Finally, we analyze the effectiveness of… ▽ More In this paper, we analyze different methods to mitigate inherent geographical biases present in state of the art image classification models. We first quantitatively present this bias in two datasets - The Dollar Street Dataset and ImageNet, using images with location information. We then present different methods which can be employed to reduce this bias. Finally, we analyze the effectiveness of the different techniques on making these models more robust to geographical locations of the images. △ Less

Submitted 2 April, 2024; v1 submitted 5 December, 2023; originally announced December 2023.

Comments: typos corrected, references added

Complete Nevanlinna-Pick kernels, the Schwarz lemma and the Schur algorithm

Authors: Daniel Alpay, Tirthankar Bhattacharyya, Abhay Jindal, Poornendu Kumar

Abstract: We investigate the Schwarz lemma and the Schur algorithm for elements in the unit ball of the multiplier algebra of a reproducing kernel Hilbert space on the open unit ball whose kernel satisfies the complete Nevanlinna-Pick property. This paper also explores the Poincaré contractivity for elements in the unit ball of the multiplier algebra of a reproducing kernel Hilbert space whose kernel satisf… ▽ More We investigate the Schwarz lemma and the Schur algorithm for elements in the unit ball of the multiplier algebra of a reproducing kernel Hilbert space on the open unit ball whose kernel satisfies the complete Nevanlinna-Pick property. This paper also explores the Poincaré contractivity for elements in the unit ball of the multiplier algebra of a reproducing kernel Hilbert space whose kernel satisfies the property mentioned above. △ Less

Submitted 3 December, 2023; originally announced December 2023.

MSC Class: 30C80; 32A38; 47B32; 46E22

Army of Thieves: Enhancing Black-Box Model Extraction via Ensemble based sample selection

Authors: Akshit Jindal, Vikram Goyal, Saket Anand, Chetan Arora

Abstract: Machine Learning (ML) models become vulnerable to Model Stealing Attacks (MSA) when they are deployed as a service. In such attacks, the deployed model is queried repeatedly to build a labelled dataset. This dataset allows the attacker to train a thief model that mimics the original model. To maximize query efficiency, the attacker has to select the most informative subset of data points from the… ▽ More Machine Learning (ML) models become vulnerable to Model Stealing Attacks (MSA) when they are deployed as a service. In such attacks, the deployed model is queried repeatedly to build a labelled dataset. This dataset allows the attacker to train a thief model that mimics the original model. To maximize query efficiency, the attacker has to select the most informative subset of data points from the pool of available data. Existing attack strategies utilize approaches like Active Learning and Semi-Supervised learning to minimize costs. However, in the black-box setting, these approaches may select sub-optimal samples as they train only one thief model. Depending on the thief model's capacity and the data it was pretrained on, the model might even select noisy samples that harm the learning process. In this work, we explore the usage of an ensemble of deep learning models as our thief model. We call our attack Army of Thieves(AOT) as we train multiple models with varying complexities to leverage the crowd's wisdom. Based on the ensemble's collective decision, uncertain samples are selected for querying, while the most confident samples are directly included in the training data. Our approach is the first one to utilize an ensemble of thief models to perform model extraction. We outperform the base approaches of existing state-of-the-art methods by at least 3% and achieve a 21% higher adversarial sample transferability than previous work for models trained on the CIFAR-10 dataset. △ Less

Submitted 8 November, 2023; originally announced November 2023.

Comments: 10 pages, 5 figures, paper accepted to WACV 2024

ChipNeMo: Domain-Adapted LLMs for Chip Design

Authors: Mingjie Liu, Teodor-Dumitru Ene, Robert Kirby, Chris Cheng, Nathaniel Pinckney, Rongjian Liang, Jonah Alben, Himyanshu Anand, Sanmitra Banerjee, Ismet Bayraktaroglu, Bonita Bhaskaran, Bryan Catanzaro, Arjun Chaudhuri, Sharon Clay, Bill Dally, Laura Dang, Parikshit Deshpande, Siddhanth Dhodhi, Sameer Halepete, Eric Hill, Jiashang Hu, Sumit Jain, Ankit Jindal, Brucek Khailany, George Kokai , et al. (17 additional authors not shown)

Abstract: ChipNeMo aims to explore the applications of large language models (LLMs) for industrial chip design. Instead of directly deploying off-the-shelf commercial or open-source LLMs, we instead adopt the following domain adaptation techniques: domain-adaptive tokenization, domain-adaptive continued pretraining, model alignment with domain-specific instructions, and domain-adapted retrieval models. We e… ▽ More ChipNeMo aims to explore the applications of large language models (LLMs) for industrial chip design. Instead of directly deploying off-the-shelf commercial or open-source LLMs, we instead adopt the following domain adaptation techniques: domain-adaptive tokenization, domain-adaptive continued pretraining, model alignment with domain-specific instructions, and domain-adapted retrieval models. We evaluate these methods on three selected LLM applications for chip design: an engineering assistant chatbot, EDA script generation, and bug summarization and analysis. Our evaluations demonstrate that domain-adaptive pretraining of language models, can lead to superior performance in domain related downstream tasks compared to their base LLaMA2 counterparts, without degradations in generic capabilities. In particular, our largest model, ChipNeMo-70B, outperforms the highly capable GPT-4 on two of our use cases, namely engineering assistant chatbot and EDA scripts generation, while exhibiting competitive performance on bug summarization and analysis. These results underscore the potential of domain-specific customization for enhancing the effectiveness of large language models in specialized applications. △ Less

Submitted 4 April, 2024; v1 submitted 31 October, 2023; originally announced November 2023.

Comments: Updated results for ChipNeMo-70B model

MedAlign: A Clinician-Generated Dataset for Instruction Following with Electronic Medical Records

Authors: Scott L. Fleming, Alejandro Lozano, William J. Haberkorn, Jenelle A. Jindal, Eduardo P. Reis, Rahul Thapa, Louis Blankemeier, Julian Z. Genkins, Ethan Steinberg, Ashwin Nayak, Birju S. Patel, Chia-Chun Chiang, Alison Callahan, Zepeng Huo, Sergios Gatidis, Scott J. Adams, Oluseyi Fayanju, Shreya J. Shah, Thomas Savage, Ethan Goh, Akshay S. Chaudhari, Nima Aghaeepour, Christopher Sharp, Michael A. Pfeffer, Percy Liang , et al. (5 additional authors not shown)

Abstract: The ability of large language models (LLMs) to follow natural language instructions with human-level fluency suggests many opportunities in healthcare to reduce administrative burden and improve quality of care. However, evaluating LLMs on realistic text generation tasks for healthcare remains challenging. Existing question answering datasets for electronic health record (EHR) data fail to capture… ▽ More The ability of large language models (LLMs) to follow natural language instructions with human-level fluency suggests many opportunities in healthcare to reduce administrative burden and improve quality of care. However, evaluating LLMs on realistic text generation tasks for healthcare remains challenging. Existing question answering datasets for electronic health record (EHR) data fail to capture the complexity of information needs and documentation burdens experienced by clinicians. To address these challenges, we introduce MedAlign, a benchmark dataset of 983 natural language instructions for EHR data. MedAlign is curated by 15 clinicians (7 specialities), includes clinician-written reference responses for 303 instructions, and provides 276 longitudinal EHRs for grounding instruction-response pairs. We used MedAlign to evaluate 6 general domain LLMs, having clinicians rank the accuracy and quality of each LLM response. We found high error rates, ranging from 35% (GPT-4) to 68% (MPT-7B-Instruct), and an 8.3% drop in accuracy moving from 32k to 2k context lengths for GPT-4. Finally, we report correlations between clinician rankings and automated natural language generation metrics as a way to rank LLMs without human review. We make MedAlign available under a research data use agreement to enable LLM evaluations on tasks aligned with clinician needs and preferences. △ Less

Submitted 24 December, 2023; v1 submitted 27 August, 2023; originally announced August 2023.

Kernels with complete Nevanlinna-Pick factors and the characteristic function

Authors: Tirthankar Bhattacharyya, Abhay Jindal

Abstract: The Sz.-Nagy Foias characteristic function for a contraction has had a rejuvenation in recent times due to a number of authors. Such a classical object relates to an object of very contemporary interest, viz., the complete Nevanlinna-Pick kernels. Indeed, a unitarily invariant kernel on the unit ball {\em admits} a characteristic function if and only if it is a complete Nevanlinna-Pick kernel. How… ▽ More The Sz.-Nagy Foias characteristic function for a contraction has had a rejuvenation in recent times due to a number of authors. Such a classical object relates to an object of very contemporary interest, viz., the complete Nevanlinna-Pick kernels. Indeed, a unitarily invariant kernel on the unit ball {\em admits} a characteristic function if and only if it is a complete Nevanlinna-Pick kernel. However, what has captured our curiosity are the recent advancements in constructing characteristic functions for kernels that do not have complete Nevanlinna-Pick property. In such cases, the reproducing kernel Hilbert space which has served as the domain of the multiplication operator has always been the vector-valued Drury-Arveson space (thus the Hardy space in case of the unit disc). We present a unified framework for deriving characteristic functions for kernels that allow a complete Nevanlinna-Pick factor. Notably, our approach not only encapsulates all previously documented cases but also achieves a remarkable level of generalization, thereby expanding the concept of the characteristic function substantially. We also provide an explanation for the prominence of the Drury-Arveson kernel in all previously established results by showing that the Drury-Arveson kernel was the natural choice inherently suitable for those situations. △ Less

Submitted 8 February, 2024; v1 submitted 20 July, 2023; originally announced July 2023.

Comments: This version has been accepted for publication in the Journal of Operator Theory

MSC Class: 47A45; 47A13; 46E22

Constructing Feedback Linearizable Discretizations for Continuous-Time Systems using Retraction Maps

Authors: Ashutosh Jindal, Ravi Banavar, David Martin Diego

Abstract: Control laws for continuous-time dynamical systems are most often implemented via digital controllers using a sample-and-hold technique. Numerical discretization of the continuous system is an integral part of subsequent analysis. Feedback linearizability of such sampled systems is dependent upon the choice of discretization map or technique. In this article, for feedback linearizable continuous-t… ▽ More Control laws for continuous-time dynamical systems are most often implemented via digital controllers using a sample-and-hold technique. Numerical discretization of the continuous system is an integral part of subsequent analysis. Feedback linearizability of such sampled systems is dependent upon the choice of discretization map or technique. In this article, for feedback linearizable continuous-time systems, we utilize the idea of retraction maps to construct discretizations that are feedback linearizable as well. We also propose a method to functionally compose discretizations to obtain higher-order integrators that are feedback linearizable. △ Less

Submitted 15 May, 2023; originally announced May 2023.

Comments: 7 pages, 9 figures

An extension of Schur's irreducibility result

Authors: Ankita Jindal, Sudesh Kaur Khanduja

Abstract: Let $n\geq 2$ be an integer. Let $φ(x)$ belonging to $\mathbb{Z}[x]$ be a monic polynomial which is irreducible modulo all primes less than or equal to $n$. Let $a_0(x), a_1(x), \dots, a_{n-1}(x)$ belonging to $\mathbb{Z}[x]$ be polynomials each having degree less than $°φ(x)$ and $a_n$ be an integer. Assume that $a_n$ and the content of $a_0(x)$ are coprime with $n!$. In the present paper, we pro… ▽ More Let $n\geq 2$ be an integer. Let $φ(x)$ belonging to $\mathbb{Z}[x]$ be a monic polynomial which is irreducible modulo all primes less than or equal to $n$. Let $a_0(x), a_1(x), \dots, a_{n-1}(x)$ belonging to $\mathbb{Z}[x]$ be polynomials each having degree less than $°φ(x)$ and $a_n$ be an integer. Assume that $a_n$ and the content of $a_0(x)$ are coprime with $n!$. In the present paper, we prove that the polynomial $\sum\limits_{i=0}^{n-1} a_i(x)\frac{φ(x)^i}{i!}+a_n\frac{φ(x)^n}{n!}$ is irreducible over the field $\mathbb{Q}$ of rational numbers. This generalizes a well known result of Schur which states that the polynomial $\sum\limits_{i=0}^{n} a_i\frac{x^i}{i!}$ is irreducible over $\mathbb{Q}$ for all $n\geq 1$ when each $a_i\in \mathbb{Z}$ and $|a_0|=|a_n|=1$. The present paper also extends a result of Filaseta thereby leading to a generalization of the classical Schönemann Irreducibility Criterion. △ Less

Submitted 8 May, 2023; originally announced May 2023.

Coupled Ferroelectricity and Superconductivity in Bilayer $T_d$-MoTe$_2$

Authors: Apoorv Jindal, Amartyajyoti Saha, Zizhong Li, Takashi Taniguchi, Kenji Watanabe, James C. Hone, Turan Birol, Rafael M. Fernandes, Cory R. Dean, Abhay N. Pasupathy, Daniel A. Rhodes

Abstract: Achieving electrostatic control of quantum phases is at the frontier of condensed matter research. Recent investigations have revealed superconductivity tunable by electrostatic doping in twisted graphene heterostructures and in two-dimensional (2D) semimetals such as WTe$_2$. Some of these systems have a polar crystal structure that gives rise to ferroelectricity, in which the interlayer polariza… ▽ More Achieving electrostatic control of quantum phases is at the frontier of condensed matter research. Recent investigations have revealed superconductivity tunable by electrostatic doping in twisted graphene heterostructures and in two-dimensional (2D) semimetals such as WTe$_2$. Some of these systems have a polar crystal structure that gives rise to ferroelectricity, in which the interlayer polarization exhibits bistability driven by external electric fields. Here we show that bilayer $T_d$-MoTe$_2$ simultaneously exhibits ferroelectric switching and superconductivity. Remarkably, a field-driven, first-order superconductor-to-normal transition is observed at its ferroelectric transition. Bilayer $T_d$-MoTe$_2$ also has a maximum in its superconducting transition temperature ($T_\textrm{c}$) as a function of carrier density and temperature, allowing independent control of the superconducting state as a function of both doping and polarization. We find that the maximum $T_\textrm{c}$ is concomitant with compensated electron and hole carrier densities and vanishes when one of the Fermi pockets disappears with doping. We argue that this unusual polarization-sensitive 2D superconductor is driven by an interband pairing interaction associated with nearly nested electron and hole Fermi pockets. △ Less

Submitted 11 April, 2023; originally announced April 2023.

Journal ref: Nature 613, 48-52 (2023)

Infinite families of congruences for $2$ and $13$-core partitions

Authors: Ankita Jindal, Nabin Kumar Meher

Abstract: A partition of $n$ is called a $t$-core partition if none of its hook number is divisible by $t.$ In 2019, Hirschhorn and Sellers \cite{Hirs2019} obtained a parity result for $3$-core partition function $a_3(n)$. Motivated by this result, both the authors \cite{MeherJindal2022} recently proved that for a non-negative integer $α,$ $a_{3^α m}(n)$ is almost always divisible by arbitrary power of $2$… ▽ More A partition of $n$ is called a $t$-core partition if none of its hook number is divisible by $t.$ In 2019, Hirschhorn and Sellers \cite{Hirs2019} obtained a parity result for $3$-core partition function $a_3(n)$. Motivated by this result, both the authors \cite{MeherJindal2022} recently proved that for a non-negative integer $α,$ $a_{3^α m}(n)$ is almost always divisible by arbitrary power of $2$ and $3$ and $a_{t}(n)$ is almost always divisible by arbitrary power of $p_i^j,$ where $j$ is a fixed positive integer and $t= p_1^{a_1}p_2^{a_2}\ldots p_m^{a_m}$ with primes $p_i \geq 5.$ In this article, by using Hecke eigenform theory, we obtain infinite families of congruences and multiplicative identities for $a_2(n)$ and $a_{13}(n)$ modulo $2$ which generalizes some results of Das \cite{Das2016}. △ Less

Submitted 23 February, 2023; originally announced February 2023.

Comments: arXiv admin note: substantial text overlap with arXiv:2302.11830

Arithmetic density and congruences of $t$-core partitions

Authors: Nabin Kumar Meher, Ankita Jindal

Abstract: A partition of $n$ is called a $t$-core partition if none of its hook number is divisible by $t.$ In 2019, Hirschhorn and Sellers \cite{Hirs2019} obtained a parity result for $3$-core partition function $a_3(n)$. Recently, both authors \cite{MeherJindal2022} proved density results for $a_3(n)$, wherein we proved that $a_3(n)$ is almost always divisible by arbitrary power of $2$ and $3.$ In this ar… ▽ More A partition of $n$ is called a $t$-core partition if none of its hook number is divisible by $t.$ In 2019, Hirschhorn and Sellers \cite{Hirs2019} obtained a parity result for $3$-core partition function $a_3(n)$. Recently, both authors \cite{MeherJindal2022} proved density results for $a_3(n)$, wherein we proved that $a_3(n)$ is almost always divisible by arbitrary power of $2$ and $3.$ In this article, we prove that for a non-negative integer $α,$ $a_{3^α m}(n)$ is almost always divisible by arbitrary power of $2$ and $3.$ Further, we prove that $a_{t}(n)$ is almost always divisible by arbitrary power of $p_i^j,$ where $j$ is a fixed positive integer and $t= p_1^{a_1}p_2^{a_2}\ldots p_m^{a_m}$ with primes $p_i \geq 5.$ Furthermore, by employing Radu and Seller's approach, we obtain an algorithm and we give alternate proofs of several congruences modulo $3$ and $5$ for $a_{p}(n)$, where $p$ is prime number. Our results also generalizes the results in \cite{radu2011a}. △ Less

Submitted 23 February, 2023; originally announced February 2023.

Exploring the Use of WebAssembly in HPC

Authors: Mohak Chadha, Nils Krueger, Jophin John, Anshul Jindal, Michael Gerndt, Shajulin Benedict

Abstract: Containerization approaches based on namespaces offered by the Linux kernel have seen an increasing popularity in the HPC community both as a means to isolate applications and as a format to package and distribute them. However, their adoption and usage in HPC systems faces several challenges. These include difficulties in unprivileged running and building of scientific application container image… ▽ More Containerization approaches based on namespaces offered by the Linux kernel have seen an increasing popularity in the HPC community both as a means to isolate applications and as a format to package and distribute them. However, their adoption and usage in HPC systems faces several challenges. These include difficulties in unprivileged running and building of scientific application container images directly on HPC resources, increasing heterogeneity of HPC architectures, and access to specialized networking libraries available only on HPC systems. These challenges of container-based HPC application development closely align with the several advantages that a new universal intermediate binary format called WebAssembly (Wasm) has to offer. These include a lightweight userspace isolation mechanism and portability across operating systems and processor architectures. In this paper, we explore the usage of Wasm as a distribution format for MPI-based HPC applications. To this end, we present MPIWasm, a novel Wasm embedder for MPI-based HPC applications that enables high-performance execution of Wasm code, has low-overhead for MPI calls, and supports high-performance networking interconnects present on HPC systems. We evaluate the performance and overhead of MPIWasm on a production HPC system and AWS Graviton2 nodes using standardized HPC benchmarks. Results from our experiments demonstrate that MPIWasm delivers competitive native application performance across all scenarios. Moreover, we observe that Wasm binaries are 139.5x smaller on average as compared to the statically-linked binaries for the different standardized benchmarks. △ Less

Submitted 10 January, 2023; originally announced January 2023.

Comments: ACM SIGPLAN PPoPP 2023

FedLesScan: Mitigating Stragglers in Serverless Federated Learning

Authors: Mohamed Elzohairy, Mohak Chadha, Anshul Jindal, Andreas Grafberger, Jianfeng Gu, Michael Gerndt, Osama Abboud

Abstract: Federated Learning (FL) is a machine learning paradigm that enables the training of a shared global model across distributed clients while keeping the training data local. While most prior work on designing systems for FL has focused on using stateful always running components, recent work has shown that components in an FL system can greatly benefit from the usage of serverless computing and Func… ▽ More Federated Learning (FL) is a machine learning paradigm that enables the training of a shared global model across distributed clients while keeping the training data local. While most prior work on designing systems for FL has focused on using stateful always running components, recent work has shown that components in an FL system can greatly benefit from the usage of serverless computing and Function-as-a-Service technologies. To this end, distributed training of models with serverless FL systems can be more resource-efficient and cheaper than conventional FL systems. However, serverless FL systems still suffer from the presence of stragglers, i.e., slow clients due to their resource and statistical heterogeneity. While several strategies have been proposed for mitigating stragglers in FL, most methodologies do not account for the particular characteristics of serverless environments, i.e., cold-starts, performance variations, and the ephemeral stateless nature of the function instances. Towards this, we propose FedLesScan, a novel clustering-based semi-asynchronous training strategy, specifically tailored for serverless FL. FedLesScan dynamically adapts to the behaviour of clients and minimizes the effect of stragglers on the overall system. We implement our strategy by extending an open-source serverless FL system called FedLess. Moreover, we comprehensively evaluate our strategy using the 2nd generation Google Cloud Functions with four datasets and varying percentages of stragglers. Results from our experiments show that compared to other approaches FedLesScan reduces training time and cost by an average of 8% and 20% respectively while utilizing clients better with an average increase in the effective update ratio of 17.75%. △ Less

Submitted 28 November, 2022; v1 submitted 10 November, 2022; originally announced November 2022.

Comments: IEEE BigData 2022

Deploying a Steered Query Optimizer in Production at Microsoft

Authors: Wangda Zhang, Matteo Interlandi, Paul Mineiro, Shi Qiao, Nasim Ghazanfari Karlen Lie, Marc Friedman, Rafah Hosn, Hiren Patel, Alekh Jindal

Abstract: Modern analytical workloads are highly heterogeneous and massively complex, making generic query optimizers untenable for many customers and scenarios. As a result, it is important to specialize these optimizers to instances of the workloads. In this paper, we continue a recent line of work in steering a query optimizer towards better plans for a given workload, and make major strides in pushing p… ▽ More Modern analytical workloads are highly heterogeneous and massively complex, making generic query optimizers untenable for many customers and scenarios. As a result, it is important to specialize these optimizers to instances of the workloads. In this paper, we continue a recent line of work in steering a query optimizer towards better plans for a given workload, and make major strides in pushing previous research ideas to production deployment. Along the way we solve several operational challenges including, making steering actions more manageable, keeping the costs of steering within budget, and avoiding unexpected performance regressions in production. Our resulting system, QQ-advisor, essentially externalizes the query planner to a massive offline pipeline for better exploration and specialization. We discuss various aspects of our design and show detailed results over production SCOPE workloads at Microsoft, where the system is currently enabled by default. △ Less

Submitted 24 October, 2022; originally announced October 2022.

Journal ref: Proceedings of the 2022 International Conference on Management of Data 2022 Jun 10 (pp. 2299-2311)

Migrating from Microservices to Serverless: An IoT Platform Case Study

Authors: Mohak Chadha, Victor Pacyna, Anshul Jindal, Jianfeng Gu, Michael Gerndt

Abstract: Microservice architecture is the common choice for developing cloud applications these days since each individual microservice can be independently modified, replaced, and scaled. As a result, application development and operating cloud infrastructure were bundled together into what is now commonly called DevOps. However, with the increasing popularity of the serverless computing paradigm and its… ▽ More Microservice architecture is the common choice for developing cloud applications these days since each individual microservice can be independently modified, replaced, and scaled. As a result, application development and operating cloud infrastructure were bundled together into what is now commonly called DevOps. However, with the increasing popularity of the serverless computing paradigm and its several advantages such as no infrastructure management, a pay-per-use billing policy, and on-demand fine-grained autoscaling, there is a growing interest in utilizing FaaS and serverless CaaS technologies for refactoring microservices-based applications. Towards this, we migrate a complex IoT platform application onto OpenWhisk (OW) and Google Cloud Run (GCR). We comprehensively evaluate the performance of the different deployment strategies, i.e., Google Kubernetes Engine (GKE)-Standard, OW, and GCR for the IoT platform using different load testing scenarios. Results from our experiments show that while GKE standard performs best for most scenarios, GCR is always cheaper wrt costs. △ Less

Submitted 9 October, 2022; originally announced October 2022.

Comments: ACM International Workshop on Serverless Computing 2022 (WoSC@Middleware 2022)

Bunk8s: Enabling Easy Integration Testing of Microservices in Kubernetes

Authors: Christoph Reile, Mohak Chadha, Valentin Hauner, Anshul Jindal, Benjamin Hofmann, Michael Gerndt

Abstract: Microservice architecture is the common choice for cloud applications these days since each individual microservice can be independently modified, replaced, and scaled. However, the complexity of microservice applications requires automated testing with a focus on the interactions between the services. While this is achievable with end-to-end tests, they are error-prone, brittle, expensive to writ… ▽ More Microservice architecture is the common choice for cloud applications these days since each individual microservice can be independently modified, replaced, and scaled. However, the complexity of microservice applications requires automated testing with a focus on the interactions between the services. While this is achievable with end-to-end tests, they are error-prone, brittle, expensive to write, time-consuming to run, and require the entire application to be deployed. Integration tests are an alternative to end-to-end tests since they have a smaller test scope and require the deployment of a significantly fewer number of services. The de-facto standard for deploying microservice applications in the cloud is containers with Kubernetes being the most widely used container orchestration platform. To support the integration testing of microservices in Kubernetes, several tools such as Octopus, Istio, and Jenkins exist. However, each of these tools either lack crucial functionality or lead to a substantial increase in the complexity and growth of the tool landscape when introduced into a project. To this end, we present \emph{Bunk8s}, a tool for integration testing of microservice applications in Kubernetes that overcomes the limitations of these existing tools. \emph{Bunk8s} is independent of the test framework used for writing integration tests, independent of the used CI/CD infrastructure, and supports test result publishing. A video demonstrating the functioning of our tool is available from \url{https://www.youtube.com/watch?v=e8wbS25O4Bo}. △ Less

Submitted 14 July, 2022; originally announced July 2022.

Comments: 29th IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER)

SLAM: SLO-Aware Memory Optimization for Serverless Applications

Authors: Gor Safaryan, Anshul Jindal, Mohak Chadha, Michael Gerndt

Abstract: Serverless computing paradigm has become more ingrained into the industry, as it offers a cheap alternative for application development and deployment. This new paradigm has also created new kinds of problems for the developer, who needs to tune memory configurations for balancing cost and performance. Many researchers have addressed the issue of minimizing cost and meeting Service Level Objective… ▽ More Serverless computing paradigm has become more ingrained into the industry, as it offers a cheap alternative for application development and deployment. This new paradigm has also created new kinds of problems for the developer, who needs to tune memory configurations for balancing cost and performance. Many researchers have addressed the issue of minimizing cost and meeting Service Level Objective (SLO) requirements for a single FaaS function, but there has been a gap for solving the same problem for an application consisting of many FaaS functions, creating complex application workflows. In this work, we designed a tool called SLAM to address the issue. SLAM uses distributed tracing to detect the relationship among the FaaS functions within a serverless application. By modeling each of them, it estimates the execution time for the application at different memory configurations. Using these estimations, SLAM determines the optimal memory configuration for the given serverless application based on the specified SLO requirements and user-specified objectives (minimum cost or minimum execution time). We demonstrate the functionality of SLAM on AWS Lambda by testing on four applications. Our results show that the suggested memory configurations guarantee that more than 95% of requests are completed within the predefined SLOs. △ Less

Submitted 13 July, 2022; originally announced July 2022.

Comments: This is the preprint version of the accepted paper at IEEE CLOUD'22

Implicit Function Theorem: Estimates on the size of the domain

Authors: Ashutosh Jindal, Debasish Chatterjee, Ravi Banavar

Abstract: In this article, we present explicit estimates of the size of the domain on which the Implicit Function Theorem and the Inverse Function Theorem are valid. For maps that are twice continuously differentiable, these estimates depend upon the magnitude of the first-order derivatives evaluated at the point of interest, and a bound on the second-order derivatives over a region of interest. One of the… ▽ More In this article, we present explicit estimates of the size of the domain on which the Implicit Function Theorem and the Inverse Function Theorem are valid. For maps that are twice continuously differentiable, these estimates depend upon the magnitude of the first-order derivatives evaluated at the point of interest, and a bound on the second-order derivatives over a region of interest. One of the key contributions of this article is that the estimates presented require minimal numerical computation. In particular, these estimates are arrived at without any intermediate optimization procedures. We then present three applications in optimization and systems and control theory where the computation of such bounds turns out to be important. First, in electrical networks, the power flow operations can be written as Quadratically Constrained Quadratic Programs (QCQPs), and we utilize our bounds to compute the size of permissible power variations to ensure stable operations of the power system network. Second, the robustness margin of positive definite solutions to the Algebraic Riccati Equation (frequently encountered in control problems) subject to perturbations in the system matrices are computed with the aid of our bounds. Finally, we employ these bounds to provide quantitative estimates of the size of the domains for feedback linearization of discrete-time control systems. △ Less

Submitted 6 July, 2023; v1 submitted 25 May, 2022; originally announced May 2022.

Comments: 36 pages, 4 figures, 1 table

Scalable Infrastructure for Workload Characterization of Cluster Traces

Authors: Thomas van Loo, Anshul Jindal, Shajulin Benedict, Mohak Chadha, Michael Gerndt

Abstract: In the recent past, characterizing workloads has been attempted to gain a foothold in the emerging serverless cloud market, especially in the large production cloud clusters of Google, AWS, and so forth. While analyzing and characterizing real workloads from a large production cloud cluster benefits cloud providers, researchers, and daily users, analyzing the workload traces of these clusters has… ▽ More In the recent past, characterizing workloads has been attempted to gain a foothold in the emerging serverless cloud market, especially in the large production cloud clusters of Google, AWS, and so forth. While analyzing and characterizing real workloads from a large production cloud cluster benefits cloud providers, researchers, and daily users, analyzing the workload traces of these clusters has been an arduous task due to the heterogeneous nature of data. This article proposes a scalable infrastructure based on Google's dataproc for analyzing the workload traces of cloud environments. We evaluated the functioning of the proposed infrastructure using the workload traces of Google cloud cluster-usage-traces-v3. We perform the workload characterization on this dataset, focusing on the heterogeneity of the workload, the variations in job durations, aspects of resources consumption, and the overall availability of resources provided by the cluster. The findings reported in the paper will be beneficial for cloud infrastructure providers and users while managing the cloud computing resources, especially serverless platforms. △ Less

Submitted 23 May, 2022; originally announced May 2022.

Comments: 9 pages, CLOSER 2022

Journal ref: In Proceedings of the 12th International Conference on Cloud Computing and Services Science - CLOSER 2022, ISBN 978-989-758-570-8; ISSN 2184-5042, pages 254-263

Impact of Multiple Fully-Absorbing Receivers in Molecular Communications

Authors: Nithin V. Sabu, Abhishek K. Gupta, Neeraj Varshney, Anshuman Jindal

Abstract: Molecular communication is a promising solution to enable intra-body communications among nanomachines. However, malicious and non-cooperative receivers can degrade the performance, compromising these systems' security. Analyzing the communication and security performance of these systems requires accurate channel models. However, such models are not present in the literature. In this work, we dev… ▽ More Molecular communication is a promising solution to enable intra-body communications among nanomachines. However, malicious and non-cooperative receivers can degrade the performance, compromising these systems' security. Analyzing the communication and security performance of these systems requires accurate channel models. However, such models are not present in the literature. In this work, we develop an analytical framework to derive the hitting probability of a molecule on a fully absorbing receiver (FAR) in the presence of other FARs, which can be either be cooperative or malicious. We first present an approximate hitting probability expression for the 3-FARs case. A simplified expression is obtained for the case when FARs are symmetrically positioned. Using the derived expressions, we study the impact of malicious receivers on the intended receiver and discuss how to minimize this impact to obtain a secure communication channel. We also study the gain that can be obtained by the cooperation of these FARs. We then present an approach to extend the analysis for a system with N FARs. The derived expressions can be used to analyze and design multiple input/output and secure molecular communication systems. △ Less

Submitted 21 May, 2022; originally announced May 2022.

Rational penta-inner functions and the distinguished boundary of the pentablock

Authors: Abhay Jindal, Poornendu Kumar

Abstract: In this note, we give a description of rational maps from the open unit disc $\mathbb{D}$ to the pentablock that map the boundary of $\mathbb{D}$ to the distinguished boundary of the pentablock. We also obtain a new characterization of the distinguished boundary of the pentablock. In this note, we give a description of rational maps from the open unit disc $\mathbb{D}$ to the pentablock that map the boundary of $\mathbb{D}$ to the distinguished boundary of the pentablock. We also obtain a new characterization of the distinguished boundary of the pentablock. △ Less

Submitted 17 November, 2022; v1 submitted 31 March, 2022; originally announced March 2022.

Comments: Final revised version

MSC Class: 32F45; 30J05; 92B36; 93B50

Journal ref: Complex Analysis and Operator Theory, Volume 16(2022), Article number: 120

A dilation theoretic approach to approximation by inner functions

Authors: Daniel Alpay, Tirthankar Bhattacharyya, Abhay Jindal, Poornendu Kumar

Abstract: Using results from theory of operators on a Hilbert space, we prove approximation results for matrix-valued holomorphic functions on the unit disc and the unit bidisc. The essential tools are the theory of unitary dilation of a contraction and the realization formula for functions in the unit ball of $H^\infty$. We first prove a generalization of a result of Carathéodory. This generalization has… ▽ More Using results from theory of operators on a Hilbert space, we prove approximation results for matrix-valued holomorphic functions on the unit disc and the unit bidisc. The essential tools are the theory of unitary dilation of a contraction and the realization formula for functions in the unit ball of $H^\infty$. We first prove a generalization of a result of Carathéodory. This generalization has many applications. A uniform approximation result for matrix-valued holomorphic functions which extend continuously to the unit circle is proved using the Potapov factorization. This generalizes a theorem due to Fisher. Approximation results are proved for matrix-valued functions for whom a naturally associated kernel has finitely many negative squares. This uses the Krein-Langer factorization. Approximation results for $J$-contractive meromorphic functions where $J$ induces an indefinite metric on $\mathbb C^N$ are proved using the Potapov-Ginzburg Theorem. Moreover, approximation results for holomorphic functions on the unit disc with values in certain other domains of interest are also proved. △ Less

Submitted 24 June, 2023; v1 submitted 11 March, 2022; originally announced March 2022.

Comments: Keywords: Approximation, State space method, Rational inner functions, Realization formula, J-contractive functions, Krein-Langer factorization, Potapov-Ginzburg transform

MSC Class: Primary: 47A20; 30E10. Secondary: 93B28; 47A56

Fairness for Text Classification Tasks with Identity Information Data Augmentation Methods

Authors: Mohit Wadhwa, Mohan Bhambhani, Ashvini Jindal, Uma Sawant, Ramanujam Madhavan

Abstract: Counterfactual fairness methods address the question: How would the prediction change if the sensitive identity attributes referenced in the text instance were different? These methods are entirely based on generating counterfactuals for the given training and test set instances. Counterfactual instances are commonly prepared by replacing sensitive identity terms, i.e., the identity terms present… ▽ More Counterfactual fairness methods address the question: How would the prediction change if the sensitive identity attributes referenced in the text instance were different? These methods are entirely based on generating counterfactuals for the given training and test set instances. Counterfactual instances are commonly prepared by replacing sensitive identity terms, i.e., the identity terms present in the instance are replaced with other identity terms that fall under the same sensitive category. Therefore, the efficacy of these methods depends heavily on the quality and comprehensiveness of identity pairs. In this paper, we offer a two-step data augmentation process where (1) the former stage consists of a novel method for preparing a comprehensive list of identity pairs with word embeddings, and (2) the latter consists of leveraging prepared identity pairs list to enhance the training instances by applying three simple operations (namely identity pair replacement, identity term blindness, and identity pair swap). We empirically show that the two-stage augmentation process leads to diverse identity pairs and an enhanced training set, with an improved counterfactual token-based fairness metric score on two well-known text classification tasks. △ Less

Submitted 4 February, 2022; originally announced March 2022.

Estimating the Capacities of Function-as-a-Service Functions

Authors: Anshul Jindal, Mohak Chadha, Shajulin Benedict, Michael Gerndt

Abstract: Serverless computing is a cloud computing paradigm that allows developers to focus exclusively on business logic as cloud service providers manage resource management tasks. Serverless applications follow this model, where the application is decomposed into a set of fine-grained Function-as-a-Service (FaaS) functions. However, the obscurities of the underlying system infrastructure and dependencie… ▽ More Serverless computing is a cloud computing paradigm that allows developers to focus exclusively on business logic as cloud service providers manage resource management tasks. Serverless applications follow this model, where the application is decomposed into a set of fine-grained Function-as-a-Service (FaaS) functions. However, the obscurities of the underlying system infrastructure and dependencies between FaaS functions within the application pose a challenge for estimating the performance of FaaS functions. To characterize the performance of a FaaS function that is relevant for the user, we define Function Capacity (FC) as the maximal number of concurrent invocations the function can serve in a time without violating the Service-Level Objective (SLO). The paper addresses the challenge of quantifying the FC individually for each FaaS function within a serverless application. This challenge is addressed by sandboxing a FaaS function and building its performance model. To this end, we develop FnCapacitor - an end-to-end automated Function Capacity estimation tool. We demonstrate the functioning of our tool on Google Cloud Functions (GCF) and AWS Lambda. FnCapacitor estimates the FCs on different deployment configurations (allocated memory & maximum function instances) by conducting time-framed load tests and building various models using statistical: linear, ridge, and polynomial regression, and Deep Neural Network (DNN) methods on the acquired performance data. Our evaluation of different FaaS functions shows relatively accurate predictions, with an accuracy greater than 75% using DNN for both cloud providers. △ Less

Submitted 27 January, 2022; originally announced January 2022.

Comments: 8 pages, Accepted at CloudAM'21 Workshop (UCC)

FARSI: Facebook AR System Investigator for Agile Domain-Specific System-on-Chip Exploration

Authors: Behzad Boroujerdian, Ying Jing, Amit Kumar, Lavanya Subramanian, Luke Yen, Vincent Lee, Vivek Venkatesan, Amit Jindal, Robert Shearer, Vijay Janapa Reddi

Abstract: Domain-specific SoCs (DSSoCs) are attractive solutions for domains with stringent power/performance/area constraints; however, they suffer from two fundamental complexities. On the one hand, their many specialized hardware blocks result in complex systems and thus high development effort. On the other, their many system knobs expand the complexity of design space, making the search for the optimal… ▽ More Domain-specific SoCs (DSSoCs) are attractive solutions for domains with stringent power/performance/area constraints; however, they suffer from two fundamental complexities. On the one hand, their many specialized hardware blocks result in complex systems and thus high development effort. On the other, their many system knobs expand the complexity of design space, making the search for the optimal design difficult. Thus to reach prevalence, taming such complexities is necessary. This work identifies necessary features of an early-stage design space exploration (DSE) framework that targets the complex design space of DSSoCs and further provides an instance of one called FARSI, (F)acebook (AR) (S)ystem (I)nvestigator. Concretely, FARSI provides an agile system-level simulator with speed up and accuracy of 8,400X and 98.5% comparing to Synopsys Platform Architect. FARSI also provides an efficient exploration heuristic and achieves up to 16X improvementin convergence time comparing to naive simulated annealing (SA). This is done by augmenting SA with architectural reasoning such as locality exploitation and bottleneck relaxation. Furthermore, we embed various co-design capabilities and show that on average, they have a 32% impact on the convergence rate. Finally, we demonstrate that using simple development-cost-aware policies can lower the system complexity, both in terms of the component count and variation by as much as 150% and 118% (e,g., for Network-on-a-Chip subsystem) △ Less

Submitted 17 January, 2022; v1 submitted 13 January, 2022; originally announced January 2022.

Channel Characterization and Performance of a 3-D Molecular Communication System with Multiple Fully-Absorbing Receivers

Authors: Nithin V. Sabu, Abhishek K. Gupta, Neeraj Varshney, Anshuman Jindal

Abstract: Molecular communication (MC) can enable the transfer of information between nanomachines using molecules as the information carrier. In MC systems, multiple receiver nanomachines often co-exist in the same communication channel to serve common or different purposes. However, the analytical channel model for a system with multiple fully absorbing receivers (FARs) does not exist in the literature, w… ▽ More Molecular communication (MC) can enable the transfer of information between nanomachines using molecules as the information carrier. In MC systems, multiple receiver nanomachines often co-exist in the same communication channel to serve common or different purposes. However, the analytical channel model for a system with multiple fully absorbing receivers (FARs) does not exist in the literature, which is significantly different from the single FAR system due to the mutual influence of FARs. The analytical channel model is essential in analyzing systems with multiple FARs, including MIMO, SIMO, and cognitive molecular communication systems. In this work, we derive an approximate analytical expression for the hitting probability of a molecule emitted from a point source on each FAR on a diffusion-based MC system with three or more FARs. Using these expressions, we derive the channel model for a SIMO system with a single transmitter and multiple FARs arranged in a uniform circular array (UCA). We then analyze the communication performance of this SIMO system under different cooperative receiver schemes and develop several interesting insights. △ Less

Submitted 6 December, 2022; v1 submitted 17 December, 2021; originally announced December 2021.

Predictive Price-Performance Optimization for Serverless Query Processing

Authors: Rathijit Sen, Abhishek Roy, Alekh Jindal

Abstract: We present an efficient, parametric modeling framework for predictive resource allocations, focusing on the amount of computational resources, that can optimize for a range of price-performance objectives for data analytics in serverless query processing settings. We discuss and evaluate in depth how our system, AutoExecutor, can use this framework to automatically select near-optimal executor and… ▽ More We present an efficient, parametric modeling framework for predictive resource allocations, focusing on the amount of computational resources, that can optimize for a range of price-performance objectives for data analytics in serverless query processing settings. We discuss and evaluate in depth how our system, AutoExecutor, can use this framework to automatically select near-optimal executor and core counts for Spark SQL queries running on Azure Synapse. Our techniques improve upon Spark's in-built, reactive, dynamic executor allocation capabilities by substantially reducing the total executors allocated and executor occupancy while running queries, thereby freeing up executors that can potentially be used by other concurrent queries or in reducing the overall cluster provisioning needs. In contrast with post-execution analysis tools such as Sparklens, we predict resource allocations for queries before executing them and can also account for changes in input data sizes for predicting the desired allocations. △ Less

Submitted 15 December, 2021; originally announced December 2021.

IAD: Indirect Anomalous VMMs Detection in the Cloud-based Environment

Authors: Anshul Jindal, Ilya Shakhat, Jorge Cardoso, Michael Gerndt, Vladimir Podolskiy

Abstract: Server virtualization in the form of virtual machines (VMs) with the use of a hypervisor or a Virtual Machine Monitor (VMM) is an essential part of cloud computing technology to provide infrastructure-as-a-service (IaaS). A fault or an anomaly in the VMM can propagate to the VMs hosted on it and ultimately affect the availability and reliability of the applications running on those VMs. Therefore,… ▽ More Server virtualization in the form of virtual machines (VMs) with the use of a hypervisor or a Virtual Machine Monitor (VMM) is an essential part of cloud computing technology to provide infrastructure-as-a-service (IaaS). A fault or an anomaly in the VMM can propagate to the VMs hosted on it and ultimately affect the availability and reliability of the applications running on those VMs. Therefore, identifying and eventually resolving it quickly is highly important. However, anomalous VMM detection is a challenge in the cloud environment since the user does not have access to the VMM. This paper addresses this challenge of anomalous VMM detection in the cloud-based environment without having any knowledge or data from VMM by introducing a novel machine learning-based algorithm called IAD: Indirect Anomalous VMMs Detection. This algorithm solely uses the VM's resources utilization data hosted on those VMMs for the anomalous VMMs detection. The developed algorithm's accuracy was tested on four datasets comprising the synthetic and real and compared against four other popular algorithms, which can also be used to the described problem. It was found that the proposed IAD algorithm has an average F1-score of 83.7% averaged across four datasets, and also outperforms other algorithms by an average F1-score of 11\%. △ Less

Submitted 22 November, 2021; originally announced November 2021.

Comments: Accepted at AIOps 2021 workshop (ICSOC 2021)

Network Graph Generation through Adaptive Clustering and Infection Dynamics: A Step Towards Global Connectivity

Authors: Aniq Ur Rahman, Fares Fourati, Khac-Hoang Ngo, Anish Jindal, Mohamed-Slim Alouini

Abstract: More than 40% of the world's population is not connected to the internet, majorly due to the lack of adequate infrastructure. Our work aims to bridge this digital divide by proposing solutions for network deployment in remote areas. Specifically, a number of access points (APs) are deployed as an interface between the users and backhaul nodes (BNs). The main challenges include designing the number… ▽ More More than 40% of the world's population is not connected to the internet, majorly due to the lack of adequate infrastructure. Our work aims to bridge this digital divide by proposing solutions for network deployment in remote areas. Specifically, a number of access points (APs) are deployed as an interface between the users and backhaul nodes (BNs). The main challenges include designing the number and location of the APs, and connecting them to the BNs. In order to address these challenges, we first propose a metric called connectivity ratio to assess the quality of the deployment. Next, we propose an agile search algorithm to determine the number of APs that maximizes this metric and perform clustering to find the optimal locations of the APs. Furthermore, we propose a novel algorithm inspired by infection dynamics to connect all the deployed APs to the existing BNs economically. To support the existing terrestrial BNs, we investigate the deployment of non-terrestrial BNs, which further improves the network performance in terms of average hop count, traffic distribution, and backhaul length. Finally, we use real datasets from a remote village to test our solution. △ Less

Submitted 20 November, 2021; originally announced November 2021.

Comments: 6 pages, 8 figures, 2 algorithms

FedLess: Secure and Scalable Federated Learning Using Serverless Computing

Authors: Andreas Grafberger, Mohak Chadha, Anshul Jindal, Jianfeng Gu, Michael Gerndt

Abstract: The traditional cloud-centric approach for Deep Learning (DL) requires training data to be collected and processed at a central server which is often challenging in privacy-sensitive domains like healthcare. Towards this, a new learning paradigm called Federated Learning (FL) has been proposed that brings the potential of DL to these domains while addressing privacy and data ownership issues. FL e… ▽ More The traditional cloud-centric approach for Deep Learning (DL) requires training data to be collected and processed at a central server which is often challenging in privacy-sensitive domains like healthcare. Towards this, a new learning paradigm called Federated Learning (FL) has been proposed that brings the potential of DL to these domains while addressing privacy and data ownership issues. FL enables remote clients to learn a shared ML model while keeping the data local. However, conventional FL systems face several challenges such as scalability, complex infrastructure management, and wasted compute and incurred costs due to idle clients. These challenges of FL systems closely align with the core problems that serverless computing and Function-as-a-Service (FaaS) platforms aim to solve. These include rapid scalability, no infrastructure management, automatic scaling to zero for idle clients, and a pay-per-use billing model. To this end, we present a novel system and framework for serverless FL, called FedLess. Our system supports multiple commercial and self-hosted FaaS providers and can be deployed in the cloud, on-premise in institutional data centers, and on edge devices. To the best of our knowledge, we are the first to enable FL across a large fabric of heterogeneous FaaS providers while providing important features like security and Differential Privacy. We demonstrate with comprehensive experiments that the successful training of DNNs for different tasks across up to 200 client functions and more is easily possible using our system. Furthermore, we demonstrate the practical viability of our methodology by comparing it against a traditional FL system and show that it can be cheaper and more resource-efficient. △ Less

Submitted 5 November, 2021; originally announced November 2021.

Comments: IEEE BigData 2021

Phoebe: A Learning-based Checkpoint Optimizer

Authors: Yiwen Zhu, Matteo Interlandi, Abhishek Roy, Krishnadhan Das, Hiren Patel, Malay Bag, Hitesh Sharma, Alekh Jindal

Abstract: Easy-to-use programming interfaces paired with cloud-scale processing engines have enabled big data system users to author arbitrarily complex analytical jobs over massive volumes of data. However, as the complexity and scale of analytical jobs increase, they encounter a number of unforeseen problems, hotspots with large intermediate data on temporary storage, longer job recovery time after failur… ▽ More Easy-to-use programming interfaces paired with cloud-scale processing engines have enabled big data system users to author arbitrarily complex analytical jobs over massive volumes of data. However, as the complexity and scale of analytical jobs increase, they encounter a number of unforeseen problems, hotspots with large intermediate data on temporary storage, longer job recovery time after failures, and worse query optimizer estimates being examples of issues that we are facing at Microsoft. To address these issues, we propose Phoebe, an efficient learning-based checkpoint optimizer. Given a set of constraints and an objective function at compile-time, Phoebe is able to determine the decomposition of job plans, and the optimal set of checkpoints to preserve their outputs to durable global storage. Phoebe consists of three machine learning predictors and one optimization module. For each stage of a job, Phoebe makes accurate predictions for: (1) the execution time, (2) the output size, and (3) the start/end time taking into account the inter-stage dependencies. Using these predictions, we formulate checkpoint optimization as an integer programming problem and propose a scalable heuristic algorithm that meets the latency requirement of the production environment. We demonstrate the effectiveness of Phoebe in production workloads, and show that we can free the temporary storage on hotspots by more than 70% and restart failed jobs 68% faster on average with minimum performance impact. Phoebe also illustrates that adding multiple sets of checkpoints is not cost-efficient, which dramatically reduces the complexity of the optimization. △ Less

Submitted 5 October, 2021; originally announced October 2021.

Journal ref: Proceedings of the VLDB Endowment 14 (11), 2505-2518, 2021

Complete Nevanlinna-Pick kernels And The Characteristic Function

Authors: Tirthankar Bhattacharyya, Abhay Jindal

Abstract: This note finds a new characterization of complete Nevanlinna-Pick kernels on the Euclidean unit ball. The classical theory of Sz.-Nagy and Foias about the characteristic function is extended in this note to a commuting tuple $\bfT$ of bounded operators satisfying the natural positivity condition of $1/k$-contractivity for an irreducible unitarily invariant complete Nevanlinna-Pick kernel. The c… ▽ More This note finds a new characterization of complete Nevanlinna-Pick kernels on the Euclidean unit ball. The classical theory of Sz.-Nagy and Foias about the characteristic function is extended in this note to a commuting tuple $\bfT$ of bounded operators satisfying the natural positivity condition of $1/k$-contractivity for an irreducible unitarily invariant complete Nevanlinna-Pick kernel. The characteristic function is a multiplier from $H_k \otimes \cE$ to $H_k \otimes \cF$, {\em factoring} a certain positive operator, for suitable Hilbert spaces $\cE$ and $\cF$ depending on $\bfT$. There is a converse, which roughly says that if a kernel $k$ {\em admits} a characteristic function, then it has to be an irreducible unitarily invariant complete Nevanlinna-Pick kernel. The characterization explains, among other things, why in the literature an analogue of the characteristic function for a Bergman contraction ($1/k$-contraction where $k$ is the Bergman kernel), when viewed as a multiplier between two vector valued reproducing kernel Hilbert spaces, requires a different (vector valued) reproducing kernel Hilbert space as the domain. △ Less

Submitted 28 April, 2023; v1 submitted 1 October, 2021; originally announced October 2021.

Comments: Final version. This is to appear in Advances in Mathematics

MSC Class: 47A45; 47A13; 46E22

DeepEdgeBench: Benchmarking Deep Neural Networks on Edge Devices

Authors: Stephan Patrick Baller, Anshul Jindal, Mohak Chadha, Michael Gerndt

Abstract: EdgeAI (Edge computing based Artificial Intelligence) has been most actively researched for the last few years to handle variety of massively distributed AI applications to meet up the strict latency requirements. Meanwhile, many companies have released edge devices with smaller form factors (low power consumption and limited resources) like the popular Raspberry Pi and Nvidia's Jetson Nano for ac… ▽ More EdgeAI (Edge computing based Artificial Intelligence) has been most actively researched for the last few years to handle variety of massively distributed AI applications to meet up the strict latency requirements. Meanwhile, many companies have released edge devices with smaller form factors (low power consumption and limited resources) like the popular Raspberry Pi and Nvidia's Jetson Nano for acting as compute nodes at the edge computing environments. Although the edge devices are limited in terms of computing power and hardware resources, they are powered by accelerators to enhance their performance behavior. Therefore, it is interesting to see how AI-based Deep Neural Networks perform on such devices with limited resources. In this work, we present and compare the performance in terms of inference time and power consumption of the four Systems on a Chip (SoCs): Asus Tinker Edge R, Raspberry Pi 4, Google Coral Dev Board, Nvidia Jetson Nano, and one microcontroller: Arduino Nano 33 BLE, on different deep learning models and frameworks. We also provide a method for measuring power consumption, inference time and accuracy for the devices, which can be easily extended to other devices. Our results showcase that, for Tensorflow based quantized model, the Google Coral Dev Board delivers the best performance, both for inference time and power consumption. For a low fraction of inference computation time, i.e. less than 29.3% of the time for MobileNetV2, the Jetson Nano performs faster than the other devices. △ Less

Submitted 21 August, 2021; originally announced August 2021.

Comments: 12 pages, accepted at IC2E'21

Architecture-Specific Performance Optimization of Compute-Intensive FaaS Functions

Authors: Mohak Chadha, Anshul Jindal, Michael Gerndt

Abstract: FaaS allows an application to be decomposed into functions that are executed on a FaaS platform. The FaaS platform is responsible for the resource provisioning of the functions. Recently, there is a growing trend towards the execution of compute-intensive FaaS functions that run for several seconds. However, due to the billing policies followed by commercial FaaS offerings, the execution of these… ▽ More FaaS allows an application to be decomposed into functions that are executed on a FaaS platform. The FaaS platform is responsible for the resource provisioning of the functions. Recently, there is a growing trend towards the execution of compute-intensive FaaS functions that run for several seconds. However, due to the billing policies followed by commercial FaaS offerings, the execution of these functions can incur significantly higher costs. Moreover, due to the abstraction of underlying processor architectures on which the functions are executed, the performance optimization of these functions is challenging. As a result, most FaaS functions use pre-compiled libraries generic to x86-64 leading to performance degradation. In this paper, we examine the underlying processor architectures for Google Cloud Functions (GCF) and determine their prevalence across the 19 available GCF regions. We modify, adapt, and optimize three compute-intensive FaaS workloads written in Python using Numba, a JIT compiler based on LLVM, and present results wrt performance, memory consumption, and costs on GCF. Results from our experiments show that the optimization of FaaS functions can improve performance by 12.8x (geometric mean) and save costs by 73.4% on average for the three functions. Our results show that optimization of the FaaS functions for the specific architecture is very important. We achieved a maximum speedup of 1.79x by tuning the function especially for the instruction set of the underlying processor architecture. △ Less

Submitted 21 July, 2021; originally announced July 2021.

Comments: Extended version IEEE CLOUD 2021

Optimal Resource Allocation for Serverless Queries

Authors: Anish Pimpley, Shuo Li, Anubha Srivastava, Vishal Rohra, Yi Zhu, Soundararajan Srinivasan, Alekh Jindal, Hiren Patel, Shi Qiao, Rathijit Sen

Abstract: Optimizing resource allocation for analytical workloads is vital for reducing costs of cloud-data services. At the same time, it is incredibly hard for users to allocate resources per query in serverless processing systems, and they frequently misallocate by orders of magnitude. Unfortunately, prior work focused on predicting peak allocation while ignoring aggressive trade-offs between resource al… ▽ More Optimizing resource allocation for analytical workloads is vital for reducing costs of cloud-data services. At the same time, it is incredibly hard for users to allocate resources per query in serverless processing systems, and they frequently misallocate by orders of magnitude. Unfortunately, prior work focused on predicting peak allocation while ignoring aggressive trade-offs between resource allocation and run-time. Additionally, these methods fail to predict allocation for queries that have not been observed in the past. In this paper, we tackle both these problems. We introduce a system for optimal resource allocation that can predict performance with aggressive trade-offs, for both new and past observed queries. We introduce the notion of a performance characteristic curve (PCC) as a parameterized representation that can compactly capture the relationship between resources and performance. To tackle training data sparsity, we introduce a novel data augmentation technique to efficiently synthesize the entire PCC using a single run of the query. Lastly, we demonstrate the advantages of a constrained loss function coupled with GNNs, over traditional ML methods, for capturing the domain specific behavior through an extensive experimental evaluation over SCOPE big data workloads at Microsoft. △ Less

Submitted 18 July, 2021; originally announced July 2021.

Memory Leak Detection Algorithms in the Cloud-based Infrastructure

Authors: Anshul Jindal, Paul Staab, Pooja Kulkarni, Jorge Cardoso, Michael Gerndt, Vladimir Podolskiy

Abstract: A memory leak in an application deployed on the cloud can affect the availability and reliability of the application. Therefore, identifying and ultimately resolve it quickly is highly important. However, in the production environment running on the cloud, memory leak detection is a challenge without the knowledge of the application or its internal object allocation details. This paper addresses… ▽ More A memory leak in an application deployed on the cloud can affect the availability and reliability of the application. Therefore, identifying and ultimately resolve it quickly is highly important. However, in the production environment running on the cloud, memory leak detection is a challenge without the knowledge of the application or its internal object allocation details. This paper addresses this challenge of detection of memory leaks in cloud-based infrastructure without having any internal knowledge by introducing two novel machine learning-based algorithms: Linear Backward Regression (LBR) and Precog and, their two variants: Linear Backward Regression with Change Points Detection (LBRCPD) and Precog with Maximum Filteration (PrecogMF). These algorithms only use one metric i.e the system's memory utilization on which the application is deployed for detection of a memory leak. The developed algorithm's accuracy was tested on 60 virtual machines manually labeled memory utilization data and it was found that the proposed PrecogMF algorithm achieves the highest accuracy score of 85%. The same algorithm also achieves this by decreasing the overall compute time by 80% when compared to LBR's compute time. The paper also presents the different memory leak patterns found in the various memory leak applications and are further classified into different classes based on their visual representation. △ Less

Submitted 16 June, 2021; originally announced June 2021.

Comments: 10. pages. arXiv admin note: substantial text overlap with arXiv:2101.09799