-
SafeTail: Efficient Tail Latency Optimization in Edge Service Scheduling via Computational Redundancy Management
Authors:
Jyoti Shokhanda,
Utkarsh Pal,
Aman Kumar,
Soumi Chattopadhyay,
Arani Bhattacharya
Abstract:
Optimizing tail latency while efficiently managing computational resources is crucial for delivering high-performance, latency-sensitive services in edge computing. Emerging applications, such as augmented reality, require low-latency computing services with high reliability on user devices, which often have limited computational capabilities. Consequently, these devices depend on nearby edge serv…
▽ More
Optimizing tail latency while efficiently managing computational resources is crucial for delivering high-performance, latency-sensitive services in edge computing. Emerging applications, such as augmented reality, require low-latency computing services with high reliability on user devices, which often have limited computational capabilities. Consequently, these devices depend on nearby edge servers for processing. However, inherent uncertainties in network and computation latencies stemming from variability in wireless networks and fluctuating server loads make service delivery on time challenging. Existing approaches often focus on optimizing median latency but fall short of addressing the specific challenges of tail latency in edge environments, particularly under uncertain network and computational conditions. Although some methods do address tail latency, they typically rely on fixed or excessive redundancy and lack adaptability to dynamic network conditions, often being designed for cloud environments rather than the unique demands of edge computing. In this paper, we introduce SafeTail, a framework that meets both median and tail response time targets, with tail latency defined as latency beyond the 90^th percentile threshold. SafeTail addresses this challenge by selectively replicating services across multiple edge servers to meet target latencies. SafeTail employs a reward-based deep learning framework to learn optimal placement strategies, balancing the need to achieve target latencies with minimizing additional resource usage. Through trace-driven simulations, SafeTail demonstrated near-optimal performance and outperformed most baseline strategies across three diverse services.
△ Less
Submitted 30 August, 2024;
originally announced August 2024.
-
Constraints on the parameter space in dark matter admixed neutron stars
Authors:
Ankit Kumar,
Hajime Sotani
Abstract:
We investigate the impact of dark matter on neutron star properties using the relativistic mean-field theory. By incorporating the dark matter model, we explore how dark matter parameters, specifically dark matter mass and Fermi momentum, influence nuclear saturation properties, the equation of state, and the mass-radius relationship of neutron stars. We also examine the universal relation between…
▽ More
We investigate the impact of dark matter on neutron star properties using the relativistic mean-field theory. By incorporating the dark matter model, we explore how dark matter parameters, specifically dark matter mass and Fermi momentum, influence nuclear saturation properties, the equation of state, and the mass-radius relationship of neutron stars. We also examine the universal relation between dimensionless tidal deformability and compactness in the presence of dark matter. Our results show that the inclusion of dark matter significantly alters nuclear saturation properties, leading to higher incompressibility and symmetry energy values. Notably, higher dark matter Fermi momenta and masses result in more compact neutron star configurations with reduced radii and lower maximum masses, highlighting a complex interplay between dark matter and nuclear matter. Deviations from the universal relation are observed with dark matter inclusion, particularly for neutron stars with lower compactness. By leveraging observational data from PSR J0740+6620, GW170817, and Neutron star Interior Composition Explorer (NICER) measurements of PSR J0030+0451, we derive stringent constraints on dark matter parameter space within neutron stars, emphasizing the necessity of integrating multimodal observations to delineate the properties of dark matter along with neutron stars. Our findings underscore the importance of considering dark matter effects in neutron star modeling and suggest potential refinements for current theoretical frameworks to accurately predict neutron star properties under various astrophysical conditions.
△ Less
Submitted 27 August, 2024;
originally announced August 2024.
-
Generative Verifiers: Reward Modeling as Next-Token Prediction
Authors:
Lunjun Zhang,
Arian Hosseini,
Hritik Bansal,
Mehran Kazemi,
Aviral Kumar,
Rishabh Agarwal
Abstract:
Verifiers or reward models are often used to enhance the reasoning performance of large language models (LLMs). A common approach is the Best-of-N method, where N candidate solutions generated by the LLM are ranked by a verifier, and the best one is selected. While LLM-based verifiers are typically trained as discriminative classifiers to score solutions, they do not utilize the text generation ca…
▽ More
Verifiers or reward models are often used to enhance the reasoning performance of large language models (LLMs). A common approach is the Best-of-N method, where N candidate solutions generated by the LLM are ranked by a verifier, and the best one is selected. While LLM-based verifiers are typically trained as discriminative classifiers to score solutions, they do not utilize the text generation capabilities of pretrained LLMs. To overcome this limitation, we instead propose training verifiers using the ubiquitous next-token prediction objective, jointly on verification and solution generation. Compared to standard verifiers, such generative verifiers (GenRM) can benefit from several advantages of LLMs: they integrate seamlessly with instruction tuning, enable chain-of-thought reasoning, and can utilize additional inference-time compute via majority voting for better verification. We demonstrate that when using Gemma-based verifiers on algorithmic and grade-school math reasoning tasks, GenRM outperforms discriminative verifiers and LLM-as-a-Judge, showing a 16-64% improvement in the percentage of problems solved with Best-of-N. Furthermore, we show that GenRM scales favorably across dataset size, model capacity, and inference-time compute.
△ Less
Submitted 27 August, 2024;
originally announced August 2024.
-
Evaluating The Explainability of State-of-the-Art Machine Learning-based IoT Network Intrusion Detection Systems
Authors:
Ayush Kumar,
Vrizlynn L. L. Thing
Abstract:
Internet-of-Things (IoT) Network Intrusion Detection Systems (NIDSs) which use machine learning (ML) models achieve high detection performance and accuracy while avoiding dependence on fixed signatures extracted from attack artifacts. However, there is a noticeable hesitance among network security experts and practitioners when it comes to deploying ML-based NIDSs in real-world production environm…
▽ More
Internet-of-Things (IoT) Network Intrusion Detection Systems (NIDSs) which use machine learning (ML) models achieve high detection performance and accuracy while avoiding dependence on fixed signatures extracted from attack artifacts. However, there is a noticeable hesitance among network security experts and practitioners when it comes to deploying ML-based NIDSs in real-world production environments due to their black-box nature, i.e., how and why the underlying models make their decisions. In this work, we analyze state-of-the-art ML-based IoT NIDS models using explainable AI (xAI) techniques (e.g., TRUSTEE, SHAP). Using the explanations generated for the models' decisions, the most prominent features used by each NIDS model considered are presented. We compare the explanations generated across xAI methods for a given NIDS model as well as the explanations generated across the NIDS models for a given xAI method. Finally, we evaluate the vulnerability of each NIDS model to inductive bias (artifacts learnt from training data). The results show that: (1) some ML-based IoT NIDS models can be better explained than other models, (2) xAI explanations are in conflict for most of the IoT NIDS models considered in this work and (3) some IoT NIDS models are more vulnerable to inductive bias than other models.
△ Less
Submitted 26 August, 2024;
originally announced August 2024.
-
Modeling and Statistical Characterization of Large-Scale Automotive Radar Networks
Authors:
Mohammad Taha Shah,
Gourab Ghatak,
Ankit Kumar,
Shobha Sundar Ram
Abstract:
The impact of discrete clutter and co-channel interference on the performance of automotive radar networks has been studied using stochastic geometry, in particular, by leveraging two-dimensional Poisson point processes (PPPs). However, such characterization does not take into account the impact of street geometry and the fact that the location of the automotive radars are restricted to the street…
▽ More
The impact of discrete clutter and co-channel interference on the performance of automotive radar networks has been studied using stochastic geometry, in particular, by leveraging two-dimensional Poisson point processes (PPPs). However, such characterization does not take into account the impact of street geometry and the fact that the location of the automotive radars are restricted to the streets as their domain rather than the entire Euclidean plane. In addition, the structure of the streets may change drastically as a vehicle moves out of a city center towards the outskirts. Consequently, not only the radar performance change but also the radar parameters and protocols must be adapted for optimum performance. In this paper, we propose and characterize line and Cox process-based street and point models to analyze large-scale automotive radar networks. We consider the classical Poisson line process (PLP) and the newly introduced Binomial line process (BLP) model to emulate the streets and the corresponding PPP-based Cox process to emulate the vehicular nodes. In particular, the BLP model effectively considers the spatial variation of street geometry across different parts of the city. We derive the effective interference set experienced by an automotive radar, the statistics of distance to interferers, and characterize the detection probability of the ego radar as a function of street and vehicle density. Finally, leveraging the real-world data on urban streets and vehicle density across different cities of the world, we present how the radar performance varies in different parts of the city as well as across different times of the day. Thus, our study equips network operators and automotive manufacturers with essential system design insights to plan and optimize automotive radar networks.
△ Less
Submitted 28 August, 2024; v1 submitted 24 August, 2024;
originally announced August 2024.
-
End-point estimates of the totally-geodesic Radon transform on simply connected spaces of constant curvature: A Unified Approach
Authors:
Aniruddha Deshmukh,
Ashisha Kumar
Abstract:
In this article, we give a unified proof of the end-point estimates of the totally-geodesic $k$-plane transform of radial functions on spaces of constant curvature. The problem of getting end-point estimates is not new and some results are available in literature. However, these results were obtained independently without much focus on the similarities between underlying geometries. We give a unif…
▽ More
In this article, we give a unified proof of the end-point estimates of the totally-geodesic $k$-plane transform of radial functions on spaces of constant curvature. The problem of getting end-point estimates is not new and some results are available in literature. However, these results were obtained independently without much focus on the similarities between underlying geometries. We give a unified proof for the end-point estimates on spaces of constant curvature by making use of geometric ideas common to the spaces of constant curvature, and obtaining a unified formula for the $k$-plane transform of radial functions. We also give some inequalities for certain special functions as an application to one of our lemmata.
△ Less
Submitted 24 August, 2024;
originally announced August 2024.
-
An Overview and Comparison of Axiomatization Structures Regarding Inconsistency Indices' Properties in Pairwise Comparisons Methods
Authors:
Sangeeta Pant,
Anuj Kumar,
Jiří Mazurek
Abstract:
Mathematical analysis of the analytic hierarchy process (AHP) led to the development of a mathematical function, usually called the inconsistency index, which has the center role in measuring the inconsistency of the judgements in AHP. Inconsistency index is a mathematical function which maps every pairwise comparison matrix (PCM) into a real number. An inconsistency index can be considered more t…
▽ More
Mathematical analysis of the analytic hierarchy process (AHP) led to the development of a mathematical function, usually called the inconsistency index, which has the center role in measuring the inconsistency of the judgements in AHP. Inconsistency index is a mathematical function which maps every pairwise comparison matrix (PCM) into a real number. An inconsistency index can be considered more trustworthy when it satisfies a set of suitable properties. Therefore, the research community has been trying to postulate a set of desirable rules (axioms, properties) for inconsistency indices. Subsequently, many axiomatic frameworks for these functions have been suggested independently, however, the literature on the topic is fragmented and missing a broader framework. Therefore, the objective of this article is twofold. Firstly, we provide a comprehensive review of the advancements in the axiomatization of inconsistency indices' properties during the last decade. Secondly, we provide a comparison and discussion of the aforementioned axiomatic structures along with directions of the future research.
△ Less
Submitted 23 August, 2024;
originally announced August 2024.
-
Quantum Information Scrambling and Entanglement: An Elegant Mathematical Connection
Authors:
Kapil K. Sharma,
Rishikant Rajdeepak,
Ashok Kumar,
Prasanta K. Panigrahi
Abstract:
Studying the behavior of quantum information scrambling in various quantum systems is an active area of research. Recently, Sharma et al. [K.K. Sharma, V.P Gerdt, Quantum Inf. Process 20, 195 (2021)] have shown the mathematical connection between quantum information scrambling (QIS) and bipartite entanglement in non-thermal states. In the present work, we elegantly generalize this mathematical con…
▽ More
Studying the behavior of quantum information scrambling in various quantum systems is an active area of research. Recently, Sharma et al. [K.K. Sharma, V.P Gerdt, Quantum Inf. Process 20, 195 (2021)] have shown the mathematical connection between quantum information scrambling (QIS) and bipartite entanglement in non-thermal states. In the present work, we elegantly generalize this mathematical connection and study such connections in X-states, non-maximally entangled Bell states, and Werner states
△ Less
Submitted 23 August, 2024;
originally announced August 2024.
-
SAGE-RT: Synthetic Alignment data Generation for Safety Evaluation and Red Teaming
Authors:
Anurakt Kumar,
Divyanshu Kumar,
Jatan Loya,
Nitin Aravind Birur,
Tanay Baswa,
Sahil Agarwal,
Prashanth Harshangi
Abstract:
We introduce Synthetic Alignment data Generation for Safety Evaluation and Red Teaming (SAGE-RT or SAGE) a novel pipeline for generating synthetic alignment and red-teaming data. Existing methods fall short in creating nuanced and diverse datasets, providing necessary control over the data generation and validation processes, or require large amount of manually generated seed data. SAGE addresses…
▽ More
We introduce Synthetic Alignment data Generation for Safety Evaluation and Red Teaming (SAGE-RT or SAGE) a novel pipeline for generating synthetic alignment and red-teaming data. Existing methods fall short in creating nuanced and diverse datasets, providing necessary control over the data generation and validation processes, or require large amount of manually generated seed data. SAGE addresses these limitations by using a detailed taxonomy to produce safety-alignment and red-teaming data across a wide range of topics. We generated 51,000 diverse and in-depth prompt-response pairs, encompassing over 1,500 topics of harmfulness and covering variations of the most frequent types of jailbreaking prompts faced by large language models (LLMs). We show that the red-teaming data generated through SAGE jailbreaks state-of-the-art LLMs in more than 27 out of 32 sub-categories, and in more than 58 out of 279 leaf-categories (sub-sub categories). The attack success rate for GPT-4o, GPT-3.5-turbo is 100% over the sub-categories of harmfulness. Our approach avoids the pitfalls of synthetic safety-training data generation such as mode collapse and lack of nuance in the generation pipeline by ensuring a detailed coverage of harmful topics using iterative expansion of the topics and conditioning the outputs on the generated raw-text. This method can be used to generate red-teaming and alignment data for LLM Safety completely synthetically to make LLMs safer or for red-teaming the models over a diverse range of topics.
△ Less
Submitted 14 August, 2024;
originally announced August 2024.
-
Non-verbal Hands-free Control for Smart Glasses using Teeth Clicks
Authors:
Payal Mohapatra,
Ali Aroudi,
Anurag Kumar,
Morteza Khaleghimeybodi
Abstract:
Smart glasses are emerging as a popular wearable computing platform potentially revolutionizing the next generation of human-computer interaction. The widespread adoption of smart glasses has created a pressing need for discreet and hands-free control methods. Traditional input techniques, such as voice commands or tactile gestures, can be intrusive and non-discreet. Additionally, voice-based cont…
▽ More
Smart glasses are emerging as a popular wearable computing platform potentially revolutionizing the next generation of human-computer interaction. The widespread adoption of smart glasses has created a pressing need for discreet and hands-free control methods. Traditional input techniques, such as voice commands or tactile gestures, can be intrusive and non-discreet. Additionally, voice-based control may not function well in noisy acoustic conditions. We propose a novel, discreet, non-verbal, and non-tactile approach to controlling smart glasses through subtle vibrations on the skin induced by teeth clicking. We demonstrate that these vibrations can be sensed by accelerometers embedded in the glasses with a low-footprint predictive model. Our proposed method, called STEALTHsense, utilizes a temporal broadcasting-based neural network architecture with just 88K trainable parameters and 7.14M Multiply and Accumulate (MMAC) per inference unit. We benchmark our proposed STEALTHsense against state-of-the-art deep learning approaches and traditional low-footprint machine learning approaches. We conducted a study across 21 participants to collect representative samples for two distinct teeth-clicking patterns and many non-patterns for robust training of STEALTHsense, achieving an average cross-person accuracy of 0.93. Field testing confirmed its effectiveness, even in noisy conditions, underscoring STEALTHsense's potential for real-world applications, offering a promising solution for smart glasses interaction.
△ Less
Submitted 21 August, 2024;
originally announced August 2024.
-
DSP-MLIR: A MLIR Dialect for Digital Signal Processing
Authors:
Abhinav Kumar,
Atharva Khedkar,
Aviral Shrivastava
Abstract:
Traditional Digital Signal Processing ( DSP ) compilers work at low level ( C-level / assembly level ) and hence lose much of the optimization opportunities present at high-level ( domain-level ). The emerging multi-level compiler infrastructure MLIR ( Multi-level Intermediate Representation ) allows to specify optimizations at higher level. In this paper, we utilize MLIR framework to introduce a…
▽ More
Traditional Digital Signal Processing ( DSP ) compilers work at low level ( C-level / assembly level ) and hence lose much of the optimization opportunities present at high-level ( domain-level ). The emerging multi-level compiler infrastructure MLIR ( Multi-level Intermediate Representation ) allows to specify optimizations at higher level. In this paper, we utilize MLIR framework to introduce a DSP Dialect and perform domain-specific optimizations at dialect -level ( high-level ) and show the usefulness of these optimizations on sample DSP apps. In particular, we develop a compiler for DSP and a DSL (Domain Specific Language) to ease the development of apps. We show the performance improvement in execution time for these sample apps by upto 10x which would have been difficult if the IR were at C/ affine level.
△ Less
Submitted 20 August, 2024;
originally announced August 2024.
-
Phase-Based Approaches for Rapid Construction of Magnetic Fields in NV Magnetometry
Authors:
Prabhat Anand,
Ankit Khandelwal,
Achanna Anil Kumar,
M Girish Chandra,
Pavan K Reddy,
Anuj Bathla,
Dasika Shishir,
Kasturi Saha
Abstract:
With the second quantum revolution underway, quantum-enhanced sensors are moving from laboratory demonstrations to field deployments, providing enhanced and even new capabilities. Signal processing and operational software is becoming integral parts of these emerging sensing systems to reap the benefits of this progress. This paper looks into widefield Nitrogen Vacancy Center-based magnetometry an…
▽ More
With the second quantum revolution underway, quantum-enhanced sensors are moving from laboratory demonstrations to field deployments, providing enhanced and even new capabilities. Signal processing and operational software is becoming integral parts of these emerging sensing systems to reap the benefits of this progress. This paper looks into widefield Nitrogen Vacancy Center-based magnetometry and focuses on estimating the magnetic field from the Optically Detected Magnetic Resonances (ODMR) signal, a crucial output for various applications. Mapping the shifts of ODMR signals to phase estimation, a computationally efficient approaches are proposed. Involving Fourier Transform and Filtering as pre-processing steps, the suggested approaches involve linear curve fit or complex frequency estimation based on well-known super-resolution technique Estimation of Signal Parameters via Rotational Invariant Techniques (ESPRIT). The existing methods in the quantum sensing literature take different routes based on Lorentzian fitting for determining magnetic field maps. To showcase the functionality and effectiveness of the suggested techniques, relevant results, based on experimental data are provided, which shows a significant reduction in computational time with the proposed method over existing methods
△ Less
Submitted 22 August, 2024; v1 submitted 17 August, 2024;
originally announced August 2024.
-
Rage Music Classification and Analysis using K-Nearest Neighbour, Random Forest, Support Vector Machine, Convolutional Neural Networks, and Gradient Boosting
Authors:
Akul Kumar
Abstract:
We classify rage music (a subgenre of rap well-known for disagreements on whether a particular song is part of the genre) with an extensive feature set through algorithms including Random Forest, Support Vector Machine, K-nearest Neighbour, Gradient Boosting, and Convolutional Neural Networks. We compare methods of classification in the application of audio analysis with machine learning and ident…
▽ More
We classify rage music (a subgenre of rap well-known for disagreements on whether a particular song is part of the genre) with an extensive feature set through algorithms including Random Forest, Support Vector Machine, K-nearest Neighbour, Gradient Boosting, and Convolutional Neural Networks. We compare methods of classification in the application of audio analysis with machine learning and identify optimal models. We then analyze the significant audio features present in and most effective in categorizing rage music, while also identifying key audio features as well as broader separating sonic variations and trends.
△ Less
Submitted 20 August, 2024;
originally announced August 2024.
-
Deep Learning-based Classification of Dementia using Image Representation of Subcortical Signals
Authors:
Shivani Ranjan,
Ayush Tripathi,
Harshal Shende,
Robin Badal,
Amit Kumar,
Pramod Yadav,
Deepak Joshi,
Lalan Kumar
Abstract:
Dementia is a neurological syndrome marked by cognitive decline. Alzheimer's disease (AD) and Frontotemporal dementia (FTD) are the common forms of dementia, each with distinct progression patterns. EEG, a non-invasive tool for recording brain activity, has shown potential in distinguishing AD from FTD and mild cognitive impairment (MCI). Previous studies have utilized various EEG features, such a…
▽ More
Dementia is a neurological syndrome marked by cognitive decline. Alzheimer's disease (AD) and Frontotemporal dementia (FTD) are the common forms of dementia, each with distinct progression patterns. EEG, a non-invasive tool for recording brain activity, has shown potential in distinguishing AD from FTD and mild cognitive impairment (MCI). Previous studies have utilized various EEG features, such as subband power and connectivity patterns to differentiate these conditions. However, artifacts in EEG signals can obscure crucial information, necessitating advanced signal processing techniques. This study aims to develop a deep learning-based classification system for dementia by analyzing scout time-series signals from deep brain regions, specifically the hippocampus, amygdala, and thalamus. The study utilizes scout time series extracted via the standardized low-resolution brain electromagnetic tomography (sLORETA) technique. The time series is converted to image representations using continuous wavelet transform (CWT) and fed as input to deep learning models. Two high-density EEG datasets are utilized to check for the efficacy of the proposed method: the online BrainLat dataset (comprising AD, FTD, and healthy controls (HC)) and the in-house IITD-AIIA dataset (including subjects with AD, MCI, and HC). Different classification strategies and classifier combinations have been utilized for the accurate mapping of classes on both datasets. The best results were achieved by using a product of probabilities from classifiers for left and right subcortical regions in conjunction with the DenseNet model architecture. It yields accuracies of 94.17$\%$ and 77.72$\%$ on the BrainLat and IITD-AIIA datasets, respectively. This highlights the potential of this approach for early and accurate differentiation of neurodegenerative disorders.
△ Less
Submitted 20 August, 2024;
originally announced August 2024.
-
Moonshine: Distilling Game Content Generators into Steerable Generative Models
Authors:
Yuhe Nie,
Michael Middleton,
Tim Merino,
Nidhushan Kanagaraja,
Ashutosh Kumar,
Zhan Zhuang,
Julian Togelius
Abstract:
Procedural Content Generation via Machine Learning (PCGML) has enhanced game content creation, yet challenges in controllability and limited training data persist. This study addresses these issues by distilling a constructive PCG algorithm into a controllable PCGML model. We first generate a large amount of content with a constructive algorithm and label it using a Large Language Model (LLM). We…
▽ More
Procedural Content Generation via Machine Learning (PCGML) has enhanced game content creation, yet challenges in controllability and limited training data persist. This study addresses these issues by distilling a constructive PCG algorithm into a controllable PCGML model. We first generate a large amount of content with a constructive algorithm and label it using a Large Language Model (LLM). We use these synthetic labels to condition two PCGML models for content-specific generation, a diffusion model and the five-dollar model. This neural network distillation process ensures that the generation aligns with the original algorithm while introducing controllability through plain text. We define this text-conditioned PCGML as a Text-to-game-Map (T2M) task, offering an alternative to prevalent text-to-image multi-modal tasks. We compare our distilled models with the baseline constructive algorithm. Our analysis of the variety, accuracy, and quality of our generation demonstrates the efficacy of distilling constructive methods into controllable text-conditioned PCGML models.
△ Less
Submitted 18 August, 2024;
originally announced August 2024.
-
Correlation of Magnetic State Configurations in Nanotubes with FMR spectrum
Authors:
Abhishek Kumar,
Chirag Kalouni,
Raghvendra Posti,
Vivek K Malik,
Dhananjay Tiwari,
Debangsu Roy
Abstract:
Magnetic nanotubes have garnered immense attention for their potential in high-density magnetic memory, owing to their stable flux closure configuration and fast, reproducible reversal processes. However, characterizing their magnetic configuration through straightforward methodologies remains a challenge in both scope and detail. Here, we elucidate the magnetic state details using Remanence Field…
▽ More
Magnetic nanotubes have garnered immense attention for their potential in high-density magnetic memory, owing to their stable flux closure configuration and fast, reproducible reversal processes. However, characterizing their magnetic configuration through straightforward methodologies remains a challenge in both scope and detail. Here, we elucidate the magnetic state details using Remanence Field Ferromagnetic Resonance Spectroscopy (RFMR) for arrays of electrodeposited nanotubes. Micromagnetic simulations revealed distinct spin configurations while coming from saturation, including the edge vortex, onion, uniform and curling states, with chirality variations depending on the preparation field direction. Dynamic measurements, coupled with RFMR spectra analysis, unveiled multiple FMR modes corresponding to these spin configurations. The evolution of spin configurations under bias fields were studied, indicating nucleation within the curling state. Observations revealed opposite RFMR spectra, denoting opposite magnetic spin configurations after removing the positive and negative saturating fields when the magnetic field was applied along {theta_H=0} and perpendicular {theta_H= 90} to the nanotube axis. We observed a mixture of the non-uniform curling states with the end vortex state (onion-like curling state) at the end of the nanotubes for the theta_H=0(90) and uniform magnetization states in the middle of the nanotubes for the theta_H=0 configuration. Building on RFMR information, frequency-swept FMR absorption spectra obtained at different bias fields allowed the characterization of magnetization states. This picture was supported by micromagnetic simulations. These findings were further substantiated with First Order Reversal Curve measurements (FORC).
△ Less
Submitted 18 August, 2024;
originally announced August 2024.
-
Utility Optimal Scheduling with a Slow Time-Scale Index-Bias for Achieving Rate Guarantees in Cellular Networks
Authors:
Anurag Kumar,
Rajesh Sundaresan
Abstract:
One of the requirements of network slicing in 5G networks is RAN (radio access network) scheduling with rate guarantees. We study a three-time-scale algorithm for maximum sum utility scheduling, with minimum rate constraints. As usual, the scheduler computes an index for each UE in each slot, and schedules the UE with the maximum index. This is at the fastest, natural time-scale of channel fading.…
▽ More
One of the requirements of network slicing in 5G networks is RAN (radio access network) scheduling with rate guarantees. We study a three-time-scale algorithm for maximum sum utility scheduling, with minimum rate constraints. As usual, the scheduler computes an index for each UE in each slot, and schedules the UE with the maximum index. This is at the fastest, natural time-scale of channel fading. The next time-scale is of the exponentially weighted moving average (EWMA) rate update. The slowest time scale in our algorithm is an "index-bias" update by a stochastic approximation algorithm, with a step-size smaller than the EWMA. The index-biases are related to Lagrange multipliers, and bias the slot indices of the UEs with rate guarantees, promoting their more frequent scheduling. We obtain a pair of coupled ordinary differential equations (o.d.e.) such that the unique stable points of the two o.d.e.s are the primal and dual solutions of the constrained utility optimization problem. The UE rate and index-bias iterations track the asymptotic behaviour of the o.d.e. system for small step-sizes of the two slower time-scale iterations. Simulations show that, by running the index-bias iteration at a slower time-scale than the EWMA iteration and using the EWMA throughput itself in the index-bias update, the UE rates stabilize close to the optimum operating point on the rate region boundary, and the index-biases have small fluctuations around the optimum Lagrange multipliers. We compare our results with a prior two-time-scale algorithm and show improved performance.
△ Less
Submitted 17 August, 2024;
originally announced August 2024.
-
GLANCE: Graph-based Learnable Digital Twin for Communication Networks
Authors:
Boning Li,
Gunjan Verma,
Timofey Efimov,
Abhishek Kumar,
Santiago Segarra
Abstract:
As digital twins (DTs) to physical communication systems, network simulators can aid the design and deployment of communication networks. However, time-consuming simulations must be run for every new set of network configurations. Learnable digital twins (LDTs), in contrast, can be trained offline to emulate simulation outcomes and serve as a more efficient alternative to simulation-based DTs at r…
▽ More
As digital twins (DTs) to physical communication systems, network simulators can aid the design and deployment of communication networks. However, time-consuming simulations must be run for every new set of network configurations. Learnable digital twins (LDTs), in contrast, can be trained offline to emulate simulation outcomes and serve as a more efficient alternative to simulation-based DTs at runtime. In this work, we propose GLANCE, a communication LDT that learns from the simulator ns-3. It can evaluate network key performance indicators (KPIs) and assist in network management with exceptional efficiency. Leveraging graph learning, we exploit network data characteristics and devise a specialized architecture to embed sequential and topological features of traffic flows within the network. In addition, multi-task learning (MTL) and transfer learning (TL) are leveraged to enhance GLANCE's generalizability to unseen inputs and efficacy across different tasks. Beyond end-to-end KPI prediction, GLANCE can be deployed within an optimization framework for network management. It serves as an efficient or differentiable evaluator in optimizing network configurations such as traffic loads and flow destinations. Through numerical experiments and benchmarking, we verify the effectiveness of the proposed LDT architecture, demonstrate its robust generalization to various inputs, and showcase its efficacy in network management applications.
△ Less
Submitted 16 August, 2024;
originally announced August 2024.
-
A Factored MDP Approach To Moving Target Defense With Dynamic Threat Modeling and Cost Efficiency
Authors:
Megha Bose,
Praveen Paruchuri,
Akshat Kumar
Abstract:
Moving Target Defense (MTD) has emerged as a proactive and dynamic framework to counteract evolving cyber threats. Traditional MTD approaches often rely on assumptions about the attackers knowledge and behavior. However, real-world scenarios are inherently more complex, with adaptive attackers and limited prior knowledge of their payoffs and intentions. This paper introduces a novel approach to MT…
▽ More
Moving Target Defense (MTD) has emerged as a proactive and dynamic framework to counteract evolving cyber threats. Traditional MTD approaches often rely on assumptions about the attackers knowledge and behavior. However, real-world scenarios are inherently more complex, with adaptive attackers and limited prior knowledge of their payoffs and intentions. This paper introduces a novel approach to MTD using a Markov Decision Process (MDP) model that does not rely on predefined attacker payoffs. Our framework integrates the attackers real-time responses into the defenders MDP using a dynamic Bayesian Network. By employing a factored MDP model, we provide a comprehensive and realistic system representation. We also incorporate incremental updates to an attack response predictor as new data emerges. This ensures an adaptive and robust defense mechanism. Additionally, we consider the costs of switching configurations in MTD, integrating them into the reward structure to balance execution and defense costs. We first highlight the challenges of the problem through a theoretical negative result on regret. However, empirical evaluations demonstrate the frameworks effectiveness in scenarios marked by high uncertainty and dynamically changing attack landscapes.
△ Less
Submitted 16 August, 2024;
originally announced August 2024.
-
D5RL: Diverse Datasets for Data-Driven Deep Reinforcement Learning
Authors:
Rafael Rafailov,
Kyle Hatch,
Anikait Singh,
Laura Smith,
Aviral Kumar,
Ilya Kostrikov,
Philippe Hansen-Estruch,
Victor Kolev,
Philip Ball,
Jiajun Wu,
Chelsea Finn,
Sergey Levine
Abstract:
Offline reinforcement learning algorithms hold the promise of enabling data-driven RL methods that do not require costly or dangerous real-world exploration and benefit from large pre-collected datasets. This in turn can facilitate real-world applications, as well as a more standardized approach to RL research. Furthermore, offline RL methods can provide effective initializations for online finetu…
▽ More
Offline reinforcement learning algorithms hold the promise of enabling data-driven RL methods that do not require costly or dangerous real-world exploration and benefit from large pre-collected datasets. This in turn can facilitate real-world applications, as well as a more standardized approach to RL research. Furthermore, offline RL methods can provide effective initializations for online finetuning to overcome challenges with exploration. However, evaluating progress on offline RL algorithms requires effective and challenging benchmarks that capture properties of real-world tasks, provide a range of task difficulties, and cover a range of challenges both in terms of the parameters of the domain (e.g., length of the horizon, sparsity of rewards) and the parameters of the data (e.g., narrow demonstration data or broad exploratory data). While considerable progress in offline RL in recent years has been enabled by simpler benchmark tasks, the most widely used datasets are increasingly saturating in performance and may fail to reflect properties of realistic tasks. We propose a new benchmark for offline RL that focuses on realistic simulations of robotic manipulation and locomotion environments, based on models of real-world robotic systems, and comprising a variety of data sources, including scripted data, play-style data collected by human teleoperators, and other data sources. Our proposed benchmark covers state-based and image-based domains, and supports both offline RL and online fine-tuning evaluation, with some of the tasks specifically designed to require both pre-training and fine-tuning. We hope that our proposed benchmark will facilitate further progress on both offline RL and fine-tuning algorithms. Website with code, examples, tasks, and data is available at \url{https://sites.google.com/view/d5rl/}
△ Less
Submitted 15 August, 2024;
originally announced August 2024.
-
Bayesian Inference analysis of jet quenching using inclusive jet and hadron suppression measurements
Authors:
R. Ehlers,
Y. Chen,
J. Mulligan,
Y. Ji,
A. Kumar,
S. Mak,
P. M. Jacobs,
A. Majumder,
A. Angerami,
R. Arora,
S. A. Bass,
R. Datta,
L. Du,
H. Elfner,
R. J. Fries,
C. Gale,
Y. He,
B. V. Jacak,
S. Jeon,
F. Jonas,
L. Kasper,
M. Kordell II,
R. Kunnawalkam-Elayavalli,
J. Latessa,
Y. -J. Lee
, et al. (28 additional authors not shown)
Abstract:
The JETSCAPE Collaboration reports a new determination of the jet transport parameter $\hat{q}$ in the Quark-Gluon Plasma (QGP) using Bayesian Inference, incorporating all available inclusive hadron and jet yield suppression data measured in heavy-ion collisions at RHIC and the LHC. This multi-observable analysis extends the previously published JETSCAPE Bayesian Inference determination of…
▽ More
The JETSCAPE Collaboration reports a new determination of the jet transport parameter $\hat{q}$ in the Quark-Gluon Plasma (QGP) using Bayesian Inference, incorporating all available inclusive hadron and jet yield suppression data measured in heavy-ion collisions at RHIC and the LHC. This multi-observable analysis extends the previously published JETSCAPE Bayesian Inference determination of $\hat{q}$, which was based solely on a selection of inclusive hadron suppression data. JETSCAPE is a modular framework incorporating detailed dynamical models of QGP formation and evolution, and jet propagation and interaction in the QGP. Virtuality-dependent partonic energy loss in the QGP is modeled as a thermalized weakly-coupled plasma, with parameters determined from Bayesian calibration using soft-sector observables. This Bayesian calibration of $\hat{q}$ utilizes Active Learning, a machine--learning approach, for efficient exploitation of computing resources. The experimental data included in this analysis span a broad range in collision energy and centrality, and in transverse momentum. In order to explore the systematic dependence of the extracted parameter posterior distributions, several different calibrations are reported, based on combined jet and hadron data; on jet or hadron data separately; and on restricted kinematic or centrality ranges of the jet and hadron data. Tension is observed in comparison of these variations, providing new insights into the physics of jet transport in the QGP and its theoretical formulation.
△ Less
Submitted 28 August, 2024; v1 submitted 15 August, 2024;
originally announced August 2024.
-
Flexibility of Two-Dimensional Euler Flows with Integrable Vorticity
Authors:
Elia Bruè,
Maria Colombo,
Anuj Kumar
Abstract:
We propose a new convex integration scheme in fluid mechanics, and we provide an application to the two-dimensional Euler equations. We prove the flexibility and nonuniqueness of $L^\infty L^2$ weak solutions with vorticity in $L^\infty L^p$ for some $p>1$, surpassing for the first time the critical scaling of the standard convex integration technique.
To achieve this, we introduce several new i…
▽ More
We propose a new convex integration scheme in fluid mechanics, and we provide an application to the two-dimensional Euler equations. We prove the flexibility and nonuniqueness of $L^\infty L^2$ weak solutions with vorticity in $L^\infty L^p$ for some $p>1$, surpassing for the first time the critical scaling of the standard convex integration technique.
To achieve this, we introduce several new ideas, including:
(i) A new family of building blocks built from the Lamb-Chaplygin dipole.
(ii) A new method to cancel the error based on time averages and non-periodic, spatially-anisotropic perturbations.
△ Less
Submitted 15 August, 2024;
originally announced August 2024.
-
A study of bound states of $η, η^{'}, D^{0}$, $\bar{D^{0}}$, $B^{0}$, $\bar{B^{0}}$, $\bar{K^{0}}$ and $φ$ mesons with light and heavy nuclei within chiral SU(3) model
Authors:
Arvind Kumar,
Amruta Mishra
Abstract:
In the present work we explore the possibilities of the formation of bound states of neutral pseudoscalar mesons $η, η^{'}, D^{0}$, $\bar{D^{0}}, B^{0}, \bar{B^{0}}$ and $\bar{K^{0}}$ and the vector meson $φ$, with the nuclei $^{12}$C, $^{16}$O, $^{40}$Ca and $^{208}$Pb, calculating their binding energy and absorption decay width. To calculate the optical potentials of these mesons in different nu…
▽ More
In the present work we explore the possibilities of the formation of bound states of neutral pseudoscalar mesons $η, η^{'}, D^{0}$, $\bar{D^{0}}, B^{0}, \bar{B^{0}}$ and $\bar{K^{0}}$ and the vector meson $φ$, with the nuclei $^{12}$C, $^{16}$O, $^{40}$Ca and $^{208}$Pb, calculating their binding energy and absorption decay width. To calculate the optical potentials of these mesons in different nuclei under study, we shall use the chiral SU(3) hadronic mean field model, in which the properties of nucleons in the medium are modified through the scalar isoscalar fields $σ$ and $ζ$ and the scalar-isovector field $δ$. The scalar-isovector field $δ$ account for the finite isospin asymmetry of different nuclei having asymmetry in number of protons and neutrons. The binding energy and absorption decay width of mesons are calculated for the ground state and some of possible excited states of the nuclei. In the chiral SU(3) model, the mesons $ η, D^{0}$, $\bar{D^{0}}, B^{0}, \bar{B^{0}}$ and $\bar{K^{0}}$ are observed to have significant negative mass shift upto nuclear saturation density which lead to the possibility of the bound states at least for ground states and some of excited states in case of heavy nuclei. For the pseudoscalar singlet $η^{'}$ and the vector meson $φ$ the mass shift obtained are found to be small and bound states are not formed. The present calculations are compared with different studies available in the field and will be useful in understanding the outcomes from different experimental facilities focusing on this area of research.
△ Less
Submitted 14 August, 2024;
originally announced August 2024.
-
Pions valence quark distributions in asymmetric nuclear matter at finite temperature
Authors:
Satyajit Puhan,
Navpreet Kaur,
Arvind Kumar,
Suneel Dutt,
Harleen Dahiya
Abstract:
We have calculated the valence quark distributions of the lightest pseudoscalar meson, pions, in the isospin asymmetric nuclear matter at zero and finite temperature employing a light-cone quark model. The medium modifications in the pion properties have been stimulated through the effective quark masses computed using the chiral SU($3$) quark mean field model. We have primarily focused on the imp…
▽ More
We have calculated the valence quark distributions of the lightest pseudoscalar meson, pions, in the isospin asymmetric nuclear matter at zero and finite temperature employing a light-cone quark model. The medium modifications in the pion properties have been stimulated through the effective quark masses computed using the chiral SU($3$) quark mean field model. We have primarily focused on the impact of isospin asymmetric medium on the distribution amplitudes (DAs) and parton distribution functions (PDFs) of a valence quark for different baryon density and temperature values. Also, the DAs and PDFs have been evolved to $Q^2=10$ GeV$^2$ and $Q^2=16$ GeV$^2$ for different densities of nuclear medium and results have been compared with the available experimental data. The DAs and PDFs are found to modify substantially as a function of baryon density as compared to temperature and isospin asymmetry of the medium.
△ Less
Submitted 14 August, 2024;
originally announced August 2024.
-
Identifying Feedforward and Feedback Controllable Subspaces of Neural Population Dynamics
Authors:
Ankit Kumar,
Loren M. Frank,
Kristofer E. Bouchard
Abstract:
There is overwhelming evidence that cognition, perception, and action rely on feedback control. However, if and how neural population dynamics are amenable to different control strategies is poorly understood, in large part because machine learning methods to directly assess controllability in neural population dynamics are lacking. To address this gap, we developed a novel dimensionality reductio…
▽ More
There is overwhelming evidence that cognition, perception, and action rely on feedback control. However, if and how neural population dynamics are amenable to different control strategies is poorly understood, in large part because machine learning methods to directly assess controllability in neural population dynamics are lacking. To address this gap, we developed a novel dimensionality reduction method, Feedback Controllability Components Analysis (FCCA), that identifies subspaces of linear dynamical systems that are most feedback controllable based on a new measure of feedback controllability. We further show that PCA identifies subspaces of linear dynamical systems that maximize a measure of feedforward controllability. As such, FCCA and PCA are data-driven methods to identify subspaces of neural population data (approximated as linear dynamical systems) that are most feedback and feedforward controllable respectively, and are thus natural contrasts for hypothesis testing. We developed new theory that proves that non-normality of underlying dynamics determines the divergence between FCCA and PCA solutions, and confirmed this in numerical simulations. Applying FCCA to diverse neural population recordings, we find that feedback controllable dynamics are geometrically distinct from PCA subspaces and are better predictors of animal behavior. Our methods provide a novel approach towards analyzing neural population dynamics from a control theoretic perspective, and indicate that feedback controllable subspaces are important for behavior.
△ Less
Submitted 11 August, 2024;
originally announced August 2024.
-
Pulse excitation mode selection via AI Pipeline to Fully Automate the WUCT System
Authors:
Ankur Kumar,
Mayank Goswami
Abstract:
The parametric optimization for the ultrasound computed tomography system is introduced. It is hypothesized that the pulse characteristic directly affects the information present in the reconstructed profile. The ultrasound excitation modes based on pulse-width modifications are studied to estimate the effect on reconstruction quality. Studies show that the pulse width affects the response of the…
▽ More
The parametric optimization for the ultrasound computed tomography system is introduced. It is hypothesized that the pulse characteristic directly affects the information present in the reconstructed profile. The ultrasound excitation modes based on pulse-width modifications are studied to estimate the effect on reconstruction quality. Studies show that the pulse width affects the response of the transducer and, thus, the reconstruction. The ultrasound scanning parameters, mainly pulse width, are assessed and optimally set by an Artificial Intelligence driven process, according to the object without the requirement of a-priori information. The optimization study uses a novel intelligent object placement procedure to ensure repeatability of the same region of interest, a key requirement to minimize the error. Further, Kanpur Theorem 1 is implemented to evaluate the quality of the acquired projection data and discard inferior quality data. Scanning results corresponding to homogeneous and heterogeneous phantoms are presented. The image processing step involves deep learning model evaluating the dice coefficient for estimating the reconstruction quality if prior information about the inner profile is known or a classical error estimate otherwise. The models segmentation accuracy is 95.72 percentage and intersection over union score is 0.8842 on the validation dataset. The article also provides valuable insights about the development and low-level control of the system.
△ Less
Submitted 9 August, 2024;
originally announced August 2024.
-
Spherical World-Locking for Audio-Visual Localization in Egocentric Videos
Authors:
Heeseung Yun,
Ruohan Gao,
Ishwarya Ananthabhotla,
Anurag Kumar,
Jacob Donley,
Chao Li,
Gunhee Kim,
Vamsi Krishna Ithapu,
Calvin Murdock
Abstract:
Egocentric videos provide comprehensive contexts for user and scene understanding, spanning multisensory perception to behavioral interaction. We propose Spherical World-Locking (SWL) as a general framework for egocentric scene representation, which implicitly transforms multisensory streams with respect to measurements of head orientation. Compared to conventional head-locked egocentric represent…
▽ More
Egocentric videos provide comprehensive contexts for user and scene understanding, spanning multisensory perception to behavioral interaction. We propose Spherical World-Locking (SWL) as a general framework for egocentric scene representation, which implicitly transforms multisensory streams with respect to measurements of head orientation. Compared to conventional head-locked egocentric representations with a 2D planar field-of-view, SWL effectively offsets challenges posed by self-motion, allowing for improved spatial synchronization between input modalities. Using a set of multisensory embeddings on a worldlocked sphere, we design a unified encoder-decoder transformer architecture that preserves the spherical structure of the scene representation, without requiring expensive projections between image and world coordinate systems. We evaluate the effectiveness of the proposed framework on multiple benchmark tasks for egocentric video understanding, including audio-visual active speaker localization, auditory spherical source localization, and behavior anticipation in everyday activities.
△ Less
Submitted 9 August, 2024;
originally announced August 2024.
-
Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters
Authors:
Charlie Snell,
Jaehoon Lee,
Kelvin Xu,
Aviral Kumar
Abstract:
Enabling LLMs to improve their outputs by using more test-time computation is a critical step towards building generally self-improving agents that can operate on open-ended natural language. In this paper, we study the scaling of inference-time computation in LLMs, with a focus on answering the question: if an LLM is allowed to use a fixed but non-trivial amount of inference-time compute, how muc…
▽ More
Enabling LLMs to improve their outputs by using more test-time computation is a critical step towards building generally self-improving agents that can operate on open-ended natural language. In this paper, we study the scaling of inference-time computation in LLMs, with a focus on answering the question: if an LLM is allowed to use a fixed but non-trivial amount of inference-time compute, how much can it improve its performance on a challenging prompt? Answering this question has implications not only on the achievable performance of LLMs, but also on the future of LLM pretraining and how one should tradeoff inference-time and pre-training compute. Despite its importance, little research attempted to understand the scaling behaviors of various test-time inference methods. Moreover, current work largely provides negative results for a number of these strategies. In this work, we analyze two primary mechanisms to scale test-time computation: (1) searching against dense, process-based verifier reward models; and (2) updating the model's distribution over a response adaptively, given the prompt at test time. We find that in both cases, the effectiveness of different approaches to scaling test-time compute critically varies depending on the difficulty of the prompt. This observation motivates applying a "compute-optimal" scaling strategy, which acts to most effectively allocate test-time compute adaptively per prompt. Using this compute-optimal strategy, we can improve the efficiency of test-time compute scaling by more than 4x compared to a best-of-N baseline. Additionally, in a FLOPs-matched evaluation, we find that on problems where a smaller base model attains somewhat non-trivial success rates, test-time compute can be used to outperform a 14x larger model.
△ Less
Submitted 6 August, 2024;
originally announced August 2024.
-
Constraining gravitational wave velocities using gravitational and electromagnetic wave observations of white dwarf binaries
Authors:
Tian-Yong Cao,
Ankit Kumar,
Shu-Xu Yi
Abstract:
Although the general theory of relativity (GR) predicts that gravitational waves (GWs) have exactly the same propagation velocity as electromagnetic (EM) waves, many theories of gravity beyond GR expect otherwise. Accurate measurement of the difference in their propagation speed, or a tight constraint on it, could be crucial to validate or put limits on theories beyond GR. The proposed future spac…
▽ More
Although the general theory of relativity (GR) predicts that gravitational waves (GWs) have exactly the same propagation velocity as electromagnetic (EM) waves, many theories of gravity beyond GR expect otherwise. Accurate measurement of the difference in their propagation speed, or a tight constraint on it, could be crucial to validate or put limits on theories beyond GR. The proposed future space-borne GW detectors are poised to detect a substantial number of Galactic white dwarf binaries (GWDBs), which emit the GW as semi-monochromatic signals. Concurrently, these GWDBs can also be identified as optical variable sources. Here we proposed that allocating a GWDB's optical light curve and contemporaneous GW signal can be used to trace the difference between the velocity of GW and EM waves. Simulating GW and EM wave data from 14 verification binaries (VBs), our method constrains propagation-originated phase differences, limiting the discrepancy between the speed of light ($c$) and GW ($c_{GW}$). Through the utilization of LISA's design sensitivity and the current precision in optical observation on GWDB, our study reveals that a four-year observation of the 14 recognized VBs results in a joint constraint that confines $Δc/c$ ($Δc = c_{\mathrm{GW}} - c$) to the range of $-2.1\times10^{-12}$ and $4.8\times10^{-12}$. Additionally, by incorporating this constraint on $c_{\mathrm{GW}}$, we are able to establish boundaries for the mass of the graviton, limiting it to $m_{\mathrm{g}}\le3\times10^{-23}\,e\mathrm{V}/c^{2}$, and for the parameter associated with local Lorentz violation, $\bar{s}_{00}$, constrained within the range of $-3.4\times10^{-11}\le\bar{s}_{00}\le1.5\times10^{-11}$.
△ Less
Submitted 5 August, 2024;
originally announced August 2024.
-
Non-invasive imaging assisted CFD simulation of 4D multi-modal fluid flow using In-situ adaptor
Authors:
Vaishali Sharma,
Arpit Kumar,
Snehlata Shakya,
Mayank Goswami
Abstract:
X-ray Computed Tomography (CT) is used to recover the true surfaces of fluid channels and fed to simulation tool (ANSYS) to create accurate cyber environment. The simulation tool also receives CT-assisted multiphase fluid profiles (belonging to the instance just before the flow starts) as an initial condition.
This unique methodology is made possible by using a novel in-situ compact adaptor desi…
▽ More
X-ray Computed Tomography (CT) is used to recover the true surfaces of fluid channels and fed to simulation tool (ANSYS) to create accurate cyber environment. The simulation tool also receives CT-assisted multiphase fluid profiles (belonging to the instance just before the flow starts) as an initial condition.
This unique methodology is made possible by using a novel in-situ compact adaptor design is used to create fluid channels that can be placed inside any industrial X-ray CT and fulfill the above objective. It is integrated with an android based App to control the flow once placed inside CT. It is portable and compact enough: (a) to be placed inside various experimental environments, and (b) modular enough to be mounted with multi-modal systems simultaneously.
Two key parameters, (a) spatial distribution and (b) the air volume fraction, are measured using two different non-invasive imaging modalities: (a) Electrical Impedance Tomography (EIT) and (d) X-ray Computed Tomography (CT). Simulated outcomes are correlated with the experimental outcomes from both EIT and X-ray CT, showing an agreement of 85 to 98 percent, respectively. Time-averaged electrically conductive fluid flow profile obtained by EIT shows a match with mass mass-attenuated fluid profile obtained by X-ray CT, justifying the utility of an in-situ adaptor. CT assistance for CFD studies can be replaced by EIT assistance as former techniques: (a) scanning time may be relatively slower than the latter, (b) it does not require rotations, (c) economical, and (d) fluid channels need not be placed inside of shielded compartment thus improving practicality. The data of analysis is shared in this work.
Multimodal non-invasive imaging provides multiphase flow information, it also differentiates conductive, and mass-attenuated multiphase profiles at common cross-sections.
△ Less
Submitted 4 August, 2024;
originally announced August 2024.
-
MALADE: Orchestration of LLM-powered Agents with Retrieval Augmented Generation for Pharmacovigilance
Authors:
Jihye Choi,
Nils Palumbo,
Prasad Chalasani,
Matthew M. Engelhard,
Somesh Jha,
Anivarya Kumar,
David Page
Abstract:
In the era of Large Language Models (LLMs), given their remarkable text understanding and generation abilities, there is an unprecedented opportunity to develop new, LLM-based methods for trustworthy medical knowledge synthesis, extraction and summarization. This paper focuses on the problem of Pharmacovigilance (PhV), where the significance and challenges lie in identifying Adverse Drug Events (A…
▽ More
In the era of Large Language Models (LLMs), given their remarkable text understanding and generation abilities, there is an unprecedented opportunity to develop new, LLM-based methods for trustworthy medical knowledge synthesis, extraction and summarization. This paper focuses on the problem of Pharmacovigilance (PhV), where the significance and challenges lie in identifying Adverse Drug Events (ADEs) from diverse text sources, such as medical literature, clinical notes, and drug labels. Unfortunately, this task is hindered by factors including variations in the terminologies of drugs and outcomes, and ADE descriptions often being buried in large amounts of narrative text. We present MALADE, the first effective collaborative multi-agent system powered by LLM with Retrieval Augmented Generation for ADE extraction from drug label data. This technique involves augmenting a query to an LLM with relevant information extracted from text resources, and instructing the LLM to compose a response consistent with the augmented data. MALADE is a general LLM-agnostic architecture, and its unique capabilities are: (1) leveraging a variety of external sources, such as medical literature, drug labels, and FDA tools (e.g., OpenFDA drug information API), (2) extracting drug-outcome association in a structured format along with the strength of the association, and (3) providing explanations for established associations. Instantiated with GPT-4 Turbo or GPT-4o, and FDA drug label data, MALADE demonstrates its efficacy with an Area Under ROC Curve of 0.90 against the OMOP Ground Truth table of ADEs. Our implementation leverages the Langroid multi-agent LLM framework and can be found at https://github.com/jihyechoi77/malade.
△ Less
Submitted 3 August, 2024;
originally announced August 2024.
-
Responsive ML inference in multi-tenanted environments using AQUA
Authors:
Abhishek Vijaya Kumar,
Gianni Antichi,
Rachee Singh
Abstract:
Modern model serving engines infer prompts on large language models in batches. While batch processing prompts leads to high inference throughput, it delays responding to requests that do not fit in a batch, potentially starving them. We propose that fair scheduling prompts for inference by time-sharing GPUs cycles, instead of batch processing them, is key to preventing prompt starvation and achie…
▽ More
Modern model serving engines infer prompts on large language models in batches. While batch processing prompts leads to high inference throughput, it delays responding to requests that do not fit in a batch, potentially starving them. We propose that fair scheduling prompts for inference by time-sharing GPUs cycles, instead of batch processing them, is key to preventing prompt starvation and achieving responsive inference. However, time-shared prompt scheduling incurs the overhead of frequently paging dynamic context needed to infer a prompt back into GPU memory. Today, serving engines support paging inference context between GPU memory and the host DRAM. The overhead of transferring context from DRAM to GPU memory is high since it is lower-bounded by the limited PCIe bandwidth. We overcome this challenge by offloading inference context from a GPU to the memory of another GPU on the same server, connected via inter-GPU interconnects that support magnitudes higher bandwidth than PCIe. We achieve this by developing AQUA, a transparent and elastic GPU memory management framework for responsive LLM inference. We evaluate AQUA by hosting eight state-of-the-art large generative ML models of different modalities (e.g., text, audio, vision) on a server with 8 cutting-edge Nvidia A100 80G GPUs. Using representative inference workloads, we show that AQUA improves the responsiveness of LLM inference by 4X compared to the state-of-the-art and it improves LLM inference throughput over a single long prompt by 6X.
△ Less
Submitted 31 July, 2024; v1 submitted 30 July, 2024;
originally announced July 2024.
-
SSPACE Astrobiology Payload-1 (SAP-1)
Authors:
A Lokaveer,
Thomas Anjana,
Maliyekkal Yasir,
S Yogahariharan,
Akash Dewangan,
Saurabh Kishor Mahajan,
Sakshi Aravind Tembhurne,
Gunja Subhash Gupta,
Devashish Bhalla,
Anantha Datta Dhruva,
Aloke Kumar,
Koushik Viswanathan,
Vikram Khaire,
Anand Narayanan,
Priyadarshnam Hari
Abstract:
The SSPACE Astrobiology Payload (SAP) series, starting with the SAP-1 project is designed to conduct in-situ microbiology experiments in low earth orbit. This payload series aims to understand the behaviour of microbial organisms in space, particularly those critical for human health, and the corresponding effects due to microgravity and solar/galactic radiation. SAP-1 focuses on studying Bacillus…
▽ More
The SSPACE Astrobiology Payload (SAP) series, starting with the SAP-1 project is designed to conduct in-situ microbiology experiments in low earth orbit. This payload series aims to understand the behaviour of microbial organisms in space, particularly those critical for human health, and the corresponding effects due to microgravity and solar/galactic radiation. SAP-1 focuses on studying Bacillus clausii and Bacillus coagulans, bacteria beneficial to humans. It aims to provide a space laboratory for astrobiology experiments under microgravity conditions. The hardware developed for these experiments is indigenous and tailored to meet the unique requirements of autonomous microbiology experiments by controlling pressure, temperature, and nutrition flow to bacteria. A rotating platform, which forms the core design, is innovatively utilised to regulate the flow and mixing of nutrients with dormant bacteria. The technology demonstration models developed at SSPACE have yielded promising results, with ongoing efforts to refine, adapt for space conditions, and prepare for integration with nanosatellites or space modules. The anticipated payload will be compact, approximately 1U in size (10cm x 10cm x 10cm), consume less than 5W power, and offer flexibility for various microbiological studies.
△ Less
Submitted 30 July, 2024;
originally announced July 2024.
-
FL-DECO-BC: A Privacy-Preserving, Provably Secure, and Provenance-Preserving Federated Learning Framework with Decentralized Oracles on Blockchain for VANETs
Authors:
Sathwik Narkedimilli,
Rayachoti Arun Kumar,
N. V. Saran Kumar,
Ramapathruni Praneeth Reddy,
Pavan Kumar C
Abstract:
Vehicular Ad-Hoc Networks (VANETs) hold immense potential for improving traffic safety and efficiency. However, traditional centralized approaches for machine learning in VANETs raise concerns about data privacy and security. Federated Learning (FL) offers a solution that enables collaborative model training without sharing raw data. This paper proposes FL-DECO-BC as a novel privacy-preserving, pr…
▽ More
Vehicular Ad-Hoc Networks (VANETs) hold immense potential for improving traffic safety and efficiency. However, traditional centralized approaches for machine learning in VANETs raise concerns about data privacy and security. Federated Learning (FL) offers a solution that enables collaborative model training without sharing raw data. This paper proposes FL-DECO-BC as a novel privacy-preserving, provably secure, and provenance-preserving federated learning framework specifically designed for VANETs. FL-DECO-BC leverages decentralized oracles on blockchain to securely access external data sources while ensuring data privacy through advanced techniques. The framework guarantees provable security through cryptographic primitives and formal verification methods. Furthermore, FL-DECO-BC incorporates a provenance-preserving design to track data origin and history, fostering trust and accountability. This combination of features empowers VANETs with secure and privacy-conscious machine-learning capabilities, paving the way for advanced traffic management and safety applications.
△ Less
Submitted 30 July, 2024;
originally announced July 2024.
-
A Scalable Tool For Analyzing Genomic Variants Of Humans Using Knowledge Graphs and Machine Learning
Authors:
Shivika Prasanna,
Ajay Kumar,
Deepthi Rao,
Eduardo Simoes,
Praveen Rao
Abstract:
The integration of knowledge graphs and graph machine learning (GML) in genomic data analysis offers several opportunities for understanding complex genetic relationships, especially at the RNA level. We present a comprehensive approach for leveraging these technologies to analyze genomic variants, specifically in the context of RNA sequencing (RNA-seq) data from COVID-19 patient samples. The prop…
▽ More
The integration of knowledge graphs and graph machine learning (GML) in genomic data analysis offers several opportunities for understanding complex genetic relationships, especially at the RNA level. We present a comprehensive approach for leveraging these technologies to analyze genomic variants, specifically in the context of RNA sequencing (RNA-seq) data from COVID-19 patient samples. The proposed method involves extracting variant-level genetic information, annotating the data with additional metadata using SnpEff, and converting the enriched Variant Call Format (VCF) files into Resource Description Framework (RDF) triples. The resulting knowledge graph is further enhanced with patient metadata and stored in a graph database, facilitating efficient querying and indexing. We utilize the Deep Graph Library (DGL) to perform graph machine learning tasks, including node classification with GraphSAGE and Graph Convolutional Networks (GCNs). Our approach demonstrates significant utility using our proposed tool, VariantKG, in three key scenarios: enriching graphs with new VCF data, creating subgraphs based on user-defined features, and conducting graph machine learning for node classification.
△ Less
Submitted 30 July, 2024;
originally announced July 2024.
-
Successive ferroelectric orders and magnetoelectric coupling without long-range magnetic order in highly frustrated pyrochlore compounds: Sm$_2$Ti$_{2-x}$V$_x$O$_7$
Authors:
S. Mukherjee,
O. Ivashko,
S. Majumdar,
A. Kumar,
S. Giri
Abstract:
Sm$_2$Ti$_2$O$_7$, a member of rare-earth titanate pyrochlores, exhibits dipolar-octupolar antiferromagnetism below $T_N$ = 0.35 K. We observed two ferroelectric transitions at 182 ($T_{FE1}$) and 52 K ($T_{FE2}$), significantly higher than $T_N$ for Sm$_2$Ti$_{2-x}$V$_x$O$_7$ ($x$ = 0, 0.1). Although the ferroelectric transition temperatures remain unchanged, the polarization value decreases cons…
▽ More
Sm$_2$Ti$_2$O$_7$, a member of rare-earth titanate pyrochlores, exhibits dipolar-octupolar antiferromagnetism below $T_N$ = 0.35 K. We observed two ferroelectric transitions at 182 ($T_{FE1}$) and 52 K ($T_{FE2}$), significantly higher than $T_N$ for Sm$_2$Ti$_{2-x}$V$_x$O$_7$ ($x$ = 0, 0.1). Although the ferroelectric transition temperatures remain unchanged, the polarization value decreases considerably with V doping. A structural transition to a polar $R3m$ rhombohedral phase from the cubic $Fd\bar{3}m$ structure occurs at $T_{FE1}$, involving a distortion in the pyochlore lattice. Remarkably, significant linear magnetoelectric coupling is observed in both compounds, with further enhancement of magnetoelectric coupling due to magnetic V doping. The existence of magnetoelectric coupling without long-range magnetic order in a frustrated pyrochlore system could enable the tailoring of magnetoelectric coupling properties, which can be further fine-tuned through V doping. The emergence of ferroelectricity in a frustrated magnetic system introduces an intriguing aspect to these compounds and paves the way for developing ferroelectric order driven by the alleviation of magnetic frustration in pyrochlore systems.
△ Less
Submitted 29 July, 2024;
originally announced July 2024.
-
RePLAy: Remove Projective LiDAR Depthmap Artifacts via Exploiting Epipolar Geometry
Authors:
Shengjie Zhu,
Girish Chandar Ganesan,
Abhinav Kumar,
Xiaoming Liu
Abstract:
3D sensing is a fundamental task for Autonomous Vehicles. Its deployment often relies on aligned RGB cameras and LiDAR. Despite meticulous synchronization and calibration, systematic misalignment persists in LiDAR projected depthmap. This is due to the physical baseline distance between the two sensors. The artifact is often reflected as background LiDAR incorrectly projected onto the foreground,…
▽ More
3D sensing is a fundamental task for Autonomous Vehicles. Its deployment often relies on aligned RGB cameras and LiDAR. Despite meticulous synchronization and calibration, systematic misalignment persists in LiDAR projected depthmap. This is due to the physical baseline distance between the two sensors. The artifact is often reflected as background LiDAR incorrectly projected onto the foreground, such as cars and pedestrians. The KITTI dataset uses stereo cameras as a heuristic solution to remove artifacts. However most AV datasets, including nuScenes, Waymo, and DDAD, lack stereo images, making the KITTI solution inapplicable. We propose RePLAy, a parameter-free analytical solution to remove the projective artifacts. We construct a binocular vision system between a hypothesized virtual LiDAR camera and the RGB camera. We then remove the projective artifacts by determining the epipolar occlusion with the proposed analytical solution. We show unanimous improvement in the State-of-The-Art (SoTA) monocular depth estimators and 3D object detectors with the artifacts-free depthmaps.
△ Less
Submitted 26 July, 2024;
originally announced July 2024.
-
Central limit theorem and moderate deviation principle for the stochastic generalized Burgers-Huxley equation with multiplicative noise
Authors:
Vivek Kumar,
Ankit Kumar,
Manil T. Mohan
Abstract:
In this work, we investigate the Central Limit Theorem (CLT) and Moderate Deviation Principle (MDP) for the stochastic generalized Burgers-Huxley (SGBH) equation with multiplicative Gaussian noise. The SGBH equation is a diffusion-convection-reaction type equation which consists a nonlinearity of polynomial order, and we take into account of an infinite-dimensional noise having a coefficient that…
▽ More
In this work, we investigate the Central Limit Theorem (CLT) and Moderate Deviation Principle (MDP) for the stochastic generalized Burgers-Huxley (SGBH) equation with multiplicative Gaussian noise. The SGBH equation is a diffusion-convection-reaction type equation which consists a nonlinearity of polynomial order, and we take into account of an infinite-dimensional noise having a coefficient that has linear growth. We first prove the CLT which allows us to establish the convergence of the distribution of the solution to a re-scaled SGBH equation to a desired distribution function. Furthermore, we extend our asymptotic analysis by investigating the MDP for the SGBH equation. Using the weak convergence method, we establish the MDP and derive the corresponding rate function.
△ Less
Submitted 26 July, 2024;
originally announced July 2024.
-
Generative AI Augmented Induction-based Formal Verification
Authors:
Aman Kumar,
Deepak Narayan Gadde
Abstract:
Generative Artificial Intelligence (GenAI) has demonstrated its capabilities in the present world that reduce human effort significantly. It utilizes deep learning techniques to create original and realistic content in terms of text, images, code, music, and video. Researchers have also shown the capabilities of modern Large Language Models (LLMs) used by GenAI models that can be used to aid hardw…
▽ More
Generative Artificial Intelligence (GenAI) has demonstrated its capabilities in the present world that reduce human effort significantly. It utilizes deep learning techniques to create original and realistic content in terms of text, images, code, music, and video. Researchers have also shown the capabilities of modern Large Language Models (LLMs) used by GenAI models that can be used to aid hardware development. Formal verification is a mathematical-based proof method used to exhaustively verify the correctness of a design. In this paper, we demonstrate how GenAI can be used in induction-based formal verification to increase the verification throughput.
△ Less
Submitted 18 July, 2024;
originally announced July 2024.
-
GERry: A Code to Optimise the Hunt for the Electromagnetic Counter-parts to Gravitational Wave Events
Authors:
David O'Neill,
Joseph Lyman,
Kendall Ackley,
Danny Steeghs,
Duncan Galloway,
Vik Dhillon,
Paul O'Brien,
Gavin Ramsay,
Kanthanakorn Noysena,
Rubina Kotak,
Rene Breton,
Laura Nuttall,
Enric Pallé,
Don Pollacco,
Krzysztof Ulaczyk,
Martin Dyer,
Felipe Jiménez-Ibarra,
Tom Killestein,
Amit Kumar,
Lisa Kelsey,
Ben Godson,
Dan Jarvis
Abstract:
The search for the electromagnetic counterparts to gravitational wave (GW) events has been rapidly gathering pace in recent years thanks to the increasing number and capabilities of both gravitational wave detectors and wide field survey telescopes. Difficulties remain, however, in detecting these counterparts due to their inherent scarcity, faintness and rapidly evolving nature. To find these cou…
▽ More
The search for the electromagnetic counterparts to gravitational wave (GW) events has been rapidly gathering pace in recent years thanks to the increasing number and capabilities of both gravitational wave detectors and wide field survey telescopes. Difficulties remain, however, in detecting these counterparts due to their inherent scarcity, faintness and rapidly evolving nature. To find these counterparts, it is important that one optimises the observing strategy for their recovery. This can be difficult due to the large number of potential variables at play. Such follow-up campaigns are also capable of detecting hundreds or potentially thousands of unrelated transients, particularly for GW events with poor localisation. Even if the observations are capable of detecting a counterpart, finding it among the numerous contaminants can prove challenging. Here we present the Gravitational wave Electromagnetic RecovRY code (GERry) to perform detailed analysis and survey-agnostic quantification of observing campaigns attempting to recover electromagnetic counterparts. GERry considers the campaign's spatial, temporal and wavelength coverage, in addition to Galactic extinction and the expected counterpart light curve evolution from the GW 3D localisation volume. It returns quantified statistics that can be used to: determine the probability of having detected the counterpart, identify the most promising sources, and assess and refine strategy. Here we demonstrate the code to look at the performance and parameter space probed by current and upcoming wide-field surveys such as GOTO & VRO.
△ Less
Submitted 29 July, 2024; v1 submitted 26 July, 2024;
originally announced July 2024.
-
Recursive Introspection: Teaching Language Model Agents How to Self-Improve
Authors:
Yuxiao Qu,
Tianjun Zhang,
Naman Garg,
Aviral Kumar
Abstract:
A central piece in enabling intelligent agentic behavior in foundation models is to make them capable of introspecting upon their behavior, reasoning, and correcting their mistakes as more computation or interaction is available. Even the strongest proprietary large language models (LLMs) do not quite exhibit the ability of continually improving their responses sequentially, even in scenarios wher…
▽ More
A central piece in enabling intelligent agentic behavior in foundation models is to make them capable of introspecting upon their behavior, reasoning, and correcting their mistakes as more computation or interaction is available. Even the strongest proprietary large language models (LLMs) do not quite exhibit the ability of continually improving their responses sequentially, even in scenarios where they are explicitly told that they are making a mistake. In this paper, we develop RISE: Recursive IntroSpEction, an approach for fine-tuning LLMs to introduce this capability, despite prior work hypothesizing that this capability may not be possible to attain. Our approach prescribes an iterative fine-tuning procedure, which attempts to teach the model how to alter its response after having executed previously unsuccessful attempts to solve a hard test-time problem, with optionally additional environment feedback. RISE poses fine-tuning for a single-turn prompt as solving a multi-turn Markov decision process (MDP), where the initial state is the prompt. Inspired by principles in online imitation learning and reinforcement learning, we propose strategies for multi-turn data collection and training so as to imbue an LLM with the capability to recursively detect and correct its previous mistakes in subsequent iterations. Our experiments show that RISE enables Llama2, Llama3, and Mistral models to improve themselves with more turns on math reasoning tasks, outperforming several single-turn strategies given an equal amount of inference-time computation. We also find that RISE scales well, often attaining larger benefits with more capable models. Our analysis shows that RISE makes meaningful improvements to responses to arrive at the correct solution for challenging prompts, without disrupting one-turn abilities as a result of expressing more complex distributions.
△ Less
Submitted 26 July, 2024; v1 submitted 25 July, 2024;
originally announced July 2024.
-
A soft-hard framework with exact four momentum conservation for small systems
Authors:
I. Soudi,
W. Zhao,
A. Majumder,
C. Shen,
J. H. Putschke,
B. Boudreaux,
A. Angerami,
R. Arora,
S. A. Bass,
Y. Chen,
R. Datta,
L. Du,
R. Ehlers,
H. Elfner,
R. J. Fries,
C. Gale,
Y. He,
B. V. Jacak,
P. M. Jacobs,
S. Jeon,
Y. Ji,
L. Kasper,
M. Kelsey,
M. Kordell II,
A. Kumar
, et al. (28 additional authors not shown)
Abstract:
A new framework, called x-scape, for the combined study of both hard and soft transverse momentum sectors in high energy proton-proton ($p$-$p$) and proton-nucleus ($p$-$A$) collisions is set up. A dynamical initial state is set up using the 3d-Glauber model with transverse locations of hotspots within each incoming nucleon. A hard scattering that emanates from two colliding hotspots is carried ou…
▽ More
A new framework, called x-scape, for the combined study of both hard and soft transverse momentum sectors in high energy proton-proton ($p$-$p$) and proton-nucleus ($p$-$A$) collisions is set up. A dynamical initial state is set up using the 3d-Glauber model with transverse locations of hotspots within each incoming nucleon. A hard scattering that emanates from two colliding hotspots is carried out using the Pythia generator. Initial state radiation from the incoming hard partons is carried out in a new module called I-matter, which includes the longitudinal location of initial splits. The energy-momentum of both the initial hard partons and their associated beam remnants is removed from the hot spots, depleting the energy-momentum available for the formation of the bulk medium. Outgoing showers are simulated using the matter generator, and results are presented for both cases, allowing for and not allowing for energy loss. First comparisons between this hard-soft model and single inclusive hadron and jet data from $p$-$p$ and minimum bias $p$-$Pb$ collisions are presented. Single hadron spectra in $p$-$p$ are used to carry out a limited (in number of parameters) Bayesian calibration of the model. Fair comparisons with data are indicative of the utility of this new framework. Theoretical studies of the correlation between jet $p_T$ and event activity at mid and forward rapidity are carried out.
△ Less
Submitted 24 July, 2024;
originally announced July 2024.
-
The Gravitational-wave Optical Transient Observer (GOTO)
Authors:
Martin J. Dyer,
Kendall Ackley,
Felipe Jiménez-Ibarra,
Joseph Lyman,
Krzysztof Ulaczyk,
Danny Steeghs,
Duncan K. Galloway,
Vik S. Dhillon,
Paul O'Brien,
Gavin Ramsay,
Kanthanakorn Noysena,
Rubina Kotak,
Rene Breton,
Laura Nuttall,
Enric Pallé,
Don Pollacco,
Tom Killestein,
Amit Kumar,
David O'Neill,
Lisa Kelsey,
Ben Godson,
Dan Jarvis
Abstract:
The Gravitational-wave Optical Transient Observer (GOTO) is a project dedicated to identifying optical counter-parts to gravitational-wave detections using a network of dedicated, wide-field telescopes. After almost a decade of design, construction, and commissioning work, the GOTO network is now fully operational with two antipodal sites: La Palma in the Canary Islands and Siding Spring in Austra…
▽ More
The Gravitational-wave Optical Transient Observer (GOTO) is a project dedicated to identifying optical counter-parts to gravitational-wave detections using a network of dedicated, wide-field telescopes. After almost a decade of design, construction, and commissioning work, the GOTO network is now fully operational with two antipodal sites: La Palma in the Canary Islands and Siding Spring in Australia. Both sites host two independent robotic mounts, each with a field-of-view of 44 square degrees formed by an array of eight 40 cm telescopes, resulting in an instantaneous 88 square degree field-of-view per site. All four telescopes operate as a single integrated network, with the ultimate aim of surveying the entire sky every 2-3 days and allowing near-24-hour response to transient events within a minute of their detection. In the modern era of transient astronomy, automated telescopes like GOTO form a vital link between multi-messenger discovery facilities and in-depth follow-up by larger telescopes. GOTO is already producing a wide range of scientific results, assisted by an efficient discovery pipeline and a successful citizen science project: Kilonova Seekers.
△ Less
Submitted 24 July, 2024;
originally announced July 2024.
-
A Multitask Deep Learning Model for Classification and Regression of Hyperspectral Images: Application to the large-scale dataset
Authors:
Koushikey Chhapariya,
Alexandre Benoit,
Krishna Mohan Buddhiraju,
Anil Kumar
Abstract:
Multitask learning is a widely recognized technique in the field of computer vision and deep learning domain. However, it is still a research question in remote sensing, particularly for hyperspectral imaging. Moreover, most of the research in the remote sensing domain focuses on small and single-task-based annotated datasets, which limits the generalizability and scalability of the developed mode…
▽ More
Multitask learning is a widely recognized technique in the field of computer vision and deep learning domain. However, it is still a research question in remote sensing, particularly for hyperspectral imaging. Moreover, most of the research in the remote sensing domain focuses on small and single-task-based annotated datasets, which limits the generalizability and scalability of the developed models to more diverse and complex real-world scenarios. Thus, in this study, we propose a multitask deep learning model designed to perform multiple classification and regression tasks simultaneously on hyperspectral images. We validated our approach on a large hyperspectral dataset called TAIGA, which contains 13 forest variables, including three categorical variables and ten continuous variables with different biophysical parameters. We design a sharing encoder and task-specific decoder network to streamline feature learning while allowing each task-specific decoder to focus on the unique aspects of its respective task.
Additionally, a dense atrous pyramid pooling layer and attention network were integrated to extract multi-scale contextual information and enable selective information processing by prioritizing task-specific features. Further, we computed multitask loss and optimized its parameters for the proposed framework to improve the model performance and efficiency across diverse tasks. A comprehensive qualitative and quantitative analysis of the results shows that the proposed method significantly outperforms other state-of-the-art methods. We trained our model across 10 seeds/trials to ensure robustness. Our proposed model demonstrates higher mean performance while maintaining lower or equivalent variability. To make the work reproducible, the codes will be available at https://github.com/Koushikey4596/Multitask-Deep-Learning-Model-for-Taiga-datatset.
△ Less
Submitted 23 July, 2024;
originally announced July 2024.
-
Family of Quantum Mutual Information and Interaction Information in Multiparty Quantum Systems
Authors:
Asutosh Kumar
Abstract:
Characterizing information in a multiparty system is crucial but cumbersome. We extend the notion of conditional mutual information to multiparty systems and introduce a family of genuinely multiparty quantum mutual information. The two versions of multiparty quantum mutual information known in the literature are part of this family. We also conjecture them to qualify for secrecy monotones useful…
▽ More
Characterizing information in a multiparty system is crucial but cumbersome. We extend the notion of conditional mutual information to multiparty systems and introduce a family of genuinely multiparty quantum mutual information. The two versions of multiparty quantum mutual information known in the literature are part of this family. We also conjecture them to qualify for secrecy monotones useful in quantum cryptography. We give interpretations and discuss their properties and some unresolved issues.
△ Less
Submitted 25 July, 2024; v1 submitted 23 July, 2024;
originally announced July 2024.
-
MHD activity induced coherent mode excitation in the edge plasma region of ADITYA-U Tokamak
Authors:
Kaushlender Singh,
Suman Dolui,
Bharat Hegde,
Lavkesh Lachhvani,
Sharvil Patel,
Injamul Hoque,
Ashok K. Kumawat,
Ankit Kumar,
Tanmay Macwan,
Harshita Raj,
Soumitra Banerjee,
Komal Yadav,
Abha Kanik,
Pramila Gautam,
Rohit Kumar,
Suman Aich,
Laxmikanta Pradhan,
Ankit Patel,
Kalpesh Galodiya,
Daniel Raju,
S. K. Jha,
K. A. Jadeja,
K. M. Patel,
S. N. Pandya,
M. B. Chaudhary
, et al. (6 additional authors not shown)
Abstract:
In this paper, we report the excitation of coherent density and potential fluctuations induced by magnetohydrodynamic (MHD) activity in the edge plasma region of ADITYA-U Tokamak. When the amplitude of the MHD mode, mainly the m/n = 2/1, increases beyond a threshold value of 0.3-0.4 %, coherent oscillations in the density and potential fluctuations are observed having the same frequency as that of…
▽ More
In this paper, we report the excitation of coherent density and potential fluctuations induced by magnetohydrodynamic (MHD) activity in the edge plasma region of ADITYA-U Tokamak. When the amplitude of the MHD mode, mainly the m/n = 2/1, increases beyond a threshold value of 0.3-0.4 %, coherent oscillations in the density and potential fluctuations are observed having the same frequency as that of the MHD mode. The mode numbers of these MHD induced density and potential fluctuations are obtained by Langmuir probes placed at different radial, poloidal, and toroidal locations in the edge plasma region. Detailed analyses of these Langmuir probe measurements reveal that the coherent mode in edge potential fluctuation has a mode structure of m/n = 2/1 whereas the edge density fluctuation has an m/n = 1/1 structure. It is further observed that beyond the threshold, the coupled power fraction scales almost linearly with the magnitude of magnetic fluctuations. Furthermore, the rise rates of the coupled power fraction for coherent modes in density and potential fluctuations are also found to be dependent on the growth rate of magnetic fluctuations. The disparate mode structures of the excited modes in density and plasma potential fluctuations suggest that the underlying mechanism for their existence is most likely due to the excitation of the global high-frequency branch of zonal flows occurring through the coupling of even harmonics of potential to the odd harmonics of pressure due to 1/R dependence of the toroidal magnetic field.
△ Less
Submitted 23 July, 2024;
originally announced July 2024.
-
Uncertainty-Aware Deep Neural Representations for Visual Analysis of Vector Field Data
Authors:
Atul Kumar,
Siddharth Garg,
Soumya Dutta
Abstract:
The widespread use of Deep Neural Networks (DNNs) has recently resulted in their application to challenging scientific visualization tasks. While advanced DNNs demonstrate impressive generalization abilities, understanding factors like prediction quality, confidence, robustness, and uncertainty is crucial. These insights aid application scientists in making informed decisions. However, DNNs lack i…
▽ More
The widespread use of Deep Neural Networks (DNNs) has recently resulted in their application to challenging scientific visualization tasks. While advanced DNNs demonstrate impressive generalization abilities, understanding factors like prediction quality, confidence, robustness, and uncertainty is crucial. These insights aid application scientists in making informed decisions. However, DNNs lack inherent mechanisms to measure prediction uncertainty, prompting the creation of distinct frameworks for constructing robust uncertainty-aware models tailored to various visualization tasks. In this work, we develop uncertainty-aware implicit neural representations to model steady-state vector fields effectively. We comprehensively evaluate the efficacy of two principled deep uncertainty estimation techniques: (1) Deep Ensemble and (2) Monte Carlo Dropout, aimed at enabling uncertainty-informed visual analysis of features within steady vector field data. Our detailed exploration using several vector data sets indicate that uncertainty-aware models generate informative visualization results of vector field features. Furthermore, incorporating prediction uncertainty improves the resilience and interpretability of our DNN model, rendering it applicable for the analysis of non-trivial vector field data sets.
△ Less
Submitted 10 August, 2024; v1 submitted 22 July, 2024;
originally announced July 2024.
-
TaskGen: A Task-Based, Memory-Infused Agentic Framework using StrictJSON
Authors:
John Chong Min Tan,
Prince Saroj,
Bharat Runwal,
Hardik Maheshwari,
Brian Lim Yi Sheng,
Richard Cottrill,
Alankrit Chona,
Ambuj Kumar,
Mehul Motani
Abstract:
TaskGen is an open-sourced agentic framework which uses an Agent to solve an arbitrary task by breaking them down into subtasks. Each subtask is mapped to an Equipped Function or another Agent to execute. In order to reduce verbosity (and hence token usage), TaskGen uses StrictJSON that ensures JSON output from the Large Language Model (LLM), along with additional features such as type checking an…
▽ More
TaskGen is an open-sourced agentic framework which uses an Agent to solve an arbitrary task by breaking them down into subtasks. Each subtask is mapped to an Equipped Function or another Agent to execute. In order to reduce verbosity (and hence token usage), TaskGen uses StrictJSON that ensures JSON output from the Large Language Model (LLM), along with additional features such as type checking and iterative error correction. Key to the philosophy of TaskGen is the management of information/memory on a need-to-know basis. We empirically evaluate TaskGen on various environments such as 40x40 dynamic maze navigation with changing obstacle locations (100% solve rate), TextWorld escape room solving with dense rewards and detailed goals (96% solve rate), web browsing (69% of actions successful), solving the MATH dataset (71% solve rate over 100 Level-5 problems), Retrieval Augmented Generation on NaturalQuestions dataset (F1 score of 47.03%)
△ Less
Submitted 22 July, 2024;
originally announced July 2024.
-
WTS: A Pedestrian-Centric Traffic Video Dataset for Fine-grained Spatial-Temporal Understanding
Authors:
Quan Kong,
Yuki Kawana,
Rajat Saini,
Ashutosh Kumar,
Jingjing Pan,
Ta Gu,
Yohei Ozao,
Balazs Opra,
David C. Anastasiu,
Yoichi Sato,
Norimasa Kobori
Abstract:
In this paper, we address the challenge of fine-grained video event understanding in traffic scenarios, vital for autonomous driving and safety. Traditional datasets focus on driver or vehicle behavior, often neglecting pedestrian perspectives. To fill this gap, we introduce the WTS dataset, highlighting detailed behaviors of both vehicles and pedestrians across over 1.2k video events in hundreds…
▽ More
In this paper, we address the challenge of fine-grained video event understanding in traffic scenarios, vital for autonomous driving and safety. Traditional datasets focus on driver or vehicle behavior, often neglecting pedestrian perspectives. To fill this gap, we introduce the WTS dataset, highlighting detailed behaviors of both vehicles and pedestrians across over 1.2k video events in hundreds of traffic scenarios. WTS integrates diverse perspectives from vehicle ego and fixed overhead cameras in a vehicle-infrastructure cooperative environment, enriched with comprehensive textual descriptions and unique 3D Gaze data for a synchronized 2D/3D view, focusing on pedestrian analysis. We also pro-vide annotations for 5k publicly sourced pedestrian-related traffic videos. Additionally, we introduce LLMScorer, an LLM-based evaluation metric to align inference captions with ground truth. Using WTS, we establish a benchmark for dense video-to-text tasks, exploring state-of-the-art Vision-Language Models with an instance-aware VideoLLM method as a baseline. WTS aims to advance fine-grained video event understanding, enhancing traffic safety and autonomous driving development.
△ Less
Submitted 21 July, 2024;
originally announced July 2024.
-
The Group Robustness is in the Details: Revisiting Finetuning under Spurious Correlations
Authors:
Tyler LaBonte,
John C. Hill,
Xinchen Zhang,
Vidya Muthukumar,
Abhishek Kumar
Abstract:
Modern machine learning models are prone to over-reliance on spurious correlations, which can often lead to poor performance on minority groups. In this paper, we identify surprising and nuanced behavior of finetuned models on worst-group accuracy via comprehensive experiments on four well-established benchmarks across vision and language tasks. We first show that the commonly used class-balancing…
▽ More
Modern machine learning models are prone to over-reliance on spurious correlations, which can often lead to poor performance on minority groups. In this paper, we identify surprising and nuanced behavior of finetuned models on worst-group accuracy via comprehensive experiments on four well-established benchmarks across vision and language tasks. We first show that the commonly used class-balancing techniques of mini-batch upsampling and loss upweighting can induce a decrease in worst-group accuracy (WGA) with training epochs, leading to performance no better than without class-balancing. While in some scenarios, removing data to create a class-balanced subset is more effective, we show this depends on group structure and propose a mixture method which can outperform both techniques. Next, we show that scaling pretrained models is generally beneficial for worst-group accuracy, but only in conjuction with appropriate class-balancing. Finally, we identify spectral imbalance in finetuning features as a potential source of group disparities -- minority group covariance matrices incur a larger spectral norm than majority groups once conditioned on the classes. Our results show more nuanced interactions of modern finetuned models with group robustness than was previously known. Our code is available at https://github.com/tmlabonte/revisiting-finetuning.
△ Less
Submitted 18 July, 2024;
originally announced July 2024.