-
Brevity is the soul of wit: Pruning long files for code generation
Authors:
Aaditya K. Singh,
Yu Yang,
Kushal Tirumala,
Mostafa Elhoushi,
Ari S. Morcos
Abstract:
Data curation is commonly considered a "secret-sauce" for LLM training, with higher quality data usually leading to better LLM performance. Given the scale of internet-scraped corpora, data pruning has become a larger and larger focus. Specifically, many have shown that de-duplicating data, or sub-selecting higher quality data, can lead to efficiency or performance improvements. Generally, three t…
▽ More
Data curation is commonly considered a "secret-sauce" for LLM training, with higher quality data usually leading to better LLM performance. Given the scale of internet-scraped corpora, data pruning has become a larger and larger focus. Specifically, many have shown that de-duplicating data, or sub-selecting higher quality data, can lead to efficiency or performance improvements. Generally, three types of methods are used to filter internet-scale corpora: embedding-based, heuristic-based, and classifier-based. In this work, we contrast the former two in the domain of finetuning LLMs for code generation. We find that embedding-based methods are often confounded by length, and that a simple heuristic--pruning long files--outperforms other methods in compute-limited regimes. Our method can yield up to a 2x efficiency benefit in training (while matching performance) or a 3.5% absolute performance improvement on HumanEval (while matching compute). However, we find that perplexity on held-out long files can increase, begging the question of whether optimizing data mixtures for common coding benchmarks (HumanEval, MBPP) actually best serves downstream use cases. Overall, we hope our work builds useful intuitions about code data (specifically, the low quality of extremely long code files) provides a compelling heuristic-based method for data pruning, and brings to light questions in how we evaluate code generation models.
△ Less
Submitted 29 June, 2024;
originally announced July 2024.
-
Arithmetic properties for generalized cubic partitions and overpartitions modulo a prime
Authors:
Tewodros Amdeberhan,
James A. Sellers,
Ajit Singh
Abstract:
A cubic partition is an integer partition wherein the even parts can appear in two colors. In this paper, we introduce the notion of generalized cubic partitions and prove a number of new congruences akin to the classical Ramanujan-type. We emphasize two methods of proofs, one elementary (relying significantly on functional equations) and the other based on modular forms. We close by proving analo…
▽ More
A cubic partition is an integer partition wherein the even parts can appear in two colors. In this paper, we introduce the notion of generalized cubic partitions and prove a number of new congruences akin to the classical Ramanujan-type. We emphasize two methods of proofs, one elementary (relying significantly on functional equations) and the other based on modular forms. We close by proving analogous results for generalized overcubic partitions.
△ Less
Submitted 15 June, 2024;
originally announced July 2024.
-
On cases where Litt's game is fair
Authors:
Anne-Laure Basdevant,
Olivier Hénard,
Edouard Maurel-Segala,
Arvind Singh
Abstract:
A fair coin is flipped $n$ times, and two finite sequences of heads and tails (words) $A$ and $B$ of the same length are given. Each time the word $A$ appears in the sequence of coin flips, Alice gets a point, and each time the word $B$ appears, Bob gets a point. Who is more likely to win? This puzzle is a slight extension of Litt's game that recently set Twitter abuzz. We show that Litt's game is…
▽ More
A fair coin is flipped $n$ times, and two finite sequences of heads and tails (words) $A$ and $B$ of the same length are given. Each time the word $A$ appears in the sequence of coin flips, Alice gets a point, and each time the word $B$ appears, Bob gets a point. Who is more likely to win? This puzzle is a slight extension of Litt's game that recently set Twitter abuzz. We show that Litt's game is fair for any value of $n$ and any two words that have the same auto-correlation structure by building up a bijection that exchanges Bob and Alice scores; the fact that the inter-correlation does not come into play in this case may come up as a surprise.
△ Less
Submitted 28 June, 2024;
originally announced June 2024.
-
Orientation reconstruction of transformation $α$ titanium alloys via polarized light microscopy: methodology and assessment
Authors:
Amit Singh,
Mark Obstalecki,
Darren C. Pagan,
Michael Glavicic,
Matthew Kasemer
Abstract:
Emerging microstructural characterization methods have received increased attention owing to their promise of relatively inexpensive and rapid measurement of polycrystalline surface morphology and crystallographic orientations. Among these nascent methods, polarized light microscopy (PLM) is attractive for characterizing alloys comprised of hexagonal crystals, but is hindered by its inability to m…
▽ More
Emerging microstructural characterization methods have received increased attention owing to their promise of relatively inexpensive and rapid measurement of polycrystalline surface morphology and crystallographic orientations. Among these nascent methods, polarized light microscopy (PLM) is attractive for characterizing alloys comprised of hexagonal crystals, but is hindered by its inability to measure complete crystal orientations. In this study, we explore the potential to reconstruct quasi-deterministic orientations for titanium microstructures characterized via PLM by considering the Burgers orientation relationship between the room temperature $α$ (HCP) phase fibers measured via PLM, and the $β$ (BCC) phase orientations of the parent grains present above the transus temperature. We describe this method -- which is capable of narrowing down the orientations to one of four possibilities -- and demonstrate its abilities on idealized computational samples in which the parent $β$ microstructure is fully, unambiguously known. We further utilize this method to inform the instantiation of samples for crystal plasticity simulations, and demonstrate the significant improvement in deformation field predictions when utilizing this reconstruction method compared to using results from traditional PLM.
△ Less
Submitted 28 June, 2024;
originally announced June 2024.
-
Malaria Cell Detection Using Deep Neural Networks
Authors:
Saurabh Sawant,
Anurag Singh
Abstract:
Malaria remains one of the most pressing public health concerns globally, causing significant morbidity and mortality, especially in sub-Saharan Africa. Rapid and accurate diagnosis is crucial for effective treatment and disease management. Traditional diagnostic methods, such as microscopic examination of blood smears, are labor-intensive and require significant expertise, which may not be readil…
▽ More
Malaria remains one of the most pressing public health concerns globally, causing significant morbidity and mortality, especially in sub-Saharan Africa. Rapid and accurate diagnosis is crucial for effective treatment and disease management. Traditional diagnostic methods, such as microscopic examination of blood smears, are labor-intensive and require significant expertise, which may not be readily available in resource-limited settings. This project aims to automate the detection of malaria-infected cells using a deep learning approach. We employed a convolutional neural network (CNN) based on the ResNet50 architecture, leveraging transfer learning to enhance performance. The Malaria Cell Images Dataset from Kaggle, containing 27,558 images categorized into infected and uninfected cells, was used for training and evaluation. Our model demonstrated high accuracy, precision, and recall, indicating its potential as a reliable tool for assisting in malaria diagnosis. Additionally, a web application was developed using Streamlit to allow users to upload cell images and receive predictions about malaria infection, making the technology accessible and user-friendly. This paper provides a comprehensive overview of the methodology, experiments, and results, highlighting the effectiveness of deep learning in medical image analysis.
△ Less
Submitted 28 June, 2024;
originally announced June 2024.
-
Ultrafast carrier dynamics in epitaxial graphene nanoribbons studied by time-resolved terahertz spectroscopy
Authors:
Arvind Singh,
Hynek Němec,
Jan Kunc,
Petr Kužel
Abstract:
Optical pump-terahertz probe spectroscopy has been used to investigate ultrafast photo-induced charge carrier transport in epitaxial graphene nanoribbons. The picosecond THz photoconductivity first increases with an increasing pump fluence and then it saturates at high fluences. This behavior is due to an interplay between contributions of the directly photoexcited carriers and the secondary carri…
▽ More
Optical pump-terahertz probe spectroscopy has been used to investigate ultrafast photo-induced charge carrier transport in epitaxial graphene nanoribbons. The picosecond THz photoconductivity first increases with an increasing pump fluence and then it saturates at high fluences. This behavior is due to an interplay between contributions of the directly photoexcited carriers and the secondary carriers, which are equilibrium conduction band carriers strongly heated by the carrier-carrier scattering process after the photoexcitation. This phenomenon leads to a non-monotonic variation of the carrier mobility and plasmonic resonance frequency as a function of the pump fluence and, at higher fluences, to a balance between a decreasing carrier scattering time and an increasing Drude weight. In addition, a weak carrier localization occurring at low pump fluences is progressively lifted as a result of increasing initial carrier temperature.
△ Less
Submitted 28 June, 2024;
originally announced June 2024.
-
In vivo and in vitro study of resorbable magnesium wires for medical implants: Mg purity, surface quality, Zn alloying and polymer coating
Authors:
K. Tesar,
J. Lunackova,
M. Jex,
M. Zaloudkova,
R. Vrbova,
M. Bartos,
P. Klein,
L. Vistejnova,
J. Duskova,
E. Filova,
Z. Sucharda,
M. Steinerova,
S. Habr,
K. Balik,
A. Singh
Abstract:
Magnesium is an excellent material in terms of biocompatibility and its corrosion products can serve as an active source for new bone formation. However, localized corrosion and H2 generation limit the potential of Mg-based implants. Utilizing low-alloyed Mg-Zn wires can strongly reduce problems with large H2 bubbles and improve the mechanical properties considerably while maintaining excellent lo…
▽ More
Magnesium is an excellent material in terms of biocompatibility and its corrosion products can serve as an active source for new bone formation. However, localized corrosion and H2 generation limit the potential of Mg-based implants. Utilizing low-alloyed Mg-Zn wires can strongly reduce problems with large H2 bubbles and improve the mechanical properties considerably while maintaining excellent long-term biocompatibility. Acidic pickling and a polymer coating can be effectively used to lower the rate of in vivo degradation. In this work, microstructural, mechanical, and in vitro characterization of 250 um and 300 um extruded wires made from ultra-pure Mg, commercially pure Mg, Mg-0.15Zn, Mg-0.4Zn and Mg-1Zn was performed. Additionally, Mg-0.4Zn wires together with a variant coated with a copolymer of L-lactide and ε-caprolactone were tested in vivo on artificially damaged Wistar rat femurs. Based on the observed Mg-induced osteogenesis, polymer-coated Mg wires with a small addition of Zn are a perspective material for bone-support applications, such as cerclage and fixation wires.
△ Less
Submitted 26 June, 2024;
originally announced June 2024.
-
Arboretum: A Large Multimodal Dataset Enabling AI for Biodiversity
Authors:
Chih-Hsuan Yang,
Benjamin Feuer,
Zaki Jubery,
Zi K. Deng,
Andre Nakkab,
Md Zahid Hasan,
Shivani Chiranjeevi,
Kelly Marshall,
Nirmal Baishnab,
Asheesh K Singh,
Arti Singh,
Soumik Sarkar,
Nirav Merchant,
Chinmay Hegde,
Baskar Ganapathysubramanian
Abstract:
We introduce Arboretum, the largest publicly accessible dataset designed to advance AI for biodiversity applications. This dataset, curated from the iNaturalist community science platform and vetted by domain experts to ensure accuracy, includes 134.6 million images, surpassing existing datasets in scale by an order of magnitude. The dataset encompasses image-language paired data for a diverse set…
▽ More
We introduce Arboretum, the largest publicly accessible dataset designed to advance AI for biodiversity applications. This dataset, curated from the iNaturalist community science platform and vetted by domain experts to ensure accuracy, includes 134.6 million images, surpassing existing datasets in scale by an order of magnitude. The dataset encompasses image-language paired data for a diverse set of species from birds (Aves), spiders/ticks/mites (Arachnida), insects (Insecta), plants (Plantae), fungus/mushrooms (Fungi), snails (Mollusca), and snakes/lizards (Reptilia), making it a valuable resource for multimodal vision-language AI models for biodiversity assessment and agriculture research. Each image is annotated with scientific names, taxonomic details, and common names, enhancing the robustness of AI model training.
We showcase the value of Arboretum by releasing a suite of CLIP models trained using a subset of 40 million captioned images. We introduce several new benchmarks for rigorous assessment, report accuracy for zero-shot learning, and evaluations across life stages, rare species, confounding species, and various levels of the taxonomic hierarchy.
We anticipate that Arboretum will spur the development of AI models that can enable a variety of digital tools ranging from pest control strategies, crop monitoring, and worldwide biodiversity assessment and environmental conservation. These advancements are critical for ensuring food security, preserving ecosystems, and mitigating the impacts of climate change. Arboretum is publicly available, easily accessible, and ready for immediate use.
Please see the \href{https://baskargroup.github.io/Arboretum/}{project website} for links to our data, models, and code.
△ Less
Submitted 25 June, 2024;
originally announced June 2024.
-
Optimizing Configuration Selection in Reconfigurable-Antenna MIMO Systems: Physics-Inspired Heuristic Solvers
Authors:
I. Krikidis,
C. Psomas,
A. K. Singh,
K. Jamieson
Abstract:
Reconfigurable antenna multiple-input multiple-output (MIMO) is a foundational technology for the continuing evolution of cellular systems, including upcoming 6G communication systems. In this paper, we address the problem of flexible/reconfigurable antenna configuration selection for point-to-point MIMO antenna systems by using physics-inspired heuristics. Firstly, we optimize the antenna configu…
▽ More
Reconfigurable antenna multiple-input multiple-output (MIMO) is a foundational technology for the continuing evolution of cellular systems, including upcoming 6G communication systems. In this paper, we address the problem of flexible/reconfigurable antenna configuration selection for point-to-point MIMO antenna systems by using physics-inspired heuristics. Firstly, we optimize the antenna configuration to maximize the signal-to-noise ratio (SNR) at the receiver by leveraging two basic heuristic solvers, i.e., coherent Ising machines (CIMs), that mimic quantum mechanical dynamics, and quantum annealing (QA), where a real-world QA architecture is considered (D-Wave). A mathematical framework that converts the configuration selection problem into CIM- and QA- compatible unconstrained quadratic formulations is investigated. Numerical and experimental results show that the proposed designs outperform classical counterparts and achieve near-optimal performance (similar to exhaustive search with exponential complexity) while ensuring polynomial complexity. Moreover, we study the optimal antenna configuration that maximizes the end-to-end Shannon capacity. A simulated annealing (SA) heuristic which achieves near-optimal performance through appropriate parameterization is adopted. A modified version of the basic SA that exploits parallel tempering to avoid local maxima is also studied, which provides additional performance gains. Extended numerical studies show that the SA solutions outperform conventional heuristics (which are also developed for comparison purposes), while the employment of the SNR-based solutions is highly sub-optimal.
△ Less
Submitted 25 June, 2024;
originally announced June 2024.
-
GraphEval2000: Benchmarking and Improving Large Language Models on Graph Datasets
Authors:
Qiming Wu,
Zichen Chen,
Will Corcoran,
Misha Sra,
Ambuj K. Singh
Abstract:
Large language models (LLMs) have achieved remarkable success in natural language processing (NLP), demonstrating significant capabilities in processing and understanding text data. However, recent studies have identified limitations in LLMs' ability to reason about graph-structured data. To address this gap, we introduce GraphEval2000, the first comprehensive graph dataset, comprising 40 graph da…
▽ More
Large language models (LLMs) have achieved remarkable success in natural language processing (NLP), demonstrating significant capabilities in processing and understanding text data. However, recent studies have identified limitations in LLMs' ability to reason about graph-structured data. To address this gap, we introduce GraphEval2000, the first comprehensive graph dataset, comprising 40 graph data structure problems along with 2000 test cases. Additionally, we introduce an evaluation framework based on GraphEval2000, designed to assess the graph reasoning abilities of LLMs through coding challenges. Our dataset categorizes test cases into four primary and four sub-categories, ensuring a comprehensive evaluation. We evaluate eight popular LLMs on GraphEval2000, revealing that LLMs exhibit a better understanding of directed graphs compared to undirected ones. While private LLMs consistently outperform open-source models, the performance gap is narrowing. Furthermore, to improve the usability of our evaluation framework, we propose Structured Symbolic Decomposition (SSD), an instruction-based method designed to enhance LLM performance on GraphEval2000. Results show that SSD improves the performance of GPT-3.5, GPT-4, and GPT-4o on complex graph problems, with an increase of 11.11\%, 33.37\%, and 33.37\%, respectively.
△ Less
Submitted 23 June, 2024;
originally announced June 2024.
-
Parabolic vector bundles and Lie algebroid connections
Authors:
David Alfaya,
Indranil Biswas,
Pradip Kumar,
Anoop Singh
Abstract:
Given a holomorphic Lie algebroid on an m-pointed Riemann surface, we define parabolic Lie algebroid connections on any parabolic vector bundle equipped with parabolic structure over the marked points. An analogue of the Atiyah exact sequence for parabolic Lie algebroids is constructed. For any Lie algebroid whose underlying holomorphic vector bundle is stable, we give a complete characterization…
▽ More
Given a holomorphic Lie algebroid on an m-pointed Riemann surface, we define parabolic Lie algebroid connections on any parabolic vector bundle equipped with parabolic structure over the marked points. An analogue of the Atiyah exact sequence for parabolic Lie algebroids is constructed. For any Lie algebroid whose underlying holomorphic vector bundle is stable, we give a complete characterization of all the parabolic vector bundles that admit a parabolic Lie algebroid connection.
△ Less
Submitted 22 June, 2024;
originally announced June 2024.
-
Keystroke Dynamics Against Academic Dishonesty in the Age of LLMs
Authors:
Debnath Kundu,
Atharva Mehta,
Rajesh Kumar,
Naman Lal,
Avinash Anand,
Apoorv Singh,
Rajiv Ratn Shah
Abstract:
The transition to online examinations and assignments raises significant concerns about academic integrity. Traditional plagiarism detection systems often struggle to identify instances of intelligent cheating, particularly when students utilize advanced generative AI tools to craft their responses. This study proposes a keystroke dynamics-based method to differentiate between bona fide and assist…
▽ More
The transition to online examinations and assignments raises significant concerns about academic integrity. Traditional plagiarism detection systems often struggle to identify instances of intelligent cheating, particularly when students utilize advanced generative AI tools to craft their responses. This study proposes a keystroke dynamics-based method to differentiate between bona fide and assisted writing within academic contexts. To facilitate this, a dataset was developed to capture the keystroke patterns of individuals engaged in writing tasks, both with and without the assistance of generative AI. The detector, trained using a modified TypeNet architecture, achieved accuracies ranging from 74.98% to 85.72% in condition-specific scenarios and from 52.24% to 80.54% in condition-agnostic scenarios. The findings highlight significant differences in keystroke dynamics between genuine and assisted writing. The outcomes of this study enhance our understanding of how users interact with generative AI and have implications for improving the reliability of digital educational platforms.
△ Less
Submitted 21 June, 2024;
originally announced June 2024.
-
Differentiable-Optimization Based Neural Policy for Occlusion-Aware Target Tracking
Authors:
Houman Masnavi,
Arun Kumar Singh,
Farrokh Janabi-Sharifi
Abstract:
Tracking a target in cluttered and dynamic environments is challenging but forms a core component in applications like aerial cinematography. The obstacles in the environment not only pose collision risk but can also occlude the target from the field-of-view of the robot. Moreover, the target future trajectory may be unknown and only its current state can be estimated. In this paper, we propose a…
▽ More
Tracking a target in cluttered and dynamic environments is challenging but forms a core component in applications like aerial cinematography. The obstacles in the environment not only pose collision risk but can also occlude the target from the field-of-view of the robot. Moreover, the target future trajectory may be unknown and only its current state can be estimated. In this paper, we propose a learned probabilistic neural policy for safe, occlusion-free target tracking.
The core novelty of our work stems from the structure of our policy network that combines generative modeling based on Conditional Variational Autoencoder (CVAE) with differentiable optimization layers. The role of the CVAE is to provide a base trajectory distribution which is then projected onto a learned feasible set through the optimization layer. Furthermore, both the weights of the CVAE network and the parameters of the differentiable optimization can be learned in an end-to-end fashion through demonstration trajectories.
We improve the state-of-the-art (SOTA) in the following respects. We show that our learned policy outperforms existing SOTA in terms of occlusion/collision avoidance capabilities and computation time. Second, we present an extensive ablation showing how different components of our learning pipeline contribute to the overall tracking task. We also demonstrate the real-time performance of our approach on resource-constrained hardware such as NVIDIA Jetson TX2. Finally, our learned policy can also be viewed as a reactive planner for navigation in highly cluttered environments.
△ Less
Submitted 20 June, 2024;
originally announced June 2024.
-
Invariant rings of the special orthogonal group have nonunimodal $h$-vectors
Authors:
Aldo Conca,
Anurag K. Singh,
Matteo Varbaro
Abstract:
For $K$ an infinite field of characteristic other than two, consider the action of the special orthogonal group $\operatorname{SO}_t(K)$ on a polynomial ring via copies of the regular representation. When $K$ has characteristic zero, Boutot's theorem implies that the invariant ring has rational singularities; when $K$ has positive characteristic, the invariant ring is $F$-regular, as proven by Has…
▽ More
For $K$ an infinite field of characteristic other than two, consider the action of the special orthogonal group $\operatorname{SO}_t(K)$ on a polynomial ring via copies of the regular representation. When $K$ has characteristic zero, Boutot's theorem implies that the invariant ring has rational singularities; when $K$ has positive characteristic, the invariant ring is $F$-regular, as proven by Hashimoto using good filtrations. We give a new proof of this, viewing the invariant ring for $\operatorname{SO}_t(K)$ as a cyclic cover of the invariant ring for the corresponding orthogonal group; this point of view has a number of useful consequences, for example it readily yields the $a$-invariant and information on the Hilbert series. Indeed, we use this to show that the $h$-vector of the invariant ring for $\operatorname{SO}_t(K)$ need not be unimodal.
△ Less
Submitted 5 August, 2024; v1 submitted 20 June, 2024;
originally announced June 2024.
-
AMC: Access to Miss Correlation Prefetcher for Evolving Graph Analytics
Authors:
Abhishek Singh,
Christian Schulte,
Xiaochen Guo
Abstract:
Modern memory hierarchies work well with applications that have good spatial locality. Evolving (dynamic) graphs are important applications widely used to model graphs and networks with edge and vertex changes. They exhibit irregular memory access patterns and suffer from a high miss ratio and long miss penalty. Prefetching can be employed to predict and fetch future demand misses. However, curren…
▽ More
Modern memory hierarchies work well with applications that have good spatial locality. Evolving (dynamic) graphs are important applications widely used to model graphs and networks with edge and vertex changes. They exhibit irregular memory access patterns and suffer from a high miss ratio and long miss penalty. Prefetching can be employed to predict and fetch future demand misses. However, current hardware prefetchers can not efficiently predict for applications with irregular memory accesses. In evolving graph applications, vertices that do not change during graph changes exhibit the same access correlation patterns. Current temporal prefetchers use one-to-one or one-to-many correlation to exploit these patterns. Similar patterns are recorded in the same entry, which causes aliasing and can lead to poor prefetch accuracy and coverage. This work proposes a software-assisted hardware prefetcher for evolving graphs. The key idea is to record the correlations between a sequence of vertex accesses and the following misses and then prefetch when the same vertex access sequence occurs in the future. The proposed Access-to-Miss Correlation (AMC) prefetcher provides a lightweight programming interface to identify the data structures of interest and sets the iteration boundary to update the correlation table. For the evaluated applications, AMC achieves a geomean speedup of 1.5x as compared to the best-performing prefetcher in prior work (VLDP). AMC can achieve an average of 62% accuracy and coverage, whereas VLDP has an accuracy of 31% and coverage of 23%.
△ Less
Submitted 20 June, 2024;
originally announced June 2024.
-
Global Human-guided Counterfactual Explanations for Molecular Properties via Reinforcement Learning
Authors:
Danqing Wang,
Antonis Antoniades,
Kha-Dinh Luong,
Edwin Zhang,
Mert Kosan,
Jiachen Li,
Ambuj Singh,
William Yang Wang,
Lei Li
Abstract:
Counterfactual explanations of Graph Neural Networks (GNNs) offer a powerful way to understand data that can naturally be represented by a graph structure. Furthermore, in many domains, it is highly desirable to derive data-driven global explanations or rules that can better explain the high-level properties of the models and data in question. However, evaluating global counterfactual explanations…
▽ More
Counterfactual explanations of Graph Neural Networks (GNNs) offer a powerful way to understand data that can naturally be represented by a graph structure. Furthermore, in many domains, it is highly desirable to derive data-driven global explanations or rules that can better explain the high-level properties of the models and data in question. However, evaluating global counterfactual explanations is hard in real-world datasets due to a lack of human-annotated ground truth, which limits their use in areas like molecular sciences. Additionally, the increasing scale of these datasets provides a challenge for random search-based methods. In this paper, we develop a novel global explanation model RLHEX for molecular property prediction. It aligns the counterfactual explanations with human-defined principles, making the explanations more interpretable and easy for experts to evaluate. RLHEX includes a VAE-based graph generator to generate global explanations and an adapter to adjust the latent representation space to human-defined principles. Optimized by Proximal Policy Optimization (PPO), the global explanations produced by RLHEX cover 4.12% more input graphs and reduce the distance between the counterfactual explanation set and the input set by 0.47% on average across three molecular datasets. RLHEX provides a flexible framework to incorporate different human-designed principles into the counterfactual explanation generation process, aligning these explanations with domain expertise. The code and data are released at https://github.com/dqwang122/RLHEX.
△ Less
Submitted 19 June, 2024;
originally announced June 2024.
-
Connecting Rashba and Dresselhaus spin-orbit interactions to inversion asymmetry in perovskite oxide heterostructures
Authors:
Nirmal Ganguli,
Avishek Singh,
Vivek Kumar,
Jayita Chakraborty
Abstract:
Inversion asymmetry, combined with spin orbit interaction, leads to Rashba or Dresselhaus effects, or combinations of them that are promising for technologies based on antiferromagnetic spintronics. Since understanding the exact nature of spin-orbit interaction is crucial for developing a technology based on it, mapping the nature of inversion asymmetry with the type of spin-orbit interaction beco…
▽ More
Inversion asymmetry, combined with spin orbit interaction, leads to Rashba or Dresselhaus effects, or combinations of them that are promising for technologies based on antiferromagnetic spintronics. Since understanding the exact nature of spin-orbit interaction is crucial for developing a technology based on it, mapping the nature of inversion asymmetry with the type of spin-orbit interaction becomes the key. We simulate a perovskite oxide heterostructure LaAlO$_3|$SrIrO$_3|$SrTiO$_3$ preserving the inversion symmetry within density functional theory to demonstrate the relation between the nature of inversion asymmetry and the corresponding Rashba or Dresselhaus-type interaction. With progressive distortion in the heterostructure, we find how the structure inversion asymmetry sets in with distorted bond lengths and bond angles, leading to Rashba effect in the system. Further, introduction of tilted IrO$_6$ octahedra leads to bulk inversion asymmetry, helping a combined Rashba-Dresselhaus interaction to set in. A comparison of the spin textures obtained from our DFT calculations and theoretical modeling helps us identify the exact nature of the interactions. Besides demonstrating the connection between the nature of asymmetry with Rashba and Dresselhaus interactions, our work may serve as a guide to identifying different types of Rashba-like spin-orbit interactions.
△ Less
Submitted 19 June, 2024;
originally announced June 2024.
-
Various Representation Dimensions associated with a Finite Group
Authors:
Anupam Singh,
Ayush Udeep
Abstract:
To a finite group $G$, one can associate several notions of dimensions (or degrees). In this survey, we attempt to bring together some of the notions of dimensions or degrees defined using representations of the group in General Linear Groups and permutation groups. These are embedding degree, minimal faithful irreducible character degree, minimal faithful permutation representation degree, minima…
▽ More
To a finite group $G$, one can associate several notions of dimensions (or degrees). In this survey, we attempt to bring together some of the notions of dimensions or degrees defined using representations of the group in General Linear Groups and permutation groups. These are embedding degree, minimal faithful irreducible character degree, minimal faithful permutation representation degree, minimal faithful quasi-permutation representation degree and essential dimension. We briefly present the progress in understanding these notions and the related problems.
△ Less
Submitted 19 June, 2024;
originally announced June 2024.
-
Class-specific Data Augmentation for Plant Stress Classification
Authors:
Nasla Saleem,
Aditya Balu,
Talukder Zaki Jubery,
Arti Singh,
Asheesh K. Singh,
Soumik Sarkar,
Baskar Ganapathysubramanian
Abstract:
Data augmentation is a powerful tool for improving deep learning-based image classifiers for plant stress identification and classification. However, selecting an effective set of augmentations from a large pool of candidates remains a key challenge, particularly in imbalanced and confounding datasets. We propose an approach for automated class-specific data augmentation using a genetic algorithm.…
▽ More
Data augmentation is a powerful tool for improving deep learning-based image classifiers for plant stress identification and classification. However, selecting an effective set of augmentations from a large pool of candidates remains a key challenge, particularly in imbalanced and confounding datasets. We propose an approach for automated class-specific data augmentation using a genetic algorithm. We demonstrate the utility of our approach on soybean [Glycine max (L.) Merr] stress classification where symptoms are observed on leaves; a particularly challenging problem due to confounding classes in the dataset. Our approach yields substantial performance, achieving a mean-per-class accuracy of 97.61% and an overall accuracy of 98% on the soybean leaf stress dataset. Our method significantly improves the accuracy of the most challenging classes, with notable enhancements from 83.01% to 88.89% and from 85.71% to 94.05%, respectively.
A key observation we make in this study is that high-performing augmentation strategies can be identified in a computationally efficient manner. We fine-tune only the linear layer of the baseline model with different augmentations, thereby reducing the computational burden associated with training classifiers from scratch for each augmentation policy while achieving exceptional performance. This research represents an advancement in automated data augmentation strategies for plant stress classification, particularly in the context of confounding datasets. Our findings contribute to the growing body of research in tailored augmentation techniques and their potential impact on disease management strategies, crop yields, and global food security. The proposed approach holds the potential to enhance the accuracy and efficiency of deep learning-based tools for managing plant stresses in agriculture.
△ Less
Submitted 18 June, 2024;
originally announced June 2024.
-
Segregation Kinetics of Miktoarm Star Polymers: A Dissipative Particle Dynamics Study
Authors:
Dorothy Gogoi,
Avinash Chauhan,
Sanjay Puri,
Awaneesh Singh
Abstract:
We study the phase separation kinetics of miktoarm star polymer (MSP) melts and blends with diverse architectures using dissipative particle dynamics simulations. Our study focuses on symmetric and asymmetric miktoarm star polymer (SMSP/AMSP) mixtures based on arm composition and number. For a fixed MSP chain size, the characteristic microphase-separated domains initially show diffusive growth wit…
▽ More
We study the phase separation kinetics of miktoarm star polymer (MSP) melts and blends with diverse architectures using dissipative particle dynamics simulations. Our study focuses on symmetric and asymmetric miktoarm star polymer (SMSP/AMSP) mixtures based on arm composition and number. For a fixed MSP chain size, the characteristic microphase-separated domains initially show diffusive growth with a growth exponent $φ\sim 1/3$ for both melts that gradually crossover to saturation at late times. The simulation results demonstrate that the evolution morphology of SMSP melts exhibits perfect dynamic scaling with varying arm numbers; the time scale follows a power-law decay with an exponent $θ\simeq 1$ as the number of arms increases. The structural constraints on AMSP melts cause the domain growth rate to decrease as the number of one type of arms increases while their length remains fixed. This increase in the number of arms for AMSP corresponds to increased off-criticality. The saturation length in AMSP follows a power law increase with an exponent $λ\simeq 2/3$ as off-criticality decreases. Additionally, macrophase separation kinetics in SMSP/AMSP blends show a transition from viscous ($φ\sim 1$) to inertial ($φ\sim 2/3$) hydrodynamic growth regimes at late times; this exhibits the same dynamical universality class as linear polymer blends, with slight deviations at early stages.
△ Less
Submitted 15 June, 2024;
originally announced June 2024.
-
Quantifying Variance in Evaluation Benchmarks
Authors:
Lovish Madaan,
Aaditya K. Singh,
Rylan Schaeffer,
Andrew Poulton,
Sanmi Koyejo,
Pontus Stenetorp,
Sharan Narang,
Dieuwke Hupkes
Abstract:
Evaluation benchmarks are the cornerstone of measuring capabilities of large language models (LLMs), as well as driving progress in said capabilities. Originally designed to make claims about capabilities (or lack thereof) in fully pretrained models, evaluation benchmarks are now also extensively used to decide between various training choices. Despite this widespread usage, we rarely quantify the…
▽ More
Evaluation benchmarks are the cornerstone of measuring capabilities of large language models (LLMs), as well as driving progress in said capabilities. Originally designed to make claims about capabilities (or lack thereof) in fully pretrained models, evaluation benchmarks are now also extensively used to decide between various training choices. Despite this widespread usage, we rarely quantify the variance in our evaluation benchmarks, which dictates whether differences in performance are meaningful. Here, we define and measure a range of metrics geared towards measuring variance in evaluation benchmarks, including seed variance across initialisations, and monotonicity during training. By studying a large number of models -- both openly available and pretrained from scratch -- we provide empirical estimates for a variety of variance metrics, with considerations and recommendations for practitioners. We also evaluate the utility and tradeoffs of continuous versus discrete performance measures and explore options for better understanding and reducing this variance. We find that simple changes, such as framing choice tasks (like MMLU) as completion tasks, can often reduce variance for smaller scale ($\sim$7B) models, while more involved methods inspired from human testing literature (such as item analysis and item response theory) struggle to meaningfully reduce variance. Overall, our work provides insights into variance in evaluation benchmarks, suggests LM-specific techniques to reduce variance, and more generally encourages practitioners to carefully factor in variance when comparing models.
△ Less
Submitted 14 June, 2024;
originally announced June 2024.
-
Temporal Planning via Interval Logic Satisfiability for Autonomous Systems
Authors:
Miquel Ramirez,
Anubhav Singh,
Peter Stuckey,
Chris Manzie
Abstract:
Many automated planning methods and formulations rely on suitably designed abstractions or simplifications of the constrained dynamics associated with agents to attain computational scalability. We consider formulations of temporal planning where intervals are associated with both action and fluent atoms, and relations between these are given as sentences in Allen's Interval Logic. We propose a no…
▽ More
Many automated planning methods and formulations rely on suitably designed abstractions or simplifications of the constrained dynamics associated with agents to attain computational scalability. We consider formulations of temporal planning where intervals are associated with both action and fluent atoms, and relations between these are given as sentences in Allen's Interval Logic. We propose a notion of planning graphs that can account for complex concurrency relations between actions and fluents as a Constraint Programming (CP) model. We test an implementation of our algorithm on a state-of-the-art framework for CP and compare it with PDDL 2.1 planners that capture plans requiring complex concurrent interactions between agents. We demonstrate our algorithm outperforms existing PDDL 2.1 planners in the case studies. Still, scalability remains challenging when plans must comply with intricate concurrent interactions and the sequencing of actions.
△ Less
Submitted 13 June, 2024;
originally announced June 2024.
-
Distribution of hooks in self-conjugate partitions
Authors:
William Craig,
Ken Ono,
Ajit Singh
Abstract:
We confirm the speculation that the distribution of $t$-hooks among unrestricted integer partitions essentially descends to self-conjugate partitions. Namely, we prove that the number of hooks of length $t$ among the size $n$ self-conjugate partitions is asymptotically normally distributed with mean
$μ_t(n) \sim \frac{\sqrt{6n}}π + \frac{3}{π^2} - \frac{t}{2}$ and variance…
▽ More
We confirm the speculation that the distribution of $t$-hooks among unrestricted integer partitions essentially descends to self-conjugate partitions. Namely, we prove that the number of hooks of length $t$ among the size $n$ self-conjugate partitions is asymptotically normally distributed with mean
$μ_t(n) \sim \frac{\sqrt{6n}}π + \frac{3}{π^2} - \frac{t}{2}$ and variance $σ_t^2(n) \sim \frac{(π^2 - 6) \sqrt{6n}}{π^3}.$
△ Less
Submitted 13 June, 2024;
originally announced June 2024.
-
Faster Spectral Density Estimation and Sparsification in the Nuclear Norm
Authors:
Yujia Jin,
Ishani Karmarkar,
Christopher Musco,
Aaron Sidford,
Apoorv Vikram Singh
Abstract:
We consider the problem of estimating the spectral density of the normalized adjacency matrix of an $n$-node undirected graph. We provide a randomized algorithm that, with $O(nε^{-2})$ queries to a degree and neighbor oracle and in $O(nε^{-3})$ time, estimates the spectrum up to $ε$ accuracy in the Wasserstein-1 metric. This improves on previous state-of-the-art methods, including an $O(nε^{-7})$…
▽ More
We consider the problem of estimating the spectral density of the normalized adjacency matrix of an $n$-node undirected graph. We provide a randomized algorithm that, with $O(nε^{-2})$ queries to a degree and neighbor oracle and in $O(nε^{-3})$ time, estimates the spectrum up to $ε$ accuracy in the Wasserstein-1 metric. This improves on previous state-of-the-art methods, including an $O(nε^{-7})$ time algorithm from [Braverman et al., STOC 2022] and, for sufficiently small $ε$, a $2^{O(ε^{-1})}$ time method from [Cohen-Steiner et al., KDD 2018]. To achieve this result, we introduce a new notion of graph sparsification, which we call nuclear sparsification. We provide an $O(nε^{-2})$-query and $O(nε^{-2})$-time algorithm for computing $O(nε^{-2})$-sparse nuclear sparsifiers. We show that this bound is optimal in both its sparsity and query complexity, and we separate our results from the related notion of additive spectral sparsification. Of independent interest, we show that our sparsification method also yields the first deterministic algorithm for spectral density estimation that scales linearly with $n$ (sublinear in the representation size of the graph).
△ Less
Submitted 11 June, 2024;
originally announced June 2024.
-
Hybrid Reinforcement Learning from Offline Observation Alone
Authors:
Yuda Song,
J. Andrew Bagnell,
Aarti Singh
Abstract:
We consider the hybrid reinforcement learning setting where the agent has access to both offline data and online interactive access. While Reinforcement Learning (RL) research typically assumes offline data contains complete action, reward and transition information, datasets with only state information (also known as observation-only datasets) are more general, abundant and practical. This motiva…
▽ More
We consider the hybrid reinforcement learning setting where the agent has access to both offline data and online interactive access. While Reinforcement Learning (RL) research typically assumes offline data contains complete action, reward and transition information, datasets with only state information (also known as observation-only datasets) are more general, abundant and practical. This motivates our study of the hybrid RL with observation-only offline dataset framework. While the task of competing with the best policy "covered" by the offline data can be solved if a reset model of the environment is provided (i.e., one that can be reset to any state), we show evidence of hardness when only given the weaker trace model (i.e., one can only reset to the initial states and must produce full traces through the environment), without further assumption of admissibility of the offline data. Under the admissibility assumptions -- that the offline data could actually be produced by the policy class we consider -- we propose the first algorithm in the trace model setting that provably matches the performance of algorithms that leverage a reset model. We also perform proof-of-concept experiments that suggest the effectiveness of our algorithm in practice.
△ Less
Submitted 11 June, 2024;
originally announced June 2024.
-
Scaling the Vocabulary of Non-autoregressive Models for Efficient Generative Retrieval
Authors:
Ravisri Valluri,
Akash Kumar Mohankumar,
Kushal Dave,
Amit Singh,
Jian Jiao,
Manik Varma,
Gaurav Sinha
Abstract:
Generative Retrieval introduces a new approach to Information Retrieval by reframing it as a constrained generation task, leveraging recent advancements in Autoregressive (AR) language models. However, AR-based Generative Retrieval methods suffer from high inference latency and cost compared to traditional dense retrieval techniques, limiting their practical applicability. This paper investigates…
▽ More
Generative Retrieval introduces a new approach to Information Retrieval by reframing it as a constrained generation task, leveraging recent advancements in Autoregressive (AR) language models. However, AR-based Generative Retrieval methods suffer from high inference latency and cost compared to traditional dense retrieval techniques, limiting their practical applicability. This paper investigates fully Non-autoregressive (NAR) language models as a more efficient alternative for generative retrieval. While standard NAR models alleviate latency and cost concerns, they exhibit a significant drop in retrieval performance (compared to AR models) due to their inability to capture dependencies between target tokens. To address this, we question the conventional choice of limiting the target token space to solely words or sub-words. We propose PIXAR, a novel approach that expands the target vocabulary of NAR models to include multi-word entities and common phrases (up to 5 million tokens), thereby reducing token dependencies. PIXAR employs inference optimization strategies to maintain low inference latency despite the significantly larger vocabulary. Our results demonstrate that PIXAR achieves a relative improvement of 31.0% in MRR@10 on MS MARCO and 23.2% in Hits@5 on Natural Questions compared to standard NAR models with similar latency and cost. Furthermore, online A/B experiments on a large commercial search engine show that PIXAR increases ad clicks by 5.08% and revenue by 4.02%.
△ Less
Submitted 10 June, 2024;
originally announced June 2024.
-
Exploring Topic Modelling of User Reviews as a Monitoring Mechanism for Emergent Issues Within Social VR Communities
Authors:
Angelo Singh,
Joseph O'Hagan
Abstract:
Users of social virtual reality (VR) platforms often use user reviews to document incidents of witnessed and/or experienced user harassment. However, at present, research has yet to be explore utilising this data as a monitoring mechanism to identify emergent issues within social VR communities. Such a system would be of much benefit to developers and researchers as it would enable the automatic i…
▽ More
Users of social virtual reality (VR) platforms often use user reviews to document incidents of witnessed and/or experienced user harassment. However, at present, research has yet to be explore utilising this data as a monitoring mechanism to identify emergent issues within social VR communities. Such a system would be of much benefit to developers and researchers as it would enable the automatic identification of emergent issues as they occur, provide a means of longitudinally analysing harassment, and reduce the reliance on alternative, high cost, monitoring methodologies, e.g. observation or interview studies. To contribute towards the development of such a system, we collected approximately 40,000 Rec Room user reviews from the Steam storefront. We then analysed our dataset's sentiment, word/term frequencies, and conducted a topic modelling analysis of the negative reviews detected in our dataset. We report our approach was capable of longitudinally monitoring changes in review sentiment and identifying high level themes related to types of harassment known to occur in social VR platforms.
△ Less
Submitted 6 June, 2024;
originally announced June 2024.
-
How Good is Zero-Shot MT Evaluation for Low Resource Indian Languages?
Authors:
Anushka Singh,
Ananya B. Sai,
Raj Dabre,
Ratish Puduppully,
Anoop Kunchukuttan,
Mitesh M Khapra
Abstract:
While machine translation evaluation has been studied primarily for high-resource languages, there has been a recent interest in evaluation for low-resource languages due to the increasing availability of data and models. In this paper, we focus on a zero-shot evaluation setting focusing on low-resource Indian languages, namely Assamese, Kannada, Maithili, and Punjabi. We collect sufficient Multi-…
▽ More
While machine translation evaluation has been studied primarily for high-resource languages, there has been a recent interest in evaluation for low-resource languages due to the increasing availability of data and models. In this paper, we focus on a zero-shot evaluation setting focusing on low-resource Indian languages, namely Assamese, Kannada, Maithili, and Punjabi. We collect sufficient Multi-Dimensional Quality Metrics (MQM) and Direct Assessment (DA) annotations to create test sets and meta-evaluate a plethora of automatic evaluation metrics. We observe that even for learned metrics, which are known to exhibit zero-shot performance, the Kendall Tau and Pearson correlations with human annotations are only as high as 0.32 and 0.45. Synthetic data approaches show mixed results and overall do not help close the gap by much for these languages. This indicates that there is still a long way to go for low-resource evaluation.
△ Less
Submitted 6 June, 2024;
originally announced June 2024.
-
Room-temperature tunable tunneling magnetoresistance in Fe3GaTe2/WSe2/Fe3GaTe2 van der Waals heterostructures
Authors:
Haiyang Pan,
Anil Kumar Singh,
Chusheng Zhang,
Xueqi Hu,
Jiayu Shi,
Liheng An,
Naizhou Wang,
Ruihuan Duan,
Zheng Liu,
S tuart S. P. Parkin,
Pritam Deb,
Weibo Gao
Abstract:
The exceptional properties of two-dimensional (2D) magnet materials present a novel approach to fabricate functional magnetic tunnel junctions (MTJ) by constructing full van der Waals (vdW) heterostructures with atomically sharp and clean interfaces. The exploration of vdW MTJ devices with high working temperature and adjustable functionalities holds great potential for advancing the application o…
▽ More
The exceptional properties of two-dimensional (2D) magnet materials present a novel approach to fabricate functional magnetic tunnel junctions (MTJ) by constructing full van der Waals (vdW) heterostructures with atomically sharp and clean interfaces. The exploration of vdW MTJ devices with high working temperature and adjustable functionalities holds great potential for advancing the application of 2D materials in magnetic sensing and data storage. Here, we report the observation of highly tunable room-temperature tunneling magnetoresistance through electronic means in a full vdW Fe3GaTe2/WSe2/Fe3GaTe2 MTJ. The spin valve effect of the MTJ can be detected even with the current below 1 nA, both at low and room temperatures, yielding a tunneling magnetoresistance (TMR) of 340% at 2 K and 50% at 300 K, respectively. Importantly, the magnitude and sign of TMR can be modulated by a DC bias current, even at room temperature, a capability that was previously unrealized in full vdW MTJs. This tunable TMR arises from the contribution of energy-dependent localized spin states in the metallic ferromagnet Fe3GaTe2 during tunnel transport when a finite electrical bias is applied. Our work offers a new perspective for designing and exploring room-temperature tunable spintronic devices based on vdW magnet heterostructures.
△ Less
Submitted 5 June, 2024;
originally announced June 2024.
-
Simplicial complexes and matroids with vanishing $T^2$
Authors:
Alexandru Constantinescu,
Patricia Klein,
Thai Thanh Nguyen,
Anurag Singh,
Lorenzo Venturello
Abstract:
We investigate quotients by radical monomial ideals for which $T^2$, the second cotangent cohomology module, vanishes. The dimension of the graded components of $T^2$, and thus their vanishing, depends only on the combinatorics of the corresponding simplicial complex. We give both a complete characterization and a full list of one dimensional complexes with $T^2=0$. We characterize the graded comp…
▽ More
We investigate quotients by radical monomial ideals for which $T^2$, the second cotangent cohomology module, vanishes. The dimension of the graded components of $T^2$, and thus their vanishing, depends only on the combinatorics of the corresponding simplicial complex. We give both a complete characterization and a full list of one dimensional complexes with $T^2=0$. We characterize the graded components of $T^2$ when the simplicial complex is a uniform matroid. Finally, we show that $T^2$ vanishes for all matroids of corank at most two and conjecture that all connected matroids with vanishing $T^2$ are of corank at most two.
△ Less
Submitted 4 June, 2024;
originally announced June 2024.
-
A Study of Optimizations for Fine-tuning Large Language Models
Authors:
Arjun Singh,
Nikhil Pandey,
Anup Shirgaonkar,
Pavan Manoj,
Vijay Aski
Abstract:
Fine-tuning large language models is a popular choice among users trying to adapt them for specific applications. However, fine-tuning these models is a demanding task because the user has to examine several factors, such as resource budget, runtime, model size and context length among others. A specific challenge is that fine-tuning is memory intensive, imposing constraints on the required hardwa…
▽ More
Fine-tuning large language models is a popular choice among users trying to adapt them for specific applications. However, fine-tuning these models is a demanding task because the user has to examine several factors, such as resource budget, runtime, model size and context length among others. A specific challenge is that fine-tuning is memory intensive, imposing constraints on the required hardware memory and context length of training data that can be handled. In this work, we share a detailed study on a variety of fine-tuning optimizations across different fine-tuning scenarios. In particular, we assess Gradient Checkpointing, Low-Rank Adaptation, DeepSpeed's Zero Redundancy Optimizer and FlashAttention. With a focus on memory and runtime, we examine the impact of different optimization combinations on GPU memory usage and execution runtime during fine-tuning phase. We provide our recommendation on the best default optimization for balancing memory and runtime across diverse model sizes. We share effective strategies for fine-tuning very large models with tens or hundreds of billions of parameters and enabling large context lengths during fine-tuning. Furthermore, we propose the appropriate optimization mixtures for fine-tuning under GPU resource limitations.
△ Less
Submitted 6 June, 2024; v1 submitted 4 June, 2024;
originally announced June 2024.
-
Fluids flow in granular aggregate packings reconstructed by high-energy X-ray computed tomography and lattice Boltzmann method
Authors:
Qifeng Lyu,
Anguo Chen,
Jie Jia,
Amardeep Singh,
Pengfei Dai
Abstract:
Properties of fluids flow in granular aggregates are important for the design of pervious infrastructures used to alleviate urban water-logging problems. Here in this work, five groups of aggregates packing with similar average porosities but varying particle sizes were scanned by a high-energy X-ray computed tomography (X-CT) facility. The structures of the packings were reconstructed. Porosities…
▽ More
Properties of fluids flow in granular aggregates are important for the design of pervious infrastructures used to alleviate urban water-logging problems. Here in this work, five groups of aggregates packing with similar average porosities but varying particle sizes were scanned by a high-energy X-ray computed tomography (X-CT) facility. The structures of the packings were reconstructed. Porosities were calculated and compared with those measured by the volume and mass of infilled water in the packing. Then pore networks were extracted and analyzed. Simulations of fluids flow in the packings were performed by using a lattice Boltzmann method (LBM) with BGK (Bhatnagar-Gross-Krook) collision model in the pore-network domain of the packings. Results showed wall effect on the porosity of aggregates packing was significant and the influence increased with the aggregate sizes. In addition, Poisson law and power law can be used to fit the coordination number and coordination volume of the packing's pore network, respectively. Moreover, the mass flow rates of fluids in the aggregates were affected by the porosities. On the two-dimensional slices, the mass flow rate decreased when the slice porosity increased. But for the three-dimensional blocks, the average mass flow rate increased with the volume porosity. And the permeability of the aggregates packing showed correlating change trend with the average pore diameter and fitting parameters of coordination volumes, when the sizes of aggregates changed. Though the limitation of merging interfaces causing fluctuation and discontinuity on micro parameters of fluid flow existed, the methods and results here may provide knowledge and insights for numerical simulations and optimal design of aggregate-based materials.
△ Less
Submitted 2 June, 2024;
originally announced June 2024.
-
The Importance of Online Data: Understanding Preference Fine-tuning via Coverage
Authors:
Yuda Song,
Gokul Swamy,
Aarti Singh,
J. Andrew Bagnell,
Wen Sun
Abstract:
Learning from human preference data has emerged as the dominant paradigm for fine-tuning large language models (LLMs). The two most common families of techniques -- online reinforcement learning (RL) such as Proximal Policy Optimization (PPO) and offline contrastive methods such as Direct Preference Optimization (DPO) -- were positioned as equivalent in prior work due to the fact that both have to…
▽ More
Learning from human preference data has emerged as the dominant paradigm for fine-tuning large language models (LLMs). The two most common families of techniques -- online reinforcement learning (RL) such as Proximal Policy Optimization (PPO) and offline contrastive methods such as Direct Preference Optimization (DPO) -- were positioned as equivalent in prior work due to the fact that both have to start from the same offline preference dataset. To further expand our theoretical understanding of the similarities and differences between online and offline techniques for preference fine-tuning, we conduct a rigorous analysis through the lens of dataset coverage, a concept that captures how the training data covers the test distribution and is widely used in RL. We prove that a global coverage condition is both necessary and sufficient for offline contrastive methods to converge to the optimal policy, but a weaker partial coverage condition suffices for online RL methods. This separation provides one explanation of why online RL methods can perform better than offline methods, especially when the offline preference data is not diverse enough. Finally, motivated by our preceding theoretical observations, we derive a hybrid preference optimization (HyPO) algorithm that uses offline data for contrastive-based preference optimization and online data for KL regularization. Theoretically and empirically, we demonstrate that HyPO is more performant than its pure offline counterpart DPO, while still preserving its computation and memory efficiency.
△ Less
Submitted 16 July, 2024; v1 submitted 3 June, 2024;
originally announced June 2024.
-
Progenitor and explosion properties of SN 2023ixf estimated based on a light-curve model grid of Type II supernovae
Authors:
Takashi J. Moriya,
Avinash Singh
Abstract:
We estimate the progenitor and explosion properties of the nearby Type II SN 2023ixf using a synthetic model grid of Type II supernova light curves. By comparing the light curves of SN 2023ixf with the pre-existing grid of Type II supernovae containing about 228,000 models with different combinations of the progenitor and explosion properties, we obtain the chi2 value for every model and evaluate…
▽ More
We estimate the progenitor and explosion properties of the nearby Type II SN 2023ixf using a synthetic model grid of Type II supernova light curves. By comparing the light curves of SN 2023ixf with the pre-existing grid of Type II supernovae containing about 228,000 models with different combinations of the progenitor and explosion properties, we obtain the chi2 value for every model and evaluate the properties of the models providing small values of chi2. We found that the light-curve models with the progenitor zero-age main-sequence mass of 10 Msun, the explosion energy of (2-3)e51 erg, the 56Ni mass of 0.04-0.06 Msun, the mass-loss rate of 1e-3 - 1e-2 Msun/yr with a wind velocity of 10 km/s, and the dense, confined circumstellar matter radius of (6-10)e14 cm match well to the observed light curves of SN 2023ixf. The photospheric velocity evolution of these models is also consistent with the observed velocity evolution. We note that the progenitor mass estimate could be affected by the adopted progenitor models. Although our parameter estimation is based on a pre-existing model grid and we do not perform any additional computations, the estimated parameters are consistent with those obtained by the detailed modeling of SN 2023ixf previously reported. This result shows that comparing the pre-existing model grid is a reasonable way to obtain a rough estimate for the properties of Type II supernovae. This simple way to estimate the properties of Type II supernovae will be essential in the Vera C. Rubin Observatory's Legacy Survey of Space and Time (LSST) era when thousands of Type II supernovae are expected to be discovered yearly.
△ Less
Submitted 17 July, 2024; v1 submitted 2 June, 2024;
originally announced June 2024.
-
ViSpeR: Multilingual Audio-Visual Speech Recognition
Authors:
Sanath Narayan,
Yasser Abdelaziz Dahou Djilali,
Ankit Singh,
Eustache Le Bihan,
Hakim Hacid
Abstract:
This work presents an extensive and detailed study on Audio-Visual Speech Recognition (AVSR) for five widely spoken languages: Chinese, Spanish, English, Arabic, and French. We have collected large-scale datasets for each language except for English, and have engaged in the training of supervised learning models. Our model, ViSpeR, is trained in a multi-lingual setting, resulting in competitive pe…
▽ More
This work presents an extensive and detailed study on Audio-Visual Speech Recognition (AVSR) for five widely spoken languages: Chinese, Spanish, English, Arabic, and French. We have collected large-scale datasets for each language except for English, and have engaged in the training of supervised learning models. Our model, ViSpeR, is trained in a multi-lingual setting, resulting in competitive performance on newly established benchmarks for each language. The datasets and models are released to the community with an aim to serve as a foundation for triggering and feeding further research work and exploration on Audio-Visual Speech Recognition, an increasingly important area of research. Code available at \href{https://github.com/YasserdahouML/visper}{https://github.com/YasserdahouML/visper}.
△ Less
Submitted 27 May, 2024;
originally announced June 2024.
-
Unravelling the asphericities in the explosion and multi-faceted circumstellar matter of SN 2023ixf
Authors:
Avinash Singh,
R. S. Teja,
T. J. Moriya,
K. Maeda,
K. S. Kawabata,
M. Tanaka,
R. Imazawa,
T. Nakaoka,
A. Gangopadhyay,
M. Yamanaka,
V. Swain,
D. K. Sahu,
G. C. Anupama,
B. Kumar,
R. M. Anche,
Y. Sano,
A. Raj,
V. K. Agnihotri,
V. Bhalerao,
D. Bisht,
M. S. Bisht,
K. Belwal,
S. K. Chakrabarti,
M. Fujii,
T. Nagayama
, et al. (11 additional authors not shown)
Abstract:
We present a detailed investigation of photometric, spectroscopic, and polarimetric observations of the Type II SN 2023ixf. The early detection of highly-ionized flash features, rapid ascent in ultraviolet flux coupled with the blueward shift in near-ultraviolet colors and temperature provides compelling evidence for a delayed shock breakout from a confined dense circumstellar matter (CSM) envelop…
▽ More
We present a detailed investigation of photometric, spectroscopic, and polarimetric observations of the Type II SN 2023ixf. The early detection of highly-ionized flash features, rapid ascent in ultraviolet flux coupled with the blueward shift in near-ultraviolet colors and temperature provides compelling evidence for a delayed shock breakout from a confined dense circumstellar matter (CSM) enveloping the progenitor star. The temporal evolution of polarization in the SN 2023ixf phase revealed three distinct peaks in polarization evolution at 1.4 d, 6.4 d, and 79.2 d, indicating an asymmetric dense CSM, an aspherical shock front and clumpiness in the low-density extended CSM, and an aspherical inner ejecta/He-core. SN 2023ixf displayed two dominant axes, one along the CSM-outer ejecta and the other along the inner ejecta/He-core, showcasing the independent origin of asymmetry in the early and late evolution. The argument for an aspherical shock front is further strengthened by the presence of a high-velocity broad absorption feature in the blue wing of the Balmer features in addition to the P-Cygni absorption post 16 d. Hydrodynamical light curve modeling indicated a progenitor mass of 10 solar mass with a radius of 470 solar radius, explosion energy of 2e51 erg, and 0.06 solar mass of 56Ni. The modeling also indicated a two-zone CSM: a confined dense CSM extending up to 5e14 cm, with a mass-loss rate of 1e-2 solar mass per year, and an extended CSM spanning from 5e14 cm to 1e16 cm with a mass-loss rate of 1e-4 solar mass per year. The early nebular phase observations display an axisymmetric line profile of [OI] and red-ward attenuation of the emission of Halpha post 125 days, marking the onset of dust formation.
△ Less
Submitted 31 May, 2024;
originally announced May 2024.
-
Can GPT Redefine Medical Understanding? Evaluating GPT on Biomedical Machine Reading Comprehension
Authors:
Shubham Vatsal,
Ayush Singh
Abstract:
Large language models (LLMs) have shown remarkable performance on many tasks in different domains. However, their performance in closed-book biomedical machine reading comprehension (MRC) has not been evaluated in depth. In this work, we evaluate GPT on four closed-book biomedical MRC benchmarks. We experiment with different conventional prompting techniques as well as introduce our own novel prom…
▽ More
Large language models (LLMs) have shown remarkable performance on many tasks in different domains. However, their performance in closed-book biomedical machine reading comprehension (MRC) has not been evaluated in depth. In this work, we evaluate GPT on four closed-book biomedical MRC benchmarks. We experiment with different conventional prompting techniques as well as introduce our own novel prompting method. To solve some of the retrieval problems inherent to LLMs, we propose a prompting strategy named Implicit Retrieval Augmented Generation (RAG) that alleviates the need for using vector databases to retrieve important chunks in traditional RAG setups. Moreover, we report qualitative assessments on the natural language generation outputs from our approach. The results show that our new prompting technique is able to get the best performance in two out of four datasets and ranks second in rest of them. Experiments show that modern-day LLMs like GPT even in a zero-shot setting can outperform supervised models, leading to new state-of-the-art (SoTA) results on two of the benchmarks.
△ Less
Submitted 28 May, 2024;
originally announced May 2024.
-
Learning Social Welfare Functions
Authors:
Kanad Shrikar Pardeshi,
Itai Shapira,
Ariel D. Procaccia,
Aarti Singh
Abstract:
Is it possible to understand or imitate a policy maker's rationale by looking at past decisions they made? We formalize this question as the problem of learning social welfare functions belonging to the well-studied family of power mean functions. We focus on two learning tasks; in the first, the input is vectors of utilities of an action (decision or policy) for individuals in a group and their a…
▽ More
Is it possible to understand or imitate a policy maker's rationale by looking at past decisions they made? We formalize this question as the problem of learning social welfare functions belonging to the well-studied family of power mean functions. We focus on two learning tasks; in the first, the input is vectors of utilities of an action (decision or policy) for individuals in a group and their associated social welfare as judged by a policy maker, whereas in the second, the input is pairwise comparisons between the welfares associated with a given pair of utility vectors. We show that power mean functions are learnable with polynomial sample complexity in both cases, even if the comparisons are social welfare information is noisy. Finally, we design practical algorithms for these tasks and evaluate their performance.
△ Less
Submitted 27 May, 2024;
originally announced May 2024.
-
Multi-agent Collaborative Perception for Robotic Fleet: A Systematic Review
Authors:
Apoorv Singh,
Gaurav Raut,
Alka Choudhary
Abstract:
Collaborative perception in multi-robot fleets is a way to incorporate the power of unity in robotic fleets. Collaborative perception refers to the collective ability of multiple entities or agents to share and integrate their sensory information for a more comprehensive understanding of their environment. In other words, it involves the collaboration and fusion of data from various sensors or sou…
▽ More
Collaborative perception in multi-robot fleets is a way to incorporate the power of unity in robotic fleets. Collaborative perception refers to the collective ability of multiple entities or agents to share and integrate their sensory information for a more comprehensive understanding of their environment. In other words, it involves the collaboration and fusion of data from various sensors or sources to enhance perception and decision-making capabilities. By combining data from diverse sources, such as cameras, lidar, radar, or other sensors, the system can create a more accurate and robust representation of the environment. In this review paper, we have summarized findings from 20+ research papers on collaborative perception. Moreover, we discuss testing and evaluation frameworks commonly accepted in academia and industry for autonomous vehicles and autonomous mobile robots. Our experiments with the trivial perception module show an improvement of over 200% with collaborative perception compared to individual robot perception. Here's our GitHub repository that shows the benefits of collaborative perception: https://github.com/synapsemobility/synapseBEV
△ Less
Submitted 22 March, 2024;
originally announced May 2024.
-
Enhancing Adverse Drug Event Detection with Multimodal Dataset: Corpus Creation and Model Development
Authors:
Pranab Sahoo,
Ayush Kumar Singh,
Sriparna Saha,
Aman Chadha,
Samrat Mondal
Abstract:
The mining of adverse drug events (ADEs) is pivotal in pharmacovigilance, enhancing patient safety by identifying potential risks associated with medications, facilitating early detection of adverse events, and guiding regulatory decision-making. Traditional ADE detection methods are reliable but slow, not easily adaptable to large-scale operations, and offer limited information. With the exponent…
▽ More
The mining of adverse drug events (ADEs) is pivotal in pharmacovigilance, enhancing patient safety by identifying potential risks associated with medications, facilitating early detection of adverse events, and guiding regulatory decision-making. Traditional ADE detection methods are reliable but slow, not easily adaptable to large-scale operations, and offer limited information. With the exponential increase in data sources like social media content, biomedical literature, and Electronic Medical Records (EMR), extracting relevant ADE-related information from these unstructured texts is imperative. Previous ADE mining studies have focused on text-based methodologies, overlooking visual cues, limiting contextual comprehension, and hindering accurate interpretation. To address this gap, we present a MultiModal Adverse Drug Event (MMADE) detection dataset, merging ADE-related textual information with visual aids. Additionally, we introduce a framework that leverages the capabilities of LLMs and VLMs for ADE detection by generating detailed descriptions of medical images depicting ADEs, aiding healthcare professionals in visually identifying adverse events. Using our MMADE dataset, we showcase the significance of integrating visual cues from images to enhance overall performance. This approach holds promise for patient safety, ADE awareness, and healthcare accessibility, paving the way for further exploration in personalized healthcare.
△ Less
Submitted 26 May, 2024; v1 submitted 24 May, 2024;
originally announced May 2024.
-
A generalized $Λ$CDM model with parameterized Hubble parameter in particle creation, viscous and $f(R)$ model framework
Authors:
G. P. Singh,
Romanshu Garg,
Ashutosh Singh
Abstract:
In this study, we construct a theoretical framework based on the generalized Hubble parameter form which may arise within the particle creation, viscous and $f(R)$ gravity theory. The Hubble parameter is scrutinized for its compatibility with the observational data relevant to the late-time universe. By using Bayesian statistical techniques based on $χ^{2}$ minimization method, we determine model…
▽ More
In this study, we construct a theoretical framework based on the generalized Hubble parameter form which may arise within the particle creation, viscous and $f(R)$ gravity theory. The Hubble parameter is scrutinized for its compatibility with the observational data relevant to the late-time universe. By using Bayesian statistical techniques based on $χ^{2}$ minimization method, we determine model parameters's best fit values for the cosmic chronometer and supernovae Pantheon datasets. For the best fit values, the cosmographic and physical parameters are analyzed to understand the cosmic dynamics in model.
△ Less
Submitted 24 May, 2024;
originally announced May 2024.
-
Unsupervised Deep Neural Network Approach To Solve Fermionic Systems
Authors:
Avishek Singh,
Nirmal Ganguli
Abstract:
Solving the Schrödinger equation for interacting many-body quantum systems faces computational challenges due to exponential scaling with system size. This complexity limits the study of important phenomena in materials science and physics. We develop an Artificial Neural Network (ANN)-driven algorithm to simulate fermionic systems on lattices. Our method uses Pauli matrices to represent quantum s…
▽ More
Solving the Schrödinger equation for interacting many-body quantum systems faces computational challenges due to exponential scaling with system size. This complexity limits the study of important phenomena in materials science and physics. We develop an Artificial Neural Network (ANN)-driven algorithm to simulate fermionic systems on lattices. Our method uses Pauli matrices to represent quantum states, incorporates Markov Chain Monte Carlo sampling, and leverages an adaptive momentum optimizer. We demonstrate the algorithm's accuracy by simulating the Heisenberg Hamiltonian on a one-dimensional lattice, achieving results with an error in the order of $10^{-4}$ compared to exact diagonalization. Furthermore, we successfully model a magnetic phase transition in a two-dimensional lattice under an applied magnetic field. Importantly, our approach avoids the sign problem common to traditional Fermionic Monte Carlo methods, enabling the investigation of frustrated systems. This work demonstrates the potential of ANN-based algorithms for efficient simulation of complex quantum systems, opening avenues for discoveries in condensed matter physics and materials science.
△ Less
Submitted 24 May, 2024;
originally announced May 2024.
-
Unsupervised Deep Neural Network Approach To Solve Bosonic Systems
Authors:
Avishek Singh,
Nirmal Ganguli
Abstract:
The simulation of quantum many-body systems poses a significant challenge in physics due to the exponential scaling of Hilbert space with the number of particles. Traditional methods often struggle with large system sizes and frustrated lattices. In this research article, we present a novel algorithm that leverages the power of deep neural networks combined with Markov Chain Monte Carlo simulation…
▽ More
The simulation of quantum many-body systems poses a significant challenge in physics due to the exponential scaling of Hilbert space with the number of particles. Traditional methods often struggle with large system sizes and frustrated lattices. In this research article, we present a novel algorithm that leverages the power of deep neural networks combined with Markov Chain Monte Carlo simulation to address these limitations. Our method introduces a neural network architecture specifically designed to represent bosonic quantum states on a 1D lattice chain. We successfully achieve the ground state of the Bose-Hubbard model, demonstrating the superiority of the adaptive momentum optimizer for convergence speed and stability. Notably, our approach offers flexibility in simulating various lattice geometries and potentially larger system sizes, making it a valuable tool for exploring complex quantum phenomena. This work represents a substantial advancement in the field of quantum simulation, opening new possibilities for investigating previously challenging systems.
△ Less
Submitted 24 May, 2024;
originally announced May 2024.
-
Semantic Aware Diffusion Inverse Tone Mapping
Authors:
Abhishek Goswami,
Aru Ranjan Singh,
Francesco Banterle,
Kurt Debattista,
Thomas Bashford-Rogers
Abstract:
The range of real-world scene luminance is larger than the capture capability of many digital camera sensors which leads to details being lost in captured images, most typically in bright regions. Inverse tone mapping attempts to boost these captured Standard Dynamic Range (SDR) images back to High Dynamic Range (HDR) by creating a mapping that linearizes the well exposed values from the SDR image…
▽ More
The range of real-world scene luminance is larger than the capture capability of many digital camera sensors which leads to details being lost in captured images, most typically in bright regions. Inverse tone mapping attempts to boost these captured Standard Dynamic Range (SDR) images back to High Dynamic Range (HDR) by creating a mapping that linearizes the well exposed values from the SDR image, and provides a luminance boost to the clipped content. However, in most cases, the details in the clipped regions cannot be recovered or estimated. In this paper, we present a novel inverse tone mapping approach for mapping SDR images to HDR that generates lost details in clipped regions through a semantic-aware diffusion based inpainting approach. Our method proposes two major contributions - first, we propose to use a semantic graph to guide SDR diffusion based inpainting in masked regions in a saturated image. Second, drawing inspiration from traditional HDR imaging and bracketing methods, we propose a principled formulation to lift the SDR inpainted regions to HDR that is compatible with generative inpainting methods. Results show that our method demonstrates superior performance across different datasets on objective metrics, and subjective experiments show that the proposed method matches (and in most cases outperforms) state-of-art inverse tone mapping operators in terms of objective metrics and outperforms them for visual fidelity.
△ Less
Submitted 24 May, 2024;
originally announced May 2024.
-
Fitness noise in the Bak-Sneppen evolution model in high dimensions
Authors:
Rahul Chhimpa,
Abha Singh,
Avinash Chand Yadav
Abstract:
We study the Bak-Sneppen evolution model on a regular hypercubic lattice in high dimensions. Recent work [Phys. Rev. E 108, 044109 (2023)] has shown the emergence of the $1/f^α$ noise for the ``fitness'' observable with $α\approx 1.2$ in one-dimension (1D) and $α\approx 2$ for the random neighbor (mean-field) version of the model. We examine the temporal correlation of fitness in 2, 3, and 4 dimen…
▽ More
We study the Bak-Sneppen evolution model on a regular hypercubic lattice in high dimensions. Recent work [Phys. Rev. E 108, 044109 (2023)] has shown the emergence of the $1/f^α$ noise for the ``fitness'' observable with $α\approx 1.2$ in one-dimension (1D) and $α\approx 2$ for the random neighbor (mean-field) version of the model. We examine the temporal correlation of fitness in 2, 3, and 4 dimensions. As obtained by finite-size scaling, the spectral exponent tends to take the mean-field value at the upper critical dimension ${\rm D}_u = 4$, which is consistent with previous studies. Our approach provides an alternative way to understand the upper critical dimension of the model. We also show the local activity power spectra, which offer insight into return time statistics and the avalanche dimension.
△ Less
Submitted 24 May, 2024;
originally announced May 2024.
-
SDSS-V Local Volume Mapper (LVM): A Glimpse into Orion
Authors:
K. Kreckel,
O. V. Egorov,
E. Egorova,
G. A. Blanc,
N. Drory,
M. Kounkel,
J. E. Mendez-Delgado,
C. G. Roman-Zuniga,
S. F. Sanchez,
G. S. Stringfellow,
A. M. Stutz,
E. Zari,
J. K. Barrera-Ballesteros,
D. Bizyaev,
J. R. Brownstein,
E. Congiu,
J. G. Fernandez-Trincado,
P. Garcia,
L. Hillenbrand,
H. J. Ibarra-Medel,
Y. Jin,
E. J. Johnston,
A. M. Jones,
J. Serena Kim,
J. A. Kollmeier
, et al. (15 additional authors not shown)
Abstract:
The Orion Molecular Cloud complex, one of the nearest (D = 406 pc) and most extensively studied massive star-forming regions, is ideal for constraining the physics of stellar feedback, but its ~12 deg diameter on the sky requires a dedicated approach to mapping ionized gas structures within and around the nebula. The Sloan Digital Sky Survey (SDSS-V) Local Volume Mapper (LVM) is a new optical inte…
▽ More
The Orion Molecular Cloud complex, one of the nearest (D = 406 pc) and most extensively studied massive star-forming regions, is ideal for constraining the physics of stellar feedback, but its ~12 deg diameter on the sky requires a dedicated approach to mapping ionized gas structures within and around the nebula. The Sloan Digital Sky Survey (SDSS-V) Local Volume Mapper (LVM) is a new optical integral field unit (IFU) that will map the ionized gas within the Milky Way and Local Group galaxies, covering 4300 deg^2 of the sky with the new LVM Instrument. We showcase optical emission line maps from LVM covering 12 deg^2 inside of the Orion belt region, with 195,000 individual spectra combined to produce images at 0.07 pc (35.3") resolution. This is the largest IFU map made (to date) of the Milky Way, and contains well-known nebulae (the Horsehead Nebula, Flame Nebula, IC 434, and IC 432), as well as ionized interfaces with the neighboring dense Orion B molecular cloud. We resolve the ionization structure of each nebula, and map the increase in both the [SII]/Ha and [NII]/Ha line ratios at the outskirts of nebulae and along the ionization front with Orion B. [OIII] line emission is only spatially resolved within the center of the Flame Nebula and IC 434, and our ~0.1 pc scale line ratio diagrams show how variations in these diagnostics are lost as we move from the resolved to the integrated view of each nebula. We detect ionized gas emission associated with the dusty bow wave driven ahead of the star sigma Orionis, where the stellar wind interacts with the ambient interstellar medium. The Horsehead Nebula is seen as a dark occlusion of the bright surrounding photo-disassociation region. This small glimpse into Orion only hints at the rich science that will be enabled by the LVM.
△ Less
Submitted 7 August, 2024; v1 submitted 23 May, 2024;
originally announced May 2024.
-
Nanoscale Terahertz Conductivity and Ultrafast Dynamics of Terahertz Plasmons in Periodic Arrays of Epitaxial Graphene Nanoribbons
Authors:
Arvind Singh,
Hynek Němec,
Jan Kunc,
Petr Kužel
Abstract:
Dynamics of plasmons in nanoribbons of (hydrogen intercalated) quasi-free-standing single layer graphene is studied by terahertz spectroscopy both in the steady state and upon photoexcitation by an ultrashort near infrared laser pulse. The use of two-dimensional frequency domain analysis of the optical pump - THz probe signals allows us to determine the evolution of carrier temperature and plasmon…
▽ More
Dynamics of plasmons in nanoribbons of (hydrogen intercalated) quasi-free-standing single layer graphene is studied by terahertz spectroscopy both in the steady state and upon photoexcitation by an ultrashort near infrared laser pulse. The use of two-dimensional frequency domain analysis of the optical pump - THz probe signals allows us to determine the evolution of carrier temperature and plasmon characteristics with ~100 fs time resolution. Namely, we find that the carrier temperature decreases from more than 5000 K to the lattice temperature within about 7 ps and that during this evolution the carrier mobility remains practically constant. The time-resolved THz conductivity spectra suggest that graphene nanoribbons contain defects which act as low potential barriers causing a weak localization of charges; the potential barriers are overcome upon photoexcitation. Furthermore, the edges of graphene nanoribbons are found to slightly enhance the scattering of carriers. The results are supported by complementary measurements using THz scanning near-field microscopy which confirm a high uniformity of the THz conductivity across the sample and demonstrate high enough sensitivity to resolve even the impact of nanometric terrace steps on SiC substrate under the graphene monolayer.
△ Less
Submitted 24 June, 2024; v1 submitted 22 May, 2024;
originally announced May 2024.
-
Analysis of Stick-Slip Motion as a Jump Phenomenon
Authors:
Vinay A. Juvekar,
Arun K. Singh
Abstract:
In this work, we analyse the stick-slip motion of a soft elastomeric block on a smooth, hard surface under the application of shear, which is induced by a puller moving at a steady velocity. The frictional stress is generated by make-break of bonds between the pendent chains of the elastomeric block and bonding sites on the hard surface. Relation between velocity and frictional stress has been est…
▽ More
In this work, we analyse the stick-slip motion of a soft elastomeric block on a smooth, hard surface under the application of shear, which is induced by a puller moving at a steady velocity. The frictional stress is generated by make-break of bonds between the pendent chains of the elastomeric block and bonding sites on the hard surface. Relation between velocity and frictional stress has been estimated using the bond-population balance model. Stick-slip motion occurs when the pulling velocity is lower than a critical value. Unlike, the rate-and-state friction model which views the stick-slip motion as a limit cycle, we show that during the stick phase, the sliding surface actually sticks to the hard surface and remains stationary till the shear exerted by puller causes rupture of all bonds between contacting surfaces. The major fraction of the bonds undergo catastrophic rupture so as to cause the sliding surface to slip and attain a significantly higher velocity than the pulling velocity. During the slip phase, the sliding friction is balanced by rapid make-break of weak bonds. As the sliding velocity decreases, the bonds undergo aging and the adhesion stress increases. When the bond adhesion stress exceeds the pulling stress, the contacting surfaces stick together. We have mathematically modeled both the stick and the slip regimes using the bond-population balance model. We have validated the model using the experimental data from the work of Baumberger et al (2002) on sliding of an elastomeric gelatine-gel block on a glass surface.
△ Less
Submitted 21 May, 2024;
originally announced May 2024.
-
Prediction of Cryptocurrency Prices through a Path Dependent Monte Carlo Simulation
Authors:
Ayush Singh,
Anshu K. Jha,
Amit N. Kumar
Abstract:
In this paper, our focus lies on the Merton's jump diffusion model, employing jump processes characterized by the compound Poisson process. Our primary objective is to forecast the drift and volatility of the model using a variety of methodologies. We adopt an approach that involves implementing different drift, volatility, and jump terms within the model through various machine learning technique…
▽ More
In this paper, our focus lies on the Merton's jump diffusion model, employing jump processes characterized by the compound Poisson process. Our primary objective is to forecast the drift and volatility of the model using a variety of methodologies. We adopt an approach that involves implementing different drift, volatility, and jump terms within the model through various machine learning techniques, traditional methods, and statistical methods on price-volume data. Additionally, we introduce a path-dependent Monte Carlo simulation to model cryptocurrency prices, taking into account the volatility and unexpected jumps in prices.
△ Less
Submitted 10 April, 2024;
originally announced May 2024.
-
Lagrangian multiform for cyclotomic Gaudin models
Authors:
Vincent Caudrelier,
Anup Anand Singh,
Benoit Vicedo
Abstract:
We construct a Lagrangian multiform for the class of cyclotomic (rational) Gaudin models by formulating its hierarchy within the Lie dialgebra framework of Semenov-Tian-Shansky and by using the framework of Lagrangian multiforms on coadjoint orbits. This provides the first example of a Lagrangian multiform for an integrable hierarchy whose classical $r$-matrix is non-skew-symmetric and spectral pa…
▽ More
We construct a Lagrangian multiform for the class of cyclotomic (rational) Gaudin models by formulating its hierarchy within the Lie dialgebra framework of Semenov-Tian-Shansky and by using the framework of Lagrangian multiforms on coadjoint orbits. This provides the first example of a Lagrangian multiform for an integrable hierarchy whose classical $r$-matrix is non-skew-symmetric and spectral parameter-dependent. As an important by-product of the construction, we obtain a Lagrangian multiform for the periodic Toda chain by choosing an appropriate realisation of the cyclotomic Gaudin Lax matrix. This fills a gap in the landscape of Toda models as only the open and infinite chains had been previously cast into the Lagrangian multiform framework. A slightly different choice of realisation produces the so-called DST model. We demonstrate the versatility of the framework by coupling the periodic Toda chain with the DST model and by obtaining a Lagrangian multiform for the corresponding integrable hierarchy.
△ Less
Submitted 21 May, 2024;
originally announced May 2024.