Showing 1–50 of 1,168 results for author: Davis, J

Deep Learning Improvements for Sparse Spatial Field Reconstruction

Authors: Robert Sunderhaft, Logan Frank, Jim Davis

Abstract: Accurately reconstructing a global spatial field from sparse data has been a longstanding problem in several domains, such as Earth Sciences and Fluid Dynamics. Historically, scientists have approached this problem by employing complex physics models to reconstruct the spatial fields. However, these methods are often computationally intensive. With the increase in popularity of machine learning (M… ▽ More Accurately reconstructing a global spatial field from sparse data has been a longstanding problem in several domains, such as Earth Sciences and Fluid Dynamics. Historically, scientists have approached this problem by employing complex physics models to reconstruct the spatial fields. However, these methods are often computationally intensive. With the increase in popularity of machine learning (ML), several researchers have applied ML to the spatial field reconstruction task and observed improvements in computational efficiency. One such method in arXiv:2101.00554 utilizes a sparse mask of sensor locations and a Voronoi tessellation with sensor measurements as inputs to a convolutional neural network for reconstructing the global spatial field. In this work, we propose multiple adjustments to the aforementioned approach and show improvements on geoscience and fluid dynamics simulation datasets. We identify and discuss scenarios that benefit the most using the proposed ML-based spatial field reconstruction approach. △ Less

Submitted 22 August, 2024; originally announced August 2024.

Energy Estimation of Last Mile Electric Vehicle Routes

Authors: André Snoeck, Aniruddha Bhargava, Daniel Merchan, Josiah Davis, Julian Pachon

Abstract: Last-mile carriers increasingly incorporate electric vehicles (EVs) into their delivery fleet to achieve sustainability goals. This goal presents many challenges across multiple planning spaces including but not limited to how to plan EV routes. In this paper, we address the problem of predicting energy consumption of EVs for Last-Mile delivery routes using deep learning. We demonstrate the need t… ▽ More Last-mile carriers increasingly incorporate electric vehicles (EVs) into their delivery fleet to achieve sustainability goals. This goal presents many challenges across multiple planning spaces including but not limited to how to plan EV routes. In this paper, we address the problem of predicting energy consumption of EVs for Last-Mile delivery routes using deep learning. We demonstrate the need to move away from thinking about range and we propose using energy as the basic unit of analysis. We share a range of deep learning solutions, beginning with a Feed Forward Neural Network (NN) and Recurrent Neural Network (RNN) and demonstrate significant accuracy improvements relative to pure physics-based and distance-based approaches. Finally, we present Route Energy Transformer (RET) a decoder-only Transformer model sized according to Chinchilla scaling laws. RET yields a +217 Basis Points (bps) improvement in Mean Absolute Percentage Error (MAPE) relative to the Feed Forward NN and a +105 bps improvement relative to the RNN. △ Less

Submitted 21 August, 2024; originally announced August 2024.

Automatic Dataset Construction (ADC): Sample Collection, Data Curation, and Beyond

Authors: Minghao Liu, Zonglin Di, Jiaheng Wei, Zhongruo Wang, Hengxiang Zhang, Ruixuan Xiao, Haoyu Wang, Jinlong Pang, Hao Chen, Ankit Shah, Hongxin Wei, Xinlei He, Zhaowei Zhao, Haobo Wang, Lei Feng, Jindong Wang, James Davis, Yang Liu

Abstract: Large-scale data collection is essential for developing personalized training data, mitigating the shortage of training data, and fine-tuning specialized models. However, creating high-quality datasets quickly and accurately remains a challenge due to annotation errors, the substantial time and costs associated with human labor. To address these issues, we propose Automatic Dataset Construction (A… ▽ More Large-scale data collection is essential for developing personalized training data, mitigating the shortage of training data, and fine-tuning specialized models. However, creating high-quality datasets quickly and accurately remains a challenge due to annotation errors, the substantial time and costs associated with human labor. To address these issues, we propose Automatic Dataset Construction (ADC), an innovative methodology that automates dataset creation with negligible cost and high efficiency. Taking the image classification task as a starting point, ADC leverages LLMs for the detailed class design and code generation to collect relevant samples via search engines, significantly reducing the need for manual annotation and speeding up the data generation process. Despite these advantages, ADC also encounters real-world challenges such as label errors (label noise) and imbalanced data distributions (label bias). We provide open-source software that incorporates existing methods for label error detection, robust learning under noisy and biased data, ensuring a higher-quality training data and more robust model training procedure. Furthermore, we design three benchmark datasets focused on label noise detection, label noise learning, and class-imbalanced learning. These datasets are vital because there are few existing datasets specifically for label noise detection, despite its importance. Finally, we evaluate the performance of existing popular methods on these datasets, thereby facilitating further research in the field. △ Less

Submitted 21 August, 2024; originally announced August 2024.

Discovery of Dynamical Heterogeneity in a Supercooled Magnetic Monopole Fluid

Authors: Jahnatta Dasini, Chaia Carroll, Chun-Chih Hsu, Hiroto Takahashi, Jack Murphy, Sudarshan Sharma, Catherine Dawson, Fabian Jerzembeck, Stephen J. Blundell, Graeme Luke, J. C. Séamus Davis, Jonathan Ward

Abstract: Dynamical heterogeneity in which transitory local fluctuations occur in the conformation and dynamics of constituent particles, is essential for evolution of supercooled liquids into the glass state. Yet its microscopic spatiotemporal phenomenology has remained unobservable in virtually all supercooled glass forming liquids. Recent theoretical advances predict that corresponding dynamical heteroge… ▽ More Dynamical heterogeneity in which transitory local fluctuations occur in the conformation and dynamics of constituent particles, is essential for evolution of supercooled liquids into the glass state. Yet its microscopic spatiotemporal phenomenology has remained unobservable in virtually all supercooled glass forming liquids. Recent theoretical advances predict that corresponding dynamical heterogeneity could also occur in supercooled magnetic monopole fluids. Motivated thus, we searched for dynamical heterogeneity when entering the supercooled monopole fluid of Dy2Ti2O7. By measuring microsecond-resolved spontaneous magnetization noise M(t,T) at temperatures between 15 mK<T<2500 mK we discover a sharp bifurcation in monopole noise characteristics beginning below T$\approx 1500$ mK, with the appearance of powerful monopole current bursts. This unique new form of dynamical heterogeneity first emerges upon entering the supercooled monopole fluid regime, reaches maximum intensity near T$\approx 500$ mK and then terminates along with coincident loss of ergodicity near T$\lesssim 250$ mK. Surprisingly, however, low intensity monopole noise representing activity at approximately 2% of the Dy sites persists below T$\lesssim 250$ mK, implying a population of dynamical monopoles trapped within the spin-ice ground state as T$\rightarrow 0$. This overall phenomenology significantly expands our knowledge of both supercooled monopole fluids and of the ground state of spin-ice. More generally, we demonstrate how comprehensive direct detection of the time sequence, magnitude and statistics of dynamical heterogeneity can greatly accelerate fundamental vitrification studies. △ Less

Submitted 1 August, 2024; originally announced August 2024.

Identifying quantum resources in encoded computations

Authors: Jack Davis, Nicolas Fabre, Ulysse Chabaud

Abstract: What is the origin of quantum computational advantage? Providing answers to this far-reaching question amounts to identifying the key properties, or quantum resources, that distinguish quantum computers from their classical counterparts, with direct applications to the development of quantum devices. The advent of universal quantum computers, however, relies on error-correcting codes to protect fr… ▽ More What is the origin of quantum computational advantage? Providing answers to this far-reaching question amounts to identifying the key properties, or quantum resources, that distinguish quantum computers from their classical counterparts, with direct applications to the development of quantum devices. The advent of universal quantum computers, however, relies on error-correcting codes to protect fragile logical quantum information by robustly encoding it into symmetric states of a quantum physical system. Such encodings make the task of resource identification more difficult, as what constitutes a resource from the logical and physical points of view can differ significantly. Here we introduce a general framework which allows us to correctly identify quantum resources in encoded computations, based on phase-space techniques. For a given quantum code, our construction provides a Wigner function that accounts for how the symmetries of the code space are contained within the transformations of the physical space, resulting in an object capable of describing the logical content of any physical state, both within and outside the code space. We illustrate our general construction with the Gottesman--Kitaev--Preskill encoding of qudits with odd dimension. The resulting Wigner function, which we call the Zak-Gross Wigner function, is shown to correctly identify quantum resources through its phase-space negativity. For instance, it is positive for encoded stabilizer states and negative for the bosonic vacuum. We further prove several properties, including that its negativity provides a measure of magic for the logical content of a state, and that its marginals are modular measurement distributions associated to conjugate Zak patches. △ Less

Submitted 25 July, 2024; originally announced July 2024.

Combinatorial transfer: a new method for constructing infinite families of nonabelian difference sets, partial difference sets, and relative difference sets

Authors: Eric Swartz, James A. Davis, John Polhill, Ken W. Smith

Abstract: For nearly a century, mathematicians have been developing techniques for constructing abelian automorphism groups of combinatorial objects, and, conversely, constructing combinatorial objects from abelian groups. While abelian groups are a natural place to start, recent computational evidence strongly indicates that the vast majority of transitive automorphism groups of combinatorial objects are n… ▽ More For nearly a century, mathematicians have been developing techniques for constructing abelian automorphism groups of combinatorial objects, and, conversely, constructing combinatorial objects from abelian groups. While abelian groups are a natural place to start, recent computational evidence strongly indicates that the vast majority of transitive automorphism groups of combinatorial objects are nonabelian. This observation is the guiding motivation for this paper. We propose a new method for constructing nonabelian automorphism groups of combinatorial objects, which could be called the \textit{combinatorial transfer method}, and we demonstrate its power by finding (1) the first infinite families of nonabelian Denniston partial difference sets (including nonabelian Denniston PDSs of odd order), (2) the first infinite family of Spence difference sets in groups with a Sylow 3-subgroup that is non-normal and not elementary abelian, (3) the first infinite families of McFarland difference sets in groups with a Sylow $p$-subgroup that is non-normal and is not elementary abelian, (4) new infinite families of partial difference sets in nonabelian $p$-groups with large exponent, (5) an infinite family of semiregular relative difference sets whose forbidden subgroup is nonabelian, and (6) a converse to Dillon's Dihedral Trick in the PDS setting. We hope this paper will lead to more techniques to explore this largely unexplored topic. △ Less

Submitted 25 July, 2024; originally announced July 2024.

Networks of Networks: Complexity Class Principles Applied to Compound AI Systems Design

Authors: Jared Quincy Davis, Boris Hanin, Lingjiao Chen, Peter Bailis, Ion Stoica, Matei Zaharia

Abstract: As practitioners seek to surpass the current reliability and quality frontier of monolithic models, Compound AI Systems consisting of many language model inference calls are increasingly employed. In this work, we construct systems, which we call Networks of Networks (NoNs) organized around the distinction between generating a proposed answer and verifying its correctness, a fundamental concept in… ▽ More As practitioners seek to surpass the current reliability and quality frontier of monolithic models, Compound AI Systems consisting of many language model inference calls are increasingly employed. In this work, we construct systems, which we call Networks of Networks (NoNs) organized around the distinction between generating a proposed answer and verifying its correctness, a fundamental concept in complexity theory that we show empirically extends to Language Models (LMs). We introduce a verifier-based judge NoN with K generators, an instantiation of "best-of-K" or "judge-based" compound AI systems. Through experiments on synthetic tasks such as prime factorization, and core benchmarks such as the MMLU, we demonstrate notable performance gains. For instance, in factoring products of two 3-digit primes, a simple NoN improves accuracy from 3.7\% to 36.6\%. On MMLU, a verifier-based judge construction with only 3 generators boosts accuracy over individual GPT-4-Turbo calls by 2.8\%. Our analysis reveals that these gains are most pronounced in domains where verification is notably easier than generation--a characterization which we believe subsumes many reasoning and procedural knowledge tasks, but doesn't often hold for factual and declarative knowledge-based settings. For mathematical and formal logic reasoning-based subjects of MMLU, we observe a 5-8\% or higher gain, whilst no gain on others such as geography and religion. We provide key takeaways for ML practitioners, including the importance of considering verification complexity, the impact of witness format on verifiability, and a simple test to determine the potential benefit of this NoN approach for a given problem distribution. This work aims to inform future research and practice in the design of compound AI systems. △ Less

Submitted 23 July, 2024; originally announced July 2024.

Overfitting In Contrastive Learning?

Authors: Zachary Rabin, Jim Davis, Benjamin Lewis, Matthew Scherreik

Abstract: Overfitting describes a machine learning phenomenon where the model fits too closely to the training data, resulting in poor generalization. While this occurrence is thoroughly documented for many forms of supervised learning, it is not well examined in the context of unsupervised learning. In this work we examine the nature of overfitting in unsupervised contrastive learning. We show that overfit… ▽ More Overfitting describes a machine learning phenomenon where the model fits too closely to the training data, resulting in poor generalization. While this occurrence is thoroughly documented for many forms of supervised learning, it is not well examined in the context of unsupervised learning. In this work we examine the nature of overfitting in unsupervised contrastive learning. We show that overfitting can indeed occur and the mechanism behind overfitting. △ Less

Submitted 22 August, 2024; v1 submitted 16 July, 2024; originally announced July 2024.

Pruning One More Token is Enough: Leveraging Latency-Workload Non-Linearities for Vision Transformers on the Edge

Authors: Nick John Eliopoulos, Purvish Jajal, James Davis, Gaowen Liu, George K. Thiravathukal, Yung-Hsiang Lu

Abstract: This paper investigates how to efficiently deploy vision transformers on edge devices. Recent methods reduce the latency of transformer neural networks by removing or merging tokens, with small accuracy degradation. However, these methods are not designed with edge device deployment in mind: jthey do not leverage information about the latency vs. workload trends to improve efficiency. First, we sh… ▽ More This paper investigates how to efficiently deploy vision transformers on edge devices. Recent methods reduce the latency of transformer neural networks by removing or merging tokens, with small accuracy degradation. However, these methods are not designed with edge device deployment in mind: jthey do not leverage information about the latency vs. workload trends to improve efficiency. First, we show the latency-workload size relationship is nonlinear for certain workload sizes. We consider this relationship to create a token pruning schedule. Second, we demonstrate a training-free, token pruning method utilizing this schedule. We show that for single batch inference, other methods increase latency by 18.6-30.3% with respect to baseline, while we can reduce it by 9%. For similar latency (within 5.2%) across devices we achieve 78.6%-84.5% ImageNet1K accuracy, while the state-of-the-art, Token Merging, achieves 45.8%-85.4%. △ Less

Submitted 18 July, 2024; v1 submitted 1 July, 2024; originally announced July 2024.

Quantum Noise Spectroscopy of Criticality in an Atomically Thin Magnet

Authors: Mark E. Ziffer, Francisco Machado, Benedikt Ursprung, Artur Lozovoi, Aya Batoul Tazi, Zhiyang Yuan, Michael E. Ziebel, Tom Delord, Nanyu Zeng, Evan Telford, Daniel G. Chica, Dane W. deQuilettes, Xiaoyang Zhu, James C. Hone, Kenneth L. Shepard, Xavier Roy, Nathalie P. de Leon, Emily J. Davis, Shubhayu Chatterjee, Carlos A. Meriles, Jonathan S. Owen, P. James Schuck, Abhay N. Pasupathy

Abstract: Dynamic critical fluctuations in magnetic materials encode important information about magnetic ordering in the associated critical exponents. Using nitrogen-vacancy centers in diamond, we implement $T_2$ (spin-decoherence) noise magnetometry to study critical dynamics in a 2D Van der Waals magnet CrSBr. By analyzing NV decoherence on time scales approaching the characteristic correlation time… ▽ More Dynamic critical fluctuations in magnetic materials encode important information about magnetic ordering in the associated critical exponents. Using nitrogen-vacancy centers in diamond, we implement $T_2$ (spin-decoherence) noise magnetometry to study critical dynamics in a 2D Van der Waals magnet CrSBr. By analyzing NV decoherence on time scales approaching the characteristic correlation time $τ_c$ of critical fluctuations, we extract the critical exponent $ν$ for the correlation length. Our result deviates from the Ising prediction and highlights the role of long-range dipolar interactions in 2D CrSBr. Furthermore, analyzing the divergence of the correlation length suggests the possibility of 2D-XY criticality in CrSBr in a temperature window near $T_C$ where static magnetic domains are absent. Our work provides a first demonstration of $T_2$ noise magnetometry to quantitatively analyze critical scaling behavior in 2D materials. △ Less

Submitted 15 August, 2024; v1 submitted 8 July, 2024; originally announced July 2024.

Comments: 19 pages main text, 4 main text figures, 26 pages Supplementary Materials, 13 Supplementary figures

Establishing Provenance Before Coding: Traditional and Next-Gen Signing

Authors: Taylor R. Schorlemmer, Ethan H. Burmane, Kelechi G. Kalu, Santiago Torres-Arias, James C. Davis

Abstract: Software engineers integrate third-party components into their applications. The resulting software supply chain is vulnerable. To reduce the attack surface, we can verify the origin of components (provenance) before adding them. Cryptographic signatures enable this. This article describes traditional signing, its challenges, and changes introduced by next generation signing platforms Software engineers integrate third-party components into their applications. The resulting software supply chain is vulnerable. To reduce the attack surface, we can verify the origin of components (provenance) before adding them. Cryptographic signatures enable this. This article describes traditional signing, its challenges, and changes introduced by next generation signing platforms △ Less

Submitted 4 July, 2024; originally announced July 2024.

DiVerify: Diversifying Identity Verification in Next-Generation Software Signing

Authors: Chinenye L. Okafor, James C. Davis, Santiago Torres-Arias

Abstract: Code signing enables software developers to digitally sign their code using cryptographic keys, thereby associating the code to their identity. This allows users to verify the authenticity and integrity of the software, ensuring it has not been tampered with. Next-generation software signing such as Sigstore and OpenPubKey simplify code signing by providing streamlined mechanisms to verify and lin… ▽ More Code signing enables software developers to digitally sign their code using cryptographic keys, thereby associating the code to their identity. This allows users to verify the authenticity and integrity of the software, ensuring it has not been tampered with. Next-generation software signing such as Sigstore and OpenPubKey simplify code signing by providing streamlined mechanisms to verify and link signer identities to the public key. However, their designs have vulnerabilities: reliance on an identity provider introduces a single point of failure, and the failure to follow the principle of least privilege on the client side increases security risks. We introduce Diverse Identity Verification (DiVerify) scheme, which strengthens the security guarantees of next-generation software signing by leveraging threshold identity validations and scope mechanisms. We formalize a general definition of diverse verification scope and how it applies to next-generation software signing solutions, enabling clients to protect themselves from the impact of a compromised identity provider and help identity providers minimize the impact of compromised clients. As proof of concept, we implement DiVerify in the Sigstore ecosystem and evaluate the security improvements. By using fine-grained access control mechanisms and implementing threshold validations over account signing capabilities, we demonstrate that signing tools can protect themselves against threats from compromised identity providers and malicious signing clients. △ Less

Submitted 21 June, 2024; originally announced June 2024.

Inference of neutron-star properties with unified crust-core equations of state for parameter estimation

Authors: P. J. Davis, H. Dinh Thi, A. F. Fantina, F. Gulminelli, M. Oertel, L. Suleiman

Abstract: Relating different global neutron-star (NS) properties, such as tidal deformability and radius, or mass and radius, requires an equation of state (EoS). Determining the NS EoS is therefore not only the science goal of a variety of observational projects, but it also enters in the analysis process; for example, to predict a NS radius from a measured tidal deformability via gravitational waves (GW)… ▽ More Relating different global neutron-star (NS) properties, such as tidal deformability and radius, or mass and radius, requires an equation of state (EoS). Determining the NS EoS is therefore not only the science goal of a variety of observational projects, but it also enters in the analysis process; for example, to predict a NS radius from a measured tidal deformability via gravitational waves (GW) during the inspiral of a binary NS merger. To this aim, it is important to estimate the theoretical uncertainties on the EoS, one of which is the possible bias coming from an inconsistent treatment of the low-density region; that is, the use of a so called non-unified NS crust. We propose a numerical tool allowing the user to consistently match a nuclear-physics informed crust to an arbitrary high-density EoS describing the core of the star. We introduce an inversion procedure of the EoS close to saturation density that allows users to extract nuclear-matter parameters and extend the EoS to lower densities in a consistent way. For the treatment of inhomogeneous matter in the crust, a standard approach based on the compressible liquid-drop (CLD) model approach was used in our work. A Bayesian analysis using a parametric agnostic EoS representation in the high-density region is also presented in order to quantify the uncertainties induced by an inconsistent treatment of the crust. We show that the use of a fixed, realistic-but-inconsistent model for the crust causes small but avoidable errors in the estimation of global NS properties and leads to an underestimation of the uncertainties in the inference of NS properties. Our results highlight the importance of employing a consistent EoS in inference schemes. The numerical tool that we developed to reconstruct such a thermodynamically consistent EoS, CUTER, has been tested and validated for use by the astrophysical community. △ Less

Submitted 21 June, 2024; originally announced June 2024.

Comments: 16 pages, 11 figures, accepted for publication in Astronomy and Astrophysics

Journal ref: A&A 687, A44 (2024)

An Exploratory Mixed-Methods Study on General Data Protection Regulation (GDPR) Compliance in Open-Source Software

Authors: Lucas Franke, Huayu Liang, Sahar Farzanehpour, Aaron Brantly, James C. Davis, Chris Brown

Abstract: Background: Governments worldwide are considering data privacy regulations. These laws, e.g. the European Union's General Data Protection Regulation (GDPR), require software developers to meet privacy-related requirements when interacting with users' data. Prior research describes the impact of such laws on software development, but only for commercial software. Open-source software is commonly in… ▽ More Background: Governments worldwide are considering data privacy regulations. These laws, e.g. the European Union's General Data Protection Regulation (GDPR), require software developers to meet privacy-related requirements when interacting with users' data. Prior research describes the impact of such laws on software development, but only for commercial software. Open-source software is commonly integrated into regulated software, and thus must be engineered or adapted for compliance. We do not know how such laws impact open-source software development. Aims: To understand how data privacy laws affect open-source software development. We studied the European Union's GDPR, the most prominent such law. We investigated how GDPR compliance activities influence OSS developer activity (RQ1), how OSS developers perceive fulfilling GDPR requirements (RQ2), the most challenging GDPR requirements to implement (RQ3), and how OSS developers assess GDPR compliance (RQ4). Method: We distributed an online survey to explore perceptions of GDPR implementations from open-source developers (N=56). We further conducted a repository mining study to analyze development metrics on pull requests (N=31462) submitted to open-source GitHub repositories. Results: GDPR policies complicate open-source development processes and introduce challenges for developers, primarily regarding the management of users' data, implementation costs and time, and assessments of compliance. Moreover, we observed negative perceptions of GDPR from open-source developers and significant increases in development activity, in particular metrics related to coding and reviewing activity, on GitHub pull requests related to GDPR compliance. Conclusions: Our findings motivate policy-related resources and automated tools to support data privacy regulation implementation and compliance efforts in open-source software. △ Less

Submitted 20 June, 2024; originally announced June 2024.

Comments: In the proceedings of the 18th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM'24)

Extracting work from coherence in a two-mode Bose-Einstein condensate

Authors: L. A. Williamson, F. Cerisola, J. Anders, Matthew J. Davis

Abstract: We show how work can be extracted from number-state coherence in a two-mode Bose-Einstein condensate. With careful tuning of parameters, a sequence of thermodynamically reversible steps transforms a Glauber coherent state into a thermal state with the same energy probability distribution. The work extracted during this process arises entirely from the removal of quantum coherence. More generally,… ▽ More We show how work can be extracted from number-state coherence in a two-mode Bose-Einstein condensate. With careful tuning of parameters, a sequence of thermodynamically reversible steps transforms a Glauber coherent state into a thermal state with the same energy probability distribution. The work extracted during this process arises entirely from the removal of quantum coherence. More generally, we characterise quantum (from coherence) and classical (remaining) contributions to work output, and find that in this system the quantum contribution can be dominant over a broad range of parameters. The proportion of quantum work output can be further enhanced by squeezing the initial coherent state. Due to the many-body nature of the system, the work from coherence can equivalently be understood as work from entanglement. △ Less

Submitted 18 June, 2024; originally announced June 2024.

Comments: 9 pages + refs, 3 figures

Intrinsic high-fidelity spin polarization of charged vacancies in hexagonal boron nitride

Authors: Wonjae Lee, Vincent S. Liu, Zhelun Zhang, Sangha Kim, Ruotian Gong, Xinyi Du, Khanh Pham, Thomas Poirier, Zeyu Hao, James H. Edgar, Philip Kim, Chong Zu, Emily J. Davis, Norman Y. Yao

Abstract: The negatively charged boron vacancy ($\mathrm{V}_{\mathrm{B}}^-$) in hexagonal boron nitride (hBN) has garnered significant attention among defects in two-dimensional materials. This owes, in part, to its deterministic generation, well-characterized atomic structure, and optical polarizability at room temperature. We investigate the latter through extensive measurements probing both the ground an… ▽ More The negatively charged boron vacancy ($\mathrm{V}_{\mathrm{B}}^-$) in hexagonal boron nitride (hBN) has garnered significant attention among defects in two-dimensional materials. This owes, in part, to its deterministic generation, well-characterized atomic structure, and optical polarizability at room temperature. We investigate the latter through extensive measurements probing both the ground and excited state polarization dynamics. We develop a semiclassical model based on these measurements that predicts a near-unity degree of spin polarization, surpassing other solid-state spin defects under ambient conditions. Building upon our model, we include the presence of nuclear spin degrees of freedom adjacent to the $\mathrm{V}_{\mathrm{B}}^-$ and perform a comprehensive set of Lindbladian numerics to investigate the hyperfine-induced polarization of the nuclear spins. Our simulations predict a number of important features that emerge as a function of magnetic field which are borne out by experiment. △ Less

Submitted 17 June, 2024; originally announced June 2024.

SoK: A Literature and Engineering Review of Regular Expression Denial of Service

Authors: Masudul Hasan Masud Bhuiyan, Berk Çakar, Ethan H Burmane, James C Davis, Cristian-Alexandru Staicu

Abstract: Regular expression denial of service (ReDoS) is an asymmetric cyberattack that has become prominent in recent years. Many research works examine ReDoS, measuring its impact or preventing its exploitation. However, there has been no systematic treatment of this topic in order to understand the limits of the state of the art and identify opportunities for further research. In this paper, we fill t… ▽ More Regular expression denial of service (ReDoS) is an asymmetric cyberattack that has become prominent in recent years. Many research works examine ReDoS, measuring its impact or preventing its exploitation. However, there has been no systematic treatment of this topic in order to understand the limits of the state of the art and identify opportunities for further research. In this paper, we fill this gap by systematizing the existing knowledge on ReDoS. We review the algorithmic basis of ReDoS attacks and the pertinent history of regular expression engines. Next, we survey the literature, dividing works into two classes: measurement studies and defenses. We find no agreed-upon definition for ReDoS vulnerabilities, and observe weaknesses in the practical evaluations of many papers, making the impact of their findings hard to assess. The majority of academic work in this area limit themselves to showing the presence of an unexpected slow computation, without illustrating how this can be weaponized against real systems. Then, we survey the latest regex engines to examine whether and how the proposed defenses have been realized. In this way, we describe the new realities that should be considered in the next generation ReDoS research. We show that many academic threat models are out of date thanks to the adoption of defenses. Beyond this, we underscore the importance of simulating ReDoS attacks in realistic contexts, where factors like request size limiting or deployed mitigations are taken into account. We propose a tool, wrk-DoS, to facilitate these simulations. △ Less

Submitted 17 June, 2024; originally announced June 2024.

SoK: Analysis of Software Supply Chain Security by Establishing Secure Design Properties

Authors: Chinenye Okafor, Taylor R. Schorlemmer, Santiago Torres-Arias, James C. Davis

Abstract: This paper systematizes knowledge about secure software supply chain patterns. It identifies four stages of a software supply chain attack and proposes three security properties crucial for a secured supply chain: transparency, validity, and separation. The paper describes current security approaches and maps them to the proposed security properties, including research ideas and case studies of su… ▽ More This paper systematizes knowledge about secure software supply chain patterns. It identifies four stages of a software supply chain attack and proposes three security properties crucial for a secured supply chain: transparency, validity, and separation. The paper describes current security approaches and maps them to the proposed security properties, including research ideas and case studies of supply chains in practice. It discusses the strengths and weaknesses of current approaches relative to known attacks and details the various security frameworks put out to ensure the security of the software supply chain. Finally, the paper highlights potential gaps in actor and operation-centered supply chain security techniques △ Less

Submitted 14 June, 2024; originally announced June 2024.

Comments: Published in the proceedings of the 1st ACM Workshop on Software Supply Chain Offensive Research and Ecosystem Defenses (SCORED) 2022

Can Large Language Models Analyze Software Failures in the News? An End-to-End Automated Pipeline with FAIL

Authors: Dharun Anandayuvaraj, Matthew Campbell, Arav Tewari, James C. Davis

Abstract: Software failures inform engineering work, standards, regulations. For example, the Log4J vulnerability brought government and industry attention to evaluating and securing software supply chains. Accessing private engineering records is difficult, so failure analyses tend to use information reported by the news media. However, prior works in this direction have relied on manual analysis. That has… ▽ More Software failures inform engineering work, standards, regulations. For example, the Log4J vulnerability brought government and industry attention to evaluating and securing software supply chains. Accessing private engineering records is difficult, so failure analyses tend to use information reported by the news media. However, prior works in this direction have relied on manual analysis. That has limited the scale of their analyses. The community lacks automated support to enable such analyses to consider a wide range of news sources and incidents. In this paper, we propose the Failure Analysis Investigation with LLMs (FAIL) system to fill this gap. FAIL collects, analyzes, and summarizes software failures as reported in the news. FAIL groups articles that describe the same incidents. It then analyzes incidents using existing taxonomies for postmortems, faults, and system characteristics. To tune and evaluate FAIL, we followed the methods of prior works by manually analyzing 31 software failures. FAIL achieved an F1 score of 90% for collecting news about software failures, a V-measure of 0.98 for merging articles reporting on the same incident, and extracted 90% of the facts about failures. We then applied FAIL to a total of 137,427 news articles from 11 providers published between 2010 and 2022. FAIL identified and analyzed 2457 distinct failures reported across 4,184 articles. Our findings include: (1) current generation of large language models are capable of identifying news articles that describe failures, and analyzing them according to structured taxonomies; (2) high recurrences of similar failures within organizations and across organizations; and (3) severity of the consequences of software failures have increased over the past decade. The full FAIL database is available so that researchers, engineers, and policymakers can learn from a diversity of software failures. △ Less

Submitted 12 June, 2024; originally announced June 2024.

What do we know about Hugging Face? A systematic literature review and quantitative validation of qualitative claims

Authors: Jason Jones, Wenxin Jiang, Nicholas Synovic, George K. Thiruvathukal, James C. Davis

Abstract: Background: Collaborative Software Package Registries (SPRs) are an integral part of the software supply chain. Much engineering work synthesizes SPR package into applications. Prior research has examined SPRs for traditional software, such as NPM (JavaScript) and PyPI (Python). Pre-Trained Model (PTM) Registries are an emerging class of SPR of increasing importance, because they support the deep… ▽ More Background: Collaborative Software Package Registries (SPRs) are an integral part of the software supply chain. Much engineering work synthesizes SPR package into applications. Prior research has examined SPRs for traditional software, such as NPM (JavaScript) and PyPI (Python). Pre-Trained Model (PTM) Registries are an emerging class of SPR of increasing importance, because they support the deep learning supply chain. Aims: Recent empirical research has examined PTM registries in ways such as vulnerabilities, reuse processes, and evolution. However, no existing research synthesizes them to provide a systematic understanding of the current knowledge. Some of the existing research includes qualitative claims lacking quantitative analysis. Our research fills these gaps by providing a knowledge synthesis and quantitative analyses. Methods: We first conduct a systematic literature review (SLR). We then observe that some of the claims are qualitative. We identify quantifiable metrics associated with those claims, and measure in order to substantiate these claims. Results: From our SLR, we identify 12 claims about PTM reuse on the HuggingFace platform, 4 of which lack quantitative validation. We successfully test 3 of these claims through a quantitative analysis, and directly compare one with traditional software. Our findings corroborate qualitative claims with quantitative measurements. Our findings are: (1) PTMs have a much higher turnover rate than traditional software, indicating a dynamic and rapidly evolving reuse environment within the PTM ecosystem; and (2) There is a strong correlation between documentation quality and PTM popularity. Conclusions: We confirm qualitative research claims with concrete metrics, supporting prior qualitative and case study research. Our measures show further dynamics of PTM reuse, inspiring research infrastructure and new measures. △ Less

Submitted 12 June, 2024; originally announced June 2024.

An Industry Interview Study of Software Signing for Supply Chain Security

Authors: Kelechi G. Kalu, Tanya Singla, Chinenye Okafor, Santiago Torres-Arias, James C. Davis

Abstract: Many software products are composed by the recursive integration of components from other teams or external parties. Each additional link in a software product's supply chain increases the risk of the injection of malicious behavior. To improve supply chain provenance, many cybersecurity frameworks, standards, and regulations recommend the use of software signing. However, recent surveys and measu… ▽ More Many software products are composed by the recursive integration of components from other teams or external parties. Each additional link in a software product's supply chain increases the risk of the injection of malicious behavior. To improve supply chain provenance, many cybersecurity frameworks, standards, and regulations recommend the use of software signing. However, recent surveys and measurement studies have found that the adoption rate and quality of software signatures are low. These findings raise questions about the practical application of software signing, the human factors influencing its adoption, and the challenges faced during its implementation. We lack in-depth industry perspectives on the challenges and practices of software signing. To understand software signing in practice, we interviewed 18 high-ranking industry practitioners across 13 organizations. We provide possible impacts of experienced software supply chain failures, security standards, and regulations on software signing adoption. We also study the challenges that affect an effective software signing implementation. To summarize our findings: (1) We present a refined model of the software supply chain factory model highlighting practitioner's signing practices; (2) We highlight the different challenges -- Technical, Organizational, and Human -- that hamper software signing implementation; (3) We report that expert subjects disagree on the importance of signing; (4) We describe how failure incidents and industry standards affect the adoption of software signing and other security techniques. Our findings contribute to the understanding of software supply chain security by highlighting the impact of human and organizational factors on Software Supply Chain risks and providing nuanced insights for effectively implementing Software Supply Chain security controls -- towards Software signing in practice. △ Less

Submitted 12 June, 2024; originally announced June 2024.

Tunable magnetism of Boron Imidazolate-based Metal-Organic Frameworks

Authors: Jackson Davis, Pilar Beccar-Varela, V. Sara Thoi, Natalia Drichko

Abstract: Magnetic metal-organic frameworks (MMOFs), where magnetic metal nodes are connected into a crystal structure by organic linkers, have a potential to host exotic magnetic states. We present a study of bulk magnetic properties of four metal-organic frameworks with boron imidazolate linkers, Zn-BIF, Cu-BIF, Co-BIF, and Ni-BIF, displaying a variety of lattice structures and nontrivial magnetic behavio… ▽ More Magnetic metal-organic frameworks (MMOFs), where magnetic metal nodes are connected into a crystal structure by organic linkers, have a potential to host exotic magnetic states. We present a study of bulk magnetic properties of four metal-organic frameworks with boron imidazolate linkers, Zn-BIF, Cu-BIF, Co-BIF, and Ni-BIF, displaying a variety of lattice structures and nontrivial magnetic behaviors. While non-magnetic Zn-BIF provides an offset of magnetic response, magnetic susceptibility measurements of the other three magnetic materials demonstrate the presence of weak magnetic interactions in these MOFs, which differ between materials by sign and size. Cu-MOF, where magnetic nodes are connected into octahedral cages, shows simple paramagnetic behavior. Triangular lattice Co-MOF shows antiferromagnetic interactions on the order of 1 K, and a spin-crossover-like effect in magnetic susceptibility due to thermal depopulation of excited crystal electric field levels. Magnetic properties of Ni-BIF suggest sizable ferromagnetic interactions. Using DC/AC susceptibility and variable-field DC magnetization, we detect behavior that resembles that of superparamagnetic single-magnetic-domain nanoparticles, but with particle sizes on the scale of the unit cell, and discuss possible microscopic origins of this behavior. This work demonstrates the variety of magnetic properties that are possible with a single organic ligand, and establishes the low energy scale of magnetic interactions through superexchange in boron imidazolate frameworks. △ Less

Submitted 28 May, 2024; originally announced May 2024.

Parker Solar Probe Observations of Energetic Particles in the Flank of a Coronal Mass Ejection Close to the Sun

Authors: N. A. Schwadron, Stuart D. Bale, J. Bonnell, A. Case, M. Shen, E. R. Christian, C. M. S. Cohen, A. J. Davis, M. I. Desai, K. Goetz, J. Giacalone, M. E. Hill, J. C. Kasper, K. Korreck, D. Larson, R. Livi, T. Lim, R. A. Leske, O. Malandraki, D. Malaspina, W. H. Matthaeus, D. J. McComas, R. L. McNutt Jr., R. A. Mewaldt, D. G. Mitchell , et al. (10 additional authors not shown)

Abstract: We present an event observed by Parker Solar Probe at $\sim$0.2 au on March 2, 2022 in which imaging and \emph{in situ} measurements coincide. During this event, PSP passed through structures on the flank of a streamer blowout CME including an isolated flux tube in front of the CME, a turbulent sheath, and the CME itself. Imaging observations and \emph{in situ} helicity and principal variance sign… ▽ More We present an event observed by Parker Solar Probe at $\sim$0.2 au on March 2, 2022 in which imaging and \emph{in situ} measurements coincide. During this event, PSP passed through structures on the flank of a streamer blowout CME including an isolated flux tube in front of the CME, a turbulent sheath, and the CME itself. Imaging observations and \emph{in situ} helicity and principal variance signatures consistently show the presence of flux ropes internal to the CME. In both the sheath, and the CME interval, the distributions are more isotropic, the spectra are softer, and the abundance ratios of Fe/O and He/H are lower than those in the isolated flux tube, and yet elevated relative to typical plasma and SEP abundances. These signatures in the sheath and the CME indicate that both flare populations and those from the plasma are accelerated to form the observed energetic particle enhancements. In contrast, the isolated flux tube shows large streaming, hard spectra and large Fe/O and He/H ratios, indicating flare sources. Energetic particle fluxes are most enhanced within the CME interval from suprathermal through energetic particle energies ($\sim$ keV to $>10$ MeV), indicating particle acceleration, and confinement local to the closed magnetic structure. The flux-rope morphology of the CME helps to enable local modulation and trapping of energetic particles, particularly along helicity channels and other plasma boundaries. Thus, the CME acts to build-up energetic particle populations, allowing them to be fed into subsequent higher energy particle acceleration throughout the inner heliosphere where a compression or shock forms on the CME front. △ Less

Submitted 26 May, 2024; originally announced May 2024.

Comments: 41 pages, 19 figures, In Press

Journal ref: Astrophysical Journal, 2024

Imaging topological polar structures in marginally twisted 2D semiconductors

Authors: Thi-Hai-Yen Vu, Daniel Bennett, Gayani Nadeera Pallewella, Md Hemayet Uddin, Kaijian Xing, Weiyao Zhao, Seng Huat Lee, Zhiqiang Mao, Jack B. Muir, Linnan Jia, Jeffrey A. Davis, Kenji Watanabe, Takashi Taniguchi, Shaffique Adam, Pankaj Sharma, Michael S. Fuhrer, Mark T. Edmonds

Abstract: Moire superlattices formed in van der Waals heterostructures due to twisting, lattice mismatch and strain present an opportunity for creating novel metamaterials with unique properties not present in the individual layers themselves. Ferroelectricity for example, arises due to broken inversion symmetry in twisted and strained bilayers of 2D semiconductors with stacking domains of alternating out-o… ▽ More Moire superlattices formed in van der Waals heterostructures due to twisting, lattice mismatch and strain present an opportunity for creating novel metamaterials with unique properties not present in the individual layers themselves. Ferroelectricity for example, arises due to broken inversion symmetry in twisted and strained bilayers of 2D semiconductors with stacking domains of alternating out-of-plane polarization. However, understanding the individual contributions of twist and strain to the formation of topological polar nanostructures remains to be established and has proven to be experimentally challenging. Inversion symmetry breaking has been predicted to give rise to an in-plane component of polarization along the domain walls, leading to the formation of a network of topologically non-trivial merons (half-skyrmions) that are Bloch-type for twisted and Neel-type for strained systems. Here we utilise angle-resolved, high-resolution vector piezoresponse force microscopy (PFM) to spatially resolve polarization components and topological polar nanostructures in marginally twisted bilayer WSe2, and provide experimental proof for the existence of topologically non-trivial meron/antimeron structures. We observe both Bloch-type and Neel-type merons, allowing us to differentiate between moire superlattices formed due to twist or heterogeneous strain. This first demonstration of non-trivial real-space topology in a twisted van der Waals heterostructure opens pathways for exploring the connection between twist and topology in engineered nano-devices. △ Less

Submitted 23 May, 2024; originally announced May 2024.

SmartCS: Enabling the Creation of ML-Powered Computer Vision Mobile Apps for Citizen Science Applications without Coding

Authors: Fahim Hasan Khan, Akila de Silva, Gregory Dusek, James Davis, Alex Pang

Abstract: It is undeniable that citizen science contributes to the advancement of various fields of study. There are now software tools that facilitate the development of citizen science apps. However, apps developed with these tools rely on individual human skills to correctly collect useful data. Machine learning (ML)-aided apps provide on-field guidance to citizen scientists on data collection tasks. How… ▽ More It is undeniable that citizen science contributes to the advancement of various fields of study. There are now software tools that facilitate the development of citizen science apps. However, apps developed with these tools rely on individual human skills to correctly collect useful data. Machine learning (ML)-aided apps provide on-field guidance to citizen scientists on data collection tasks. However, these apps rely on server-side ML support, and therefore need a reliable internet connection. Furthermore, the development of citizen science apps with ML support requires a significant investment of time and money. For some projects, this barrier may preclude the use of citizen science effectively. We present a platform that democratizes citizen science by making it accessible to a much broader audience of both researchers and participants. The SmartCS platform allows one to create citizen science apps with ML support quickly and without coding skills. Apps developed using SmartCS have client-side ML support, making them usable in the field, even when there is no internet connection. The client-side ML helps educate users to better recognize the subjects, thereby enabling high-quality data collection. We present several citizen science apps created using SmartCS, some of which were conceived and created by high school students. △ Less

Submitted 23 May, 2024; originally announced May 2024.

CATEcor: an Open Science, Shaded-Truss, Externally-Occulted Coronagraph

Authors: Craig E. DeForest, Daniel B. Seaton, Amir Caspi, Matt Beasley, Sarah J. Davis, Nicholas F. Erickson, Sarah A. Kovac, Ritesh Patel, Anna Tosolini, Matthew J. West

Abstract: We present the design of a portable coronagraph, CATEcor, that incorporates a novel "shaded truss" style of external occultation and serves as a proof-of-concept for that family of coronagraphs. The shaded truss design style has the potential for broad application in various scientific settings. We conceived CATEcor itself as a simple instrument to observe the corona during the darker skies availa… ▽ More We present the design of a portable coronagraph, CATEcor, that incorporates a novel "shaded truss" style of external occultation and serves as a proof-of-concept for that family of coronagraphs. The shaded truss design style has the potential for broad application in various scientific settings. We conceived CATEcor itself as a simple instrument to observe the corona during the darker skies available during a partial solar eclipse, or for students or interested amateurs to detect the corona under ideal non-eclipsed conditions. CATEcor is therefore optimized for simplicity and accessibility to the public. It is implemented using an existing dioptric telescope and an adapter rig that mounts in front of the objective lens, restricting the telescope aperture and providing external occultation. The adapter rig, including occulter, is fabricated using fusion deposition modeling (FDM; colloquially "3D printing"), greatly reducing cost. The structure is designed to be integrated with moderate care and may be replicated in a university or amateur setting. While CATEcor is a simple demonstration unit, the design concept, process, and trades are useful for other more sophisticated coronagraphs in the same general family, which might operate under normal daytime skies outside the annular-eclipse conditions used for CATEcor. △ Less

Submitted 14 May, 2024; originally announced May 2024.

Comments: 27pp; 12 figures; accepted to Solar Physics

Journal ref: Solar Physics, Vol. 299, 78 (23pp); 2024 June 10

Spiral Spin Liquid Noise

Authors: Hiroto Takahashi, Chun-Chih Hsu, Fabian Jerzembeck, Jack Murphy, Jonathan Ward, Jack D. Enright, Jan Knapp, Pascal Puphal, Masahiko Isobe, Yosuke Matsumoto, Hidenori Takagi, J. C. Séamus Davis, Stephen J. Blundell

Abstract: No state of matter can be defined categorically by what it is not; yet spin liquids are often conjectured to exist based on the nonexistence of magnetic order as $T \to 0$. An emerging concept designed to circumvent this ambiguity is to categorically identify each spin liquid type by using its spectrum of spontaneous spin noise. Here we introduce such a spectroscopy to spin liquid studies by consi… ▽ More No state of matter can be defined categorically by what it is not; yet spin liquids are often conjectured to exist based on the nonexistence of magnetic order as $T \to 0$. An emerging concept designed to circumvent this ambiguity is to categorically identify each spin liquid type by using its spectrum of spontaneous spin noise. Here we introduce such a spectroscopy to spin liquid studies by considering Ca$_{10}$Cr$_7$O$_{28}$. This is a spin liquid, but whether classical or quantum and in which specific state, are unknown. By enhancing the flux-noise spectrometry techniques introduced for magnetic monopole noise studies, here we measure the time and temperature dependence of spontaneous flux $\varPhi(t,T)$ and thus magnetization $M(t,T)$ of Ca$_{10}$Cr$_7$O$_{28}$ samples. The resulting power spectral density of magnetization noise $S_M(ω,T)$ along with its correlation function $C_M(t,T)$, reveal intense spin fluctuations spanning frequencies $0.1\ \mathrm{Hz} \leq ω/2π\leq 50\ \mathrm{kHz}$, and that $S_M(ω,T)\propto ω^{-α(T)}$ with $0.84 < α(T) < 1.04$. Predictions for quantum spin liquids yield a frequency-independent spin-noise spectrum, clearly inconsistent with this phenomenology However, when compared to Monte Carlo simulations for a 2D spiral spin liquid state that are accurately parameterized to describe Ca$_{10}$Cr$_7$O$_{28}$, comprehensive quantitative correspondence with the data including $S_M(ω,T)$, $C_M(t,T)$ and magnetization variance $σ_M^2(T)$ fingerprint the state of Ca$_{10}$Cr$_7$O$_{28}$ as a spiral spin liquid. △ Less

Submitted 3 May, 2024; originally announced May 2024.

Comments: 42 pages, 4 main figures, 8 supplementary figures, 2 supplementary movies

DMON: A Simple yet Effective Approach for Argument Structure Learning

Authors: Wei Sun, Mingxiao Li, Jingyuan Sun, Jesse Davis, Marie-Francine Moens

Abstract: Argument structure learning~(ASL) entails predicting relations between arguments. Because it can structure a document to facilitate its understanding, it has been widely applied in many fields~(medical, commercial, and scientific domains). Despite its broad utilization, ASL remains a challenging task because it involves examining the complex relationships between the sentences in a potentially uns… ▽ More Argument structure learning~(ASL) entails predicting relations between arguments. Because it can structure a document to facilitate its understanding, it has been widely applied in many fields~(medical, commercial, and scientific domains). Despite its broad utilization, ASL remains a challenging task because it involves examining the complex relationships between the sentences in a potentially unstructured discourse. To resolve this problem, we have developed a simple yet effective approach called Dual-tower Multi-scale cOnvolution neural Network~(DMON) for the ASL task. Specifically, we organize arguments into a relationship matrix that together with the argument embeddings forms a relationship tensor and design a mechanism to capture relations with contextual arguments. Experimental results on three different-domain argument mining datasets demonstrate that our framework outperforms state-of-the-art models. The code is available at https://github.com/VRCMF/DMON.git . △ Less

Submitted 2 May, 2024; originally announced May 2024.

Comments: COLING 2024

A Partial Replication of MaskFormer in TensorFlow on TPUs for the TensorFlow Model Garden

Authors: Vishal Purohit, Wenxin Jiang, Akshath R. Ravikiran, James C. Davis

Abstract: This paper undertakes the task of replicating the MaskFormer model a universal image segmentation model originally developed using the PyTorch framework, within the TensorFlow ecosystem, specifically optimized for execution on Tensor Processing Units (TPUs). Our implementation exploits the modular constructs available within the TensorFlow Model Garden (TFMG), encompassing elements such as the dat… ▽ More This paper undertakes the task of replicating the MaskFormer model a universal image segmentation model originally developed using the PyTorch framework, within the TensorFlow ecosystem, specifically optimized for execution on Tensor Processing Units (TPUs). Our implementation exploits the modular constructs available within the TensorFlow Model Garden (TFMG), encompassing elements such as the data loader, training orchestrator, and various architectural components, tailored and adapted to meet the specifications of the MaskFormer model. We address key challenges encountered during the replication, non-convergence issues, slow training, adaptation of loss functions, and the integration of TPU-specific functionalities. We verify our reproduced implementation and present qualitative results on the COCO dataset. Although our implementation meets some of the objectives for end-to-end reproducibility, we encountered challenges in replicating the PyTorch version of MaskFormer in TensorFlow. This replication process is not straightforward and requires substantial engineering efforts. Specifically, it necessitates the customization of various components within the TFMG, alongside thorough verification and hyper-parameter tuning. The replication is available at: https://github.com/PurdueDualityLab/tf-maskformer/tree/main/official/projects/maskformer △ Less

Submitted 29 April, 2024; originally announced April 2024.

Reusing Deep Learning Models: Challenges and Directions in Software Engineering

Authors: James C. Davis, Purvish Jajal, Wenxin Jiang, Taylor R. Schorlemmer, Nicholas Synovic, George K. Thiruvathukal

Abstract: Deep neural networks (DNNs) achieve state-of-the-art performance in many areas, including computer vision, system configuration, and question-answering. However, DNNs are expensive to develop, both in intellectual effort (e.g., devising new architectures) and computational costs (e.g., training). Reusing DNNs is a promising direction to amortize costs within a company and across the computing indu… ▽ More Deep neural networks (DNNs) achieve state-of-the-art performance in many areas, including computer vision, system configuration, and question-answering. However, DNNs are expensive to develop, both in intellectual effort (e.g., devising new architectures) and computational costs (e.g., training). Reusing DNNs is a promising direction to amortize costs within a company and across the computing industry. As with any new technology, however, there are many challenges in reusing DNNs. These challenges include both missing technical capabilities and missing engineering practices. This vision paper describes challenges in current approaches to DNN re-use. We summarize studies of re-use failures across the spectrum of re-use techniques, including conceptual (e.g., reusing based on a research paper), adaptation (e.g., re-using by building on an existing implementation), and deployment (e.g., direct re-use on a new device). We outline possible advances that would improve each kind of re-use. △ Less

Submitted 25 April, 2024; originally announced April 2024.

Comments: Proceedings of the IEEE John Vincent Atanasoff Symposium on Modern Computing (JVA'23) 2023

Introducing Systems Thinking as a Framework for Teaching and Assessing Threat Modeling Competency

Authors: Siddhant S. Joshi, Preeti Mukherjee, Kirsten A. Davis, James C. Davis

Abstract: Computing systems face diverse and substantial cybersecurity threats. To mitigate these cybersecurity threats, software engineers need to be competent in the skill of threat modeling. In industry and academia, there are many frameworks for teaching threat modeling, but our analysis of these frameworks suggests that (1) these approaches tend to be focused on component-level analysis rather than edu… ▽ More Computing systems face diverse and substantial cybersecurity threats. To mitigate these cybersecurity threats, software engineers need to be competent in the skill of threat modeling. In industry and academia, there are many frameworks for teaching threat modeling, but our analysis of these frameworks suggests that (1) these approaches tend to be focused on component-level analysis rather than educating students to reason holistically about a system's cybersecurity, and (2) there is no rubric for assessing a student's threat modeling competency. To address these concerns, we propose using systems thinking in conjunction with popular and industry-standard threat modeling frameworks like STRIDE for teaching and assessing threat modeling competency. Prior studies suggest a holistic approach, like systems thinking, can help understand and mitigate cybersecurity threats. Thus, we developed and piloted two novel rubrics - one for assessing STRIDE threat modeling performance and the other for assessing systems thinking performance while conducting STRIDE. To conduct this study, we piloted the two rubrics mentioned above to assess threat model artifacts of students enrolled in an upper-level software engineering course at Purdue University in Fall 2021, Spring 2023, and Fall 2023. Students who had both systems thinking and STRIDE instruction identified and attempted to mitigate component-level as well as systems-level threats. Students with only STRIDE instruction tended to focus on identifying and mitigating component-level threats and discounted system-level threats. We contribute to engineering education by: (1) describing a new rubric for assessing threat modeling based on systems thinking; (2) identifying trends and blindspots in students' threat modeling approach; and (3) envisioning the benefits of integrating systems thinking in threat modeling teaching and assessment. △ Less

Submitted 25 April, 2024; originally announced April 2024.

Comments: Presented at the Annual Conference of the American Society for Engineering Education (ASEE'24) 2024

Designing, simulating, and performing the 100-AV field test for the CIRCLES consortium: Methodology and Implementation of the Largest mobile traffic control experiment to date

Authors: Mostafa Ameli, Sean Mcquade, Jonathan W. Lee, Matthew Bunting, Matthew Nice, Han Wang, William Barbour, Ryan Weightman, Chris Denaro, Ryan Delorenzo, Sharon Hornstein, Jon F. Davis, Dan Timsit, Riley Wagner, Rita Xu, Malaika Mahmood, Mikail Mahmood, Maria Laura Delle Monache, Benjamin Seibold, Daniel B. Work, Jonathan Sprinkle, Benedetto Piccoli, Alexandre M. Bayen

Abstract: Previous controlled experiments on single-lane ring roads have shown that a single partially autonomous vehicle (AV) can effectively mitigate traffic waves. This naturally prompts the question of how these findings can be generalized to field operational, high-density traffic conditions. To address this question, the Congestion Impacts Reduction via CAV-in-the-loop Lagrangian Energy Smoothing (CIR… ▽ More Previous controlled experiments on single-lane ring roads have shown that a single partially autonomous vehicle (AV) can effectively mitigate traffic waves. This naturally prompts the question of how these findings can be generalized to field operational, high-density traffic conditions. To address this question, the Congestion Impacts Reduction via CAV-in-the-loop Lagrangian Energy Smoothing (CIRCLES) Consortium conducted MegaVanderTest (MVT), a live traffic control experiment involving 100 vehicles near Nashville, TN, USA. This article is a tutorial for developing analytical and simulation-based tools essential for designing and executing a live traffic control experiment like the MVT. It presents an overview of the proposed roadmap and various procedures used in designing, monitoring, and conducting the MVT, which is the largest mobile traffic control experiment at the time. The design process is aimed at evaluating the impact of the CIRCLES AVs on surrounding traffic. The article discusses the agent-based traffic simulation framework created for this evaluation. A novel methodological framework is introduced to calibrate this microsimulation, aiming to accurately capture traffic dynamics and assess the impact of adding 100 vehicles to existing traffic. The calibration model's effectiveness is verified using data from a six-mile section of Nashville's I-24 highway. The results indicate that the proposed model establishes an effective feedback loop between the optimizer and the simulator, thereby calibrating flow and speed with different spatiotemporal characteristics to minimize the error between simulated and real-world data. Finally, We simulate AVs in multiple scenarios to assess their effect on traffic congestion. This evaluation validates the AV routes, thereby contributing to the execution of a safe and successful live traffic control experiment via AVs. △ Less

Submitted 23 April, 2024; originally announced April 2024.

Dynamics of Polar-Core Spin Vortices in Inhomogeneous Spin-1 Bose-Einstein Condensates

Authors: Zachary L. Stevens-Hough, Matthew J. Davis, Lewis A. Williamson

Abstract: In the easy-plane phase, a ferromagnetic spin-1 Bose-Einstein condensate is magnetized in a plane transverse to the applied Zeeman field. This phase supports polar-core spin vortices (PCVs), which consist of phase windings of transverse magnetization. Here we show that spin-changing collisions cause a PCV to accelerate down density gradients in an inhomogeneous condensate. The dynamics is well-des… ▽ More In the easy-plane phase, a ferromagnetic spin-1 Bose-Einstein condensate is magnetized in a plane transverse to the applied Zeeman field. This phase supports polar-core spin vortices (PCVs), which consist of phase windings of transverse magnetization. Here we show that spin-changing collisions cause a PCV to accelerate down density gradients in an inhomogeneous condensate. The dynamics is well-described by a simplified model adapted from scalar systems, which predicts the dependence of the dynamics on trap tightness and quadratic Zeeman energy. In a harmonic trap, a PCV accelerates radially to the condensate boundary, in stark contrast to the azimuthal motion of vortices in a scalar condensate. In a trap that has a local potential maximum at the centre, the PCV exhibits oscillations around the trap centre, which persist for a remarkably long time. The oscillations coincide with the emission and reabsorption of axial spin waves, which reflect off the condensate boundary. △ Less

Submitted 21 April, 2024; originally announced April 2024.

Comments: 13 pages + refs, 6 figures

A strongly interacting, two-dimensional, dipolar spin ensemble in (111)-oriented diamond

Authors: Lillian B. Hughes, Simon A. Meynell, Weijie Wu, Shreyas Parthasarathy, Lingjie Chen, Zhiran Zhang, Zilin Wang, Emily J. Davis, Kunal Mukherjee, Norman Y. Yao, Ania C. Bleszynski Jayich

Abstract: Systems of spins with strong dipolar interactions and controlled dimensionality enable new explorations in quantum sensing and simulation. In this work, we investigate the creation of strong dipolar interactions in a two-dimensional ensemble of nitrogen-vacancy (NV) centers generated via plasma-enhanced chemical vapor deposition (PECVD) on (111)-oriented diamond substrates. We find that diamond gr… ▽ More Systems of spins with strong dipolar interactions and controlled dimensionality enable new explorations in quantum sensing and simulation. In this work, we investigate the creation of strong dipolar interactions in a two-dimensional ensemble of nitrogen-vacancy (NV) centers generated via plasma-enhanced chemical vapor deposition (PECVD) on (111)-oriented diamond substrates. We find that diamond growth on the (111) plane yields high incorporation of spins, both nitrogen and NV centers, where the density of the latter is tunable via the miscut of the diamond substrate. Our process allows us to form dense, preferentially aligned, 2D NV ensembles with volume-normalized AC sensitivity down to $η_{AC}$ = 810 pT um$^{3/2}$ Hz$^{-1/2}$. Furthermore, we show that (111) affords maximally positive dipolar interactions amongst a 2D NV ensemble, which is crucial for leveraging dipolar-driven entanglement schemes and exploring new interacting spin physics. △ Less

Submitted 15 April, 2024; originally announced April 2024.

Early Adoption of Generative AI by Global Business Leaders: Insights from an INSEAD Alumni Survey

Authors: Jason P Davis, Jian Bai Li

Abstract: How are new technologies like generative AI quickly adopted and used by executive and managerial leaders to create value in organizations? A survey of INSEAD's global alumni base revealed several intriguing insights into perceptions and engagements with generative AI across a broad spectrum of demographics, industries, and geographies. Notably, there's a prevailing optimism about the role of gener… ▽ More How are new technologies like generative AI quickly adopted and used by executive and managerial leaders to create value in organizations? A survey of INSEAD's global alumni base revealed several intriguing insights into perceptions and engagements with generative AI across a broad spectrum of demographics, industries, and geographies. Notably, there's a prevailing optimism about the role of generative AI in enhancing productivity and innovation, as evidenced by the 90% of respondents being excited about its time-saving and efficiency benefits. Analysis revealed different attitudes about adoption and use across demographic variables. Younger respondents are significantly more excited about generative AI and more likely to be using it at work and in personal life than older participants. Those in Europe have a somewhat more distant view of generative AI than those in North America in Asia, in that they see the gains more likely to be captured by organizations than individuals, and are less likely to be using it in professional and personal contexts than those in North America and Asia. This may also be related to the fact that those in Europe are more likely to be working in Financial Services and less likely to be working in Information Technology industries than those in North America and Asia. Despite this, those in Europe are more likely to see AGI happening faster than those in North America, although this may reflect less interaction with generative AI in personal and professional contexts. These findings collectively underscore the complex and multifaceted perceptions of generative AI's role in society, pointing to both its promising potential and the challenges it presents. △ Less

Submitted 6 April, 2024; originally announced April 2024.

Observation of Gravitational Waves from the Coalescence of a $2.5\text{-}4.5~M_\odot$ Compact Object and a Neutron Star

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, A. G. Abac, R. Abbott, I. Abouelfettouh, F. Acernese, K. Ackley, S. Adhicary, N. Adhikari, R. X. Adhikari, V. K. Adkins, D. Agarwal, M. Agathos, M. Aghaei Abchouyeh, O. D. Aguiar, I. Aguilar, L. Aiello, A. Ain, P. Ajith, S. Akçay, T. Akutsu, S. Albanesi, R. A. Alfaidi, A. Al-Jodah , et al. (1771 additional authors not shown)

Abstract: We report the observation of a coalescing compact binary with component masses $2.5\text{-}4.5~M_\odot$ and $1.2\text{-}2.0~M_\odot$ (all measurements quoted at the 90% credible level). The gravitational-wave signal GW230529_181500 was observed during the fourth observing run of the LIGO-Virgo-KAGRA detector network on 2023 May 29 by the LIGO Livingston Observatory. The primary component of the so… ▽ More We report the observation of a coalescing compact binary with component masses $2.5\text{-}4.5~M_\odot$ and $1.2\text{-}2.0~M_\odot$ (all measurements quoted at the 90% credible level). The gravitational-wave signal GW230529_181500 was observed during the fourth observing run of the LIGO-Virgo-KAGRA detector network on 2023 May 29 by the LIGO Livingston Observatory. The primary component of the source has a mass less than $5~M_\odot$ at 99% credibility. We cannot definitively determine from gravitational-wave data alone whether either component of the source is a neutron star or a black hole. However, given existing estimates of the maximum neutron star mass, we find the most probable interpretation of the source to be the coalescence of a neutron star with a black hole that has a mass between the most massive neutron stars and the least massive black holes observed in the Galaxy. We provisionally estimate a merger rate density of $55^{+127}_{-47}~\text{Gpc}^{-3}\,\text{yr}^{-1}$ for compact binary coalescences with properties similar to the source of GW230529_181500; assuming that the source is a neutron star-black hole merger, GW230529_181500-like sources constitute about 60% of the total merger rate inferred for neutron star-black hole coalescences. The discovery of this system implies an increase in the expected rate of neutron star-black hole mergers with electromagnetic counterparts and provides further evidence for compact objects existing within the purported lower mass gap. △ Less

Submitted 26 July, 2024; v1 submitted 5 April, 2024; originally announced April 2024.

Comments: 45 pages (10 pages author list, 13 pages main text, 1 page acknowledgements, 13 pages appendices, 8 pages bibliography), 17 figures, 16 tables. Update to match version published in The Astrophysical Journal Letters. Data products available from https://zenodo.org/records/10845779

Report number: LIGO-P2300352

Journal ref: ApJL 970, L34 (2024)

Twins in rotational spectroscopy: Does a rotational spectrum uniquely identify a molecule?

Authors: Marcus Schwarting, Nathan A. Seifert, Michael J. Davis, Ben Blaiszik, Ian Foster, Kirill Prozument

Abstract: Rotational spectroscopy is the most accurate method for determining structures of molecules in the gas phase. It is often assumed that a rotational spectrum is a unique "fingerprint" of a molecule. The availability of large molecular databases and the development of artificial intelligence methods for spectroscopy makes the testing of this assumption timely. In this paper, we pose the determinatio… ▽ More Rotational spectroscopy is the most accurate method for determining structures of molecules in the gas phase. It is often assumed that a rotational spectrum is a unique "fingerprint" of a molecule. The availability of large molecular databases and the development of artificial intelligence methods for spectroscopy makes the testing of this assumption timely. In this paper, we pose the determination of molecular structures from rotational spectra as an inverse problem. Within this framework, we adopt a funnel-based approach to search for molecular twins, which are two or more molecules, which have similar rotational spectra but distinctly different molecular structures. We demonstrate that there are twins within standard levels of computational accuracy by generating rotational constants for many molecules from several large molecular databases, indicating the inverse problem is ill-posed. However, some twins can be distinguished by increasing the accuracy of the theoretical methods or by performing additional experiments. △ Less

Submitted 5 April, 2024; originally announced April 2024.

Observations of the Polarized Solar Corona during the Annular Eclipse of October 14, 2023

Authors: Daniel B. Seaton, Amir Caspi, Nathalia Alzate, Sarah J. Davis, Alec R. DeForest, Craig E. DeForest, Nicholas F. Erickson, Sarah A. Kovac, Ritesh Patel, Steven N. Osterman, Anna Tosolini, Samuel J. Van Kooten, Matthew J. West

Abstract: We present results of a dual eclipse expedition to observe the solar corona from two sites during the annular solar eclipse of 2023 October 14, using a novel coronagraph designed to be accessible for amateurs and students to build and deploy. The coronagraph "CATEcor" builds on the standardized eclipse observing equipment developed for the Citizen CATE 2024 experiment. The observing sites were sel… ▽ More We present results of a dual eclipse expedition to observe the solar corona from two sites during the annular solar eclipse of 2023 October 14, using a novel coronagraph designed to be accessible for amateurs and students to build and deploy. The coronagraph "CATEcor" builds on the standardized eclipse observing equipment developed for the Citizen CATE 2024 experiment. The observing sites were selected for likelihood of clear observations, for historic relevance (near the Climax site in the Colorado Rocky Mountains), and for centrality to the annular eclipse path (atop Sandia Peak above Albuquerque, New Mexico). The novel portion of CATEcor is an external occulter assembly that slips over the front of a conventional dioptric telescope, forming a "shaded-truss" externally occulted coronagraph. CATEcor is specifically designed to be easily constructed in a garage or "makerspace" environment. We successfully observed some bright features in the solar corona to an altitude of approximately 2.25 R$_\odot$ during the annular phases of the eclipse. Future improvements to the design, in progress now, will reduce both stray light and image artifacts; our objective is to develop a design that can be operated successfully by amateur astronomers at sufficient altitude even without the darkened skies of a partial or annular eclipse. △ Less

Submitted 3 April, 2024; v1 submitted 2 April, 2024; originally announced April 2024.

Comments: Accepted by Solar Physics

Journal ref: Solar Physics, Vol. 299, 79 (20pp); 2024 June 10

VortexViz: Finding Vortex Boundaries by Learning from Particle Trajectories

Authors: Akila de Silva, Nicholas Tee, Omkar Ghanekar, Fahim Hasan Khan, Gregory Dusek, James Davis, Alex Pang

Abstract: Vortices are studied in various scientific disciplines, offering insights into fluid flow behavior. Visualizing the boundary of vortices is crucial for understanding flow phenomena and detecting flow irregularities. This paper addresses the challenge of accurately extracting vortex boundaries using deep learning techniques. While existing methods primarily train on velocity components, we propose… ▽ More Vortices are studied in various scientific disciplines, offering insights into fluid flow behavior. Visualizing the boundary of vortices is crucial for understanding flow phenomena and detecting flow irregularities. This paper addresses the challenge of accurately extracting vortex boundaries using deep learning techniques. While existing methods primarily train on velocity components, we propose a novel approach incorporating particle trajectories (streamlines or pathlines) into the learning process. By leveraging the regional/local characteristics of the flow field captured by streamlines or pathlines, our methodology aims to enhance the accuracy of vortex boundary extraction. △ Less

Submitted 1 April, 2024; originally announced April 2024.

Comments: Under review

SplatFace: Gaussian Splat Face Reconstruction Leveraging an Optimizable Surface

Authors: Jiahao Luo, Jing Liu, James Davis

Abstract: We present SplatFace, a novel Gaussian splatting framework designed for 3D human face reconstruction without reliance on accurate pre-determined geometry. Our method is designed to simultaneously deliver both high-quality novel view rendering and accurate 3D mesh reconstructions. We incorporate a generic 3D Morphable Model (3DMM) to provide a surface geometric structure, making it possible to reco… ▽ More We present SplatFace, a novel Gaussian splatting framework designed for 3D human face reconstruction without reliance on accurate pre-determined geometry. Our method is designed to simultaneously deliver both high-quality novel view rendering and accurate 3D mesh reconstructions. We incorporate a generic 3D Morphable Model (3DMM) to provide a surface geometric structure, making it possible to reconstruct faces with a limited set of input images. We introduce a joint optimization strategy that refines both the Gaussians and the morphable surface through a synergistic non-rigid alignment process. A novel distance metric, splat-to-surface, is proposed to improve alignment by considering both the Gaussian position and covariance. The surface information is also utilized to incorporate a world-space densification process, resulting in superior reconstruction quality. Our experimental analysis demonstrates that the proposed method is competitive with both other Gaussian splatting techniques in novel view synthesis and other 3D reconstruction methods in producing 3D face meshes with high geometric precision. △ Less

Submitted 29 March, 2024; v1 submitted 27 March, 2024; originally announced March 2024.

An Exploratory Study on Upper-Level Computing Students' Use of Large Language Models as Tools in a Semester-Long Project

Authors: Ben Arie Tanay, Lexy Arinze, Siddhant S. Joshi, Kirsten A. Davis, James C. Davis

Abstract: Background: Large Language Models (LLMs) such as ChatGPT and CoPilot are influencing software engineering practice. Software engineering educators must teach future software engineers how to use such tools well. As of yet, there have been few studies that report on the use of LLMs in the classroom. It is, therefore, important to evaluate students' perception of LLMs and possible ways of adapting t… ▽ More Background: Large Language Models (LLMs) such as ChatGPT and CoPilot are influencing software engineering practice. Software engineering educators must teach future software engineers how to use such tools well. As of yet, there have been few studies that report on the use of LLMs in the classroom. It is, therefore, important to evaluate students' perception of LLMs and possible ways of adapting the computing curriculum to these shifting paradigms. Purpose: The purpose of this study is to explore computing students' experiences and approaches to using LLMs during a semester-long software engineering project. Design/Method: We collected data from a senior-level software engineering course at Purdue University. This course uses a project-based learning (PBL) design. The students used LLMs such as ChatGPT and Copilot in their projects. A sample of these student teams were interviewed to understand (1) how they used LLMs in their projects; and (2) whether and how their perspectives on LLMs changed over the course of the semester. We analyzed the data to identify themes related to students' usage patterns and learning outcomes. Results/Discussion: When computing students utilize LLMs within a project, their use cases cover both technical and professional applications. In addition, these students perceive LLMs to be efficient tools in obtaining information and completion of tasks. However, there were concerns about the responsible use of LLMs without being detrimental to their own learning outcomes. Based on our findings, we recommend future research to investigate the usage of LLM's in lower-level computer engineering courses to understand whether and how LLMs can be integrated as a learning aid without hurting the learning outcomes. △ Less

Submitted 16 April, 2024; v1 submitted 27 March, 2024; originally announced March 2024.

Comments: Accepted to the 2024 General Conference of the American Society for Engineering Education (ASEE)

Extracting Biomedical Entities from Noisy Audio Transcripts

Authors: Nima Ebadi, Kellen Morgan, Adrian Tan, Billy Linares, Sheri Osborn, Emma Majors, Jeremy Davis, Anthony Rios

Abstract: Automatic Speech Recognition (ASR) technology is fundamental in transcribing spoken language into text, with considerable applications in the clinical realm, including streamlining medical transcription and integrating with Electronic Health Record (EHR) systems. Nevertheless, challenges persist, especially when transcriptions contain noise, leading to significant drops in performance when Natural… ▽ More Automatic Speech Recognition (ASR) technology is fundamental in transcribing spoken language into text, with considerable applications in the clinical realm, including streamlining medical transcription and integrating with Electronic Health Record (EHR) systems. Nevertheless, challenges persist, especially when transcriptions contain noise, leading to significant drops in performance when Natural Language Processing (NLP) models are applied. Named Entity Recognition (NER), an essential clinical task, is particularly affected by such noise, often termed the ASR-NLP gap. Prior works have primarily studied ASR's efficiency in clean recordings, leaving a research gap concerning the performance in noisy environments. This paper introduces a novel dataset, BioASR-NER, designed to bridge the ASR-NLP gap in the biomedical domain, focusing on extracting adverse drug reactions and mentions of entities from the Brief Test of Adult Cognition by Telephone (BTACT) exam. Our dataset offers a comprehensive collection of almost 2,000 clean and noisy recordings. In addressing the noise challenge, we present an innovative transcript-cleaning method using GPT4, investigating both zero-shot and few-shot methodologies. Our study further delves into an error analysis, shedding light on the types of errors in transcription software, corrections by GPT4, and the challenges GPT4 faces. This paper aims to foster improved understanding and potential solutions for the ASR-NLP gap, ultimately supporting enhanced healthcare documentation practices. △ Less

Submitted 25 March, 2024; originally announced March 2024.

Comments: Accepted to LREC-COLING 2024

Magnon-microwave backaction noise evasion in cavity magnomechanics

Authors: V. A. S. V. Bittencourt, C. A. Potts, J. P. Davis, A. Metelmann

Abstract: In cavity magnomechanical systems, magnetic excitations couple simultaneously with mechanical vibrations and microwaves, combining the tunability of the magnetization, the long lifetimes of mechanical modes and the whole measurement toolbox of microwave systems. Such hybrid systems have been proposed for applications ranging from thermometry to entanglement generation. However, backaction noise ca… ▽ More In cavity magnomechanical systems, magnetic excitations couple simultaneously with mechanical vibrations and microwaves, combining the tunability of the magnetization, the long lifetimes of mechanical modes and the whole measurement toolbox of microwave systems. Such hybrid systems have been proposed for applications ranging from thermometry to entanglement generation. However, backaction noise can hinder the measurement of the mechanical vibrations, potentially rendering such applications infeasible. In this paper, we investigate the noise introduced in a mechanical mode of a cavity magnomechanical system in a one-tone drive scheme and propose a scheme for realizing backaction evasion measurements of the mechanical vibrations. Our proposal consists of driving the microwave cavity with two tones separated by twice the phonon frequency and with amplitudes balanced to generate equal numbers of coherent magnons. We demonstrate that different configurations of such a scheme are possible and show that drives centered around the lower frequency magnon-microwave polariton in a triple resonance scheme add the minimum imprecision noise in the measurement, even though such configuration is not the most robust to imperfections. △ Less

Submitted 25 March, 2024; originally announced March 2024.

Comments: 25 pages, 13 figures

A Survey on Human-AI Teaming with Large Pre-Trained Models

Authors: Vanshika Vats, Marzia Binta Nizam, Minghao Liu, Ziyuan Wang, Richard Ho, Mohnish Sai Prasad, Vincent Titterton, Sai Venkat Malreddy, Riya Aggarwal, Yanwen Xu, Lei Ding, Jay Mehta, Nathan Grinnell, Li Liu, Sijia Zhong, Devanathan Nallur Gandamani, Xinyi Tang, Rohan Ghosalkar, Celeste Shen, Rachel Shen, Nafisa Hussain, Kesav Ravichandran, James Davis

Abstract: In the rapidly evolving landscape of artificial intelligence (AI), the collaboration between human intelligence and AI systems, known as Human-AI (HAI) Teaming, has emerged as a cornerstone for advancing problem-solving and decision-making processes. The advent of Large Pre-trained Models (LPtM) has significantly transformed this landscape, offering unprecedented capabilities by leveraging vast am… ▽ More In the rapidly evolving landscape of artificial intelligence (AI), the collaboration between human intelligence and AI systems, known as Human-AI (HAI) Teaming, has emerged as a cornerstone for advancing problem-solving and decision-making processes. The advent of Large Pre-trained Models (LPtM) has significantly transformed this landscape, offering unprecedented capabilities by leveraging vast amounts of data to understand and predict complex patterns. This paper surveys the pivotal integration of LPtMs with HAI, emphasizing how these models enhance collaborative intelligence beyond traditional approaches. It examines the potential of LPtMs in augmenting human capabilities, discussing this collaboration for AI model improvements, effective teaming, ethical considerations, and their broad applied implications in various sectors. Through this exploration, the study sheds light on the transformative impact of LPtM-enhanced HAI Teaming, providing insights for future research, policy development, and strategic implementations aimed at harnessing the full potential of this collaboration for research and societal benefit. △ Less

Submitted 26 June, 2024; v1 submitted 7 March, 2024; originally announced March 2024.

Are More LLM Calls All You Need? Towards Scaling Laws of Compound Inference Systems

Authors: Lingjiao Chen, Jared Quincy Davis, Boris Hanin, Peter Bailis, Ion Stoica, Matei Zaharia, James Zou

Abstract: Many recent state-of-the-art results in language tasks were achieved using compound systems that perform multiple Language Model (LM) calls and aggregate their responses. However, there is little understanding of how the number of LM calls - e.g., when asking the LM to answer each question multiple times and taking a majority vote - affects such a compound system's performance. In this paper, we i… ▽ More Many recent state-of-the-art results in language tasks were achieved using compound systems that perform multiple Language Model (LM) calls and aggregate their responses. However, there is little understanding of how the number of LM calls - e.g., when asking the LM to answer each question multiple times and taking a majority vote - affects such a compound system's performance. In this paper, we initiate the study of scaling properties of compound inference systems. We analyze, theoretically and empirically, how the number of LM calls affects the performance of Vote and Filter-Vote, two of the simplest compound system designs, which aggregate LM responses via majority voting, optionally applying LM filters. We find, surprisingly, that across multiple language tasks, the performance of both Vote and Filter-Vote can first increase but then decrease as a function of the number of LM calls. Our theoretical results suggest that this non-monotonicity is due to the diversity of query difficulties within a task: more LM calls lead to higher performance on "easy" queries, but lower performance on "hard" queries, and non-monotone behavior can emerge when a task contains both types of queries. This insight then allows us to compute, from a small number of samples, the number of LM calls that maximizes system performance, and define an analytical scaling model for both systems. Experiments show that our scaling model can accurately predict the performance of Vote and Filter-Vote systems and thus find the optimal number of LM calls to make. △ Less

Submitted 4 June, 2024; v1 submitted 4 March, 2024; originally announced March 2024.

Dichotomous Dynamics of Magnetic Monopole Fluids

Authors: Chun-Chih Hsu, Hiroto Takahashi, Fabian Jerzembeck, Jahnatta Dasini, Chaia Carroll, Ritika Dusad, Jonathan Ward, Catherine Dawson, Sudarshan Sharma, Graeme Luke, Stephen J. Blundell, Claudio Castelnovo, Jonathan N. Hallén, Roderich Moessner, J. C. Séamus Davis

Abstract: A recent advance in the study of emergent magnetic monopoles was the discovery that monopole motion is restricted to dynamical fractal trajectories (J. Hallén et al, Science 378, 1218 (2022)) thus explaining the characteristics of magnetic monopole noise spectra (Dusad, R. et al. Nature 571, 234 (2019); Samarakoon, A. M. et al. Proc. Natl. Acad. Sci. 119, e2117453119 (2022)). Here we apply this ne… ▽ More A recent advance in the study of emergent magnetic monopoles was the discovery that monopole motion is restricted to dynamical fractal trajectories (J. Hallén et al, Science 378, 1218 (2022)) thus explaining the characteristics of magnetic monopole noise spectra (Dusad, R. et al. Nature 571, 234 (2019); Samarakoon, A. M. et al. Proc. Natl. Acad. Sci. 119, e2117453119 (2022)). Here we apply this new theory to explore the dynamics of field-driven monopole currents, finding them comprised of two quite distinct transport processes: initially swift fractal rearrangements of local monopole configurations followed by conventional monopole diffusion. This theory also predicts a characteristic frequency dependence of the dissipative loss-angle for AC-field-driven currents. To explore these novel perspectives on monopole transport, we introduce simultaneous monopole current control and measurement techniques using SQUID-based monopole current sensors. For the canonical material Dy2Ti2O7, we measure $Φ(t)$, the time-dependence of magnetic flux threading the sample when a net monopole current $J(t) = \dotΦ(t)/μ_0$ is generated by applying an external magnetic field $B_0(t)$. These experiments find a sharp dichotomy of monopole currents, separated by their distinct relaxation time-constants before and after $t \approx 600 μs$ from monopole current initiation. Application of sinusoidal magnetic fields $B_0(t) = Bcos(ωt)$ generates oscillating monopole currents whose loss angle $θ(f)$ exhibits a characteristic transition at frequency $f \approx 1.8$ kHz over the same temperature range. Finally, the magnetic noise power is also dichotomic, diminishing sharply after $t \approx 600 μs$. This complex phenomenology represents a new form of heterogeneous dynamics generated by the interplay of fractionalization and local spin configurational symmetry. △ Less

Submitted 9 April, 2024; v1 submitted 1 March, 2024; originally announced March 2024.

An Interview Study on Third-Party Cyber Threat Hunting Processes in the U.S. Department of Homeland Security

Authors: William P. Maxam III, James C. Davis

Abstract: Cybersecurity is a major challenge for large organizations. Traditional cybersecurity defense is reactive. Cybersecurity operations centers keep out adversaries and incident response teams clean up after break-ins. Recently a proactive stage has been introduced: Cyber Threat Hunting (TH) looks for potential compromises missed by other cyber defenses. TH is mandated for federal executive agencies a… ▽ More Cybersecurity is a major challenge for large organizations. Traditional cybersecurity defense is reactive. Cybersecurity operations centers keep out adversaries and incident response teams clean up after break-ins. Recently a proactive stage has been introduced: Cyber Threat Hunting (TH) looks for potential compromises missed by other cyber defenses. TH is mandated for federal executive agencies and government contractors. As threat hunting is a new cybersecurity discipline, most TH teams operate without a defined process. The practices and challenges of TH have not yet been documented. To address this gap, this paper describes the first interview study of threat hunt practitioners. We obtained access and interviewed 11 threat hunters associated with the U.S. government's Department of Homeland Security. Hour-long interviews were conducted. We analyzed the transcripts with process and thematic coding.We describe the diversity among their processes, show that their processes differ from the TH processes reported in the literature, and unify our subjects' descriptions into a single TH process.We enumerate common TH challenges and solutions according to the subjects. The two most common challenges were difficulty in assessing a Threat Hunter's expertise, and developing and maintaining automation. We conclude with recommendations for TH teams (improve planning, focus on automation, and apprentice new members) and highlight directions for future work (finding a TH process that balances flexibility and formalism, and identifying assessments for TH team performance). △ Less

Submitted 19 February, 2024; originally announced February 2024.

Comments: Technical report accompanying a paper at USENIX Security 2024

Melting of a vortex matter Wigner crystal

Authors: Tyler W. Neely, Guillaume Gauthier, Charles Glasspool, Matthew J. Davis, Matthew T. Reeves

Abstract: The two-dimensional One-Component Plasma (OCP) is a foundational model of the statistical mechanics of interacting particles, describing phenomena common to astrophysics, turbulence, and the Fractional Quantum Hall Effect (FQHE). Despite an extensive literature, the phase diagram of the 2D OCP is still a subject of some controversy. Here we develop a "vortex matter" simulator to realize the logari… ▽ More The two-dimensional One-Component Plasma (OCP) is a foundational model of the statistical mechanics of interacting particles, describing phenomena common to astrophysics, turbulence, and the Fractional Quantum Hall Effect (FQHE). Despite an extensive literature, the phase diagram of the 2D OCP is still a subject of some controversy. Here we develop a "vortex matter" simulator to realize the logarithmic-interaction OCP experimentally by exploiting the topological character of quantized vortices in a thin superfluid layer. Precision optical-tweezer control of the location of quantized vortices enables direct preparation of the OCP ground state with or without defects, and heating from acoustic excitations allows the observation of the melting transition from the solid Wigner crystal through the liquid phase. We present novel theoretical analysis that is in quantitative agreement with experimental observations, and demonstrates how equilibrium states are achieved through the system dynamics. This allows a precise measurement of the superfluid-thermal cloud mutual friction and heating coefficients. This platform provides a route towards solving a number of open problems in systems with long-range interactions. At equilibrium, it could distinguish between the competing scenarios of grain boundary melting and KTHNY theory. Dynamical simulators could test the existence of predicted edge-wave solitons which form a hydrodynamic analogue of topological edge states in the FQHE. △ Less

Submitted 15 February, 2024; originally announced February 2024.

Comments: 9 pages, 9 figures

Taking GPU Programming Models to Task for Performance Portability

Authors: Joshua H. Davis, Pranav Sivaraman, Joy Kitson, Konstantinos Parasyris, Harshitha Menon, Isaac Minn, Giorgis Georgakoudis, Abhinav Bhatele

Abstract: Portability is critical to ensuring high productivity in developing and maintaining scientific software as the diversity in on-node hardware architectures increases. While several programming models provide portability for diverse GPU platforms, they don't make any guarantees about performance portability. In this work, we explore several programming models -- CUDA, HIP, Kokkos, RAJA, OpenMP, Open… ▽ More Portability is critical to ensuring high productivity in developing and maintaining scientific software as the diversity in on-node hardware architectures increases. While several programming models provide portability for diverse GPU platforms, they don't make any guarantees about performance portability. In this work, we explore several programming models -- CUDA, HIP, Kokkos, RAJA, OpenMP, OpenACC, and SYCL, to study if the performance of these models is consistently good across NVIDIA and AMD GPUs. We use five proxy applications from different scientific domains, create implementations where missing, and use them to present a comprehensive comparative evaluation of the programming models. We provide a Spack scripting-based methodology to ensure reproducibility of experiments conducted in this work. Finally, we attempt to answer the question -- to what extent does each programming model provide performance portability for heterogeneous systems in real-world usage? △ Less

Submitted 21 May, 2024; v1 submitted 14 February, 2024; originally announced February 2024.

Comments: 12 pages, 4 figures

Faster Repeated Evasion Attacks in Tree Ensembles

Authors: Lorenzo Cascioli, Laurens Devos, Ondřej Kuželka, Jesse Davis

Abstract: Tree ensembles are one of the most widely used model classes. However, these models are susceptible to adversarial examples, i.e., slightly perturbed examples that elicit a misprediction. There has been significant research on designing approaches to construct such examples for tree ensembles. But this is a computationally challenging problem that often must be solved a large number of times (e.g.… ▽ More Tree ensembles are one of the most widely used model classes. However, these models are susceptible to adversarial examples, i.e., slightly perturbed examples that elicit a misprediction. There has been significant research on designing approaches to construct such examples for tree ensembles. But this is a computationally challenging problem that often must be solved a large number of times (e.g., for all examples in a training set). This is compounded by the fact that current approaches attempt to find such examples from scratch. In contrast, we exploit the fact that multiple similar problems are being solved. Specifically, our approach exploits the insight that adversarial examples for tree ensembles tend to perturb a consistent but relatively small set of features. We show that we can quickly identify this set of features and use this knowledge to speedup constructing adversarial examples. △ Less

Submitted 13 February, 2024; originally announced February 2024.