Showing 1–50 of 154 results for author: Lawrence, D

"A Good Bot Always Knows Its Limitations": Assessing Autonomous System Decision-making Competencies through Factorized Machine Self-confidence

Authors: Brett Israelsen, Nisar R. Ahmed, Matthew Aitken, Eric W. Frew, Dale A. Lawrence, Brian M. Argrow

Abstract: How can intelligent machines assess their competencies in completing tasks? This question has come into focus for autonomous systems that algorithmically reason and make decisions under uncertainty. It is argued here that machine self-confidence - a form of meta-reasoning based on self-assessments of an agent's knowledge about the state of the world and itself, as well as its ability to reason abo… ▽ More How can intelligent machines assess their competencies in completing tasks? This question has come into focus for autonomous systems that algorithmically reason and make decisions under uncertainty. It is argued here that machine self-confidence - a form of meta-reasoning based on self-assessments of an agent's knowledge about the state of the world and itself, as well as its ability to reason about and execute tasks - leads to many eminently computable and useful competency indicators for such agents. This paper presents a culmination of work on this concept in the form of a computational framework called Factorized Machine Self-confidence (FaMSeC), which provides a holistic engineering-focused description of factors driving an algorithmic decision-making process, including: outcome assessment, solver quality, model quality, alignment quality, and past experience. In FaMSeC, self confidence indicators are derived from hierarchical `problem-solving statistics' embedded within broad classes of probabilistic decision-making algorithms such as Markov decision processes. The problem-solving statistics are obtained by evaluating and grading probabilistic exceedance margins with respect to given competency standards, which are specified for each of the various decision-making competency factors by the informee (e.g. a non-expert user or an expert system designer). This approach allows `algorithmic goodness of fit' evaluations to be easily incorporated into the design of many kinds of autonomous agents in the form of human-interpretable competency self-assessment reports. Detailed descriptions and application examples for a Markov decision process agent show how two of the FaMSeC factors (outcome assessment and solver quality) can be computed and reported for a range of possible tasking contexts through novel use of meta-utility functions, behavior simulations, and surrogate prediction models. △ Less

Submitted 2 August, 2024; v1 submitted 28 July, 2024; originally announced July 2024.

Comments: 59 pages, 22 figures, draft to be submitted for journal review

An Upper Limit on the Photoproduction Cross Section of the Spin-Exotic $π_1(1600)$

Authors: F. Afzal, C. S. Akondi, M. Albrecht, M. Amaryan, S. Arrigo, V. Arroyave, A. Asaturyan, A. Austregesilo, Z. Baldwin, F. Barbosa, J. Barlow, E. Barriga, R. Barsotti, D. Barton, V. Baturin, V. V. Berdnikov, T. Black, W. Boeglin, M. Boer, W. J. Briscoe, T. Britton, S. Cao, E. Chudakov, G. Chung, P. L. Cole , et al. (124 additional authors not shown)

Abstract: The spin-exotic hybrid meson $π_{1}(1600)$ is predicted to have a large decay rate to the $ωππ$ final state. Using 76.6~pb$^{-1}$ of data collected with the GlueX detector, we measure the cross sections for the reactions $γp \to ωπ^+ π^- p$, $γp \to ωπ^0 π^0 p$, and $γp\toωπ^-π^0Δ^{++}$ in the range $E_γ=$ 8-10 GeV. Using isospin conservation, we set the first upper limits on the photoproduction c… ▽ More The spin-exotic hybrid meson $π_{1}(1600)$ is predicted to have a large decay rate to the $ωππ$ final state. Using 76.6~pb$^{-1}$ of data collected with the GlueX detector, we measure the cross sections for the reactions $γp \to ωπ^+ π^- p$, $γp \to ωπ^0 π^0 p$, and $γp\toωπ^-π^0Δ^{++}$ in the range $E_γ=$ 8-10 GeV. Using isospin conservation, we set the first upper limits on the photoproduction cross sections of the $π^{0}_{1}(1600)$ and $π^{-}_{1}(1600)$. We combine these limits with lattice calculations of decay widths and find that photoproduction of $η'π$ is the most sensitive two-body system to search for the $π_1(1600)$. △ Less

Submitted 3 July, 2024; originally announced July 2024.

Comments: 6 pages, 3 figures plus supplemental materials

On Feature Learning for Titi Monkey Activity Detection

Authors: Aditya Ravuri, Jen Muir, Neil D. Lawrence

Abstract: This paper, a technical summary of our preceding publication, introduces a robust machine learning framework for the detection of vocal activities of Coppery titi monkeys. Utilizing a combination of MFCC features and a bidirectional LSTM-based classifier, we effectively address the challenges posed by the small amount of expert-annotated vocal data available. Our approach significantly reduces fal… ▽ More This paper, a technical summary of our preceding publication, introduces a robust machine learning framework for the detection of vocal activities of Coppery titi monkeys. Utilizing a combination of MFCC features and a bidirectional LSTM-based classifier, we effectively address the challenges posed by the small amount of expert-annotated vocal data available. Our approach significantly reduces false positives and improves the accuracy of call detection in bioacoustic research. Initial results demonstrate an accuracy of 95\% on instance predictions, highlighting the effectiveness of our model in identifying and classifying complex vocal patterns in environmental audio recordings. Moreover, we show how call classification can be done downstream, paving the way for real-world monitoring. △ Less

Submitted 1 July, 2024; originally announced July 2024.

OQuPy: A Python package to efficiently simulate non-Markovian open quantum systems with process tensors

Authors: Gerald E. Fux, Piper Fowler-Wright, Joel Beckles, Eoin P. Butler, Paul R. Eastham, Dominic Gribben, Jonathan Keeling, Dainius Kilda, Peter Kirton, Ewen D. C. Lawrence, Brendon W. Lovett, Eoin O'Neill, Aidan Strathearn, Roosmarijn de Wit

Abstract: Non-Markovian dynamics arising from the strong coupling of a system to a structured environment is essential in many applications of quantum mechanics and emerging technologies. Deriving an accurate description of general quantum dynamics including memory effects is however a demanding task, prohibitive to standard analytical or direct numerical approaches. We present a major release of our open s… ▽ More Non-Markovian dynamics arising from the strong coupling of a system to a structured environment is essential in many applications of quantum mechanics and emerging technologies. Deriving an accurate description of general quantum dynamics including memory effects is however a demanding task, prohibitive to standard analytical or direct numerical approaches. We present a major release of our open source software package, OQuPy (Open Quantum System in Python), which provides several recently developed numerical methods that address this challenging task. It utilizes the process tensor approach to open quantum systems in which a single map, the process tensor, captures all possible effects of an environment on the system. The representation of the process tensor in a tensor network form allows an exact yet highly efficient description of non-Markovian open quantum systems (NM-OQS). The OQuPy package provides methods to (1) compute the dynamics and multi-time correlations of quantum systems coupled to single and multiple environments, (2) optimize control protocols for NM-OQS, (3) simulate interacting chains of NM-OQS, and (4) compute the mean-field dynamics of an ensemble of NM-OQS coupled to a common central system. Our aim is to provide an easily accessible and extensible tool for researchers of open quantum systems in fields such as quantum chemistry, quantum sensing, and quantum information. △ Less

Submitted 24 June, 2024; originally announced June 2024.

Comments: 20 pages, 15 figures

Measurement of Spin-Density Matrix Elements in $Δ^{++}(1232)$ photoproduction

Authors: F. Afzal, C. S. Akondi, M. Albrecht, M. Amaryan, S. Arrigo, V. Arroyave, A. Asaturyan, A. Austregesilo, Z. Baldwin, F. Barbosa, J. Barlow, E. Barriga, R. Barsotti, D. Barton, V. Baturin, V. V. Berdnikov, T. Black, W. Boeglin, M. Boer, W. J. Briscoe, T. Britton, S. Cao, E. Chudakov, G. Chung, P. L. Cole , et al. (124 additional authors not shown)

Abstract: We measure the spin-density matrix elements (SDMEs) of the $Δ^{++}(1232)$ in the photoproduction reaction $γp \to π^-Δ^{++}(1232)$ with the GlueX experiment in Hall D at Jefferson Lab. The measurement uses a linearly--polarized photon beam with energies from $8.2$ to $8.8$~GeV and the statistical precision of the SDMEs exceeds the previous measurement by three orders of magnitude for the momentum… ▽ More We measure the spin-density matrix elements (SDMEs) of the $Δ^{++}(1232)$ in the photoproduction reaction $γp \to π^-Δ^{++}(1232)$ with the GlueX experiment in Hall D at Jefferson Lab. The measurement uses a linearly--polarized photon beam with energies from $8.2$ to $8.8$~GeV and the statistical precision of the SDMEs exceeds the previous measurement by three orders of magnitude for the momentum transfer squared region below $1.4$ GeV$^2$. The data are sensitive to the previously undetermined relative sign between couplings in existing Regge-exchange models. Linear combinations of the extracted SDMEs allow for a decomposition into natural and unnatural--exchange amplitudes. We find that the unnatural exchange plays an important role in the low momentum transfer region. △ Less

Submitted 26 July, 2024; v1 submitted 18 June, 2024; originally announced June 2024.

Towards One Model for Classical Dimensionality Reduction: A Probabilistic Perspective on UMAP and t-SNE

Authors: Aditya Ravuri, Neil D. Lawrence

Abstract: This paper shows that the dimensionality reduction methods, UMAP and t-SNE, can be approximately recast as MAP inference methods corresponding to a generalized Wishart-based model introduced in ProbDR. This interpretation offers deeper theoretical insights into these algorithms, while introducing tools with which similar dimensionality reduction methods can be studied. This paper shows that the dimensionality reduction methods, UMAP and t-SNE, can be approximately recast as MAP inference methods corresponding to a generalized Wishart-based model introduced in ProbDR. This interpretation offers deeper theoretical insights into these algorithms, while introducing tools with which similar dimensionality reduction methods can be studied. △ Less

Submitted 27 May, 2024; originally announced May 2024.

Comments: Workshop preprint

Requirements are All You Need: The Final Frontier for End-User Software Engineering

Authors: Diana Robinson, Christian Cabrera, Andrew D. Gordon, Neil D. Lawrence, Lars Mennen

Abstract: What if end users could own the software development lifecycle from conception to deployment using only requirements expressed in language, images, video or audio? We explore this idea, building on the capabilities that generative Artificial Intelligence brings to software generation and maintenance techniques. How could designing software in this way better serve end users? What are the implicati… ▽ More What if end users could own the software development lifecycle from conception to deployment using only requirements expressed in language, images, video or audio? We explore this idea, building on the capabilities that generative Artificial Intelligence brings to software generation and maintenance techniques. How could designing software in this way better serve end users? What are the implications of this process for the future of end-user software engineering and the software development lifecycle? We discuss the research needed to bridge the gap between where we are today and these imagined systems of the future. △ Less

Submitted 22 May, 2024; originally announced May 2024.

Comments: Accepted at International Workshop on Software Engineering 2030 in Porto de Galinhas, Brazil (July 2024)

Scalable Amortized GPLVMs for Single Cell Transcriptomics Data

Authors: Sarah Zhao, Aditya Ravuri, Vidhi Lalchand, Neil D. Lawrence

Abstract: Dimensionality reduction is crucial for analyzing large-scale single-cell RNA-seq data. Gaussian Process Latent Variable Models (GPLVMs) offer an interpretable dimensionality reduction method, but current scalable models lack effectiveness in clustering cell types. We introduce an improved model, the amortized stochastic variational Bayesian GPLVM (BGPLVM), tailored for single-cell RNA-seq with sp… ▽ More Dimensionality reduction is crucial for analyzing large-scale single-cell RNA-seq data. Gaussian Process Latent Variable Models (GPLVMs) offer an interpretable dimensionality reduction method, but current scalable models lack effectiveness in clustering cell types. We introduce an improved model, the amortized stochastic variational Bayesian GPLVM (BGPLVM), tailored for single-cell RNA-seq with specialized encoder, kernel, and likelihood designs. This model matches the performance of the leading single-cell variational inference (scVI) approach on synthetic and real-world COVID datasets and effectively incorporates cell-cycle and batch information to reveal more interpretable latent structures as we demonstrate on an innate immunity dataset. △ Less

Submitted 6 May, 2024; originally announced May 2024.

ML-based Calibration and Control of the GlueX Central Drift Chamber

Authors: Thomas Britton, Michael Goodrich, Naomi Jarvis, Torri Jeske, Nikhil Kalra, David Lawrence, Diana McSpadden, Kishan Rajput

Abstract: The GlueX Central Drift Chamber (CDC) in Hall D at Jefferson Lab, used for detecting and tracking charged particles, is calibrated and controlled during data taking using a Gaussian process. The system dynamically adjusts the high voltage applied to the anode wires inside the chamber in response to changing environmental and experimental conditions such that the gain is stabilized. Control policie… ▽ More The GlueX Central Drift Chamber (CDC) in Hall D at Jefferson Lab, used for detecting and tracking charged particles, is calibrated and controlled during data taking using a Gaussian process. The system dynamically adjusts the high voltage applied to the anode wires inside the chamber in response to changing environmental and experimental conditions such that the gain is stabilized. Control policies have been established to manage the CDC's behavior. These policies are activated when the model's uncertainty exceeds a configurable threshold or during human-initiated tests during normal production running. We demonstrate the system reduces the time detector experts dedicate to calibration of the data offline, leading to a marked decrease in computing resource usage without compromising detector performance. △ Less

Submitted 3 July, 2024; v1 submitted 5 March, 2024; originally announced March 2024.

Comments: AI4EIC2023, 9 pages

Hydra: Computer Vision for Data Quality Monitoring

Authors: Thomas Britton, Torri Jeske, David Lawrence, Kishansingh Rajput

Abstract: Hydra is a system which utilizes computer vision to perform near real time data quality management, initially developed for Hall-D in 2019. Since then, it has been deployed across all experimental halls at Jefferson Lab, with the CLAS12 collaboration in Hall-B being the first outside of GlueX to fully utilize Hydra. The system comprises back end processes that manage the models, their inferences,… ▽ More Hydra is a system which utilizes computer vision to perform near real time data quality management, initially developed for Hall-D in 2019. Since then, it has been deployed across all experimental halls at Jefferson Lab, with the CLAS12 collaboration in Hall-B being the first outside of GlueX to fully utilize Hydra. The system comprises back end processes that manage the models, their inferences, and the data flow. The front-end components, accessible via web pages, allow detector experts and shift crews to view and interact with the system. This talk will give an overview of the Hydra system as well as highlight significant developments in Hydra's feature set, acute challenges with operating Hydra in all halls, and lessons learned along the way. △ Less

Submitted 1 March, 2024; originally announced March 2024.

AI Assisted Experiment Control and Calibration

Authors: Thomas Britton, Michael Goodrich, Naomi Jarvis, Torri Jeske, Nikhil Kalra, David Lawrence, Diana McSpadden

Abstract: Final report for the AI Assisted Experiment Control and Calibration project. This project integrated AI/ML into the controls and calibration of a production detector system in the GlueX spectrometer, a large scale Nuclear Physics detector in experimental Hall-D at Jefferson Lab. The AI/ML model predicted calibration constants for a Central Drift Chamber using environmental information available pr… ▽ More Final report for the AI Assisted Experiment Control and Calibration project. This project integrated AI/ML into the controls and calibration of a production detector system in the GlueX spectrometer, a large scale Nuclear Physics detector in experimental Hall-D at Jefferson Lab. The AI/ML model predicted calibration constants for a Central Drift Chamber using environmental information available prior to taking the data. The device controls were then automatically adjusted so that the calibration values needed for post-processing of the data were much more stable and quicker to determine. Integration into a production system required guardrails and policy choices to ensure safety of the equipment and the data quality. The project sought to apply similar technology to other detectors. Those efforts are also described here. This documents many of the details of the project. △ Less

Submitted 7 February, 2024; originally announced February 2024.

Comments: 68 pages

Self-sustaining Software Systems (S4): Towards Improved Interpretability and Adaptation

Authors: Christian Cabrera, Andrei Paleyes, Neil D. Lawrence

Abstract: Software systems impact society at different levels as they pervasively solve real-world problems. Modern software systems are often so sophisticated that their complexity exceeds the limits of human comprehension. These systems must respond to changing goals, dynamic data, unexpected failures, and security threats, among other variable factors in real-world environments. Systems' complexity chall… ▽ More Software systems impact society at different levels as they pervasively solve real-world problems. Modern software systems are often so sophisticated that their complexity exceeds the limits of human comprehension. These systems must respond to changing goals, dynamic data, unexpected failures, and security threats, among other variable factors in real-world environments. Systems' complexity challenges their interpretability and requires autonomous responses to dynamic changes. Two main research areas explore autonomous systems' responses: evolutionary computing and autonomic computing. Evolutionary computing focuses on software improvement based on iterative modifications to the source code. Autonomic computing focuses on optimising systems' performance by changing their structure, behaviour, or environment variables. Approaches from both areas rely on feedback loops that accumulate knowledge from the system interactions to inform autonomous decision-making. However, this knowledge is often limited, constraining the systems' interpretability and adaptability. This paper proposes a new concept for interpretable and adaptable software systems: self-sustaining software systems (S4). S4 builds knowledge loops between all available knowledge sources that define modern software systems to improve their interpretability and adaptability. This paper introduces and discusses the S4 concept. △ Less

Submitted 20 January, 2024; originally announced January 2024.

Comments: Accepted at The 1st International Workshop New Trends in Software Architecture (SATrends) 2024

A numerical approach for calculating exact non-adiabatic terms in quantum dynamics

Authors: Ewen D C Lawrence, Sebastian F J Schmid, Ieva Čepaitė, Peter Kirton, Callum W Duncan

Abstract: Understanding how non-adiabatic terms affect quantum dynamics is fundamental to improving various protocols for quantum technologies. We present a novel approach to computing the Adiabatic Gauge Potential (AGP), which gives information on the non-adiabatic terms that arise from time dependence in the Hamiltonian. Our approach uses commutators of the Hamiltonian to build up an appropriate basis of… ▽ More Understanding how non-adiabatic terms affect quantum dynamics is fundamental to improving various protocols for quantum technologies. We present a novel approach to computing the Adiabatic Gauge Potential (AGP), which gives information on the non-adiabatic terms that arise from time dependence in the Hamiltonian. Our approach uses commutators of the Hamiltonian to build up an appropriate basis of the AGP, which can be easily truncated to give an approximate form when the exact result is intractable. We use this approach to study the AGP obtained for the transverse field Ising model on a variety of graphs, showing how the different underlying graph structures can give rise to very different scaling for the number of terms required in the AGP. △ Less

Submitted 19 January, 2024; originally announced January 2024.

Comments: 28 pages, 6 figures, comments welcome

Probabilistic Reconstruction of Paleodemographic Signals

Authors: L. M. Arthur, F. Chelazzi, D. Lawrence, M. D. Price

Abstract: We present a comprehensive Bayesian approach to paleodemography, emphasizing the proper handling of uncertainties. We then apply that framework to survey data from Cyprus, and quantify the uncertainties in the paleodemographic estimates to demonstrate the applicability of the Bayesian approach and to show the large uncertainties present in current paleodemographic models and data. We also discuss… ▽ More We present a comprehensive Bayesian approach to paleodemography, emphasizing the proper handling of uncertainties. We then apply that framework to survey data from Cyprus, and quantify the uncertainties in the paleodemographic estimates to demonstrate the applicability of the Bayesian approach and to show the large uncertainties present in current paleodemographic models and data. We also discuss methods to reduce the uncertainties and improve the efficacy of paleodemographic models. △ Less

Submitted 11 June, 2024; v1 submitted 8 December, 2023; originally announced December 2023.

Comments: 17 pages, 2 figures; expanded discussion, additional references, improved figures

Presentation Attack Detection using Convolutional Neural Networks and Local Binary Patterns

Authors: Justin Spencer, Deborah Lawrence, Prosenjit Chatterjee, Kaushik Roy, Albert Esterline, Jung-Hee Kim

Abstract: The use of biometrics to authenticate users and control access to secure areas has become extremely popular in recent years, and biometric access control systems are frequently used by both governments and private corporations. However, these systems may represent risks to security when deployed without considering the possibility of biometric presentation attacks (also known as spoofing). Present… ▽ More The use of biometrics to authenticate users and control access to secure areas has become extremely popular in recent years, and biometric access control systems are frequently used by both governments and private corporations. However, these systems may represent risks to security when deployed without considering the possibility of biometric presentation attacks (also known as spoofing). Presentation attacks are a serious threat because they do not require significant time, expense, or skill to carry out while remaining effective against many biometric systems in use today. This research compares three different software-based methods for facial and iris presentation attack detection in images. The first method uses Inception-v3, a pre-trained deep Convolutional Neural Network (CNN) made by Google for the ImageNet challenge, which is retrained for this problem. The second uses a shallow CNN based on a modified Spoofnet architecture, which is trained normally. The third is a texture-based method using Local Binary Patterns (LBP). The datasets used are the ATVS-FIr dataset, which contains real and fake iris images, and the CASIA Face Anti-Spoofing Dataset, which contains real images as well as warped photos, cut photos, and video replay presentation attacks. We also present a third set of results, based on cropped versions of the CASIA images. △ Less

Submitted 23 November, 2023; originally announced December 2023.

Automated discovery of trade-off between utility, privacy and fairness in machine learning models

Authors: Bogdan Ficiu, Neil D. Lawrence, Andrei Paleyes

Abstract: Machine learning models are deployed as a central component in decision making and policy operations with direct impact on individuals' lives. In order to act ethically and comply with government regulations, these models need to make fair decisions and protect the users' privacy. However, such requirements can come with decrease in models' performance compared to their potentially biased, privacy… ▽ More Machine learning models are deployed as a central component in decision making and policy operations with direct impact on individuals' lives. In order to act ethically and comply with government regulations, these models need to make fair decisions and protect the users' privacy. However, such requirements can come with decrease in models' performance compared to their potentially biased, privacy-leaking counterparts. Thus the trade-off between fairness, privacy and performance of ML models emerges, and practitioners need a way of quantifying this trade-off to enable deployment decisions. In this work we interpret this trade-off as a multi-objective optimization problem, and propose PFairDP, a pipeline that uses Bayesian optimization for discovery of Pareto-optimal points between fairness, privacy and utility of ML models. We show how PFairDP can be used to replicate known results that were achieved through manual constraint setting process. We further demonstrate effectiveness of PFairDP with experiments on multiple models and datasets. △ Less

Submitted 27 November, 2023; originally announced November 2023.

Comments: 3rd Workshop on Bias and Fairness in AI (BIAS), ECML 2023

Mixing model of Phobos' bulk elemental composition for the determination of its origin: Multivariate analysis of MMX/MEGANE data

Authors: Kaori Hirata, Tomohiro Usui, Ryuki Hyodo, Hidenori Genda, Ryota Fukai, David J. Lawrence, Nancy L. Chabot, Patrick N. Peplowski, Hiroki Kusano

Abstract: The formation process of the two Martian moons, Phobos and Deimos, is still debated with two main competing hypotheses: the capture of an asteroid or a giant impact onto Mars. In order to reveal their origin, the Martian Moons eXploration (MMX) mission by Japan Aerospace Exploration Agency (JAXA) plans to measure Phobos' elemental composition by a gamma-ray and neutron spectrometer called MEGANE.… ▽ More The formation process of the two Martian moons, Phobos and Deimos, is still debated with two main competing hypotheses: the capture of an asteroid or a giant impact onto Mars. In order to reveal their origin, the Martian Moons eXploration (MMX) mission by Japan Aerospace Exploration Agency (JAXA) plans to measure Phobos' elemental composition by a gamma-ray and neutron spectrometer called MEGANE. This study provides a model of Phobos' bulk elemental composition, assuming the two formation hypotheses. Using the mixing model, we established a MEGANE data analysis flow to discriminate between the formation hypotheses by multivariate analysis. The mixing model expresses the composition of Phobos in 6 key lithophile elements that will be measured by MEGANE (Fe, Si, O, Ca, Mg, and Th) as a linear mixing of two mixing components: material from Mars and material from an asteroid as represented by primitive meteorite compositions. The inversion calculation includes consideration of MEGANE's measurement errors ($E_P$) and derives the mixing ratio for a given Phobos composition, based on which the formation hypotheses are judged. For at least 65\% of the modeled compositions, MEGANE measurements will determine the origin uniquely ($E_P$ = 30\%), and this increases from 74 to 87\% as $E_P$ decreases from 20 to 10\%. Although the discrimination performance depends on $E_P$, the current operation plan for MEGANE predicts an instrument performance for $E_P$ of 20--30\%, resulting in ~70\% discrimination between the original hypotheses. MEGANE observations can also enable the determination of the asteroid type of the captured body or the impactor. The addition of other measurements, such as MEGANE's measurements of the volatile element K, as well as observations by other MMX remote sensing instruments, will also contribute to the MMX mission's goal to constrain the origin of Phobos. △ Less

Submitted 27 November, 2023; originally announced November 2023.

Comments: 34 pages, 7 figures, accepted for publication in Icarus

Measurement of Spin-Density Matrix Elements in $ρ(770)$ Production with a Linearly Polarized Photon Beam at $E_γ= 8.2\,-\,8.8\,\text{GeV}$

Authors: GlueX Collaboration, S. Adhikari, F. Afzal, C. S. Akondi, M. Albrecht, M. Amaryan, V. Arroyave, A. Asaturyan, A. Austregesilo, Z. Baldwin, F. Barbosa, J. Barlow, E. Barriga, R. Barsotti, T. D. Beattie, V. V. Berdnikov, T. Black, W. Boeglin, W. J. Briscoe, T. Britton, W. K. Brooks, D. Byer, E. Chudakov, P. L. Cole, O. Cortes , et al. (128 additional authors not shown)

Abstract: The GlueX experiment at Jefferson Lab studies photoproduction of mesons using linearly polarized $8.5\,\text{GeV}$ photons impinging on a hydrogen target which is contained within a detector with near-complete coverage for charged and neutral particles. We present measurements of spin-density matrix elements for the photoproduction of the vector meson $ρ$(770). The statistical precision achieved e… ▽ More The GlueX experiment at Jefferson Lab studies photoproduction of mesons using linearly polarized $8.5\,\text{GeV}$ photons impinging on a hydrogen target which is contained within a detector with near-complete coverage for charged and neutral particles. We present measurements of spin-density matrix elements for the photoproduction of the vector meson $ρ$(770). The statistical precision achieved exceeds that of previous experiments for polarized photoproduction in this energy range by orders of magnitude. We confirm a high degree of $s$-channel helicity conservation at small squared four-momentum transfer $t$ and are able to extract the $t$-dependence of natural and unnatural-parity exchange contributions to the production process in detail. We confirm the dominance of natural-parity exchange over the full $t$ range. We also find that helicity amplitudes in which the helicity of the incident photon and the photoproduced $ρ(770)$ differ by two units are negligible for $-t<0.5\,\text{GeV}^{2}/c^{2}$. △ Less

Submitted 9 July, 2024; v1 submitted 15 May, 2023; originally announced May 2023.

Comments: 15 pages, 11 figures

Journal ref: Phys. Rev. C 108, 055204 (2023)

Causal fault localisation in dataflow systems

Authors: Andrei Paleyes, Neil D. Lawrence

Abstract: Dataflow computing was shown to bring significant benefits to multiple niches of systems engineering and has the potential to become a general-purpose paradigm of choice for data-driven application development. One of the characteristic features of dataflow computing is the natural access to the dataflow graph of the entire system. Recently it has been observed that these dataflow graphs can be tr… ▽ More Dataflow computing was shown to bring significant benefits to multiple niches of systems engineering and has the potential to become a general-purpose paradigm of choice for data-driven application development. One of the characteristic features of dataflow computing is the natural access to the dataflow graph of the entire system. Recently it has been observed that these dataflow graphs can be treated as complete graphical causal models, opening opportunities to apply causal inference techniques to dataflow systems. In this demonstration paper we aim to provide the first practical validation of this idea with a particular focus on causal fault localisation. We provide multiple demonstrations of how causal inference can be used to detect software bugs and data shifts in multiple scenarios with three modern dataflow engines. △ Less

Submitted 24 April, 2023; originally announced April 2023.

Comments: Accepted to EuroMLSys'23

Dimensionality Reduction as Probabilistic Inference

Authors: Aditya Ravuri, Francisco Vargas, Vidhi Lalchand, Neil D. Lawrence

Abstract: Dimensionality reduction (DR) algorithms compress high-dimensional data into a lower dimensional representation while preserving important features of the data. DR is a critical step in many analysis pipelines as it enables visualisation, noise reduction and efficient downstream processing of the data. In this work, we introduce the ProbDR variational framework, which interprets a wide range of cl… ▽ More Dimensionality reduction (DR) algorithms compress high-dimensional data into a lower dimensional representation while preserving important features of the data. DR is a critical step in many analysis pipelines as it enables visualisation, noise reduction and efficient downstream processing of the data. In this work, we introduce the ProbDR variational framework, which interprets a wide range of classical DR algorithms as probabilistic inference algorithms in this framework. ProbDR encompasses PCA, CMDS, LLE, LE, MVU, diffusion maps, kPCA, Isomap, (t-)SNE, and UMAP. In our framework, a low-dimensional latent variable is used to construct a covariance, precision, or a graph Laplacian matrix, which can be used as part of a generative model for the data. Inference is done by optimizing an evidence lower bound. We demonstrate the internal consistency of our framework and show that it enables the use of probabilistic programming languages (PPLs) for DR. Additionally, we illustrate that the framework facilitates reasoning about unseen data and argue that our generative models approximate Gaussian processes (GPs) on manifolds. By providing a unified view of DR, our framework facilitates communication, reasoning about uncertainties, model composition, and extensions, particularly when domain knowledge is present. △ Less

Submitted 24 May, 2023; v1 submitted 15 April, 2023; originally announced April 2023.

Comments: Workshop version preprint, typos corrected

Measurement of the J/$ψ$ photoproduction cross section over the full near-threshold kinematic region

Authors: GlueX Collaboration, S. Adhikari, F. Afzal, C. S. Akondi, M. Albrecht, M. Amaryan, V. Arroyave, A. Asaturyan, A. Austregesilo, Z. Baldwin, F. Barbosa, J. Barlow, E. Barriga, R. Barsotti, T. D. Beattie, V. V. Berdnikov, T. Black, W. Boeglin, W. J. Briscoe, T. Britton, W. K. Brooks, D. Byer, E. Chudakov, P. L. Cole, O. Cortes , et al. (128 additional authors not shown)

Abstract: We report the total and differential cross sections for $J/ψ$ photoproduction with the large acceptance GlueX spectrometer for photon beam energies from the threshold at 8.2~GeV up to 11.44~GeV and over the full kinematic range of momentum transfer squared, $t$. Such coverage facilitates the extrapolation of the differential cross sections to the forward ($t = 0$) point beyond the physical region.… ▽ More We report the total and differential cross sections for $J/ψ$ photoproduction with the large acceptance GlueX spectrometer for photon beam energies from the threshold at 8.2~GeV up to 11.44~GeV and over the full kinematic range of momentum transfer squared, $t$. Such coverage facilitates the extrapolation of the differential cross sections to the forward ($t = 0$) point beyond the physical region. The forward cross section is used by many theoretical models and plays an important role in understanding $J/ψ$ photoproduction and its relation to the $J/ψ-$proton interaction. These measurements of $J/ψ$ photoproduction near threshold are also crucial inputs to theoretical models that are used to study important aspects of the gluon structure of the proton, such as the gluon Generalized Parton Distribution (GPD) of the proton, the mass radius of the proton, and the trace anomaly contribution to the proton mass. We observe possible structures in the total cross section energy dependence and find evidence for contributions beyond gluon exchange in the differential cross section close to threshold, both of which are consistent with contributions from open-charm intermediate states. △ Less

Submitted 9 July, 2024; v1 submitted 7 April, 2023; originally announced April 2023.

Comments: 15 pages 18 figures

Fundamental Symmetries, Neutrons, and Neutrinos (FSNN): Whitepaper for the 2023 NSAC Long Range Plan

Authors: B. Acharya, C. Adams, A. A. Aleksandrova, K. Alfonso, P. An, S. Baeßler, A. B. Balantekin, P. S. Barbeau, F. Bellini, V. Bellini, R. S. Beminiwattha, J. C. Bernauer, T. Bhattacharya, M. Bishof, A. E. Bolotnikov, P. A. Breur, M. Brodeur, J. P. Brodsky, L. J. Broussard, T. Brunner, D. P. Burdette, J. Caylor, M. Chiu, V. Cirigliano, J. A. Clark , et al. (154 additional authors not shown)

Abstract: This whitepaper presents the research priorities decided on by attendees of the 2022 Town Meeting for Fundamental Symmetries, Neutrons and Neutrinos, which took place December 13-15, 2022 in Chapel Hill, NC, as part of the Nuclear Science Advisory Committee (NSAC) 2023 Long Range Planning process. A total of 275 scientists registered for the meeting. The whitepaper makes a number of explicit recom… ▽ More This whitepaper presents the research priorities decided on by attendees of the 2022 Town Meeting for Fundamental Symmetries, Neutrons and Neutrinos, which took place December 13-15, 2022 in Chapel Hill, NC, as part of the Nuclear Science Advisory Committee (NSAC) 2023 Long Range Planning process. A total of 275 scientists registered for the meeting. The whitepaper makes a number of explicit recommendations and justifies them in detail. △ Less

Submitted 6 April, 2023; originally announced April 2023.

Dataflow graphs as complete causal graphs

Authors: Andrei Paleyes, Siyuan Guo, Bernhard Schölkopf, Neil D. Lawrence

Abstract: Component-based development is one of the core principles behind modern software engineering practices. Understanding of causal relationships between components of a software system can yield significant benefits to developers. Yet modern software design approaches make it difficult to track and discover such relationships at system scale, which leads to growing intellectual debt. In this paper we… ▽ More Component-based development is one of the core principles behind modern software engineering practices. Understanding of causal relationships between components of a software system can yield significant benefits to developers. Yet modern software design approaches make it difficult to track and discover such relationships at system scale, which leads to growing intellectual debt. In this paper we consider an alternative approach to software design, flow-based programming (FBP), and draw the attention of the community to the connection between dataflow graphs produced by FBP and structural causal models. With expository examples we show how this connection can be leveraged to improve day-to-day tasks in software projects, including fault localisation, business analysis and experimentation. △ Less

Submitted 16 March, 2023; originally announced March 2023.

Comments: Accepted to 2nd International Conference on AI Engineering - Software Engineering for AI (CAIN 23)

AI for Science: An Emerging Agenda

Authors: Philipp Berens, Kyle Cranmer, Neil D. Lawrence, Ulrike von Luxburg, Jessica Montgomery

Abstract: This report documents the programme and the outcomes of Dagstuhl Seminar 22382 "Machine Learning for Science: Bridging Data-Driven and Mechanistic Modelling". Today's scientific challenges are characterised by complexity. Interconnected natural, technological, and human systems are influenced by forces acting across time- and spatial-scales, resulting in complex interactions and emergent behaviour… ▽ More This report documents the programme and the outcomes of Dagstuhl Seminar 22382 "Machine Learning for Science: Bridging Data-Driven and Mechanistic Modelling". Today's scientific challenges are characterised by complexity. Interconnected natural, technological, and human systems are influenced by forces acting across time- and spatial-scales, resulting in complex interactions and emergent behaviours. Understanding these phenomena -- and leveraging scientific advances to deliver innovative solutions to improve society's health, wealth, and well-being -- requires new ways of analysing complex systems. The transformative potential of AI stems from its widespread applicability across disciplines, and will only be achieved through integration across research domains. AI for science is a rendezvous point. It brings together expertise from $\mathrm{AI}$ and application domains; combines modelling knowledge with engineering know-how; and relies on collaboration across disciplines and between humans and machines. Alongside technical advances, the next wave of progress in the field will come from building a community of machine learning researchers, domain experts, citizen scientists, and engineers working together to design and deploy effective AI tools. This report summarises the discussions from the seminar and provides a roadmap to suggest how different communities can collaborate to deliver a new wave of progress in AI and its application for scientific discovery. △ Less

Submitted 7 March, 2023; originally announced March 2023.

The Present and Future of QCD

Authors: P. Achenbach, D. Adhikari, A. Afanasev, F. Afzal, C. A. Aidala, A. Al-bataineh, D. K. Almaalol, M. Amaryan, D. Androić, W. R. Armstrong, M. Arratia, J. Arrington, A. Asaturyan, E. C. Aschenauer, H. Atac, H. Avakian, T. Averett, C. Ayerbe Gayoso, X. Bai, K. N. Barish, N. Barnea, G. Basar, M. Battaglieri, A. A. Baty, I. Bautista , et al. (378 additional authors not shown)

Abstract: This White Paper presents the community inputs and scientific conclusions from the Hot and Cold QCD Town Meeting that took place September 23-25, 2022 at MIT, as part of the Nuclear Science Advisory Committee (NSAC) 2023 Long Range Planning process. A total of 424 physicists registered for the meeting. The meeting highlighted progress in Quantum Chromodynamics (QCD) nuclear physics since the 2015… ▽ More This White Paper presents the community inputs and scientific conclusions from the Hot and Cold QCD Town Meeting that took place September 23-25, 2022 at MIT, as part of the Nuclear Science Advisory Committee (NSAC) 2023 Long Range Planning process. A total of 424 physicists registered for the meeting. The meeting highlighted progress in Quantum Chromodynamics (QCD) nuclear physics since the 2015 LRP (LRP15) and identified key questions and plausible paths to obtaining answers to those questions, defining priorities for our research over the coming decade. In defining the priority of outstanding physics opportunities for the future, both prospects for the short (~ 5 years) and longer term (5-10 years and beyond) are identified together with the facilities, personnel and other resources needed to maximize the discovery potential and maintain United States leadership in QCD physics worldwide. This White Paper is organized as follows: In the Executive Summary, we detail the Recommendations and Initiatives that were presented and discussed at the Town Meeting, and their supporting rationales. Section 2 highlights major progress and accomplishments of the past seven years. It is followed, in Section 3, by an overview of the physics opportunities for the immediate future, and in relation with the next QCD frontier: the EIC. Section 4 provides an overview of the physics motivations and goals associated with the EIC. Section 5 is devoted to the workforce development and support of diversity, equity and inclusion. This is followed by a dedicated section on computing in Section 6. Section 7 describes the national need for nuclear data science and the relevance to QCD research. △ Less

Submitted 4 March, 2023; originally announced March 2023.

Comments: QCD Town Meeting White Paper, as submitted to 2023 NSAC LRP committee on Feb. 28, 2023

Journal ref: Nucl.Phys.A 1047 (2024) 122874

Real-world Machine Learning Systems: A survey from a Data-Oriented Architecture Perspective

Authors: Christian Cabrera, Andrei Paleyes, Pierre Thodoroff, Neil D. Lawrence

Abstract: Machine Learning models are being deployed as parts of real-world systems with the upsurge of interest in artificial intelligence. The design, implementation, and maintenance of such systems are challenged by real-world environments that produce larger amounts of heterogeneous data and users requiring increasingly faster responses with efficient resource consumption. These requirements push preval… ▽ More Machine Learning models are being deployed as parts of real-world systems with the upsurge of interest in artificial intelligence. The design, implementation, and maintenance of such systems are challenged by real-world environments that produce larger amounts of heterogeneous data and users requiring increasingly faster responses with efficient resource consumption. These requirements push prevalent software architectures to the limit when deploying ML-based systems. Data-oriented Architecture (DOA) is an emerging concept that equips systems better for integrating ML models. DOA extends current architectures to create data-driven, loosely coupled, decentralised, open systems. Even though papers on deployed ML-based systems do not mention DOA, their authors made design decisions that implicitly follow DOA. The reasons why, how, and the extent to which DOA is adopted in these systems are unclear. Implicit design decisions limit the practitioners' knowledge of DOA to design ML-based systems in the real world. This paper answers these questions by surveying real-world deployments of ML-based systems. The survey shows the design decisions of the systems and the requirements these satisfy. Based on the survey findings, we also formulate practical advice to facilitate the deployment of ML-based systems. Finally, we outline open challenges to deploying DOA-based systems that integrate ML models. △ Less

Submitted 9 October, 2023; v1 submitted 9 February, 2023; originally announced February 2023.

Comments: Under review

AgAsk: An Agent to Help Answer Farmer's Questions From Scientific Documents

Authors: Bevan Koopman, Ahmed Mourad, Hang Li, Anton van der Vegt, Shengyao Zhuang, Simon Gibson, Yash Dang, David Lawrence, Guido Zuccon

Abstract: Decisions in agriculture are increasingly data-driven; however, valuable agricultural knowledge is often locked away in free-text reports, manuals and journal articles. Specialised search systems are needed that can mine agricultural information to provide relevant answers to users' questions. This paper presents AgAsk -- an agent able to answer natural language agriculture questions by mining sci… ▽ More Decisions in agriculture are increasingly data-driven; however, valuable agricultural knowledge is often locked away in free-text reports, manuals and journal articles. Specialised search systems are needed that can mine agricultural information to provide relevant answers to users' questions. This paper presents AgAsk -- an agent able to answer natural language agriculture questions by mining scientific documents. We carefully survey and analyse farmers' information needs. On the basis of these needs we release an information retrieval test collection comprising real questions, a large collection of scientific documents split in passages, and ground truth relevance assessments indicating which passages are relevant to each question. We implement and evaluate a number of information retrieval models to answer farmers questions, including two state-of-the-art neural ranking models. We show that neural rankers are highly effective at matching passages to questions in this context. Finally, we propose a deployment architecture for AgAsk that includes a client based on the Telegram messaging platform and retrieval model deployed on commodity hardware. The test collection we provide is intended to stimulate more research in methods to match natural language to answers in scientific documents. While the retrieval models were evaluated in the agriculture domain, they are generalisable and of interest to others working on similar problems. The test collection is available at: \url{https://github.com/ielab/agvaluate}. △ Less

Submitted 20 December, 2022; originally announced December 2022.

Comments: 17 pages, submitted to IJDL

Characterizing ICME-related Forbush Decreases at Mercury using MESSENGER Observations: Identification of a One or Two-Step Structure

Authors: Emma E. Davies, Réka M. Winslow, David J. Lawrence

Abstract: The large-scale magnetic structure of interplanetary coronal mass ejections (ICMEs) has been shown to cause decreases in the galactic cosmic ray (GCR) flux measured in situ by spacecraft, known as Forbush decreases (Fds). We use measurements of the GCR count rate obtained by MESSENGER during its orbital phase around Mercury to identify such Fds related to the passage of ICMEs and characterize thei… ▽ More The large-scale magnetic structure of interplanetary coronal mass ejections (ICMEs) has been shown to cause decreases in the galactic cosmic ray (GCR) flux measured in situ by spacecraft, known as Forbush decreases (Fds). We use measurements of the GCR count rate obtained by MESSENGER during its orbital phase around Mercury to identify such Fds related to the passage of ICMEs and characterize their structure. Of the 42 ICMEs with corresponding high-quality GCR data, 79% are associated with a Fd. Thus a total of 33 ICME-related Fds were identified, 24 of which (73%) have a two-step structure. We use a superposed epoch analysis to build an average Fd profile at MESSENGER and find that despite the variability of individual events, a two-step structure is produced and is directly linked with the magnetic boundaries of the ICME. By using results from previous studies at Earth and Mars, we also address whether two-step Fds are more commonly observed closer to the Sun; we found that although likely, this is not conclusive when comparing to the wide range of results of previous studies conducted at Earth. Finally, we find that the percentage decrease in GCR flux of the Fd is greater at MESSENGER on average than at Earth and Mars, decreasing with increasing heliocentric distance. The relationship between the percentage decrease and maximum hourly decrease is also in agreement with previous studies, and follows trends relating to the expansion of ICMEs as they propagate through the heliosphere. △ Less

Submitted 5 December, 2022; originally announced December 2022.

Ice Core Dating using Probabilistic Programming

Authors: Aditya Ravuri, Tom R. Andersson, Ieva Kazlauskaite, Will Tebbutt, Richard E. Turner, J. Scott Hosking, Neil D. Lawrence, Markus Kaiser

Abstract: Ice cores record crucial information about past climate. However, before ice core data can have scientific value, the chronology must be inferred by estimating the age as a function of depth. Under certain conditions, chemicals locked in the ice display quasi-periodic cycles that delineate annual layers. Manually counting these noisy seasonal patterns to infer the chronology can be an imperfect an… ▽ More Ice cores record crucial information about past climate. However, before ice core data can have scientific value, the chronology must be inferred by estimating the age as a function of depth. Under certain conditions, chemicals locked in the ice display quasi-periodic cycles that delineate annual layers. Manually counting these noisy seasonal patterns to infer the chronology can be an imperfect and time-consuming process, and does not capture uncertainty in a principled fashion. In addition, several ice cores may be collected from a region, introducing an aspect of spatial correlation between them. We present an exploration of the use of probabilistic models for automatic dating of ice cores, using probabilistic programming to showcase its use for prototyping, automatic inference and maintainability, and demonstrate common failure modes of these tools. △ Less

Submitted 29 October, 2022; originally announced October 2022.

Modelling Technical and Biological Effects in scRNA-seq data with Scalable GPLVMs

Authors: Vidhi Lalchand, Aditya Ravuri, Emma Dann, Natsuhiko Kumasaka, Dinithi Sumanaweera, Rik G. H. Lindeboom, Shaista Madad, Sarah A. Teichmann, Neil D. Lawrence

Abstract: Single-cell RNA-seq datasets are growing in size and complexity, enabling the study of cellular composition changes in various biological/clinical contexts. Scalable dimensionality reduction techniques are in need to disentangle biological variation in them, while accounting for technical and biological confounders. In this work, we extend a popular approach for probabilistic non-linear dimensiona… ▽ More Single-cell RNA-seq datasets are growing in size and complexity, enabling the study of cellular composition changes in various biological/clinical contexts. Scalable dimensionality reduction techniques are in need to disentangle biological variation in them, while accounting for technical and biological confounders. In this work, we extend a popular approach for probabilistic non-linear dimensionality reduction, the Gaussian process latent variable model, to scale to massive single-cell datasets while explicitly accounting for technical and biological confounders. The key idea is to use an augmented kernel which preserves the factorisability of the lower bound allowing for fast stochastic variational inference. We demonstrate its ability to reconstruct latent signatures of innate immunity recovered in Kumasaka et al. (2021) with 9x lower training time. We further analyze a COVID dataset and demonstrate across a cohort of 130 individuals, that this framework enables data integration while capturing interpretable signatures of infection. Specifically, we explore COVID severity as a latent dimension to refine patient stratification and capture disease-specific gene expression. △ Less

Submitted 5 November, 2022; v1 submitted 14 September, 2022; originally announced September 2022.

Comments: Machine Learning and Computational Biology Symposium (Oral), 2022

MSC Class: 92D99; 92C99; ACM Class: J.3; I.5

Design of the ECCE Detector for the Electron Ion Collider

Authors: J. K. Adkins, Y. Akiba, A. Albataineh, M. Amaryan, I. C. Arsene, C. Ayerbe Gayoso, J. Bae, X. Bai, M. D. Baker, M. Bashkanov, R. Bellwied, F. Benmokhtar, V. Berdnikov, J. C. Bernauer, F. Bock, W. Boeglin, M. Borysova, E. Brash, P. Brindza, W. J. Briscoe, M. Brooks, S. Bueltmann, M. H. S. Bukhari, A. Bylinkin, R. Capobianco , et al. (259 additional authors not shown)

Abstract: The EIC Comprehensive Chromodynamics Experiment (ECCE) detector has been designed to address the full scope of the proposed Electron Ion Collider (EIC) physics program as presented by the National Academy of Science and provide a deeper understanding of the quark-gluon structure of matter. To accomplish this, the ECCE detector offers nearly acceptance and energy coverage along with excellent track… ▽ More The EIC Comprehensive Chromodynamics Experiment (ECCE) detector has been designed to address the full scope of the proposed Electron Ion Collider (EIC) physics program as presented by the National Academy of Science and provide a deeper understanding of the quark-gluon structure of matter. To accomplish this, the ECCE detector offers nearly acceptance and energy coverage along with excellent tracking and particle identification. The ECCE detector was designed to be built within the budget envelope set out by the EIC project while simultaneously managing cost and schedule risks. This detector concept has been selected to be the basis for the EIC project detector. △ Less

Submitted 20 July, 2024; v1 submitted 6 September, 2022; originally announced September 2022.

Comments: 34 pages, 30 figures, 9 tables

Report number: JLAB-PHY-24-4124

Detector Requirements and Simulation Results for the EIC Exclusive, Diffractive and Tagging Physics Program using the ECCE Detector Concept

Authors: A. Bylinkin, C. T. Dean, S. Fegan, D. Gangadharan, K. Gates, S. J. D. Kay, I. Korover, W. B. Li, X. Li, R. Montgomery, D. Nguyen, G. Penman, J. R. Pybus, N. Santiesteban, R. Trotta, A. Usman, M. D. Baker, J. Frantz, D. I. Glazier, D. W. Higinbotham, T. Horn, J. Huang, G. Huber, R. Reed, J. Roche , et al. (258 additional authors not shown)

Abstract: This article presents a collection of simulation studies using the ECCE detector concept in the context of the EIC's exclusive, diffractive, and tagging physics program, which aims to further explore the rich quark-gluon structure of nucleons and nuclei. To successfully execute the program, ECCE proposed to utilize the detecter system close to the beamline to ensure exclusivity and tag ion beam/fr… ▽ More This article presents a collection of simulation studies using the ECCE detector concept in the context of the EIC's exclusive, diffractive, and tagging physics program, which aims to further explore the rich quark-gluon structure of nucleons and nuclei. To successfully execute the program, ECCE proposed to utilize the detecter system close to the beamline to ensure exclusivity and tag ion beam/fragments for a particular reaction of interest. Preliminary studies confirmed the proposed technology and design satisfy the requirements. The projected physics impact results are based on the projected detector performance from the simulation at 10 or 100 fb^-1 of integrated luminosity. Additionally, a few insights on the potential 2nd Interaction Region can (IR) were also documented which could serve as a guidepost for the future development of a second EIC detector. △ Less

Submitted 6 March, 2023; v1 submitted 30 August, 2022; originally announced August 2022.

ECCE unpolarized TMD measurements

Authors: R. Seidl, A. Vladimirov, J. K. Adkins, Y. Akiba, A. Albataineh, M. Amaryan, I. C. Arsene, C. Ayerbe Gayoso, J. Bae, X. Bai, M. D. Baker, M. Bashkanov, R. Bellwied, F. Benmokhtar, V. Berdnikov, J. C. Bernauer, F. Bock, W. Boeglin, M. Borysova, E. Brash, P. Brindza, W. J. Briscoe, M. Brooks, S. Bueltmann, M. H. S. Bukhari , et al. (258 additional authors not shown)

Abstract: We performed feasibility studies for various measurements that are related to unpolarized TMD distribution and fragmentation functions. The processes studied include semi-inclusive Deep inelastic scattering (SIDIS) where single hadrons (pions and kaons) were detected in addition to the scattered DIS lepton. The single hadron cross sections and multiplicities were extracted as a function of the DIS… ▽ More We performed feasibility studies for various measurements that are related to unpolarized TMD distribution and fragmentation functions. The processes studied include semi-inclusive Deep inelastic scattering (SIDIS) where single hadrons (pions and kaons) were detected in addition to the scattered DIS lepton. The single hadron cross sections and multiplicities were extracted as a function of the DIS variables $x$ and $Q^2$, as well as the semi-inclusive variables $z$, which corresponds to the momentum fraction the detected hadron carries relative to the struck parton and $P_T$, which corresponds to the transverse momentum of the detected hadron relative to the virtual photon. The expected statistical precision of such measurements is extrapolated to accumulated luminosities of 10 fb$^{-1}$ and potential systematic uncertainties are approximated given the deviations between true and reconstructed yields. △ Less

Submitted 22 July, 2022; originally announced July 2022.

Comments: 12 pages, 9 figures, to be submitted in joint ECCE proposal NIM-A volume

Report number: ecce-paper-phys-2022-09

ECCE Sensitivity Studies for Single Hadron Transverse Single Spin Asymmetry Measurements

Authors: R. Seidl, A. Vladimirov, D. Pitonyak, A. Prokudin, J. K. Adkins, Y. Akiba, A. Albataineh, M. Amaryan, I. C. Arsene, C. Ayerbe Gayoso, J. Bae, X. Bai, M. D. Baker, M. Bashkanov, R. Bellwied, F. Benmokhtar, V. Berdnikov, J. C. Bernauer, F. Bock, W. Boeglin, M. Borysova, E. Brash, P. Brindza, W. J. Briscoe, M. Brooks , et al. (260 additional authors not shown)

Abstract: We performed feasibility studies for various single transverse spin measurements that are related to the Sivers effect, transversity and the tensor charge, and the Collins fragmentation function. The processes studied include semi-inclusive deep inelastic scattering (SIDIS) where single hadrons (pions and kaons) were detected in addition to the scattered DIS lepton. The data were obtained in {\sc… ▽ More We performed feasibility studies for various single transverse spin measurements that are related to the Sivers effect, transversity and the tensor charge, and the Collins fragmentation function. The processes studied include semi-inclusive deep inelastic scattering (SIDIS) where single hadrons (pions and kaons) were detected in addition to the scattered DIS lepton. The data were obtained in {\sc pythia}6 and {\sc geant}4 simulated e+p collisions at 18 GeV on 275 GeV, 18 on 100, 10 on 100, and 5 on 41 that use the ECCE detector configuration. Typical DIS kinematics were selected, most notably $Q^2 > 1 $ GeV$^2$, and cover the $x$ range from $10^{-4}$ to $1$. The single spin asymmetries were extracted as a function of $x$ and $Q^2$, as well as the semi-inclusive variables $z$, and $P_T$. They are obtained in azimuthal moments in combinations of the azimuthal angles of the hadron transverse momentum and transverse spin of the nucleon relative to the lepton scattering plane. The initially unpolarized MonteCarlo was re-weighted in the true kinematic variables, hadron types and parton flavors based on global fits of fixed target SIDIS experiments and $e^+e^-$ annihilation data. The expected statistical precision of such measurements is extrapolated to 10 fb$^{-1}$ and potential systematic uncertainties are approximated given the deviations between true and reconstructed yields. The impact on the knowledge of the Sivers functions, transversity and tensor charges, and the Collins function has then been evaluated in the same phenomenological extractions as in the Yellow Report. The impact is found to be comparable to that obtained with the parameterized Yellow Report detector and shows that the ECCE detector configuration can fulfill the physics goals on these quantities. △ Less

Submitted 22 July, 2022; originally announced July 2022.

Comments: 22 pages, 22 figures, to be submitted to joint ECCE proposal NIM-A volume

Report number: ecce-paper-phys-2022-08

Open Heavy Flavor Studies for the ECCE Detector at the Electron Ion Collider

Authors: X. Li, J. K. Adkins, Y. Akiba, A. Albataineh, M. Amaryan, I. C. Arsene, C. Ayerbe Gayoso, J. Bae, X. Bai, M. D. Baker, M. Bashkanov, R. Bellwied, F. Benmokhtar, V. Berdnikov, J. C. Bernauer, F. Bock, W. Boeglin, M. Borysova, E. Brash, P. Brindza, W. J. Briscoe, M. Brooks, S. Bueltmann, M. H. S. Bukhari, A. Bylinkin , et al. (262 additional authors not shown)

Abstract: The ECCE detector has been recommended as the selected reference detector for the future Electron-Ion Collider (EIC). A series of simulation studies have been carried out to validate the physics feasibility of the ECCE detector. In this paper, detailed studies of heavy flavor hadron and jet reconstruction and physics projections with the ECCE detector performance and different magnet options will… ▽ More The ECCE detector has been recommended as the selected reference detector for the future Electron-Ion Collider (EIC). A series of simulation studies have been carried out to validate the physics feasibility of the ECCE detector. In this paper, detailed studies of heavy flavor hadron and jet reconstruction and physics projections with the ECCE detector performance and different magnet options will be presented. The ECCE detector has enabled precise EIC heavy flavor hadron and jet measurements with a broad kinematic coverage. These proposed heavy flavor measurements will help systematically study the hadronization process in vacuum and nuclear medium especially in the underexplored kinematic region. △ Less

Submitted 23 July, 2022; v1 submitted 21 July, 2022; originally announced July 2022.

Comments: Open heavy flavor studies with the EIC reference detector design by the ECCE consortium. 11 pages, 11 figures, to be submitted to the Nuclear Instruments and Methods A

Report number: LANL report number: LA-UR-22-27181

Exclusive J/$ψ$ Detection and Physics with ECCE

Authors: X. Li, J. K. Adkins, Y. Akiba, A. Albataineh, M. Amaryan, I. C. Arsene, C. Ayerbe Gayoso, J. Bae, X. Bai, M. D. Baker, M. Bashkanov, R. Bellwied, F. Benmokhtar, V. Berdnikov, J. C. Bernauer, F. Bock, W. Boeglin, M. Borysova, E. Brash, P. Brindza, W. J. Briscoe, M. Brooks, S. Bueltmann, M. H. S. Bukhari, A. Bylinkin , et al. (262 additional authors not shown)

Abstract: Exclusive heavy quarkonium photoproduction is one of the most popular processes in EIC, which has a large cross section and a simple final state. Due to the gluonic nature of the exchange Pomeron, this process can be related to the gluon distributions in the nucleus. The momentum transfer dependence of this process is sensitive to the interaction sites, which provides a powerful tool to probe the… ▽ More Exclusive heavy quarkonium photoproduction is one of the most popular processes in EIC, which has a large cross section and a simple final state. Due to the gluonic nature of the exchange Pomeron, this process can be related to the gluon distributions in the nucleus. The momentum transfer dependence of this process is sensitive to the interaction sites, which provides a powerful tool to probe the spatial distribution of gluons in the nucleus. Recently the problem of the origin of hadron mass has received lots of attention in determining the anomaly contribution $M_{a}$. The trace anomaly is sensitive to the gluon condensate, and exclusive production of quarkonia such as J/$ψ$ and $Υ$ can serve as a sensitive probe to constrain it. In this paper, we present the performance of the ECCE detector for exclusive J/$ψ$ detection and the capability of this process to investigate the above physics opportunities with ECCE. △ Less

Submitted 21 July, 2022; originally announced July 2022.

Comments: 11 pages, 14 figures, 1 table

Search for $e\toτ$ Charged Lepton Flavor Violation at the EIC with the ECCE Detector

Authors: J. -L. Zhang, S. Mantry, J. K. Adkins, Y. Akiba, A. Albataineh, M. Amaryan, I. C. Arsene, C. Ayerbe Gayoso, J. Bae, X. Bai, M. D. Baker, M. Bashkanov, R. Bellwied, F. Benmokhtar, V. Berdnikov, J. C. Bernauer, F. Bock, W. Boeglin, M. Borysova, E. Brash, P. Brindza, W. J. Briscoe, M. Brooks, S. Bueltmann, M. H. S. Bukhari , et al. (262 additional authors not shown)

Abstract: The recently approved Electron-Ion Collider (EIC) will provide a unique new opportunity for searches of charged lepton flavor violation (CLFV) and other new physics scenarios. In contrast to the $e \leftrightarrow μ$ CLFV transition for which very stringent limits exist, there is still a relatively large discovery space for the $e \to τ$ CLFV transition, potentially to be explored by the EIC. With… ▽ More The recently approved Electron-Ion Collider (EIC) will provide a unique new opportunity for searches of charged lepton flavor violation (CLFV) and other new physics scenarios. In contrast to the $e \leftrightarrow μ$ CLFV transition for which very stringent limits exist, there is still a relatively large discovery space for the $e \to τ$ CLFV transition, potentially to be explored by the EIC. With the latest detector design of ECCE (EIC Comprehensive Chromodynamics Experiment) and projected integral luminosity of the EIC, we find the $τ$-leptons created in the DIS process $ep\to τX$ are expected to be identified with high efficiency. A first ECCE simulation study, restricted to the 3-prong $τ$-decay mode and with limited statistics for the Standard Model backgrounds, estimates that the EIC will be able to improve the current exclusion limit on $e\to τ$ CLFV by an order of magnitude. △ Less

Submitted 20 July, 2022; originally announced July 2022.

Comments: 11 pages, 8 figures, to be submitted to NIM

Design and Simulated Performance of Calorimetry Systems for the ECCE Detector at the Electron Ion Collider

Authors: F. Bock, N. Schmidt, P. K. Wang, N. Santiesteban, T. Horn, J. Huang, J. Lajoie, C. Munoz Camacho, J. K. Adkins, Y. Akiba, A. Albataineh, M. Amaryan, I. C. Arsene, C. Ayerbe Gayoso, J. Bae, X. Bai, M. D. Baker, M. Bashkanov, R. Bellwied, F. Benmokhtar, V. Berdnikov, J. C. Bernauer, W. Boeglin, M. Borysova, E. Brash , et al. (263 additional authors not shown)

Abstract: We describe the design and performance the calorimeter systems used in the ECCE detector design to achieve the overall performance specifications cost-effectively with careful consideration of appropriate technical and schedule risks. The calorimeter systems consist of three electromagnetic calorimeters, covering the combined pseudorapdity range from -3.7 to 3.8 and two hadronic calorimeters. Key… ▽ More We describe the design and performance the calorimeter systems used in the ECCE detector design to achieve the overall performance specifications cost-effectively with careful consideration of appropriate technical and schedule risks. The calorimeter systems consist of three electromagnetic calorimeters, covering the combined pseudorapdity range from -3.7 to 3.8 and two hadronic calorimeters. Key calorimeter performances which include energy and position resolutions, reconstruction efficiency, and particle identification will be presented. △ Less

Submitted 19 July, 2022; originally announced July 2022.

Comments: 19 pages, 22 figures, 5 tables

Modeling the Machine Learning Multiverse

Authors: Samuel J. Bell, Onno P. Kampman, Jesse Dodge, Neil D. Lawrence

Abstract: Amid mounting concern about the reliability and credibility of machine learning research, we present a principled framework for making robust and generalizable claims: the multiverse analysis. Our framework builds upon the multiverse analysis (Steegen et al., 2016) introduced in response to psychology's own reproducibility crisis. To efficiently explore high-dimensional and often continuous ML sea… ▽ More Amid mounting concern about the reliability and credibility of machine learning research, we present a principled framework for making robust and generalizable claims: the multiverse analysis. Our framework builds upon the multiverse analysis (Steegen et al., 2016) introduced in response to psychology's own reproducibility crisis. To efficiently explore high-dimensional and often continuous ML search spaces, we model the multiverse with a Gaussian Process surrogate and apply Bayesian experimental design. Our framework is designed to facilitate drawing robust scientific conclusions about model performance, and thus our approach focuses on exploration rather than conventional optimization. In the first of two case studies, we investigate disputed claims about the relative merit of adaptive optimizers. Second, we synthesize conflicting research on the effect of learning rate on the large batch training generalization gap. For the machine learning community, the multiverse analysis is a simple and effective technique for identifying robust claims, for increasing transparency, and a step toward improved reproducibility. △ Less

Submitted 12 October, 2022; v1 submitted 13 June, 2022; originally announced June 2022.

Comments: To appear in Advances in Neural Information Processing Systems (NeurIPS) 2022

The Effect of Task Ordering in Continual Learning

Authors: Samuel J. Bell, Neil D. Lawrence

Abstract: We investigate the effect of task ordering on continual learning performance. We conduct an extensive series of empirical experiments on synthetic and naturalistic datasets and show that reordering tasks significantly affects the amount of catastrophic forgetting. Connecting to the field of curriculum learning, we show that the effect of task ordering can be exploited to modify continual learning… ▽ More We investigate the effect of task ordering on continual learning performance. We conduct an extensive series of empirical experiments on synthetic and naturalistic datasets and show that reordering tasks significantly affects the amount of catastrophic forgetting. Connecting to the field of curriculum learning, we show that the effect of task ordering can be exploited to modify continual learning performance, and present a simple approach for doing so. Our method computes the distance between all pairs of tasks, where distance is defined as the source task curvature of a gradient step toward the target task. Using statistically rigorous methods and sound experimental design, we show that task ordering is an important aspect of continual learning that can be modified for improved performance. △ Less

Submitted 26 May, 2022; originally announced May 2022.

AI-assisted Optimization of the ECCE Tracking System at the Electron Ion Collider

Authors: C. Fanelli, Z. Papandreou, K. Suresh, J. K. Adkins, Y. Akiba, A. Albataineh, M. Amaryan, I. C. Arsene, C. Ayerbe Gayoso, J. Bae, X. Bai, M. D. Baker, M. Bashkanov, R. Bellwied, F. Benmokhtar, V. Berdnikov, J. C. Bernauer, F. Bock, W. Boeglin, M. Borysova, E. Brash, P. Brindza, W. J. Briscoe, M. Brooks, S. Bueltmann , et al. (258 additional authors not shown)

Abstract: The Electron-Ion Collider (EIC) is a cutting-edge accelerator facility that will study the nature of the "glue" that binds the building blocks of the visible matter in the universe. The proposed experiment will be realized at Brookhaven National Laboratory in approximately 10 years from now, with detector design and R&D currently ongoing. Notably, EIC is one of the first large-scale facilities to… ▽ More The Electron-Ion Collider (EIC) is a cutting-edge accelerator facility that will study the nature of the "glue" that binds the building blocks of the visible matter in the universe. The proposed experiment will be realized at Brookhaven National Laboratory in approximately 10 years from now, with detector design and R&D currently ongoing. Notably, EIC is one of the first large-scale facilities to leverage Artificial Intelligence (AI) already starting from the design and R&D phases. The EIC Comprehensive Chromodynamics Experiment (ECCE) is a consortium that proposed a detector design based on a 1.5T solenoid. The EIC detector proposal review concluded that the ECCE design will serve as the reference design for an EIC detector. Herein we describe a comprehensive optimization of the ECCE tracker using AI. The work required a complex parametrization of the simulated detector system. Our approach dealt with an optimization problem in a multidimensional design space driven by multiple objectives that encode the detector performance, while satisfying several mechanical constraints. We describe our strategy and show results obtained for the ECCE tracking system. The AI-assisted design is agnostic to the simulation framework and can be extended to other sub-detectors or to a system of sub-detectors to further optimize the performance of the EIC detector. △ Less

Submitted 19 May, 2022; v1 submitted 18 May, 2022; originally announced May 2022.

Comments: 16 pages, 18 figures, 2 appendices, 3 tables

Scientific Computing Plan for the ECCE Detector at the Electron Ion Collider

Authors: J. C. Bernauer, C. T. Dean, C. Fanelli, J. Huang, K. Kauder, D. Lawrence, J. D. Osborn, C. Paus, J. K. Adkins, Y. Akiba, A. Albataineh, M. Amaryan, I. C. Arsene, C. Ayerbe Gayoso, J. Bae, X. Bai, M. D. Baker, M. Bashkanov, R. Bellwied, F. Benmokhtar, V. Berdnikov, F. Bock, W. Boeglin, M. Borysova, E. Brash , et al. (256 additional authors not shown)

Abstract: The Electron Ion Collider (EIC) is the next generation of precision QCD facility to be built at Brookhaven National Laboratory in conjunction with Thomas Jefferson National Laboratory. There are a significant number of software and computing challenges that need to be overcome at the EIC. During the EIC detector proposal development period, the ECCE consortium began identifying and addressing thes… ▽ More The Electron Ion Collider (EIC) is the next generation of precision QCD facility to be built at Brookhaven National Laboratory in conjunction with Thomas Jefferson National Laboratory. There are a significant number of software and computing challenges that need to be overcome at the EIC. During the EIC detector proposal development period, the ECCE consortium began identifying and addressing these challenges in the process of producing a complete detector proposal based upon detailed detector and physics simulations. In this document, the software and computing efforts to produce this proposal are discussed; furthermore, the computing and software model and resources required for the future of ECCE are described. △ Less

Submitted 17 May, 2022; originally announced May 2022.

Journal ref: NIMA 1047, 167859 (2023)

An Empirical Evaluation of Flow Based Programming in the Machine Learning Deployment Context

Authors: Andrei Paleyes, Christian Cabrera, Neil D. Lawrence

Abstract: As use of data driven technologies spreads, software engineers are more often faced with the task of solving a business problem using data-driven methods such as machine learning (ML) algorithms. Deployment of ML within large software systems brings new challenges that are not addressed by standard engineering practices and as a result businesses observe high rate of ML deployment project failures… ▽ More As use of data driven technologies spreads, software engineers are more often faced with the task of solving a business problem using data-driven methods such as machine learning (ML) algorithms. Deployment of ML within large software systems brings new challenges that are not addressed by standard engineering practices and as a result businesses observe high rate of ML deployment project failures. Data Oriented Architecture (DOA) is an emerging approach that can support data scientists and software developers when addressing such challenges. However, there is a lack of clarity about how DOA systems should be implemented in practice. This paper proposes to consider Flow-Based Programming (FBP) as a paradigm for creating DOA applications. We empirically evaluate FBP in the context of ML deployment on four applications that represent typical data science projects. We use Service Oriented Architecture (SOA) as a baseline for comparison. Evaluation is done with respect to different application domains, ML deployment stages, and code quality metrics. Results reveal that FBP is a suitable paradigm for data collection and data science tasks, and is able to simplify data collection and discovery when compared with SOA. We discuss the advantages of FBP as well as the gaps that need to be addressed to increase FBP adoption as a standard design paradigm for DOA. △ Less

Submitted 27 April, 2022; originally announced April 2022.

Comments: Accepted to CAIN 2022, 1st International Conference on AI Engineering - Software Engineering for AI. arXiv admin note: text overlap with arXiv:2108.04105

Scalable Bigraphical Lasso: Two-way Sparse Network Inference for Count Data

Authors: Sijia Li, Martín López-García, Neil D. Lawrence, Luisa Cutillo

Abstract: Classically, statistical datasets have a larger number of data points than features ($n > p$). The standard model of classical statistics caters for the case where data points are considered conditionally independent given the parameters. However, for $n\approx p$ or $p > n$ such models are poorly determined. Kalaitzis et al. (2013) introduced the Bigraphical Lasso, an estimator for sparse precisi… ▽ More Classically, statistical datasets have a larger number of data points than features ($n > p$). The standard model of classical statistics caters for the case where data points are considered conditionally independent given the parameters. However, for $n\approx p$ or $p > n$ such models are poorly determined. Kalaitzis et al. (2013) introduced the Bigraphical Lasso, an estimator for sparse precision matrices based on the Cartesian product of graphs. Unfortunately, the original Bigraphical Lasso algorithm is not applicable in case of large p and n due to memory requirements. We exploit eigenvalue decomposition of the Cartesian product graph to present a more efficient version of the algorithm which reduces memory requirements from $O(n^2p^2)$ to $O(n^2 + p^2)$. Many datasets in different application fields, such as biology, medicine and social science, come with count data, for which Gaussian based models are not applicable. Our multi-way network inference approach can be used for discrete data. Our methodology accounts for the dependencies across both instances and features, reduces the computational complexity for high dimensional data and enables to deal with both discrete and continuous data. Numerical studies on both synthetic and real datasets are presented to showcase the performance of our method. △ Less

Submitted 15 March, 2022; originally announced March 2022.

AI for Experimental Controls at Jefferson Lab

Authors: Torri Jeske, Diana McSpadden, Nikhil Kalra, Thomas Britton, Naomi Jarvis, David Lawrence

Abstract: The AI for Experimental Controls project is developing an AI system to control and calibrate detector systems located at Jefferson Laboratory. Currently, calibrations are performed offline and require significant time and attention from experts. This work would reduce the amount of data and the amount of time spent calibrating in an offline setting. The first use case involves the Central Drift Ch… ▽ More The AI for Experimental Controls project is developing an AI system to control and calibrate detector systems located at Jefferson Laboratory. Currently, calibrations are performed offline and require significant time and attention from experts. This work would reduce the amount of data and the amount of time spent calibrating in an offline setting. The first use case involves the Central Drift Chamber (CDC) located inside the GlueX spectrometer in Hall D. We use a combination of environmental and experimental data, such as atmospheric pressure, gas temperature, and the flux of incident particles as inputs to a Sequential Neural Network (NN) to recommend a high voltage setting and the corresponding calibration constants in order to maintain consistent gain and optimal resolution throughout the experiment. Utilizing AI in this manner represents an initial shift from offline calibration towards near real time calibrations performed at Jefferson Laboratory. △ Less

Submitted 11 March, 2022; originally announced March 2022.

Generalised Gaussian Process Latent Variable Models (GPLVM) with Stochastic Variational Inference

Authors: Vidhi Lalchand, Aditya Ravuri, Neil D. Lawrence

Abstract: Gaussian process latent variable models (GPLVM) are a flexible and non-linear approach to dimensionality reduction, extending classical Gaussian processes to an unsupervised learning context. The Bayesian incarnation of the GPLVM Titsias and Lawrence, 2010] uses a variational framework, where the posterior over latent variables is approximated by a well-behaved variational family, a factorized Gau… ▽ More Gaussian process latent variable models (GPLVM) are a flexible and non-linear approach to dimensionality reduction, extending classical Gaussian processes to an unsupervised learning context. The Bayesian incarnation of the GPLVM Titsias and Lawrence, 2010] uses a variational framework, where the posterior over latent variables is approximated by a well-behaved variational family, a factorized Gaussian yielding a tractable lower bound. However, the non-factories ability of the lower bound prevents truly scalable inference. In this work, we study the doubly stochastic formulation of the Bayesian GPLVM model amenable with minibatch training. We show how this framework is compatible with different latent variable formulations and perform experiments to compare a suite of models. Further, we demonstrate how we can train in the presence of massively missing data and obtain high-fidelity reconstructions. We demonstrate the model's performance by benchmarking against the canonical sparse GPLVM for high-dimensional data examples. △ Less

Submitted 9 April, 2022; v1 submitted 25 February, 2022; originally announced February 2022.

Comments: AISTATS 2022

Journal ref: Proceedings of the 25th International Conference on Artificial Intelligence and Statistics (AISTATS) 2022, Valencia, Spain. PMLR: Volume 151

Streaming readout for next generation electron scattering experiment

Authors: Fabrizio Ameli, Marco Battaglieri, Vladimir V. Berdnikov, Mariangela Bondì, Sergey Boyarinov, Nathan Brei, Laura Cappelli, Andrea Celentano, Tommaso Chiarusi, Raffaella De Vita, Cristiano Fanelli, Vardan Gyurjyan, David Lawrence, Patrick Moran, Paolo Musico, Carmelo Pellegrino, Alessandro Pilloni, Ben Raydo, Carl Timmer, Maurizio Ungaro, Simone Vallarino

Abstract: Current and future experiments at the high intensity frontier are expected to produce an enormous amount of data that needs to be collected and stored for offline analysis. Thanks to the continuous progress in computing and networking technology, it is now possible to replace the standard `triggered' data acquisition systems with a new, simplified and outperforming scheme. `Streaming readout' (SRO… ▽ More Current and future experiments at the high intensity frontier are expected to produce an enormous amount of data that needs to be collected and stored for offline analysis. Thanks to the continuous progress in computing and networking technology, it is now possible to replace the standard `triggered' data acquisition systems with a new, simplified and outperforming scheme. `Streaming readout' (SRO) DAQ aims to replace the hardware-based trigger with a much more powerful and flexible software-based one, that considers the whole detector information for efficient real-time data tagging and selection. Considering the crucial role of DAQ in an experiment, validation with on-field tests is required to demonstrate SRO performance. In this paper we report results of the on-beam validation of the Jefferson Lab SRO framework. We exposed different detectors (PbWO-based electromagnetic calorimeters and a plastic scintillator hodoscope) to the Hall-D electron-positron secondary beam and to the Hall-B production electron beam, with increasingly complex experimental conditions. By comparing the data collected with the SRO system against the traditional DAQ, we demonstrate that the SRO performs as expected. Furthermore, we provide evidence of its superiority in implementing sophisticated AI-supported algorithms for real-time data analysis and reconstruction. △ Less

Submitted 7 February, 2022; originally announced February 2022.

Bayesian Learning via Neural Schrödinger-Föllmer Flows

Authors: Francisco Vargas, Andrius Ovsianas, David Fernandes, Mark Girolami, Neil D. Lawrence, Nikolas Nüsken

Abstract: In this work we explore a new framework for approximate Bayesian inference in large datasets based on stochastic control (i.e. Schrödinger bridges). We advocate stochastic control as a finite time and low variance alternative to popular steady-state methods such as stochastic gradient Langevin dynamics (SGLD). Furthermore, we discuss and adapt the existing theoretical guarantees of this framework… ▽ More In this work we explore a new framework for approximate Bayesian inference in large datasets based on stochastic control (i.e. Schrödinger bridges). We advocate stochastic control as a finite time and low variance alternative to popular steady-state methods such as stochastic gradient Langevin dynamics (SGLD). Furthermore, we discuss and adapt the existing theoretical guarantees of this framework and establish connections to already existing VI routines in SDE-based models. △ Less

Submitted 25 October, 2022; v1 submitted 19 November, 2021; originally announced November 2021.

Emulation of physical processes with Emukit

Authors: Andrei Paleyes, Mark Pullin, Maren Mahsereci, Cliff McCollum, Neil D. Lawrence, Javier Gonzalez

Abstract: Decision making in uncertain scenarios is an ubiquitous challenge in real world systems. Tools to deal with this challenge include simulations to gather information and statistical emulation to quantify uncertainty. The machine learning community has developed a number of methods to facilitate decision making, but so far they are scattered in multiple different toolkits, and generally rely on a fi… ▽ More Decision making in uncertain scenarios is an ubiquitous challenge in real world systems. Tools to deal with this challenge include simulations to gather information and statistical emulation to quantify uncertainty. The machine learning community has developed a number of methods to facilitate decision making, but so far they are scattered in multiple different toolkits, and generally rely on a fixed backend. In this paper, we present Emukit, a highly adaptable Python toolkit for enriching decision making under uncertainty. Emukit allows users to: (i) use state of the art methods including Bayesian optimization, multi-fidelity emulation, experimental design, Bayesian quadrature and sensitivity analysis; (ii) easily prototype new decision making methods for new problems. Emukit is agnostic to the underlying modeling framework and enables users to use their own custom models. We show how Emukit can be used on three exemplary case studies. △ Less

Submitted 25 October, 2021; originally announced October 2021.

Comments: Second Workshop on Machine Learning and the Physical Sciences, NeurIPS 2019

Behavioral Experiments for Understanding Catastrophic Forgetting

Authors: Samuel J. Bell, Neil D. Lawrence

Abstract: In this paper we explore whether the fundamental tool of experimental psychology, the behavioral experiment, has the power to generate insight not only into humans and animals, but artificial systems too. We apply the techniques of experimental psychology to investigating catastrophic forgetting in neural networks. We present a series of controlled experiments with two-layer ReLU networks, and exp… ▽ More In this paper we explore whether the fundamental tool of experimental psychology, the behavioral experiment, has the power to generate insight not only into humans and animals, but artificial systems too. We apply the techniques of experimental psychology to investigating catastrophic forgetting in neural networks. We present a series of controlled experiments with two-layer ReLU networks, and exploratory results revealing a new understanding of the behavior of catastrophic forgetting. Alongside our empirical findings, we demonstrate an alternative, behavior-first approach to investigating neural network phenomena. △ Less

Submitted 13 December, 2022; v1 submitted 20 October, 2021; originally announced October 2021.

Journal ref: Presented at the AI Evaluation Beyond Metrics (EBeM) Workshop at IJCAI, Vienna 2022