-
ML-based Calibration and Control of the GlueX Central Drift Chamber
Authors:
Thomas Britton,
Michael Goodrich,
Naomi Jarvis,
Torri Jeske,
Nikhil Kalra,
David Lawrence,
Diana McSpadden,
Kishan Rajput
Abstract:
The GlueX Central Drift Chamber (CDC) in Hall D at Jefferson Lab, used for detecting and tracking charged particles, is calibrated and controlled during data taking using a Gaussian process. The system dynamically adjusts the high voltage applied to the anode wires inside the chamber in response to changing environmental and experimental conditions such that the gain is stabilized. Control policie…
▽ More
The GlueX Central Drift Chamber (CDC) in Hall D at Jefferson Lab, used for detecting and tracking charged particles, is calibrated and controlled during data taking using a Gaussian process. The system dynamically adjusts the high voltage applied to the anode wires inside the chamber in response to changing environmental and experimental conditions such that the gain is stabilized. Control policies have been established to manage the CDC's behavior. These policies are activated when the model's uncertainty exceeds a configurable threshold or during human-initiated tests during normal production running. We demonstrate the system reduces the time detector experts dedicate to calibration of the data offline, leading to a marked decrease in computing resource usage without compromising detector performance.
△ Less
Submitted 3 July, 2024; v1 submitted 5 March, 2024;
originally announced March 2024.
-
AI Assisted Experiment Control and Calibration
Authors:
Thomas Britton,
Michael Goodrich,
Naomi Jarvis,
Torri Jeske,
Nikhil Kalra,
David Lawrence,
Diana McSpadden
Abstract:
Final report for the AI Assisted Experiment Control and Calibration project. This project integrated AI/ML into the controls and calibration of a production detector system in the GlueX spectrometer, a large scale Nuclear Physics detector in experimental Hall-D at Jefferson Lab. The AI/ML model predicted calibration constants for a Central Drift Chamber using environmental information available pr…
▽ More
Final report for the AI Assisted Experiment Control and Calibration project. This project integrated AI/ML into the controls and calibration of a production detector system in the GlueX spectrometer, a large scale Nuclear Physics detector in experimental Hall-D at Jefferson Lab. The AI/ML model predicted calibration constants for a Central Drift Chamber using environmental information available prior to taking the data. The device controls were then automatically adjusted so that the calibration values needed for post-processing of the data were much more stable and quicker to determine. Integration into a production system required guardrails and policy choices to ensure safety of the equipment and the data quality. The project sought to apply similar technology to other detectors. Those efforts are also described here. This documents many of the details of the project.
△ Less
Submitted 7 February, 2024;
originally announced February 2024.
-
Dataset for Investigating Anomalies in Compute Clusters
Authors:
Diana McSpadden,
Yasir Alanazi,
Bryan Hess,
Laura Hild,
Mark Jones,
Yiyang Lub,
Ahmed Mohammed,
Wesley Moore,
Jie Ren,
Malachi Schram,
Evgenia Smirni
Abstract:
The dataset was collected for 332 compute nodes throughout May 19 - 23, 2023. May 19 - 22 characterizes normal compute cluster behavior, while May 23 includes an anomalous event. The dataset includes eight CPU, 11 disk, 47 memory, and 22 Slurm metrics. It represents five distinct hardware configurations and contains over one million records, totaling more than 180GB of raw data.
The dataset was collected for 332 compute nodes throughout May 19 - 23, 2023. May 19 - 22 characterizes normal compute cluster behavior, while May 23 includes an anomalous event. The dataset includes eight CPU, 11 disk, 47 memory, and 22 Slurm metrics. It represents five distinct hardware configurations and contains over one million records, totaling more than 180GB of raw data.
△ Less
Submitted 31 October, 2023;
originally announced November 2023.
-
A comparison of machine learning surrogate models of street-scale flooding in Norfolk, Virginia
Authors:
Diana McSpadden,
Steven Goldenberg,
Binata Roy,
Malachi Schram,
Jonathan L. Goodall,
Heather Richter
Abstract:
Low-lying coastal cities, exemplified by Norfolk, Virginia, face the challenge of street flooding caused by rainfall and tides, which strain transportation and sewer systems and can lead to property damage. While high-fidelity, physics-based simulations provide accurate predictions of urban pluvial flooding, their computational complexity renders them unsuitable for real-time applications. Using d…
▽ More
Low-lying coastal cities, exemplified by Norfolk, Virginia, face the challenge of street flooding caused by rainfall and tides, which strain transportation and sewer systems and can lead to property damage. While high-fidelity, physics-based simulations provide accurate predictions of urban pluvial flooding, their computational complexity renders them unsuitable for real-time applications. Using data from Norfolk rainfall events between 2016 and 2018, this study compares the performance of a previous surrogate model based on a random forest algorithm with two deep learning models: Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU). This investigation underscores the importance of using a model architecture that supports the communication of prediction uncertainty and the effective integration of relevant, multi-modal features.
△ Less
Submitted 26 July, 2023;
originally announced July 2023.
-
Artificial Intelligence for the Electron Ion Collider (AI4EIC)
Authors:
C. Allaire,
R. Ammendola,
E. -C. Aschenauer,
M. Balandat,
M. Battaglieri,
J. Bernauer,
M. Bondì,
N. Branson,
T. Britton,
A. Butter,
I. Chahrour,
P. Chatagnon,
E. Cisbani,
E. W. Cline,
S. Dash,
C. Dean,
W. Deconinck,
A. Deshpande,
M. Diefenthaler,
R. Ent,
C. Fanelli,
M. Finger,
M. Finger, Jr.,
E. Fol,
S. Furletov
, et al. (70 additional authors not shown)
Abstract:
The Electron-Ion Collider (EIC), a state-of-the-art facility for studying the strong force, is expected to begin commissioning its first experiments in 2028. This is an opportune time for artificial intelligence (AI) to be included from the start at this facility and in all phases that lead up to the experiments. The second annual workshop organized by the AI4EIC working group, which recently took…
▽ More
The Electron-Ion Collider (EIC), a state-of-the-art facility for studying the strong force, is expected to begin commissioning its first experiments in 2028. This is an opportune time for artificial intelligence (AI) to be included from the start at this facility and in all phases that lead up to the experiments. The second annual workshop organized by the AI4EIC working group, which recently took place, centered on exploring all current and prospective application areas of AI for the EIC. This workshop is not only beneficial for the EIC, but also provides valuable insights for the newly established ePIC collaboration at EIC. This paper summarizes the different activities and R&D projects covered across the sessions of the workshop and provides an overview of the goals, approaches and strategies regarding AI/ML in the EIC community, as well as cutting-edge techniques currently studied in other experiments.
△ Less
Submitted 17 July, 2023;
originally announced July 2023.
-
Distributed Conditional GAN (discGAN) For Synthetic Healthcare Data Generation
Authors:
David Fuentes,
Diana McSpadden,
Sodiq Adewole
Abstract:
In this paper, we propose a distributed Generative Adversarial Networks (discGANs) to generate synthetic tabular data specific to the healthcare domain. While using GANs to generate images has been well studied, little to no attention has been given to generation of tabular data. Modeling distributions of discrete and continuous tabular data is a non-trivial task with high utility. We applied disc…
▽ More
In this paper, we propose a distributed Generative Adversarial Networks (discGANs) to generate synthetic tabular data specific to the healthcare domain. While using GANs to generate images has been well studied, little to no attention has been given to generation of tabular data. Modeling distributions of discrete and continuous tabular data is a non-trivial task with high utility. We applied discGAN to model non-Gaussian multi-modal healthcare data. We generated 249,000 synthetic records from original 2,027 eICU dataset. We evaluated the performance of the model using machine learning efficacy, the Kolmogorov-Smirnov (KS) test for continuous variables and chi-squared test for discrete variables. Our results show that discGAN was able to generate data with distributions similar to the real data.
△ Less
Submitted 9 April, 2023;
originally announced April 2023.
-
AI for Experimental Controls at Jefferson Lab
Authors:
Torri Jeske,
Diana McSpadden,
Nikhil Kalra,
Thomas Britton,
Naomi Jarvis,
David Lawrence
Abstract:
The AI for Experimental Controls project is developing an AI system to control and calibrate detector systems located at Jefferson Laboratory. Currently, calibrations are performed offline and require significant time and attention from experts. This work would reduce the amount of data and the amount of time spent calibrating in an offline setting. The first use case involves the Central Drift Ch…
▽ More
The AI for Experimental Controls project is developing an AI system to control and calibrate detector systems located at Jefferson Laboratory. Currently, calibrations are performed offline and require significant time and attention from experts. This work would reduce the amount of data and the amount of time spent calibrating in an offline setting. The first use case involves the Central Drift Chamber (CDC) located inside the GlueX spectrometer in Hall D. We use a combination of environmental and experimental data, such as atmospheric pressure, gas temperature, and the flux of incident particles as inputs to a Sequential Neural Network (NN) to recommend a high voltage setting and the corresponding calibration constants in order to maintain consistent gain and optimal resolution throughout the experiment. Utilizing AI in this manner represents an initial shift from offline calibration towards near real time calibrations performed at Jefferson Laboratory.
△ Less
Submitted 11 March, 2022;
originally announced March 2022.
