-
IRIS-HEP Strategic Plan for the Next Phase of Software Upgrades for HL-LHC Physics
Authors:
Brian Bockelman,
Peter Elmer,
Gordon Watts
Abstract:
The quest to understand the fundamental building blocks of nature and their interactions is one of the oldest and most ambitious of human scientific endeavors. CERN's Large Hadron Collider (LHC) represents a huge step forward in this quest. The discovery of the Higgs boson, the observation of exceedingly rare decays of $B$ mesons, and stringent constraints on many viable theories of physics beyond…
▽ More
The quest to understand the fundamental building blocks of nature and their interactions is one of the oldest and most ambitious of human scientific endeavors. CERN's Large Hadron Collider (LHC) represents a huge step forward in this quest. The discovery of the Higgs boson, the observation of exceedingly rare decays of $B$ mesons, and stringent constraints on many viable theories of physics beyond the Standard Model (SM) demonstrate the great scientific value of the LHC physics program. The next phase of this global scientific project will be the High-Luminosity LHC (HL-LHC) which will collect data starting circa 2029 and continue through the 2030s. The primary science goal is to search for physics beyond the SM and, should it be discovered, to study its implications. In the HL-LHC era, the ATLAS and CMS experiments will record around 100 times as many collisions as were used to discover the Higgs boson (and at twice the energy). Both NSF and DOE are making large detector upgrade investments so the HL-LHC can operate in this high-rate environment. Similar investment in software R&D for acquiring, managing, processing and analyzing HL-LHC data is critical to maximize the return-on-investment in the upgraded accelerator and detectors. This report presents a strategic plan for a possible second 5-year funded phase (2023 through 2028) for the Institute for Research and Innovation in Software for High Energy Physics (IRIS-HEP) which will close remaining software and computing gaps to deliver HL-LHC science.
△ Less
Submitted 2 February, 2023;
originally announced February 2023.
-
Snowmass 2021 Computational Frontier CompF4 Topical Group Report: Storage and Processing Resource Access
Authors:
W. Bhimji,
D. Carder,
E. Dart,
J. Duarte,
I. Fisk,
R. Gardner,
C. Guok,
B. Jayatilaka,
T. Lehman,
M. Lin,
C. Maltzahn,
S. McKee,
M. S. Neubauer,
O. Rind,
O. Shadura,
N. V. Tran,
P. van Gemmeren,
G. Watts,
B. A. Weaver,
F. Würthwein
Abstract:
Computing plays a significant role in all areas of high energy physics. The Snowmass 2021 CompF4 topical group's scope is facilities R&D, where we consider "facilities" as the computing hardware and software infrastructure inside the data centers plus the networking between data centers, irrespective of who owns them, and what policies are applied for using them. In other words, it includes commer…
▽ More
Computing plays a significant role in all areas of high energy physics. The Snowmass 2021 CompF4 topical group's scope is facilities R&D, where we consider "facilities" as the computing hardware and software infrastructure inside the data centers plus the networking between data centers, irrespective of who owns them, and what policies are applied for using them. In other words, it includes commercial clouds, federally funded High Performance Computing (HPC) systems for all of science, and systems funded explicitly for a given experimental or theoretical program. This topical group report summarizes the findings and recommendations for the storage, processing, networking and associated software service infrastructures for future high energy physics research, based on the discussions organized through the Snowmass 2021 community study.
△ Less
Submitted 29 September, 2022; v1 submitted 19 September, 2022;
originally announced September 2022.
-
Particle Physics Outreach at Non-traditional Venues
Authors:
Jim Cochran,
John Huth,
Roger Jones,
Paul Laycock,
Claire Lee,
Lawrence Lee,
Connie Potter,
Gordon Watts
Abstract:
Since 2016 the group known as `The Big Bang Collective' has brought High Energy Physics outreach to music and culture festivals across Europe, successfully engaging with and inspiring audiences who may never have sought this out themselves through activities in their `Physics Pavilions'. The US has a very long, glorious tradition of music festivals, and an incredible community of sci-comm engaged…
▽ More
Since 2016 the group known as `The Big Bang Collective' has brought High Energy Physics outreach to music and culture festivals across Europe, successfully engaging with and inspiring audiences who may never have sought this out themselves through activities in their `Physics Pavilions'. The US has a very long, glorious tradition of music festivals, and an incredible community of sci-comm engaged physicists, from students to senior staff. With the experience already gained in Europe, The Big Bang Collective believes the time is now ripe to bring their Physics Pavilions to US music festivals.
△ Less
Submitted 17 March, 2022;
originally announced March 2022.
-
Broadening the scope of Education, Career and Open Science in HEP
Authors:
Sudhir Malik,
David DeMuth,
Sijbrand de Jong,
Randal Ruchti,
Savannah Thais,
Guillermo Fidalgo,
Ken Heller,
Mathew Muether,
Minerba Betancourt,
Meenakshi Narain,
Tiffany R. Lewis,
Kyle Cranmer,
Gordon Watts
Abstract:
High Energy Particle Physics (HEP) faces challenges over the coming decades with a need to attract young people to the field and STEM careers, as well as a need to recognize, promote and sustain those in the field who are making important contributions to the research effort across the many specialties needed to deliver the science. Such skills can also serve as attractors for students who may not…
▽ More
High Energy Particle Physics (HEP) faces challenges over the coming decades with a need to attract young people to the field and STEM careers, as well as a need to recognize, promote and sustain those in the field who are making important contributions to the research effort across the many specialties needed to deliver the science. Such skills can also serve as attractors for students who may not want to pursue a PhD in HEP but use them as a springboard to other STEM careers. This paper reviews the challenges and develops strategies to correct the disparities to help transform the particle physics field into a stronger and more diverse ecosystem of talent and expertise, with the expectation of long-lasting scientific and societal benefits.
△ Less
Submitted 15 March, 2022;
originally announced March 2022.
-
The International Linear Collider: Report to Snowmass 2021
Authors:
Alexander Aryshev,
Ties Behnke,
Mikael Berggren,
James Brau,
Nathaniel Craig,
Ayres Freitas,
Frank Gaede,
Spencer Gessner,
Stefania Gori,
Christophe Grojean,
Sven Heinemeyer,
Daniel Jeans,
Katja Kruger,
Benno List,
Jenny List,
Zhen Liu,
Shinichiro Michizono,
David W. Miller,
Ian Moult,
Hitoshi Murayama,
Tatsuya Nakada,
Emilio Nanni,
Mihoko Nojiri,
Hasan Padamsee,
Maxim Perelstein
, et al. (487 additional authors not shown)
Abstract:
The International Linear Collider (ILC) is on the table now as a new global energy-frontier accelerator laboratory taking data in the 2030s. The ILC addresses key questions for our current understanding of particle physics. It is based on a proven accelerator technology. Its experiments will challenge the Standard Model of particle physics and will provide a new window to look beyond it. This docu…
▽ More
The International Linear Collider (ILC) is on the table now as a new global energy-frontier accelerator laboratory taking data in the 2030s. The ILC addresses key questions for our current understanding of particle physics. It is based on a proven accelerator technology. Its experiments will challenge the Standard Model of particle physics and will provide a new window to look beyond it. This document brings the story of the ILC up to date, emphasizing its strong physics motivation, its readiness for construction, and the opportunity it presents to the US and the global particle physics community.
△ Less
Submitted 16 January, 2023; v1 submitted 14 March, 2022;
originally announced March 2022.
-
Towards Real-World Applications of ServiceX, an Analysis Data Transformation System
Authors:
KyungEon Choi,
Andrew Eckart,
Ben Galewsky,
Robert Gardner,
Mark S. Neubauer,
Peter Onyisi,
Mason Proffitt,
Ilija Vukotic,
Gordon T. Watts
Abstract:
One of the biggest challenges in the High-Luminosity LHC (HL- LHC) era will be the significantly increased data size to be recorded and analyzed from the collisions at the ATLAS and CMS experiments. ServiceX is a software R&D project in the area of Data Organization, Management and Access of the IRIS- HEP to investigate new computational models for the HL- LHC era. ServiceX is an experiment-agnost…
▽ More
One of the biggest challenges in the High-Luminosity LHC (HL- LHC) era will be the significantly increased data size to be recorded and analyzed from the collisions at the ATLAS and CMS experiments. ServiceX is a software R&D project in the area of Data Organization, Management and Access of the IRIS- HEP to investigate new computational models for the HL- LHC era. ServiceX is an experiment-agnostic service to enable on-demand data delivery specifically tailored for nearly-interactive vectorized analyses. It is capable of retrieving data from grid sites, on-the-fly data transformation, and delivering user-selected data in a variety of different formats. New features will be presented that make the service ready for public use. An ongoing effort to integrate ServiceX with a popular statistical analysis framework in ATLAS will be described with an emphasis of a practical implementation of ServiceX into the physics analysis pipeline.
△ Less
Submitted 5 July, 2021;
originally announced July 2021.
-
Learning from the Pandemic: the Future of Meetings in HEP and Beyond
Authors:
Mark S. Neubauer,
Todd Adams,
Jennifer Adelman-McCarthy,
Gabriele Benelli,
Tulika Bose,
David Britton,
Pat Burchat,
Joel Butler,
Timothy A. Cartwright,
Tomáš Davídek,
Jacques Dumarchez,
Peter Elmer,
Matthew Feickert,
Ben Galewsky,
Mandeep Gill,
Maciej Gladki,
Aman Goel,
Jonathan E. Guyer,
Bo Jayatilaka,
Brendan Kiburg,
Benjamin Krikler,
David Lange,
Claire Lee,
Nick Manganelli,
Giovanni Marchiori
, et al. (14 additional authors not shown)
Abstract:
The COVID-19 pandemic has by-and-large prevented in-person meetings since March 2020. While the increasing deployment of effective vaccines around the world is a very positive development, the timeline and pathway to "normality" is uncertain and the "new normal" we will settle into is anyone's guess. Particle physics, like many other scientific fields, has more than a year of experience in holding…
▽ More
The COVID-19 pandemic has by-and-large prevented in-person meetings since March 2020. While the increasing deployment of effective vaccines around the world is a very positive development, the timeline and pathway to "normality" is uncertain and the "new normal" we will settle into is anyone's guess. Particle physics, like many other scientific fields, has more than a year of experience in holding virtual meetings, workshops, and conferences. A great deal of experimentation and innovation to explore how to execute these meetings effectively has occurred. Therefore, it is an appropriate time to take stock of what we as a community learned from running virtual meetings and discuss possible strategies for the future. Continuing to develop effective strategies for meetings with a virtual component is likely to be important for reducing the carbon footprint of our research activities, while also enabling greater diversity and inclusion for participation. This report summarizes a virtual two-day workshop on Virtual Meetings held May 5-6, 2021 which brought together experts from both inside and outside of high-energy physics to share their experiences and practices with organizing and executing virtual workshops, and to develop possible strategies for future meetings as we begin to emerge from the COVID-19 pandemic. This report outlines some of the practices and tools that have worked well which we hope will serve as a valuable resource for future virtual meeting organizers in all scientific fields.
△ Less
Submitted 29 June, 2021;
originally announced June 2021.
-
hep_tables: Heterogeneous Array Programming for HEP
Authors:
Gordon Watts
Abstract:
Array operations are one of the most concise ways of expressing common filtering and simple aggregation operations that is the hallmark of the first step of a particle physics analysis: selection, filtering, basic vector operations, and filling histograms. The High Luminosity run of the Large Hadron Collider (HL-LHC), scheduled to start in 2026, will require physicists to regularly skim datasets t…
▽ More
Array operations are one of the most concise ways of expressing common filtering and simple aggregation operations that is the hallmark of the first step of a particle physics analysis: selection, filtering, basic vector operations, and filling histograms. The High Luminosity run of the Large Hadron Collider (HL-LHC), scheduled to start in 2026, will require physicists to regularly skim datasets that are over a PB in size, and repeatedly run over datasets that are 100's of TB's - too big to fit in memory. Declarative programming techniques are a way of separating the intent of the physicist from the mechanics of finding the data, processing the data, and using distributed computing to process it efficiently that is required to extract the plot or data desired in a timely fashion. This paper describes a prototype library that provides a framework for different sub-systems to cooperate in producing this data, using an array-programming declarative interface. This prototype has a ServiceX data-delivery sub-system and an awkward array sub-system cooperating to generate requested data. The ServiceX system runs against ATLAS xAOD data.
△ Less
Submitted 21 March, 2021;
originally announced March 2021.
-
FuncADL: Functional Analysis Description Language
Authors:
Mason Proffitt,
Gordon Watts
Abstract:
The traditional approach in HEP analysis software is to loop over every event and every object via the ROOT framework. This method follows an imperative paradigm, in which the code is tied to the storage format and steps of execution. A more desirable strategy would be to implement a declarative language, such that the storage medium and execution are not included in the abstraction model. This wi…
▽ More
The traditional approach in HEP analysis software is to loop over every event and every object via the ROOT framework. This method follows an imperative paradigm, in which the code is tied to the storage format and steps of execution. A more desirable strategy would be to implement a declarative language, such that the storage medium and execution are not included in the abstraction model. This will become increasingly important to managing the large dataset collected by the LHC and the HL-LHC. A new analysis description language (ADL) inspired by functional programming, FuncADL, was developed using Python as a host language. The expressiveness of this language was tested by implementing example analysis tasks designed to benchmark the functionality of ADLs. Many simple selections are expressible in a declarative way with FuncADL, which can be used as an interface to retrieve filtered data. Some limitations were identified, but the design of the language allows for future extensions to add missing features. FuncADL is part of a suite of analysis software tools being developed by the Institute for Research and Innovation in Software for High Energy Physics (IRIS-HEP). These tools will be available to develop highly scalable physics analyses for the LHC.
△ Less
Submitted 22 June, 2021; v1 submitted 2 March, 2021;
originally announced March 2021.
-
Analysis Description Languages for the LHC
Authors:
Sezen Sekmen,
Philippe Gras,
Lindsey Gray,
Benjamin Krikler,
Jim Pivarski,
Harrison B. Prosper,
Andrea Rizzi,
Gokhan Unel,
Gordon Watts
Abstract:
An analysis description language is a domain specific language capable of describing the contents of an LHC analysis in a standard and unambiguous way, independent of any computing framework. It is designed for use by anyone with an interest in, and knowledge of, LHC physics, i.e., experimentalists, phenomenologists and other enthusiasts. Adopting analysis description languages would bring numerou…
▽ More
An analysis description language is a domain specific language capable of describing the contents of an LHC analysis in a standard and unambiguous way, independent of any computing framework. It is designed for use by anyone with an interest in, and knowledge of, LHC physics, i.e., experimentalists, phenomenologists and other enthusiasts. Adopting analysis description languages would bring numerous benefits for the LHC experimental and phenomenological communities ranging from analysis preservation beyond the lifetimes of experiments or analysis software to facilitating the abstraction, design, visualization, validation, combination, reproduction, interpretation and overall communication of the analysis contents. Here, we introduce the analysis description language concept and summarize the current efforts ongoing to develop such languages and tools to use them in LHC analyses.
△ Less
Submitted 3 November, 2020;
originally announced November 2020.
-
An Update to the Letter of Intent for MATHUSLA: Search for Long-Lived Particles at the HL-LHC
Authors:
Cristiano Alpigiani,
Juan Carlos Arteaga-Velázquez,
Austin Ball,
Liron Barak,
Jared Barron,
Brian Batell,
James Beacham,
Yan Benhammo,
Karen Salomé Caballero-Mora,
Paolo Camarri,
Roberto Cardarelli,
John Paul Chou,
Wentao Cui,
David Curtin,
Miriam Diamond,
Keith R. Dienes,
Liam Andrew Dougherty,
Giuseppe Di Sciascio,
Marco Drewes,
Erez Etzion,
Rouven Essig,
Jared Evans,
Arturo Fernández Téllez,
Oliver Fischer,
Jim Freeman
, et al. (58 additional authors not shown)
Abstract:
We report on recent progress in the design of the proposed MATHUSLA Long Lived Particle (LLP) detector for the HL-LHC, updating the information in the original Letter of Intent (LoI), see CDS:LHCC-I-031, arXiv:1811.00927. A suitable site has been identified at LHC Point 5 that is closer to the CMS Interaction Point (IP) than assumed in the LoI. The decay volume has been increased from 20 m to 25 m…
▽ More
We report on recent progress in the design of the proposed MATHUSLA Long Lived Particle (LLP) detector for the HL-LHC, updating the information in the original Letter of Intent (LoI), see CDS:LHCC-I-031, arXiv:1811.00927. A suitable site has been identified at LHC Point 5 that is closer to the CMS Interaction Point (IP) than assumed in the LoI. The decay volume has been increased from 20 m to 25 m in height. Engineering studies have been made in order to locate much of the decay volume below ground, bringing the detector even closer to the IP. With these changes, a 100 m x 100 m detector has the same physics reach for large c$τ$ as the 200 m x 200 m detector described in the LoI and other studies. The performance for small c$τ$ is improved because of the proximity to the IP. Detector technology has also evolved while retaining the strip-like sensor geometry in Resistive Plate Chambers (RPC) described in the LoI. The present design uses extruded scintillator bars read out using wavelength shifting fibers and silicon photomultipliers (SiPM). Operations will be simpler and more robust with much lower operating voltages and without the use of greenhouse gases. Manufacturing is straightforward and should result in cost savings. Understanding of backgrounds has also significantly advanced, thanks to new simulation studies and measurements taken at the MATHUSLA test stand operating above ATLAS in 2018. We discuss next steps for the MATHUSLA collaboration, and identify areas where new members can make particularly important contributions.
△ Less
Submitted 3 September, 2020;
originally announced September 2020.
-
HL-LHC Computing Review: Common Tools and Community Software
Authors:
HEP Software Foundation,
:,
Thea Aarrestad,
Simone Amoroso,
Markus Julian Atkinson,
Joshua Bendavid,
Tommaso Boccali,
Andrea Bocci,
Andy Buckley,
Matteo Cacciari,
Paolo Calafiura,
Philippe Canal,
Federico Carminati,
Taylor Childers,
Vitaliano Ciulli,
Gloria Corti,
Davide Costanzo,
Justin Gage Dezoort,
Caterina Doglioni,
Javier Mauricio Duarte,
Agnieszka Dziurda,
Peter Elmer,
Markus Elsing,
V. Daniel Elvira,
Giulio Eulisse
, et al. (85 additional authors not shown)
Abstract:
Common and community software packages, such as ROOT, Geant4 and event generators have been a key part of the LHC's success so far and continued development and optimisation will be critical in the future. The challenges are driven by an ambitious physics programme, notably the LHC accelerator upgrade to high-luminosity, HL-LHC, and the corresponding detector upgrades of ATLAS and CMS. In this doc…
▽ More
Common and community software packages, such as ROOT, Geant4 and event generators have been a key part of the LHC's success so far and continued development and optimisation will be critical in the future. The challenges are driven by an ambitious physics programme, notably the LHC accelerator upgrade to high-luminosity, HL-LHC, and the corresponding detector upgrades of ATLAS and CMS. In this document we address the issues for software that is used in multiple experiments (usually even more widely than ATLAS and CMS) and maintained by teams of developers who are either not linked to a particular experiment or who contribute to common software within the context of their experiment activity. We also give space to general considerations for future software and projects that tackle upcoming challenges, no matter who writes it, which is an area where community convergence on best practice is extremely useful.
△ Less
Submitted 31 August, 2020;
originally announced August 2020.
-
The MATHUSLA Test Stand
Authors:
Maf Alidra,
Cristiano Alpigiani,
Austin Ball,
Paolo Camarri,
Roberto Cardarelli,
John Paul Chou,
David Curtin,
Erez Etzion,
Ali Garabaglu,
Brandon Gomes,
Roberto Guida,
W. Kuykendall,
Audrey Kvam,
Dragoslav Lazic,
H. J. Lubatti,
Giovanni Marsella,
Gilad Mizrachi,
Antonio Policicchio,
Mason Proffitt,
Joe Rothberg,
Rinaldo Santonico,
Yiftah Silver,
Steffie Ann Thayil,
Emma Torro-Pastor,
Gordon Watts
, et al. (1 additional authors not shown)
Abstract:
The rate of muons from LHC $pp$ collisions reaching the surface above the ATLAS interaction point is measured and compared with expected rates from decays of $W$ and $Z$ bosons and $b$- and $c$-quark jets. In addition, data collected during periods without beams circulating in the LHC provide a measurement of the background from cosmic ray inelastic backscattering that is compared to simulation pr…
▽ More
The rate of muons from LHC $pp$ collisions reaching the surface above the ATLAS interaction point is measured and compared with expected rates from decays of $W$ and $Z$ bosons and $b$- and $c$-quark jets. In addition, data collected during periods without beams circulating in the LHC provide a measurement of the background from cosmic ray inelastic backscattering that is compared to simulation predictions. Data were recorded during 2018 in a 2.5 $\times$ 2.5 $\times$ 6.5~$\rm{m}^3$ active volume MATHUSLA test stand detector unit consisting of two scintillator planes, one at the top and one at the bottom, which defined the trigger, and six layers of RPCs between them, grouped into three $(x,y)$-measuring layers separated by 1.74 m from each other. Triggers selecting both upward-going tracks and downward-going tracks were used.
△ Less
Submitted 9 September, 2020; v1 submitted 5 May, 2020;
originally announced May 2020.
-
A Letter of Intent for MATHUSLA: a dedicated displaced vertex detector above ATLAS or CMS
Authors:
Cristiano Alpigiani,
Austin Ball,
Liron Barak,
James Beacham,
Yan Benhammo,
Tingting Cao,
Paolo Camarri,
Roberto Cardarelli,
Mario Rodriguez-Cahuantzi,
John Paul Chou,
David Curtin,
Miriam Diamond,
Giuseppe Di Sciascio,
Marco Drewes,
Sarah C. Eno,
Erez Etzion,
Rouven Essig,
Jared Evans,
Oliver Fischer,
Stefano Giagu,
Brandon Gomes,
Andy Haas,
Yuekun Heng,
Giuseppe Iaselli,
Ken Johns
, et al. (39 additional authors not shown)
Abstract:
In this Letter of Intent (LOI) we propose the construction of MATHUSLA (MAssive Timing Hodoscope for Ultra-Stable neutraL pArticles), a dedicated large-volume displaced vertex detector for the HL-LHC on the surface above ATLAS or CMS. Such a detector, which can be built using existing technologies with a reasonable budget in time for the HL-LHC upgrade, could search for neutral long-lived particle…
▽ More
In this Letter of Intent (LOI) we propose the construction of MATHUSLA (MAssive Timing Hodoscope for Ultra-Stable neutraL pArticles), a dedicated large-volume displaced vertex detector for the HL-LHC on the surface above ATLAS or CMS. Such a detector, which can be built using existing technologies with a reasonable budget in time for the HL-LHC upgrade, could search for neutral long-lived particles (LLPs) with up to several orders of magnitude better sensitivity than ATLAS or CMS, while also acting as a cutting-edge cosmic ray telescope at CERN to explore many open questions in cosmic ray and astro-particle physics. We review the physics motivations for MATHUSLA and summarize its LLP reach for several different possible detector geometries, as well as outline the cosmic ray physics program. We present several updated background studies for MATHUSLA, which help inform a first detector-design concept utilizing modular construction with Resistive Plate Chambers (RPCs) as the primary tracking technology. We present first efficiency and reconstruction studies to verify the viability of this design concept, and we explore some aspects of its total cost. We end with a summary of recent progress made on the MATHUSLA test stand, a small-scale demonstrator experiment currently taking data at CERN Point 1, and finish with a short comment on future work.
△ Less
Submitted 2 November, 2018;
originally announced November 2018.
-
HEP Software Foundation Community White Paper Working Group - Data and Software Preservation to Enable Reuse
Authors:
M. D. Hildreth,
A. Boehnlein,
K. Cranmer,
S. Dallmeier,
R. Gardner,
T. Hacker,
L. Heinrich,
I. Jimenez,
M. Kane,
D. S. Katz,
T. Malik,
C. Maltzahn,
M. Neubauer,
S. Neubert,
Jim Pivarski,
E. Sexton,
J. Shiers,
T. Simko,
S. Smith,
D. South,
A. Verbytskyi,
G. Watts,
J. Wozniak
Abstract:
In this chapter of the High Energy Physics Software Foundation Community Whitepaper, we discuss the current state of infrastructure, best practices, and ongoing developments in the area of data and software preservation in high energy physics. A re-framing of the motivation for preservation to enable re-use is presented. A series of research and development goals in software and other cyberinfrast…
▽ More
In this chapter of the High Energy Physics Software Foundation Community Whitepaper, we discuss the current state of infrastructure, best practices, and ongoing developments in the area of data and software preservation in high energy physics. A re-framing of the motivation for preservation to enable re-use is presented. A series of research and development goals in software and other cyberinfrastructure that will aid in the enabling of reuse of particle physics analyses and production software are presented and discussed.
△ Less
Submitted 2 October, 2018;
originally announced October 2018.
-
Machine Learning in High Energy Physics Community White Paper
Authors:
Kim Albertsson,
Piero Altoe,
Dustin Anderson,
John Anderson,
Michael Andrews,
Juan Pedro Araque Espinosa,
Adam Aurisano,
Laurent Basara,
Adrian Bevan,
Wahid Bhimji,
Daniele Bonacorsi,
Bjorn Burkle,
Paolo Calafiura,
Mario Campanelli,
Louis Capps,
Federico Carminati,
Stefano Carrazza,
Yi-fan Chen,
Taylor Childers,
Yann Coadou,
Elias Coniavitis,
Kyle Cranmer,
Claire David,
Douglas Davis,
Andrea De Simone
, et al. (103 additional authors not shown)
Abstract:
Machine learning has been applied to several problems in particle physics research, beginning with applications to high-level physics analysis in the 1990s and 2000s, followed by an explosion of applications in particle and event identification and reconstruction in the 2010s. In this document we discuss promising future research and development areas for machine learning in particle physics. We d…
▽ More
Machine learning has been applied to several problems in particle physics research, beginning with applications to high-level physics analysis in the 1990s and 2000s, followed by an explosion of applications in particle and event identification and reconstruction in the 2010s. In this document we discuss promising future research and development areas for machine learning in particle physics. We detail a roadmap for their implementation, software and hardware resource requirements, collaborative initiatives with the data science community, academia and industry, and training the particle physics community in data science. The main objective of the document is to connect and motivate these areas of research and development with the physics drivers of the High-Luminosity Large Hadron Collider and future neutrino experiments and identify the resource needs for their implementation. Additionally we identify areas where collaboration with external communities will be of great benefit.
△ Less
Submitted 16 May, 2019; v1 submitted 8 July, 2018;
originally announced July 2018.
-
HEP Software Foundation Community White Paper Working Group - Data Analysis and Interpretation
Authors:
Lothar Bauerdick,
Riccardo Maria Bianchi,
Brian Bockelman,
Nuno Castro,
Kyle Cranmer,
Peter Elmer,
Robert Gardner,
Maria Girone,
Oliver Gutsche,
Benedikt Hegner,
José M. Hernández,
Bodhitha Jayatilaka,
David Lange,
Mark S. Neubauer,
Daniel S. Katz,
Lukasz Kreczko,
James Letts,
Shawn McKee,
Christoph Paus,
Kevin Pedro,
Jim Pivarski,
Martin Ritter,
Eduardo Rodrigues,
Tai Sakuma,
Elizabeth Sexton-Kennedy
, et al. (4 additional authors not shown)
Abstract:
At the heart of experimental high energy physics (HEP) is the development of facilities and instrumentation that provide sensitivity to new phenomena. Our understanding of nature at its most fundamental level is advanced through the analysis and interpretation of data from sophisticated detectors in HEP experiments. The goal of data analysis systems is to realize the maximum possible scientific po…
▽ More
At the heart of experimental high energy physics (HEP) is the development of facilities and instrumentation that provide sensitivity to new phenomena. Our understanding of nature at its most fundamental level is advanced through the analysis and interpretation of data from sophisticated detectors in HEP experiments. The goal of data analysis systems is to realize the maximum possible scientific potential of the data within the constraints of computing and human resources in the least time. To achieve this goal, future analysis systems should empower physicists to access the data with a high level of interactivity, reproducibility and throughput capability. As part of the HEP Software Foundation Community White Paper process, a working group on Data Analysis and Interpretation was formed to assess the challenges and opportunities in HEP data analysis and develop a roadmap for activities in this area over the next decade. In this report, the key findings and recommendations of the Data Analysis and Interpretation Working Group are presented.
△ Less
Submitted 9 April, 2018;
originally announced April 2018.
-
A Roadmap for HEP Software and Computing R&D for the 2020s
Authors:
Johannes Albrecht,
Antonio Augusto Alves Jr,
Guilherme Amadio,
Giuseppe Andronico,
Nguyen Anh-Ky,
Laurent Aphecetche,
John Apostolakis,
Makoto Asai,
Luca Atzori,
Marian Babik,
Giuseppe Bagliesi,
Marilena Bandieramonte,
Sunanda Banerjee,
Martin Barisits,
Lothar A. T. Bauerdick,
Stefano Belforte,
Douglas Benjamin,
Catrin Bernius,
Wahid Bhimji,
Riccardo Maria Bianchi,
Ian Bird,
Catherine Biscarat,
Jakob Blomer,
Kenneth Bloom,
Tommaso Boccali
, et al. (285 additional authors not shown)
Abstract:
Particle physics has an ambitious and broad experimental programme for the coming decades. This programme requires large investments in detector hardware, either to build new facilities and experiments, or to upgrade existing ones. Similarly, it requires commensurate investment in the R&D of software to acquire, manage, process, and analyse the shear amounts of data to be recorded. In planning for…
▽ More
Particle physics has an ambitious and broad experimental programme for the coming decades. This programme requires large investments in detector hardware, either to build new facilities and experiments, or to upgrade existing ones. Similarly, it requires commensurate investment in the R&D of software to acquire, manage, process, and analyse the shear amounts of data to be recorded. In planning for the HL-LHC in particular, it is critical that all of the collaborating stakeholders agree on the software goals and priorities, and that the efforts complement each other. In this spirit, this white paper describes the R&D activities required to prepare for this software upgrade.
△ Less
Submitted 19 December, 2018; v1 submitted 18 December, 2017;
originally announced December 2017.
-
Data preservation at the Fermilab Tevatron
Authors:
S. Amerio,
S. Behari,
J. Boyd,
M. Brochmann,
R. Culbertson,
M. Diesburg,
J. Freeman,
L. Garren,
H. Greenlee,
K. Herner,
R. Illingworth,
B. Jayatilaka,
A. Jonckheere,
Q. Li,
S. Naymola,
G. Oleynik,
W. Sakumotob,
E. Varnes,
C. Vellidis,
G. Watts,
S. White
Abstract:
The Fermilab Tevatron collider's data-taking run ended in September 2011, yielding a dataset with rich scientific potential. The CDF and D0 experiments each have approximately 9 PB of collider and simulated data stored on tape. A large computing infrastructure consisting of tape storage, disk cache, and distributed grid computing for physics analysis with the Tevatron data is present at Fermilab.…
▽ More
The Fermilab Tevatron collider's data-taking run ended in September 2011, yielding a dataset with rich scientific potential. The CDF and D0 experiments each have approximately 9 PB of collider and simulated data stored on tape. A large computing infrastructure consisting of tape storage, disk cache, and distributed grid computing for physics analysis with the Tevatron data is present at Fermilab. The Fermilab Run II data preservation project intends to keep this analysis capability sustained through the year 2020 and beyond. To achieve this goal, we have implemented a system that utilizes virtualization, automated validation, and migration to new standards in both software and data storage technology and leverages resources available from currently-running experiments at Fermilab. These efforts have also provided useful lessons in ensuring long-term data access for numerous experiments, and enable high-quality scientific output for years to come.
△ Less
Submitted 26 January, 2017;
originally announced January 2017.
-
The DZERO Level 3 Data Acquistion System
Authors:
B. Angstadt,
G. Brooijmans,
D. Chapin,
M. Clements,
D. Charak,
D. Cutts,
S. Fuess,
A. Haas,
R. Hauser,
A. Kulyavtsev,
D. Leichtman,
S. E. K Mattingly,
M. Mulders,
P. Padley,
D. Petravick,
R. Rechenmacher,
G. Watts,
D. Zhang
Abstract:
The DZERO experiment located at Fermilab has recently started RunII with an upgraded detector. The RunII physics program requires the Data Acquisition to readout the detector at a rate of 1 KHz. Events fragments, totaling 250 KB, are readout from approximately 60 front end crates and sent to a particular farm node for Level 3 Trigger processing. A scalable system, capable of complex event routin…
▽ More
The DZERO experiment located at Fermilab has recently started RunII with an upgraded detector. The RunII physics program requires the Data Acquisition to readout the detector at a rate of 1 KHz. Events fragments, totaling 250 KB, are readout from approximately 60 front end crates and sent to a particular farm node for Level 3 Trigger processing. A scalable system, capable of complex event routing, has been designed and implemented based on commodity components: VMIC 7750 Single Board Computers for readout, a Cisco 6509 switch for data flow, and close to 100 Linux-based PCs for high-level event filtering.
△ Less
Submitted 14 July, 2003;
originally announced July 2003.
-
The DZERO DAQ/Online Monitoring System and Applications, Including an Active Auto-recovery Tool
Authors:
B. Angstadt,
G. Brooijmans,
D. Chapin,
D. Charak,
M. Clements,
S. Fuess,
A. Haas,
R. Hauser,
D. Leichtman,
S. Mattingly,
A. Kulyavtsev,
M. Mulders,
P. Padley,
D. Petravick,
R. Rechenmacher,
G. Watts,
D. Zhang
Abstract:
The DZERO experiment, located at the Fermi National Accelerator Laboratory, has recently started the Run 2 physics program. The detector upgrade included a new Data Acquisition/Level 3 Trigger system. Part of the design for the DAQ/Trigger system was a new monitoring infrastructure. The monitoring was designed to satisfy real-time requirements with 1-second resolution as well as non-real-time da…
▽ More
The DZERO experiment, located at the Fermi National Accelerator Laboratory, has recently started the Run 2 physics program. The detector upgrade included a new Data Acquisition/Level 3 Trigger system. Part of the design for the DAQ/Trigger system was a new monitoring infrastructure. The monitoring was designed to satisfy real-time requirements with 1-second resolution as well as non-real-time data. It was also designed to handle a large number of displays without putting undue load on the sources of monitoring information. The resulting protocol is based on XML, is easily extensible, and has spawned a large number of displays, clients, and other applications. It is also one of the few sources of detector performance available outside the Online System's security wall. A tool, based on this system, which provides for auto-recovery of DAQ errors, has been designed. This talk will include a description of the DZERO DAQ/Online monitor server, based on the ACE framework, the protocol, the auto-recovery tool, and several of the unique displays which include an ORACLE-based archiver and numerous GUIs.
△ Less
Submitted 29 June, 2003;
originally announced June 2003.
