-
Best practices for estimating and reporting epidemiological delay distributions of infectious diseases using public health surveillance and healthcare data
Authors:
Kelly Charniga,
Sang Woo Park,
Andrei R Akhmetzhanov,
Anne Cori,
Jonathan Dushoff,
Sebastian Funk,
Katelyn M Gostic,
Natalie M Linton,
Adrian Lison,
Christopher E Overton,
Juliet R C Pulliam,
Thomas Ward,
Simon Cauchemez,
Sam Abbott
Abstract:
Epidemiological delays, such as incubation periods, serial intervals, and hospital lengths of stay, are among key quantities in infectious disease epidemiology that inform public health policy and clinical practice. This information is used to inform mathematical and statistical models, which in turn can inform control strategies. There are three main challenges that make delay distributions diffi…
▽ More
Epidemiological delays, such as incubation periods, serial intervals, and hospital lengths of stay, are among key quantities in infectious disease epidemiology that inform public health policy and clinical practice. This information is used to inform mathematical and statistical models, which in turn can inform control strategies. There are three main challenges that make delay distributions difficult to estimate. First, the data are commonly censored (e.g., symptom onset may only be reported by date instead of the exact time of day). Second, delays are often right truncated when being estimated in real time (not all events that have occurred have been observed yet). Third, during a rapidly growing or declining outbreak, overrepresentation or underrepresentation, respectively, of recently infected cases in the data can lead to bias in estimates. Studies that estimate delays rarely address all these factors and sometimes report several estimates using different combinations of adjustments, which can lead to conflicting answers and confusion about which estimates are most accurate. In this work, we formulate a checklist of best practices for estimating and reporting epidemiological delays with a focus on the incubation period and serial interval. We also propose strategies for handling common biases and identify areas where more work is needed. Our recommendations can help improve the robustness and utility of reported estimates and provide guidance for the evaluation of estimates for downstream use in transmission models or other analyses.
△ Less
Submitted 14 May, 2024;
originally announced May 2024.
-
Assessing Human Judgment Forecasts in the Rapid Spread of the Mpox Outbreak: Insights and Challenges for Pandemic Preparedness
Authors:
Thomas McAndrew,
Maimuna S. Majumder,
Andrew A. Lover,
Srini Venkatramanan,
Paolo Bocchini,
Tamay Besiroglu,
Allison Codi,
Gaia Dempsey,
Sam Abbott,
Sylvain Chevalier,
Nikos I. Bosse,
Juan Cambeiro,
David Braun
Abstract:
In May 2022, mpox (formerly monkeypox) spread to non-endemic countries rapidly. Human judgment is a forecasting approach that has been sparsely evaluated during the beginning of an outbreak. We collected -- between May 19, 2022 and July 31, 2022 -- 1275 forecasts from 442 individuals of six questions about the mpox outbreak where ground truth data are now available. Individual human judgment forec…
▽ More
In May 2022, mpox (formerly monkeypox) spread to non-endemic countries rapidly. Human judgment is a forecasting approach that has been sparsely evaluated during the beginning of an outbreak. We collected -- between May 19, 2022 and July 31, 2022 -- 1275 forecasts from 442 individuals of six questions about the mpox outbreak where ground truth data are now available. Individual human judgment forecasts and an equally weighted ensemble were evaluated, as well as compared to a random walk, autoregressive, and doubling time model. We found (1) individual human judgment forecasts underestimated outbreak size, (2) the ensemble forecast median moved closer to the ground truth over time but uncertainty around the median did not appreciably decrease, and (3) compared to computational models, for 2-8 week ahead forecasts, the human judgment ensemble outperformed all three models when using median absolute error and weighted interval score; for one week ahead forecasts a random walk outperformed human judgment. We propose two possible explanations: at the time a forecast was submitted, the mode was correlated with the most recent (and smaller) observation that would eventually determine ground truth. Several forecasts were solicited on a logarithmic scale which may have caused humans to generate forecasts with unintended, large uncertainty intervals. To aide in outbreak preparedness, platforms that solicit human judgment forecasts may wish to assess whether specifying a forecast on logarithmic scale matches an individual's intended forecast, support human judgment by finding cues that are typically used to build forecasts, and, to improve performance, tailor their platform to allow forecasters to assign zero probability to events.
△ Less
Submitted 22 April, 2024;
originally announced April 2024.
-
Community recommendations on cryoEM data archiving and validation
Authors:
Gerard J. Kleywegt,
Paul D. Adams,
Sarah J. Butcher,
Cathy Lawson,
Alexis Rohou,
Peter B. Rosenthal,
Sriram Subramaniam,
Maya Topf,
Sanja Abbott,
Philip R. Baldwin,
John M. Berrisford,
Gérard Bricogne,
Preeti Choudhary,
Tristan I. Croll,
Radostin Danev,
Sai J. Ganesan,
Timothy Grant,
Aleksandras Gutmanas,
Richard Henderson,
J. Bernard Heymann,
Juha T. Huiskonen,
Andrei Istrate,
Takayuki Kato,
Gabriel C. Lander,
Shee-Mei Lok
, et al. (22 additional authors not shown)
Abstract:
In January 2020, a workshop was held at EMBL-EBI (Hinxton, UK) to discuss data requirements for deposition and validation of cryoEM structures, with a focus on single-particle analysis. The meeting was attended by 45 experts in data processing, model building and refinement, validation, and archiving of such structures. This report describes the workshop's motivation and history, the topics discus…
▽ More
In January 2020, a workshop was held at EMBL-EBI (Hinxton, UK) to discuss data requirements for deposition and validation of cryoEM structures, with a focus on single-particle analysis. The meeting was attended by 45 experts in data processing, model building and refinement, validation, and archiving of such structures. This report describes the workshop's motivation and history, the topics discussed, and consensus recommendations resulting from the workshop. Some challenges for future methods-development efforts in this area are also highlighted, as is the implementation to date of some of the recommendations.
△ Less
Submitted 2 February, 2024; v1 submitted 29 November, 2023;
originally announced November 2023.
-
Generative Bayesian modeling to nowcast the effective reproduction number from line list data with missing symptom onset dates
Authors:
Adrian Lison,
Sam Abbott,
Jana Huisman,
Tanja Stadler
Abstract:
The time-varying effective reproduction number $R_t$ is a widely used indicator of transmission dynamics during infectious disease outbreaks. Timely estimates of $R_t$ can be obtained from observations close to the original date of infection, such as the date of symptom onset. However, these data often have missing information and are subject to right truncation. Previous methods have addressed th…
▽ More
The time-varying effective reproduction number $R_t$ is a widely used indicator of transmission dynamics during infectious disease outbreaks. Timely estimates of $R_t$ can be obtained from observations close to the original date of infection, such as the date of symptom onset. However, these data often have missing information and are subject to right truncation. Previous methods have addressed these problems independently by first imputing missing onset dates, then adjusting truncated case counts, and finally estimating the effective reproduction number. This stepwise approach makes it difficult to propagate uncertainty and can introduce subtle biases during real-time estimation due to the continued impact of assumptions made in previous steps. In this work, we integrate imputation, truncation adjustment, and $R_t$ estimation into a single generative Bayesian model, allowing direct joint inference of case counts and $R_t$ from line list data with missing symptom onset dates. We then use this framework to compare the performance of nowcasting approaches with different stepwise and generative components on synthetic line list data for multiple outbreak scenarios and across different epidemic phases. We find that under long reporting delays, intermediate smoothing, as is common practice in stepwise approaches, can bias nowcasts of case counts and $R_t$, which is avoided in a joint generative approach due to shared regularization of all model components. On incomplete line list data, a fully generative approach enables the quantification of uncertainty due to missing onset dates without the need for an initial multiple imputation step. In a real-world comparison using hospitalization line list data from the COVID-19 pandemic in Switzerland, we observe the same qualitative differences between approaches. Our generative modeling components have been integrated into the R package epinowcast.
△ Less
Submitted 25 August, 2023;
originally announced August 2023.
-
Nowcasting the 2022 mpox outbreak in England
Authors:
Christopher E. Overton,
Sam Abbott,
Rachel Christie,
Fergus Cumming,
Julie Day,
Owen Jones,
Rob Paton,
Charlie Turner,
Thomas Ward
Abstract:
In May 2022, a cluster of mpox cases were detected in the UK that could not be traced to recent travel history from an endemic region. Over the coming months, the outbreak grew, with over 3000 total cases reported in the UK, and similar outbreaks occurring worldwide. These outbreaks appeared linked to sexual contact networks between gay, bisexual and other men who have sex with men. Following the…
▽ More
In May 2022, a cluster of mpox cases were detected in the UK that could not be traced to recent travel history from an endemic region. Over the coming months, the outbreak grew, with over 3000 total cases reported in the UK, and similar outbreaks occurring worldwide. These outbreaks appeared linked to sexual contact networks between gay, bisexual and other men who have sex with men. Following the COVID-19 pandemic, local health systems were strained, and therefore effective surveillance for mpox was essential for managing public health policy. However, the mpox outbreak in the UK was characterised by substantial delays in the reporting of the symptom onset date and specimen collection date for confirmed positive cases. These delays led to substantial backfilling in the epidemic curve, making it challenging to interpret the epidemic trajectory in real-time. Many nowcasting models exist to tackle this challenge in epidemiological data, but these lacked sufficient flexibility. We have developed a novel nowcasting model using generalised additive models to correct the mpox epidemic curve in England, and provide real-time characteristics of the state of the epidemic, including the real-time growth rate. This model benefited from close collaboration with individuals involved in collecting and processing the data, enabling temporal changes in the reporting structure to be built into the model, which improved the robustness of the nowcasts generated.
△ Less
Submitted 17 February, 2023;
originally announced February 2023.
-
Evaluating Forecasts with scoringutils in R
Authors:
Nikos I. Bosse,
Hugo Gruson,
Anne Cori,
Edwin van Leeuwen,
Sebastian Funk,
Sam Abbott
Abstract:
Evaluating forecasts is essential in order to understand and improve forecasting and make forecasts useful to decision-makers. Much theoretical work has been done on the development of proper scoring rules and other scoring metrics that can help evaluate forecasts. In practice, however, conducting a forecast evaluation and comparison of different forecasters remains challenging. In this paper we i…
▽ More
Evaluating forecasts is essential in order to understand and improve forecasting and make forecasts useful to decision-makers. Much theoretical work has been done on the development of proper scoring rules and other scoring metrics that can help evaluate forecasts. In practice, however, conducting a forecast evaluation and comparison of different forecasters remains challenging. In this paper we introduce scoringutils, an R package that aims to greatly facilitate this process. It is especially geared towards comparing multiple forecasters, regardless of how forecasts were created, and visualising results. The package is able to handle missing forecasts and is the first R package to offer extensive support for forecasts represented through predictive quantiles, a format used by several collaborative ensemble forecasting efforts. The paper gives a short introduction to forecast evaluation, discusses the metrics implemented in scoringutils and gives guidance on when they are appropriate to use, and illustrates the application of the package using example data of forecasts for COVID-19 cases and deaths submitted to the European Forecast Hub between May and September 2021
△ Less
Submitted 14 May, 2022;
originally announced May 2022.
-
Effect of electron diamagnetic drifts on cylindrical double-tearing modes
Authors:
Stephen Abbott,
Kai Germaschewski
Abstract:
Double-tearing modes (DTMs) have been proposed as a driver of `off-axis sawtooth' crashes in reverse magnetic shear tokamak configurations. Recently differential rotation provided by equilibrium sheared flows has been shown capable of decoupling the two DTM resonant layers, slowing the growth the instability. In this work we instead supply this differential rotation using an electron diamagnetic d…
▽ More
Double-tearing modes (DTMs) have been proposed as a driver of `off-axis sawtooth' crashes in reverse magnetic shear tokamak configurations. Recently differential rotation provided by equilibrium sheared flows has been shown capable of decoupling the two DTM resonant layers, slowing the growth the instability. In this work we instead supply this differential rotation using an electron diamagnetic drift, which emerges in the presence of an equilibrium pressure gradient and finite Larmor radius physics. Diamagnetic drifts have the additional benefit of stabilizing reconnection local to the two tearing layers. Conducting linear and nonlinear simulations with the extended MHD code MRC-3d, we consider an m=2, n=1 cylindrical double-tearing mode. We show that asymmetries between the resonant layers and the emergence of an ideal MHD instability cause the DTM evolution to be highly dependent on the location of the pressure gradient. By locating a strong drift near the outer, dominant resonant surface are we able to saturate the mode and preserve the annular current ring, suggesting that the appearance of DTM activity in advanced tokamaks depends strongly on the details of the plasma pressure profile.
△ Less
Submitted 8 August, 2015;
originally announced August 2015.
-
Seismic isolation of Advanced LIGO: Review of strategy, instrumentation and performance
Authors:
F. Matichard,
B. Lantz,
R. Mittleman,
K. Mason,
J. Kissel,
J. McIver,
B. Abbott,
R. Abbott,
S. Abbott,
E. Allwine,
S. Barnum,
J. Birch,
S. Biscans,
C. Celerier,
D. Clark,
D. Coyne,
D. DeBra,
R. DeRosa,
M. Evans,
S. Foley,
P. Fritschel,
J. A. Giaime,
C. Gray,
G. Grabeel,
J. Hanson
, et al. (27 additional authors not shown)
Abstract:
Isolating ground-based interferometric gravitational wave observatories from environmental disturbances is one of the great challenges of the advanced detector era. In order to directly observe gravitational waves, the detector components and test masses must be highly inertially decoupled from the ground motion not only to sense the faint strain of space-time induced by gravitational waves, but a…
▽ More
Isolating ground-based interferometric gravitational wave observatories from environmental disturbances is one of the great challenges of the advanced detector era. In order to directly observe gravitational waves, the detector components and test masses must be highly inertially decoupled from the ground motion not only to sense the faint strain of space-time induced by gravitational waves, but also to maintain the resonance of the very sensitive 4 km interferometers.
This article presents the seismic isolation instrumentation and strategy developed for Advanced LIGO interferometers. It reviews over a decade of research on active isolation in the context of gravitational wave detection, and presents the performance recently achieved with the Advanced LIGO observatory. Lastly, it discusses prospects for future developments in active seismic isolation and the anticipated benefits to astrophysical gravitational wave searches.
Beyond gravitational wave research, the goal of this article is to provide detailed isolation strategy guidelines for sensitive ground-based physics experiments that may benefit from similar levels of inertial isolation.
△ Less
Submitted 19 January, 2016; v1 submitted 22 February, 2015;
originally announced February 2015.
-
Advanced LIGO Two-Stage Twelve-Axis Vibration Isolation and Positioning Platform. Part 1: Design and Production Overview
Authors:
Fabrice Matichard,
Brian Lantz,
Kenneth Mason,
Richard Mittleman,
Benjamin Abbott,
Samuel Abbott,
Eric Allwine,
Samuel Barnum,
Jeremy Birch,
Sebastien Biscans,
Daniel Clark,
Dennis Coyne,
Dan DeBra,
Ryan DeRosa,
Stephany Foley,
Peter Fritschel,
Joseph A Giaime,
Corey Gray,
Gregory Grabeel,
Joe Hanson,
Michael Hillard,
Jeffrey Kissel,
Christopher Kucharczyk,
Adrien Le Roux,
Vincent Lhuillier
, et al. (15 additional authors not shown)
Abstract:
New generations of gravity wave detectors require unprecedented levels of vibration isolation. This paper presents the final design of the vibration isolation and positioning platform used in Advanced LIGO to support the interferometers core optics. This five-ton two-and-half-meter wide system operates in ultra-high vacuum. It features two stages of isolation mounted in series. The stages are imbr…
▽ More
New generations of gravity wave detectors require unprecedented levels of vibration isolation. This paper presents the final design of the vibration isolation and positioning platform used in Advanced LIGO to support the interferometers core optics. This five-ton two-and-half-meter wide system operates in ultra-high vacuum. It features two stages of isolation mounted in series. The stages are imbricated to reduce the overall height. Each stage provides isolation in all directions of translation and rotation. The system is instrumented with a unique combination of low noise relative and inertial sensors. The active control provides isolation from 0.1 Hz to 30 Hz. It brings the platform motion down to 10^(-11) m/Hz^(0.5) at 1 Hz. Active and passive isolation combine to bring the platform motion below 10^(-12) m/Hz^(0.5) at 10 Hz. The passive isolation lowers the motion below 10^(-13) m/Hz^(0.5) at 100 Hz. The paper describes how the platform has been engineered not only to meet the isolation requirements, but also to permit the construction, testing, and commissioning process of the fifteen units needed for Advanced LIGO observatories.
△ Less
Submitted 23 July, 2014;
originally announced July 2014.
-
Advanced LIGO Two-Stage Twelve-Axis Vibration Isolation and Positioning Platform. Part 2: Experimental Investigation and Tests Results
Authors:
Fabrice Matichard,
Brian Lantz,
Kenneth Mason,
Richard Mittleman,
Benjamin Abbott,
Samuel Abbott,
Eric Allwine,
Samuel Barnum,
Jeremy Birch,
Sebastien Biscans,
Daniel Clark,
Dennis Coyne,
Dan DeBra,
Ryan DeRosa,
Stephany Foley,
Peter Fritschel,
Joseph A Giaime,
Corey Gray,
Gregory Grabeel,
Joe Hanson,
Michael Hillard,
Jeffrey Kissel,
Christopher Kucharczyk,
Adrien Le Roux,
Vincent Lhuillier
, et al. (15 additional authors not shown)
Abstract:
This paper presents the results of the past seven years of experimental investigation and testing done on the two-stage twelve-axis vibration isolation platform for Advanced LIGO gravity waves observatories. This five-ton two-and-half-meter wide system supports more than a 1000 kg of very sensitive equipment. It provides positioning capability and seismic isolation in all directions of translation…
▽ More
This paper presents the results of the past seven years of experimental investigation and testing done on the two-stage twelve-axis vibration isolation platform for Advanced LIGO gravity waves observatories. This five-ton two-and-half-meter wide system supports more than a 1000 kg of very sensitive equipment. It provides positioning capability and seismic isolation in all directions of translation and rotation. To meet the very stringent requirements of Advanced LIGO, the system must provide more than three orders of magnitude of isolation over a very large bandwidth. It must bring the motion below 10^(-11) m/(Hz)^0.5 at 1 Hz and 10^(-12) m/(Hz)^0.5 at 10 Hz. A prototype of this system has been built in 2006. It has been extensively tested and analyzed during the following two years. This paper shows how the experimental results obtained with the prototype were used to engineer the final design. It highlights how the engineering solutions implemented not only improved the isolation performance but also greatly simplified the assembly, testing, and commissioning process. During the past two years, five units have been constructed, tested, installed and commissioned at each of the two LIGO observatories. Five other units are being built for an upcoming third observatory. The test results presented show that the system meets the motion requirements, and reach the sensor noise in the control bandwidth.
△ Less
Submitted 23 July, 2014;
originally announced July 2014.
-
The Plasma Simulation Code: A modern particle-in-cell code with load-balancing and GPU support
Authors:
Kai Germaschewski,
William Fox,
Stephen Abbott,
Narges Ahmadi,
Kristofor Maynard,
Liang Wang,
Hartmut Ruhl,
Amitava Bhattacharjee
Abstract:
Recent increases in supercomputing power, driven by the multi-core revolution and accelerators such as the IBM Cell processor, graphics processing units (GPUs) and Intel's Many Integrated Core (MIC) technology have enabled kinetic simulations of plasmas at unprecedented resolutions, but changing HPC architectures also come with challenges for writing efficient numerical codes. This paper describes…
▽ More
Recent increases in supercomputing power, driven by the multi-core revolution and accelerators such as the IBM Cell processor, graphics processing units (GPUs) and Intel's Many Integrated Core (MIC) technology have enabled kinetic simulations of plasmas at unprecedented resolutions, but changing HPC architectures also come with challenges for writing efficient numerical codes. This paper describes the Plasma Simulation Code (PSC), an explicit, electromagnetic particle-in-cell code with support for different order particle shape functions. We focus on two distinguishing feature of the code: patch-based load balancing using space-filling curves, and support for Nvidia GPUs, which achieves substantial speed-up of up to more than 6x on the Cray XK7 architecture compared to a CPU-only implementation.
△ Less
Submitted 12 November, 2015; v1 submitted 29 October, 2013;
originally announced October 2013.
-
Control System Design for the LIGO Pre-stabilized Laser
Authors:
R. Abbott,
P. King
Abstract:
To meet the strain sensitivity requirements [1], [2] of the Laser Interferometer Gravitational Wave Observatory (LIGO), the laser frequency and amplitude noise must initially be reduced by a factor of 1000 in the pre-stabilized portion of the interferometer [3]. A control system was implemented to provide laser noise suppression, data acquisition interfaces, diagnostics, and operator control inp…
▽ More
To meet the strain sensitivity requirements [1], [2] of the Laser Interferometer Gravitational Wave Observatory (LIGO), the laser frequency and amplitude noise must initially be reduced by a factor of 1000 in the pre-stabilized portion of the interferometer [3]. A control system was implemented to provide laser noise suppression, data acquisition interfaces, diagnostics, and operator control inputs. This paper describes the VME-based analog and digital controls used in the LIGO Pre-stabilized Laser (PSL).
△ Less
Submitted 20 November, 2001;
originally announced November 2001.
