-
Integration of Data Reduction and Near Real-Time Archiving into the Keck Observing Model
Authors:
Max Brodheim,
John O'Meara,
Jeffrey A. Mader,
G. Bruce Berriman,
Matthew Brown,
Lucas Furhman,
Tyler Tucker,
Christopher R. Gelino,
Meca S. Lynn,
Melanie A. Swain
Abstract:
The W. M. Keck Observatory is welcoming a new era where data reduction and archiving are tightly integrated into our observing model, under the auspices of the Observatory's Data Services Initiative (DSI) project. While previously the Keck Observatory Archive (KOA) archived minimally processed, raw science data the day after observing, Keck is transitioning to a model in which it archives both raw…
▽ More
The W. M. Keck Observatory is welcoming a new era where data reduction and archiving are tightly integrated into our observing model, under the auspices of the Observatory's Data Services Initiative (DSI) project. While previously the Keck Observatory Archive (KOA) archived minimally processed, raw science data the day after observing, Keck is transitioning to a model in which it archives both raw frames and reduced data in near real-time. These data will be made available to observers and collaborators immediately upon ingestion through a dedicated new interface that will support collaboration and sharing among teams, as well as stream data directly to personal computers without access to WMKO's internal networks. Both the raw and science-ready data products will be made publicly available upon the expiration of data protections.
△ Less
Submitted 6 June, 2024;
originally announced June 2024.
-
The Observers' Data Access Portal at the Keck Observatory Archive
Authors:
T. Oluyide,
M. S. Lynn,
T. Coda,
G. B. Berriman,
M. Brown,
L. Fuhrman,
C. Gelino,
J. Good,
J. Hayashi,
C. -H. Lee,
J. Mader,
M. A. Swain
Abstract:
For all active instruments, the Keck Observatory Archive (KOA) now ingests raw data from the Keck Telescopes within 1 minute of acquisition, quick-look reduced data within 5 minutes of creation, and science ready reduced data for four instruments as they are created by their automated pipelines. On August 1, 2023, KOA released the Observers Data Access Portal (ODAP), which enables observers at the…
▽ More
For all active instruments, the Keck Observatory Archive (KOA) now ingests raw data from the Keck Telescopes within 1 minute of acquisition, quick-look reduced data within 5 minutes of creation, and science ready reduced data for four instruments as they are created by their automated pipelines. On August 1, 2023, KOA released the Observers Data Access Portal (ODAP), which enables observers at the telescope and their collaborators anywhere in the world to securely monitor and download science, calibration, and quick-look data as they are ingested into the archive. The portal is built using Python Socket IO.WebSockets that ensure metadata appear in the portal as the data themselves are ingested. The portal itself is a dynamic web interface built with React. It enables users to view and customize metadata fields, filter metadata according to data type, and download data as they are ingested or in bulk through wget scripts. Observers have used the ODAP since its release and have provided feedback that will guide future releases.
△ Less
Submitted 6 February, 2024;
originally announced February 2024.
-
3D Imaging of Magnetic Domains in Nd2Fe14B using Scanning Hard X-Ray Nanotomography
Authors:
Srutarshi Banerjee,
Doga Gursoy,
Junjing Deng,
Maik Kahnt,
Matthew Kramer,
Matthew Lynn,
Daniel Haskel,
Joerg Strempfer
Abstract:
Nanoscale structural and electronic heterogeneities are prevalent in condensed matter physics. Investigating these heterogeneities in three dimensions (3D) has become an important task for understanding their material properties. To provide a tool to unravel the connection between nanoscale heterogeneity and macroscopic emergent properties in magnetic materials, scanning transmission X-ray microsc…
▽ More
Nanoscale structural and electronic heterogeneities are prevalent in condensed matter physics. Investigating these heterogeneities in three dimensions (3D) has become an important task for understanding their material properties. To provide a tool to unravel the connection between nanoscale heterogeneity and macroscopic emergent properties in magnetic materials, scanning transmission X-ray microscopy (STXM) is combined with X-ray magnetic circular dichroism (XMCD). A vector tomography algorithm has been developed to reconstruct the full 3D magnetic vector field without any prior assumptions or knowledge. 2D STXM projections of single crystalline \ndfeb\ pillars are recorded for two different sample tilt angles while rotating around the vertical tomographic axis using $120$ nm X-ray beams with left and right circular polarization. Image alignment and iterative registration has been implemented, based on the 2D STXM projections for the two tilts. Dichroic projections obtained from difference images are used for the tomographic reconstruction to obtain the 3D magnetization distribution at the nanoscale.
△ Less
Submitted 21 January, 2024;
originally announced January 2024.
-
Real-time Data Ingestion at the Keck Observatory Archive (KOA)
Authors:
G. Bruce Berriman,
M. Brodheim,
M. Brown,
L. Fuhrman,
C. R. Gelino,
M. Kong,
C. -H. Lee,
M. S. Lynn,
J. Mader,
T. Oluyide,
M. A. Swain,
T. Tucker,
A. Laity,
J. Riley
Abstract:
Since February of this year, KOA began to prepare, transfer, and ingest data as they were acquired in near-real time; in most cases data are available to observers through KOA within one minute of acquisition. Real-time ingestion will be complete for all active instruments by the end of Summer 2022. The observatory is supporting the development of modern Python data reduction pipelines, which when…
▽ More
Since February of this year, KOA began to prepare, transfer, and ingest data as they were acquired in near-real time; in most cases data are available to observers through KOA within one minute of acquisition. Real-time ingestion will be complete for all active instruments by the end of Summer 2022. The observatory is supporting the development of modern Python data reduction pipelines, which when delivered, will automatically create science-ready data sets at the end of each night for ingestion into the archive. This presentation will describe the infrastructure developed to support real-time data ingestion, itself part of a larger initiative at the Observatory to modernize end-to-end operations.
During telescope operations, the software at WMKO is executed automatically when a newly acquired file is recognized through monitoring a keyword-based observatory control system; this system is used at Keck to execute virtually all observatory functions. The monitor uses callbacks built into the control system to begin data preparation of files for transmission to the archive on an individual basis: scheduling scripts or file system related triggers are unnecessary. An HTTP-based system called from the Flask micro-framework enables file transfers between WMKO and NExScI and triggers data ingestion at NExScI. The ingestion system at NEXScI is a compact (4 KLOC), highly fault-tolerant, Python-based system. It uses a shared file system to transfer data from WMKO to NExScI. The ingestion code is instrument agnostic, with instrument parameters read from configuration files. It replaces an unwieldy (50 KLOC) C-based system that had been in use since 2004.
△ Less
Submitted 5 December, 2022;
originally announced December 2022.
-
Multi-modal electron microscopy study on decoherence sources and their stability in Nb based superconducting qubit
Authors:
Jin-Su Oh,
Xiaotian Fang,
Tae-Hoon Kim,
Matt Lynn,
Matt Kramer,
Mehdi Zarea,
James A. Sauls,
A. Romanenko,
S. Posen,
A. Grassellino,
Cameron J. Kopas,
Mark Field,
Jayss Marshall,
Hilal Cansizoglu,
Joshua Y. Mutus,
Matthew Reagor,
Lin Zhou
Abstract:
Niobium is commonly used for superconducting quantum systems as readout resonators, capacitors, and interconnects. The coherence time of the superconducting qubits is mainly limited by microwave dissipation attributed to two-level system defects at interfaces, such as the Nb/Si and Nb/air interface. One way to improve the Nb/air interface quality is by thermal annealing, as shown by extensive stud…
▽ More
Niobium is commonly used for superconducting quantum systems as readout resonators, capacitors, and interconnects. The coherence time of the superconducting qubits is mainly limited by microwave dissipation attributed to two-level system defects at interfaces, such as the Nb/Si and Nb/air interface. One way to improve the Nb/air interface quality is by thermal annealing, as shown by extensive studies in 3D superconducting radio frequency (SRF) cavities. However, it is unclear how the microstructure and chemistry of the interface structures change during heat treatment. To address this knowledge gap, we comprehensively characterized Nb films deposited on Si wafers by physical vapor deposition, including (1) an Nb film from a transmon and (2) an Nb film without any patterning step, using an aberration-corrected transmission electron microscope. Both Nb films exhibit columnar growth with strong [110] textures. There is a double layer between the Nb film and Si substrate, which are amorphous niobium silicides with different Nb and Si concentrations. After in-situ heating of the heterostructure at 360°C inside the microscope, the composition of the double layers at the Nb-Si interface remains almost the same despite different thickness changes. The initial amorphous niobium oxide layer on Nb surface decomposes into face-centered cubic Nb nanograins in the amorphous Nb-O matrix upon heating.
△ Less
Submitted 12 April, 2022;
originally announced April 2022.
-
Axion Dark Matter
Authors:
C. B. Adams,
N. Aggarwal,
A. Agrawal,
R. Balafendiev,
C. Bartram,
M. Baryakhtar,
H. Bekker,
P. Belov,
K. K. Berggren,
A. Berlin,
C. Boutan,
D. Bowring,
D. Budker,
A. Caldwell,
P. Carenza,
G. Carosi,
R. Cervantes,
S. S. Chakrabarty,
S. Chaudhuri,
T. Y. Chen,
S. Cheong,
A. Chou,
R. T. Co,
J. Conrad,
D. Croon
, et al. (130 additional authors not shown)
Abstract:
Axions are well-motivated dark matter candidates with simple cosmological production mechanisms. They were originally introduced to solve the strong CP problem, but also arise in a wide range of extensions to the Standard Model. This Snowmass white paper summarizes axion phenomenology and outlines next-generation laboratory experiments proposed to detect axion dark matter. There are vibrant synerg…
▽ More
Axions are well-motivated dark matter candidates with simple cosmological production mechanisms. They were originally introduced to solve the strong CP problem, but also arise in a wide range of extensions to the Standard Model. This Snowmass white paper summarizes axion phenomenology and outlines next-generation laboratory experiments proposed to detect axion dark matter. There are vibrant synergies with astrophysical searches and advances in instrumentation including quantum-enabled readout, high-Q resonators and cavities and large high-field magnets. This white paper outlines a clear roadmap to discovery, and shows that the US is well-positioned to be at the forefront of the search for axion dark matter in the coming decade.
△ Less
Submitted 29 March, 2023; v1 submitted 28 March, 2022;
originally announced March 2022.
-
A study on Channel Popularity in Twitch
Authors:
Ha Le,
Junming Wu,
Louis Yu,
Melissa Lynn
Abstract:
In the past few decades, there has been an increasing need for Internet users to host real time events online and to share their experiences with live, interactive audiences. Online streaming services like Twitch have attracted millions of users to stream and to spectate. There have been few studies about the prediction of streamers' popularity on Twitch. In this paper, we look at potential factor…
▽ More
In the past few decades, there has been an increasing need for Internet users to host real time events online and to share their experiences with live, interactive audiences. Online streaming services like Twitch have attracted millions of users to stream and to spectate. There have been few studies about the prediction of streamers' popularity on Twitch. In this paper, we look at potential factors that can contribute to the popularity of streamers. Streamer data was collected through consistent tracking using Twitch's API during a 4 weeks period. Each user's streaming information such as the number of current viewers and followers, the genre of the stream etc., were collected. From the results, we found that the frequency of streaming sessions, the types of content and the length of the streams are major factors in determining how much viewers and subscribers streamers can gain during sessions.
△ Less
Submitted 10 November, 2021;
originally announced November 2021.
-
A Constraint Propagation Algorithm for Sums-of-Squares Formulas over the Integers
Authors:
Melissa Lynn
Abstract:
Sums-of-squares formulas over the integers have been studied extensively using their equivalence to consistently signed intercalate matrices. This representation, combined with combinatorial arguments, has been used to produce sums-of-squares formulas and to show that formulas of certain types cannot exist. In this paper, we introduce an algorithm that produces consistently signed intercalate matr…
▽ More
Sums-of-squares formulas over the integers have been studied extensively using their equivalence to consistently signed intercalate matrices. This representation, combined with combinatorial arguments, has been used to produce sums-of-squares formulas and to show that formulas of certain types cannot exist. In this paper, we introduce an algorithm that produces consistently signed intercalate matrices, or proves their nonexistence, extending previous methods beyond what is computationally feasible by hand.
△ Less
Submitted 11 October, 2018;
originally announced October 2018.
-
Sums-of-Squares Formulas over Algebraically Closed Fields
Authors:
Melissa Lynn
Abstract:
In this paper, we consider whether existence of a sums-of-squares formula depends on the base field. We reformulate the question of existence as a question in algebraic geometry. We show that, for large enough p, existence of sums-of-squares formulas over algebraically closed fields is independent of the characteristic. We make the bound on p explicit, and we prove that the existence of a sums-of-…
▽ More
In this paper, we consider whether existence of a sums-of-squares formula depends on the base field. We reformulate the question of existence as a question in algebraic geometry. We show that, for large enough p, existence of sums-of-squares formulas over algebraically closed fields is independent of the characteristic. We make the bound on p explicit, and we prove that the existence of a sums-of-squares formula of fixed type over an algebraically closed field is theoretically (though not practically) computable.
△ Less
Submitted 31 October, 2016; v1 submitted 19 October, 2015;
originally announced October 2015.
-
The NASA Exoplanet Archive: Data and Tools for Exoplanet Research
Authors:
R. L. Akeson,
X. Chen,
D. Ciardi,
M. Crane,
J. Good,
M. Harbut,
E. Jackson,
S. R. Kane,
A. C. Laity,
S. Leifer,
M. Lynn,
D. L. McElroy,
M. Papin,
P. Plavchan,
S. V. Ramirez,
R. Rey,
K. von Braun,
M. Wittman,
M. Abajian,
B. Ali,
C. Beichman,
A. Beekley,
G. B. Berriman,
S. Berukoff,
G. Bryden
, et al. (10 additional authors not shown)
Abstract:
We describe the contents and functionality of the NASA Exoplanet Archive, a database and tool set funded by NASA to support astronomers in the exoplanet community. The current content of the database includes interactive tables containing properties of all published exoplanets, Kepler planet candidates, threshold-crossing events, data validation reports and target stellar parameters, light curves…
▽ More
We describe the contents and functionality of the NASA Exoplanet Archive, a database and tool set funded by NASA to support astronomers in the exoplanet community. The current content of the database includes interactive tables containing properties of all published exoplanets, Kepler planet candidates, threshold-crossing events, data validation reports and target stellar parameters, light curves from the Kepler and CoRoT missions and from several ground-based surveys, and spectra and radial velocity measurements from the literature. Tools provided to work with these data include a transit ephemeris predictor, both for single planets and for observing locations, light curve viewing and normalization utilities, and a periodogram and phased light curve service. The archive can be accessed at http://exoplanetarchive.ipac.caltech.edu.
△ Less
Submitted 10 July, 2013;
originally announced July 2013.
-
The NStED Periodogram Service and Interface for Public CoRoT Data
Authors:
K. von Braun,
M. Abajian,
A. Beekley,
G. B. Berriman,
G. Bryden,
B. Chan,
D. R. Ciardi,
J. Good,
M. Harbut,
S. R. Kane,
A. Laity,
C. Lau,
M. Lynn,
D. McElroy,
P. Plavchan,
M. Regelson,
R. Rey,
S. V. Ramirez,
J. Stauffer,
A. Zhang
Abstract:
As part of the NASA-CNES agreement, the NASA Star and Exoplanet Database (NStED) serves as the official US portal for the public CoRoT data products. NStED is a general purpose archive with the aim of providing support for NASA's planet finding and characterization goals. Consequently, the NASA Exoplanet Science Institute (NExScI) developed, and NStED adapted, a periodogram service for CoRoT data…
▽ More
As part of the NASA-CNES agreement, the NASA Star and Exoplanet Database (NStED) serves as the official US portal for the public CoRoT data products. NStED is a general purpose archive with the aim of providing support for NASA's planet finding and characterization goals. Consequently, the NASA Exoplanet Science Institute (NExScI) developed, and NStED adapted, a periodogram service for CoRoT data to determine periods of variability phenomena and create phased photometric light curves. Through the NStED periodogram interface, the user may choose three different period detection algorithms to use on any photometric time series product, or even upload and analyze their own data. Additionally, the NStED periodogram is remotely accessed by the CoRoT archive as part of its interface. NStED is available at {\bf http://nsted.ipac.caltech.edu}.
△ Less
Submitted 11 July, 2011;
originally announced July 2011.
