-
Phi-3 Safety Post-Training: Aligning Language Models with a "Break-Fix" Cycle
Authors:
Emman Haider,
Daniel Perez-Becker,
Thomas Portet,
Piyush Madan,
Amit Garg,
Atabak Ashfaq,
David Majercak,
Wen Wen,
Dongwoo Kim,
Ziyi Yang,
Jianwen Zhang,
Hiteshi Sharma,
Blake Bullwinkel,
Martin Pouliot,
Amanda Minnich,
Shiven Chawla,
Solianna Herrera,
Shahed Warreth,
Maggie Engler,
Gary Lopez,
Nina Chikanov,
Raja Sekhar Rao Dheekonda,
Bolor-Erdene Jagdagdorj,
Roman Lutz,
Richard Lundeen
, et al. (6 additional authors not shown)
Abstract:
Recent innovations in language model training have demonstrated that it is possible to create highly performant models that are small enough to run on a smartphone. As these models are deployed in an increasing number of domains, it is critical to ensure that they are aligned with human preferences and safety considerations. In this report, we present our methodology for safety aligning the Phi-3…
▽ More
Recent innovations in language model training have demonstrated that it is possible to create highly performant models that are small enough to run on a smartphone. As these models are deployed in an increasing number of domains, it is critical to ensure that they are aligned with human preferences and safety considerations. In this report, we present our methodology for safety aligning the Phi-3 series of language models. We utilized a "break-fix" cycle, performing multiple rounds of dataset curation, safety post-training, benchmarking, red teaming, and vulnerability identification to cover a variety of harm areas in both single and multi-turn scenarios. Our results indicate that this approach iteratively improved the performance of the Phi-3 models across a wide range of responsible AI benchmarks. Finally, we include additional red teaming strategies and evaluations that were used to test the safety behavior of Phi-3.5-mini and Phi-3.5-MoE, which were optimized for multilingual capabilities.
△ Less
Submitted 22 August, 2024; v1 submitted 18 July, 2024;
originally announced July 2024.
-
$τ$SPECT: A spin-flip loaded magnetic ultracold neutron trap for a determination of the neutron lifetime
Authors:
J. Auler,
M. Engler,
K. Franz,
J. Kahlenberg,
J. Karch,
N. Pfeifer,
K. Roß,
C. -F. Strid,
N. Yazdandoost,
E. Adamek,
S. Kaufmann,
Ch. Schmidt,
P. Blümler,
M. Fertl,
W. Heil,
D. Ries
Abstract:
The confinement of ultracold neutrons (UCNs) in a three dimensional magnetic field gradient trap allows for a measurement of the free neutron lifetime with superior control over spurious loss channels and can provide a large kinetic energy acceptance to enhance statistical sensitivity. In this paper, we present the first successful implementation of a pulsed spin-flip based loading scheme for a th…
▽ More
The confinement of ultracold neutrons (UCNs) in a three dimensional magnetic field gradient trap allows for a measurement of the free neutron lifetime with superior control over spurious loss channels and can provide a large kinetic energy acceptance to enhance statistical sensitivity. In this paper, we present the first successful implementation of a pulsed spin-flip based loading scheme for a three-dimensional magnetic UCN trap. The measurements with the $τ$SPECT experiment were performed at the pulsed UCN source of the research reactor TRIGA Mainz. We report on detailed investigations of major systematic effects influencing the neutron storage time, statistically limited by the size of the recorded data set. The extracted neutron storage time constant of $τ= 859(16)\mathrm{s}$ is compatible with, but not to be interpreted as, a measurement of the free neutron lifetime.
△ Less
Submitted 22 August, 2024; v1 submitted 25 October, 2023;
originally announced November 2023.
-
A neutron trigger detector for pulsed reactor neutron sources
Authors:
Julian Auler,
Dieter Ries,
Bernd Ulmann,
Evan Adamek,
Martin Engler,
Martin Fertl,
Konrad Franz,
Werner Heil,
Simon Kaufmann,
Niklas Pfeifer,
Kim Roß,
Alexandra Tsvetkov,
Noah Yazdandoost
Abstract:
A variety of experiments investigating properties of neutrons can be performed at pulsed reactor neutron sources like the research reactor TRIGA Mainz. A typical problem faced by these experiments is the non-availability of a reliable facility-provided trigger signal in coincidence with the neutron production. Here we present the design and implementation of a neutron pulse detector that provides…
▽ More
A variety of experiments investigating properties of neutrons can be performed at pulsed reactor neutron sources like the research reactor TRIGA Mainz. A typical problem faced by these experiments is the non-availability of a reliable facility-provided trigger signal in coincidence with the neutron production. Here we present the design and implementation of a neutron pulse detector that provides a coincident trigger signal for experimental timing with a relative precision of 4.5 ms.
△ Less
Submitted 17 April, 2024; v1 submitted 16 August, 2023;
originally announced August 2023.
-
An intermediate morphology in the patterning of the crystalline Ge(001) surface induced by ion irradiation
Authors:
Denise J. Erb,
Daniel A. Pearson,
Tomáš Škereň,
Martin Engler,
R. Mark Bradley,
Stefan Facsko
Abstract:
We investigate the morphologies of the Ge(001) surface that are produced by bombardment with a normally incident, broad argon ion beam at sample temperatures above the recrystallization temperature. Two previously-observed kinds of topographies are seen, i.e., patterns consisting of upright and inverted rectangular pyramids, as well as patterns composed of shallow, isotropic basins. In addition, w…
▽ More
We investigate the morphologies of the Ge(001) surface that are produced by bombardment with a normally incident, broad argon ion beam at sample temperatures above the recrystallization temperature. Two previously-observed kinds of topographies are seen, i.e., patterns consisting of upright and inverted rectangular pyramids, as well as patterns composed of shallow, isotropic basins. In addition, we observe the formation of an unexpected third type of pattern for intermediate values of the temperature, ion energy and ion flux. In this type of intermediate morphology, isolated peaks with rectangular cross sections stand above a landscape of shallow, rounded basins. We also extend past theoretical work to include a second order correction term that comes from the curvature dependence of the sputter yield. For a range of parameter values, the resulting continuum model of the surface dynamics produces patterns that are remarkably similar to the intermediate morphologies we observe in our experiments. The formation of the isolated peaks is the result of a term that is not ordinarily included in the equation of motion, a second order correction to the curvature dependence of the sputter yield.
△ Less
Submitted 15 December, 2023; v1 submitted 13 April, 2023;
originally announced April 2023.
-
Optimization of nuclear polarization in an alkali-noble gas comagnetometer
Authors:
Emmanuel Klinger,
Tianhao Liu,
Mikhail Padniuk,
Martin Engler,
Thomas Kornack,
Szymon Pustelny,
Derek F. Jackson Kimball,
Dmitry Budker,
Arne Wickenbrock
Abstract:
Self-compensated comagnetometers, employing overlapping samples of spin-polarized alkali and noble gases (for example K-$^3$He) are promising sensors for exotic beyond-the-standard-model fields and high-precision metrology such as rotation sensing. When the comagnetometer operates in the so-called self-compensated regime, the effective field, originating from contact interactions between the alkal…
▽ More
Self-compensated comagnetometers, employing overlapping samples of spin-polarized alkali and noble gases (for example K-$^3$He) are promising sensors for exotic beyond-the-standard-model fields and high-precision metrology such as rotation sensing. When the comagnetometer operates in the so-called self-compensated regime, the effective field, originating from contact interactions between the alkali valence electrons and the noble-gas nuclei, is compensated with an applied magnetic field. When the comagnetometer begins operation in a given magnetic field, spin-exchange optical pumping establishes equilibrium between the alkali electron-spin polarization and the nuclear-spin polarization. Subsequently, when the magnetic field is tuned to the compensation point, the spin polarization is brought out of the equilibrium conditions. This causes a practical issue for long measurement times. We report on a novel method for closed-loop control of the compensation field. This method allows optimization of the operating parameters, especially magnetic field gradients, in spite of the inherently slow (hours to days) dynamics of the system. With the optimization, higher stable nuclear polarization, longer relaxation times and stronger electron-nuclear coupling are achieved which is useful for nuclear-spin-based quantum memory, spin amplifiers and gyroscopes. The optimized sensor demonstrates a sensitivity comparable to the best previous comagnetometer but with four times lower noble gas density. This paves the way for applications in both fundamental and applied science.
△ Less
Submitted 23 August, 2023; v1 submitted 14 October, 2022;
originally announced October 2022.
-
Search for axion-like dark matter using solid-state nuclear magnetic resonance
Authors:
Deniz Aybas,
Janos Adam,
Emmy Blumenthal,
Alexander V. Gramolin,
Dorian Johnson,
Annalies Kleyheeg,
Samer Afach,
John W. Blanchard,
Gary P. Centers,
Antoine Garcon,
Martin Engler,
Nataniel L. Figueroa,
Marina Gil Sendra,
Arne Wickenbrock,
Matthew Lawson,
Tao Wang,
Teng Wu,
Haosu Luo,
Hamdi Mani,
Philip Mauskopf,
Peter W. Graham,
Surjeet Rajendran,
Derek F. Jackson Kimball,
Dmitry Budker,
Alexander O. Sushkov
Abstract:
We report the results of an experimental search for ultralight axion-like dark matter in the mass range 162 neV to 166 neV. The detection scheme of our Cosmic Axion Spin Precession Experiment (CASPEr) is based on a precision measurement of $^{207}$Pb solid-state nuclear magnetic resonance in a polarized ferroelectric crystal. Axion-like dark matter can exert an oscillating torque on $^{207}$Pb nuc…
▽ More
We report the results of an experimental search for ultralight axion-like dark matter in the mass range 162 neV to 166 neV. The detection scheme of our Cosmic Axion Spin Precession Experiment (CASPEr) is based on a precision measurement of $^{207}$Pb solid-state nuclear magnetic resonance in a polarized ferroelectric crystal. Axion-like dark matter can exert an oscillating torque on $^{207}$Pb nuclear spins via the electric-dipole moment coupling $g_d$, or via the gradient coupling $g_{\text{aNN}}$. We calibrated the detector and characterized the excitation spectrum and relaxation parameters of the nuclear spin ensemble with pulsed magnetic resonance measurements in a 4.4 T magnetic field. We swept the magnetic field near this value and searched for axion-like dark matter with Compton frequency within a 1 MHz band centered at 39.65 MHz. Our measurements place the upper bounds $|g_d|<9.5\times10^{-4}\,\text{GeV}^{-2}$ and $|g_{\text{aNN}}|<2.8\times10^{-1}\,\text{GeV}^{-1}$ (95% confidence level) in this frequency range. The constraint on $g_d$ corresponds to an upper bound of $1.0\times 10^{-21}\,\text{e}\cdot\text{cm}$ on the amplitude of oscillations of the neutron electric dipole moment, and $4.3\times 10^{-6}$ on the amplitude of oscillations of CP-violating $θ$ parameter of quantum chromodynamics. Our results demonstrate the feasibility of using solid-state nuclear magnetic resonance to search for axion-like dark matter in the nano-electronvolt mass range.
△ Less
Submitted 12 March, 2021; v1 submitted 4 January, 2021;
originally announced January 2021.
-
Somatic mutations render human exome and pathogen DNA more similar
Authors:
Ehsan Ebrahimzadeh,
Maggie Engler,
David Tse,
Razvan Cristescu,
Aslan Tchamkerten
Abstract:
Immunotherapy has recently shown important clinical successes in a substantial number of oncology indications. Additionally, the tumor somatic mutation load has been shown to associate with response to these therapeutic agents, and specific mutational signatures are hypothesized to improve this association, including signatures related to pathogen insults. We sought to study in silico the validity…
▽ More
Immunotherapy has recently shown important clinical successes in a substantial number of oncology indications. Additionally, the tumor somatic mutation load has been shown to associate with response to these therapeutic agents, and specific mutational signatures are hypothesized to improve this association, including signatures related to pathogen insults. We sought to study in silico the validity of these observations and how they relate to each other. We first addressed whether somatic mutations typically involved in cancer may increase, in a statistically meaningful manner, the similarity between common pathogens and the human exome. Our study shows that common mutagenic processes increase, in the upper range of biologically plausible frequencies, the similarity between cancer exomes and pathogen DNA at a scale of 12-16 nucleotide sequences and established that this increased similarity is due to the specific mutation distribution of the considered mutagenic processes. Next, we studied the impact of mutation rate and showed that increasing mutation rate generally results in an increased similarity between the cancer exome and pathogen DNA, at a scale of 4-5 amino acids. Finally, we investigated whether the considered mutational processes result in amino-acid changes with functional relevance that are more likely to be immunogenic. We showed that functional tolerance to mutagenic processes across species generally suggests more resilience to mutagenic processes that are due to exposure to elements of nature than to mutagenic processes that are due to exposure to cancer-causing artificial substances. These results support the idea that recognition of pathogen sequences as well as differential functional tolerance to mutagenic processes may play an important role in the immune recognition process involved in tumor infiltration by lymphocytes.
△ Less
Submitted 7 May, 2019;
originally announced May 2019.
-
Overview of the Cosmic Axion Spin Precession Experiment (CASPEr)
Authors:
D. F. Jackson Kimball,
S. Afach,
D. Aybas,
J. W. Blanchard,
D. Budker,
G. Centers,
M. Engler,
N. L. Figueroa,
A. Garcon,
P. W. Graham,
H. Luo,
S. Rajendran,
M. G. Sendra,
A. O. Sushkov,
T. Wang,
A. Wickenbrock,
A. Wilzewski,
T. Wu
Abstract:
An overview of our experimental program to search for axion and axion-like-particle (ALP) dark matter using nuclear magnetic resonance (NMR) techniques is presented. An oscillating axion field can exert a time-varying torque on nuclear spins either directly or via generation of an oscillating nuclear electric dipole moment (EDM). Magnetic resonance techniques can be used to detect such an effect.…
▽ More
An overview of our experimental program to search for axion and axion-like-particle (ALP) dark matter using nuclear magnetic resonance (NMR) techniques is presented. An oscillating axion field can exert a time-varying torque on nuclear spins either directly or via generation of an oscillating nuclear electric dipole moment (EDM). Magnetic resonance techniques can be used to detect such an effect. The first-stage experiments explore many decades of ALP parameter space beyond the current astrophysical and laboratory bounds. It is anticipated that future versions of the experiments will be sensitive to the axions associated with quantum chromodynamics (QCD) having masses $\lesssim 10^{-9}~{\rm eV}/c^2$.
△ Less
Submitted 30 October, 2018; v1 submitted 9 November, 2017;
originally announced November 2017.
-
Nano patterns self-aligned to Ga dimer rows on GaAs surfaces
Authors:
Martin Engler,
Tomáš Škereň,
Stefan Facsko
Abstract:
Ion beam irradiation of semiconductors is a method to produce regular periodic nanoscale patterns self-organized on wafer scale. At low temperatures, the surface of semiconductors is typically amorphized by the ion beam. Above a material dependent dynamic recrystallization temperature however, the surface remains crystalline and ion beam irradiation produces regular arrays of faceted ripples on II…
▽ More
Ion beam irradiation of semiconductors is a method to produce regular periodic nanoscale patterns self-organized on wafer scale. At low temperatures, the surface of semiconductors is typically amorphized by the ion beam. Above a material dependent dynamic recrystallization temperature however, the surface remains crystalline and ion beam irradiation produces regular arrays of faceted ripples on III-V semiconductors. This provides a powerful single-step technique for the production of nanostructures on a large area. On $(001)$ surfaces these ripples are parallel to the $[1\bar{1}0]$ direction without any external anisotropy. The origin of this self-alignment was not fully understood until now. A simple experiment exposing the front side and back side of a GaAs$(001)$ wafer to the ion beam clarifies its origin and proves that the ripples align to the Ga dimer rows. As the direction of Ga dimer rows rotates by 90° on the back side, the orientation of the ripples also rotates by 90° to $[110]$. We discuss the experimental results in view of a model where the pattern formation is driven by creation of vacancies and ad-atoms by the ion beam and their diffusion, which is linked to the direction of dimers on the surface.
△ Less
Submitted 21 November, 2016;
originally announced November 2016.
-
Strong anisotropy in surface kinetic roughening: analysis and experiments
Authors:
Edoardo Vivo,
Matteo Nicoli,
Martin Engler,
Thomas Michely,
Luis Vázquez,
Rodolfo Cuerno
Abstract:
We report an experimental assessment of surface kinetic roughening properties that are anisotropic in space. Working for two specific instances of silicon surfaces irradiated by ion-beam sputtering under diverse conditions (with and without concurrent metallic impurity codeposition), we verify the predictions and consistency of a recently proposed scaling Ansatz for surface observables like the tw…
▽ More
We report an experimental assessment of surface kinetic roughening properties that are anisotropic in space. Working for two specific instances of silicon surfaces irradiated by ion-beam sputtering under diverse conditions (with and without concurrent metallic impurity codeposition), we verify the predictions and consistency of a recently proposed scaling Ansatz for surface observables like the two-dimensional (2D) height Power Spectral Density (PSD). In contrast with other formulations, this Ansatz is naturally tailored to the study of two-dimensional surfaces, and allows to readily explore the implications of anisotropic scaling for other observables, such as real-space correlation functions and PSD functions for 1D profiles of the surface. Our results confirm that there are indeed actual experimental systems whose kinetic roughening is strongly anisotropic, as consistently described by this scaling analysis. In the light of our work, some types of experimental measurements are seen to be more affected by issues like finite space resolution effects, etc. that may hinder a clear-cut assessment of strongly anisotropic scaling in the present and other practical contexts.
△ Less
Submitted 20 December, 2012; v1 submitted 10 September, 2012;
originally announced September 2012.