-
Confident Object Detection via Conformal Prediction and Conformal Risk Control: an Application to Railway Signaling
Authors:
Léo Andéol,
Thomas Fel,
Florence De Grancey,
Luca Mossina
Abstract:
Deploying deep learning models in real-world certified systems requires the ability to provide confidence estimates that accurately reflect their uncertainty. In this paper, we demonstrate the use of the conformal prediction framework to construct reliable and trustworthy predictors for detecting railway signals. Our approach is based on a novel dataset that includes images taken from the perspect…
▽ More
Deploying deep learning models in real-world certified systems requires the ability to provide confidence estimates that accurately reflect their uncertainty. In this paper, we demonstrate the use of the conformal prediction framework to construct reliable and trustworthy predictors for detecting railway signals. Our approach is based on a novel dataset that includes images taken from the perspective of a train operator and state-of-the-art object detectors. We test several conformal approaches and introduce a new method based on conformal risk control. Our findings demonstrate the potential of the conformal prediction framework to evaluate model performance and provide practical guidance for achieving formally guaranteed uncertainty bounds.
△ Less
Submitted 17 April, 2023; v1 submitted 12 April, 2023;
originally announced April 2023.
-
Conformal Prediction for Trustworthy Detection of Railway Signals
Authors:
Léo Andéol,
Thomas Fel,
Florence De Grancey,
Luca Mossina
Abstract:
We present an application of conformal prediction, a form of uncertainty quantification with guarantees, to the detection of railway signals. State-of-the-art architectures are tested and the most promising one undergoes the process of conformalization, where a correction is applied to the predicted bounding boxes (i.e. to their height and width) such that they comply with a predefined probability…
▽ More
We present an application of conformal prediction, a form of uncertainty quantification with guarantees, to the detection of railway signals. State-of-the-art architectures are tested and the most promising one undergoes the process of conformalization, where a correction is applied to the predicted bounding boxes (i.e. to their height and width) such that they comply with a predefined probability of success. We work with a novel exploratory dataset of images taken from the perspective of a train operator, as a first step to build and validate future trustworthy machine learning models for the detection of railway signals.
△ Less
Submitted 26 January, 2023;
originally announced January 2023.
-
White Paper Machine Learning in Certified Systems
Authors:
Hervé Delseny,
Christophe Gabreau,
Adrien Gauffriau,
Bernard Beaudouin,
Ludovic Ponsolle,
Lucian Alecu,
Hugues Bonnin,
Brice Beltran,
Didier Duchel,
Jean-Brice Ginestet,
Alexandre Hervieu,
Ghilaine Martinez,
Sylvain Pasquet,
Kevin Delmas,
Claire Pagetti,
Jean-Marc Gabriel,
Camille Chapdelaine,
Sylvaine Picard,
Mathieu Damour,
Cyril Cappi,
Laurent Gardès,
Florence De Grancey,
Eric Jenn,
Baptiste Lefevre,
Gregory Flandin
, et al. (3 additional authors not shown)
Abstract:
Machine Learning (ML) seems to be one of the most promising solution to automate partially or completely some of the complex tasks currently realized by humans, such as driving vehicles, recognizing voice, etc. It is also an opportunity to implement and embed new capabilities out of the reach of classical implementation techniques. However, ML techniques introduce new potential risks. Therefore, t…
▽ More
Machine Learning (ML) seems to be one of the most promising solution to automate partially or completely some of the complex tasks currently realized by humans, such as driving vehicles, recognizing voice, etc. It is also an opportunity to implement and embed new capabilities out of the reach of classical implementation techniques. However, ML techniques introduce new potential risks. Therefore, they have only been applied in systems where their benefits are considered worth the increase of risk. In practice, ML techniques raise multiple challenges that could prevent their use in systems submitted to certification constraints. But what are the actual challenges? Can they be overcome by selecting appropriate ML techniques, or by adopting new engineering or certification practices? These are some of the questions addressed by the ML Certification 3 Workgroup (WG) set-up by the Institut de Recherche Technologique Saint Exupéry de Toulouse (IRT), as part of the DEEL Project.
△ Less
Submitted 18 March, 2021;
originally announced March 2021.
-
Probing nuclear forces beyond the nuclear drip line: The cases of $^{16}$F and $^{15}$F
Authors:
V. Girard-Alcindor,
I. Stefan,
F. de Oliveira Santos,
O. Sorlin,
D. Ackermann,
P. Adsley,
J. C. Angelique,
M. Assie,
M. Assuncao,
D. Beaumel,
E. Berthoumieux,
R. Borcea,
L. Caceres,
I. Celikovic,
M. Ciemala,
V. Chudoba,
G. D Agata,
F. de Grancey,
G. Dumitru,
F. Flavigny,
C. Fougeres,
S. Franchoo,
A. Georgiadou,
S. Grevy,
J. Guillot
, et al. (31 additional authors not shown)
Abstract:
The unbound proton-rich nuclei $^{16}$F and $^{15}$F are investigated experimentally and theoretically. Several experiments using the resonant elastic scattering method were performed at GANIL with radioactive beams to determine the properties of the low lying states of these nuclei. Strong asymmetry between $^{16}$F-$^{16}$N and $^{15}$F-$^{15}$C mirror nuclei is observed. The strength of the…
▽ More
The unbound proton-rich nuclei $^{16}$F and $^{15}$F are investigated experimentally and theoretically. Several experiments using the resonant elastic scattering method were performed at GANIL with radioactive beams to determine the properties of the low lying states of these nuclei. Strong asymmetry between $^{16}$F-$^{16}$N and $^{15}$F-$^{15}$C mirror nuclei is observed. The strength of the $nucleon-nucleon$ effective interaction involving the loosely bound proton in the $s_{1/2}$ orbit is significantly modified with respect to their mirror nuclei $^{16}$N and $^{15}$C. The reduction of the effective interaction is estimated by calculating the interaction energies with a schematic zero-range force. It is found that, after correcting for the effects due to changes in the radial distribution of the single-particle wave functions, the mirror symmetry of the $n-p$ interaction is preserved between $^{16}$F and $^{16}$N, while a difference of 63\% is measured between the $p-p$ versus $n-n$ interactions in the second excited state of $^{15}$F and $^{15}$C nuclei. Several explanations are proposed.
△ Less
Submitted 6 January, 2021;
originally announced January 2021.
-
An above-barrier narrow resonance in $^{15}$F
Authors:
F. De Grancey,
A. Mercenne,
F. de Oliveira Santos,
T. Davinson,
O. Sorlin,
J. C. Angélique,
M. Assié,
E. Berthoumieux,
R. Borcea,
A. Buta,
I. Celikovic,
V. Chudoba,
J. M. Daugas,
G. Dumitru,
M. Fadil,
S. Grévy,
J. Kiener,
A. Lefebvre-Schuhl,
N. Michel,
J. Mrazek,
F. Negoita,
J. Okolowicz,
D. Pantelica,
M. G. Pellegriti,
L. Perrot
, et al. (15 additional authors not shown)
Abstract:
Intense and purified radioactive beam of post-accelerated $^{14}$O was used to study the low-lying states in the unbound $^{15}$F nucleus. Exploiting resonant elastic scattering in inverse kinematics with a thick target, the second excited state, a resonance at E$\_R$=4.757(6)(10)~MeV with a width of $Γ$=36(5)(14)~keV was measured for the first time with high precision. The structure of this narro…
▽ More
Intense and purified radioactive beam of post-accelerated $^{14}$O was used to study the low-lying states in the unbound $^{15}$F nucleus. Exploiting resonant elastic scattering in inverse kinematics with a thick target, the second excited state, a resonance at E$\_R$=4.757(6)(10)~MeV with a width of $Γ$=36(5)(14)~keV was measured for the first time with high precision. The structure of this narrow above-barrier state in a nucleus located two neutrons beyond the proton drip line was investigated using the Gamow Shell Model in the coupled channel representation with a $^{12}$C core and three valence protons. It is found that it is an almost pure wave function of two quasi-bound protons in the $2s\_{1/2}$ shell.
△ Less
Submitted 1 March, 2016;
originally announced March 2016.
-
Probing Nuclear forces beyond the drip-line using the mirror nuclei $^{16}$N and $^{16}$F
Authors:
I. Stefan,
F. de Oliveira Santos,
O. Sorlin,
T. Davinson,
M. Lewitowicz,
G. Dumitru,
J. C. Angélique,
M. Angélique,
E. Berthoumieux,
C. Borcea,
R. Borcea,
A. Buta,
J. M. Daugas,
F. De Grancey,
M. Fadil,
S. Grévy,
J. Kiener,
A. Lefebvre-Schuhl,
M. Lenhardt,
J. Mrazek,
F. Negoita,
D. Pantelica,
M. G. Pellegriti,
L. Perrot,
M. Ploszajczak
, et al. (7 additional authors not shown)
Abstract:
Radioactive beams of $^{14}$O and $^{15}$O were used to populate the resonant states 1/2$^+$, 5/2$^+$ and $0^-,1^-,2^-$ in the unbound $^{15}$F and $^{16}$F nuclei respectively by means of proton elastic scattering reactions in inverse kinematics. Based on their large proton spectroscopic factor values, the resonant states in $^{16}$F can be viewed as a core of $^{14}$O plus a proton in the 2s…
▽ More
Radioactive beams of $^{14}$O and $^{15}$O were used to populate the resonant states 1/2$^+$, 5/2$^+$ and $0^-,1^-,2^-$ in the unbound $^{15}$F and $^{16}$F nuclei respectively by means of proton elastic scattering reactions in inverse kinematics. Based on their large proton spectroscopic factor values, the resonant states in $^{16}$F can be viewed as a core of $^{14}$O plus a proton in the 2s$_{1/2}$ or 1d$_{5/2}$ shell and a neutron in 1p$_{1/2}$. Experimental energies were used to derive the strength of the 2s$_{1/2}$-1p$_{1/2}$ and 1d$_{5/2}$-1p$_{1/2}$ proton-neutron interactions. It is found that the former changes by 40% compared with the mirror nucleus $^{16}$N, and the second by 10%. This apparent symmetry breaking of the nuclear force between mirror nuclei finds explanation in the role of the large coupling to the continuum for the states built on an $\ell=0$ proton configuration.
△ Less
Submitted 13 June, 2014;
originally announced June 2014.
-
Spectroscopy of $^{18}$Na: Bridging the two-proton radioactivity of $^{19}$Mg
Authors:
M. Assié,
F. de Oliveira Santos,
T. Davinson,
F. de Grancey,
L. Achouri,
J. Alcántara-Núñez,
T. Al Kalanee,
J. -C. Angélique,
C. Borcea,
R. Borcea,
L. Caceres,
I. Celikovic,
V. Chudoba,
D. Y. Pang,
C. Ducoin,
M. Fallot,
O. Kamalou,
J. Kiener,
Y. Lam,
A. Lefebvre-Schuhl,
G. Lotay,
J. Mrazek,
L. Perrot,
A. M. Sánchez-Benítez,
F. Rotaru
, et al. (9 additional authors not shown)
Abstract:
The unbound nucleus $^{18}$Na, the intermediate nucleus in the two-proton radioactivity of $^{19}$Mg, was studied by the measurement of the resonant elastic scattering reaction $^{17}$Ne(p,$^{17}$Ne)p performed at 4 A.MeV. Spectroscopic properties of the low-lying states were obtained in a R-matrix analysis of the excitation function. Using these new results, we show that the lifetime of the…
▽ More
The unbound nucleus $^{18}$Na, the intermediate nucleus in the two-proton radioactivity of $^{19}$Mg, was studied by the measurement of the resonant elastic scattering reaction $^{17}$Ne(p,$^{17}$Ne)p performed at 4 A.MeV. Spectroscopic properties of the low-lying states were obtained in a R-matrix analysis of the excitation function. Using these new results, we show that the lifetime of the $^{19}$Mg radioactivity can be understood assuming a sequential emission of two protons via low energy tails of $^{18}$Na resonances.
△ Less
Submitted 6 October, 2011;
originally announced October 2011.
-
Measurements of nuclear $γ$-ray line emission in interactions of protons and $α$ particles with N, O, Ne and Si
Authors:
H. Benhabiles-Mezhoud,
J. Kiener,
J. -P. Thibaud,
V. Tatischeff,
I. Deloncle,
A. Coc,
J. Duprat,
C. Hamadache,
A. Lefebvre-Schuhl,
J. -C. Dalouzy,
F. De Grancey,
F. De Oliveira,
F. Dayras,
N. De Séréville,
M. -G. Pellegriti,
L. Lamia,
S. Ouichaoui
Abstract:
$γ$-ray production cross sections have been measured in proton irradiations of N, Ne and Si and $α$-particle irradiations of N and Ne. In the same experiment we extracted also line shapes for strong $γ$-ray lines of $^{16}$O produced in proton and $α…
▽ More
$γ$-ray production cross sections have been measured in proton irradiations of N, Ne and Si and $α$-particle irradiations of N and Ne. In the same experiment we extracted also line shapes for strong $γ$-ray lines of $^{16}$O produced in proton and $α$-particle irradiations of O. For the measurements gas targets were used for N, O and Ne and a thick foil was used for Si. All targets were of natural isotopic composition. Beams in the energy range up to 26 MeV for protons and 39 MeV for $α$-particles have been delivered by the IPN-Orsay tandem accelerator. The $γ$ rays have been detected with four HP-Ge detectors in the angular range 30$^{\circ}$ to 135$^{\circ}$. We extracted 36 cross section excitation functions for proton reactions and 14 for $α$-particle reactions. For the majority of the excitation functions no other data exist to our knowledge. Where comparison with existing data was possible usually a very good agreement was found. It is shown that these data are very interesting for constraining nuclear reaction models. In particular the agreement of cross section calculations in the nuclear reaction code TALYS with the measured data could be improved by adjusting the coupling schemes of collective levels in the target nuclei $^{14}$N, $^{20,22}$Ne and $^{28}$Si. The importance of these results for the modeling of nuclear $γ$-ray line emission in astrophysical sites is discussed.
△ Less
Submitted 11 November, 2010;
originally announced November 2010.
