-
HSEmotion Team at the 7th ABAW Challenge: Multi-Task Learning and Compound Facial Expression Recognition
Authors:
Andrey V. Savchenko
Abstract:
In this paper, we describe the results of the HSEmotion team in two tasks of the seventh Affective Behavior Analysis in-the-wild (ABAW) competition, namely, multi-task learning for simultaneous prediction of facial expression, valence, arousal, and detection of action units, and compound expression recognition. We propose an efficient pipeline based on frame-level facial feature extractors pre-tra…
▽ More
In this paper, we describe the results of the HSEmotion team in two tasks of the seventh Affective Behavior Analysis in-the-wild (ABAW) competition, namely, multi-task learning for simultaneous prediction of facial expression, valence, arousal, and detection of action units, and compound expression recognition. We propose an efficient pipeline based on frame-level facial feature extractors pre-trained in multi-task settings to estimate valence-arousal and basic facial expressions given a facial photo. We ensure the privacy-awareness of our techniques by using the lightweight architectures of neural networks, such as MT-EmotiDDAMFN, MT-EmotiEffNet, and MT-EmotiMobileFaceNet, that can run even on a mobile device without the need to send facial video to a remote server. It was demonstrated that a significant step in improving the overall accuracy is the smoothing of neural network output scores using Gaussian or box filters. It was experimentally demonstrated that such a simple post-processing of predictions from simple blending of two top visual models improves the F1-score of facial expression recognition up to 7%. At the same time, the mean Concordance Correlation Coefficient (CCC) of valence and arousal is increased by up to 1.25 times compared to each model's frame-level predictions. As a result, our final performance score on the validation set from the multi-task learning challenge is 4.5 times higher than the baseline (1.494 vs 0.32).
△ Less
Submitted 18 July, 2024;
originally announced July 2024.
-
A detailed study of the very-high-energy Crab pulsar emission with the LST-1
Authors:
CTA-LST Project,
:,
K. Abe,
S. Abe,
A. Abhishek,
F. Acero,
A. Aguasca-Cabot,
I. Agudo,
N. Alvarez Crespo,
L. A. Antonelli,
C. Aramo,
A. Arbet-Engels,
C. Arcaro,
M. Artero,
K. Asano,
P. Aubert,
A. Baktash,
A. Bamba,
A. Baquero Larriva,
L. Baroncelli,
U. Barres de Almeida,
J. A. Barrio,
I. Batkovic,
J. Baxter,
J. Becerra González
, et al. (272 additional authors not shown)
Abstract:
Context: There are currently three pulsars firmly detected by imaging atmospheric Cherenkov telescopes (IACTs), two of them reaching TeV energies, challenging models of very-high-energy (VHE) emission in pulsars. More precise observations are needed to better characterize pulsar emission at these energies. The LST-1 is the prototype of the Large-Sized Telescope, that will be part of the Cherenkov…
▽ More
Context: There are currently three pulsars firmly detected by imaging atmospheric Cherenkov telescopes (IACTs), two of them reaching TeV energies, challenging models of very-high-energy (VHE) emission in pulsars. More precise observations are needed to better characterize pulsar emission at these energies. The LST-1 is the prototype of the Large-Sized Telescope, that will be part of the Cherenkov Telescope Array Observatory (CTAO). Its improved performance over previous IACTs makes it well suited for studying pulsars. Aims: To study the Crab pulsar emission with the LST-1, improving and complementing the results from other telescopes. These observations can also be used to characterize the potential of the LST-1 to study other pulsars and detect new ones. Methods: We analyzed a total of $\sim$103 hours of gamma-ray observations of the Crab pulsar conducted with the LST-1 in the period from September 2020 to January 2023. The observations were carried out at zenith angles less than 50 degrees. A new analysis of the Fermi-LAT data was also performed, including $\sim$14 years of observations. Results: The Crab pulsar phaseogram, long-term light-curve, and phase-resolved spectra are reconstructed with the LST-1 from 20 GeV to 450 GeV for P1 and up to 700 GeV for P2. The pulsed emission is detected with a significance of 15.2$σ$. The two characteristic emission peaks of the Crab pulsar are clearly detected (>10$σ$), as well as the so-called bridge emission (5.7$σ$). We find that both peaks are well described by power laws, with spectral indices of $\sim$3.44 and $\sim$3.03 respectively. The joint analysis of Fermi-LAT and LST-1 data shows a good agreement between both instruments in the overlapping energy range. The detailed results obtained in the first observations of the Crab pulsar with LST-1 show the potential that CTAO will have to study this type of sources.
△ Less
Submitted 2 July, 2024;
originally announced July 2024.
-
The Good, the Bad, and the Hulk-like GPT: Analyzing Emotional Decisions of Large Language Models in Cooperation and Bargaining Games
Authors:
Mikhail Mozikov,
Nikita Severin,
Valeria Bodishtianu,
Maria Glushanina,
Mikhail Baklashkin,
Andrey V. Savchenko,
Ilya Makarov
Abstract:
Behavior study experiments are an important part of society modeling and understanding human interactions. In practice, many behavioral experiments encounter challenges related to internal and external validity, reproducibility, and social bias due to the complexity of social interactions and cooperation in human user studies. Recent advances in Large Language Models (LLMs) have provided researche…
▽ More
Behavior study experiments are an important part of society modeling and understanding human interactions. In practice, many behavioral experiments encounter challenges related to internal and external validity, reproducibility, and social bias due to the complexity of social interactions and cooperation in human user studies. Recent advances in Large Language Models (LLMs) have provided researchers with a new promising tool for the simulation of human behavior. However, existing LLM-based simulations operate under the unproven hypothesis that LLM agents behave similarly to humans as well as ignore a crucial factor in human decision-making: emotions.
In this paper, we introduce a novel methodology and the framework to study both, the decision-making of LLMs and their alignment with human behavior under emotional states. Experiments with GPT-3.5 and GPT-4 on four games from two different classes of behavioral game theory showed that emotions profoundly impact the performance of LLMs, leading to the development of more optimal strategies. While there is a strong alignment between the behavioral responses of GPT-3.5 and human participants, particularly evident in bargaining games, GPT-4 exhibits consistent behavior, ignoring induced emotions for rationality decisions. Surprisingly, emotional prompting, particularly with `anger' emotion, can disrupt the "superhuman" alignment of GPT-4, resembling human emotional responses.
△ Less
Submitted 5 June, 2024;
originally announced June 2024.
-
HSEmotion Team at the 6th ABAW Competition: Facial Expressions, Valence-Arousal and Emotion Intensity Prediction
Authors:
Andrey V. Savchenko
Abstract:
This article presents our results for the sixth Affective Behavior Analysis in-the-wild (ABAW) competition. To improve the trustworthiness of facial analysis, we study the possibility of using pre-trained deep models that extract reliable emotional features without the need to fine-tune the neural networks for a downstream task. In particular, we introduce several lightweight models based on Mobil…
▽ More
This article presents our results for the sixth Affective Behavior Analysis in-the-wild (ABAW) competition. To improve the trustworthiness of facial analysis, we study the possibility of using pre-trained deep models that extract reliable emotional features without the need to fine-tune the neural networks for a downstream task. In particular, we introduce several lightweight models based on MobileViT, MobileFaceNet, EfficientNet, and DDAMFN architectures trained in multi-task scenarios to recognize facial expressions, valence, and arousal on static photos. These neural networks extract frame-level features fed into a simple classifier, e.g., linear feed-forward neural network, to predict emotion intensity, compound expressions, action units, facial expressions, and valence/arousal. Experimental results for five tasks from the sixth ABAW challenge demonstrate that our approach lets us significantly improve quality metrics on validation sets compared to existing non-ensemble techniques.
△ Less
Submitted 18 March, 2024;
originally announced March 2024.
-
Results of the follow-up of ANTARES neutrino alerts
Authors:
A. Albert,
S. Alves,
M. André,
M. Ardid,
S. Ardid,
J. -J. Aubert,
J. Aublin,
B. Baret,
S. Basa,
Y. Becherini,
B. Belhorma,
M. Bendahman,
F. Benfenati,
V. Bertin,
S. Biagi,
M. Bissinger,
J. Boumaaza,
M. Bouta,
M. C. Bouwhuis,
H. Brânzas,
R. Bruijn,
J. Brunner,
J. Busto,
B. Caiffi,
D. Calvo
, et al. (166 additional authors not shown)
Abstract:
High-energy neutrinos could be produced in the interaction of charged cosmic rays with matter or radiation surrounding astrophysical sources. To look for transient sources associated with neutrino emission, a follow-up program of neutrino alerts has been operating within the ANTARES Collaboration since 2009. This program, named TAToO, has triggered robotic optical telescopes (MASTER, TAROT, ROTSE…
▽ More
High-energy neutrinos could be produced in the interaction of charged cosmic rays with matter or radiation surrounding astrophysical sources. To look for transient sources associated with neutrino emission, a follow-up program of neutrino alerts has been operating within the ANTARES Collaboration since 2009. This program, named TAToO, has triggered robotic optical telescopes (MASTER, TAROT, ROTSE and the SVOM ground based telescopes) immediately after the detection of any relevant neutrino candidate and scheduled several observations in the weeks following the detection. A subset of ANTARES events with highest probabilities of being of cosmic origin has also been followed by the Swift and the INTEGRAL satellites, the Murchison Widefield Array radio telescope and the H.E.S.S. high-energy gamma-ray telescope. The results of twelve years of observations are reported. No optical counterpart has been significantly associated with an ANTARES candidate neutrino signal during image analysis. Constraints on transient neutrino emission have been set. In September 2015, ANTARES issued a neutrino alert and during the follow-up, a potential transient counterpart was identified by Swift and MASTER. A multi-wavelength follow-up campaign has allowed to identify the nature of this source and has proven its fortuitous association with the neutrino. The return of experience is particularly important for the design of the alert system of KM3NeT, the next generation neutrino telescope in the Mediterranean Sea.
△ Less
Submitted 26 February, 2024;
originally announced February 2024.
-
A magnetar giant flare in the nearby starburst galaxy M82
Authors:
Sandro Mereghetti,
Michela Rigoselli,
Ruben Salvaterra,
Dominik P. Pacholski,
James C. Rodi,
Diego Gotz,
Edoardo Arrigoni,
Paolo D'Avanzo,
Christophe Adami,
Angela Bazzano,
Enrico Bozzo,
Riccardo Brivio,
Sergio Campana,
Enrico Cappellaro,
Jerome Chenevez,
Fiore De Luise,
Lorenzo Ducci,
Paolo Esposito,
Carlo Ferrigno,
Matteo Ferro,
Gian Luca Israel,
Emeric Le Floc'h,
Antonio Martin-Carrillo,
Francesca Onori,
Nanda Rea
, et al. (10 additional authors not shown)
Abstract:
Giant flares, short explosive events releasing up to 10$^{47}$ erg of energy in the gamma-ray band in less than one second, are the most spectacular manifestation of magnetars, young neutron stars powered by a very strong magnetic field, 10$^{14-15}$ G in the magnetosphere and possibly higher in the star interior. The rate of occurrence of these rare flares is poorly constrained, as only three hav…
▽ More
Giant flares, short explosive events releasing up to 10$^{47}$ erg of energy in the gamma-ray band in less than one second, are the most spectacular manifestation of magnetars, young neutron stars powered by a very strong magnetic field, 10$^{14-15}$ G in the magnetosphere and possibly higher in the star interior. The rate of occurrence of these rare flares is poorly constrained, as only three have been seen from three different magnetars in the Milky Way and in the Large Magellanic Cloud in about 50 years since the beginning of gamma-ray astronomy. This sample can be enlarged by the discovery of extragalactic events, since for a fraction of a second giant flares reach peak luminosities above 10$^{46}$ erg/s, which makes them visible by current instruments up to a few tens of Mpc. However, at these distances they appear similar to, and difficult to distinguish from, regular short gamma-ray bursts (GRBs). The latter are much more energetic events, 10$^{50-53}$ erg, produced by compact binary mergers and originating at much larger distances. Indeed, only a few short GRBs have been proposed, with different levels of confidence, as magnetar giant flare candidates in nearby galaxies. Here we report the discovery of a short GRB positionally coincident with the central region of the starburst galaxy M82. Its spectral and timing properties, together with the limits on its X-ray and optical counterparts obtained a few hours after the event and the lack of an associated gravitational wave signal, qualify with high confidence this event as a giant flare from a magnetar in M82.
△ Less
Submitted 10 March, 2024; v1 submitted 22 December, 2023;
originally announced December 2023.
-
Near infrared emission bands of solid Nitrogen
Authors:
E. V. Savchenko,
I. V. Khyzhniy,
S. A. Uyutnov,
M. A. Bludov
Abstract:
New results on the study of radiation effects in solid nitrogen and N$_2$-doped Ne matrix are presented with a focus on the so-called $γ$-line origin. The irradiation was carried out in dc regime with an electron beam of subthreshold energy. Relaxation dynamics was monitored by emission spectroscopy - cathodoluminescence (CL) and nonstationary luminescence (NsL), along with current activation spec…
▽ More
New results on the study of radiation effects in solid nitrogen and N$_2$-doped Ne matrix are presented with a focus on the so-called $γ$-line origin. The irradiation was carried out in dc regime with an electron beam of subthreshold energy. Relaxation dynamics was monitored by emission spectroscopy - cathodoluminescence (CL) and nonstationary luminescence (NsL), along with current activation spectroscopy. Thermally stimulated luminescence (TSL) and exoelectron emission (TSEE) of pure nitrogen and N$_2$ in the Ne matrix were measured in a correlated manner. Three emission bands were recorded in the NIR CL spectra of solid N$_2$: 794, 802, and 810 nm. The band at 810 nm was detected for the first time. These three bands are characterized by similar behavior and form molecular series with spacing between adjacent vibrational energy levels of the ground state of 125 cm$^{-1}$ and 123 cm$^{-1}$. These data cast doubt on the recently made assumption that the $γ$-line is attributed to the emission of the nitrogen anion N$^-$ [19]. The processes of an electron attachment and neutralization of positively charged species are discussed. It has been established that the $γ$-line in the TSL spectra of pure nitrogen and N$_2$-doped Ne matrix correlates with TSEE currents and recombination emission of O$^+$, N$_2^+$, and N$_4^+$ ions, which indicates its connection with the neutralization reaction. The measurement of NsL supported this conclusion. A new possible assignment of the $γ$-line and its satellites to the emission of tetranitrogen N$_4$ is discussed.
△ Less
Submitted 29 November, 2023;
originally announced November 2023.
-
On (Sub)stochastic and Transient Weightings of Infinite Strong Digraphs
Authors:
S. V. Savchenko
Abstract:
In the present paper, for a given (possibly, infinite) strongly connected digraph $\cal{D},$ we consider the class $\cal{S}_{<}({\cal D})$ of all truthly substochastic weightings of ${\cal D}$ (here, the word "truthly" means that there exists a vertex whose out-weight is strictly less than $1$). For a finite subdigraph $\cal{F}$ of $\cal{D}$ weighted by $S\in {\cal S}_{<}({\cal D}),$ let…
▽ More
In the present paper, for a given (possibly, infinite) strongly connected digraph $\cal{D},$ we consider the class $\cal{S}_{<}({\cal D})$ of all truthly substochastic weightings of ${\cal D}$ (here, the word "truthly" means that there exists a vertex whose out-weight is strictly less than $1$). For a finite subdigraph $\cal{F}$ of $\cal{D}$ weighted by $S\in {\cal S}_{<}({\cal D}),$ let $\ell_{max}(\cal{F})$ be the length of its longest directed cycle and $λ_{S}(\cal{F})$ be the Perron root (spectral radius) of its weighted adjacency matrix. We prove that the infimum of $\ell_{max}(\cal{F})\bigl(1-λ_{S}(\cal{F})\bigr)$ taken over all $\cal{F}$ is positive for every $S\in \cal{S}_{<}({\cal D})$ if and only if $\cal{D}$ admits a finite cycle transversal. The result obtained provides general theorems on the set ${\cal T}({\cal D})$ of transient weightings of ${\cal D}.$ In particular, we present a theorem of alternatives for finite approximations to elements of ${\cal T}({\cal D})$ and simply reprove V. Cyr's criterion for ${\cal T}({\cal D})$ to be empty.
△ Less
Submitted 22 November, 2023;
originally announced November 2023.
-
Chasing Gravitational Waves with the Cherenkov Telescope Array
Authors:
Jarred Gershon Green,
Alessandro Carosi,
Lara Nava,
Barbara Patricelli,
Fabian Schüssler,
Monica Seglar-Arroyo,
Cta Consortium,
:,
Kazuki Abe,
Shotaro Abe,
Atreya Acharyya,
Remi Adam,
Arnau Aguasca-Cabot,
Ivan Agudo,
Jorge Alfaro,
Nuria Alvarez-Crespo,
Rafael Alves Batista,
Jean-Philippe Amans,
Elena Amato,
Filippo Ambrosino,
Ekrem Oguzhan Angüner,
Lucio Angelo Antonelli,
Carla Aramo,
Cornelia Arcaro,
Luisa Arrabito
, et al. (545 additional authors not shown)
Abstract:
The detection of gravitational waves from a binary neutron star merger by Advanced LIGO and Advanced Virgo (GW170817), along with the discovery of the electromagnetic counterparts of this gravitational wave event, ushered in a new era of multimessenger astronomy, providing the first direct evidence that BNS mergers are progenitors of short gamma-ray bursts (GRBs). Such events may also produce very…
▽ More
The detection of gravitational waves from a binary neutron star merger by Advanced LIGO and Advanced Virgo (GW170817), along with the discovery of the electromagnetic counterparts of this gravitational wave event, ushered in a new era of multimessenger astronomy, providing the first direct evidence that BNS mergers are progenitors of short gamma-ray bursts (GRBs). Such events may also produce very-high-energy (VHE, > 100GeV) photons which have yet to be detected in coincidence with a gravitational wave signal. The Cherenkov Telescope Array (CTA) is a next-generation VHE observatory which aims to be indispensable in this search, with an unparalleled sensitivity and ability to slew anywhere on the sky within a few tens of seconds. New observing modes and follow-up strategies are being developed for CTA to rapidly cover localization areas of gravitational wave events that are typically larger than the CTA field of view. This work will evaluate and provide estimations on the expected number of of gravitational wave events that will be observable with CTA, considering both on- and off-axis emission. In addition, we will present and discuss the prospects of potential follow-up strategies with CTA.
△ Less
Submitted 5 February, 2024; v1 submitted 11 October, 2023;
originally announced October 2023.
-
Performance of the joint LST-1 and MAGIC observations evaluated with Crab Nebula data
Authors:
H. Abe,
K. Abe,
S. Abe,
V. A. Acciari,
A. Aguasca-Cabot,
I. Agudo,
N. Alvarez Crespo,
T. Aniello,
S. Ansoldi,
L. A. Antonelli,
C. Aramo,
A. Arbet-Engels,
C. Arcaro,
M. Artero,
K. Asano,
P. Aubert,
D. Baack,
A. Babić,
A. Baktash,
A. Bamba,
A. Baquero Larriva,
L. Baroncelli,
U. Barres de Almeida,
J. A. Barrio,
I. Batković
, et al. (344 additional authors not shown)
Abstract:
Aims. LST-1, the prototype of the Large-Sized Telescope for the upcoming Cherenkov Telescope Array Observatory, is concluding its commissioning in Observatorio del Roque de los Muchachos on the island of La Palma. The proximity of LST-1 (Large-Sized Telescope 1) to the two MAGIC (Major Atmospheric Gamma Imaging Cherenkov) telescopes permits observations of the same gamma-ray events with both syste…
▽ More
Aims. LST-1, the prototype of the Large-Sized Telescope for the upcoming Cherenkov Telescope Array Observatory, is concluding its commissioning in Observatorio del Roque de los Muchachos on the island of La Palma. The proximity of LST-1 (Large-Sized Telescope 1) to the two MAGIC (Major Atmospheric Gamma Imaging Cherenkov) telescopes permits observations of the same gamma-ray events with both systems. Methods. We describe the joint LST-1+MAGIC analysis pipeline and use simultaneous Crab Nebula observations and Monte Carlo simulations to assess the performance of the three-telescope system. The addition of the LST-1 telescope allows the recovery of events in which one of the MAGIC images is too dim to survive analysis quality cuts. Results. Thanks to the resulting increase in the collection area and stronger background rejection, we find a significant improvement in sensitivity, allowing the detection of 30% weaker fluxes in the energy range between 200 GeV and 3 TeV. The spectrum of the Crab Nebula, reconstructed in the energy range ~60 GeV to ~10 TeV, is in agreement with previous measurements.
△ Less
Submitted 3 October, 2023;
originally announced October 2023.
-
Prospects for $γ$-ray observations of the Perseus galaxy cluster with the Cherenkov Telescope Array
Authors:
The Cherenkov Telescope Array Consortium,
:,
K. Abe,
S. Abe,
F. Acero,
A. Acharyya,
R. Adam,
A. Aguasca-Cabot,
I. Agudo,
A. Aguirre-Santaella,
J. Alfaro,
R. Alfaro,
N. Alvarez-Crespo,
R. Alves Batista,
J. -P. Amans,
E. Amato,
E. O. Angüner,
L. A. Antonelli,
C. Aramo,
M. Araya,
C. Arcaro,
L. Arrabito,
K. Asano,
Y. Ascasíbar,
J. Aschersleben
, et al. (542 additional authors not shown)
Abstract:
Galaxy clusters are expected to be dark matter (DM) reservoirs and storage rooms for the cosmic-ray protons (CRp) that accumulate along the cluster's formation history. Accordingly, they are excellent targets to search for signals of DM annihilation and decay at gamma-ray energies and are predicted to be sources of large-scale gamma-ray emission due to hadronic interactions in the intracluster med…
▽ More
Galaxy clusters are expected to be dark matter (DM) reservoirs and storage rooms for the cosmic-ray protons (CRp) that accumulate along the cluster's formation history. Accordingly, they are excellent targets to search for signals of DM annihilation and decay at gamma-ray energies and are predicted to be sources of large-scale gamma-ray emission due to hadronic interactions in the intracluster medium. We estimate the sensitivity of the Cherenkov Telescope Array (CTA) to detect diffuse gamma-ray emission from the Perseus galaxy cluster. We perform a detailed spatial and spectral modelling of the expected signal for the DM and the CRp components. For each, we compute the expected CTA sensitivity. The observing strategy of Perseus is also discussed. In the absence of a diffuse signal (non-detection), CTA should constrain the CRp to thermal energy ratio within the radius $R_{500}$ down to about $X_{500}<3\times 10^{-3}$, for a spatial CRp distribution that follows the thermal gas and a CRp spectral index $α_{\rm CRp}=2.3$. Under the optimistic assumption of a pure hadronic origin of the Perseus radio mini-halo and depending on the assumed magnetic field profile, CTA should measure $α_{\rm CRp}$ down to about $Δα_{\rm CRp}\simeq 0.1$ and the CRp spatial distribution with 10% precision. Regarding DM, CTA should improve the current ground-based gamma-ray DM limits from clusters observations on the velocity-averaged annihilation cross-section by a factor of up to $\sim 5$, depending on the modelling of DM halo substructure. In the case of decay of DM particles, CTA will explore a new region of the parameter space, reaching models with $τ_χ>10^{27}$s for DM masses above 1 TeV. These constraints will provide unprecedented sensitivity to the physics of both CRp acceleration and transport at cluster scale and to TeV DM particle models, especially in the decay scenario.
△ Less
Submitted 7 September, 2023;
originally announced September 2023.
-
Simultaneous and panchromatic observations of the Fast Radio Burst FRB 20180916B
Authors:
M. Trudu,
M. Pilia,
L. Nicastro,
C. Guidorzi,
M. Orlandini,
L. Zampieri,
V. R. Marthi,
F. Ambrosino,
A. Possenti,
M. Burgay,
C. Casentini,
I. Mereminskiy,
V. Savchenko,
E. Palazzi,
F. Panessa,
A. Ridolfi,
F. Verrecchia,
M. Anedda,
G. Bernardi,
M. Bachetti,
R. Burenin,
A. Burtovoi,
P. Casella,
M. Fiori,
F. Frontera
, et al. (25 additional authors not shown)
Abstract:
Aims. Fast Radio Bursts are bright radio transients whose origin has not yet explained. The search for a multi-wavelength counterpart of those events can put a tight constrain on the emission mechanism and the progenitor source. Methods. We conducted a multi-wavelength observational campaign on FRB 20180916B between October 2020 and August 2021 during eight activity cycles of the source. Observati…
▽ More
Aims. Fast Radio Bursts are bright radio transients whose origin has not yet explained. The search for a multi-wavelength counterpart of those events can put a tight constrain on the emission mechanism and the progenitor source. Methods. We conducted a multi-wavelength observational campaign on FRB 20180916B between October 2020 and August 2021 during eight activity cycles of the source. Observations were led in the radio band by the SRT both at 336 MHz and 1547 MHz and the uGMRT at 400 MHz. Simultaneous observations have been conducted by the optical telescopes Asiago (Galileo and Copernico), CMO SAI MSU, CAHA 2.2m, RTT-150 and TNG, and X/Gamma-ray detectors on board the AGILE, Insight-HXMT, INTEGRAL and Swift satellites. Results. We present the detection of 14 new bursts detected with the SRT at 336 MHz and seven new bursts with the uGMRT from this source. We provide the deepest prompt upper limits in the optical band fro FRB 20180916B to date. In fact, the TNG/SiFAP2 observation simultaneous to a burst detection by uGMRT gives an upper limit E_optical / E_radio < 1.3 x 10^2. Another burst detected by the SRT at 336 MHz was also co-observed by Insight-HMXT. The non-detection in the X-rays yields an upper limit (1-30 keV band) of E_X-ray / E_radio in the range of (0.9-1.3) x 10^7, depending on which model is considered for the X-ray emission.
△ Less
Submitted 29 May, 2023;
originally announced May 2023.
-
Workflows Community Summit 2022: A Roadmap Revolution
Authors:
Rafael Ferreira da Silva,
Rosa M. Badia,
Venkat Bala,
Debbie Bard,
Peer-Timo Bremer,
Ian Buckley,
Silvina Caino-Lores,
Kyle Chard,
Carole Goble,
Shantenu Jha,
Daniel S. Katz,
Daniel Laney,
Manish Parashar,
Frederic Suter,
Nick Tyler,
Thomas Uram,
Ilkay Altintas,
Stefan Andersson,
William Arndt,
Juan Aznar,
Jonathan Bader,
Bartosz Balis,
Chris Blanton,
Kelly Rosa Braghetto,
Aharon Brodutch
, et al. (80 additional authors not shown)
Abstract:
Scientific workflows have become integral tools in broad scientific computing use cases. Science discovery is increasingly dependent on workflows to orchestrate large and complex scientific experiments that range from execution of a cloud-based data preprocessing pipeline to multi-facility instrument-to-edge-to-HPC computational workflows. Given the changing landscape of scientific computing and t…
▽ More
Scientific workflows have become integral tools in broad scientific computing use cases. Science discovery is increasingly dependent on workflows to orchestrate large and complex scientific experiments that range from execution of a cloud-based data preprocessing pipeline to multi-facility instrument-to-edge-to-HPC computational workflows. Given the changing landscape of scientific computing and the evolving needs of emerging scientific applications, it is paramount that the development of novel scientific workflows and system functionalities seek to increase the efficiency, resilience, and pervasiveness of existing systems and applications. Specifically, the proliferation of machine learning/artificial intelligence (ML/AI) workflows, need for processing large scale datasets produced by instruments at the edge, intensification of near real-time data processing, support for long-term experiment campaigns, and emergence of quantum computing as an adjunct to HPC, have significantly changed the functional and operational requirements of workflow systems. Workflow systems now need to, for example, support data streams from the edge-to-cloud-to-HPC enable the management of many small-sized files, allow data reduction while ensuring high accuracy, orchestrate distributed services (workflows, instruments, data movement, provenance, publication, etc.) across computing and user facilities, among others. Further, to accelerate science, it is also necessary that these systems implement specifications/standards and APIs for seamless (horizontal and vertical) integration between systems and applications, as well as enabling the publication of workflows and their associated products according to the FAIR principles. This document reports on discussions and findings from the 2022 international edition of the Workflows Community Summit that took place on November 29 and 30, 2022.
△ Less
Submitted 31 March, 2023;
originally announced April 2023.
-
EmotiEffNet Facial Features in Uni-task Emotion Recognition in Video at ABAW-5 competition
Authors:
Andrey V. Savchenko
Abstract:
In this article, the results of our team for the fifth Affective Behavior Analysis in-the-wild (ABAW) competition are presented. The usage of the pre-trained convolutional networks from the EmotiEffNet family for frame-level feature extraction is studied. In particular, we propose an ensemble of a multi-layered perceptron and the LightAutoML-based classifier. The post-processing by smoothing the r…
▽ More
In this article, the results of our team for the fifth Affective Behavior Analysis in-the-wild (ABAW) competition are presented. The usage of the pre-trained convolutional networks from the EmotiEffNet family for frame-level feature extraction is studied. In particular, we propose an ensemble of a multi-layered perceptron and the LightAutoML-based classifier. The post-processing by smoothing the results for sequential frames is implemented. Experimental results for the large-scale Aff-Wild2 database demonstrate that our model achieves a much greater macro-averaged F1-score for facial expression recognition and action unit detection and concordance correlation coefficients for valence/arousal estimation when compared to baseline.
△ Less
Submitted 16 March, 2023;
originally announced March 2023.
-
Deep X-ray and radio observations of the first outburst of the young magnetar Swift J1818.0-1607
Authors:
A. Y. Ibrahim,
A. Borghese,
N. Rea,
F. Coti Zelati,
E. Parent,
T. D. Russell,
S. Ascenzi,
R. Sathyaprakash,
D. Gotz,
S. Mereghetti,
M. Topinka,
M. Rigoselli,
V. Savchenko,
S. Campana,
G. L. Israel,
A. Tiengo,
R. Perna,
R. Turolla,
S. Zane,
P. Esposito,
G. A. Rodrıguez Castillo,
V. Graber,
A. Possenti,
C. Dehman,
M. Ronchi
, et al. (1 additional authors not shown)
Abstract:
Swift J1818.0-1607 is a radio-loud magnetar with a spin period of 1.36 s and a dipolar magnetic field strength of B~3E14 G, which is very young compared to the Galactic pulsar population. We report here on the long-term X-ray monitoring campaign of this young magnetar using XMM-Newton, NuSTAR, and Swift from the activation of its first outburst in March 2020 until October 2021, as well as INTEGRAL…
▽ More
Swift J1818.0-1607 is a radio-loud magnetar with a spin period of 1.36 s and a dipolar magnetic field strength of B~3E14 G, which is very young compared to the Galactic pulsar population. We report here on the long-term X-ray monitoring campaign of this young magnetar using XMM-Newton, NuSTAR, and Swift from the activation of its first outburst in March 2020 until October 2021, as well as INTEGRAL upper limits on its hard X-ray emission. The 1-10 keV magnetar spectrum is well modeled by an absorbed blackbody with a temperature of kT_BB~1.1 keV, and apparent reduction in the radius of the emitting region from ~0.6 to ~0.2 km. We also confirm the bright diffuse X-ray emission around the source extending between ~50'' and ~110''. A timing analysis revealed large torque variability, with an average spin-down rate nudot~-2.3E-11 Hz^2 that appears to decrease in magnitude over time. We also observed Swift J1818.0-1607 with the Karl G. Jansky Very Large Array (VLA) on 2021 March 22. We detected the radio counterpart to Swift J1818.0-1607 measuring a flux density of S_v = 4.38+/-0.05 mJy at 3 GHz, and a half ring-like structure of bright diffuse radio emission located at ~90'' to the west of the magnetar. We tentatively suggest that the diffuse X-ray emission is due to a dust scattering halo and that the radio structure may be associated with the supernova remnant of this young pulsar, based on its morphology.
△ Less
Submitted 22 November, 2022;
originally announced November 2022.
-
HSE-NN Team at the 4th ABAW Competition: Multi-task Emotion Recognition and Learning from Synthetic Images
Authors:
Andrey V. Savchenko
Abstract:
In this paper, we present the results of the HSE-NN team in the 4th competition on Affective Behavior Analysis in-the-wild (ABAW). The novel multi-task EfficientNet model is trained for simultaneous recognition of facial expressions and prediction of valence and arousal on static photos. The resulting MT-EmotiEffNet extracts visual features that are fed into simple feed-forward neural networks in…
▽ More
In this paper, we present the results of the HSE-NN team in the 4th competition on Affective Behavior Analysis in-the-wild (ABAW). The novel multi-task EfficientNet model is trained for simultaneous recognition of facial expressions and prediction of valence and arousal on static photos. The resulting MT-EmotiEffNet extracts visual features that are fed into simple feed-forward neural networks in the multi-task learning challenge. We obtain performance measure 1.3 on the validation set, which is significantly greater when compared to either performance of baseline (0.3) or existing models that are trained only on the s-Aff-Wild2 database. In the learning from synthetic data challenge, the quality of the original synthetic training set is increased by using the super-resolution techniques, such as Real-ESRGAN. Next, the MT-EmotiEffNet is fine-tuned on the new training set. The final prediction is a simple blending ensemble of pre-trained and fine-tuned MT-EmotiEffNets. Our average validation F1 score is 18% greater than the baseline convolutional neural network.
△ Less
Submitted 20 October, 2022; v1 submitted 19 July, 2022;
originally announced July 2022.
-
The Astropy Project: Sustaining and Growing a Community-oriented Open-source Project and the Latest Major Release (v5.0) of the Core Package
Authors:
The Astropy Collaboration,
Adrian M. Price-Whelan,
Pey Lian Lim,
Nicholas Earl,
Nathaniel Starkman,
Larry Bradley,
David L. Shupe,
Aarya A. Patil,
Lia Corrales,
C. E. Brasseur,
Maximilian Nöthe,
Axel Donath,
Erik Tollerud,
Brett M. Morris,
Adam Ginsburg,
Eero Vaher,
Benjamin A. Weaver,
James Tocknell,
William Jamieson,
Marten H. van Kerkwijk,
Thomas P. Robitaille,
Bruce Merry,
Matteo Bachetti,
H. Moritz Günther,
Thomas L. Aldcroft
, et al. (111 additional authors not shown)
Abstract:
The Astropy Project supports and fosters the development of open-source and openly-developed Python packages that provide commonly needed functionality to the astronomical community. A key element of the Astropy Project is the core package $\texttt{astropy}$, which serves as the foundation for more specialized projects and packages. In this article, we summarize key features in the core package as…
▽ More
The Astropy Project supports and fosters the development of open-source and openly-developed Python packages that provide commonly needed functionality to the astronomical community. A key element of the Astropy Project is the core package $\texttt{astropy}$, which serves as the foundation for more specialized projects and packages. In this article, we summarize key features in the core package as of the recent major release, version 5.0, and provide major updates for the Project. We then discuss supporting a broader ecosystem of interoperable packages, including connections with several astronomical observatories and missions. We also revisit the future outlook of the Astropy Project and the current status of Learn Astropy. We conclude by raising and discussing the current and future challenges facing the Project.
△ Less
Submitted 28 June, 2022;
originally announced June 2022.
-
Frame-level Prediction of Facial Expressions, Valence, Arousal and Action Units for Mobile Devices
Authors:
Andrey V. Savchenko
Abstract:
In this paper, we consider the problem of real-time video-based facial emotion analytics, namely, facial expression recognition, prediction of valence and arousal and detection of action unit points. We propose the novel frame-level emotion recognition algorithm by extracting facial features with the single EfficientNet model pre-trained on AffectNet. As a result, our approach may be implemented e…
▽ More
In this paper, we consider the problem of real-time video-based facial emotion analytics, namely, facial expression recognition, prediction of valence and arousal and detection of action unit points. We propose the novel frame-level emotion recognition algorithm by extracting facial features with the single EfficientNet model pre-trained on AffectNet. As a result, our approach may be implemented even for video analytics on mobile devices. Experimental results for the large scale Aff-Wild2 database from the third Affective Behavior Analysis in-the-wild (ABAW) Competition demonstrate that our simple model is significantly better when compared to the VggFace baseline. In particular, our method is characterized by 0.15-0.2 higher performance measures for validation sets in uni-task Expression Classification, Valence-Arousal Estimation and Expression Classification. Due to simplicity, our approach may be considered as a new baseline for all four sub-challenges.
△ Less
Submitted 24 May, 2022; v1 submitted 24 March, 2022;
originally announced March 2022.
-
The Second Catalog of Interplanetary Network Localizations of Konus Short Duration Gamma-Ray Bursts
Authors:
D. Svinkin,
K. Hurley,
A. Ridnaia,
A. Lysenko,
D. Frederiks,
S. Golenetskii,
A. Tsvetkova,
M. Ulanov,
A. Kokomov,
T. L. Cline,
I. Mitrofanov,
D. Golovin,
A. Kozyrev,
M. Litvak,
A. Sanin,
A. Goldstein,
M. S. Briggs,
C. Wilson-Hodge,
E. Burns,
A. von Kienlin,
X. -L. Zhang,
A. Rau,
V. Savchenko,
E. Bozzo,
C. Ferrigno
, et al. (50 additional authors not shown)
Abstract:
We present the catalog of Interplanetary Network (IPN) localizations for 199 short-duration gamma-ray bursts (sGRBs) detected by the Konus-Wind (KW) experiment between 2011 January 1 and 2021 August 31, which extends the initial sample of IPN localized KW sGRBs (arXiv:1301.3740) to 495 events. We present the most comprehensive IPN localization data on these events, including probability sky maps i…
▽ More
We present the catalog of Interplanetary Network (IPN) localizations for 199 short-duration gamma-ray bursts (sGRBs) detected by the Konus-Wind (KW) experiment between 2011 January 1 and 2021 August 31, which extends the initial sample of IPN localized KW sGRBs (arXiv:1301.3740) to 495 events. We present the most comprehensive IPN localization data on these events, including probability sky maps in HEALPix format.
△ Less
Submitted 16 March, 2022;
originally announced March 2022.
-
Cosmological Fast Optical Transients with the Zwicky Transient Facility: A Search for Dirty Fireballs
Authors:
Anna Y. Q. Ho,
Daniel A. Perley,
Yuhan Yao,
Dmitry Svinkin,
A. de Ugarte Postigo,
R. A. Perley,
D. Alexander Kann,
Eric Burns,
Igor Andreoni,
Eric C. Bellm,
Elisabetta Bissaldi,
Joshua S. Bloom,
Richard Dekany,
Andrew J. Drake,
José Feliciano Agüí Fernández,
Dmitry Frederiks,
Matthew J. Graham,
Boyan A. Hristov,
Mansi M. Kasliwal,
S. R. Kulkarni,
Harsh Kumar,
Russ R. Laher,
Alexandra L. Lysenko,
Bagrat Mailyan,
Christian Malacaria
, et al. (11 additional authors not shown)
Abstract:
Dirty fireballs are a hypothesized class of relativistic massive-star explosions with an initial Lorentz factor $Γ_\mathrm{init}$ below the $Γ_\mathrm{init}\sim100$ required to produce a long-duration gamma-ray burst (LGRB), but which could still produce optical emission resembling LGRB afterglows. Here we present the results of a search for on-axis optical afterglows using the Zwicky Transient Fa…
▽ More
Dirty fireballs are a hypothesized class of relativistic massive-star explosions with an initial Lorentz factor $Γ_\mathrm{init}$ below the $Γ_\mathrm{init}\sim100$ required to produce a long-duration gamma-ray burst (LGRB), but which could still produce optical emission resembling LGRB afterglows. Here we present the results of a search for on-axis optical afterglows using the Zwicky Transient Facility (ZTF). Our search yielded seven optical transients that resemble on-axis LGRB afterglows in terms of their red colors ($g-r>0$ mag), faint host galaxy ($r>23$ mag), and rapid fading ($dr/dt>1$ mag/day). Spectroscopy of the transient emission within a few days of discovery established cosmological distances ($z=0.876$ to $z=2.9$) for six events, tripling the number of afterglows with redshift measurements discovered by optical surveys without a $γ$-ray trigger. Upon a retrospective search, four events (ZTF20abbiixp/AT2020kym, ZTF21aagwbjr/AT2021buv, ZTF21aakruew/AT2021cwd, ZTF21abfmpwn/AT2021qbd) turned out to have a likely associated LGRB (GRB200524A, GRB210204A, GRB210212B, GRB210610B), while three did not (ZTF20aajnksq/AT2020blt, ZTF21aaeyldq/AT2021any, ZTF21aayokph/AT2021lfa). Our search revealed no definitive new class of events: the simplest explanation for the apparently "orphan" events is that they were regular LGRBs missed by high-energy satellites due to detector sensitivity and duty cycle, although it is possible that they were intrinsically faint in $γ$-rays or viewed slightly off-axis. We rule out a scenario in which dirty fireballs have a similar energy per solid angle to LGRBs and are an order of magnitude more common. In addition, we set the first direct constraint on the ratio of the opening angles of the material producing $γ$-rays and the material producing early optical afterglow emission, finding that they must be comparable.
△ Less
Submitted 22 August, 2022; v1 submitted 28 January, 2022;
originally announced January 2022.
-
INTEGRAL Results on Gamma-Ray Bursts and Polarization of Hard X-ray Sources
Authors:
D Gotz,
C. Gouiffes,
J. Rodriguez,
P. Laurent,
E. Jourdain,
J. P. Roques,
S. Mereghetti,
S. Lutovinonv,
V. Savchenko,
L. Hanlon,
A. Martin-Carrillo,
P. Moran
Abstract:
In this paper we first review the results obtained by the INTEGRAL mission in the domain of Gamma-Ray Bursts (GRBs), thanks to the INTEGRAL Burst Alert System, which is able to deliver near real-time alerts for GRBs detected within the IBIS field of view. More than 120 GRBs have been detected to date and we summarize their properties here. In the second part of this review we focus on the polarime…
▽ More
In this paper we first review the results obtained by the INTEGRAL mission in the domain of Gamma-Ray Bursts (GRBs), thanks to the INTEGRAL Burst Alert System, which is able to deliver near real-time alerts for GRBs detected within the IBIS field of view. More than 120 GRBs have been detected to date and we summarize their properties here. In the second part of this review we focus on the polarimetric results obtained by IBIS and SPI on GRBs and Galactic compact objects.
△ Less
Submitted 14 December, 2021;
originally announced December 2021.
-
HILIGT, Upper Limit Servers II -- Implementing the data servers
Authors:
Ole König,
Richard D. Saxton,
Peter Kretschmar,
Lorella Angelini,
Guillaume Belanger,
Phil A. Evans,
Michael J. Freyberg,
Volodymyr Savchenko,
Iris Traulsen,
Jörn Wilms
Abstract:
The High-Energy Lightcurve Generator (HILIGT) is a new web-based tool which allows the user to generate long-term lightcurves of X-ray sources. It provides historical data and calculates upper limits from image data in real-time. HILIGT utilizes data from twelve satellites, both modern missions such as XMM-Newton and Swift, and earlier facilities such as ROSAT, EXOSAT, Einstein or Ariel V. Togethe…
▽ More
The High-Energy Lightcurve Generator (HILIGT) is a new web-based tool which allows the user to generate long-term lightcurves of X-ray sources. It provides historical data and calculates upper limits from image data in real-time. HILIGT utilizes data from twelve satellites, both modern missions such as XMM-Newton and Swift, and earlier facilities such as ROSAT, EXOSAT, Einstein or Ariel V. Together, this enables the user to query 50 years of X-ray data and, for instance, study outburst behavior of transient sources. In this paper we focus on the individual back-end servers for each satellite, detailing the software layout, database design, catalog calls, and image footprints. We compile all relevant calibration information of these missions and provide an in-depth summary of the details of X-ray astronomical instrumentation and data.
△ Less
Submitted 26 November, 2021;
originally announced November 2021.
-
INTEGRAL reloaded: spacecraft, instruments and ground system
Authors:
Erik Kuulkers,
Carlo Ferrigno,
Peter Kretschmar,
Julia Alfonso-Garzon,
Marius Baab,
Angela Bazzano,
Guillaume Belanger,
Ian Benson,
Anthony J. Bird,
Enrico Bozzo,
Soren Brandt,
Elliott Coe,
Isabel Caballero,
Floriane Cangemi,
Jerome Chenevez,
Bradley Cenko,
Nebil Cinar,
Alexis Coleiro,
Stefano De Padova,
Roland Diehl,
Claudia Dietze,
Albert Domingo,
Mark Drapes,
Eleonora D'uva,
Matthias Ehle
, et al. (63 additional authors not shown)
Abstract:
ESA's INTErnational Gamma-Ray Astrophysics Laboratory (INTEGRAL) was launched on 17 Oct 2002 at 06:41 CEST. Since then, it has been providing long, uninterrupted observations (up to about 47 hr, or 170 ksec, per satellite orbit of 2.7 days) with a large field-of-view (fully coded: 100 deg^2), msec time resolution, keV energy resolution, polarization measurements, as well as additional coverage in…
▽ More
ESA's INTErnational Gamma-Ray Astrophysics Laboratory (INTEGRAL) was launched on 17 Oct 2002 at 06:41 CEST. Since then, it has been providing long, uninterrupted observations (up to about 47 hr, or 170 ksec, per satellite orbit of 2.7 days) with a large field-of-view (fully coded: 100 deg^2), msec time resolution, keV energy resolution, polarization measurements, as well as additional coverage in the optical. This is realized by two main instruments in the 15 keV to 10 MeV range, the spectrometer SPI (spectral resolution 3 keV at 1.8 MeV) and the imager IBIS (angular resolution 12 arcmin FWHM), complemented by X-ray (JEM-X; 3-35 keV) and optical (OMC; Johnson V-band) monitors. All instruments are co-aligned to simultaneously observe the target region. A particle radiation monitor (IREM) measures charged particle fluxes near the spacecraft. The Anti-coincidence subsystems of the main instruments are also efficient all-sky gamma-ray detectors, which provide omni-directional monitoring above ~75 keV. INTEGRAL can also rapidly (within a couple of hours) re-point and conduct Target of Opportunity observations. INTEGRAL has build an impressive legacy: e.g. discovery of >600 new high-energy sources; first-ever direct detection of 56Ni and 56Co radio-active decay lines from a Type Ia supernova; new insights on positron annihilation in the Galactic bulge and disk; pioneering gamma-ray polarization studies. INTEGRAL is also a successful in multi-messenger astronomy: INTEGRAL found the first prompt electromagnetic radiation in coincidence with a binary neutron star merger. More than 1750 papers based on INTEGRAL data have been published in refereed journals. Here we give a comprehensive update of the satellite status after more than 18 years of operations in a harsh space environment, and an account of the successful Ground Segment.
△ Less
Submitted 23 June, 2021;
originally announced June 2021.
-
Facial expression and attributes recognition based on multi-task learning of lightweight neural networks
Authors:
Andrey V. Savchenko
Abstract:
In this paper, the multi-task learning of lightweight convolutional neural networks is studied for face identification and classification of facial attributes (age, gender, ethnicity) trained on cropped faces without margins. The necessity to fine-tune these networks to predict facial expressions is highlighted. Several models are presented based on MobileNet, EfficientNet and RexNet architectures…
▽ More
In this paper, the multi-task learning of lightweight convolutional neural networks is studied for face identification and classification of facial attributes (age, gender, ethnicity) trained on cropped faces without margins. The necessity to fine-tune these networks to predict facial expressions is highlighted. Several models are presented based on MobileNet, EfficientNet and RexNet architectures. It was experimentally demonstrated that they lead to near state-of-the-art results in age, gender and race recognition on the UTKFace dataset and emotion classification on the AffectNet dataset. Moreover, it is shown that the usage of the trained models as feature extractors of facial regions in video frames leads to 4.5% higher accuracy than the previously known state-of-the-art single models for the AFEW and the VGAF datasets from the EmotiW challenges. The models and source code are publicly available at https://github.com/HSE-asavchenko/face-emotion-recognition.
△ Less
Submitted 4 October, 2021; v1 submitted 31 March, 2021;
originally announced March 2021.
-
Identification of a Local Sample of Gamma-Ray Bursts Consistent with a Magnetar Giant Flare Origin
Authors:
E. Burns,
D. Svinkin,
K. Hurley,
Z. Wadiasingh,
M. Negro,
G. Younes,
R. Hamburg,
A. Ridnaia,
D. Cook,
S. B. Cenko,
R. Aloisi,
G. Ashton,
M. Baring,
M. S. Briggs,
N. Christensen,
D. Frederiks,
A. Goldstein,
C. M. Hui,
D. L. Kaplan,
M. M. Kasliwal,
D. Kocevski,
O. J. Roberts,
V. Savchenko,
A. Tohuvavohu,
P. Veres
, et al. (1 additional authors not shown)
Abstract:
Cosmological Gamma-Ray Bursts (GRBs) are known to arise from distinct progenitor channels: short GRBs mostly from neutron star mergers and long GRBs from a rare type of core-collapse supernova (CCSN) called collapsars. Highly magnetized neutron stars called magnetars also generate energetic, short-duration gamma-ray transients called Magnetar Giant Flares (MGFs). Three have been observed from the…
▽ More
Cosmological Gamma-Ray Bursts (GRBs) are known to arise from distinct progenitor channels: short GRBs mostly from neutron star mergers and long GRBs from a rare type of core-collapse supernova (CCSN) called collapsars. Highly magnetized neutron stars called magnetars also generate energetic, short-duration gamma-ray transients called Magnetar Giant Flares (MGFs). Three have been observed from the Milky Way and its satellite galaxies and they have long been suspected to contribute a third class of extragalactic GRBs. We report the unambiguous identification of a distinct population of 4 local ($<$5 Mpc) short GRBs, adding GRB 070222 to previously discussed events. While identified solely based on alignment to nearby star-forming galaxies, their rise time and isotropic energy release are independently inconsistent with the larger short GRB population at $>$99.9% confidence. These properties, the host galaxies, and non-detection in gravitational waves all point to an extragalactic MGF origin. Despite the small sample, the inferred volumetric rates for events above $4\times10^{44}$ erg of $R_{MGF}=3.8_{-3.1}^{+4.0}\times10^5$ Gpc$^{-3}$ yr$^{-1}$ place MGFs as the dominant gamma-ray transient detected from extragalactic sources. As previously suggested, these rates imply that some magnetars produce multiple MGFs, providing a source of repeating GRBs. The rates and host galaxies favor common CCSN as key progenitors of magnetars.
△ Less
Submitted 22 January, 2021; v1 submitted 13 January, 2021;
originally announced January 2021.
-
A bright gamma-ray flare interpreted as a giant magnetar flare in NGC 253
Authors:
D. Svinkin,
D. Frederiks,
K. Hurley,
R. Aptekar,
S. Golenetskii,
A. Lysenko,
A. V. Ridnaia,
A. Tsvetkova,
M. Ulanov,
T. L. Cline,
I. Mitrofanov,
D. Golovin,
A. Kozyrev,
M. Litvak,
A. Sanin,
A. Goldstein,
M. S. Briggs,
C. Wilson-Hodge,
A. von Kienlin,
X. -L. Zhang,
A. Rau,
V. Savchenko,
E. Bozzo,
C. Ferrigno,
P. Ubertini
, et al. (11 additional authors not shown)
Abstract:
Magnetars are young, highly magnetized neutron stars that produce extremely rare giant flares of gamma-rays, the most luminous astrophysical phenomena in our Galaxy. The detection of these flares from outside the Local Group of galaxies has been predicted, with just two candidates so far. Here we report on the extremely bright gamma-ray flare GRB 200415A of April 15, 2020, which we localize, using…
▽ More
Magnetars are young, highly magnetized neutron stars that produce extremely rare giant flares of gamma-rays, the most luminous astrophysical phenomena in our Galaxy. The detection of these flares from outside the Local Group of galaxies has been predicted, with just two candidates so far. Here we report on the extremely bright gamma-ray flare GRB 200415A of April 15, 2020, which we localize, using the Interplanetary Network, to a tiny (20 sq. arcmin) area on the celestial sphere, that overlaps the central region of the Sculptor galaxy at 3.5 Mpc from the Milky Way. From the Konus-Wind detections, we find a striking similarity between GRB 200415A and GRB 051103, the even more energetic flare that presumably originated from the M81/M82 group of galaxies at nearly the same distance (3.6 Mpc). Both bursts display a sharp, millisecond-scale, hard-spectrum initial pulse, followed by an approximately 0.2 s long steadily fading and softening tail. Apart from the huge initial pulses of magnetar giant flares, no astrophysical signal with this combination of temporal and spectral properties and implied energy has been reported previously. At the inferred distances, the energy released in both flares is on par with that of the December 27, 2004 superflare from the Galactic magnetar SGR 1806-20, but with a higher peak luminosity. Taken all together, this makes GRB 200415A and its twin GRB 051103 the most significant candidates for extragalactic magnetar giant flares, both a factor of five more luminous than the brightest Galactic magnetar flare observed previously, thus providing an important step towards a better understanding of this fascinating phenomenon.
△ Less
Submitted 13 January, 2021;
originally announced January 2021.
-
The INTEGRAL view of the pulsating hard X-ray sky: from accreting and transitional millisecond pulsars to rotation-powered pulsars and magnetars
Authors:
A. Papitto,
M. Falanga,
W. Hermsen,
S. Mereghetti,
L. Kuiper,
J. Poutanen,
E. Bozzo,
F. Ambrosino,
F. Coti Zelati,
V. De Falco,
D. de Martino,
T. Di Salvo,
P. Esposito,
C. Ferrigno,
M. Forot,
D. Götz,
C. Gouiffes,
R. Iaria,
P. Laurent,
J. Li,
Z. Li,
T. Mineo,
P. Moran,
A. Neronov,
A. Paizis
, et al. (8 additional authors not shown)
Abstract:
In the last 25 years, a new generation of X-ray satellites imparted a significant leap forward in our knowledge of X-ray pulsars. The discovery of accreting and transitional millisecond pulsars proved that disk accretion can spin up a neutron star to a very high rotation speed. The detection of MeV-GeV pulsed emission from a few hundreds of rotation-powered pulsars probed particle acceleration in…
▽ More
In the last 25 years, a new generation of X-ray satellites imparted a significant leap forward in our knowledge of X-ray pulsars. The discovery of accreting and transitional millisecond pulsars proved that disk accretion can spin up a neutron star to a very high rotation speed. The detection of MeV-GeV pulsed emission from a few hundreds of rotation-powered pulsars probed particle acceleration in the outer magnetosphere, or even beyond. Also, a population of two dozens of magnetars has emerged. INTEGRAL played a central role to achieve these results by providing instruments with high temporal resolution up to the hard X-ray/soft gamma-ray band and a large field of view imager with good angular resolution to spot hard X-ray transients. In this article, we review the main contributions by INTEGRAL to our understanding of the pulsating hard X-ray sky, such as the discovery and characterization of several accreting and transitional millisecond pulsars, the generation of the first catalog of hard X-ray/soft gamma-ray rotation-powered pulsars, the detection of polarization in the hard X-ray emission from the Crab pulsar, and the discovery of persistent hard X-ray emission from several magnetars.
△ Less
Submitted 2 December, 2020;
originally announced December 2020.
-
Multi-messenger astronomy with INTEGRAL
Authors:
C. Ferrigno,
V. Savchenko,
A. Coleiro,
F. Panessa,
A. Bazzano,
E. Bozzo,
J. Chenevez,
A. Domingo,
M. Doyle,
A. Goldwurm,
D. Goetz,
E. Jourdain,
A. von Kienlin,
E. Kuulkers,
S. Mereghetti,
A. Martin-Carrillo,
L. Natalucci,
F. Onori,
J. Rodi,
J. Pierre Roques,
C. Sanchez-Fernandez,
P. Ubertini
Abstract:
At the time of defining the science objectives of the INTernational Gamma-Ray Astrophysics Laboratory (INTEGRAL), such a rapid and spectacular development of multi-messenger astronomy could not have been predicted, with new impulsive phenomena becoming accessible through different channels.
Neutrino telescopes have routinely detected energetic neutrino events coming from unknown cosmic sources s…
▽ More
At the time of defining the science objectives of the INTernational Gamma-Ray Astrophysics Laboratory (INTEGRAL), such a rapid and spectacular development of multi-messenger astronomy could not have been predicted, with new impulsive phenomena becoming accessible through different channels.
Neutrino telescopes have routinely detected energetic neutrino events coming from unknown cosmic sources since 2013. Gravitational wave detectors opened a novel window on the sky in 2015 with the detection of the merging of two black holes and in 2017 with the merging of two neutron stars, followed by signals in the full electromagnetic range. Finally, since 2007, radio telescopes detected extremely intense and short burst of radio waves, known as Fast Radio Bursts (FRBs) whose origin is for most cases extragalactic, but enigmatic.
The exceptionally robust and versatile design of the INTEGRAL mission has allowed researchers to exploit data collected not only with the pointed instruments, but also with the active cosmic-ray shields of the main instruments to detect impulses of gamma-rays in coincidence with unpredictable phenomena. The full-sky coverage, mostly unocculted by the Earth, the large effective area, the stable background, and the high duty cycle (85%) put INTEGRAL in a privileged position to give a major contribution to multi-messenger astronomy.
In this review, we describe how INTEGRAL has provided upper limits on the gamma-ray emission from black-hole binary mergers, detected a short gamma-ray burst in coincidence with a binary neutron star merger, contributed to define the spectral energy distribution of a blazar associated with a neutrino event, set upper limits on impulsive and steady gamma-ray emission from cosmological FRBs, and detected a magnetar flare associated with fast radio bursting emission.
△ Less
Submitted 24 November, 2020;
originally announced November 2020.
-
Gender domain adaptation for automatic speech recognition task
Authors:
Sokolov Artem,
Andrey V. Savchenko
Abstract:
This paper is focused on the finetuning of acoustic models for speaker adaptation goals on a given gender. We pretrained the Transformer baseline model on Librispeech-960 and conduct experiments with finetuning on the gender-specific test subsets and. In general, we do not obtain essential WER reduction by finetuning techniques by this approach. We achieved up to ~5% lower word error rate on the m…
▽ More
This paper is focused on the finetuning of acoustic models for speaker adaptation goals on a given gender. We pretrained the Transformer baseline model on Librispeech-960 and conduct experiments with finetuning on the gender-specific test subsets and. In general, we do not obtain essential WER reduction by finetuning techniques by this approach. We achieved up to ~5% lower word error rate on the male subset and 3% on the female subset if the layers in the encoder and decoder are not frozen, but the tuning is started from the last checkpoints. Moreover, we adapted our base model on the full L2 Arctic dataset of accented speech and fine-tuned it for particular speakers and male and female genders separately. The models trained on the gender subsets obtained 1-2% higher accuracy when compared to the model tuned on the whole L2 Arctic dataset. Finally, we tested the concatenation of the pretrained x-vector voice embeddings and embeddings from a conventional encoder, but its gain in accuracy is not significant.
△ Less
Submitted 17 November, 2020; v1 submitted 8 October, 2020;
originally announced October 2020.
-
Fink, a new generation of broker for the LSST community
Authors:
Anais Möller,
Julien Peloton,
Emille E. O. Ishida,
Chris Arnault,
Etienne Bachelet,
Tristan Blaineau,
Dominique Boutigny,
Abhishek Chauhan,
Emmanuel Gangler,
Fabio Hernandez,
Julius Hrivnac,
Marco Leoni,
Nicolas Leroy,
Marc Moniez,
Sacha Pateyron,
Adrien Ramparison,
Damien Turpin,
Réza Ansari,
Tarek Allam Jr.,
Armelle Bajat,
Biswajit Biswas,
Alexandre Boucaud,
Johan Bregeon,
Jean-Eric Campagne,
Johann Cohen-Tanugi
, et al. (11 additional authors not shown)
Abstract:
Fink is a broker designed to enable science with large time-domain alert streams such as the one from the upcoming Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST). It exhibits traditional astronomy broker features such as automatised ingestion, annotation, selection and redistribution of promising alerts for transient science. It is also designed to go beyond traditional broker fe…
▽ More
Fink is a broker designed to enable science with large time-domain alert streams such as the one from the upcoming Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST). It exhibits traditional astronomy broker features such as automatised ingestion, annotation, selection and redistribution of promising alerts for transient science. It is also designed to go beyond traditional broker features by providing real-time transient classification which is continuously improved by using state-of-the-art Deep Learning and Adaptive Learning techniques. These evolving added values will enable more accurate scientific output from LSST photometric data for diverse science cases while also leading to a higher incidence of new discoveries which shall accompany the evolution of the survey. In this paper we introduce Fink, its science motivation, architecture and current status including first science verification cases using the Zwicky Transient Facility alert stream.
△ Less
Submitted 16 December, 2020; v1 submitted 21 September, 2020;
originally announced September 2020.
-
INTEGRAL discovery of a burst with associated radio emission from the magnetar SGR 1935+2154
Authors:
S. Mereghetti,
V. Savchenko,
C. Ferrigno,
D. Götz,
M. Rigoselli,
A. Tiengo,
A. Bazzano,
E. Bozzo,
A. Coleiro,
T. J. -L. Courvoisier,
M. Doyle,
A. Goldwurm,
L. Hanlon,
E. Jourdain,
A. von Kienlin,
A. Lutovinov,
A. Martin-Carrillo,
S. Molkov,
L. Natalucci,
F. Onori,
F. Panessa,
J. Rodi,
J. Rodriguez,
C. Sánchez-Fernández,
R. Sunyaev
, et al. (1 additional authors not shown)
Abstract:
We report on INTEGRAL observations of the soft $γ$-ray repeater SGR 1935+2154 performed between 2020 April 28 and May 3. Several short bursts with fluence of $\sim10^{-7}-10^{-6}$ erg cm$^{-2}$ were detected by the IBIS instrument in the 20-200 keV range. The burst with the hardest spectrum, discovered and localized in real time by the INTEGRAL Burst Alert System, was spatially and temporally coin…
▽ More
We report on INTEGRAL observations of the soft $γ$-ray repeater SGR 1935+2154 performed between 2020 April 28 and May 3. Several short bursts with fluence of $\sim10^{-7}-10^{-6}$ erg cm$^{-2}$ were detected by the IBIS instrument in the 20-200 keV range. The burst with the hardest spectrum, discovered and localized in real time by the INTEGRAL Burst Alert System, was spatially and temporally coincident with a short and very bright radio burst detected by the CHIME and STARE2 radio telescopes at 400-800 MHz and 1.4 GHz, respectively. Its lightcurve shows three narrow peaks separated by $\sim$29 ms time intervals, superimposed on a broad pulse lasting $\sim$0.6 s. The brightest peak had a delay of 6.5$\pm$1.0 ms with respect to the 1.4 GHz radio pulse (that coincides with the second and brightest component seen at lower frequencies). The burst spectrum, an exponentially cut-off power law with photon index $Γ=0.7_{-0.2}^{+0.4}$ and peak energy $E_p=65\pm5$ keV, is harder than those of the bursts usually observed from this and other magnetars. By the analysis of an expanding dust scattering ring seen in X-rays with the {\it Neil Gehrels Swift Observatory} XRT instrument, we derived a distance of 4.4$_{-1.3}^{+2.8}$ kpc for SGR 1935+2154, independent of its possible association with the supernova remnant G57.2+0.8. At this distance, the burst 20-200 keV fluence of $(6.1\pm 0.3)\times10^{-7}$ erg cm$^{-2}$ corresponds to an isotropic emitted energy of $\sim1.4\times10^{39}$ erg. This is the first burst with a radio counterpart observed from a soft $γ$-ray repeater and it strongly supports models based on magnetars that have been proposed for extragalactic fast radio bursts.
△ Less
Submitted 5 July, 2020; v1 submitted 13 May, 2020;
originally announced May 2020.
-
The lowest frequency Fast Radio Bursts: Sardinia Radio Telescope detection of the periodic FRB 180916 at 328 MHz
Authors:
M. Pilia,
M. Burgay,
A. Possenti,
A. Ridolfi,
V. Gajjar,
A. Corongiu,
D. Perrodin,
G. Bernardi,
G. Naldi,
G. Pupillo,
F. Ambrosino,
G. Bianchi,
A. Burtovoi,
P. Casella,
C. Casentini,
M. Cecconi,
C. Ferrigno,
M. Fiori,
K. C. Gendreau,
A. Ghedina,
G. Naletto,
L. Nicastro,
P. Ochner,
E. Palazzi,
F. Panessa
, et al. (13 additional authors not shown)
Abstract:
We report on the lowest-frequency detection to date of three bursts from the fast radio burst FRB 180916, observed at 328 MHz with the Sardinia Radio Telescope (SRT). The SRT observed the periodic repeater FRB 180916 for five days from 2020 February 20 to 24 during a time interval of active radio bursting, and detected the three bursts during the first hour of observations; no more bursts were det…
▽ More
We report on the lowest-frequency detection to date of three bursts from the fast radio burst FRB 180916, observed at 328 MHz with the Sardinia Radio Telescope (SRT). The SRT observed the periodic repeater FRB 180916 for five days from 2020 February 20 to 24 during a time interval of active radio bursting, and detected the three bursts during the first hour of observations; no more bursts were detected during the remaining ~ 30 hours. Simultaneous SRT observations at 1548 MHz did not detect any bursts. Burst fluences are in the range 37 to 13 Jy ms. No relevant scattering is observed for these bursts. We also present the results of the multi-wavelength campaign we performed on FRB 180916, during the five days of the active window. Simultaneously with the SRT observations, others with different time spans were performed with the Northern Cross at 408 MHz, with XMM-Newton, NICER, INTEGRAL, AGILE, and with the TNG and two optical telescopes in Asiago, which are equipped with fast photometers. XMM-Newton obtained data simultaneously with the three bursts detected by the SRT, and determined a luminosity upper limit in the 0.3-10 keV energy range of ~$10^{45}$ erg/s for the burst emission. AGILE obtained data simultaneously with the first burst and determined a fluence upper limit in the MeV range for millisecond timescales of $ 10^{-8}$ erg cm$^{-2}$.Our results show that absorption from the circumburst medium does not significantly affect the emission from FRB 180916, thus limiting the possible presence of a superluminous supernova around the source, and indicate that a cutoff for the bursting mechanism, if present, must be at lower frequencies. Our multi-wavelength campaign sensitively constrains the broadband emission from FRB 180916, and provides the best limits so far for the electromagnetic response to the radio bursting of this remarkable source of fast radio bursts.
△ Less
Submitted 3 July, 2020; v1 submitted 28 March, 2020;
originally announced March 2020.
-
An online data analysis system of INTEGRAL telescope
Authors:
A. Neronov,
V. Savchenko,
A. Tramacere,
M. Meharga,
C. Ferrigno,
S. Paltani
Abstract:
During more than 17 years of operation in space INTEGRAL telescope has accumulated large data set that contains records of hard X-ray and soft gamma-ray astronomical sources. These data can be re-used in the context of multi-wavelength or multi-messenger studies of astronomical sources and have to be preserved on long time scales. We present a scientific validation of an interactive online INTEGRA…
▽ More
During more than 17 years of operation in space INTEGRAL telescope has accumulated large data set that contains records of hard X-ray and soft gamma-ray astronomical sources. These data can be re-used in the context of multi-wavelength or multi-messenger studies of astronomical sources and have to be preserved on long time scales. We present a scientific validation of an interactive online INTEGRAL data analysis system for multi-wavelength studies of hard X-ray and soft gamma-ray sources. The online data analysis system generates publication-quality high-level data products: sky images, spectra and light-curves in response to user queries that define analysis parameters, such as source position, time and energy interval and binning. The data products can be requested via a web browser interface or via Application Programming Interface (API) available as a Python package. The analysis workflow organized to preserve and re-use various intermediate analysis products, ensuring that frequently requested results are available without delay. The platform can be deployed in any compatible infrastructure. We report the functionalities and performance of the online data analysis system by reproducing the benchmark INTEGRAL results on different types of sources, including bright steady and transient Galactic sources, and bright and weak variable extra-galactic sources. We compare the results obtained with the online data analysis system with previously published results on these sources. We consider the INTEGRAL online data analysis as a demonstrator of more general web-based "data analysis as a service" approach that provides a promising solution for preservation and maintenance of data analysis tools of astronomical telescopes on (multi)decade long time scales and facilitates combination of data in multi-wavelength and multi-messenger studies of astronomical sources.
△ Less
Submitted 9 March, 2021; v1 submitted 28 February, 2020;
originally announced February 2020.
-
Event Recognition with Automatic Album Detection based on Sequential Processing, Neural Attention and Image Captioning
Authors:
Andrey V. Savchenko
Abstract:
In this paper a new formulation of event recognition task is examined: it is required to predict event categories in a gallery of images, for which albums (groups of photos corresponding to a single event) are unknown. We propose the novel two-stage approach. At first, features are extracted in each photo using the pre-trained convolutional neural network. These features are classified individuall…
▽ More
In this paper a new formulation of event recognition task is examined: it is required to predict event categories in a gallery of images, for which albums (groups of photos corresponding to a single event) are unknown. We propose the novel two-stage approach. At first, features are extracted in each photo using the pre-trained convolutional neural network. These features are classified individually. The scores of the classifier are used to group sequential photos into several clusters. Finally, the features of photos in each group are aggregated into a single descriptor using neural attention mechanism. This algorithm is optionally extended to improve the accuracy for classification of each image in an album. In contrast to conventional fine-tuning of convolutional neural networks (CNN) we proposed to use image captioning, i.e., generative model that converts images to textual descriptions. They are one-hot encoded and summarized into sparse feature vector suitable for learning of arbitrary classifier. Experimental study with Photo Event Collection and Multi-Label Curation of Flickr Events Dataset demonstrates that our approach is 9-20% more accurate than event recognition on single photos. Moreover, proposed method has 13-16% lower error rate than classification of groups of photos obtained with hierarchical clustering. It is experimentally shown that the image captions trained on Conceptual Captions dataset can be classified more accurately than the features from object detector, though they both are obviously not as rich as the CNN-based features. However, it is possible to combine our approach with conventional CNNs in an ensemble to provide the state-of-the-art results for several event datasets.
△ Less
Submitted 15 January, 2020; v1 submitted 25 November, 2019;
originally announced November 2019.
-
Preferences Prediction using a Gallery of Mobile Device based on Scene Recognition and Object Detection
Authors:
A. V. Savchenko,
K. V. Demochkin,
I. S. Grechikhin
Abstract:
In this paper user modeling task is examined by processing a gallery of photos and videos on a mobile device. We propose novel engine for user preference prediction based on scene recognition, object detection and facial analysis. At first, all faces in a gallery are clustered and all private photos and videos with faces from large clusters are processed on the embedded system in offline mode. Oth…
▽ More
In this paper user modeling task is examined by processing a gallery of photos and videos on a mobile device. We propose novel engine for user preference prediction based on scene recognition, object detection and facial analysis. At first, all faces in a gallery are clustered and all private photos and videos with faces from large clusters are processed on the embedded system in offline mode. Other photos may be sent to the remote server to be analyzed by very deep models. The visual features of each photo are obtained from scene recognition and object detection models. These features are aggregated into a single user descriptor in the neural attention block. The proposed pipeline is implemented for the Android mobile platform. Experimental results with a subset of Photo Event Collection, Web Image Dataset for Event Recognition and Amazon Fashion datasets demonstrate the possibility to process images very efficiently without significant accuracy degradation. The source code of Android mobile application is publicly available at https://github.com/HSE-asavchenko/mobile-visual-preferences.
△ Less
Submitted 18 April, 2021; v1 submitted 10 July, 2019;
originally announced July 2019.
-
Follow-up of the Neutron Star Bearing Gravitational Wave Candidate Events S190425z and S190426c with MMT and SOAR
Authors:
G. Hosseinzadeh,
P. S. Cowperthwaite,
S. Gomez,
V. A. Villar,
M. Nicholl,
R. Margutti,
E. Berger,
R. Chornock,
K. Paterson,
W. Fong,
V. Savchenko,
P. Short,
K. D. Alexander,
P. K. Blanchard,
J. Braga,
M. L. Calkins,
R. Cartier,
D. L. Coppejans,
T. Eftekhari,
T. Laskar,
C. Ly,
L. Patton,
I. Pelisoli,
D. Reichart,
G. Terreran
, et al. (1 additional authors not shown)
Abstract:
On 2019 April 25.346 and 26.640 UT the LIGO and Virgo gravitational wave (GW) observatories announced the detection of the first candidate events in Observing Run 3 that contain at least one neutron star. S190425z is a likely binary neutron star (BNS) merger at $d_L = 156 \pm 41$ Mpc, while S190426c is possibly the first NS-BH merger ever detected, at $d_L = 377 \pm 100$ Mpc, although with margina…
▽ More
On 2019 April 25.346 and 26.640 UT the LIGO and Virgo gravitational wave (GW) observatories announced the detection of the first candidate events in Observing Run 3 that contain at least one neutron star. S190425z is a likely binary neutron star (BNS) merger at $d_L = 156 \pm 41$ Mpc, while S190426c is possibly the first NS-BH merger ever detected, at $d_L = 377 \pm 100$ Mpc, although with marginal statistical significance. Here we report our optical follow-up observations for both events using the MMT 6.5-m telescope, as well as our spectroscopic follow-up of candidate counterparts (which turned out to be unrelated) with the 4.1-m SOAR telescope. We compare to publicly reported searches, explore the overall areal coverage and depth, and evaluate those in relation to the optical/NIR kilonova emission from the BNS merger GW170817, to theoretical kilonova models, and to short GRB afterglows. We find that for a GW170817-like kilonova, the partial volume covered spans up to about 40% for S190425z and 60% for S190426c. For an on-axis jet typical of short GRBs, the search effective volume is larger, but such a configuration is expected in at most a few percent of mergers. We further find that wide-field $γ$-ray and X-ray limits rule out luminous on-axis SGRBs, for a large fraction of the localization regions, although these searches are not sufficiently deep in the context of the $γ$-ray emission from GW170817 or off-axis SGRB afterglows. The results indicate that some optical follow-up searches are sufficiently deep for counterpart identification to about 300 Mpc, but that localizations better than 1000 deg$^2$ are likely essential.
△ Less
Submitted 18 July, 2019; v1 submitted 6 May, 2019;
originally announced May 2019.
-
Compression of Recurrent Neural Networks for Efficient Language Modeling
Authors:
Artem M. Grachev,
Dmitry I. Ignatov,
Andrey V. Savchenko
Abstract:
Recurrent neural networks have proved to be an effective method for statistical language modeling. However, in practice their memory and run-time complexity are usually too large to be implemented in real-time offline mobile applications. In this paper we consider several compression techniques for recurrent neural networks including Long-Short Term Memory models. We make particular attention to t…
▽ More
Recurrent neural networks have proved to be an effective method for statistical language modeling. However, in practice their memory and run-time complexity are usually too large to be implemented in real-time offline mobile applications. In this paper we consider several compression techniques for recurrent neural networks including Long-Short Term Memory models. We make particular attention to the high-dimensional output problem caused by the very large vocabulary size. We focus on effective compression methods in the context of their exploitation on devices: pruning, quantization, and matrix decomposition approaches (low-rank factorization and tensor train decomposition, in particular). For each model we investigate the trade-off between its size, suitability for fast inference and perplexity. We propose a general pipeline for applying the most suitable methods to compress recurrent neural networks for language modeling. It has been shown in the experimental study with the Penn Treebank (PTB) dataset that the most efficient results in terms of speed and compression-perplexity balance are obtained by matrix decomposition techniques.
△ Less
Submitted 6 February, 2019;
originally announced February 2019.
-
The multi-outburst activity of the magnetar in Westerlund I
Authors:
A. Borghese,
N. Rea,
R. Turolla,
J. A. Pons,
P. Esposito,
F. Coti Zelati,
V. Savchenko,
E. Bozzo,
R. Perna,
S. Zane,
S. Mereghetti,
S. Campana,
R. P. Mignani,
M. Bachetti,
G. Rodriguez,
F. Pintore,
A. Tiengo,
D. Gotz,
G. L. Israel,
L. Stella
Abstract:
After two major outbursts in 2006 and 2011, on 2017 May 16 the magnetar CXOU J164710.2-455216, hosted within the massive star cluster Westerlund I, emitted a short (20 ms) burst, which marked the onset of a new active phase. We started a long-term monitoring campaign with Swift (45 observations), Chandra (5 observations) and NuSTAR (4 observations) from the activation until 2018 April. During the…
▽ More
After two major outbursts in 2006 and 2011, on 2017 May 16 the magnetar CXOU J164710.2-455216, hosted within the massive star cluster Westerlund I, emitted a short (20 ms) burst, which marked the onset of a new active phase. We started a long-term monitoring campaign with Swift (45 observations), Chandra (5 observations) and NuSTAR (4 observations) from the activation until 2018 April. During the campaign, Swift BAT registered the occurrence of multiple bursts, accompanied by two other enhancements of the X-ray persistent flux. The long time span covered by our observations allowed us to study the spectral as well as the timing evolution of the source. After 11 months since the 2017 May outburst onset, the observed flux was about 15 times higher than its historical minimum level and a factor of 3 higher than the level reached after the 2006 outburst. This suggests that the crust has not fully relaxed to the quiescent level, or that the source quiescent level has changed following the multiple outburst activities in the past 10 years or so. This is another case of multiple outbursts from the same source on a yearly time scale, a somehow recently discovered behaviour in magnetars.
△ Less
Submitted 7 January, 2019;
originally announced January 2019.
-
An embedded X-ray source shines through the aspherical AT2018cow: revealing the inner workings of the most luminous fast-evolving optical transients
Authors:
Raffaella Margutti,
B. D. Metzger,
R. Chornock,
I. Vurm,
N. Roth,
B. W. Grefenstette,
V. Savchenko,
R. Cartier,
J. F. Steiner,
G. Terreran,
G. Migliori,
D. Milisavljevic,
K. D. Alexander,
M. Bietenholz,
P. K. Blanchard,
E. Bozzo,
D. Brethauer,
I. V. Chilingarian,
D. L. Coppejans,
L. Ducci,
C. Ferrigno,
W. Fong,
D. GÖtz,
C. Guidorzi,
A. Hajela
, et al. (19 additional authors not shown)
Abstract:
We present the first extensive radio to gamma-ray observations of a fast-rising blue optical transient (FBOT), AT2018cow, over its first ~100 days. AT2018cow rose over a few days to a peak luminosity $L_{pk}\sim4\times 10^{44}$ erg/s exceeding those of superluminous supernovae (SNe), before declining as $\propto t^{-2}$. Initial spectra at $\lesssim 15$ days were mostly featureless and indicated l…
▽ More
We present the first extensive radio to gamma-ray observations of a fast-rising blue optical transient (FBOT), AT2018cow, over its first ~100 days. AT2018cow rose over a few days to a peak luminosity $L_{pk}\sim4\times 10^{44}$ erg/s exceeding those of superluminous supernovae (SNe), before declining as $\propto t^{-2}$. Initial spectra at $\lesssim 15$ days were mostly featureless and indicated large expansion velocities v~0.1c and temperatures reaching 30000 K. Later spectra revealed a persistent optically-thick photosphere and the emergence of H and He emission features with v~sim 4000 km/s with no evidence for ejecta cooling. Our broad-band monitoring revealed a hard X-ray spectral component at $E\ge 10$ keV, in addition to luminous and highly variable soft X-rays, with properties unprecedented among astronomical transients. An abrupt change in the X-ray decay rate and variability appears to accompany the change in optical spectral properties. AT2018cow showed bright radio emission consistent with the interaction of a blastwave with $v_{sh}$~0.1c with a dense environment ($\dot M\sim10^{-3}-10^{-4}\,M_{\odot}yr^{-1}$ for $v_w=1000$ km\s). While these properties exclude Ni-powered transients, our multi-wavelength analysis instead indicates that AT2018cow harbored a "central engine", either a compact object (magnetar or black hole) or an embedded internal shock produced by interaction with a compact, dense circumstellar medium. The engine released $\sim10^{50}-10^{51.5}$ erg over $\sim10^3-10^5$ s and resides within low-mass fast-moving material with equatorial-polar density asymmetry ($M_{ej,fast}\lesssim0.3\,\rm{M_{\odot}}$). Successful SNe from low-mass H-rich stars (like electron-capture SNe) or failed explosions from blue supergiants satisfy these constraints. Intermediate-mass black-holes are disfavored by the large environmental density probed by the radio observations.
△ Less
Submitted 25 October, 2018;
originally announced October 2018.
-
Efficient Facial Representations for Age, Gender and Identity Recognition in Organizing Photo Albums using Multi-output CNN
Authors:
Andrey V. Savchenko
Abstract:
This paper is focused on the automatic extraction of persons and their attributes (gender, year of born) from album of photos and videos. We propose the two-stage approach, in which, firstly, the convolutional neural network simultaneously predicts age/gender from all photos and additionally extracts facial representations suitable for face identification. We modified the MobileNet, which is preli…
▽ More
This paper is focused on the automatic extraction of persons and their attributes (gender, year of born) from album of photos and videos. We propose the two-stage approach, in which, firstly, the convolutional neural network simultaneously predicts age/gender from all photos and additionally extracts facial representations suitable for face identification. We modified the MobileNet, which is preliminarily trained to perform face recognition, in order to additionally recognize age and gender. In the second stage of our approach, extracted faces are grouped using hierarchical agglomerative clustering techniques. The born year and gender of a person in each cluster are estimated using aggregation of predictions for individual photos. We experimentally demonstrated that our facial clustering quality is competitive with the state-of-the-art neural networks, though our implementation is much computationally cheaper. Moreover, our approach is characterized by more accurate video-based age/gender recognition when compared to the publicly available models.
△ Less
Submitted 13 June, 2019; v1 submitted 20 July, 2018;
originally announced July 2018.
-
Gamma-Ray Observations of Nova Sgr 2015 No. 2 with INTEGRAL
Authors:
Thomas Siegert,
Alain Coc,
Laura Delgado,
Roland Diehl,
Jochen Greiner,
Margarita Hernanz,
Pierre Jean,
Jordi Jose,
Paolo Molaro,
Moritz M. M. Pleintinger,
Volodymyr Savchenko,
Sumner Starrfield,
Vincent Tatischeff,
Christoph Weinberger
Abstract:
INTEGRAL observed the nova V5668 Sgr around the time of its optical maximum on March 21, 2015. Studies at UV wavelengths showed spectral lines of freshly produced Be-7. This could be measurable also in gamma-rays at 478 keV from the decay to Li-7. Novae are also expected to synthesise Na-22 which decays to Ne-22, emitting a 1275 keV photon. About one week before the optical maximum, a strong gamma…
▽ More
INTEGRAL observed the nova V5668 Sgr around the time of its optical maximum on March 21, 2015. Studies at UV wavelengths showed spectral lines of freshly produced Be-7. This could be measurable also in gamma-rays at 478 keV from the decay to Li-7. Novae are also expected to synthesise Na-22 which decays to Ne-22, emitting a 1275 keV photon. About one week before the optical maximum, a strong gamma-ray flash on time-scales of hours is expected from short-lived radioactive nuclei, such as N-13 and F-18. These beta-plus-unstable nuclei should yield emission up to 511 keV, but which has never been observed. The spectrometer SPI aboard INTEGRAL pointed towards V5668 by chance. We use these observations to search for possible gamma-ray emission of decaying Be-7, and to directly measure the synthesised mass during explosive burning. We also aim to constrain possible burst-like emission days to weeks before the optical maximum using the SPI anticoincidence shield (ACS). We extract spectral and temporal information to determine the fluxes of gamma-ray lines at 478 keV, 511 keV, and 1275 keV. A measured flux value directly converts into abundances produced by the nova. The SPI-ACS rates are analysed for burst-like emission using a nova model light-curve. For the obtained nova flash candidate events, we discuss possible origins. No significant excess for the expected gamma-ray lines is found. Our upper limits on the synthesised Be-7 and Na-22 mass depend on the uncertainties of the distance to the nova: The Be-7 mass is constrained to less than $4.8\times10^{-9}\,(d/kpc)^2$, and Na-22 to less than $2.4\times10^{-8}\,(d/kpc)^2$ solar masses. For the Be-7 mass estimate from UV studies, the distance to V5668 Sgr must be larger than 1.2 kpc. During three weeks before the optical maximum, we find 23 burst-like events in the ACS rate, of which six could possibly be associated with V5668 Sgr.
△ Less
Submitted 19 March, 2018;
originally announced March 2018.
-
INTEGRAL results on the electromagnetic counterparts of gravitational waves
Authors:
S. Mereghetti,
V. Savchenko,
C. Ferrigno,
E. Kuulkers,
P. Ubertini,
A. Bazzano,
E. Bozzo,
S. Brandt,
J. Chenevez,
T. J. -L. Courvoisier,
R. Diehl,
L. Hanlon,
A. von Kienlin,
P. Laurent,
F. Lebrun,
A. Lutovinov,
A. Martin-Carrillo,
L. Natalucci,
J. P. Roques,
T. Siegert,
R. Sunyaev
Abstract:
Thanks to its high orbit and a set of complementary detectors providing continuous coverage of the whole sky, the INTEGRAL satellite has unique capabilities for the identification and study of the electromagnetic radiation associated to gravitational waves signals and, more generally, for multi-messenger astrophysics. Here we briefly review the results obtained during the first two observing runs…
▽ More
Thanks to its high orbit and a set of complementary detectors providing continuous coverage of the whole sky, the INTEGRAL satellite has unique capabilities for the identification and study of the electromagnetic radiation associated to gravitational waves signals and, more generally, for multi-messenger astrophysics. Here we briefly review the results obtained during the first two observing runs of the advanced LIGO/Virgo interferometers.
△ Less
Submitted 16 January, 2018;
originally announced January 2018.
-
Prospects about X- and gamma-ray counterparts of gravitational wave signals with INTEGRAL
Authors:
P. Bacon,
V. Savchenko,
E. Chassande-Mottin,
P. Laurent
Abstract:
By extrapolating the number of detections made during the first LIGO science run, tenths of gravitational wave signals from binary black hole mergers are anticipated in upcoming LIGO Virgo science runs. Finding an electromagnetic counterpart from compact binary merger events would be a capital achievement. We evaluate the ability of current wide-field X- and gamma-ray telescopes aboard INTEGRAL to…
▽ More
By extrapolating the number of detections made during the first LIGO science run, tenths of gravitational wave signals from binary black hole mergers are anticipated in upcoming LIGO Virgo science runs. Finding an electromagnetic counterpart from compact binary merger events would be a capital achievement. We evaluate the ability of current wide-field X- and gamma-ray telescopes aboard INTEGRAL to find such counterparts thanks to an end-to-end simulation for estimating the fraction of the sources that can be followed up and/or detected.
△ Less
Submitted 8 November, 2017;
originally announced November 2017.
-
INTEGRAL Detection of the First Prompt Gamma-Ray Signal Coincident with the Gravitational Wave Event GW170817
Authors:
V. Savchenko,
C. Ferrigno,
E. Kuulkers,
A. Bazzano,
E. Bozzo,
S. Brandt,
J. Chenevez,
T. J. -L. Courvoisier,
R. Diehl,
A. Domingo,
L. Hanlon,
E. Jourdain,
A. von Kienlin,
P. Laurent,
F. Lebrun,
A. Lutovinov,
A. Martin-Carrillo,
S. Mereghetti,
L. Natalucci,
J. Rodi,
J. -P. Roques,
R. Sunyaev,
P. Ubertini
Abstract:
We report the e INTernational Gamma-ray Astrophysics Laboratory (INTEGRAL) detection of the short gamma-ray burst GRB 170817A (discovered by Fermi-GBM) with a signal-to-noise ratio of 4.6, and, for the first time, its association with the gravitational waves (GWs) from binary neutron star (BNS) merging event GW170817 detected by the LIGO and Virgo observatories. The significance of association bet…
▽ More
We report the e INTernational Gamma-ray Astrophysics Laboratory (INTEGRAL) detection of the short gamma-ray burst GRB 170817A (discovered by Fermi-GBM) with a signal-to-noise ratio of 4.6, and, for the first time, its association with the gravitational waves (GWs) from binary neutron star (BNS) merging event GW170817 detected by the LIGO and Virgo observatories. The significance of association between the gamma-ray burst observed by INTEGRAL and GW170817 is 3.2 $σ$, while the association between the Fermi-GBM and INTEGRAL detections is 4.2 $σ$. GRB 170817A was detected by the SPI-ACS instrument about 2 s after the end of the gravitational wave event. We measure a fluence of $(1.4 \pm 0.4 \pm 0.6) \times$10$^{-7}$ erg cm$^{-2})$ (75--2000 keV), where, respectively, the statistical error is given at the 1 $σ$ confidence level, and the systematic error corresponds to the uncertainty in the spectral model and instrument response.
We also report on the pointed follow-up observations carried out by INTEGRAL, starting 19.5 h after the event, and lasting for 5.4 days. We provide a stringent upper limit on any electromagnetic signal in a very broad energy range, from 3 keV to 8 MeV, constraining the soft gamma-ray afterglow flux to $<7.1\times$10$^{-11}$ erg cm$^{-2}$ s$^{-1}$ (80--300 keV). Exploiting the unique capabilities of INTEGRAL, we constrained the gamma-ray line emission from radioactive decays that are expected to be the principal source of the energy behind a kilonova event following a BNS coalescence. Finally, we put a stringent upper limit on any delayed bursting activity, for example from a newly formed magnetar.
△ Less
Submitted 16 October, 2017;
originally announced October 2017.
-
Organizing Multimedia Data in Video Surveillance Systems Based on Face Verification with Convolutional Neural Networks
Authors:
Anastasiia D. Sokolova,
Angelina S. Kharchevnikova,
Andrey V. Savchenko
Abstract:
In this paper we propose the two-stage approach of organizing information in video surveillance systems. At first, the faces are detected in each frame and a video stream is split into sequences of frames with face region of one person. Secondly, these sequences (tracks) that contain identical faces are grouped using face verification algorithms and hierarchical agglomerative clustering. Gender an…
▽ More
In this paper we propose the two-stage approach of organizing information in video surveillance systems. At first, the faces are detected in each frame and a video stream is split into sequences of frames with face region of one person. Secondly, these sequences (tracks) that contain identical faces are grouped using face verification algorithms and hierarchical agglomerative clustering. Gender and age are estimated for each cluster (person) in order to facilitate the usage of the organized video collection. The particular attention is focused on the aggregation of features extracted from each frame with the deep convolutional neural networks. The experimental results of the proposed approach using YTF and IJB-A datasets demonstrated that the most accurate and fast solution is achieved for matching of normalized average of feature vectors of all frames in a track.
△ Less
Submitted 17 September, 2017;
originally announced September 2017.
-
Recombination of radiation defects in solid methane - neutron sources and cryo-volcanism on celestial bodies
Authors:
O. Kirichek,
E. V. Savchenko,
C. R. Lawson,
I. V. Khyzhniy,
D. M. Jenkins,
S. A. Uyutnov,
M. A. Bludov,
D. J. Haynes
Abstract:
Physicochemical properties of solid methane exposed to ionizing radiation have attracted significant interest in recent years. Here we present new trends in the study of radiation effects in solid methane. We particularly focus on relaxation phenomena in solid methane pre-irradiated by energetic neutrons and electron beam. We compare experimental results obtained in the temperature range from 10K…
▽ More
Physicochemical properties of solid methane exposed to ionizing radiation have attracted significant interest in recent years. Here we present new trends in the study of radiation effects in solid methane. We particularly focus on relaxation phenomena in solid methane pre-irradiated by energetic neutrons and electron beam. We compare experimental results obtained in the temperature range from 10K to 100K with a model based on the assumption that radiolysis defect recombinations happen in two stages, at two different temperatures. In the case of slow heating up of the solid methane sample, irradiated at 10K, the first wave of recombination occurs around 20K with a further second wave taking place between 50 and 60K. We also discuss the role of the recombination mechanisms in burp phenomenon discovered by J. Carpenter in the late 1980s. An understanding of these mechanisms is vital for the designing and operation of solid methane moderators used in advanced neutron sources and could also be a possible explanation for the driving forces behind cryo-volcanism on celestial bodies.
△ Less
Submitted 26 August, 2017;
originally announced September 2017.
-
Group-level Emotion Recognition using Transfer Learning from Face Identification
Authors:
Alexandr G. Rassadin,
Alexey S. Gruzdev,
Andrey V. Savchenko
Abstract:
In this paper, we describe our algorithmic approach, which was used for submissions in the fifth Emotion Recognition in the Wild (EmotiW 2017) group-level emotion recognition sub-challenge. We extracted feature vectors of detected faces using the Convolutional Neural Network trained for face identification task, rather than traditional pre-training on emotion recognition problems. In the final pip…
▽ More
In this paper, we describe our algorithmic approach, which was used for submissions in the fifth Emotion Recognition in the Wild (EmotiW 2017) group-level emotion recognition sub-challenge. We extracted feature vectors of detected faces using the Convolutional Neural Network trained for face identification task, rather than traditional pre-training on emotion recognition problems. In the final pipeline an ensemble of Random Forest classifiers was learned to predict emotion score using available training set. In case when the faces have not been detected, one member of our ensemble extracts features from the whole image. During our experimental study, the proposed approach showed the lowest error rate when compared to other explored techniques. In particular, we achieved 75.4% accuracy on the validation data, which is 20% higher than the handcrafted feature-based baseline. The source code using Keras framework is publicly available.
△ Less
Submitted 30 October, 2017; v1 submitted 6 September, 2017;
originally announced September 2017.
-
Maximum A Posteriori Estimation of Distances Between Deep Features in Still-to-Video Face Recognition
Authors:
Andrey V. Savchenko,
Natalya S. Belova
Abstract:
The paper deals with the still-to-video face recognition for the small sample size problem based on computation of distances between high-dimensional deep bottleneck features. We present the novel statistical recognition method, in which the still-to-video recognition task is casted into Maximum A Posteriori estimation. In this method we maximize the joint probabilistic density of the distances to…
▽ More
The paper deals with the still-to-video face recognition for the small sample size problem based on computation of distances between high-dimensional deep bottleneck features. We present the novel statistical recognition method, in which the still-to-video recognition task is casted into Maximum A Posteriori estimation. In this method we maximize the joint probabilistic density of the distances to all reference still images. It is shown that this likelihood can be estimated with the known asymptotically normal distribution of the Kullback-Leibler discriminations between nonnegative features. The experimental study with the LFW (Labeled Faces in the Wild), YTF (YouTube Faces) and IJB-A (IARPA Janus Benchmark A) datasets has been provided. We demonstrated, that the proposed approach can be applied with the state-of-the-art deep features and dissimilarity measures. Our algorithm achieves 3-5% higher accuracy when compared with conventional aggregation of decisions obtained for all frames.
△ Less
Submitted 26 August, 2017;
originally announced August 2017.
-
Neural Networks Compression for Language Modeling
Authors:
Artem M. Grachev,
Dmitry I. Ignatov,
Andrey V. Savchenko
Abstract:
In this paper, we consider several compression techniques for the language modeling problem based on recurrent neural networks (RNNs). It is known that conventional RNNs, e.g, LSTM-based networks in language modeling, are characterized with either high space complexity or substantial inference time. This problem is especially crucial for mobile applications, in which the constant interaction with…
▽ More
In this paper, we consider several compression techniques for the language modeling problem based on recurrent neural networks (RNNs). It is known that conventional RNNs, e.g, LSTM-based networks in language modeling, are characterized with either high space complexity or substantial inference time. This problem is especially crucial for mobile applications, in which the constant interaction with the remote server is inappropriate. By using the Penn Treebank (PTB) dataset we compare pruning, quantization, low-rank factorization, tensor train decomposition for LSTM networks in terms of model size and suitability for fast inference.
△ Less
Submitted 20 August, 2017;
originally announced August 2017.
-
INTEGRAL observations of GW170104
Authors:
V. Savchenko,
C. Ferrigno,
E. Bozzo,
A. Bazzano,
S. Brandt,
J. Chenevez,
T. J. -L. Courvoisier,
R. Diehl,
L. Hanlon,
A. von Kienlin,
E. Kuulkers,
P. Laurent,
F. Lebrun,
A. Lutovinov,
A. Martin-Carillo,
S. Mereghetti,
J. P. Roques,
R. Sunyaev,
P. Ubertini
Abstract:
We used data from the INTErnational Gamma-Ray Astrophysics Laboratory (INTEGRAL) to set upper-limits on the $γ$-ray and hard X-ray prompt emission associated with the gravitational wave event GW170104, discovered by the LIGO/Virgo collaboration. The unique omni-directional viewing capability of the instruments on-board INTEGRAL allowed us to examine the full 90% confidence level localization regio…
▽ More
We used data from the INTErnational Gamma-Ray Astrophysics Laboratory (INTEGRAL) to set upper-limits on the $γ$-ray and hard X-ray prompt emission associated with the gravitational wave event GW170104, discovered by the LIGO/Virgo collaboration. The unique omni-directional viewing capability of the instruments on-board INTEGRAL allowed us to examine the full 90% confidence level localization region of the LIGO trigger. Depending on the particular spectral model assumed and the specific position within this region, the upper limits inferred from the INTEGRAL observations range from F$γ$=1.9x10-7 erg cm-2 to F$γ$=10-6 erg cm-2 (75 keV - 2 MeV energy range). This translates into a ratio between the prompt energy released in $γ$-rays along the direction to the observer and the gravitational wave energy of E$γ$/EGW <2.6x10-5 . Using the INTEGRAL results, we can not confirm the $γ$-ray proposed counterpart to GW170104 by the AGILE team with the MCAL instrument. The reported flux of the AGILE/MCAL event, E2, is not compatible with the INTEGRAL upper limits within most of the 90% LIGO localization region. There is only a relatively limited portion of the sky where the sensitivity of the INTEGRAL instruments was not optimal and the lowest allowed fluence estimated for E2 would still be compatible with the INTEGRAL results. This region was also observed independently by Fermi/GBM and AstroSAT, from which, as far as we are aware, there are no reports of any significant detection of a prompt high-energy event.
△ Less
Submitted 18 August, 2017; v1 submitted 12 July, 2017;
originally announced July 2017.