-
Source Tracing of Audio Deepfake Systems
Authors:
Nicholas Klein,
Tianxiang Chen,
Hemlata Tak,
Ricardo Casal,
Elie Khoury
Abstract:
Recent progress in generative AI technology has made audio deepfakes remarkably more realistic. While current research on anti-spoofing systems primarily focuses on assessing whether a given audio sample is fake or genuine, there has been limited attention on discerning the specific techniques to create the audio deepfakes. Algorithms commonly used in audio deepfake generation, like text-to-speech…
▽ More
Recent progress in generative AI technology has made audio deepfakes remarkably more realistic. While current research on anti-spoofing systems primarily focuses on assessing whether a given audio sample is fake or genuine, there has been limited attention on discerning the specific techniques to create the audio deepfakes. Algorithms commonly used in audio deepfake generation, like text-to-speech (TTS) and voice conversion (VC), undergo distinct stages including input processing, acoustic modeling, and waveform generation. In this work, we introduce a system designed to classify various spoofing attributes, capturing the distinctive features of individual modules throughout the entire generation pipeline. We evaluate our system on two datasets: the ASVspoof 2019 Logical Access and the Multi-Language Audio Anti-Spoofing Dataset (MLAAD). Results from both experiments demonstrate the robustness of the system to identify the different spoofing attributes of deepfake generation systems.
△ Less
Submitted 10 July, 2024;
originally announced July 2024.
-
Temporal convolutional networks and transformers for classifying the sleep stage in awake or asleep using pulse oximetry signals
Authors:
Ramiro Casal,
Leandro E. Di Persia,
Gastón Schlotthauer
Abstract:
Sleep disorders are very widespread in the world population and suffer from a generalized underdiagnosis, given the complexity of their diagnostic methods. Therefore, there is an increasing interest in developing simpler screening methods. A pulse oximeter is an ideal device for sleep disorder screenings since it is a portable, low-cost and accessible technology. This device can provide an estimat…
▽ More
Sleep disorders are very widespread in the world population and suffer from a generalized underdiagnosis, given the complexity of their diagnostic methods. Therefore, there is an increasing interest in developing simpler screening methods. A pulse oximeter is an ideal device for sleep disorder screenings since it is a portable, low-cost and accessible technology. This device can provide an estimation of the heart rate (HR), which can be useful to obtain information regarding the sleep stage. In this work, we developed a network architecture with the aim of classifying the sleep stage in awake or asleep using only HR signals from a pulse oximeter. The proposed architecture has two fundamental parts. The first part has the objective of obtaining a representation of the HR by using temporal convolutional networks. Then, the obtained representation is used to feed the second part, which is based on transformers, a model built solely with attention mechanisms. Transformers are able to model the sequence, learning the transition rules between sleep stages. The performance of the proposed method was evaluated on Sleep Heart Health Study dataset, composed of 5000 healthy and pathological subjects. The dataset was split into three subsets: 2500 for training, $1250$ for validating, and 1250 for testing. The overall accuracy, specificity, sensibility, and Cohen's Kappa coefficient were 90.0%, 94.9%, 78.1%, and 0.73.
△ Less
Submitted 29 January, 2021;
originally announced February 2021.
-
Classifying sleep-wake stages through recurrent neural networks using pulse oximetry signals
Authors:
Ramiro Casal,
Leandro E. Di Persia,
Gastón Schlotthauer
Abstract:
The regulation of the autonomic nervous system changes with the sleep stages causing variations in the physiological variables. We exploit these changes with the aim of classifying the sleep stages in awake or asleep using pulse oximeter signals. We applied a recurrent neural network to heart rate and peripheral oxygen saturation signals to classify the sleep stage every 30 seconds. The network ar…
▽ More
The regulation of the autonomic nervous system changes with the sleep stages causing variations in the physiological variables. We exploit these changes with the aim of classifying the sleep stages in awake or asleep using pulse oximeter signals. We applied a recurrent neural network to heart rate and peripheral oxygen saturation signals to classify the sleep stage every 30 seconds. The network architecture consists of two stacked layers of bidirectional gated recurrent units (GRUs) and a softmax layer to classify the output. In this paper, we used 5000 patients from the Sleep Heart Health Study dataset. 2500 patients were used to train the network, and two subsets of 1250 were used to validate and test the trained models. In the test stage, the best result obtained was 90.13% accuracy, 94.13% sensitivity, 80.26% specificity, 92.05% precision, and 84.68% negative predictive value. Further, the Cohen's Kappa coefficient was 0.74 and the average absolute error percentage to the actual sleep time was 8.9%. The performance of the proposed network is comparable with the state-of-the-art algorithms when they use much more informative signals (except those with EEG).
△ Less
Submitted 7 August, 2020;
originally announced August 2020.
-
On Estimating the Perimeter Using the Alpha-Shape
Authors:
Ery Arias-Castro,
Alberto Rodríguez Casal
Abstract:
We consider the problem of estimating the perimeter of a smooth domain in the plane based on a sample from the uniform distribution over the domain. We study the performance of the estimator defined as the perimeter of the alpha-shape of the sample. Some numerical experiments corroborate our theoretical findings.
We consider the problem of estimating the perimeter of a smooth domain in the plane based on a sample from the uniform distribution over the domain. We study the performance of the estimator defined as the perimeter of the alpha-shape of the sample. Some numerical experiments corroborate our theoretical findings.
△ Less
Submitted 30 June, 2015;
originally announced July 2015.
-
Recovering the shape of a point cloud in the plane
Authors:
Beatriz Pateiro-López,
Alberto Rodríguez Casal
Abstract:
In this work we deal with the problem of support estimation under shape restrictions. The shape restriction we deal with is an extension of the notion of convexity named alpha-convexity. Instead of assuming, as in the convex case, the existence of a separating hyperplane for each exterior point we assume the existence of a separating open ball with radius alpha. Given an alpha-convex set S, the al…
▽ More
In this work we deal with the problem of support estimation under shape restrictions. The shape restriction we deal with is an extension of the notion of convexity named alpha-convexity. Instead of assuming, as in the convex case, the existence of a separating hyperplane for each exterior point we assume the existence of a separating open ball with radius alpha. Given an alpha-convex set S, the alpha-convex hull of independent random points in S is the natural estimator of the set. If alpha is unknown the r_n-convex hull of the sample can be considered. We analyze the asymptotic properties of the r_n-convex hull estimator in the bidimensional case and obtain the convergence rate for the expected distance in measure between the set and the estimator. The geometrical complexity of the estimator and its dependence on r_n is also obtained via the analysis of the expected number of vertices of the r_n-convex hull.
△ Less
Submitted 30 May, 2011;
originally announced May 2011.
