Showing 101–150 of 1,057 results for author: Tran, M

Multi-modal Facial Action Unit Detection with Large Pre-trained Models for the 5th Competition on Affective Behavior Analysis in-the-wild

Authors: Yufeng Yin, Minh Tran, Di Chang, Xinrui Wang, Mohammad Soleymani

Abstract: Facial action unit detection has emerged as an important task within facial expression analysis, aimed at detecting specific pre-defined, objective facial expressions, such as lip tightening and cheek raising. This paper presents our submission to the Affective Behavior Analysis in-the-wild (ABAW) 2023 Competition for AU detection. We propose a multi-modal method for facial action unit detection w… ▽ More Facial action unit detection has emerged as an important task within facial expression analysis, aimed at detecting specific pre-defined, objective facial expressions, such as lip tightening and cheek raising. This paper presents our submission to the Affective Behavior Analysis in-the-wild (ABAW) 2023 Competition for AU detection. We propose a multi-modal method for facial action unit detection with visual, acoustic, and lexical features extracted from the large pre-trained models. To provide high-quality details for visual feature extraction, we apply super-resolution and face alignment to the training data and show potential performance gain. Our approach achieves the F1 score of 52.3% on the official validation set of the 5th ABAW Challenge. △ Less

Submitted 17 April, 2023; v1 submitted 19 March, 2023; originally announced March 2023.

Comments: 8 pages, 7 figures, 5 tables

Learning for Amalgamation: A Multi-Source Transfer Learning Framework For Sentiment Classification

Authors: Cuong V. Nguyen, Khiem H. Le, Anh M. Tran, Quang H. Pham, Binh T. Nguyen

Abstract: Transfer learning plays an essential role in Deep Learning, which can remarkably improve the performance of the target domain, whose training data is not sufficient. Our work explores beyond the common practice of transfer learning with a single pre-trained model. We focus on the task of Vietnamese sentiment classification and propose LIFA, a framework to learn a unified embedding from several pre… ▽ More Transfer learning plays an essential role in Deep Learning, which can remarkably improve the performance of the target domain, whose training data is not sufficient. Our work explores beyond the common practice of transfer learning with a single pre-trained model. We focus on the task of Vietnamese sentiment classification and propose LIFA, a framework to learn a unified embedding from several pre-trained models. We further propose two more LIFA variants that encourage the pre-trained models to either cooperate or compete with one another. Studying these variants sheds light on the success of LIFA by showing that sharing knowledge among the models is more beneficial for transfer learning. Moreover, we construct the AISIA-VN-Review-F dataset, the first large-scale Vietnamese sentiment classification database. We conduct extensive experiments on the AISIA-VN-Review-F and existing benchmarks to demonstrate the efficacy of LIFA compared to other techniques. To contribute to the Vietnamese NLP research, we publish our source code and datasets to the research community upon acceptance. △ Less

Submitted 16 March, 2023; originally announced March 2023.

Comments: Information Sciences

Theory of transition from brittle to ductile fracture

Authors: Khanh Chau Le, Hyeonyeong Jeong, Tuan Minh Tran

Abstract: In this paper, two improvements to the theory of transition from brittle to ductile fracture developed by Langer are proposed. First, considering the drastic temperature rise near the crack tip, the temperature dependence of the shear modulus is included to better quantify the thermally sensitive dislocation entanglement. Second, the parameters of the improved theory are identified by the large sc… ▽ More In this paper, two improvements to the theory of transition from brittle to ductile fracture developed by Langer are proposed. First, considering the drastic temperature rise near the crack tip, the temperature dependence of the shear modulus is included to better quantify the thermally sensitive dislocation entanglement. Second, the parameters of the improved theory are identified by the large scale least squares method. The comparison between the fracture toughness predicted by the theory and the values obtained in Gumbsch's experiments for tungsten at different temperatures shows good agreement. △ Less

Submitted 5 May, 2023; v1 submitted 15 March, 2023; originally announced March 2023.

Comments: 7 pages, 4 figures

Locality and Error Mitigation of Quantum Circuits

Authors: Minh C. Tran, Kunal Sharma, Kristan Temme

Abstract: In this work, we study and improve two leading error mitigation techniques, namely Probabilistic Error Cancellation (PEC) and Zero-Noise Extrapolation (ZNE), for estimating the expectation value of local observables. For PEC, we introduce a new estimator that takes into account the light cone of the unitary circuit with respect to a target local observable. Given a fixed error tolerance, the sampl… ▽ More In this work, we study and improve two leading error mitigation techniques, namely Probabilistic Error Cancellation (PEC) and Zero-Noise Extrapolation (ZNE), for estimating the expectation value of local observables. For PEC, we introduce a new estimator that takes into account the light cone of the unitary circuit with respect to a target local observable. Given a fixed error tolerance, the sampling overhead for the new estimator can be several orders of magnitude smaller than the standard PEC estimators. For ZNE, we also use light-cone arguments to establish an error bound that closely captures the behavior of the bias that remains after extrapolation. △ Less

Submitted 11 March, 2023; originally announced March 2023.

Data, Data, Everywhere: Uncovering Everyday Data Experiences for People with Intellectual and Developmental Disabilities

Authors: Keke Wu, Michelle H Tran, Emma Petersen, Varsha Koushik, Danielle Albers Szafir

Abstract: Data is everywhere but may not be accessible to everyone. Conventional data visualization tools and guidelines often do not actively consider the specific needs and abilities of people with Intellectual and Developmental Disabilities (IDD), leaving them excluded from data-driven activities and vulnerable to ethical issues. To understand the needs and challenges people with IDD have with data, we c… ▽ More Data is everywhere but may not be accessible to everyone. Conventional data visualization tools and guidelines often do not actively consider the specific needs and abilities of people with Intellectual and Developmental Disabilities (IDD), leaving them excluded from data-driven activities and vulnerable to ethical issues. To understand the needs and challenges people with IDD have with data, we conducted 15 semi-structured interviews with individuals with IDD and their caregivers. Our algorithmic interview approach situated data in the lived experiences of people with IDD to uncover otherwise hidden data encounters in their everyday life. Drawing on findings and observations, we characterize how they conceptualize data, when and where they use data, and what barriers exist when they interact with data. We use our results as a lens to reimagine the role of visualization in data accessibility and establish a critical near-term research agenda for cognitively accessible visualization. △ Less

Submitted 9 March, 2023; originally announced March 2023.

Journal ref: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23), April 23-28, 2023, Hamburg, Germany

MaskDiff: Modeling Mask Distribution with Diffusion Probabilistic Model for Few-Shot Instance Segmentation

Authors: Minh-Quan Le, Tam V. Nguyen, Trung-Nghia Le, Thanh-Toan Do, Minh N. Do, Minh-Triet Tran

Abstract: Few-shot instance segmentation extends the few-shot learning paradigm to the instance segmentation task, which tries to segment instance objects from a query image with a few annotated examples of novel categories. Conventional approaches have attempted to address the task via prototype learning, known as point estimation. However, this mechanism depends on prototypes (\eg mean of $K-$shot) for pr… ▽ More Few-shot instance segmentation extends the few-shot learning paradigm to the instance segmentation task, which tries to segment instance objects from a query image with a few annotated examples of novel categories. Conventional approaches have attempted to address the task via prototype learning, known as point estimation. However, this mechanism depends on prototypes (\eg mean of $K-$shot) for prediction, leading to performance instability. To overcome the disadvantage of the point estimation mechanism, we propose a novel approach, dubbed MaskDiff, which models the underlying conditional distribution of a binary mask, which is conditioned on an object region and $K-$shot information. Inspired by augmentation approaches that perturb data with Gaussian noise for populating low data density regions, we model the mask distribution with a diffusion probabilistic model. We also propose to utilize classifier-free guided mask sampling to integrate category information into the binary mask generation process. Without bells and whistles, our proposed method consistently outperforms state-of-the-art methods on both base and novel classes of the COCO dataset while simultaneously being more stable than existing methods. The source code is available at: https://github.com/minhquanlecs/MaskDiff. △ Less

Submitted 21 January, 2024; v1 submitted 9 March, 2023; originally announced March 2023.

Comments: Accepted at AAAI 2024 (oral presentation)

An Inception-Residual-Based Architecture with Multi-Objective Loss for Detecting Respiratory Anomalies

Authors: Dat Ngo, Lam Pham, Huy Phan, Minh Tran, Delaram Jarchi, Sefki Kolozali

Abstract: This paper presents a deep learning system applied for detecting anomalies from respiratory sound recordings. Initially, our system begins with audio feature extraction using Gammatone and Continuous Wavelet transformation. This step aims to transform the respiratory sound input into a two-dimensional spectrogram where both spectral and temporal features are presented. Then, our proposed system in… ▽ More This paper presents a deep learning system applied for detecting anomalies from respiratory sound recordings. Initially, our system begins with audio feature extraction using Gammatone and Continuous Wavelet transformation. This step aims to transform the respiratory sound input into a two-dimensional spectrogram where both spectral and temporal features are presented. Then, our proposed system integrates Inception-residual-based backbone models combined with multi-head attention and multi-objective loss to classify respiratory anomalies. Instead of applying a simple concatenation approach by combining results from various spectrograms, we propose a Linear combination, which has the ability to regulate equally the contribution of each individual spectrogram throughout the training process. To evaluate the performance, we conducted experiments over the benchmark dataset of SPRSound (The Open-Source SJTU Paediatric Respiratory Sound) proposed by the IEEE BioCAS 2022 challenge. As regards the Score computed by an average between the average score and harmonic score, our proposed system gained significant improvements of 9.7%, 15.8%, 17.8%, and 16.1% in Task 1-1, Task 1-2, Task 2-1, and Task 2-2, respectively, compared to the challenge baseline system. Notably, we achieved the Top-1 performance in Task 2-1 and Task 2-2 with the highest Score of 74.5% and 53.9%, respectively. △ Less

Submitted 19 June, 2023; v1 submitted 7 March, 2023; originally announced March 2023.

Optical Signatures of Strain Differences in Epitaxial Graphene Nanoribbons

Authors: Heather M. Hill, Ching-Chen Yeh, Swapnil M. Mhatre, Ngoc Thanh Mai Tran, Hanbyul Jin, Adam J. Biacchi, Chi-Te Liang, Angela R. Hight Walker, Albert F. Rigosi

Abstract: We demonstrate the preparation of both armchair and zigzag epitaxial graphene nanoribbons (GNRs) on 4H-SiC using a polymer-assisted, sublimation growth method. Historically, the preparation of GNRs depended on the quality, or smoothness, of the surface changes during growth. The physical phenomenon of terrace step formation introduces the risk of GNR deformation along sidewalls, but the risk is he… ▽ More We demonstrate the preparation of both armchair and zigzag epitaxial graphene nanoribbons (GNRs) on 4H-SiC using a polymer-assisted, sublimation growth method. Historically, the preparation of GNRs depended on the quality, or smoothness, of the surface changes during growth. The physical phenomenon of terrace step formation introduces the risk of GNR deformation along sidewalls, but the risk is heavily mitigated by this polymer-assisted sublimation method. Two widths (100 nm and 50 nm) are examined electrically and optically for both armchair and zigzag GNRs. Our electrical results support the expected behaviors of the GNRs, while the optical signatures of variable strain reveal the subtle differences among all the GNR species measured. △ Less

Submitted 28 February, 2023; originally announced February 2023.

Practical Analyses of How Common Social Media Platforms and Photo Storage Services Handle Uploaded Images

Authors: Duc-Tien Dang-Nguyen, Vegard Velle Sjøen, Dinh-Hai Le, Thien-Phu Dao, Anh-Duy Tran, Minh-Triet Tran

Abstract: The research done in this study has delved deeply into the changes made to digital images that are uploaded to three of the major social media platforms and image storage services in today's society: Facebook, Flickr, and Google Photos. In addition to providing up-to-date data on an ever-changing landscape of different social media networks' digital fingerprints, a deep analysis of the social netw… ▽ More The research done in this study has delved deeply into the changes made to digital images that are uploaded to three of the major social media platforms and image storage services in today's society: Facebook, Flickr, and Google Photos. In addition to providing up-to-date data on an ever-changing landscape of different social media networks' digital fingerprints, a deep analysis of the social networks' filename conventions has resulted in two new approaches in (i) estimating the true upload date of Flickr photos, regardless of whether the dates have been changed by the user or not, and regardless of whether the image is available to the public or has been deleted from the platform; (ii) revealing the photo ID of a photo uploaded to Facebook based solely on the file name of the photo. △ Less

Submitted 23 February, 2023; originally announced February 2023.

Bayesian Inference for Evidence Accumulation Models with Regressors

Authors: Viet Hung Dao, David Gunawan, Robert Kohn, Minh-Ngoc Tran, Guy E. Hawkins, Scott D. Brown

Abstract: Evidence accumulation models (EAMs) are an important class of cognitive models used to analyze both response time and response choice data recorded from decision-making tasks. Developments in estimation procedures have helped EAMs become important both in basic scientific applications and solution-focussed applied work. Hierarchical Bayesian estimation frameworks for the linear ballistic accumulat… ▽ More Evidence accumulation models (EAMs) are an important class of cognitive models used to analyze both response time and response choice data recorded from decision-making tasks. Developments in estimation procedures have helped EAMs become important both in basic scientific applications and solution-focussed applied work. Hierarchical Bayesian estimation frameworks for the linear ballistic accumulator model (LBA) and the diffusion decision model (DDM) have been widely used, but still suffer from some key limitations, particularly for large sample sizes, for models with many parameters, and when linking decision-relevant covariates to model parameters. We extend upon previous work with methods for estimating the LBA and DDM in hierarchical Bayesian frameworks that include random effects which are correlated between people, and include regression-model links between decision-relevant covariates and model parameters. Our methods work equally well in cases where the covariates are measured once per person (e.g., personality traits or psychological tests) or once per decision (e.g., neural or physiological data). We provide methods for exact Bayesian inference, using particle-based MCMC, and also approximate methods based on variational Bayesian (VB) inference. The VB methods are sufficiently fast and efficient that they can address large-scale estimation problems, such as with very large data sets. We evaluate the performance of these methods in applications to data from three existing experiments. Detailed algorithmic implementations and code are freely available for all methods. △ Less

Submitted 31 May, 2023; v1 submitted 20 February, 2023; originally announced February 2023.

Comments: 92 pages including supplement, 29 figures, 6 tables

Deep Learning Enhanced Realized GARCH

Authors: Chen Liu, Chao Wang, Minh-Ngoc Tran, Robert Kohn

Abstract: We propose a new approach to volatility modeling by combining deep learning (LSTM) and realized volatility measures. This LSTM-enhanced realized GARCH framework incorporates and distills modeling advances from financial econometrics, high frequency trading data and deep learning. Bayesian inference via the Sequential Monte Carlo method is employed for statistical inference and forecasting. The new… ▽ More We propose a new approach to volatility modeling by combining deep learning (LSTM) and realized volatility measures. This LSTM-enhanced realized GARCH framework incorporates and distills modeling advances from financial econometrics, high frequency trading data and deep learning. Bayesian inference via the Sequential Monte Carlo method is employed for statistical inference and forecasting. The new framework can jointly model the returns and realized volatility measures, has an excellent in-sample fit and superior predictive performance compared to several benchmark models, while being able to adapt well to the stylized facts in volatility. The performance of the new framework is tested using a wide range of metrics, from marginal likelihood, volatility forecasting, to tail risk forecasting and option pricing. We report on a comprehensive empirical study using 31 widely traded stock indices over a time period that includes COVID-19 pandemic. △ Less

Submitted 17 October, 2023; v1 submitted 15 February, 2023; originally announced February 2023.

Comments: 47 pages, 12 tables

Error Correction of Quantum Algorithms: Arbitrarily Accurate Recovery Of Noisy Quantum Signal Processing

Authors: Andrew K. Tan, Yuan Liu, Minh C. Tran, Isaac L. Chuang

Abstract: The intrinsic probabilistic nature of quantum systems makes error correction or mitigation indispensable for quantum computation. While current error-correcting strategies focus on correcting errors in quantum states or quantum gates, these fine-grained error-correction methods can incur significant overhead for quantum algorithms of increasing complexity. We present a first step in achieving erro… ▽ More The intrinsic probabilistic nature of quantum systems makes error correction or mitigation indispensable for quantum computation. While current error-correcting strategies focus on correcting errors in quantum states or quantum gates, these fine-grained error-correction methods can incur significant overhead for quantum algorithms of increasing complexity. We present a first step in achieving error correction at the level of quantum algorithms by combining a unified perspective on modern quantum algorithms via quantum signal processing (QSP). An error model of under- or over-rotation of the signal processing operator parameterized by $ε< 1$ is introduced. It is shown that while Pauli $Z$-errors are not recoverable without additional resources, Pauli $X$ and $Y$ errors can be arbitrarily suppressed by coherently appending a noisy `recovery QSP.' Furthermore, it is found that a recovery QSP of length $O(2^k c^{k^2} d)$ is sufficient to correct any length-$d$ QSP with $c$ unique phases to $k^{th}$-order in error $ε$. Allowing an additional assumption, a lower bound of $Ω(cd)$ is shown, which is tight for $k = 1$, on the length of the recovery sequence. Our algorithmic-level error correction method is applied to Grover's fixed-point search algorithm as a demonstration. △ Less

Submitted 20 January, 2023; originally announced January 2023.

Report number: MIT-CTP/5521

On the wave turbulence theory for the beam wave equation

Authors: Gigliola Staffilani, Minh-Binh Tran

Abstract: Starting from the beam wave equation, which has a Schrödinger structure, on a hypercubic lattice of size $L$, with weak nonlinearity of strength $λ$, we show that the two point correlation function can be asymptotically expressed as the solution of the 3-wave kinetic equation at the kinetic limit under very general assumptions. The limit is taken in the physical order: first taking $L\to\infty$, t… ▽ More Starting from the beam wave equation, which has a Schrödinger structure, on a hypercubic lattice of size $L$, with weak nonlinearity of strength $λ$, we show that the two point correlation function can be asymptotically expressed as the solution of the 3-wave kinetic equation at the kinetic limit under very general assumptions. The limit is taken in the physical order: first taking $L\to\infty$, then letting $λ\to0$. The initial condition is assumed out of equilibrium and the physical dimension is $d= 3$. The combination of previous works on the derivations of the wave kinetic equations from the lattice ZK equation [42,74] (with stochasticity, due to the singularity of the lattice ZK dispersion relation) and the present work (without stochasticity, thanks to the Schrödinger structure) give a detailed and general picture of how sensitive the kinetic descriptions are with respect to the regularities of the dispersion relations in the physical order of taking the limits. In terms of technical novelties, the current paper introduces new tools that produce the first obtained control of the Duhamel expansions when the number of collisions is of order $\mathcal{O}(λ^{-γ})$ (with $γ>0$) in the nonlinear context. To the best of our knowledge, such a strong control is a major step in understanding the long time dynamics of weakly nonlinear interactions of waves, and until now it could only be achieved in the linear context (see the work of Erdos-Salmhofer-Yau [34]). △ Less

Submitted 26 January, 2023; v1 submitted 19 January, 2023; originally announced January 2023.

Comments: Some of the proofs need some revisions. New version will be posted later

Multi Kernel Positional Embedding ConvNeXt for Polyp Segmentation

Authors: Trong-Hieu Nguyen Mau, Quoc-Huy Trinh, Nhat-Tan Bui, Minh-Triet Tran, Hai-Dang Nguyen

Abstract: Medical image segmentation is the technique that helps doctor view and has a precise diagnosis, particularly in Colorectal Cancer. Specifically, with the increase in cases, the diagnosis and identification need to be faster and more accurate for many patients; in endoscopic images, the segmentation task has been vital to helping the doctor identify the position of the polyps or the ache in the sys… ▽ More Medical image segmentation is the technique that helps doctor view and has a precise diagnosis, particularly in Colorectal Cancer. Specifically, with the increase in cases, the diagnosis and identification need to be faster and more accurate for many patients; in endoscopic images, the segmentation task has been vital to helping the doctor identify the position of the polyps or the ache in the system correctly. As a result, many efforts have been made to apply deep learning to automate polyp segmentation, mostly to ameliorate the U-shape structure. However, the simple skip connection scheme in UNet leads to deficient context information and the semantic gap between feature maps from the encoder and decoder. To deal with this problem, we propose a novel framework composed of ConvNeXt backbone and Multi Kernel Positional Embedding block. Thanks to the suggested module, our method can attain better accuracy and generalization in the polyps segmentation task. Extensive experiments show that our model achieves the Dice coefficient of 0.8818 and the IOU score of 0.8163 on the Kvasir-SEG dataset. Furthermore, on various datasets, we make competitive achievement results with other previous state-of-the-art methods. △ Less

Submitted 15 June, 2023; v1 submitted 16 January, 2023; originally announced January 2023.

L-SeqSleepNet: Whole-cycle Long Sequence Modelling for Automatic Sleep Staging

Authors: Huy Phan, Kristian P. Lorenzen, Elisabeth Heremans, Oliver Y. Chén, Minh C. Tran, Philipp Koch, Alfred Mertins, Mathias Baumert, Kaare Mikkelsen, Maarten De Vos

Abstract: Human sleep is cyclical with a period of approximately 90 minutes, implying long temporal dependency in the sleep data. Yet, exploring this long-term dependency when developing sleep staging models has remained untouched. In this work, we show that while encoding the logic of a whole sleep cycle is crucial to improve sleep staging performance, the sequential modelling approach in existing state-of… ▽ More Human sleep is cyclical with a period of approximately 90 minutes, implying long temporal dependency in the sleep data. Yet, exploring this long-term dependency when developing sleep staging models has remained untouched. In this work, we show that while encoding the logic of a whole sleep cycle is crucial to improve sleep staging performance, the sequential modelling approach in existing state-of-the-art deep learning models are inefficient for that purpose. We thus introduce a method for efficient long sequence modelling and propose a new deep learning model, L-SeqSleepNet, which takes into account whole-cycle sleep information for sleep staging. Evaluating L-SeqSleepNet on four distinct databases of various sizes, we demonstrate state-of-the-art performance obtained by the model over three different EEG setups, including scalp EEG in conventional Polysomnography (PSG), in-ear EEG, and around-the-ear EEG (cEEGrid), even with a single EEG channel input. Our analyses also show that L-SeqSleepNet is able to alleviate the predominance of N2 sleep (the major class in terms of classification) to bring down errors in other sleep stages. Moreover the network becomes much more robust, meaning that for all subjects where the baseline method had exceptionally poor performance, their performance are improved significantly. Finally, the computation time only grows at a sub-linear rate when the sequence length increases. △ Less

Submitted 4 August, 2023; v1 submitted 9 January, 2023; originally announced January 2023.

Comments: This article has been published in IEEE Journal of Biomedical and Health Informatics (JBHI). Source code is available at http://github.com/pquochuy/l-seqsleepnet

Simulating neutrino oscillations on a superconducting qutrit

Authors: Ha C. Nguyen, Bao G. Bach, Tien D. Nguyen, Duc M. Tran, Duy V. Nguyen, Hung Q. Nguyen

Abstract: Precise measurements of parameters in the PMNS framework might lead to new physics beyond the Standard Model. However, they are incredibly challenging to determine in neutrino oscillation experiments. Quantum simulations can be a powerful supplementary tool to study these phenomenologies. In today's noisy quantum hardware, encoding neutrinos in a multi-qubit system requires a redundant basis and t… ▽ More Precise measurements of parameters in the PMNS framework might lead to new physics beyond the Standard Model. However, they are incredibly challenging to determine in neutrino oscillation experiments. Quantum simulations can be a powerful supplementary tool to study these phenomenologies. In today's noisy quantum hardware, encoding neutrinos in a multi-qubit system requires a redundant basis and tricky entangling gates. We encode a three-flavor neutrino in a superconducting qutrit and study its oscillations using PMNS theory with time evolution expressed in terms of single qutrit gates. The qutrit is engineered from the multi-level structure of IBM transmon devices. High-fidelity gate control and readout are fine-tuned using programming microwave pulses using a high-level language. Our quantum simulations on real hardware match well to analytical calculations in three oscillation cases: vacuum, interaction with matter, and CP-violation. △ Less

Submitted 10 February, 2023; v1 submitted 28 December, 2022; originally announced December 2022.

Measuring Arbitrary Physical Properties in Analog Quantum Simulation

Authors: Minh C. Tran, Daniel K. Mark, Wen Wei Ho, Soonwon Choi

Abstract: A central challenge in analog quantum simulation is to characterize desirable physical properties of quantum states produced in experiments. However, in conventional approaches, the extraction of arbitrary information requires performing measurements in many different bases, which necessitates a high level of control that present-day quantum devices may not have. Here, we propose and analyze a sca… ▽ More A central challenge in analog quantum simulation is to characterize desirable physical properties of quantum states produced in experiments. However, in conventional approaches, the extraction of arbitrary information requires performing measurements in many different bases, which necessitates a high level of control that present-day quantum devices may not have. Here, we propose and analyze a scalable protocol that leverages the ergodic nature of generic quantum dynamics, enabling the efficient extraction of many physical properties. The protocol does not require sophisticated controls and can be generically implemented in analog quantum simulation platforms today. Our protocol involves introducing ancillary degrees of freedom in a predetermined state to a system of interest, quenching the joint system under Hamiltonian dynamics native to the particular experimental platform, and then measuring globally in a single, fixed basis. We show that arbitrary information of the original quantum state is contained within such measurement data, and can be extracted using a classical data-processing procedure. We numerically demonstrate our approach with a number of examples, including the measurements of entanglement entropy, many-body Chern number, and various superconducting orders in systems of neutral atom arrays, bosonic and fermionic particles on optical lattices, respectively, only assuming existing technological capabilities. Our protocol excitingly promises to overcome limited controllability and, thus, enhance the versatility and utility of near-term quantum technologies. △ Less

Submitted 31 March, 2023; v1 submitted 5 December, 2022; originally announced December 2022.

Report number: MIT-CTP/5503

Journal ref: Phys. Rev. X 13, 011049 (2023)

Meta Learning for Few-Shot Medical Text Classification

Authors: Pankaj Sharma, Imran Qureshi, Minh Tran

Abstract: Medical professionals frequently work in a data constrained setting to provide insights across a unique demographic. A few medical observations, for instance, informs the diagnosis and treatment of a patient. This suggests a unique setting for meta-learning, a method to learn models quickly on new tasks, to provide insights unattainable by other methods. We investigate the use of meta-learning and… ▽ More Medical professionals frequently work in a data constrained setting to provide insights across a unique demographic. A few medical observations, for instance, informs the diagnosis and treatment of a patient. This suggests a unique setting for meta-learning, a method to learn models quickly on new tasks, to provide insights unattainable by other methods. We investigate the use of meta-learning and robustness techniques on a broad corpus of benchmark text and medical data. To do this, we developed new data pipelines, combined language models with meta-learning approaches, and extended existing meta-learning algorithms to minimize worst case loss. We find that meta-learning on text is a suitable framework for text-based data, providing better data efficiency and comparable performance to few-shot language models and can be successfully applied to medical note data. Furthermore, meta-learning models coupled with DRO can improve worst case loss across disease codes. △ Less

Submitted 3 December, 2022; originally announced December 2022.

Multilingual Communication System with Deaf Individuals Utilizing Natural and Visual Languages

Authors: Tuan-Luc Huynh, Khoi-Nguyen Nguyen-Ngoc, Chi-Bien Chu, Minh-Triet Tran, Trung-Nghia Le

Abstract: According to the World Federation of the Deaf, more than two hundred sign languages exist. Therefore, it is challenging to understand deaf individuals, even proficient sign language users, resulting in a barrier between the deaf community and the rest of society. To bridge this language barrier, we propose a novel multilingual communication system, namely MUGCAT, to improve the communication effic… ▽ More According to the World Federation of the Deaf, more than two hundred sign languages exist. Therefore, it is challenging to understand deaf individuals, even proficient sign language users, resulting in a barrier between the deaf community and the rest of society. To bridge this language barrier, we propose a novel multilingual communication system, namely MUGCAT, to improve the communication efficiency of sign language users. By converting recognized specific hand gestures into expressive pictures, which is universal usage and language independence, our MUGCAT system significantly helps deaf people convey their thoughts. To overcome the limitation of sign language usage, which is mostly impossible to translate into complete sentences for ordinary people, we propose to reconstruct meaningful sentences from the incomplete translation of sign language. We also measure the semantic similarity of generated sentences with fragmented recognized hand gestures to keep the original meaning. Experimental results show that the proposed system can work in a real-time manner and synthesize exquisite stunning illustrations and meaningful sentences from a few hand gestures of sign language. This proves that our MUGCAT has promising potential in assisting deaf communication. △ Less

Submitted 1 December, 2022; originally announced December 2022.

On the complexity of implementing Trotter steps

Authors: Guang Hao Low, Yuan Su, Yu Tong, Minh C. Tran

Abstract: Quantum dynamics can be simulated on a quantum computer by exponentiating elementary terms from the Hamiltonian in a sequential manner. However, such an implementation of Trotter steps has gate complexity depending on the total Hamiltonian term number, comparing unfavorably to algorithms using more advanced techniques. We develop methods to perform faster Trotter steps with complexity sublinear in… ▽ More Quantum dynamics can be simulated on a quantum computer by exponentiating elementary terms from the Hamiltonian in a sequential manner. However, such an implementation of Trotter steps has gate complexity depending on the total Hamiltonian term number, comparing unfavorably to algorithms using more advanced techniques. We develop methods to perform faster Trotter steps with complexity sublinear in the number of terms. We achieve this for a class of Hamiltonians whose interaction strength decays with distance according to power law. Our methods include one based on a recursive block encoding and one based on an average-cost simulation, overcoming the normalization-factor barrier of these advanced quantum simulation techniques. We also realize faster Trotter steps when certain blocks of Hamiltonian coefficients have low rank. Combining with a tighter error analysis, we show that it suffices to use $\left(η^{1/3}n^{1/3}+\frac{n^{2/3}}{η^{2/3}}\right)n^{1+o(1)}$ gates to simulate uniform electron gas with $n$ spin orbitals and $η$ electrons in second quantization in real space, asymptotically improving over the best previous work. We obtain an analogous result when the external potential of nuclei is introduced under the Born-Oppenheimer approximation. We prove a circuit lower bound when the Hamiltonian coefficients take a continuum range of values, showing that generic $n$-qubit $2$-local Hamiltonians with commuting terms require at least $Ω(n^2)$ gates to evolve with accuracy $ε=Ω(1/poly(n))$ for time $t=Ω(ε)$. Our proof is based on a gate-efficient reduction from the approximate synthesis of diagonal unitaries within the Hamming weight-$2$ subspace, which may be of independent interest. Our result thus suggests the use of Hamiltonian structural properties as both necessary and sufficient to implement Trotter steps with lower gate complexity. △ Less

Submitted 11 May, 2023; v1 submitted 16 November, 2022; originally announced November 2022.

Comments: 69 pages, 7 figures. Tightened gate complexity analysis with no amplitude amplification prefactors. Discussed ancilla space complexity. Added master theorem analysis of the recursive low-rank algorithm. Enhanced version of the article published in PRX Quantum at https://journals.aps.org/prxquantum/abstract/10.1103/PRXQuantum.4.020323

Journal ref: PRX Quantum 4, 020323 (2023)

A Generalized Muirhead Inequality and Symmetric Sums of Nonnegative Circuits

Authors: Janin Heuer, Ngoc Mai Tran, Timo de Wolff

Abstract: Circuit polynomials are a certificate of nonnegativity for real polynomials, which can be derived via a generalization of the classical inequality of arithmetic and geometric means. In this article, we show that similarly nonnegativity of symmetric real polynomials can be certified via a generalization of the classical Muirhead inequality. Moreover, we show that a nonnegative symmetric polynomial… ▽ More Circuit polynomials are a certificate of nonnegativity for real polynomials, which can be derived via a generalization of the classical inequality of arithmetic and geometric means. In this article, we show that similarly nonnegativity of symmetric real polynomials can be certified via a generalization of the classical Muirhead inequality. Moreover, we show that a nonnegative symmetric polynomial admits a decomposition into sums of nonnegative circuit polynomials if and only if it satisfies said generalized Muirhead condition. The latter re-proves a result by Moustrou, Naumann, Riener, Theobald, and Verdure for the case of the symmetric group in a shortened and more elementary way. △ Less

Submitted 14 November, 2022; originally announced November 2022.

Comments: 16 pages

MSC Class: 12D15; 13J30; 14P99; 20B30; 26D15; 90C23

On the wave turbulence theory for a stochastic KdV type equation -- Generalization for the inhomogeneous kinetic limit

Authors: Amirali Hannani, Matthew Rosenzweig, Gigliola Staffilani, Minh-Binh Tran

Abstract: Starting from a stochastic Zakharov-Kuznetsov (ZK) equation on a lattice, the previous work [ST21] by the last two authors gave a derivation of the homogeneous 3-wave kinetic equation at the kinetic limit under very general assumptions: the initial condition is out of equilibrium, the dimension $d\ge 2$, the smallness of the nonlinearity $λ$ is allowed to be independent of the size of the lattice,… ▽ More Starting from a stochastic Zakharov-Kuznetsov (ZK) equation on a lattice, the previous work [ST21] by the last two authors gave a derivation of the homogeneous 3-wave kinetic equation at the kinetic limit under very general assumptions: the initial condition is out of equilibrium, the dimension $d\ge 2$, the smallness of the nonlinearity $λ$ is allowed to be independent of the size of the lattice, the weak noise is chosen not to compete with the weak nonlinearity and not to inject energy into the equation. In the present work, we build on the framework of [ST21], following the formal derivation of Spohn [Spo06] and inspired by previous work [HO21] of the first author and Olla, so that the inhomogeneous 3-wave kinetic equation can also be obtained at the kinetic limit under analogous assumptions. Similar to the homogeneous case -- and unlike the cubic nonlinear Schrödinger equation -- the inhomogeneous kinetic description of the deterministic lattice ZK equation is unlikely to happen due to the vanishing of the dispersion relation on a certain singular manifold on which not only $3$-wave interactions but also all $n$-wave interactions ($n\ge3$) are allowed to happen, a phenomenon first observed by Lukkarinen [Luk07]. To the best of our knowledge, our work provides the first rigorous derivation of a nonlinear inhomogeneous wave kinetic equation in the kinetic limit. △ Less

Submitted 8 November, 2022; v1 submitted 31 October, 2022; originally announced October 2022.

Comments: arXiv admin note: substantial text overlap with arXiv:2106.09819

AISFormer: Amodal Instance Segmentation with Transformer

Authors: Minh Tran, Khoa Vo, Kashu Yamazaki, Arthur Fernandes, Michael Kidd, Ngan Le

Abstract: Amodal Instance Segmentation (AIS) aims to segment the region of both visible and possible occluded parts of an object instance. While Mask R-CNN-based AIS approaches have shown promising results, they are unable to model high-level features coherence due to the limited receptive field. The most recent transformer-based models show impressive performance on vision tasks, even better than Convoluti… ▽ More Amodal Instance Segmentation (AIS) aims to segment the region of both visible and possible occluded parts of an object instance. While Mask R-CNN-based AIS approaches have shown promising results, they are unable to model high-level features coherence due to the limited receptive field. The most recent transformer-based models show impressive performance on vision tasks, even better than Convolution Neural Networks (CNN). In this work, we present AISFormer, an AIS framework, with a Transformer-based mask head. AISFormer explicitly models the complex coherence between occluder, visible, amodal, and invisible masks within an object's regions of interest by treating them as learnable queries. Specifically, AISFormer contains four modules: (i) feature encoding: extract ROI and learn both short-range and long-range visual features. (ii) mask transformer decoding: generate the occluder, visible, and amodal mask query embeddings by a transformer decoder (iii) invisible mask embedding: model the coherence between the amodal and visible masks, and (iv) mask predicting: estimate output masks including occluder, visible, amodal and invisible. We conduct extensive experiments and ablation studies on three challenging benchmarks i.e. KINS, D2SA, and COCOA-cls to evaluate the effectiveness of AISFormer. The code is available at: https://github.com/UARK-AICV/AISFormer △ Less

Submitted 17 March, 2024; v1 submitted 12 October, 2022; originally announced October 2022.

Comments: Accepted to BMVC2022

Effects of charge doping on Mott insulator with strong spin-orbit coupling, Ba$_2$NaOsO$_6$

Authors: E. Garcia, R. Cong, P. C. Forino, A. Tassetti, G. Allodi, A. P. Reyes, P. M. Tran, P. M. Woodward, C. Franchini, S. Sanna, V. F. Mitrović

Abstract: The effects of doping on the electronic evolution of the Mott insulating state have been extensively studied in efforts to understand mechanisms of emergent quantum phases of materials. The study of these effects becomes ever more intriguing in the presence of entanglement between spin and orbital degrees of freedom. Here, we present a comprehensive investigation of charge doping in the double per… ▽ More The effects of doping on the electronic evolution of the Mott insulating state have been extensively studied in efforts to understand mechanisms of emergent quantum phases of materials. The study of these effects becomes ever more intriguing in the presence of entanglement between spin and orbital degrees of freedom. Here, we present a comprehensive investigation of charge doping in the double perovskite Ba$_2$NaOsO$_6$, a a complex Mott insulator where such entanglement plays an important role. We establish that the insulating magnetic ground state evolves from canted antiferromagnet (cAF)to Néel order for dopant levels exceeding ~ 10 %. Furthermore, we determine that a broken local point symmetry (BLPS) phase, precursor to the magnetically ordered state, occupies an extended portion of the (H-T) phase diagram with increased doping. This finding reveals that the breaking of the local cubic symmetry is driven by a multipolar order, most-likely of the antiferro-quadrupolar type. △ Less

Submitted 23 November, 2022; v1 submitted 10 October, 2022; originally announced October 2022.

EmbryosFormer: Deformable Transformer and Collaborative Encoding-Decoding for Embryos Stage Development Classification

Authors: Tien-Phat Nguyen, Trong-Thang Pham, Tri Nguyen, Hieu Le, Dung Nguyen, Hau Lam, Phong Nguyen, Jennifer Fowler, Minh-Triet Tran, Ngan Le

Abstract: The timing of cell divisions in early embryos during the In-Vitro Fertilization (IVF) process is a key predictor of embryo viability. However, observing cell divisions in Time-Lapse Monitoring (TLM) is a time-consuming process and highly depends on experts. In this paper, we propose EmbryosFormer, a computational model to automatically detect and classify cell divisions from original time-lapse im… ▽ More The timing of cell divisions in early embryos during the In-Vitro Fertilization (IVF) process is a key predictor of embryo viability. However, observing cell divisions in Time-Lapse Monitoring (TLM) is a time-consuming process and highly depends on experts. In this paper, we propose EmbryosFormer, a computational model to automatically detect and classify cell divisions from original time-lapse images. Our proposed network is designed as an encoder-decoder deformable transformer with collaborative heads. The transformer contracting path predicts per-image labels and is optimized by a classification head. The transformer expanding path models the temporal coherency between embryo images to ensure monotonic non-decreasing constraint and is optimized by a segmentation head. Both contracting and expanding paths are synergetically learned by a collaboration head. We have benchmarked our proposed EmbryosFormer on two datasets: a public dataset with mouse embryos with 8-cell stage and an in-house dataset with human embryos with 4-cell stage. Source code: https://github.com/UARK-AICV/Embryos. △ Less

Submitted 6 October, 2022; originally announced October 2022.

Comments: Accepted at WACV 2023

AOE-Net: Entities Interactions Modeling with Adaptive Attention Mechanism for Temporal Action Proposals Generation

Authors: Khoa Vo, Sang Truong, Kashu Yamazaki, Bhiksha Raj, Minh-Triet Tran, Ngan Le

Abstract: Temporal action proposal generation (TAPG) is a challenging task, which requires localizing action intervals in an untrimmed video. Intuitively, we as humans, perceive an action through the interactions between actors, relevant objects, and the surrounding environment. Despite the significant progress of TAPG, a vast majority of existing methods ignore the aforementioned principle of the human per… ▽ More Temporal action proposal generation (TAPG) is a challenging task, which requires localizing action intervals in an untrimmed video. Intuitively, we as humans, perceive an action through the interactions between actors, relevant objects, and the surrounding environment. Despite the significant progress of TAPG, a vast majority of existing methods ignore the aforementioned principle of the human perceiving process by applying a backbone network into a given video as a black-box. In this paper, we propose to model these interactions with a multi-modal representation network, namely, Actors-Objects-Environment Interaction Network (AOE-Net). Our AOE-Net consists of two modules, i.e., perception-based multi-modal representation (PMR) and boundary-matching module (BMM). Additionally, we introduce adaptive attention mechanism (AAM) in PMR to focus only on main actors (or relevant objects) and model the relationships among them. PMR module represents each video snippet by a visual-linguistic feature, in which main actors and surrounding environment are represented by visual information, whereas relevant objects are depicted by linguistic features through an image-text model. BMM module processes the sequence of visual-linguistic features as its input and generates action proposals. Comprehensive experiments and extensive ablation studies on ActivityNet-1.3 and THUMOS-14 datasets show that our proposed AOE-Net outperforms previous state-of-the-art methods with remarkable performance and generalization for both TAPG and temporal action detection. To prove the robustness and effectiveness of AOE-Net, we further conduct an ablation study on egocentric videos, i.e. EPIC-KITCHENS 100 dataset. Source code is available upon acceptance. △ Less

Submitted 5 October, 2022; originally announced October 2022.

Comments: Accepted for publication in International Journal of Computer Vision

Towards Safe Mechanical Ventilation Treatment Using Deep Offline Reinforcement Learning

Authors: Flemming Kondrup, Thomas Jiralerspong, Elaine Lau, Nathan de Lara, Jacob Shkrob, My Duc Tran, Doina Precup, Sumana Basu

Abstract: Mechanical ventilation is a key form of life support for patients with pulmonary impairment. Healthcare workers are required to continuously adjust ventilator settings for each patient, a challenging and time consuming task. Hence, it would be beneficial to develop an automated decision support tool to optimize ventilation treatment. We present DeepVent, a Conservative Q-Learning (CQL) based offli… ▽ More Mechanical ventilation is a key form of life support for patients with pulmonary impairment. Healthcare workers are required to continuously adjust ventilator settings for each patient, a challenging and time consuming task. Hence, it would be beneficial to develop an automated decision support tool to optimize ventilation treatment. We present DeepVent, a Conservative Q-Learning (CQL) based offline Deep Reinforcement Learning (DRL) agent that learns to predict the optimal ventilator parameters for a patient to promote 90 day survival. We design a clinically relevant intermediate reward that encourages continuous improvement of the patient vitals as well as addresses the challenge of sparse reward in RL. We find that DeepVent recommends ventilation parameters within safe ranges, as outlined in recent clinical trials. The CQL algorithm offers additional safety by mitigating the overestimation of the value estimates of out-of-distribution states/actions. We evaluate our agent using Fitted Q Evaluation (FQE) and demonstrate that it outperforms physicians from the MIMIC-III dataset. △ Less

Submitted 5 October, 2022; originally announced October 2022.

Comments: to be published in IAAI (Innovative Applications of Artificial Intelligence) 2023

Predicting the Future of AI with AI: High-quality link prediction in an exponentially growing knowledge network

Authors: Mario Krenn, Lorenzo Buffoni, Bruno Coutinho, Sagi Eppel, Jacob Gates Foster, Andrew Gritsevskiy, Harlin Lee, Yichao Lu, Joao P. Moutinho, Nima Sanjabi, Rishi Sonthalia, Ngoc Mai Tran, Francisco Valente, Yangxinyu Xie, Rose Yu, Michael Kopp

Abstract: A tool that could suggest new personalized research directions and ideas by taking insights from the scientific literature could significantly accelerate the progress of science. A field that might benefit from such an approach is artificial intelligence (AI) research, where the number of scientific publications has been growing exponentially over the last years, making it challenging for human re… ▽ More A tool that could suggest new personalized research directions and ideas by taking insights from the scientific literature could significantly accelerate the progress of science. A field that might benefit from such an approach is artificial intelligence (AI) research, where the number of scientific publications has been growing exponentially over the last years, making it challenging for human researchers to keep track of the progress. Here, we use AI techniques to predict the future research directions of AI itself. We develop a new graph-based benchmark based on real-world data -- the Science4Cast benchmark, which aims to predict the future state of an evolving semantic network of AI. For that, we use more than 100,000 research papers and build up a knowledge network with more than 64,000 concept nodes. We then present ten diverse methods to tackle this task, ranging from pure statistical to pure learning methods. Surprisingly, the most powerful methods use a carefully curated set of network features, rather than an end-to-end AI approach. It indicates a great potential that can be unleashed for purely ML approaches without human knowledge. Ultimately, better predictions of new future research directions will be a crucial component of more advanced research suggestion tools. △ Less

Submitted 23 September, 2022; originally announced October 2022.

Comments: 13 pages, 7 figures. Comments welcome!

Journal ref: Nature Machine Intelligence 5, 1326 (2023)

Enhancing Detection of Topological Order by Local Error Correction

Authors: Iris Cong, Nishad Maskara, Minh C. Tran, Hannes Pichler, Giulia Semeghini, Susanne F. Yelin, Soonwon Choi, Mikhail D. Lukin

Abstract: The exploration of topologically-ordered states of matter is a long-standing goal at the interface of several subfields of the physical sciences. Such states feature intriguing physical properties such as long-range entanglement, emergent gauge fields and non-local correlations, and can aid in realization of scalable fault-tolerant quantum computation. However, these same features also make creati… ▽ More The exploration of topologically-ordered states of matter is a long-standing goal at the interface of several subfields of the physical sciences. Such states feature intriguing physical properties such as long-range entanglement, emergent gauge fields and non-local correlations, and can aid in realization of scalable fault-tolerant quantum computation. However, these same features also make creation, detection, and characterization of topologically-ordered states particularly challenging. Motivated by recent experimental demonstrations, we introduce a new paradigm for quantifying topological states -- locally error-corrected decoration (LED) -- by combining methods of error correction with ideas of renormalization-group flow. Our approach allows for efficient and robust identification of topological order, and is applicable in the presence of incoherent noise sources, making it particularly suitable for realistic experiments. We demonstrate the power of LED using numerical simulations of the toric code under a variety of perturbations. We subsequently apply it to an experimental realization, providing new insights into a quantum spin liquid created on a Rydberg-atom simulator. Finally, we extend LED to generic topological phases, including those with non-abelian order. △ Less

Submitted 30 July, 2023; v1 submitted 26 September, 2022; originally announced September 2022.

Comments: Corrected minor typos. Added new results on generalizations to non-abelian topological phases, and connections between LED and topological entanglement negativity

Report number: MIT-CTP/5462

Journal ref: Nat Commun 15, 1527 (2024)

A Deep Learning Approximation of Non-Stationary Solutions to Wave Kinetic Equations

Authors: Steven Walton, Minh-Binh Tran, Alain Bensoussan

Abstract: We present a deep learning approximation, stochastic optimization based, method for wave kinetic equations. To build confidence in our approach, we apply the method to a Smoluchowski coagulation equation with multiplicative kernel for which an analytic solution exists. Our deep learning approach is then used to approximate the non-stationary solution to a 3-wave kinetic equation corresponding to a… ▽ More We present a deep learning approximation, stochastic optimization based, method for wave kinetic equations. To build confidence in our approach, we apply the method to a Smoluchowski coagulation equation with multiplicative kernel for which an analytic solution exists. Our deep learning approach is then used to approximate the non-stationary solution to a 3-wave kinetic equation corresponding to acoustic wave systems. To validate the neural network approximation, we compare the decay rate of the total energy with previously obtained theoretical results. A finite volume solution is presented and compared with the present method. △ Less

Submitted 25 September, 2022; originally announced September 2022.

Increased success probability in Hardy's nonlocality: Theory and demonstration

Authors: Duc Minh Tran, Van-Duy Nguyen, Le Bin Ho, Hung Q. Nguyen

Abstract: Depending on the way one measures, quantum nonlocality might manifest more visibly. Using basis transformations and interactions on a particle pair, Hardy logically argued that any local hidden variable theory leads to a paradox. Extended from the original work, we introduce a quantum nonlocal scheme for n-particle systems using two distinct approaches. First, a theoretical model is derived with a… ▽ More Depending on the way one measures, quantum nonlocality might manifest more visibly. Using basis transformations and interactions on a particle pair, Hardy logically argued that any local hidden variable theory leads to a paradox. Extended from the original work, we introduce a quantum nonlocal scheme for n-particle systems using two distinct approaches. First, a theoretical model is derived with analytical results for Hardy's nonlocality conditions and probability. Second, a quantum simulation using quantum circuits is constructed that matches very well to the analytical theory. When demonstrated on real quantum computers for n=3, we obtain reasonable results compared to theory. Even at macroscopic scales as n grows, the success probability asymptotes 15.6%, which is stronger than previous results. △ Less

Submitted 30 March, 2023; v1 submitted 12 September, 2022; originally announced September 2022.

Comments: 4 pages, 4 figures

The c-equivalence principle and its implications for physics

Authors: Max Tran

Abstract: The c-equivalence principle, commonly accepted as true by most physicists, is the unstated assumption that $1/\sqrt{ε_o μ_o}$ equals the kinematic speed of light. Should someone prove the principle false, it would render the composition of two Lorentz transformations meaningless. It would also invalidate the second hypothesis of the Special Theory of Relativity in its strong form. This paper exami… ▽ More The c-equivalence principle, commonly accepted as true by most physicists, is the unstated assumption that $1/\sqrt{ε_o μ_o}$ equals the kinematic speed of light. Should someone prove the principle false, it would render the composition of two Lorentz transformations meaningless. It would also invalidate the second hypothesis of the Special Theory of Relativity in its strong form. This paper examine some other consequences for physics, should this principle be proven false and outline some experiments to determine light speed, which could falsify the principle and provide evidence for the ether. △ Less

Submitted 26 August, 2022; originally announced August 2022.

Comments: 15 pages

A critical examination of relativity theories

Authors: Max Tran

Abstract: We give a brief critical examination of the special theory of relativity and a similar Newtonian framework to the first order of the $v/c$ ratio, focusing on the phenomena of aberration, Fresnel dragging, and the Doppler effect. We will show that both frameworks yield the same equations modeling these phenomena up to first order. We do this at a level understandable to anyone with a working knowle… ▽ More We give a brief critical examination of the special theory of relativity and a similar Newtonian framework to the first order of the $v/c$ ratio, focusing on the phenomena of aberration, Fresnel dragging, and the Doppler effect. We will show that both frameworks yield the same equations modeling these phenomena up to first order. We do this at a level understandable to anyone with a working knowledge of calculus so that the underlying ideas do not get lost in abstruse mathematical formulations. △ Less

Submitted 29 July, 2022; originally announced August 2022.

An Ensemble Approach for Multiple Emotion Descriptors Estimation Using Multi-task Learning

Authors: Irfan Haider, Minh-Trieu Tran, Soo-Hyung Kim, Hyung-Jeong Yang, Guee-Sang Lee

Abstract: This paper illustrates our submission method to the fourth Affective Behavior Analysis in-the-Wild (ABAW) Competition. The method is used for the Multi-Task Learning Challenge. Instead of using only face information, we employ full information from a provided dataset containing face and the context around the face. We utilized the InceptionNet V3 model to extract deep features then we applied the… ▽ More This paper illustrates our submission method to the fourth Affective Behavior Analysis in-the-Wild (ABAW) Competition. The method is used for the Multi-Task Learning Challenge. Instead of using only face information, we employ full information from a provided dataset containing face and the context around the face. We utilized the InceptionNet V3 model to extract deep features then we applied the attention mechanism to refine the features. After that, we put those features into the transformer block and multi-layer perceptron networks to get the final multiple kinds of emotion. Our model predicts arousal and valence, classifies the emotional expression and estimates the action units simultaneously. The proposed system achieves the performance of 0.917 on the MTL Challenge validation dataset. △ Less

Submitted 22 July, 2022; originally announced July 2022.

The tropical geometry of causal inference for extremes

Authors: Ngoc M Tran

Abstract: Extreme value statistics is the max analogue of classical statistics, while tropical geometry is the max analogue of classical geometry. In this paper, we review recent work where insights from tropical geometry were used to develop new, efficient learning algorithms with leading performance on benchmark datasets in extreme value statistics. We give intuition, backed by performances on benchmark d… ▽ More Extreme value statistics is the max analogue of classical statistics, while tropical geometry is the max analogue of classical geometry. In this paper, we review recent work where insights from tropical geometry were used to develop new, efficient learning algorithms with leading performance on benchmark datasets in extreme value statistics. We give intuition, backed by performances on benchmark datasets, for why and when causal inference for extremes should be employed over classical methods. Finally, we list some open problems at the intersection of causal inference, tropical geometry and deep learning. △ Less

Submitted 20 July, 2022; originally announced July 2022.

Comments: 19 pages, 5 figures

SHREC 2022 Track on Online Detection of Heterogeneous Gestures

Authors: Ariel Caputo, Marco Emporio, Andrea Giachetti, Marco Cristani, Guido Borghi, Andrea D'Eusanio, Minh-Quan Le, Hai-Dang Nguyen, Minh-Triet Tran, F. Ambellan, M. Hanik, E. Nava-Yazdani, C. von Tycowicz

Abstract: This paper presents the outcomes of a contest organized to evaluate methods for the online recognition of heterogeneous gestures from sequences of 3D hand poses. The task is the detection of gestures belonging to a dictionary of 16 classes characterized by different pose and motion features. The dataset features continuous sequences of hand tracking data where the gestures are interleaved with non… ▽ More This paper presents the outcomes of a contest organized to evaluate methods for the online recognition of heterogeneous gestures from sequences of 3D hand poses. The task is the detection of gestures belonging to a dictionary of 16 classes characterized by different pose and motion features. The dataset features continuous sequences of hand tracking data where the gestures are interleaved with non-significant motions. The data have been captured using the Hololens 2 finger tracking system in a realistic use-case of mixed reality interaction. The evaluation is based not only on the detection performances but also on the latency and the false positives, making it possible to understand the feasibility of practical interaction tools based on the algorithms proposed. The outcomes of the contest's evaluation demonstrate the necessity of further research to reduce recognition errors, while the computational cost of the algorithms proposed is sufficiently low. △ Less

Submitted 22 July, 2022; v1 submitted 14 July, 2022; originally announced July 2022.

Comments: Accepted on Computer & Graphics journal

MSC Class: 68T10 ACM Class: I.5.2

SHREC'22 Track: Sketch-Based 3D Shape Retrieval in the Wild

Authors: Jie Qin, Shuaihang Yuan, Jiaxin Chen, Boulbaba Ben Amor, Yi Fang, Nhat Hoang-Xuan, Chi-Bien Chu, Khoi-Nguyen Nguyen-Ngoc, Thien-Tri Cao, Nhat-Khang Ngo, Tuan-Luc Huynh, Hai-Dang Nguyen, Minh-Triet Tran, Haoyang Luo, Jianning Wang, Zheng Zhang, Zihao Xin, Yang Wang, Feng Wang, Ying Tang, Haiqin Chen, Yan Wang, Qunying Zhou, Ji Zhang, Hongyuan Wang

Abstract: Sketch-based 3D shape retrieval (SBSR) is an important yet challenging task, which has drawn more and more attention in recent years. Existing approaches address the problem in a restricted setting, without appropriately simulating real application scenarios. To mimic the realistic setting, in this track, we adopt large-scale sketches drawn by amateurs of different levels of drawing skills, as wel… ▽ More Sketch-based 3D shape retrieval (SBSR) is an important yet challenging task, which has drawn more and more attention in recent years. Existing approaches address the problem in a restricted setting, without appropriately simulating real application scenarios. To mimic the realistic setting, in this track, we adopt large-scale sketches drawn by amateurs of different levels of drawing skills, as well as a variety of 3D shapes including not only CAD models but also models scanned from real objects. We define two SBSR tasks and construct two benchmarks consisting of more than 46,000 CAD models, 1,700 realistic models, and 145,000 sketches in total. Four teams participated in this track and submitted 15 runs for the two tasks, evaluated by 7 commonly-adopted metrics. We hope that, the benchmarks, the comparative results, and the open-sourced evaluation code will foster future research in this direction among the 3D object retrieval community. △ Less

Submitted 11 July, 2022; originally announced July 2022.

Ultralow voltage, High-speed, and Energy-efficient Cryogenic Electro-Optic Modulator

Authors: Paolo Pintus, Anshuman Singh, Weiqiang Xie, Leonardo Ranzani, Martin V. Gustafsson, Minh A. Tran, Chao Xiang, Jonathan Peters, John E. Bowers, Moe Soltani

Abstract: Photonic integrated circuits (PICs) at cryogenic temperatures enable a wide range of applications in scalable classical and quantum systems for computing and sensing. A promising application of cryogenic PICs is to provide optical interconnects by up-converting signals from electrical to optical domain, allowing massive data-transfer from 4 K superconducting (SC) electronics to room temperature en… ▽ More Photonic integrated circuits (PICs) at cryogenic temperatures enable a wide range of applications in scalable classical and quantum systems for computing and sensing. A promising application of cryogenic PICs is to provide optical interconnects by up-converting signals from electrical to optical domain, allowing massive data-transfer from 4 K superconducting (SC) electronics to room temperature environment. Such a solution is central to overcome the major bottleneck in the scalability of cryogenic systems, which currently rely on bulky copper cables that suffer from limited bandwidth, large heat load, and do not show any scalability path. A key element for realizing a cryogenic-to-room temperature optical interconnect is a high-speed electro-optic (EO) modulator operating at 4 K with operation voltage at mV scale, compatible with SC electronics. Although several cryogenic EO modulators have been demonstrated, their driving voltages are significantly large compared to the mV scale voltage required for SC circuits. Here, we demonstrate a cryogenic modulator with ~10 mV peak-to-peak driving voltage and gigabits/sec data rate, with ultra-low electric and optical energy consumptions of ~10.4 atto-joules/bit and ~213 femto-joules/bit, respectively. We achieve this record performance by designing a compact optical ring resonator modulator in a heterogeneous InP-on-Silicon platform, where we optimize a multi-quantum well layer of InAIGaAs to achieve a strong EO effect at 4 K. Unlike other semiconductors such as silicon, our platform benefits from the high-carrier mobility and minimal free carrier freezing of III-V compounds at low temperatures, with moderate doping level and low loss (intrinsic resonator Q~272,000). These modulators can pave the path for complex cryogenic photonic functionalities and massive data transmission between cryogenic and room-temperature electronics. △ Less

Submitted 7 July, 2022; originally announced July 2022.

Comments: 18 page manuscript with 5 figures and 1 table, plus 17 page supplementary material

SHREC 2022: Fitting and recognition of simple geometric primitives on point clouds

Authors: Chiara Romanengo, Andrea Raffo, Silvia Biasotti, Bianca Falcidieno, Vlassis Fotis, Ioannis Romanelis, Eleftheria Psatha, Konstantinos Moustakas, Ivan Sipiran, Quang-Thuc Nguyen, Chi-Bien Chu, Khoi-Nguyen Nguyen-Ngoc, Dinh-Khoi Vo, Tuan-An To, Nham-Tan Nguyen, Nhat-Quynh Le-Pham, Hai-Dang Nguyen, Minh-Triet Tran, Yifan Qie, Nabil Anwer

Abstract: This paper presents the methods that have participated in the SHREC 2022 track on the fitting and recognition of simple geometric primitives on point clouds. As simple primitives we mean the classical surface primitives derived from constructive solid geometry, i.e., planes, spheres, cylinders, cones and tori. The aim of the track is to evaluate the quality of automatic algorithms for fitting and… ▽ More This paper presents the methods that have participated in the SHREC 2022 track on the fitting and recognition of simple geometric primitives on point clouds. As simple primitives we mean the classical surface primitives derived from constructive solid geometry, i.e., planes, spheres, cylinders, cones and tori. The aim of the track is to evaluate the quality of automatic algorithms for fitting and recognising geometric primitives on point clouds. Specifically, the goal is to identify, for each point cloud, its primitive type and some geometric descriptors. For this purpose, we created a synthetic dataset, divided into a training set and a test set, containing segments perturbed with different kinds of point cloud artifacts. Among the six participants to this track, two are based on direct methods, while four are either fully based on deep learning or combine direct and neural approaches. The performance of the methods is evaluated using various classification and approximation measures. △ Less

Submitted 7 July, 2022; v1 submitted 15 June, 2022; originally announced June 2022.

MSC Class: 68U05; 68U07; 65D18; 65D17 ACM Class: G.1.2; I.3.5; I.5.4

Journal ref: Computers & Graphics 107 (2022) 32-49

Fabrication of uniformly doped graphene quantum Hall arrays with multiple quantized resistance outputs

Authors: Swapnil M. Mhatre, Ngoc Thanh Mai Tran, Heather M. Hill, Ching-Chen Yeh, Dipanjan Saha, David B. Newell, Angela R. Hight Walker, Chi-Te Liang, Randolph E. Elmquist, Albert F. Rigosi

Abstract: In this work, limiting factors for developing metrologically useful arrays from epitaxial graphene on SiC are lifted with a combination of centimeter-scale, high-quality material growth and the implementation of superconducting contacts. Standard devices for metrology have been restricted to having a single quantized value output based on the $ν$ = 2 Landau level. With the demonstrations herein of… ▽ More In this work, limiting factors for developing metrologically useful arrays from epitaxial graphene on SiC are lifted with a combination of centimeter-scale, high-quality material growth and the implementation of superconducting contacts. Standard devices for metrology have been restricted to having a single quantized value output based on the $ν$ = 2 Landau level. With the demonstrations herein of devices having multiple outputs of quantized values available simultaneously, these versatile devices can be used to disseminate the ohm globally. Such devices are designed to give access to quantized resistance values over the range of three orders of magnitude, starting as low as the standard value of approximately 12.9 k$Ω$ and reaching as high as 1.29 M$Ω$. Several experimental methods are used to assess the quality and versatility of the devices, including standard lock-in techniques and Raman spectroscopy. △ Less

Submitted 10 June, 2022; originally announced June 2022.

Novel projection schemes for graph-based Light Field coding

Authors: Bach Gia Nguyen, Chanh Minh Tran, Tho Nguyen Duc, Tan Xuan Phan, Kamioka Eiji

Abstract: In Light Field compression, graph-based coding is powerful to exploit signal redundancy along irregular shapes and obtains good energy compaction. However, apart from high time complexity to process high dimensional graphs, their graph construction method is highly sensitive to the accuracy of disparity information between viewpoints. In real world Light Field or synthetic Light Field generated by… ▽ More In Light Field compression, graph-based coding is powerful to exploit signal redundancy along irregular shapes and obtains good energy compaction. However, apart from high time complexity to process high dimensional graphs, their graph construction method is highly sensitive to the accuracy of disparity information between viewpoints. In real world Light Field or synthetic Light Field generated by computer software, the use of disparity information for super-rays projection might suffer from inaccuracy due to vignetting effect and large disparity between views in the two types of Light Fields respectively. This paper introduces two novel projection schemes resulting in less error in disparity information, in which one projection scheme can also significantly reduce time computation for both encoder and decoder. Experimental results show projection quality of super-pixels across views can be considerably enhanced using the proposals, along with rate-distortion performance when compared against original projection scheme and HEVC-based or JPEG Pleno-based coding approaches. △ Less

Submitted 9 June, 2022; originally announced June 2022.

SHREC 2022: pothole and crack detection in the road pavement using images and RGB-D data

Authors: Elia Moscoso Thompson, Andrea Ranieri, Silvia Biasotti, Miguel Chicchon, Ivan Sipiran, Minh-Khoi Pham, Thang-Long Nguyen-Ho, Hai-Dang Nguyen, Minh-Triet Tran

Abstract: This paper describes the methods submitted for evaluation to the SHREC 2022 track on pothole and crack detection in the road pavement. A total of 7 different runs for the semantic segmentation of the road surface are compared, 6 from the participants plus a baseline method. All methods exploit Deep Learning techniques and their performance is tested using the same environment (i.e.: a single Jupyt… ▽ More This paper describes the methods submitted for evaluation to the SHREC 2022 track on pothole and crack detection in the road pavement. A total of 7 different runs for the semantic segmentation of the road surface are compared, 6 from the participants plus a baseline method. All methods exploit Deep Learning techniques and their performance is tested using the same environment (i.e.: a single Jupyter notebook). A training set, composed of 3836 semantic segmentation image/mask pairs and 797 RGB-D video clips collected with the latest depth cameras was made available to the participants. The methods are then evaluated on the 496 image/mask pairs in the validation set, on the 504 pairs in the test set and finally on 8 video clips. The analysis of the results is based on quantitative metrics for image segmentation and qualitative analysis of the video clips. The participation and the results show that the scenario is of great interest and that the use of RGB-D data is still challenging in this context. △ Less

Submitted 12 July, 2022; v1 submitted 26 May, 2022; originally announced May 2022.

3DConvCaps: 3DUnet with Convolutional Capsule Encoder for Medical Image Segmentation

Authors: Minh Tran, Viet-Khoa Vo-Ho, Ngan T. H. Le

Abstract: Convolutional Neural Networks (CNNs) have achieved promising results in medical image segmentation. However, CNNs require lots of training data and are incapable of handling pose and deformation of objects. Furthermore, their pooling layers tend to discard important information such as positions as well as CNNs are sensitive to rotation and affine transformation. Capsule network is a recent new ar… ▽ More Convolutional Neural Networks (CNNs) have achieved promising results in medical image segmentation. However, CNNs require lots of training data and are incapable of handling pose and deformation of objects. Furthermore, their pooling layers tend to discard important information such as positions as well as CNNs are sensitive to rotation and affine transformation. Capsule network is a recent new architecture that has achieved better robustness in part-whole representation learning by replacing pooling layers with dynamic routing and convolutional strides, which has shown potential results on popular tasks such as digit classification and object segmentation. In this paper, we propose a 3D encoder-decoder network with Convolutional Capsule Encoder (called 3DConvCaps) to learn lower-level features (short-range attention) with convolutional layers while modeling the higher-level features (long-range dependence) with capsule layers. Our experiments on multiple datasets including iSeg-2017, Hippocampus, and Cardiac demonstrate that our 3D 3DConvCaps network considerably outperforms previous capsule networks and 3D-UNets. We further conduct ablation studies of network efficiency and segmentation performance under various configurations of convolution layers and capsule layers at both contracting and expanding paths. △ Less

Submitted 25 June, 2022; v1 submitted 18 May, 2022; originally announced May 2022.

Comments: Accepted to ICPR 2022

Anomaly detection using prediction error with Spatio-Temporal Convolutional LSTM

Authors: Hanh Thi Minh Tran, David Hogg

Abstract: In this paper, we propose a novel method for video anomaly detection motivated by an existing architecture for sequence-to-sequence prediction and reconstruction using a spatio-temporal convolutional Long Short-Term Memory (convLSTM). As in previous work on anomaly detection, anomalies arise as spatially localised failures in reconstruction or prediction. In experiments with five benchmark dataset… ▽ More In this paper, we propose a novel method for video anomaly detection motivated by an existing architecture for sequence-to-sequence prediction and reconstruction using a spatio-temporal convolutional Long Short-Term Memory (convLSTM). As in previous work on anomaly detection, anomalies arise as spatially localised failures in reconstruction or prediction. In experiments with five benchmark datasets, we show that using prediction gives superior performance to using reconstruction. We also compare performance with different length input/output sequences. Overall, our results using prediction are comparable with the state of the art on the benchmark datasets. △ Less

Submitted 18 May, 2022; originally announced May 2022.

Minimal Representations of Tropical Rational Functions

Authors: Ngoc Mai Tran, Jidong Wang

Abstract: This paper studies the following question: given a piecewise-linear function, find its minimal algebraic representation as a tropical rational signomial. We put forward two different notions of minimality, one based on monomial length, the other based on factorization length. We show that in dimension one, both notions coincide, but this is not true in dimensions two or more. We prove uniqueness o… ▽ More This paper studies the following question: given a piecewise-linear function, find its minimal algebraic representation as a tropical rational signomial. We put forward two different notions of minimality, one based on monomial length, the other based on factorization length. We show that in dimension one, both notions coincide, but this is not true in dimensions two or more. We prove uniqueness of the minimal representation for dimension one and certain subclasses of piecewise-linear functions in dimension two. As a proof step, we obtain counting formulas and lower bounds for the number of regions in an arrangement of tropical hypersurfaces, giving a small extension for a result by Montúfar, Ren and Zhang. As an equivalent formulation, it gives a lower bound on the number of vertices in a regular mixed subdivision of a Minkowski sum, giving a small extension for Adiprasito's Lower Bound Theorem for Minkowski sums. △ Less

Submitted 16 January, 2024; v1 submitted 11 May, 2022; originally announced May 2022.

Comments: 27 pages, 15 figures

MSC Class: 14T15; 14T90; 52B05

Journal ref: Alg. Stat. 15 (2024) 27-59

Scaling Cross-Domain Content-Based Image Retrieval for E-commerce Snap and Search Application

Authors: Isaac Kwan Yin Chung, Minh Tran, Eran Nussinovitch

Abstract: In this industry talk at ECIR 2022, we illustrate how we approach the main challenges from large scale cross-domain content-based image retrieval using a cascade method and a combination of our visual search and classification capabilities. Specifically, we present a system that is able to handle the scale of the data for e-commerce usage and the cross-domain nature of the query and gallery image… ▽ More In this industry talk at ECIR 2022, we illustrate how we approach the main challenges from large scale cross-domain content-based image retrieval using a cascade method and a combination of our visual search and classification capabilities. Specifically, we present a system that is able to handle the scale of the data for e-commerce usage and the cross-domain nature of the query and gallery image pools. We showcase the approach applied in real-world e-commerce snap and search use case and its impact on ranking and latency performance. △ Less

Submitted 13 April, 2022; originally announced April 2022.

Comments: ECIR 2022 Industry Day

Spectroscopic assessment of short-term nitric acid doping of epitaxial graphene

Authors: Ngoc Thanh Mai Tran, Swapnil M. Mhatre, Cristiane N. Santos, Adam J. Biacchi, Mathew L. Kelley, Heather M. Hill, Dipanjan Saha, Chi-Te Liang, Randolph E. Elmquist, David B. Newell, Benoit Hackens, Christina A. Hacker, Albert F. Rigosi

Abstract: This work reports information on the transience of hole doping in epitaxial graphene devices when nitric acid is used as an adsorbent. Under vacuum conditions, desorption processes are monitored by electrical and spectroscopic means to extract the relevant timescales from the corresponding data. It is of vital importance to understand the reversible nature of hole doping because such device proces… ▽ More This work reports information on the transience of hole doping in epitaxial graphene devices when nitric acid is used as an adsorbent. Under vacuum conditions, desorption processes are monitored by electrical and spectroscopic means to extract the relevant timescales from the corresponding data. It is of vital importance to understand the reversible nature of hole doping because such device processing can be a suitable alternative to large-scale, metallic gating. Most measurements are performed post-exposure at room temperature, and, for some electrical transport measurements, at 1.5 K. Vacuum conditions are applied to many measurements to replicate the laboratory conditions under which devices using this doping method would be measured. The relevant timescales from transport measurements are compared with results from X-ray photoelecton spectroscopy and Fourier transform infrared spectroscopy measurements, with the latter performed at ambient conditions and accompanied by calculations of the spectra in the Reststrahlen band. △ Less

Submitted 15 April, 2022; originally announced April 2022.

Timescales for Nitric Acid Desorption in Epitaxial Graphene Devices

Authors: Swapnil M. Mhatre, Ngoc Thanh Mai Tran, Heather M. Hill, Dipanjan Saha, Angela R. Hight Walker, Chi-Te Liang, Randolph E. Elmquist, David B. Newell, Albert F. Rigosi

Abstract: This work reports the dynamics of transient hole doping in epitaxial graphene devices by using nitric acid as an adsorbent. The timescales associated with corresponding desorption processes are extracted from the data. The understanding of reversible hole doping without gating is of crucial importance to those fabricating devices with a particular functionality. Measurements of the electrical and… ▽ More This work reports the dynamics of transient hole doping in epitaxial graphene devices by using nitric acid as an adsorbent. The timescales associated with corresponding desorption processes are extracted from the data. The understanding of reversible hole doping without gating is of crucial importance to those fabricating devices with a particular functionality. Measurements of the electrical and optical properties of several devices post-exposure were performed with transport temperatures between 300 K and 1.5 K. Ambient conditions are applied to non-transport measurements to replicate the most likely laboratory conditions for handling devices using this doping method. The relevant timescales from transport measurements are compared with results from Raman spectroscopy measurements. △ Less

Submitted 15 April, 2022; originally announced April 2022.

Machine Composition of Korean Music via Topological Data Analysis and Artificial Neural Network

Authors: Mai Lan Tran, Dongjin Lee, Jae-Hun Jung

Abstract: Common AI music composition algorithms based on artificial neural networks are to train a machine by feeding a large number of music pieces and create artificial neural networks that can produce music similar to the input music data. This approach is a blackbox optimization, that is, the underlying composition algorithm is, in general, not known to users. In this paper, we present a way of machi… ▽ More Common AI music composition algorithms based on artificial neural networks are to train a machine by feeding a large number of music pieces and create artificial neural networks that can produce music similar to the input music data. This approach is a blackbox optimization, that is, the underlying composition algorithm is, in general, not known to users. In this paper, we present a way of machine composition that trains a machine the composition principle embedded in the given music data instead of directly feeding music pieces. We propose this approach by using the concept of {\color{black}{Overlap}} matrix proposed in \cite{TPJ}. In \cite{TPJ}, a type of Korean music, so-called the {\it Dodeuri} music such as Suyeonjangjigok has been analyzed using topological data analysis (TDA), particularly using persistent homology. As the raw music data is not suitable for TDA analysis, the music data is first reconstructed as a graph. The node of the graph is defined as a two-dimensional vector composed of the pitch and duration of each music note. The edge between two nodes is created when those nodes appear consecutively in the music flow. Distance is defined based on the frequency of such appearances. Through TDA on the constructed graph, a unique set of cycles is found for the given music. In \cite{TPJ}, the new concept of the {\it {\color{black}{Overlap}} matrix} has been proposed, which visualizes how those cycles are interconnected over the music flow, in a matrix form. In this paper, we explain how we use the {\color{black}{Overlap}} matrix for machine composition. The {\color{black}{Overlap}} matrix makes it possible to compose a new music piece algorithmically and also provide a seed music towards the desired artificial neural network. In this paper, we use the {\it Dodeuri} music and explain detailed steps. △ Less

Submitted 29 March, 2022; originally announced March 2022.

MSC Class: 00A65; 55N31

A Speech Representation Anonymization Framework via Selective Noise Perturbation

Authors: Minh Tran, Mohammad Soleymani

Abstract: Privacy and security are major concerns when communicating speech signals to cloud services such as automatic speech recognition (ASR) and speech emotion recognition (SER). Existing solutions for speech anonymization mainly focus on voice conversion or voice modification to convert a raw utterance into another one with similar content but different, or no, identity-related information. However, an… ▽ More Privacy and security are major concerns when communicating speech signals to cloud services such as automatic speech recognition (ASR) and speech emotion recognition (SER). Existing solutions for speech anonymization mainly focus on voice conversion or voice modification to convert a raw utterance into another one with similar content but different, or no, identity-related information. However, an alternative approach to share speech data under the form of privacy-preserving representation has been largely under-explored. In this paper, we propose a speech anonymization framework that achieves privacy via noise perturbation to a selected subset of the high-utility representations extracted using a pre-trained speech encoder. The subset is chosen with a Transformer-based privacy-risk saliency estimator. We validate our framework on four tasks, namely, Automatic Speaker Verification (ASV), ASR, SER and Intent Classification (IC) for privacy and utility assessment. Experimental results show that our approach is able to achieve a competitive, or even better, utility compared to the speech anonymization baselines from the VoicePrivacy2022 Challenges, providing the same level of privacy. Moreover, the easily-controlled amount of perturbation allows our framework to have a flexible range of privacy-utility trade-offs without re-training any component. △ Less

Submitted 27 October, 2022; v1 submitted 26 March, 2022; originally announced March 2022.