Showing 1–50 of 3,810 results for author: Nguyen, T

Modular variable laser cooling for efficient entropy extraction

Authors: Brennan de Neeve, Thanh-Long Nguyen, Alexander Ferk, Tanja Behrle, Francesco Lancellotti, Matteo Simoni, Stephan Welte, Jonathan Home

Abstract: We propose and experimentally demonstrate a method for laser cooling an oscillator based on sequences of spin-state-dependent displacements followed by spin repumping. For a thermal state with mean occupation $\bar{n}\gg 1$ the method attains a reduction to 0.632 of the initial thermal oscillator occupation for two repumps of the two-level spin state. This is within a factor of 2.53 of the optimum… ▽ More We propose and experimentally demonstrate a method for laser cooling an oscillator based on sequences of spin-state-dependent displacements followed by spin repumping. For a thermal state with mean occupation $\bar{n}\gg 1$ the method attains a reduction to 0.632 of the initial thermal oscillator occupation for two repumps of the two-level spin state. This is within a factor of 2.53 of the optimum that might be expected due to the reduction of the oscillator entropy by $2 \ln(2)$. We show that the method, which is based on encoding the value of the modular-variable of the oscillator into the spin, has a simple semi-classical description in terms of a Bayesian update. We demonstrate the method experimentally using the internal and motional states of a single trapped ion. △ Less

Submitted 28 August, 2024; originally announced August 2024.

ClimDetect: A Benchmark Dataset for Climate Change Detection and Attribution

Authors: Sungduk Yu, Brian L. White, Anahita Bhiwandiwalla, Musashi Hinck, Matthew Lyle Olson, Tung Nguyen, Vasudev Lal

Abstract: Detecting and attributing temperature increases due to climate change is crucial for understanding global warming and guiding adaptation strategies. The complexity of distinguishing human-induced climate signals from natural variability has challenged traditional detection and attribution (D&A) approaches, which seek to identify specific "fingerprints" in climate response variables. Deep learning… ▽ More Detecting and attributing temperature increases due to climate change is crucial for understanding global warming and guiding adaptation strategies. The complexity of distinguishing human-induced climate signals from natural variability has challenged traditional detection and attribution (D&A) approaches, which seek to identify specific "fingerprints" in climate response variables. Deep learning offers potential for discerning these complex patterns in expansive spatial datasets. However, lack of standard protocols has hindered consistent comparisons across studies. We introduce ClimDetect, a standardized dataset of over 816k daily climate snapshots, designed to enhance model accuracy in identifying climate change signals. ClimDetect integrates various input and target variables used in past research, ensuring comparability and consistency. We also explore the application of vision transformers (ViT) to climate data, a novel and modernizing approach in this context. Our open-access data and code serve as a benchmark for advancing climate science through improved model evaluations. ClimDetect is publicly accessible via Huggingface dataet respository at: https://huggingface.co/datasets/ClimDetect/ClimDetect. △ Less

Submitted 28 August, 2024; originally announced August 2024.

Modified scattering for long-range Hartree equations of infinite rank near vacuum

Authors: Toan T. Nguyen, Chanjin You

Abstract: We establish the asymptotic behavior and decay of solutions near vacuum to the Hartree equation with the Coulomb interaction potential in three dimensions. Our approach is direct, which consists of independently deriving the sharp dispersive decay estimates for the density function and establishing the boundedness of energy norms. The global in time well-posedness is done without introducing the p… ▽ More We establish the asymptotic behavior and decay of solutions near vacuum to the Hartree equation with the Coulomb interaction potential in three dimensions. Our approach is direct, which consists of independently deriving the sharp dispersive decay estimates for the density function and establishing the boundedness of energy norms. The global in time well-posedness is done without introducing the phase correction, while the phase modification is explicit in terms of the density function. △ Less

Submitted 28 August, 2024; originally announced August 2024.

Comments: 10 pages

MEDSAGE: Enhancing Robustness of Medical Dialogue Summarization to ASR Errors with LLM-generated Synthetic Dialogues

Authors: Kuluhan Binici, Abhinav Ramesh Kashyap, Viktor Schlegel, Andy T. Liu, Vijay Prakash Dwivedi, Thanh-Tung Nguyen, Xiaoxue Gao, Nancy F. Chen, Stefan Winkler

Abstract: Automatic Speech Recognition (ASR) systems are pivotal in transcribing speech into text, yet the errors they introduce can significantly degrade the performance of downstream tasks like summarization. This issue is particularly pronounced in clinical dialogue summarization, a low-resource domain where supervised data for fine-tuning is scarce, necessitating the use of ASR models as black-box solut… ▽ More Automatic Speech Recognition (ASR) systems are pivotal in transcribing speech into text, yet the errors they introduce can significantly degrade the performance of downstream tasks like summarization. This issue is particularly pronounced in clinical dialogue summarization, a low-resource domain where supervised data for fine-tuning is scarce, necessitating the use of ASR models as black-box solutions. Employing conventional data augmentation for enhancing the noise robustness of summarization models is not feasible either due to the unavailability of sufficient medical dialogue audio recordings and corresponding ASR transcripts. To address this challenge, we propose MEDSAGE, an approach for generating synthetic samples for data augmentation using Large Language Models (LLMs). Specifically, we leverage the in-context learning capabilities of LLMs and instruct them to generate ASR-like errors based on a few available medical dialogue examples with audio recordings. Experimental results show that LLMs can effectively model ASR noise, and incorporating this noisy data into the training process significantly improves the robustness and accuracy of medical dialogue summarization systems. This approach addresses the challenges of noisy ASR outputs in critical applications, offering a robust solution to enhance the reliability of clinical dialogue summarization. △ Less

Submitted 26 August, 2024; originally announced August 2024.

SwiftBrush v2: Make Your One-step Diffusion Model Better Than Its Teacher

Authors: Trung Dao, Thuan Hoang Nguyen, Thanh Le, Duc Vu, Khoi Nguyen, Cuong Pham, Anh Tran

Abstract: In this paper, we aim to enhance the performance of SwiftBrush, a prominent one-step text-to-image diffusion model, to be competitive with its multi-step Stable Diffusion counterpart. Initially, we explore the quality-diversity trade-off between SwiftBrush and SD Turbo: the former excels in image diversity, while the latter excels in image quality. This observation motivates our proposed modificat… ▽ More In this paper, we aim to enhance the performance of SwiftBrush, a prominent one-step text-to-image diffusion model, to be competitive with its multi-step Stable Diffusion counterpart. Initially, we explore the quality-diversity trade-off between SwiftBrush and SD Turbo: the former excels in image diversity, while the latter excels in image quality. This observation motivates our proposed modifications in the training methodology, including better weight initialization and efficient LoRA training. Moreover, our introduction of a novel clamped CLIP loss enhances image-text alignment and results in improved image quality. Remarkably, by combining the weights of models trained with efficient LoRA and full training, we achieve a new state-of-the-art one-step diffusion model, achieving an FID of 8.14 and surpassing all GAN-based and multi-step Stable Diffusion models. The project page is available at https://swiftbrushv2.github.io. △ Less

Submitted 27 August, 2024; v1 submitted 26 August, 2024; originally announced August 2024.

Comments: Accepted to ECCV'24

ALIAS: DAG Learning with Efficient Unconstrained Policies

Authors: Bao Duong, Hung Le, Thin Nguyen

Abstract: Recently, reinforcement learning (RL) has proved a promising alternative for conventional local heuristics in score-based approaches to learning directed acyclic causal graphs (DAGs) from observational data. However, the intricate acyclicity constraint still challenges the efficient exploration of the vast space of DAGs in existing methods. In this study, we introduce ALIAS (reinforced dAg Learnin… ▽ More Recently, reinforcement learning (RL) has proved a promising alternative for conventional local heuristics in score-based approaches to learning directed acyclic causal graphs (DAGs) from observational data. However, the intricate acyclicity constraint still challenges the efficient exploration of the vast space of DAGs in existing methods. In this study, we introduce ALIAS (reinforced dAg Learning wIthout Acyclicity conStraints), a novel approach to causal discovery powered by the RL machinery. Our method features an efficient policy for generating DAGs in just a single step with an optimal quadratic complexity, fueled by a novel parametrization of DAGs that directly translates a continuous space to the space of all DAGs, bypassing the need for explicitly enforcing acyclicity constraints. This approach enables us to navigate the search space more effectively by utilizing policy gradient methods and established scoring functions. In addition, we provide compelling empirical evidence for the strong performance of ALIAS in comparison with state-of-the-arts in causal discovery over increasingly difficult experiment conditions on both synthetic and real datasets. △ Less

Submitted 26 August, 2024; v1 submitted 23 August, 2024; originally announced August 2024.

Ada2I: Enhancing Modality Balance for Multimodal Conversational Emotion Recognition

Authors: Cam-Van Thi Nguyen, The-Son Le, Anh-Tuan Mai, Duc-Trong Le

Abstract: Multimodal Emotion Recognition in Conversations (ERC) is a typical multimodal learning task in exploiting various data modalities concurrently. Prior studies on effective multimodal ERC encounter challenges in addressing modality imbalances and optimizing learning across modalities. Dealing with these problems, we present a novel framework named Ada2I, which consists of two inseparable modules nam… ▽ More Multimodal Emotion Recognition in Conversations (ERC) is a typical multimodal learning task in exploiting various data modalities concurrently. Prior studies on effective multimodal ERC encounter challenges in addressing modality imbalances and optimizing learning across modalities. Dealing with these problems, we present a novel framework named Ada2I, which consists of two inseparable modules namely Adaptive Feature Weighting (AFW) and Adaptive Modality Weighting (AMW) for feature-level and modality-level balancing respectively via leveraging both Inter- and Intra-modal interactions. Additionally, we introduce a refined disparity ratio as part of our training optimization strategy, a simple yet effective measure to assess the overall discrepancy of the model's learning process when handling multiple modalities simultaneously. Experimental results validate the effectiveness of Ada2I with state-of-the-art performance compared to baselines on three benchmark datasets, particularly in addressing modality imbalances. △ Less

Submitted 23 August, 2024; originally announced August 2024.

Comments: Accepted at ACM Multimedia 2024

Vintern-1B: An Efficient Multimodal Large Language Model for Vietnamese

Authors: Khang T. Doan, Bao G. Huynh, Dung T. Hoang, Thuc D. Pham, Nhat H. Pham, Quan T. M. Nguyen, Bang Q. Vo, Suong N. Hoang

Abstract: In this report, we introduce Vintern-1B, a reliable 1-billion-parameters multimodal large language model (MLLM) for Vietnamese language tasks. By integrating the Qwen2-0.5B-Instruct language model with the InternViT-300M-448px visual model, Vintern-1B is optimized for a range of applications, including optical character recognition (OCR), document extraction, and general question-answering in Viet… ▽ More In this report, we introduce Vintern-1B, a reliable 1-billion-parameters multimodal large language model (MLLM) for Vietnamese language tasks. By integrating the Qwen2-0.5B-Instruct language model with the InternViT-300M-448px visual model, Vintern-1B is optimized for a range of applications, including optical character recognition (OCR), document extraction, and general question-answering in Vietnamese context. The model is fine-tuned on an extensive dataset of over 3 million image-question-answer pairs, achieving robust performance and reliable results across multiple Vietnamese language benchmarks like OpenViVQA and ViTextVQA. Vintern-1B is small enough to fit into various on-device applications easily. Additionally, we have open-sourced several Vietnamese vision question answering (VQA) datasets for text and diagrams, created with Gemini 1.5 Flash. Our models are available at: https://huggingface.co/5CD-AI/Vintern-1B-v2. △ Less

Submitted 23 August, 2024; v1 submitted 22 August, 2024; originally announced August 2024.

LLMs are not Zero-Shot Reasoners for Biomedical Information Extraction

Authors: Aishik Nagar, Viktor Schlegel, Thanh-Tung Nguyen, Hao Li, Yuping Wu, Kuluhan Binici, Stefan Winkler

Abstract: Large Language Models (LLMs) are increasingly adopted for applications in healthcare, reaching the performance of domain experts on tasks such as question answering and document summarisation. Despite their success on these tasks, it is unclear how well LLMs perform on tasks that are traditionally pursued in the biomedical domain, such as structured information extration. To breach this gap, in th… ▽ More Large Language Models (LLMs) are increasingly adopted for applications in healthcare, reaching the performance of domain experts on tasks such as question answering and document summarisation. Despite their success on these tasks, it is unclear how well LLMs perform on tasks that are traditionally pursued in the biomedical domain, such as structured information extration. To breach this gap, in this paper, we systematically benchmark LLM performance in Medical Classification and Named Entity Recognition (NER) tasks. We aim to disentangle the contribution of different factors to the performance, particularly the impact of LLMs' task knowledge and reasoning capabilities, their (parametric) domain knowledge, and addition of external knowledge. To this end we evaluate various open LLMs -- including BioMistral and Llama-2 models -- on a diverse set of biomedical datasets, using standard prompting, Chain-of-Thought (CoT) and Self-Consistency based reasoning as well as Retrieval-Augmented Generation (RAG) with PubMed and Wikipedia corpora. Counter-intuitively, our results reveal that standard prompting consistently outperforms more complex techniques across both tasks, laying bare the limitations in the current application of CoT, self-consistency and RAG in the biomedical domain. Our findings suggest that advanced prompting methods developed for knowledge- or reasoning-intensive tasks, such as CoT or RAG, are not easily portable to biomedical tasks where precise structured outputs are required. This highlights the need for more effective integration of external knowledge and reasoning mechanisms in LLMs to enhance their performance in real-world biomedical applications. △ Less

Submitted 22 August, 2024; originally announced August 2024.

Comments: 11 pages

FUSELOC: Fusing Global and Local Descriptors to Disambiguate 2D-3D Matching in Visual Localization

Authors: Son Tung Nguyen, Alejandro Fontan, Michael Milford, Tobias Fischer

Abstract: Hierarchical methods represent state-of-the-art visual localization, optimizing search efficiency by using global descriptors to focus on relevant map regions. However, this state-of-the-art performance comes at the cost of substantial memory requirements, as all database images must be stored for feature matching. In contrast, direct 2D-3D matching algorithms require significantly less memory but… ▽ More Hierarchical methods represent state-of-the-art visual localization, optimizing search efficiency by using global descriptors to focus on relevant map regions. However, this state-of-the-art performance comes at the cost of substantial memory requirements, as all database images must be stored for feature matching. In contrast, direct 2D-3D matching algorithms require significantly less memory but suffer from lower accuracy due to the larger and more ambiguous search space. We address this ambiguity by fusing local and global descriptors using a weighted average operator within a 2D-3D search framework. This fusion rearranges the local descriptor space such that geographically nearby local descriptors are closer in the feature space according to the global descriptors. Therefore, the number of irrelevant competing descriptors decreases, specifically if they are geographically distant, thereby increasing the likelihood of correctly matching a query descriptor. We consistently improve the accuracy over local-only systems and achieve performance close to hierarchical methods while halving memory requirements. Extensive experiments using various state-of-the-art local and global descriptors across four different datasets demonstrate the effectiveness of our approach. For the first time, our approach enables direct matching algorithms to benefit from global descriptors while maintaining memory efficiency. The code for this paper will be published at \href{https://github.com/sontung/descriptor-disambiguation}{github.com/sontung/descriptor-disambiguation}. △ Less

Submitted 21 August, 2024; originally announced August 2024.

End-to-end learned Lossy Dynamic Point Cloud Attribute Compression

Authors: Dat Thanh Nguyen, Daniel Zieger, Marc Stamminger, Andre Kaup

Abstract: Recent advancements in point cloud compression have primarily emphasized geometry compression while comparatively fewer efforts have been dedicated to attribute compression. This study introduces an end-to-end learned dynamic lossy attribute coding approach, utilizing an efficient high-dimensional convolution to capture extensive inter-point dependencies. This enables the efficient projection of a… ▽ More Recent advancements in point cloud compression have primarily emphasized geometry compression while comparatively fewer efforts have been dedicated to attribute compression. This study introduces an end-to-end learned dynamic lossy attribute coding approach, utilizing an efficient high-dimensional convolution to capture extensive inter-point dependencies. This enables the efficient projection of attribute features into latent variables. Subsequently, we employ a context model that leverage previous latent space in conjunction with an auto-regressive context model for encoding the latent tensor into a bitstream. Evaluation of our method on widely utilized point cloud datasets from the MPEG and Microsoft demonstrates its superior performance compared to the core attribute compression module Region-Adaptive Hierarchical Transform method from MPEG Geometry Point Cloud Compression with 38.1% Bjontegaard Delta-rate saving in average while ensuring a low-complexity encoding/decoding. △ Less

Submitted 20 August, 2024; originally announced August 2024.

Comments: 6 pages, accepted for presentation at 2024 IEEE International Conference on Image Processing (ICIP) 2024

High-pressure torsion processing of serine and glutamic acid: Understanding mechanochemical behavior of amino acids under astronomical impacts

Authors: Kaveh Edalati, Jacqueline Hidalgo-Jiménez, Thanh Tam Nguyen, Motonori Watanabe, Ikuo Taniguchi

Abstract: Astronomical impacts by small solar system bodies (meteoroids, asteroids, comets, and transitional objects) are considered a mechanism for delivering amino acids and their polymerization to proteins in early Earth conditions. High-pressure torsion (HPT) is a new methodology to simulate such impacts and clarify the behavior of biomolecules. In this study, two amino acids, crystalline L-serine and L… ▽ More Astronomical impacts by small solar system bodies (meteoroids, asteroids, comets, and transitional objects) are considered a mechanism for delivering amino acids and their polymerization to proteins in early Earth conditions. High-pressure torsion (HPT) is a new methodology to simulate such impacts and clarify the behavior of biomolecules. In this study, two amino acids, crystalline L-serine and L-glutamic acid that were detected in meteorites, are processed by HPT and examined by ex situ X-ray diffraction, Raman spectroscopy, nuclear magnetic resonance, Fourier transform infrared spectroscopy, and in situ mechanical shear testing. No polymerization, chemical reactions, or phase transformations are detected after HPT, indicating that the stability and presence of these two amino acids in meteorites are quite reasonable. However, some microstructural and mechanical changes like crystal size reduction to the nanometer level, crystal defect formation, lattice expansion by vacancy formation, and shear strength enhancement to the steady state are found which are similar to the behaviors reported in metals and ceramics after HPT processing. △ Less

Submitted 20 August, 2024; originally announced August 2024.

Journal ref: Advanced Engineering Materials, vol. 26, p. 2302267, 2024

Impact of high-pressure torsion on hydrogen production from photodegradation of polypropylene plastic wastes

Authors: Thanh Tam Nguyen, Kaveh Edalati

Abstract: Plastic waste entering the environment through landfilling or improper disposal poses substantial risks to ecosystems and human health. Photoreforming is emerging as a clean photocatalytic technology that degrades plastic waste to organic compounds while simultaneously producing hydrogen fuel. This study introduces high-pressure torsion (HPT), a severe plastic deformation (SPD) method, as an innov… ▽ More Plastic waste entering the environment through landfilling or improper disposal poses substantial risks to ecosystems and human health. Photoreforming is emerging as a clean photocatalytic technology that degrades plastic waste to organic compounds while simultaneously producing hydrogen fuel. This study introduces high-pressure torsion (HPT), a severe plastic deformation (SPD) method, as an innovative technique to enhance the photoreforming of polypropylene (PP) plastic mixed with a brookite TiO2 photocatalyst. Hydrogen production systematically increases with the number of HPT turns, accompanied by the formation of valuable small organic molecules. The enhancement in photocatalytic activity is attributed to strain-induced defect formation in both catalysts and plastics, as well as the creation of catalyst/plastic interphases that enhance charge carrier transport between inorganic and organic phases. These findings reveal a new functional application for SPD in energy conversion and sustainability. △ Less

Submitted 20 August, 2024; originally announced August 2024.

Journal ref: International Journal of Hydrogen Energy, vol. 81, pp. 411-417, 2024

Brookite TiO2 as an active photocatalyst for photoconversion of plastic wastes to acetic acid and simultaneous hydrogen production: Comparison with anatase and rutile

Authors: Thanh Tam Nguyen, Kaveh Edalati

Abstract: Photoreforming is a clean photocatalytic technology for simultaneous plastic waste degradation and hydrogen fuel production, but there are still limited active and stable catalysts for this process. This work introduces the brookite polymorph of TiO2 as an active photocatalyst for photoreforming with an activity higher than anatase and rutile polymorphs for both hydrogen production and plastic deg… ▽ More Photoreforming is a clean photocatalytic technology for simultaneous plastic waste degradation and hydrogen fuel production, but there are still limited active and stable catalysts for this process. This work introduces the brookite polymorph of TiO2 as an active photocatalyst for photoreforming with an activity higher than anatase and rutile polymorphs for both hydrogen production and plastic degradation. Commercial brookite successfully converts polyethylene terephthalate (PET) plastic to acetic acid under light. The high activity of brookite is attributed to good charge separation, slow decay and moderate electron trap energy, which lead to a higher generation of hydrogen and hydroxyl radicals and accordingly enhanced photo-oxidation of PET plastic. These results introduce brookite as a stable and active catalyst for the photoconversion of water contaminated with microplastics to value-added organic compounds and hydrogen. △ Less

Submitted 20 August, 2024; originally announced August 2024.

Journal ref: Chomosphere, Vol. 355, p. 141785, 2024

NoMatterXAI: Generating "No Matter What" Alterfactual Examples for Explaining Black-Box Text Classification Models

Authors: Tuc Nguyen, James Michels, Hua Shen, Thai Le

Abstract: In Explainable AI (XAI), counterfactual explanations (CEs) are a well-studied method to communicate feature relevance through contrastive reasoning of "what if" to explain AI models' predictions. However, they only focus on important (i.e., relevant) features and largely disregard less important (i.e., irrelevant) ones. Such irrelevant features can be crucial in many applications, especially when… ▽ More In Explainable AI (XAI), counterfactual explanations (CEs) are a well-studied method to communicate feature relevance through contrastive reasoning of "what if" to explain AI models' predictions. However, they only focus on important (i.e., relevant) features and largely disregard less important (i.e., irrelevant) ones. Such irrelevant features can be crucial in many applications, especially when users need to ensure that an AI model's decisions are not affected or biased against specific attributes such as gender, race, religion, or political affiliation. To address this gap, the concept of alterfactual explanations (AEs) has been proposed. AEs explore an alternative reality of "no matter what", where irrelevant features are substituted with alternative features (e.g., "republicans" -> "democrats") within the same attribute (e.g., "politics") while maintaining a similar prediction output. This serves to validate whether AI model predictions are influenced by the specified attributes. Despite the promise of AEs, there is a lack of computational approaches to systematically generate them, particularly in the text domain, where creating AEs for AI text classifiers presents unique challenges. This paper addresses this challenge by formulating AE generation as an optimization problem and introducing MoMatterXAI, a novel algorithm that generates AEs for text classification tasks. Our approach achieves high fidelity of up to 95% while preserving context similarity of over 90% across multiple models and datasets. A human study further validates the effectiveness of AEs in explaining AI text classifiers to end users. All codes will be publicly available. △ Less

Submitted 20 August, 2024; originally announced August 2024.

Adaptive Knowledge Distillation for Classification of Hand Images using Explainable Vision Transformers

Authors: Thanh Thi Nguyen, Campbell Wilson, Janis Dalins

Abstract: Assessing the forensic value of hand images involves the use of unique features and patterns present in an individual's hand. The human hand has distinct characteristics, such as the pattern of veins, fingerprints, and the geometry of the hand itself. This paper investigates the use of vision transformers (ViTs) for classification of hand images. We use explainability tools to explore the internal… ▽ More Assessing the forensic value of hand images involves the use of unique features and patterns present in an individual's hand. The human hand has distinct characteristics, such as the pattern of veins, fingerprints, and the geometry of the hand itself. This paper investigates the use of vision transformers (ViTs) for classification of hand images. We use explainability tools to explore the internal representations of ViTs and assess their impact on the model outputs. Utilizing the internal understanding of ViTs, we introduce distillation methods that allow a student model to adaptively extract knowledge from a teacher model while learning on data of a different domain to prevent catastrophic forgetting. Two publicly available hand image datasets are used to conduct a series of experiments to evaluate performance of the ViTs and our proposed adaptive distillation methods. The experimental results demonstrate that ViT models significantly outperform traditional machine learning methods and the internal states of ViTs are useful for explaining the model outputs in the classification task. By averting catastrophic forgetting, our distillation methods achieve excellent performance on data from both source and target domains, particularly when these two domains exhibit significant dissimilarity. The proposed approaches therefore can be developed and implemented effectively for real-world applications such as access control, identity verification, and authentication systems. △ Less

Submitted 19 August, 2024; originally announced August 2024.

Comments: Accepted at the ECML PKDD 2024 (Research Track)

SDE-based Multiplicative Noise Removal

Authors: An Vuong, Thinh Nguyen

Abstract: Multiplicative noise, also known as speckle or pepper noise, commonly affects images produced by synthetic aperture radar (SAR), lasers, or optical lenses. Unlike additive noise, which typically arises from thermal processes or external factors, multiplicative noise is inherent to the system, originating from the fluctuation in diffuse reflections. These fluctuations result in multiple copies of t… ▽ More Multiplicative noise, also known as speckle or pepper noise, commonly affects images produced by synthetic aperture radar (SAR), lasers, or optical lenses. Unlike additive noise, which typically arises from thermal processes or external factors, multiplicative noise is inherent to the system, originating from the fluctuation in diffuse reflections. These fluctuations result in multiple copies of the same signal with varying magnitudes being combined. Consequently, despeckling, or removing multiplicative noise, necessitates different techniques compared to those used for additive noise removal. In this paper, we propose a novel approach using Stochastic Differential Equations based diffusion models to address multiplicative noise. We demonstrate that multiplicative noise can be effectively modeled as a Geometric Brownian Motion process in the logarithmic domain. Utilizing the Fokker-Planck equation, we derive the corresponding reverse process for image denoising. To validate our method, we conduct extensive experiments on two different datasets, comparing our approach to both classical signal processing techniques and contemporary CNN-based noise removal models. Our results indicate that the proposed method significantly outperforms existing methods on perception-based metrics such as FID and LPIPS, while maintaining competitive performance on traditional metrics like PSNR and SSIM. △ Less

Submitted 18 August, 2024; originally announced August 2024.

Comments: 9 pages, 4 figures

Good binary quantum codes with transversal CCZ gate

Authors: Quynh T. Nguyen

Abstract: We give an asymptotically good family of quantum CSS codes on qubits with a transversal CCZ gate, meaning that the parallel logical CCZ on all logical qubits is performed by parallel physical CCZs on (a subset of) physical qubits. Our construction is based on the observation that any classical code satisfying a multiplication property can be used to construct a quantum CSS code with transversal (q… ▽ More We give an asymptotically good family of quantum CSS codes on qubits with a transversal CCZ gate, meaning that the parallel logical CCZ on all logical qubits is performed by parallel physical CCZs on (a subset of) physical qubits. Our construction is based on the observation that any classical code satisfying a multiplication property can be used to construct a quantum CSS code with transversal (qudit) CCZ. To obtain a constant-rate and linear-distance family, we instantiate this construction with a classical good family of algebraic-geometry codes on a non-binary, but constant-sized, alphabet. We then use a technique from the arithmetic secret sharing literature to reduce the alphabet to binary. As a corollary, our code family provides a constant-overhead magic state distillation scheme. △ Less

Submitted 19 August, 2024; originally announced August 2024.

Offline RLHF Methods Need More Accurate Supervision Signals

Authors: Shiqi Wang, Zhengze Zhang, Rui Zhao, Fei Tan, Cam Tu Nguyen

Abstract: With the rapid advances in Large Language Models (LLMs), aligning LLMs with human preferences become increasingly important. Although Reinforcement Learning with Human Feedback (RLHF) proves effective, it is complicated and highly resource-intensive. As such, offline RLHF has been introduced as an alternative solution, which directly optimizes LLMs with ranking losses on a fixed preference dataset… ▽ More With the rapid advances in Large Language Models (LLMs), aligning LLMs with human preferences become increasingly important. Although Reinforcement Learning with Human Feedback (RLHF) proves effective, it is complicated and highly resource-intensive. As such, offline RLHF has been introduced as an alternative solution, which directly optimizes LLMs with ranking losses on a fixed preference dataset. Current offline RLHF only captures the ``ordinal relationship'' between responses, overlooking the crucial aspect of ``how much'' one is preferred over the others. To address this issue, we propose a simple yet effective solution called \textbf{R}eward \textbf{D}ifference \textbf{O}ptimization, shorted as \textbf{RDO}. Specifically, we introduce {\it reward difference coefficients} to reweigh sample pairs in offline RLHF. We then develop a {\it difference model} involving rich interactions between a pair of responses for predicting these difference coefficients. Experiments with 7B LLMs on the HH and TL;DR datasets substantiate the effectiveness of our method in both automatic metrics and human evaluation, thereby highlighting its potential for aligning LLMs with human intent and values. △ Less

Submitted 18 August, 2024; originally announced August 2024.

Comments: under review

Approximations to worst-case data dropping: unmasking failure modes

Authors: Jenny Y. Huang, David R. Burt, Tin D. Nguyen, Yunyi Shen, Tamara Broderick

Abstract: A data analyst might worry about generalization if dropping a very small fraction of data points from a study could change its substantive conclusions. Finding the worst-case data subset to drop poses a combinatorial optimization problem. To overcome this intractability, recent works propose using additive approximations, which treat the contribution of a collection of data points as the sum of th… ▽ More A data analyst might worry about generalization if dropping a very small fraction of data points from a study could change its substantive conclusions. Finding the worst-case data subset to drop poses a combinatorial optimization problem. To overcome this intractability, recent works propose using additive approximations, which treat the contribution of a collection of data points as the sum of their individual contributions, and greedy approximations, which iteratively select the point with the highest impact to drop and re-run the data analysis without that point [Broderick et al., 2020, Kuschnig et al., 2021]. We identify that, even in a setting as simple as OLS linear regression, many of these approximations can break down in realistic data arrangements. Several of our examples reflect masking, where one outlier may hide or conceal the effect of another outlier. Based on the failures we identify, we provide recommendations for users and suggest directions for future improvements. △ Less

Submitted 16 August, 2024; originally announced August 2024.

Comments: 39 pages

Bundle Recommendation with Item-level Causation-enhanced Multi-view Learning

Authors: Huy-Son Nguyen, Tuan-Nghia Bui, Long-Hai Nguyen, Hoang Manh-Hung, Cam-Van Thi Nguyen, Hoang-Quynh Le, Duc-Trong Le

Abstract: Bundle recommendation aims to enhance business profitability and user convenience by suggesting a set of interconnected items. In real-world scenarios, leveraging the impact of asymmetric item affiliations is crucial for effective bundle modeling and understanding user preferences. To address this, we present BunCa, a novel bundle recommendation approach employing item-level causation-enhanced mul… ▽ More Bundle recommendation aims to enhance business profitability and user convenience by suggesting a set of interconnected items. In real-world scenarios, leveraging the impact of asymmetric item affiliations is crucial for effective bundle modeling and understanding user preferences. To address this, we present BunCa, a novel bundle recommendation approach employing item-level causation-enhanced multi-view learning. BunCa provides comprehensive representations of users and bundles through two views: the Coherent View, leveraging the Multi-Prospect Causation Network for causation-sensitive relations among items, and the Cohesive View, employing LightGCN for information propagation among users and bundles. Modeling user preferences and bundle construction combined from both views ensures rigorous cohesion in direct user-bundle interactions through the Cohesive View and captures explicit intents through the Coherent View. Simultaneously, the integration of concrete and discrete contrastive learning optimizes the consistency and self-discrimination of multi-view representations. Extensive experiments with BunCa on three benchmark datasets demonstrate the effectiveness of this novel research and validate our hypothesis. △ Less

Submitted 13 August, 2024; originally announced August 2024.

Imaging coupled vibrational, rotational, and electronic wave packet dynamics in a triatomic molecule

Authors: Huynh Van Sa Lam, Van-Hung Hoang, Anbu Selvam Venkatachalam, Surjendu Bhattacharyya, Keyu Chen, Sina Jacob, Sanduni Kudagama, Tu Thanh Nguyen, Daniel Rolles, Uwe Thumm, Artem Rudenko, Vinod Kumarappan

Abstract: Molecular dynamics triggered by interaction with light often involve the excitation of several electronic, vibrational, and rotational states. Characterizing the resulting coupled electronic and nuclear wave packet motion represents a severe challenge, even for small polyatomic systems. In this Letter, we demonstrate how the interplay between vibrational, rotational, and electronic degrees of free… ▽ More Molecular dynamics triggered by interaction with light often involve the excitation of several electronic, vibrational, and rotational states. Characterizing the resulting coupled electronic and nuclear wave packet motion represents a severe challenge, even for small polyatomic systems. In this Letter, we demonstrate how the interplay between vibrational, rotational, and electronic degrees of freedom governs the evolution of molecular wave packets in the low-lying states of strong-field-ionized sulfur dioxide. Using time-resolved Coulomb explosion imaging (CEI) in combination with quantum mechanical wave packet simulations, we directly map bending vibrations of the molecule, show how the vibrational wave packet is influenced by molecular alignment, and elucidate the role of the coupling between the two lowest electronic states of the cation. A conical intersection between these states couples the bending and asymmetric stretching coordinates, which is clearly reflected in the correlated fragment momenta. Our results suggest that multi-coincident CEI represents an efficient experimental tool for characterizing coupled electronic and nuclear motion in polyatomic molecules. △ Less

Submitted 15 August, 2024; originally announced August 2024.

Sensitivity of MCMC-based analyses to small-data removal

Authors: Tin D. Nguyen, Ryan Giordano, Rachael Meager, Tamara Broderick

Abstract: If the conclusion of a data analysis is sensitive to dropping very few data points, that conclusion might hinge on the particular data at hand rather than representing a more broadly applicable truth. How could we check whether this sensitivity holds? One idea is to consider every small subset of data, drop it from the dataset, and re-run our analysis. But running MCMC to approximate a Bayesian po… ▽ More If the conclusion of a data analysis is sensitive to dropping very few data points, that conclusion might hinge on the particular data at hand rather than representing a more broadly applicable truth. How could we check whether this sensitivity holds? One idea is to consider every small subset of data, drop it from the dataset, and re-run our analysis. But running MCMC to approximate a Bayesian posterior is already very expensive; running multiple times is prohibitive, and the number of re-runs needed here is combinatorially large. Recent work proposes a fast and accurate approximation to find the worst-case dropped data subset, but that work was developed for problems based on estimating equations -- and does not directly handle Bayesian posterior approximations using MCMC. We make two principal contributions in the present work. We adapt the existing data-dropping approximation to estimators computed via MCMC. Observing that Monte Carlo errors induce variability in the approximation, we use a variant of the bootstrap to quantify this uncertainty. We demonstrate how to use our approximation in practice to determine whether there is non-robustness in a problem. Empirically, our method is accurate in simple models, such as linear regression. In models with complicated structure, such as hierarchical models, the performance of our method is mixed. △ Less

Submitted 13 August, 2024; originally announced August 2024.

Comments: Shorter version appeared in ICML 2024 Workshop on Differentiable Almost Everything: Differentiable Relaxations, Algorithms, Operators, and Simulators (https://openreview.net/pdf?id=bCPhVcq9Mj)

Measurement Study of Programmable Network Coding in Cloud-native 5G and Beyond Networks

Authors: Osel Lhamo, Tung V. Doan, Elif Tasdemir, Mahdi Attawna, Giang T. Nguyen, Patrick Seeling, Martin Reisslein, Frank H. P. Fitzek

Abstract: Emerging 5G/6G use cases span various industries, necessitating flexible solutions that leverage emerging technologies to meet diverse and stringent application requirements under changing network conditions. The standard 5G RAN solution, retransmission, reduces packet loss but can increase transmission delay in the process. Random Linear Network Coding (RLNC) offers an alternative by proactively… ▽ More Emerging 5G/6G use cases span various industries, necessitating flexible solutions that leverage emerging technologies to meet diverse and stringent application requirements under changing network conditions. The standard 5G RAN solution, retransmission, reduces packet loss but can increase transmission delay in the process. Random Linear Network Coding (RLNC) offers an alternative by proactively sending combinations of original packets, thus reducing both delay and packet loss. Current research often only simulates the integration of RLNC in 5G while we implement and evaluate our approach on real commercially available hardware in a real-world deployment. We introduce Flexible Network Coding (FlexNC), which enables the flexible fusion of several RLNC protocols by incorporating a forwarder with multiple RLNC nodes. Network operators can configure FlexNC based on network conditions and application requirements. To further boost network programmability, our Recoder in the Network (RecNet) leverages intermediate network nodes to join the coding process. Both the proposed algorithms have been implemented on OpenAirInterface and extensively tested with traffic from different applications in a real network. While FlexNC adapts to various application needs of latency and packet loss, RecNet significantly minimizes packet loss for a remote user with minimal increase in delay compared to pure RLNC. △ Less

Submitted 12 August, 2024; originally announced August 2024.

A combined study of thermohaline mixing and envelope overshooting with PARSEC: Calibration to NGC 6397 and M4

Authors: C. T. Nguyen, A. Bressan, A. J. Korn, G. Cescutti, G. Costa, F. Addari, L. Girardi, X. Fu, Y. Chen, P. Marigo

Abstract: Thermohaline mixing is one of the main processes in low-mass red giant stars that affect the transport of chemicals and, thus, the surface abundances along the evolution. The interplay of thermohaline mixing with other processes, such as the downward overshooting from the convective envelope, should be carefully investigated. This study aims to understand the combined effects of thermohaline mixin… ▽ More Thermohaline mixing is one of the main processes in low-mass red giant stars that affect the transport of chemicals and, thus, the surface abundances along the evolution. The interplay of thermohaline mixing with other processes, such as the downward overshooting from the convective envelope, should be carefully investigated. This study aims to understand the combined effects of thermohaline mixing and envelope overshooting. After implementing the thermohaline mixing process in the \textsc{parsec} stellar evolutionary code, we compute tracks and isochrones (with \textsc{trilegal} code) and compare them with observational data. To constrain the efficiencies of both processes, we perform a detailed modelling that is suitable for globular clusters NGC 6397 and M4. Our results indicate that an envelope overshooting efficiency parameter, $Λ_\mathrm{e}=0.6$, and a thermohaline efficiency parameter, $α_\mathrm{th}=50$, are necessary to reproduce the RGB bump magnitudes and lithium abundances observed in these clusters. We find that both envelope overshooting and thermohaline mixing have a significant impact on the variation of $^7$Li abundances. Additionally, we also explore the effects of adopting solar-scaled or $α$-enhanced mixtures on our models. The $^{12}$C and the $^{12}$C/$^{13}$C ratio are also effective indicators to probe extra mixing in RGB stars. Although, their usefulness is currently limited by the lack of precise and accurate C-isotopes abundances. △ Less

Submitted 9 August, 2024; originally announced August 2024.

Comments: 14 pages, 14 figures

Dislocation-induced flexoelectricity in SrTiO$_3$ nanostructure from first principles

Authors: Kunihiko Yamauchi, Thi Phuong Thao Nguyen, Tamio Oguchi

Abstract: Flexoelectricity refers to a linear coupling between the electric polarization and the strain gradient, such as bending or asymmetric compression. This effect is enhanced in nano-scale structures, where grain boundaries or dislocation cores induce the strain gradient. In this study, we theoretically investigate the flexoelectric polarization induced by misfit dislocations in a thin film. A nano-sc… ▽ More Flexoelectricity refers to a linear coupling between the electric polarization and the strain gradient, such as bending or asymmetric compression. This effect is enhanced in nano-scale structures, where grain boundaries or dislocation cores induce the strain gradient. In this study, we theoretically investigate the flexoelectric polarization induced by misfit dislocations in a thin film. A nano-scale dislocation structure is modeled in a periodic SrTiO$_3$ supercell, and then the structure is optimized by using neural-network-potential and first-principles approaches. We point out that a pyramidal TiO$_5$ coordination forms near the dislocation cores, which in turn dominantly causes the sizable flexoelectric polarization. △ Less

Submitted 9 August, 2024; originally announced August 2024.

Comments: 5 pages, 4 figures, submitted for publication

XMainframe: A Large Language Model for Mainframe Modernization

Authors: Anh T. V. Dau, Hieu Trung Dao, Anh Tuan Nguyen, Hieu Trung Tran, Phong X. Nguyen, Nghi D. Q. Bui

Abstract: Mainframe operating systems, despite their inception in the 1940s, continue to support critical sectors like finance and government. However, these systems are often viewed as outdated, requiring extensive maintenance and modernization. Addressing this challenge necessitates innovative tools that can understand and interact with legacy codebases. To this end, we introduce XMainframe, a state-of-th… ▽ More Mainframe operating systems, despite their inception in the 1940s, continue to support critical sectors like finance and government. However, these systems are often viewed as outdated, requiring extensive maintenance and modernization. Addressing this challenge necessitates innovative tools that can understand and interact with legacy codebases. To this end, we introduce XMainframe, a state-of-the-art large language model (LLM) specifically designed with knowledge of mainframe legacy systems and COBOL codebases. Our solution involves the creation of an extensive data collection pipeline to produce high-quality training datasets, enhancing XMainframe's performance in this specialized domain. Additionally, we present MainframeBench, a comprehensive benchmark for assessing mainframe knowledge, including multiple-choice questions, question answering, and COBOL code summarization. Our empirical evaluations demonstrate that XMainframe consistently outperforms existing state-of-the-art LLMs across these tasks. Specifically, XMainframe achieves 30% higher accuracy than DeepSeek-Coder on multiple-choice questions, doubles the BLEU score of Mixtral-Instruct 8x7B on question answering, and scores six times higher than GPT-3.5 on COBOL summarization. Our work highlights the potential of XMainframe to drive significant advancements in managing and modernizing legacy systems, thereby enhancing productivity and saving time for software developers. △ Less

Submitted 26 August, 2024; v1 submitted 5 August, 2024; originally announced August 2024.

Better Alignment with Instruction Back-and-Forth Translation

Authors: Thao Nguyen, Jeffrey Li, Sewoong Oh, Ludwig Schmidt, Jason Weston, Luke Zettlemoyer, Xian Li

Abstract: We propose a new method, instruction back-and-forth translation, to construct high-quality synthetic data grounded in world knowledge for aligning large language models (LLMs). Given documents from a web corpus, we generate and curate synthetic instructions using the backtranslation approach proposed by Li et al.(2023a), and rewrite the responses to improve their quality further based on the initi… ▽ More We propose a new method, instruction back-and-forth translation, to construct high-quality synthetic data grounded in world knowledge for aligning large language models (LLMs). Given documents from a web corpus, we generate and curate synthetic instructions using the backtranslation approach proposed by Li et al.(2023a), and rewrite the responses to improve their quality further based on the initial documents. Fine-tuning with the resulting (backtranslated instruction, rewritten response) pairs yields higher win rates on AlpacaEval than using other common instruction datasets such as Humpback, ShareGPT, Open Orca, Alpaca-GPT4 and Self-instruct. We also demonstrate that rewriting the responses with an LLM outperforms direct distillation, and the two generated text distributions exhibit significant distinction in embedding space. Further analysis shows that our backtranslated instructions are of higher quality than other sources of synthetic instructions, while our responses are more diverse and complex than those obtained from distillation. Overall we find that instruction back-and-forth translation combines the best of both worlds -- making use of the information diversity and quantity found on the web, while ensuring the quality of the responses which is necessary for effective alignment. △ Less

Submitted 13 August, 2024; v1 submitted 8 August, 2024; originally announced August 2024.

Connective Viewpoints of Signal-to-Noise Diffusion Models

Authors: Khanh Doan, Long Tung Vuong, Tuan Nguyen, Anh Tuan Bui, Quyen Tran, Thanh-Toan Do, Dinh Phung, Trung Le

Abstract: Diffusion models (DM) have become fundamental components of generative models, excelling across various domains such as image creation, audio generation, and complex data interpolation. Signal-to-Noise diffusion models constitute a diverse family covering most state-of-the-art diffusion models. While there have been several attempts to study Signal-to-Noise (S2N) diffusion models from various pers… ▽ More Diffusion models (DM) have become fundamental components of generative models, excelling across various domains such as image creation, audio generation, and complex data interpolation. Signal-to-Noise diffusion models constitute a diverse family covering most state-of-the-art diffusion models. While there have been several attempts to study Signal-to-Noise (S2N) diffusion models from various perspectives, there remains a need for a comprehensive study connecting different viewpoints and exploring new perspectives. In this study, we offer a comprehensive perspective on noise schedulers, examining their role through the lens of the signal-to-noise ratio (SNR) and its connections to information theory. Building upon this framework, we have developed a generalized backward equation to enhance the performance of the inference process. △ Less

Submitted 8 August, 2024; originally announced August 2024.

ULLME: A Unified Framework for Large Language Model Embeddings with Generation-Augmented Learning

Authors: Hieu Man, Nghia Trung Ngo, Franck Dernoncourt, Thien Huu Nguyen

Abstract: Large Language Models (LLMs) excel in various natural language processing tasks, but leveraging them for dense passage embedding remains challenging. This is due to their causal attention mechanism and the misalignment between their pre-training objectives and the text ranking tasks. Despite some recent efforts to address these issues, existing frameworks for LLM-based text embeddings have been li… ▽ More Large Language Models (LLMs) excel in various natural language processing tasks, but leveraging them for dense passage embedding remains challenging. This is due to their causal attention mechanism and the misalignment between their pre-training objectives and the text ranking tasks. Despite some recent efforts to address these issues, existing frameworks for LLM-based text embeddings have been limited by their support for only a limited range of LLM architectures and fine-tuning strategies, limiting their practical application and versatility. In this work, we introduce the Unified framework for Large Language Model Embedding (ULLME), a flexible, plug-and-play implementation that enables bidirectional attention across various LLMs and supports a range of fine-tuning strategies. We also propose Generation-augmented Representation Learning (GRL), a novel fine-tuning method to boost LLMs for text embedding tasks. GRL enforces consistency between representation-based and generation-based relevance scores, leveraging LLMs' powerful generative abilities for learning passage embeddings. To showcase our framework's flexibility and effectiveness, we release three pre-trained models from ULLME with different backbone architectures, ranging from 1.5B to 8B parameters, all of which demonstrate strong performance on the Massive Text Embedding Benchmark. Our framework is publicly available at: https://github.com/nlp-uoregon/ullme. A demo video for ULLME can also be found at https://rb.gy/ws1ile. △ Less

Submitted 6 August, 2024; originally announced August 2024.

Modular assurance of an Autonomous Ferry using Contract-Based Design and Simulation-based Verification Principles

Authors: Jon Arne Glomsrud, Stephanie Kemna, Chanjei Vasanthan, Luman Zhao, Dag McGeorge, Tom Arne Pedersen, Tobias Rye Torben, Børge Rokseth, Dong Trong Nguyen

Abstract: With the introduction of autonomous technology into our society, e.g. autonomous shipping, it is important to assess and assure the safety of autonomous systems in a real-world context. Simulation-based testing is a common approach to attempt to verify performance of autonomous systems, but assurance also requires formal evidence. This paper introduces the Assurance of Digital Assets (ADA) framewo… ▽ More With the introduction of autonomous technology into our society, e.g. autonomous shipping, it is important to assess and assure the safety of autonomous systems in a real-world context. Simulation-based testing is a common approach to attempt to verify performance of autonomous systems, but assurance also requires formal evidence. This paper introduces the Assurance of Digital Assets (ADA) framework, a structured method for the assurance of digital assets, i.e. novel, complex, or intelligent systems enabled by digital technologies, using contract-based design. Results are shown for an autonomous ferry assurance case, focusing on collision avoidance during the ferry's transit. Further, we discuss the role of simulation-based testing in verifying compliance to contract specifications, to build the necessary evidence for an assurance case. △ Less

Submitted 6 August, 2024; originally announced August 2024.

Comments: 12 pages, 3 figures, final draft submitted to ICMASS/MTEC 2024 conference

Joint Design of Probabilistic Constellation Shaping and Precoding for Multi-user VLC Systems

Authors: Thang K. Nguyen, Thanh V. Pham, Hoang D. Le, Chuyen T. Nguyen, Anh T. Pham

Abstract: This paper proposes a joint design of probabilistic constellation shaping (PCS) and precoding to enhance the sum-rate performance of multi-user visible light communications (VLC) broadcast channels subject to signal amplitude constraint. In the proposed design, the transmission probabilities of bipolar $M$-pulse amplitude modulation ($M$-PAM) symbols for each user and the transmit precoding matrix… ▽ More This paper proposes a joint design of probabilistic constellation shaping (PCS) and precoding to enhance the sum-rate performance of multi-user visible light communications (VLC) broadcast channels subject to signal amplitude constraint. In the proposed design, the transmission probabilities of bipolar $M$-pulse amplitude modulation ($M$-PAM) symbols for each user and the transmit precoding matrix are jointly optimized to improve the sum-rate performance. The joint design problem is shown to be a complex non-convex problem due to the non-convexity of the objective function. To tackle the problem, the firefly algorithm (FA), a nature-inspired heuristic optimization approach, is employed to solve a local optima to the original non-convex optimization problem. The FA-based approach, however, suffers from high computational complexity. Therefore, we propose a low-complexity design based on zero-forcing (ZF) precoding, which is solved using an alternating optimization (AO) approach. Simulation results reveal that the proposed joint design with PCS significantly improves the sum-rate performance compared to the conventional design with uniform signaling. Some insights into the optimal symbol distributions of the two joint design approaches are also provided. △ Less

Submitted 6 August, 2024; originally announced August 2024.

Active Learning for WBAN-based Health Monitoring

Authors: Cho-Chun Chiu, Tuan Nguyen, Ting He, Shiqiang Wang, Beom-Su Kim, Ki-Il Kim

Abstract: We consider a novel active learning problem motivated by the need of learning machine learning models for health monitoring in wireless body area network (WBAN). Due to the limited resources at body sensors, collecting each unlabeled sample in WBAN incurs a nontrivial cost. Moreover, training health monitoring models typically requires labels indicating the patient's health state that need to be g… ▽ More We consider a novel active learning problem motivated by the need of learning machine learning models for health monitoring in wireless body area network (WBAN). Due to the limited resources at body sensors, collecting each unlabeled sample in WBAN incurs a nontrivial cost. Moreover, training health monitoring models typically requires labels indicating the patient's health state that need to be generated by healthcare professionals, which cannot be obtained at the same pace as data collection. These challenges make our problem fundamentally different from classical active learning, where unlabeled samples are free and labels can be queried in real time. To handle these challenges, we propose a two-phased active learning method, consisting of an online phase where a coreset construction algorithm is proposed to select a subset of unlabeled samples based on their noisy predictions, and an offline phase where the selected samples are labeled to train the target model. The samples selected by our algorithm are proved to yield a guaranteed error in approximating the full dataset in evaluating the loss function. Our evaluation based on real health monitoring data and our own experimentation demonstrates that our solution can drastically save the data curation cost without sacrificing the quality of the target model. △ Less

Submitted 5 August, 2024; originally announced August 2024.

Learning to Predict Program Execution by Modeling Dynamic Dependency on Code Graphs

Authors: Cuong Chi Le, Hoang Nhat Phan, Huy Nhat Phan, Tien N. Nguyen, Nghi D. Q. Bui

Abstract: Predicting program behavior without execution is a crucial and challenging task in software engineering. Traditional models often struggle to capture the dynamic dependencies and interactions within code. This paper introduces a novel machine learning-based framework called CodeFlow, designed to predict code coverage and detect runtime errors through Dynamic Dependencies Learning. By utilizing con… ▽ More Predicting program behavior without execution is a crucial and challenging task in software engineering. Traditional models often struggle to capture the dynamic dependencies and interactions within code. This paper introduces a novel machine learning-based framework called CodeFlow, designed to predict code coverage and detect runtime errors through Dynamic Dependencies Learning. By utilizing control flow graphs (CFGs), CodeFlow represents all possible execution paths and the relationships between different statements, providing a comprehensive understanding of program behavior. CodeFlow constructs CFGs to depict execution paths and learns vector representations for CFG nodes, capturing static control-flow dependencies. Additionally, it learns dynamic dependencies through execution traces, which reflect the impacts among statements during execution. This approach enables accurate prediction of code coverage and effective identification of runtime errors. Empirical evaluations demonstrate significant improvements in code coverage prediction accuracy and effective localization of runtime errors, outperforming existing models. △ Less

Submitted 9 August, 2024; v1 submitted 5 August, 2024; originally announced August 2024.

Study of Turbulence and Pressure Recovery in the Heat Pipe Vapor Flow Using the Spectral-Element Method

Authors: Carolina Bourdot Dutra, Tri Nguyen, Elia Merzari, Joshua E. Hansel

Abstract: Heat pipes can efficiently and passively remove heat in nuclear microreactors. Nevertheless, the flow dynamics within heat pipes present a significant challenge in designing and optimizing them for nuclear energy applications. This work aims to explore the vapor core of heat pipes through comprehensive two- and three-dimensional simulations, with a primary focus on modeling the pressure recovery o… ▽ More Heat pipes can efficiently and passively remove heat in nuclear microreactors. Nevertheless, the flow dynamics within heat pipes present a significant challenge in designing and optimizing them for nuclear energy applications. This work aims to explore the vapor core of heat pipes through comprehensive two- and three-dimensional simulations, with a primary focus on modeling the pressure recovery observed in the condenser section. The goal is to establish improved correlations for one-dimensional heat pipe codes. The simulations are validated against experimental data from a vapor pipe documented in the literature. The turbulence model is employed in the two-dimensional simulations through the open-source spectral-element code Nek5000. This model provides insights into pressure recovery within heat pipes with low computational cost. In addition, Large Eddy Simulations (LES) are used to capture turbulent flow features in a three-dimensional vapor pipe model, utilizing the code NekRS. Using LES is crucial for comprehending the impact of laminar-to-turbulent transition on pressure recovery. A simulation framework is created to model the heat pipe's vapor core, laying the foundation for an enhanced understanding of heat pipe behavior. The ultimate goal is to improve and optimize heat pipe designs, provide data to validate lower-fidelity approaches and enhance their performance in nuclear reactors. △ Less

Submitted 5 August, 2024; originally announced August 2024.

Comments: 14th International Topical Meeting on Nuclear Reactor Thermal-Hydraulics, Operation and Safety (NUTHOS-14)

A Survey and Evaluation of Adversarial Attacks for Object Detection

Authors: Khoi Nguyen Tiet Nguyen, Wenyu Zhang, Kangkang Lu, Yuhuan Wu, Xingjian Zheng, Hui Li Tan, Liangli Zhen

Abstract: Deep learning models excel in various computer vision tasks but are susceptible to adversarial examples-subtle perturbations in input data that lead to incorrect predictions. This vulnerability poses significant risks in safety-critical applications such as autonomous vehicles, security surveillance, and aircraft health monitoring. While numerous surveys focus on adversarial attacks in image class… ▽ More Deep learning models excel in various computer vision tasks but are susceptible to adversarial examples-subtle perturbations in input data that lead to incorrect predictions. This vulnerability poses significant risks in safety-critical applications such as autonomous vehicles, security surveillance, and aircraft health monitoring. While numerous surveys focus on adversarial attacks in image classification, the literature on such attacks in object detection is limited. This paper offers a comprehensive taxonomy of adversarial attacks specific to object detection, reviews existing adversarial robustness evaluation metrics, and systematically assesses open-source attack methods and model robustness. Key observations are provided to enhance the understanding of attack effectiveness and corresponding countermeasures. Additionally, we identify crucial research challenges to guide future efforts in securing automated object detection systems. △ Less

Submitted 5 August, 2024; v1 submitted 4 August, 2024; originally announced August 2024.

Comments: 14 pages

Deep Learning Approach for Changepoint Detection: Penalty Parameter Optimization

Authors: Tung L Nguyen, Toby Dylan Hocking

Abstract: Changepoint detection, a technique for identifying significant shifts within data sequences, is crucial in various fields such as finance, genomics, medicine, etc. Dynamic programming changepoint detection algorithms are employed to identify the locations of changepoints within a sequence, which rely on a penalty parameter to regulate the number of changepoints. To estimate this penalty parameter,… ▽ More Changepoint detection, a technique for identifying significant shifts within data sequences, is crucial in various fields such as finance, genomics, medicine, etc. Dynamic programming changepoint detection algorithms are employed to identify the locations of changepoints within a sequence, which rely on a penalty parameter to regulate the number of changepoints. To estimate this penalty parameter, previous work uses simple models such as linear models or decision trees. This study introduces a novel deep learning method for predicting penalty parameters, leading to demonstrably improved changepoint detection accuracy on large benchmark supervised labeled datasets compared to previous methods. △ Less

Submitted 11 August, 2024; v1 submitted 1 August, 2024; originally announced August 2024.

Comments: 13 pages, 7 figures

Segment-Based Test Case Prioritization: A Multi-objective Approach

Authors: Hieu Huynh, Nhu Pham, Tien N. Nguyen, Vu Nguyen

Abstract: Regression testing of software is a crucial but time-consuming task, especially in the context of user interface (UI) testing where multiple microservices must be validated simultaneously. Test case prioritization (TCP) is a cost-efficient solution to address this by scheduling test cases in an execution order that maximizes an objective function, generally aimed at increasing the fault detection… ▽ More Regression testing of software is a crucial but time-consuming task, especially in the context of user interface (UI) testing where multiple microservices must be validated simultaneously. Test case prioritization (TCP) is a cost-efficient solution to address this by scheduling test cases in an execution order that maximizes an objective function, generally aimed at increasing the fault detection rate. While several techniques have been proposed for TCP, most rely on source code information which is usually not available for UI testing. In this paper, we introduce a multi-objective optimization approach to prioritize UI test cases, using evolutionary search algorithms and four coverage criteria focusing on web page elements as objectives for the optimization problem. Our method, which does not require source code information, is evaluated using two evolutionary algorithms (AGE-MOEA and NSGA-II) and compared with other TCP methods on a self-collected dataset of 11 test suites. The results show that our approach significantly outperforms other methods in terms of Average Percentage of Faults Detected (APFD) and APFD with Cost (APFDc), achieving the highest scores of 87.8\% and 79.2\%, respectively. We also introduce a new dataset and demonstrate the significant improvement of our approach over existing ones via empirical experiments. The paper's contributions include the application of web page segmentation in TCP, the construction of a new dataset for UI TCP, and empirical comparisons that demonstrate the improvement of our approach. △ Less

Submitted 1 August, 2024; originally announced August 2024.

Comments: ISSTA 2024

Ground-to-UAV and RIS-assisted UAV-to-Ground Communication Under Channel Aging: Statistical Characterization and Outage Performance

Authors: Thanh Luan Nguyen, Georges Kaddoum, Tri Nhu Do, Zygmunt J. Haas

Abstract: This paper studies the statistical characterization of ground-to-air (G2A) and reconfigurable intelligent surface (RIS)-assisted air-to-ground (A2G) communications in RIS-assisted UAV networks under the impact of channel aging. A comprehensive channel model is presented, which incorporates the time-varying fading, three-dimensional (3D) mobility, Doppler shifts, and the effects of channel aging on… ▽ More This paper studies the statistical characterization of ground-to-air (G2A) and reconfigurable intelligent surface (RIS)-assisted air-to-ground (A2G) communications in RIS-assisted UAV networks under the impact of channel aging. A comprehensive channel model is presented, which incorporates the time-varying fading, three-dimensional (3D) mobility, Doppler shifts, and the effects of channel aging on array antenna structures. We provide analytical expressions for the G2A signal-to-noise ratio (SNR) probability density function (PDF) and cumulative distribution function (CDF), demonstrating that the G2A SNR follows a mixture of noncentral $χ^2$ distributions. The A2G communication is characterized under RIS arbitrary phase-shift configurations, showing that the A2G SNR can be represented as the product of two correlated noncentral $χ^2$ random variables (RVs). Additionally, we present the PDF and the CDF of the product of two independently distributed noncentral $χ^2$ RVs, which accurately characterize the A2G SNR's distribution. Our paper confirms the effectiveness of RISs in mitigating channel aging effects within the coherence time. Finally, we propose an adaptive spectral efficiency method that ensures consistent system performance and satisfactory outage levels when the UAV and the ground user equipments are in motion. △ Less

Submitted 1 August, 2024; originally announced August 2024.

Fluctuating Line-of-Sight Fading Distribution: Statistical Characterization and Applications

Authors: Thanh Luan Nguyen, Georges Kaddoum

Abstract: We introduce the fluctuating Line-of-Sight (fLoS) fading model, characterized by parameters $K$, $k$, $λ$, and $Ω$. The fLoS fading distribution is expressed in terms of the multivariate confluent hypergeometric functions $Ψ_2$, $Φ_3^{(n)}$, and $Φ_3 = Φ_3^{(2)}$ and encompasses well-known distributions, such as the Nakagami-$m$, Hoyt, Rice, and Rician shadowed fading distributions as special case… ▽ More We introduce the fluctuating Line-of-Sight (fLoS) fading model, characterized by parameters $K$, $k$, $λ$, and $Ω$. The fLoS fading distribution is expressed in terms of the multivariate confluent hypergeometric functions $Ψ_2$, $Φ_3^{(n)}$, and $Φ_3 = Φ_3^{(2)}$ and encompasses well-known distributions, such as the Nakagami-$m$, Hoyt, Rice, and Rician shadowed fading distributions as special cases. An efficient method to numerically compute the fLoS fading distribution is also addressed. Notably, for a positive integer $k$, the fLoS fading distribution simplifies to a finite mixture of $κ$-$μ$ distributions. Additionally, we analyze the outage probability and Ergodic capacity, presenting a tailored Prony's approximation method for the latter. Numerical results are presented to show the impact of the fading parameters and verify the accuracy of the proposed approximation. Moreover, we illustrate an application of the proposed fLoS fading distribution for characterizing wireless systems affected by channel aging. △ Less

Submitted 1 August, 2024; originally announced August 2024.

On the Perturbed States for Transformed Input-robust Reinforcement Learning

Authors: Tung M. Luu, Haeyong Kang, Tri Ton, Thanh Nguyen, Chang D. Yoo

Abstract: Reinforcement Learning (RL) agents demonstrating proficiency in a training environment exhibit vulnerability to adversarial perturbations in input observations during deployment. This underscores the importance of building a robust agent before its real-world deployment. To alleviate the challenging point, prior works focus on developing robust training-based procedures, encompassing efforts to fo… ▽ More Reinforcement Learning (RL) agents demonstrating proficiency in a training environment exhibit vulnerability to adversarial perturbations in input observations during deployment. This underscores the importance of building a robust agent before its real-world deployment. To alleviate the challenging point, prior works focus on developing robust training-based procedures, encompassing efforts to fortify the deep neural network component's robustness or subject the agent to adversarial training against potent attacks. In this work, we propose a novel method referred to as Transformed Input-robust RL (TIRL), which explores another avenue to mitigate the impact of adversaries by employing input transformation-based defenses. Specifically, we introduce two principles for applying transformation-based defenses in learning robust RL agents: (1) autoencoder-styled denoising to reconstruct the original state and (2) bounded transformations (bit-depth reduction and vector quantization (VQ)) to achieve close transformed inputs. The transformations are applied to the state before feeding it into the policy network. Extensive experiments on multiple MuJoCo environments demonstrate that input transformation-based defenses, i.e., VQ, defend against several adversaries in the state observations. The official code is available at https://github.com/tunglm2203/tirl △ Less

Submitted 2 August, 2024; v1 submitted 31 July, 2024; originally announced August 2024.

Comments: 12 pages (Code: https://github.com/tunglm2203/tirl)

Clouds on partial atmospheres of lava planets and where to find them

Authors: T. Giang Nguyen, Nicolas B. Cowan, Lisa Dang

Abstract: With dayside temperatures hot enough to sustain a magma ocean and a silicate atmosphere, lava planets are the best targets to study the atmosphere of a rocky world. In the absence of nightside heating, the entire atmosphere collapses near the day-night terminator, so condensation seems inevitable, but the impact of clouds on radiative transfer, dynamics, and observables has not yet been studied in… ▽ More With dayside temperatures hot enough to sustain a magma ocean and a silicate atmosphere, lava planets are the best targets to study the atmosphere of a rocky world. In the absence of nightside heating, the entire atmosphere collapses near the day-night terminator, so condensation seems inevitable, but the impact of clouds on radiative transfer, dynamics, and observables has not yet been studied in the non-global atmospheric regime. Therefore, we simulate cloud formation and determine which lava planets should be most affected by clouds. We find that despite the scattering of visible light by clouds, heat advection compensates for the cooling effect of clouds in the atmosphere. On the other hand, surface temperatures are significantly affected and can drop 100-200 K under a cloudy sky. We find that among our targets, HD213885b and HD20329b are most affected by cloud formation: there is a discernable difference between having clouds and not having them, but the precision required to make such an inference is at the limit of current instruments. △ Less

Submitted 30 July, 2024; originally announced July 2024.

Comments: 15 pages, 7 figures; revised manuscript under review

Sentiment Reasoning for Healthcare

Authors: Khai Le-Duc, Khai-Nguyen Nguyen, Bach Phan Tat, Duy Le, Jerry Ngo, Long Vo-Dang, Anh Totti Nguyen, Truong-Son Hy

Abstract: Transparency in AI decision-making is crucial in healthcare due to the severe consequences of errors, and this is important for building trust among AI and users in sentiment analysis task. Incorporating reasoning capabilities helps Large Language Models (LLMs) understand human emotions within broader contexts, handle nuanced and ambiguous language, and infer underlying sentiments that may not be… ▽ More Transparency in AI decision-making is crucial in healthcare due to the severe consequences of errors, and this is important for building trust among AI and users in sentiment analysis task. Incorporating reasoning capabilities helps Large Language Models (LLMs) understand human emotions within broader contexts, handle nuanced and ambiguous language, and infer underlying sentiments that may not be explicitly stated. In this work, we introduce a new task - Sentiment Reasoning - for both speech and text modalities, along with our proposed multimodal multitask framework and dataset. Our study showed that rationale-augmented training enhances model performance in sentiment classification across both human transcript and ASR settings. Also, we found that the generated rationales typically exhibit different vocabularies compared to human-generated rationales, but maintain similar semantics. All code, data (English-translated and Vietnamese) and models are published online: https://github.com/leduckhai/MultiMed △ Less

Submitted 24 July, 2024; originally announced July 2024.

Comments: Preprint, 18 pages

Beamforming Design for Max-Min Fairness Performance Balancing in ISAC Systems

Authors: Tianyu Fang, Nhan Thanh Nguyen, Markku Juntti

Abstract: Integrated sensing and communications (ISAC) is envisioned as a key technology for future wireless communications. In this paper, we consider a downlink monostatic ISAC system wherein the base station serves multiple communications users and sensing targets at the same time in the presence of clutter. We aim at both guaranteeing fairness among the communications users while simultaneously balancin… ▽ More Integrated sensing and communications (ISAC) is envisioned as a key technology for future wireless communications. In this paper, we consider a downlink monostatic ISAC system wherein the base station serves multiple communications users and sensing targets at the same time in the presence of clutter. We aim at both guaranteeing fairness among the communications users while simultaneously balancing the performances of communications and sensing functionalities. Therefore, we optimize the transmit and receive beamformers to maximize the weighted minimum signal-to-interference and clutter-plus-noise ratios. The design problem is highly challenging due to the non-smooth and non-convex objective function and strongly coupled variables. We propose two efficient methods to solve the problem. First, we rely on fractional programming and transform the original problem into convex sub-problems, which can be solved with standard convex optimization tools. To further reduce the complexity and dependence on numerical tools, we develop a novel approach to address the inherent non-smoothness of the formulated problem. Finally, the efficiencies of the proposed designs are demonstrated by numerical results. △ Less

Submitted 28 July, 2024; originally announced July 2024.

Comments: 5 pages, 3 figures

HD-maps as Prior Information for Globally Consistent Mapping in GPS-denied Environments

Authors: Waqas Ali, Patric Jensfelt, Thien-Minh Nguyen

Abstract: In recent years, prior maps have become a mainstream tool in autonomous navigation. However, commonly available prior maps are still tailored to control-and-decision tasks, and the use of these maps for localization remains largely unexplored. To bridge this gap, we propose a lidar-based localization and mapping (LOAM) system that can exploit the common HD-maps in autonomous driving scenarios. Spe… ▽ More In recent years, prior maps have become a mainstream tool in autonomous navigation. However, commonly available prior maps are still tailored to control-and-decision tasks, and the use of these maps for localization remains largely unexplored. To bridge this gap, we propose a lidar-based localization and mapping (LOAM) system that can exploit the common HD-maps in autonomous driving scenarios. Specifically, we propose a technique to extract information from the drivable area and ground surface height components of the HD-maps to construct 4DOF pose priors. These pose priors are then further integrated into the pose-graph optimization problem to create a globally consistent 3D map. Experiments show that our scheme can significantly improve the global consistency of the map compared to state-of-the-art lidar-only approaches, proven to be a useful technology to enhance the system's robustness, especially in GPS-denied environment. Moreover, our work also serves as a first step towards long-term navigation of robots in familiar environment, by updating a map. In autonomous driving this could enable updating the HD-maps without sourcing a new from a third party company, which is expensive and introduces delays from change in the world to updated map. △ Less

Submitted 28 July, 2024; originally announced July 2024.

The Impact of LoRA Adapters for LLMs on Clinical NLP Classification Under Data Limitations

Authors: Thanh-Dung Le, Ti Ti Nguyen, Vu Nguyen Ha

Abstract: Fine-tuning Large Language Models (LLMs) for clinical Natural Language Processing (NLP) poses significant challenges due to the domain gap and limited data availability. This study investigates the effectiveness of various adapter techniques, equivalent to Low-Rank Adaptation (LoRA), for fine-tuning LLMs in a resource-constrained hospital environment. We experimented with four structures-Adapter,… ▽ More Fine-tuning Large Language Models (LLMs) for clinical Natural Language Processing (NLP) poses significant challenges due to the domain gap and limited data availability. This study investigates the effectiveness of various adapter techniques, equivalent to Low-Rank Adaptation (LoRA), for fine-tuning LLMs in a resource-constrained hospital environment. We experimented with four structures-Adapter, Lightweight, TinyAttention, and Gated Residual Network (GRN)-as final layers for clinical notes classification. We fine-tuned biomedical pre-trained models, including CamemBERT-bio, AliBERT, and DrBERT, alongside two Transformer-based models. Our extensive experimental results indicate that i) employing adapter structures does not yield significant improvements in fine-tuning biomedical pre-trained LLMs, and ii) simpler Transformer-based models, trained from scratch, perform better under resource constraints. Among the adapter structures, GRN demonstrated superior performance with accuracy, precision, recall, and an F1 score of 0.88. Moreover, the total training time for LLMs exceeded 1000 hours, compared to under 6 hours for simpler transformer-based models, highlighting that LLMs are more suitable for environments with extensive computational resources and larger datasets. Consequently, this study demonstrates that simpler Transformer-based models can be effectively trained from scratch, providing a viable solution for clinical NLP tasks in low-resource environments with limited data availability. By identifying the GRN as the most effective adapter structure, we offer a practical approach to enhance clinical note classification without requiring extensive computational resources. △ Less

Submitted 27 July, 2024; originally announced July 2024.

Comments: Under revisions

SHANGUS: Deep Reinforcement Learning Meets Heuristic Optimization for Speedy Frontier-Based Exploration of Autonomous Vehicles in Unknown Spaces

Authors: Seunghyeop Nam, Tuan Anh Nguyen, Eunmi Choi, Dugki Min

Abstract: This paper introduces SHANGUS, an advanced framework combining Deep Reinforcement Learning (DRL) with heuristic optimization to improve frontier-based exploration efficiency in unknown environments, particularly for intelligent vehicles in autonomous air services, search and rescue operations, and space exploration robotics. SHANGUS harnesses DRL's adaptability and heuristic prioritization, marked… ▽ More This paper introduces SHANGUS, an advanced framework combining Deep Reinforcement Learning (DRL) with heuristic optimization to improve frontier-based exploration efficiency in unknown environments, particularly for intelligent vehicles in autonomous air services, search and rescue operations, and space exploration robotics. SHANGUS harnesses DRL's adaptability and heuristic prioritization, markedly enhancing exploration efficiency, reducing completion time, and minimizing travel distance. The strategy involves a frontier selection node to identify unexplored areas and a DRL navigation node using the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm for robust path planning and dynamic obstacle avoidance. Extensive experiments in ROS2 and Gazebo simulation environments show SHANGUS surpasses representative traditional methods like the Nearest Frontier (NF), Novel Frontier-Based Exploration Algorithm (CFE), and Goal-Driven Autonomous Exploration (GDAE) algorithms, especially in complex scenarios, excelling in completion time, travel distance, and exploration rate. This scalable solution is suitable for real-time autonomous navigation in fields such as industrial automation, autonomous driving, household robotics, and space exploration. Future research will integrate additional sensory inputs and refine heuristic functions to further boost SHANGUS's efficiency and robustness. △ Less

Submitted 26 July, 2024; originally announced July 2024.

Machine Unlearning using a Multi-GAN based Model

Authors: Amartya Hatua, Trung T. Nguyen, Andrew H. Sung

Abstract: This article presents a new machine unlearning approach that utilizes multiple Generative Adversarial Network (GAN) based models. The proposed method comprises two phases: i) data reorganization in which synthetic data using the GAN model is introduced with inverted class labels of the forget datasets, and ii) fine-tuning the pre-trained model. The GAN models consist of two pairs of generators and… ▽ More This article presents a new machine unlearning approach that utilizes multiple Generative Adversarial Network (GAN) based models. The proposed method comprises two phases: i) data reorganization in which synthetic data using the GAN model is introduced with inverted class labels of the forget datasets, and ii) fine-tuning the pre-trained model. The GAN models consist of two pairs of generators and discriminators. The generator discriminator pairs generate synthetic data for the retain and forget datasets. Then, a pre-trained model is utilized to get the class labels of the synthetic datasets. The class labels of synthetic and original forget datasets are inverted. Finally, all combined datasets are used to fine-tune the pre-trained model to get the unlearned model. We have performed the experiments on the CIFAR-10 dataset and tested the unlearned models using Membership Inference Attacks (MIA). The inverted class labels procedure and synthetically generated data help to acquire valuable information that enables the model to outperform state-of-the-art models and other standard unlearning classifiers. △ Less

Submitted 25 July, 2024; originally announced July 2024.

Average orders of Goldbach Estimates in Arithmetic Progressions

Authors: Thi Thu Nguyen

Abstract: We obtain asymptotic results on the average numbers of Goldbach representations of an interger as the sum of two primes in different arithmetic progressions. We also prove an omega-result showing that the asymptotic result is essentially the best possible. We obtain asymptotic results on the average numbers of Goldbach representations of an interger as the sum of two primes in different arithmetic progressions. We also prove an omega-result showing that the asymptotic result is essentially the best possible. △ Less

Submitted 17 July, 2024; originally announced July 2024.

MSC Class: Primary 11P32; Secondary 11P55

EEG-SSM: Leveraging State-Space Model for Dementia Detection

Authors: Xuan-The Tran, Linh Le, Quoc Toan Nguyen, Thomas Do, Chin-Teng Lin

Abstract: State-space models (SSMs) have garnered attention for effectively processing long data sequences, reducing the need to segment time series into shorter intervals for model training and inference. Traditionally, SSMs capture only the temporal dynamics of time series data, omitting the equally critical spectral features. This study introduces EEG-SSM, a novel state-space model-based approach for dem… ▽ More State-space models (SSMs) have garnered attention for effectively processing long data sequences, reducing the need to segment time series into shorter intervals for model training and inference. Traditionally, SSMs capture only the temporal dynamics of time series data, omitting the equally critical spectral features. This study introduces EEG-SSM, a novel state-space model-based approach for dementia classification using EEG data. Our model features two primary innovations: EEG-SSM temporal and EEG-SSM spectral components. The temporal component is designed to efficiently process EEG sequences of varying lengths, while the spectral component enhances the model by integrating frequency-domain information from EEG signals. The synergy of these components allows EEG-SSM to adeptly manage the complexities of multivariate EEG data, significantly improving accuracy and stability across different temporal resolutions. Demonstrating a remarkable 91.0 percent accuracy in classifying Healthy Control (HC), Frontotemporal Dementia (FTD), and Alzheimer's Disease (AD) groups, EEG-SSM outperforms existing models on the same dataset. The development of EEG-SSM represents an improvement in the use of state-space models for screening dementia, offering more precise and cost-effective tools for clinical neuroscience. △ Less

Submitted 25 July, 2024; originally announced July 2024.