Showing 51–100 of 796 results for author: Tran, H

Stochastic ISTA/FISTA Adaptive Step Search Algorithms for Convex Composite Optimization

Authors: Lam M. Nguyen, Katya Scheinberg, Trang H. Tran

Abstract: We develop and analyze stochastic variants of ISTA and a full backtracking FISTA algorithms [Beck and Teboulle, 2009, Scheinberg et al., 2014] for composite optimization without the assumption that stochastic gradient is an unbiased estimator. This work extends analysis of inexact fixed step ISTA/FISTA in [Schmidt et al., 2011] to the case of stochastic gradient estimates and adaptive step-size pa… ▽ More We develop and analyze stochastic variants of ISTA and a full backtracking FISTA algorithms [Beck and Teboulle, 2009, Scheinberg et al., 2014] for composite optimization without the assumption that stochastic gradient is an unbiased estimator. This work extends analysis of inexact fixed step ISTA/FISTA in [Schmidt et al., 2011] to the case of stochastic gradient estimates and adaptive step-size parameter chosen by backtracking. It also extends the framework for analyzing stochastic line-search method in [Cartis and Scheinberg, 2018] to the proximal gradient framework as well as to the accelerated first order methods. △ Less

Submitted 23 February, 2024; originally announced February 2024.

Detailed Report on the Measurement of the Positive Muon Anomalous Magnetic Moment to 0.20 ppm

Authors: D. P. Aguillard, T. Albahri, D. Allspach, A. Anisenkov, K. Badgley, S. Baeßler, I. Bailey, L. Bailey, V. A. Baranov, E. Barlas-Yucel, T. Barrett, E. Barzi, F. Bedeschi, M. Berz, M. Bhattacharya, H. P. Binney, P. Bloom, J. Bono, E. Bottalico, T. Bowcock, S. Braun, M. Bressler, G. Cantatore, R. M. Carey, B. C. K. Casey , et al. (168 additional authors not shown)

Abstract: We present details on a new measurement of the muon magnetic anomaly, $a_μ= (g_μ-2)/2$. The result is based on positive muon data taken at Fermilab's Muon Campus during the 2019 and 2020 accelerator runs. The measurement uses $3.1$ GeV$/c$ polarized muons stored in a $7.1$-m-radius storage ring with a $1.45$ T uniform magnetic field. The value of $ a_μ$ is determined from the measured difference b… ▽ More We present details on a new measurement of the muon magnetic anomaly, $a_μ= (g_μ-2)/2$. The result is based on positive muon data taken at Fermilab's Muon Campus during the 2019 and 2020 accelerator runs. The measurement uses $3.1$ GeV$/c$ polarized muons stored in a $7.1$-m-radius storage ring with a $1.45$ T uniform magnetic field. The value of $ a_μ$ is determined from the measured difference between the muon spin precession frequency and its cyclotron frequency. This difference is normalized to the strength of the magnetic field, measured using Nuclear Magnetic Resonance (NMR). The ratio is then corrected for small contributions from beam motion, beam dispersion, and transient magnetic fields. We measure $a_μ= 116 592 057 (25) \times 10^{-11}$ (0.21 ppm). This is the world's most precise measurement of this quantity and represents a factor of $2.2$ improvement over our previous result based on the 2018 dataset. In combination, the two datasets yield $a_μ(\text{FNAL}) = 116 592 055 (24) \times 10^{-11}$ (0.20 ppm). Combining this with the measurements from Brookhaven National Laboratory for both positive and negative muons, the new world average is $a_μ$(exp) $ = 116 592 059 (22) \times 10^{-11}$ (0.19 ppm). △ Less

Submitted 22 May, 2024; v1 submitted 23 February, 2024; originally announced February 2024.

Comments: 48 pages, 29 figures; 4 pages of Supplement Material; version accepted for publication in Physical Review D

Report number: FERMILAB-PUB-24-0084-AD-CSAID-PPD

Distillation Contrastive Decoding: Improving LLMs Reasoning with Contrastive Decoding and Distillation

Authors: Phuc Phan, Hieu Tran, Long Phan

Abstract: We propose a straightforward approach called Distillation Contrastive Decoding (DCD) to enhance the reasoning capabilities of Large Language Models (LLMs) during inference. In contrast to previous approaches that relied on smaller amateur models or analysis of hidden state differences, DCD employs Contrastive Chain-of-thought Prompting and advanced distillation techniques, including Dropout and Qu… ▽ More We propose a straightforward approach called Distillation Contrastive Decoding (DCD) to enhance the reasoning capabilities of Large Language Models (LLMs) during inference. In contrast to previous approaches that relied on smaller amateur models or analysis of hidden state differences, DCD employs Contrastive Chain-of-thought Prompting and advanced distillation techniques, including Dropout and Quantization. This approach effectively addresses the limitations of Contrastive Decoding (CD), which typically requires both an expert and an amateur model, thus increasing computational resource demands. By integrating contrastive prompts with distillation, DCD obviates the need for an amateur model and reduces memory usage. Our evaluations demonstrate that DCD significantly enhances LLM performance across a range of reasoning benchmarks, surpassing both CD and existing methods in the GSM8K and StrategyQA datasets. △ Less

Submitted 23 August, 2024; v1 submitted 21 February, 2024; originally announced February 2024.

Comments: Under Review

MSTAR: Multi-Scale Backbone Architecture Search for Timeseries Classification

Authors: Tue M. Cao, Nhat H. Tran, Hieu H. Pham, Hung T. Nguyen, Le P. Nguyen

Abstract: Most of the previous approaches to Time Series Classification (TSC) highlight the significance of receptive fields and frequencies while overlooking the time resolution. Hence, unavoidably suffered from scalability issues as they integrated an extensive range of receptive fields into classification models. Other methods, while having a better adaptation for large datasets, require manual design an… ▽ More Most of the previous approaches to Time Series Classification (TSC) highlight the significance of receptive fields and frequencies while overlooking the time resolution. Hence, unavoidably suffered from scalability issues as they integrated an extensive range of receptive fields into classification models. Other methods, while having a better adaptation for large datasets, require manual design and yet not being able to reach the optimal architecture due to the uniqueness of each dataset. We overcome these challenges by proposing a novel multi-scale search space and a framework for Neural architecture search (NAS), which addresses both the problem of frequency and time resolution, discovering the suitable scale for a specific dataset. We further show that our model can serve as a backbone to employ a powerful Transformer module with both untrained and pre-trained weights. Our search space reaches the state-of-the-art performance on four datasets on four different domains while introducing more than ten highly fine-tuned models for each data. △ Less

Submitted 21 February, 2024; originally announced February 2024.

A Transition System Abstraction Framework for Neural Network Dynamical System Models

Authors: Yejiang Yang, Zihao Mo, Hoang-Dung Tran, Weiming Xiang

Abstract: This paper proposes a transition system abstraction framework for neural network dynamical system models to enhance the model interpretability, with applications to complex dynamical systems such as human behavior learning and verification. To begin with, the localized working zone will be segmented into multiple localized partitions under the data-driven Maximum Entropy (ME) partitioning method.… ▽ More This paper proposes a transition system abstraction framework for neural network dynamical system models to enhance the model interpretability, with applications to complex dynamical systems such as human behavior learning and verification. To begin with, the localized working zone will be segmented into multiple localized partitions under the data-driven Maximum Entropy (ME) partitioning method. Then, the transition matrix will be obtained based on the set-valued reachability analysis of neural networks. Finally, applications to human handwriting dynamics learning and verification are given to validate our proposed abstraction framework, which demonstrates the advantages of enhancing the interpretability of the black-box model, i.e., our proposed framework is able to abstract a data-driven neural network model into a transition system, making the neural network model interpretable through verifying specifications described in Computational Tree Logic (CTL) languages. △ Less

Submitted 18 February, 2024; originally announced February 2024.

Comments: ACC 2024

How good are my search strings? Reflections on using an existing review as a quasi-gold standard

Authors: Huynh Khanh Vi Tran, Jürgen Börstler, Nauman Bin Ali, Michael Unterkalmsteiner

Abstract: Background: Systematic literature studies (SLS) have become a core research methodology in Evidence-based Software Engineering (EBSE). Search completeness, ie, finding all relevant papers on the topic of interest, has been recognized as one of the most commonly discussed validity issues of SLSs. Aim: This study aims at raising awareness on the issues related to search string construction and on se… ▽ More Background: Systematic literature studies (SLS) have become a core research methodology in Evidence-based Software Engineering (EBSE). Search completeness, ie, finding all relevant papers on the topic of interest, has been recognized as one of the most commonly discussed validity issues of SLSs. Aim: This study aims at raising awareness on the issues related to search string construction and on search validation using a quasi-gold standard (QGS). Furthermore, we aim at providing guidelines for search string validation. Method: We use a recently completed tertiary study as a case and complement our findings with the observations from other researchers studying and advancing EBSE. Results: We found that the issue of assessing QGS quality has not seen much attention in the literature, and the validation of automated searches in SLSs could be improved. Hence, we propose to extend the current search validation approach by the additional analysis step of the automated search validation results and provide recommendations for the QGS construction. Conclusion: In this paper, we report on new issues which could affect search completeness in SLSs. Furthermore, the proposed guideline and recommendations could help researchers implement a more reliable search strategy in their SLSs. △ Less

Submitted 16 February, 2024; originally announced February 2024.

Journal ref: e Informatica Softw. Eng. J. 16(1) (2022)

Policy Learning for Off-Dynamics RL with Deficient Support

Authors: Linh Le Pham Van, Hung The Tran, Sunil Gupta

Abstract: Reinforcement Learning (RL) can effectively learn complex policies. However, learning these policies often demands extensive trial-and-error interactions with the environment. In many real-world scenarios, this approach is not practical due to the high costs of data collection and safety concerns. As a result, a common strategy is to transfer a policy trained in a low-cost, rapid source simulator… ▽ More Reinforcement Learning (RL) can effectively learn complex policies. However, learning these policies often demands extensive trial-and-error interactions with the environment. In many real-world scenarios, this approach is not practical due to the high costs of data collection and safety concerns. As a result, a common strategy is to transfer a policy trained in a low-cost, rapid source simulator to a real-world target environment. However, this process poses challenges. Simulators, no matter how advanced, cannot perfectly replicate the intricacies of the real world, leading to dynamics discrepancies between the source and target environments. Past research posited that the source domain must encompass all possible target transitions, a condition we term full support. However, expecting full support is often unrealistic, especially in scenarios where significant dynamics discrepancies arise. In this paper, our emphasis shifts to addressing large dynamics mismatch adaptation. We move away from the stringent full support condition of earlier research, focusing instead on crafting an effective policy for the target domain. Our proposed approach is simple but effective. It is anchored in the central concepts of the skewing and extension of source support towards target support to mitigate support deficiencies. Through comprehensive testing on a varied set of benchmarks, our method's efficacy stands out, showcasing notable improvements over previous techniques. △ Less

Submitted 16 February, 2024; originally announced February 2024.

Comments: Accepted by AAMAS 2024 as a full paper

Assessing test artifact quality -- A tertiary study

Authors: Huynh Khanh Vi Tran, Michael Unterkalmsteiner, Jürgen Börstler, Nauman bin Ali

Abstract: Context: Modern software development increasingly relies on software testing for an ever more frequent delivery of high quality software. This puts high demands on the quality of the central artifacts in software testing, test suites and test cases. Objective: We aim to develop a comprehensive model for capturing the dimensions of test case/suite quality, which are relevant for a variety of perspe… ▽ More Context: Modern software development increasingly relies on software testing for an ever more frequent delivery of high quality software. This puts high demands on the quality of the central artifacts in software testing, test suites and test cases. Objective: We aim to develop a comprehensive model for capturing the dimensions of test case/suite quality, which are relevant for a variety of perspectives. Method: We have carried out a systematic literature review to identify and analyze existing secondary studies on quality aspects of software testing artifacts. Results: We identified 49 relevant secondary studies. Of these 49 studies, less than half did some form of quality appraisal of the included primary studies and only 3 took into account the quality of the primary study when synthesizing the results. We present an aggregation of the context dimensions and factors that can be used to characterize the environment in which the test case/suite quality is investigated. We also provide a comprehensive model of test case/suite quality with definitions for the quality attributes and measurements based on findings in the literature and ISO/IEC 25010:2011. Conclusion: The test artifact quality model presented in the paper can be used to support test artifact quality assessment and improvement initiatives in practice. Furtherm Information and Software Technology 139 (2021): 106620ore, the model can also be used as a framework for documenting context characteristics to make research results more accessible for research and practice. △ Less

Submitted 14 February, 2024; originally announced February 2024.

Journal ref: Information and Software Technology 139 (2021): 106620

PINN-BO: A Black-box Optimization Algorithm using Physics-Informed Neural Networks

Authors: Dat Phan-Trong, Hung The Tran, Alistair Shilton, Sunil Gupta

Abstract: Black-box optimization is a powerful approach for discovering global optima in noisy and expensive black-box functions, a problem widely encountered in real-world scenarios. Recently, there has been a growing interest in leveraging domain knowledge to enhance the efficacy of machine learning methods. Partial Differential Equations (PDEs) often provide an effective means for elucidating the fundame… ▽ More Black-box optimization is a powerful approach for discovering global optima in noisy and expensive black-box functions, a problem widely encountered in real-world scenarios. Recently, there has been a growing interest in leveraging domain knowledge to enhance the efficacy of machine learning methods. Partial Differential Equations (PDEs) often provide an effective means for elucidating the fundamental principles governing the black-box functions. In this paper, we propose PINN-BO, a black-box optimization algorithm employing Physics-Informed Neural Networks that integrates the knowledge from Partial Differential Equations (PDEs) to improve the sample efficiency of the optimization. We analyze the theoretical behavior of our algorithm in terms of regret bound using advances in NTK theory and prove that the use of the PDE alongside the black-box function evaluations, PINN-BO leads to a tighter regret bound. We perform several experiments on a variety of optimization tasks and show that our algorithm is more sample-efficient compared to existing methods. △ Less

Submitted 5 February, 2024; originally announced February 2024.

Optimal rate of convergence in periodic homogenization of viscous Hamilton-Jacobi equations

Authors: Jianliang Qian, Timo Sprekeler, Hung V. Tran, Yifeng Yu

Abstract: We study the optimal rate of convergence in periodic homogenization of the viscous Hamilton-Jacobi equation $u^\varepsilon_t + H(\frac{x}{\varepsilon},Du^\varepsilon) = \varepsilon Δu^\varepsilon$ in $\mathbb R^n\times (0,\infty)$ subject to a given initial datum. We prove that $\|u^\varepsilon-u\|_{L^\infty(\mathbb R^n \times [0,T])} \leq C(1+T) \sqrt{\varepsilon}$ for any given $T>0$, where $u$… ▽ More We study the optimal rate of convergence in periodic homogenization of the viscous Hamilton-Jacobi equation $u^\varepsilon_t + H(\frac{x}{\varepsilon},Du^\varepsilon) = \varepsilon Δu^\varepsilon$ in $\mathbb R^n\times (0,\infty)$ subject to a given initial datum. We prove that $\|u^\varepsilon-u\|_{L^\infty(\mathbb R^n \times [0,T])} \leq C(1+T) \sqrt{\varepsilon}$ for any given $T>0$, where $u$ is the viscosity solution of the effective problem. Moreover, we show that the $O(\sqrt{\varepsilon})$ rate is optimal for a natural class of $H$ and a Lipschitz continuous initial datum, both theoretically and through numerical experiments. It remains an interesting question to investigate whether the convergence rate can be improved when $H$ is uniformly convex. Finally, we propose a numerical scheme for the approximation of the effective Hamiltonian based on a finite element approximation of approximate corrector problems. △ Less

Submitted 26 February, 2024; v1 submitted 5 February, 2024; originally announced February 2024.

Comments: updated version

Stereographic Spherical Sliced Wasserstein Distances

Authors: Huy Tran, Yikun Bai, Abihith Kothapalli, Ashkan Shahbazi, Xinran Liu, Rocio Diaz Martin, Soheil Kolouri

Abstract: Comparing spherical probability distributions is of great interest in various fields, including geology, medical domains, computer vision, and deep representation learning. The utility of optimal transport-based distances, such as the Wasserstein distance, for comparing probability measures has spurred active research in developing computationally efficient variations of these distances for spheri… ▽ More Comparing spherical probability distributions is of great interest in various fields, including geology, medical domains, computer vision, and deep representation learning. The utility of optimal transport-based distances, such as the Wasserstein distance, for comparing probability measures has spurred active research in developing computationally efficient variations of these distances for spherical probability measures. This paper introduces a high-speed and highly parallelizable distance for comparing spherical measures using the stereographic projection and the generalized Radon transform, which we refer to as the Stereographic Spherical Sliced Wasserstein (S3W) distance. We carefully address the distance distortion caused by the stereographic projection and provide an extensive theoretical analysis of our proposed metric and its rotationally invariant variation. Finally, we evaluate the performance of the proposed metrics and compare them with recent baselines in terms of both speed and accuracy through a wide range of numerical studies, including gradient flows and self-supervised learning. Our code is available at https://github.com/mint-vu/s3wd. △ Less

Submitted 9 June, 2024; v1 submitted 4 February, 2024; originally announced February 2024.

Comments: Published at ICML 2024 (Spotlight). Project page: https://abi-kothapalli.github.io/s3w/

PresAIse, A Prescriptive AI Solution for Enterprises

Authors: Wei Sun, Scott McFaddin, Linh Ha Tran, Shivaram Subramanian, Kristjan Greenewald, Yeshi Tenzin, Zack Xue, Youssef Drissi, Markus Ettl

Abstract: Prescriptive AI represents a transformative shift in decision-making, offering causal insights and actionable recommendations. Despite its huge potential, enterprise adoption often faces several challenges. The first challenge is caused by the limitations of observational data for accurate causal inference which is typically a prerequisite for good decision-making. The second pertains to the inter… ▽ More Prescriptive AI represents a transformative shift in decision-making, offering causal insights and actionable recommendations. Despite its huge potential, enterprise adoption often faces several challenges. The first challenge is caused by the limitations of observational data for accurate causal inference which is typically a prerequisite for good decision-making. The second pertains to the interpretability of recommendations, which is crucial for enterprise decision-making settings. The third challenge is the silos between data scientists and business users, hindering effective collaboration. This paper outlines an initiative from IBM Research, aiming to address some of these challenges by offering a suite of prescriptive AI solutions. Leveraging insights from various research papers, the solution suite includes scalable causal inference methods, interpretable decision-making approaches, and the integration of large language models (LLMs) to bridge communication gaps via a conversation agent. A proof-of-concept, PresAIse, demonstrates the solutions' potential by enabling non-ML experts to interact with prescriptive AI models via a natural language interface, democratizing advanced analytics for strategic decision-making. △ Less

Submitted 12 February, 2024; v1 submitted 2 February, 2024; originally announced February 2024.

Comments: 14 pages

Spatially Resolved Galactic Winds at Cosmic Noon: Outflow Kinematics and Mass Loading in a Lensed Star-Forming Galaxy at $z=1.87$

Authors: Keerthi Vasan G. C., Tucker Jones, Anowar J. Shajib, Sunny Rhoades, Yuguang Chen, Ryan L. Sanders, Daniel P. Stark, Richard S. Ellis, Nicha Leethochawalit, Glenn G. Kacprzak, Tania M. Barone, Karl Glazebrook, Kim-Vy H. Tran, Hannah Skobe, Kris Mortensen, Ivana Barisic

Abstract: We study the spatially resolved outflow properties of CSWA13, an intermediate mass ($M_*=10^{9}~\mathrm{M}_{\odot}$), gravitationally lensed star-forming galaxy at $z=1.87$. We use Keck/KCWI to map outflows in multiple rest-frame ultraviolet ISM absorption lines, along with fluorescent Si II$^*$ emission, and nebular emission from C III] tracing the local systemic velocity. The spatial structure o… ▽ More We study the spatially resolved outflow properties of CSWA13, an intermediate mass ($M_*=10^{9}~\mathrm{M}_{\odot}$), gravitationally lensed star-forming galaxy at $z=1.87$. We use Keck/KCWI to map outflows in multiple rest-frame ultraviolet ISM absorption lines, along with fluorescent Si II$^*$ emission, and nebular emission from C III] tracing the local systemic velocity. The spatial structure of outflow velocity mirrors that of the nebular kinematics, which we interpret to be a signature of a young galactic wind that is pressurizing the ISM of the galaxy but is yet to burst out. From the radial extent of Si II$^*$ emission, we estimate that the outflow is largely encapsulated within $3.5$ kpc. We explore the geometry (e.g., patchiness) of the outflow by measuring the covering fraction at different velocities, finding that the maximum covering fraction is at velocities $v\simeq-150$ km$\,$s$^{-1}$. Using the outflow velocity ($v_{out}$), radius ($R$), column density ($N$), and solid angle ($Ω$) based on the covering fraction, we measure the mass loss rate $\log\dot{m}_{out}/(\mathrm{M}_{\odot}\text{yr}^{-1}) = 1.73\pm0.23$ and mass loading factor $\logη= 0.04\pm0.34$ for the low-ionization outflowing gas in this galaxy. These values are relatively large and the bulk of the outflowing gas is moving with speeds less than the escape velocity of the galaxy halo, suggesting that the majority of outflowing mass will remain in the circumgalactic medium and/or recycle back into the galaxy. The results support a picture of high outflow rates transporting mass and metals into the inner circumgalactic medium, providing the gas reservoir for future star formation. △ Less

Submitted 1 February, 2024; originally announced February 2024.

Comments: Submitted to ApJ. Comments welcome (17 pages, 10 figures, 1 table)

A Class-aware Optimal Transport Approach with Higher-Order Moment Matching for Unsupervised Domain Adaptation

Authors: Tuan Nguyen, Van Nguyen, Trung Le, He Zhao, Quan Hung Tran, Dinh Phung

Abstract: Unsupervised domain adaptation (UDA) aims to transfer knowledge from a labeled source domain to an unlabeled target domain. In this paper, we introduce a novel approach called class-aware optimal transport (OT), which measures the OT distance between a distribution over the source class-conditional distributions and a mixture of source and target data distribution. Our class-aware OT leverages a c… ▽ More Unsupervised domain adaptation (UDA) aims to transfer knowledge from a labeled source domain to an unlabeled target domain. In this paper, we introduce a novel approach called class-aware optimal transport (OT), which measures the OT distance between a distribution over the source class-conditional distributions and a mixture of source and target data distribution. Our class-aware OT leverages a cost function that determines the matching extent between a given data example and a source class-conditional distribution. By optimizing this cost function, we find the optimal matching between target examples and source class-conditional distributions, effectively addressing the data and label shifts that occur between the two domains. To handle the class-aware OT efficiently, we propose an amortization solution that employs deep neural networks to formulate the transportation probabilities and the cost function. Additionally, we propose minimizing class-aware Higher-order Moment Matching (HMM) to align the corresponding class regions on the source and target domains. The class-aware HMM component offers an economical computational approach for accurately evaluating the HMM distance between the two distributions. Extensive experiments on benchmark datasets demonstrate that our proposed method significantly outperforms existing state-of-the-art baselines. △ Less

Submitted 29 January, 2024; originally announced January 2024.

Comments: 18 pages

Context-Aware Stress Monitoring using Wearable and Mobile Technologies in Everyday Settings

Authors: Seyed Amir Hossein Aqajari, Sina Labbaf, Phuc Hoang Tran, Brenda Nguyen, Milad Asgari Mehrabadi, Marco Levorato, Nikil Dutt, Amir M. Rahmani

Abstract: Daily monitoring of stress is a critical component of maintaining optimal physical and mental health. Physiological signals and contextual information have recently emerged as promising indicators for detecting instances of heightened stress. Nonetheless, developing a real-time monitoring system that utilizes both physiological and contextual data to anticipate stress levels in everyday settings w… ▽ More Daily monitoring of stress is a critical component of maintaining optimal physical and mental health. Physiological signals and contextual information have recently emerged as promising indicators for detecting instances of heightened stress. Nonetheless, developing a real-time monitoring system that utilizes both physiological and contextual data to anticipate stress levels in everyday settings while also gathering stress labels from participants represents a significant challenge. We present a monitoring system that objectively tracks daily stress levels by utilizing both physiological and contextual data in a daily-life environment. Additionally, we have integrated a smart labeling approach to optimize the ecological momentary assessment (EMA) collection, which is required for building machine learning models for stress detection. We propose a three-tier Internet-of-Things-based system architecture to address the challenges. We utilized a cross-validation technique to accurately estimate the performance of our stress models. We achieved the F1-score of 70\% with a Random Forest classifier using both PPG and contextual data, which is considered an acceptable score in models built for everyday settings. Whereas using PPG data alone, the highest F1-score achieved is approximately 56\%, emphasizing the significance of incorporating both PPG and contextual data in stress detection tasks. △ Less

Submitted 14 December, 2023; originally announced January 2024.

Quenching for axisymmetric hypersurfaces under forced mean curvature flows

Authors: Hiroyoshi Mitake, Yusuke Oka, Hung Vinh Tran

Abstract: Here, we study the motion of axisymmetric hypersurfaces $\{Γ_t\}_{t\ge0}$ evolved by forced mean curvature flows in the periodic setting. We establish conditions that quenching occurs or does not occur in terms of the initial data and forcing term. We also study the locations where the quenching happens in some special cases. Here, we study the motion of axisymmetric hypersurfaces $\{Γ_t\}_{t\ge0}$ evolved by forced mean curvature flows in the periodic setting. We establish conditions that quenching occurs or does not occur in terms of the initial data and forcing term. We also study the locations where the quenching happens in some special cases. △ Less

Submitted 10 January, 2024; originally announced January 2024.

Comments: 16 pages

README: Bridging Medical Jargon and Lay Understanding for Patient Education through Data-Centric NLP

Authors: Zonghai Yao, Nandyala Siddharth Kantu, Guanghao Wei, Hieu Tran, Zhangqi Duan, Sunjae Kwon, Zhichao Yang, README annotation team, Hong Yu

Abstract: The advancement in healthcare has shifted focus toward patient-centric approaches, particularly in self-care and patient education, facilitated by access to Electronic Health Records (EHR). However, medical jargon in EHRs poses significant challenges in patient comprehension. To address this, we introduce a new task of automatically generating lay definitions, aiming to simplify complex medical te… ▽ More The advancement in healthcare has shifted focus toward patient-centric approaches, particularly in self-care and patient education, facilitated by access to Electronic Health Records (EHR). However, medical jargon in EHRs poses significant challenges in patient comprehension. To address this, we introduce a new task of automatically generating lay definitions, aiming to simplify complex medical terms into patient-friendly lay language. We first created the README dataset, an extensive collection of over 50,000 unique (medical term, lay definition) pairs and 300,000 mentions, each offering context-aware lay definitions manually annotated by domain experts. We have also engineered a data-centric Human-AI pipeline that synergizes data filtering, augmentation, and selection to improve data quality. We then used README as the training data for models and leveraged a Retrieval-Augmented Generation method to reduce hallucinations and improve the quality of model outputs. Our extensive automatic and human evaluations demonstrate that open-source mobile-friendly models, when fine-tuned with high-quality data, are capable of matching or even surpassing the performance of state-of-the-art closed-source large language models like ChatGPT. This research represents a significant stride in closing the knowledge gap in patient education and advancing patient-centric healthcare solutions. △ Less

Submitted 16 June, 2024; v1 submitted 24 December, 2023; originally announced December 2023.

IncepSE: Leveraging InceptionTime's performance with Squeeze and Excitation mechanism in ECG analysis

Authors: Tue Minh Cao, Nhat Hong Tran, Le Phi Nguyen, Hieu Huy Pham, Hung Thanh Nguyen

Abstract: Our study focuses on the potential for modifications of Inception-like architecture within the electrocardiogram (ECG) domain. To this end, we introduce IncepSE, a novel network characterized by strategic architectural incorporation that leverages the strengths of both InceptionTime and channel attention mechanisms. Furthermore, we propose a training setup that employs stabilization techniques tha… ▽ More Our study focuses on the potential for modifications of Inception-like architecture within the electrocardiogram (ECG) domain. To this end, we introduce IncepSE, a novel network characterized by strategic architectural incorporation that leverages the strengths of both InceptionTime and channel attention mechanisms. Furthermore, we propose a training setup that employs stabilization techniques that are aimed at tackling the formidable challenges of severe imbalance dataset PTB-XL and gradient corruption. By this means, we manage to set a new height for deep learning model in a supervised learning manner across the majority of tasks. Our model consistently surpasses InceptionTime by substantial margins compared to other state-of-the-arts in this domain, noticeably 0.013 AUROC score improvement in the "all" task, while also mitigating the inherent dataset fluctuations during training. △ Less

Submitted 16 November, 2023; originally announced December 2023.

Asymptotic growth rate of solutions to level-set forced mean curvature flows with evolving spirals

Authors: Hiroyoshi Mitake, Hung V. Tran

Abstract: Here, we study a level-set forced mean curvature flow with evolving spirals and the homogeneous Neumann boundary condition, which appears in a crystal growth model. Under some appropriate conditions on the forcing term, we prove that the solution is globally Lipschitz. We then study the large time average of the solution and deduce the asymptotic growth rate of the crystal. Some large time behavio… ▽ More Here, we study a level-set forced mean curvature flow with evolving spirals and the homogeneous Neumann boundary condition, which appears in a crystal growth model. Under some appropriate conditions on the forcing term, we prove that the solution is globally Lipschitz. We then study the large time average of the solution and deduce the asymptotic growth rate of the crystal. Some large time behavior results of the solution are obtained. △ Less

Submitted 13 December, 2023; originally announced December 2023.

Comments: 21 pages, 7 figures

Collapsing universe before time

Authors: Gary Shiu, Flavio Tonioni, Hung V. Tran

Abstract: In this note, we prove analytic bounds on the equation of state of a cosmological fluid composed of an arbitrary number of canonical scalars evolving in a negative multi-exponential potential. Because of the negative energy, the universe is contracting and eventually undergoes a big crunch. A contracting universe is a fundamental feature of models of ekpyrosis and cyclic universes, which are a pro… ▽ More In this note, we prove analytic bounds on the equation of state of a cosmological fluid composed of an arbitrary number of canonical scalars evolving in a negative multi-exponential potential. Because of the negative energy, the universe is contracting and eventually undergoes a big crunch. A contracting universe is a fundamental feature of models of ekpyrosis and cyclic universes, which are a proposed alternative to cosmic inflation to solve the flatness and horizon problems. Our analytic bounds set quantitative constraints on general effective theories of ekpyrosis. When applied to specific top-down constructions, our bounds can be used to determine whether ekpyrosis could in principle be realized. We point out some possible sources of tension in realizing the ekpyrotic universe in controlled constructions of string theory. △ Less

Submitted 30 May, 2024; v1 submitted 11 December, 2023; originally announced December 2023.

Comments: 13 pages + appendices + references, 2 figures; v2: minor typos corrected and refs. added

Vines and MAT-labeled graphs

Authors: Hung Manh Tran, Tan Nhat Tran, Shuhei Tsujie

Abstract: The present paper explores a connection between two concepts arising from different fields of mathematics. The first concept, called vine, is a graphical model for dependent random variables. This concept first appeared in a work of Joe (1994), and the formal definition was given later by Cooke (1997). Vines have nowadays become an active research area whose applications can be found in probabilit… ▽ More The present paper explores a connection between two concepts arising from different fields of mathematics. The first concept, called vine, is a graphical model for dependent random variables. This concept first appeared in a work of Joe (1994), and the formal definition was given later by Cooke (1997). Vines have nowadays become an active research area whose applications can be found in probability theory and uncertainty analysis. The second concept, called MAT-freeness, is a combinatorial property in the theory of freeness of logarithmic derivation modules of hyperplane arrangements. This concept was first studied by Abe-Barakat-Cuntz-Hoge-Terao (2016), and soon afterwards investigated further by Cuntz-M{ü}cksch (2020). In the particular case of graphic arrangements, the last two authors (2023) recently proved that the MAT-freeness is completely characterized by the existence of certain edge-labeled graphs, called MAT-labeled graphs. In this paper, we first introduce a poset characterization of a vine, the so-called vine. Then we show that, interestingly, there exists an explicit equivalence between the categories of locally regular vines and MAT-labeled graphs. In particular, we obtain an equivalence between the categories of regular vines and MAT-labeled complete graphs. Several applications will be mentioned to illustrate the interaction between the two concepts. Notably, we give an affirmative answer to a question of Cuntz-M{ü}cksch that MAT-freeness can be characterized by a generalization of the root poset in the case of graphic arrangements. △ Less

Submitted 23 February, 2024; v1 submitted 29 November, 2023; originally announced November 2023.

Comments: 32 pages; refined the definitions of the categories MG and LRV (Def. 6.2 & 6.3), hence improved the main result (Thm. 6.10); the term "vineposet" is no longer used, instead we distinguish the graphical and poset definitions of a vine

MSC Class: Primary 06A07; Secondary 52C35

Weakly-semi-supervised object detection in remotely sensed imagery

Authors: Ji Hun Wang, Jeremy Irvin, Beri Kohen Behar, Ha Tran, Raghav Samavedam, Quentin Hsu, Andrew Y. Ng

Abstract: Deep learning for detecting objects in remotely sensed imagery can enable new technologies for important applications including mitigating climate change. However, these models often require large datasets labeled with bounding box annotations which are expensive to curate, prohibiting the development of models for new tasks and geographies. To address this challenge, we develop weakly-semi-superv… ▽ More Deep learning for detecting objects in remotely sensed imagery can enable new technologies for important applications including mitigating climate change. However, these models often require large datasets labeled with bounding box annotations which are expensive to curate, prohibiting the development of models for new tasks and geographies. To address this challenge, we develop weakly-semi-supervised object detection (WSSOD) models on remotely sensed imagery which can leverage a small amount of bounding boxes together with a large amount of point labels that are easy to acquire at scale in geospatial data. We train WSSOD models which use large amounts of point-labeled images with varying fractions of bounding box labeled images in FAIR1M and a wind turbine detection dataset, and demonstrate that they substantially outperform fully supervised models trained with the same amount of bounding box labeled images on both datasets. Furthermore, we find that the WSSOD models trained with 2-10x fewer bounding box labeled images can perform similarly to or outperform fully supervised models trained on the full set of bounding-box labeled images. We believe that the approach can be extended to other remote sensing tasks to reduce reliance on bounding box labels and increase development of models for impactful applications. △ Less

Submitted 29 November, 2023; originally announced November 2023.

Comments: Tackling Climate Change with Machine Learning at NeurIPS 2023

A Supervised Contrastive Learning Pretrain-Finetune Approach for Time Series

Authors: Trang H. Tran, Lam M. Nguyen, Kyongmin Yeo, Nam Nguyen, Roman Vaculin

Abstract: Foundation models have recently gained attention within the field of machine learning thanks to its efficiency in broad data processing. While researchers had attempted to extend this success to time series models, the main challenge is effectively extracting representations and transferring knowledge from pretraining datasets to the target finetuning dataset. To tackle this issue, we introduce a… ▽ More Foundation models have recently gained attention within the field of machine learning thanks to its efficiency in broad data processing. While researchers had attempted to extend this success to time series models, the main challenge is effectively extracting representations and transferring knowledge from pretraining datasets to the target finetuning dataset. To tackle this issue, we introduce a novel pretraining procedure that leverages supervised contrastive learning to distinguish features within each pretraining dataset. This pretraining phase enables a probabilistic similarity metric, which assesses the likelihood of a univariate sample being closely related to one of the pretraining datasets. Subsequently, using this similarity metric as a guide, we propose a fine-tuning procedure designed to enhance the accurate prediction of the target data by aligning it more closely with the learned dynamics of the pretraining datasets. Our experiments have shown promising results which demonstrate the efficacy of our approach. △ Less

Submitted 20 November, 2023; originally announced November 2023.

Orthogonally weighted $\ell_{2,1}$ regularization for rank-aware joint sparse recovery: algorithm and analysis

Authors: Armenak Petrosyan, Konstantin Pieper, Hoang Tran

Abstract: We propose and analyze an efficient algorithm for solving the joint sparse recovery problem using a new regularization-based method, named orthogonally weighted $\ell_{2,1}$ ($\mathit{ow}\ell_{2,1}$), which is specifically designed to take into account the rank of the solution matrix. This method has applications in feature extraction, matrix column selection, and dictionary learning, and it is di… ▽ More We propose and analyze an efficient algorithm for solving the joint sparse recovery problem using a new regularization-based method, named orthogonally weighted $\ell_{2,1}$ ($\mathit{ow}\ell_{2,1}$), which is specifically designed to take into account the rank of the solution matrix. This method has applications in feature extraction, matrix column selection, and dictionary learning, and it is distinct from commonly used $\ell_{2,1}$ regularization and other existing regularization-based approaches because it can exploit the full rank of the row-sparse solution matrix, a key feature in many applications. We provide a proof of the method's rank-awareness, establish the existence of solutions to the proposed optimization problem, and develop an efficient algorithm for solving it, whose convergence is analyzed. We also present numerical experiments to illustrate the theory and demonstrate the effectiveness of our method on real-life problems. △ Less

Submitted 20 November, 2023; originally announced November 2023.

SniffyArt: The Dataset of Smelling Persons

Authors: Mathias Zinnen, Azhar Hussian, Hang Tran, Prathmesh Madhu, Andreas Maier, Vincent Christlein

Abstract: Smell gestures play a crucial role in the investigation of past smells in the visual arts yet their automated recognition poses significant challenges. This paper introduces the SniffyArt dataset, consisting of 1941 individuals represented in 441 historical artworks. Each person is annotated with a tightly fitting bounding box, 17 pose keypoints, and a gesture label. By integrating these annotatio… ▽ More Smell gestures play a crucial role in the investigation of past smells in the visual arts yet their automated recognition poses significant challenges. This paper introduces the SniffyArt dataset, consisting of 1941 individuals represented in 441 historical artworks. Each person is annotated with a tightly fitting bounding box, 17 pose keypoints, and a gesture label. By integrating these annotations, the dataset enables the development of hybrid classification approaches for smell gesture recognition. The datasets high-quality human pose estimation keypoints are achieved through the merging of five separate sets of keypoint annotations per person. The paper also presents a baseline analysis, evaluating the performance of representative algorithms for detection, keypoint estimation, and classification tasks, showcasing the potential of combining keypoint estimation with smell gesture classification. The SniffyArt dataset lays a solid foundation for future research and the exploration of multi-task approaches leveraging pose keypoints and person boxes to advance human gesture and olfactory dimension analysis in historical artworks. △ Less

Submitted 20 November, 2023; originally announced November 2023.

Comments: 10 pages, 8 figures

Journal ref: Proceedings of the 5th Workshop on analySis, Understanding and proMotion of heritAge Contents. 2023. S. 49-58

Modeling Power Systems Dynamics with Symbolic Physics-Informed Neural Networks

Authors: Huynh T. T. Tran, Hieu T. Nguyen

Abstract: In recent years, scientific machine learning, particularly physic-informed neural networks (PINNs), has introduced new innovative methods to understanding the differential equations that describe power system dynamics, providing a more efficient alternative to traditional methods. However, using a single neural network to capture patterns of all variables requires a large enough size of networks,… ▽ More In recent years, scientific machine learning, particularly physic-informed neural networks (PINNs), has introduced new innovative methods to understanding the differential equations that describe power system dynamics, providing a more efficient alternative to traditional methods. However, using a single neural network to capture patterns of all variables requires a large enough size of networks, leading to a long time of training and still high computational costs. In this paper, we utilize the interfacing of PINNs with symbolic techniques to construct multiple single-output neural networks by taking the loss function apart and integrating it over the relevant domain. Also, we reweigh the factors of the components in the loss function to improve the performance of the network for instability systems. Our results show that the symbolic PINNs provide higher accuracy with significantly fewer parameters and faster training time. By using the adaptive weight method, the symbolic PINNs can avoid the vanishing gradient problem and numerical instability. △ Less

Submitted 11 November, 2023; originally announced November 2023.

Journal ref: The 2024 Conference on Innovative Smart Grid Technologies, North America (ISGT NA 2024)

Two Higgs doublet model fitting and $t\bar{t}b\bar{b}$ signal at the ILC

Authors: Hieu Minh Tran, Huong Thu Nguyen, Yoshimasa Kurihara

Abstract: One of the most straightforward extensions of the standard model (SM) is having an additional Higgs doublet to the SM, namely the two Higgs doublet models(THDM). In the type-I model, an additional Higgs doublet is introduced that does not couple to any fermion via the Yukawa interaction. Considering various theoretical and phenomenological constraints, we have found the best-fitted parameter set i… ▽ More One of the most straightforward extensions of the standard model (SM) is having an additional Higgs doublet to the SM, namely the two Higgs doublet models(THDM). In the type-I model, an additional Higgs doublet is introduced that does not couple to any fermion via the Yukawa interaction. Considering various theoretical and phenomenological constraints, we have found the best-fitted parameter set in the type-I model using the minimum $χ^2$ method by scanning the model's parameter space. We show that this optimal parameter set can be probed by precisely analyzing the decay processes $D^+ \rightarrow μ^+ ν_μ$, $B^0 \rightarrow K^* μ^+ μ^-$. Moreover, the decay channels $h \rightarrow s\bar{s}$, $W^+W^-$ and $gg$ can be used to distinguish the model from the SM. For a direct search of the model at future colliders, we have proposed an investigation of the $e^+e^- \rightarrow t\bar{t} b\bar{b}$ process at the ILC to detect the new physics of the model. Considering the initial state radiation correction and applying appropriate background cuts, the calculation result of the scattering cross section shows that it is feasible to observe a clear and unique signal in the $t\bar{b}$ invariant mass distribution corresponding to the charged Higgs pair creations. △ Less

Submitted 10 November, 2023; originally announced November 2023.

Comments: 20 pages, 8 figures

Aspect-based Meeting Transcript Summarization: A Two-Stage Approach with Weak Supervision on Sentence Classification

Authors: Zhongfen Deng, Seunghyun Yoon, Trung Bui, Franck Dernoncourt, Quan Hung Tran, Shuaiqi Liu, Wenting Zhao, Tao Zhang, Yibo Wang, Philip S. Yu

Abstract: Aspect-based meeting transcript summarization aims to produce multiple summaries, each focusing on one aspect of content in a meeting transcript. It is challenging as sentences related to different aspects can mingle together, and those relevant to a specific aspect can be scattered throughout the long transcript of a meeting. The traditional summarization methods produce one summary mixing inform… ▽ More Aspect-based meeting transcript summarization aims to produce multiple summaries, each focusing on one aspect of content in a meeting transcript. It is challenging as sentences related to different aspects can mingle together, and those relevant to a specific aspect can be scattered throughout the long transcript of a meeting. The traditional summarization methods produce one summary mixing information of all aspects, which cannot deal with the above challenges of aspect-based meeting transcript summarization. In this paper, we propose a two-stage method for aspect-based meeting transcript summarization. To select the input content related to specific aspects, we train a sentence classifier on a dataset constructed from the AMI corpus with pseudo-labeling. Then we merge the sentences selected for a specific aspect as the input for the summarizer to produce the aspect-based summary. Experimental results on the AMI corpus outperform many strong baselines, which verifies the effectiveness of our proposed method. △ Less

Submitted 7 November, 2023; originally announced November 2023.

Comments: Accepted by 2023 IEEE International Conference on Big Data

MOSEL survey: JWST reveals major mergers/strong interactions drive the extreme emission lines in the early universe

Authors: Anshu Gupta, Ravi Jaiswar, Vicente Rodriguez-Gomez, Ben Forrest, Kim-Vy Tran, Themiya Nanayakkara, Anishya Harshan, Elisabete da Cunha, Glenn G. Kacprzak, Michaela Hirschmann

Abstract: Extreme emission line galaxies (EELGs), where nebular emissions contribute 30-40% of the flux in certain photometric bands, are ubiquitous in the early universe (z>6). We utilise deep NIRCam imaging from the JWST Advanced Deep Extragalactic Survey (JADES) to investigate the properties of companion galaxies (projected distance <40 kpc, |dv|<10,000 km/s) around EELGs at z~3. Tests with TNG100 simula… ▽ More Extreme emission line galaxies (EELGs), where nebular emissions contribute 30-40% of the flux in certain photometric bands, are ubiquitous in the early universe (z>6). We utilise deep NIRCam imaging from the JWST Advanced Deep Extragalactic Survey (JADES) to investigate the properties of companion galaxies (projected distance <40 kpc, |dv|<10,000 km/s) around EELGs at z~3. Tests with TNG100 simulation reveal that nearly all galaxies at z=3 will merge with at least one companion galaxy selected using similar parameters by z=0. The median mass ratio of the most massive companion and the total mass ratio of all companions around EELGs is more than 10 times higher than the control sample. Even after comparing with a stellar mass and stellar mass plus specific SFR-matched control sample, EELGs have three-to-five times higher mass ratios of the brightest companion and total mass ratio of all companions. Our measurements suggest that EELGs are more likely to be experiencing strong interactions or undergoing major mergers irrespective of their stellar mass or specific SFRs. We suspect that gas cooling induced by strong interactions and/or major mergers could be triggering the extreme emission lines, and the increased merger rate might be responsible for the over-abundance of EELGs at z>6. △ Less

Submitted 3 November, 2023; originally announced November 2023.

Comments: 7 pages, 5 figure, Accepted for publication in the Astrophysical Journal Letters

Journal ref: The Astrophysical Journal Letters, 2023

BioInstruct: Instruction Tuning of Large Language Models for Biomedical Natural Language Processing

Authors: Hieu Tran, Zhichao Yang, Zonghai Yao, Hong Yu

Abstract: To enhance the performance of large language models (LLMs) in biomedical natural language processing (BioNLP) by introducing a domain-specific instruction dataset and examining its impact when combined with multi-task learning principles. We created the BioInstruct, comprising 25,005 instructions to instruction-tune LLMs(LLaMA 1 & 2, 7B & 13B version). The instructions were created by prompting th… ▽ More To enhance the performance of large language models (LLMs) in biomedical natural language processing (BioNLP) by introducing a domain-specific instruction dataset and examining its impact when combined with multi-task learning principles. We created the BioInstruct, comprising 25,005 instructions to instruction-tune LLMs(LLaMA 1 & 2, 7B & 13B version). The instructions were created by prompting the GPT-4 language model with three-seed samples randomly drawn from an 80 human curated instructions. We employed Low-Rank Adaptation(LoRA) for parameter-efficient fine-tuning. We then evaluated these instruction-tuned LLMs on several BioNLP tasks, which can be grouped into three major categories: question answering(QA), information extraction(IE), and text generation(GEN). We also examined whether categories(e.g., QA, IE, and generation) of instructions impact model performance. Comparing with LLMs without instruction-tuned, our instruction-tuned LLMs demonstrated marked performance gains: 17.3% in QA, 5.7% in IE, and 96% in Generation tasks. Our 7B-parameter instruction-tuned LLaMA 1 model was competitive or even surpassed other LLMs in the biomedical domain that were also fine-tuned from LLaMA 1 with vast domain-specific data or a variety of tasks. Our results also show that the performance gain is significantly higher when instruction fine-tuning is conducted with closely related tasks. Our findings align with the observations of multi-task learning, suggesting the synergies between two tasks. The BioInstruct dataset serves as a valuable resource and instruction tuned LLMs lead to the best performing BioNLP applications. △ Less

Submitted 6 June, 2024; v1 submitted 30 October, 2023; originally announced October 2023.

Comments: This article has been accepted for publication in Journal of the American Medical Informatics Association Published by Oxford University Press. https://academic.oup.com/jamia/advance-article-abstract/doi/10.1093/jamia/ocae122/7687618

Signs of Similar Stellar Obliquity Distributions for Hot and Warm Jupiters Orbiting Cool Stars

Authors: Marvin Morgan, Brendan P. Bowler, Quang H. Tran, Erik Petigura, Vighnesh Nagpal, Sarah Blunt

Abstract: Transiting giant planets provide a natural opportunity to examine stellar obliquities, which offer clues about the origin and dynamical histories of close-in planets. Hot Jupiters orbiting Sun-like stars show a tendency for obliquity alignment, which suggests that obliquities are rarely excited or that tidal realignment is common. However, the stellar obliquity distribution is less clear for giant… ▽ More Transiting giant planets provide a natural opportunity to examine stellar obliquities, which offer clues about the origin and dynamical histories of close-in planets. Hot Jupiters orbiting Sun-like stars show a tendency for obliquity alignment, which suggests that obliquities are rarely excited or that tidal realignment is common. However, the stellar obliquity distribution is less clear for giant planets at wider separations where realignment mechanisms are not expected to operate. In this work, we uniformly derive line-of-sight inclinations for 47 cool stars ($T_\mathrm{eff}$ $<$ 6200 K) harboring transiting hot and warm giant planets by combining rotation periods, stellar radii, and $v \sin i$ measurements. Among the systems that show signs of spin-orbit misalignment in our sample, three are identified as being misaligned here for the first time. Of particular interest are Kepler-1654, one of the longest-period (1047 d; 2.0 AU) giant planets in a misaligned system, and Kepler-30, a multi-planet misaligned system. By comparing the reconstructed underlying inclination distributions, we find that the inferred minimum misalignment distributions of hot Jupiters spanning $a/R_{*}$ = 3-20 ($\approx$ 0.01-0.1 AU) and warm Jupiters spanning $a/R_{*}$ = 20-400 ($\approx$ 0.1-1.9 AU) are in good agreement. With 90$\%$ confidence, at least 24$^{+9}_{-7}\%$ of warm Jupiters and 14$^{+7}_{-5}\%$ of hot Jupiters around cool stars are misaligned by at least 10$^\circ$. Most stars harboring warm Jupiters are therefore consistent with spin-orbit alignment. The similarity of hot and warm Jupiter misalignment rates suggests that either the occasional misalignments are primordial and originate in misaligned disks, or the same underlying processes that create misaligned hot Jupiters also lead to misaligned warm Jupiters. △ Less

Submitted 27 October, 2023; originally announced October 2023.

Comments: AJ, accepted

Cutoff for the Glauber-Exclusion process in the full high-temperature regime: an information percolation approach

Authors: Hong-Quan Tran

Abstract: The Glauber-Exclusion process is a superposition of a Glauber dynamics and the Symmetric Simple Exclusion Process (SSEP) on the lattice. The model was shown to admit a reaction-diffusion equation as the hydrodynamic limit. In this article, we define a notion of temperature regimes via the reaction function in the equation and prove cutoff in the full high-temperature regime for the attractive mode… ▽ More The Glauber-Exclusion process is a superposition of a Glauber dynamics and the Symmetric Simple Exclusion Process (SSEP) on the lattice. The model was shown to admit a reaction-diffusion equation as the hydrodynamic limit. In this article, we define a notion of temperature regimes via the reaction function in the equation and prove cutoff in the full high-temperature regime for the attractive model in dimensions $1$ and $2$ with periodic boundary condition. Our results show that the equation in the hydrodynamic limit reflects the mixing behavior of the large but finite system. Besides, cutoff is proved under the lack of reversibility and an explicit formula for the invariant measure. We also provide the spectral gap and prove pre-cutoff in all dimensions. Our proof involves a new interpretation of attractiveness, the information percolation framework introduced by Lubetzky and Sly, anti-concentration of simple random walk on the lattice, and a coupling inspired by excursion theory. We hope that this approach can find new applications in the future. △ Less

Submitted 24 October, 2023; originally announced October 2023.

Comments: 68 + 3 pages, 5 figures, comments welcome!

MSC Class: 60K35; 60J27; 82C22; 37A25

Electric Fields in Liquid Water Irradiated with Protons at Ultrahigh Dose Rates

Authors: F. Gobet, P. Barberet, M. -H. Delville, G. Devès, T. Guérin, R. Liénard, H. N. Tran, C. Vecco-Garda, A. Würger, S. Zein, H. Seznec

Abstract: We study the effects of irradiating water with 3 MeV protons at high doses by observing the motion of charged polystyrene beads outside the proton beam. By single-particle tracking, we measure a radial velocity of the order of microns per second. Combining electrokinetic theory with simulations of the beam-generated reaction products and their outward diffusion, we find that the bead motion is due… ▽ More We study the effects of irradiating water with 3 MeV protons at high doses by observing the motion of charged polystyrene beads outside the proton beam. By single-particle tracking, we measure a radial velocity of the order of microns per second. Combining electrokinetic theory with simulations of the beam-generated reaction products and their outward diffusion, we find that the bead motion is due to electrophoresis in the electric field induced by the mobility contrast of cations and anions. This work sheds light on the perturbation of biological systems by high-dose radiations and paves the way for the manipulation of colloid or macromolecular dispersions by radiation-induced diffusiophoresis. △ Less

Submitted 23 October, 2023; originally announced October 2023.

Journal ref: Phys.Rev.Lett. 131, 178001 (2023)

The weak Lefschetz property of artinian algebras associated to paths and cycles

Authors: Hop D. Nguyen, Quang Hoa Tran

Abstract: Given a base field $\Bbbk$ of characteristic zero, for each graph $G$, we associate the artinian algebra $A(G)$ defined by the edge ideal of $G$ and the squares of the variables. We study the weak Lefschetz property of $A(G)$. We classify some classes of graphs with relatively few edges, including paths and cycles, such that its associated artinian ring has the weak Lefschetz property. Given a base field $\Bbbk$ of characteristic zero, for each graph $G$, we associate the artinian algebra $A(G)$ defined by the edge ideal of $G$ and the squares of the variables. We study the weak Lefschetz property of $A(G)$. We classify some classes of graphs with relatively few edges, including paths and cycles, such that its associated artinian ring has the weak Lefschetz property. △ Less

Submitted 5 May, 2024; v1 submitted 22 October, 2023; originally announced October 2023.

Comments: 21 pages. Comments are welcome!

MSC Class: 13E10; 13F20; 13F55; 05C31

Kähler Solitons, Contact Structures, and Isoparametric Functions

Authors: Hung Tran

Abstract: LLet $(M, g, f, J, λ)$ be a complete Kähler gradient Ricci soliton. In real dimension four, all currently known examples are toric and the symmetry is intrinsically related to the potential function $f$ and the scalar curvature $\SS$. Another article addresses the case that $f$ and $\SS$ are functionally independent. In this one, we consider the dependence case and deduce the symmetry and a comple… ▽ More LLet $(M, g, f, J, λ)$ be a complete Kähler gradient Ricci soliton. In real dimension four, all currently known examples are toric and the symmetry is intrinsically related to the potential function $f$ and the scalar curvature $\SS$. Another article addresses the case that $f$ and $\SS$ are functionally independent. In this one, we consider the dependence case and deduce the symmetry and a complete classification accordingly. Specifically, integral curves of $\nabla f$ are reparamertrized geodesics and this property is closely related to the notion of isoparametric functions. Our first theorem concludes that the soliton must be either a product metric or of cohomogeneity one with deformed homogeneous Sasakian orbits. The second is a partially reverse statement in any dimension. Suppose that each regular level set of $f$ is a deformed contact metric structure then the soliton is totally determined by a regular Sasakian model, which is a Riemannian submersion over a Kähler-Einstein manifold. In particular, $f$ must be isoparametric. An important ingredient of the proof is a characterization of a deformed Sasakian structure which generalizes a classical result. △ Less

Submitted 19 August, 2024; v1 submitted 17 October, 2023; originally announced October 2023.

Comments: improve the abstract and introduction to make clearer the connection to another article

MSC Class: 53C25; 53D15; 53E30

Sparse topic modeling via spectral decomposition and thresholding

Authors: Huy Tran, Yating Liu, Claire Donnat

Abstract: The probabilistic Latent Semantic Indexing model assumes that the expectation of the corpus matrix is low-rank and can be written as the product of a topic-word matrix and a word-document matrix. In this paper, we study the estimation of the topic-word matrix under the additional assumption that the ordered entries of its columns rapidly decay to zero. This sparsity assumption is motivated by the… ▽ More The probabilistic Latent Semantic Indexing model assumes that the expectation of the corpus matrix is low-rank and can be written as the product of a topic-word matrix and a word-document matrix. In this paper, we study the estimation of the topic-word matrix under the additional assumption that the ordered entries of its columns rapidly decay to zero. This sparsity assumption is motivated by the empirical observation that the word frequencies in a text often adhere to Zipf's law. We introduce a new spectral procedure for estimating the topic-word matrix that thresholds words based on their corpus frequencies, and show that its $\ell_1$-error rate under our sparsity assumption depends on the vocabulary size $p$ only via a logarithmic term. Our error bound is valid for all parameter regimes and in particular for the setting where $p$ is extremely large; this high-dimensional setting is commonly encountered but has not been adequately addressed in prior literature. Furthermore, our procedure also accommodates datasets that violate the separability assumption, which is necessary for most prior approaches in topic modeling. Experiments with synthetic data confirm that our procedure is computationally fast and allows for consistent estimation of the topic-word matrix in a wide variety of parameter regimes. Our procedure also performs well relative to well-established methods when applied to a large corpus of research paper abstracts, as well as the analysis of single-cell and microbiome data where the same statistical model is relevant but the parameter regimes are vastly different. △ Less

Submitted 10 October, 2023; originally announced October 2023.

MSC Class: 62H12

MVC: A Multi-Task Vision Transformer Network for COVID-19 Diagnosis from Chest X-ray Images

Authors: Huyen Tran, Duc Thanh Nguyen, John Yearwood

Abstract: Medical image analysis using computer-based algorithms has attracted considerable attention from the research community and achieved tremendous progress in the last decade. With recent advances in computing resources and availability of large-scale medical image datasets, many deep learning models have been developed for disease diagnosis from medical images. However, existing techniques focus on… ▽ More Medical image analysis using computer-based algorithms has attracted considerable attention from the research community and achieved tremendous progress in the last decade. With recent advances in computing resources and availability of large-scale medical image datasets, many deep learning models have been developed for disease diagnosis from medical images. However, existing techniques focus on sub-tasks, e.g., disease classification and identification, individually, while there is a lack of a unified framework enabling multi-task diagnosis. Inspired by the capability of Vision Transformers in both local and global representation learning, we propose in this paper a new method, namely Multi-task Vision Transformer (MVC) for simultaneously classifying chest X-ray images and identifying affected regions from the input data. Our method is built upon the Vision Transformer but extends its learning capability in a multi-task setting. We evaluated our proposed method and compared it with existing baselines on a benchmark dataset of COVID-19 chest X-ray images. Experimental results verified the superiority of the proposed method over the baselines on both the image classification and affected region identification tasks. △ Less

Submitted 30 September, 2023; originally announced October 2023.

NAYER: Noisy Layer Data Generation for Efficient and Effective Data-free Knowledge Distillation

Authors: Minh-Tuan Tran, Trung Le, Xuan-May Le, Mehrtash Harandi, Quan Hung Tran, Dinh Phung

Abstract: Data-Free Knowledge Distillation (DFKD) has made significant recent strides by transferring knowledge from a teacher neural network to a student neural network without accessing the original data. Nonetheless, existing approaches encounter a significant challenge when attempting to generate samples from random noise inputs, which inherently lack meaningful information. Consequently, these models s… ▽ More Data-Free Knowledge Distillation (DFKD) has made significant recent strides by transferring knowledge from a teacher neural network to a student neural network without accessing the original data. Nonetheless, existing approaches encounter a significant challenge when attempting to generate samples from random noise inputs, which inherently lack meaningful information. Consequently, these models struggle to effectively map this noise to the ground-truth sample distribution, resulting in prolonging training times and low-quality outputs. In this paper, we propose a novel Noisy Layer Generation method (NAYER) which relocates the random source from the input to a noisy layer and utilizes the meaningful constant label-text embedding (LTE) as the input. LTE is generated by using the language model once, and then it is stored in memory for all subsequent training processes. The significance of LTE lies in its ability to contain substantial meaningful inter-class information, enabling the generation of high-quality samples with only a few training steps. Simultaneously, the noisy layer plays a key role in addressing the issue of diversity in sample generation by preventing the model from overemphasizing the constrained label information. By reinitializing the noisy layer in each iteration, we aim to facilitate the generation of diverse samples while still retaining the method's efficiency, thanks to the ease of learning provided by LTE. Experiments carried out on multiple datasets demonstrate that our NAYER not only outperforms the state-of-the-art methods but also achieves speeds 5 to 15 times faster than previous approaches. The code is available at https://github.com/tmtuan1307/nayer. △ Less

Submitted 21 March, 2024; v1 submitted 30 September, 2023; originally announced October 2023.

Comments: Accepted at CVPR 2024

On Generating Explanations for Reinforcement Learning Policies: An Empirical Study

Authors: Mikihisa Yuasa, Huy T. Tran, Ramavarapu S. Sreenivas

Abstract: Understanding a \textit{reinforcement learning} policy, which guides state-to-action mappings to maximize rewards, necessitates an accompanying explanation for human comprehension. In this paper, we introduce a set of \textit{linear temporal logic} (LTL) formulae designed to provide explanations for policies, and an algorithm for searching through those formulae for the one that best explains a gi… ▽ More Understanding a \textit{reinforcement learning} policy, which guides state-to-action mappings to maximize rewards, necessitates an accompanying explanation for human comprehension. In this paper, we introduce a set of \textit{linear temporal logic} (LTL) formulae designed to provide explanations for policies, and an algorithm for searching through those formulae for the one that best explains a given policy. Our focus is on crafting explanations that elucidate both the ultimate objectives accomplished by the policy and the prerequisite conditions it upholds throughout its execution. These LTL-based explanations feature a structured representation, which is particularly well-suited for local-search techniques. The effectiveness of our proposed approach is illustrated through a simulated game of capture the flag and a car-parking environment. The paper concludes with suggested directions for future △ Less

Submitted 5 March, 2024; v1 submitted 28 September, 2023; originally announced September 2023.

Comments: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible

Test-Case Quality -- Understanding Practitioners' Perspectives

Authors: Huynh Khanh Vi Tran, Nauman Bin Ali, Jürgen Börstler, Michael Unterkalmsteiner

Abstract: Background: Test-case quality has always been one of the major concerns in software testing. To improve test-case quality, it is important to better understand how practitioners perceive the quality of test-cases. Objective: Motivated by that need, we investigated how practitioners define test-case quality and which aspects of test-cases are important for quality assessment. Method: We conducted s… ▽ More Background: Test-case quality has always been one of the major concerns in software testing. To improve test-case quality, it is important to better understand how practitioners perceive the quality of test-cases. Objective: Motivated by that need, we investigated how practitioners define test-case quality and which aspects of test-cases are important for quality assessment. Method: We conducted semi-structured interviews with professional developers, testers and test architects from a multinational software company in Sweden. Before the interviews, we asked participants for actual test cases (written in natural language) that they perceive as good, normal, and bad respectively together with rationales for their assessment. We also compared their opinions on shared test cases and contrasted their views with the relevant literature. Results: We present a quality model which consists of 11 test-case quality attributes. We also identify a misalignment in defining test-case quality among practitioners and between academia and industry, along with suggestions for improving test-case quality in industry. Conclusion: The results show that practitioners' background, including roles and working experience, are critical dimensions of how test-case quality is defined and assessed. △ Less

Submitted 28 September, 2023; originally announced September 2023.

Comments: PROFES 2019: 37-52

A Comprehensive Survey of Document-level Relation Extraction (2016-2023)

Authors: Julien Delaunay, Hanh Thi Hong Tran, Carlos-Emiliano González-Gallardo, Georgeta Bordea, Nicolas Sidere, Antoine Doucet

Abstract: Document-level relation extraction (DocRE) is an active area of research in natural language processing (NLP) concerned with identifying and extracting relationships between entities beyond sentence boundaries. Compared to the more traditional sentence-level relation extraction, DocRE provides a broader context for analysis and is more challenging because it involves identifying relationships that… ▽ More Document-level relation extraction (DocRE) is an active area of research in natural language processing (NLP) concerned with identifying and extracting relationships between entities beyond sentence boundaries. Compared to the more traditional sentence-level relation extraction, DocRE provides a broader context for analysis and is more challenging because it involves identifying relationships that may span multiple sentences or paragraphs. This task has gained increased interest as a viable solution to build and populate knowledge bases automatically from unstructured large-scale documents (e.g., scientific papers, legal contracts, or news articles), in order to have a better understanding of relationships between entities. This paper aims to provide a comprehensive overview of recent advances in this field, highlighting its different applications in comparison to sentence-level relation extraction. △ Less

Submitted 12 October, 2023; v1 submitted 28 September, 2023; originally announced September 2023.

ACM Class: A.1

Partial Transport for Point-Cloud Registration

Authors: Yikun Bai, Huy Tran, Steven B. Damelin, Soheil Kolouri

Abstract: Point cloud registration plays a crucial role in various fields, including robotics, computer graphics, and medical imaging. This process involves determining spatial relationships between different sets of points, typically within a 3D space. In real-world scenarios, complexities arise from non-rigid movements and partial visibility, such as occlusions or sensor noise, making non-rigid registrati… ▽ More Point cloud registration plays a crucial role in various fields, including robotics, computer graphics, and medical imaging. This process involves determining spatial relationships between different sets of points, typically within a 3D space. In real-world scenarios, complexities arise from non-rigid movements and partial visibility, such as occlusions or sensor noise, making non-rigid registration a challenging problem. Classic non-rigid registration methods are often computationally demanding, suffer from unstable performance, and, importantly, have limited theoretical guarantees. The optimal transport problem and its unbalanced variations (e.g., the optimal partial transport problem) have emerged as powerful tools for point-cloud registration, establishing a strong benchmark in this field. These methods view point clouds as empirical measures and provide a mathematically rigorous way to quantify the `correspondence' between (the transformed) source and target points. In this paper, we approach the point-cloud registration problem through the lens of optimal transport theory and first propose a comprehensive set of non-rigid registration methods based on the optimal partial transportation problem. Subsequently, leveraging the emerging work on efficient solutions to the one-dimensional optimal partial transport problem, we extend our proposed algorithms via slicing to gain significant computational efficiency, resulting in fast and robust non-rigid registration algorithms. We demonstrate the effectiveness of our proposed methods and compare them against baselines on various 3D and 2D non-rigid registration problems where the source and target point clouds are corrupted by random noise. △ Less

Submitted 27 September, 2023; originally announced September 2023.

Federated Deep Equilibrium Learning: A Compact Shared Representation for Edge Communication Efficiency

Authors: Long Tan Le, Tuan Dung Nguyen, Tung-Anh Nguyen, Choong Seon Hong, Nguyen H. Tran

Abstract: Federated Learning (FL) is a prominent distributed learning paradigm facilitating collaboration among nodes within an edge network to co-train a global model without centralizing data. By shifting computation to the network edge, FL offers robust and responsive edge-AI solutions and enhance privacy-preservation. However, deploying deep FL models within edge environments is often hindered by commun… ▽ More Federated Learning (FL) is a prominent distributed learning paradigm facilitating collaboration among nodes within an edge network to co-train a global model without centralizing data. By shifting computation to the network edge, FL offers robust and responsive edge-AI solutions and enhance privacy-preservation. However, deploying deep FL models within edge environments is often hindered by communication bottlenecks, data heterogeneity, and memory limitations. To address these challenges jointly, we introduce FeDEQ, a pioneering FL framework that effectively employs deep equilibrium learning and consensus optimization to exploit a compact shared data representation across edge nodes, allowing the derivation of personalized models specific to each node. We delve into a unique model structure composed of an equilibrium layer followed by traditional neural network layers. Here, the equilibrium layer functions as a global feature representation that edge nodes can adapt to personalize their local layers. Capitalizing on FeDEQ's compactness and representation power, we present a novel distributed algorithm rooted in the alternating direction method of multipliers (ADMM) consensus optimization and theoretically establish its convergence for smooth objectives. Experiments across various benchmarks demonstrate that FeDEQ achieves performance comparable to state-of-the-art personalized methods while employing models of up to 4 times smaller in communication size and 1.5 times lower memory footprint during training. △ Less

Submitted 27 September, 2023; originally announced September 2023.

Deep Learning based Fast and Accurate Beamforming for Millimeter-Wave Systems

Authors: Tarun S Cousik, Vijay K Shah, Jeffrey H. Reed Harry X Tran, Rittwik Jana

Abstract: The widespread proliferation of mmW devices has led to a surge of interest in antenna arrays. This interest in arrays is due to their ability to steer beams in desired directions, for the purpose of increasing signal-power and/or decreasing interference levels. To enable beamforming, array coefficients are typically stored in look-up tables (LUTs) for subsequent referencing. While LUTs enable fast… ▽ More The widespread proliferation of mmW devices has led to a surge of interest in antenna arrays. This interest in arrays is due to their ability to steer beams in desired directions, for the purpose of increasing signal-power and/or decreasing interference levels. To enable beamforming, array coefficients are typically stored in look-up tables (LUTs) for subsequent referencing. While LUTs enable fast sweep times, their limited memory size restricts the number of beams the array can produce. Consequently, a receiver is likely to be offset from the main beam, thus decreasing received power, and resulting in sub-optimal performance. In this letter, we present BeamShaper, a deep neural network (DNN) framework, which enables fast and accurate beamsteering in any desirable 3-D direction. Unlike traditional finite-memory LUTs which support a fixed set of beams, BeamShaper utilizes a trained NN model to generate the array coefficients for arbitrary directions in \textit{real-time}. Our simulations show that BeamShaper outperforms contemporary LUT based solutions in terms of cosine-similarity and central angle in time scales that are slightly higher than LUT based solutions. Additionally, we show that our DNN based approach has the added advantage of being more resilient to the effects of quantization noise generated while using digital phase-shifters. △ Less

Submitted 19 September, 2023; originally announced September 2023.

Comments: 7 pages, 5 figures, accepted to Milcom2023. Not published yet(Sep 2023)

Q-Transformer: Scalable Offline Reinforcement Learning via Autoregressive Q-Functions

Authors: Yevgen Chebotar, Quan Vuong, Alex Irpan, Karol Hausman, Fei Xia, Yao Lu, Aviral Kumar, Tianhe Yu, Alexander Herzog, Karl Pertsch, Keerthana Gopalakrishnan, Julian Ibarz, Ofir Nachum, Sumedh Sontakke, Grecia Salazar, Huong T Tran, Jodilyn Peralta, Clayton Tan, Deeksha Manjunath, Jaspiar Singht, Brianna Zitkovich, Tomas Jackson, Kanishka Rao, Chelsea Finn, Sergey Levine

Abstract: In this work, we present a scalable reinforcement learning method for training multi-task policies from large offline datasets that can leverage both human demonstrations and autonomously collected data. Our method uses a Transformer to provide a scalable representation for Q-functions trained via offline temporal difference backups. We therefore refer to the method as Q-Transformer. By discretizi… ▽ More In this work, we present a scalable reinforcement learning method for training multi-task policies from large offline datasets that can leverage both human demonstrations and autonomously collected data. Our method uses a Transformer to provide a scalable representation for Q-functions trained via offline temporal difference backups. We therefore refer to the method as Q-Transformer. By discretizing each action dimension and representing the Q-value of each action dimension as separate tokens, we can apply effective high-capacity sequence modeling techniques for Q-learning. We present several design decisions that enable good performance with offline RL training, and show that Q-Transformer outperforms prior offline RL algorithms and imitation learning techniques on a large diverse real-world robotic manipulation task suite. The project's website and videos can be found at https://qtransformer.github.io △ Less

Submitted 17 October, 2023; v1 submitted 18 September, 2023; originally announced September 2023.

Comments: See website at https://qtransformer.github.io

Workshop on a future muon program at FNAL

Authors: S. Corrodi, Y. Oksuzian, A. Edmonds, J. Miller, H. N. Tran, R. Bonventre, D. N. Brown, F. Meot, V. Singh, Y. Kolomensky, S. Tripathy, L. Borrel, M. Bub, B. Echenard, D. G. Hitlin, H. Jafree, S. Middleton, R. Plestid, F. C. Porter, R. Y. Zhu, L. Bottura, E. Pinsard, A. M. Teixeira, C. Carelli, D. Ambrose , et al. (68 additional authors not shown)

Abstract: The Snowmass report on rare processes and precision measurements recommended Mu2e-II and a next generation muon facility at Fermilab (Advanced Muon Facility) as priorities for the frontier. The Workshop on a future muon program at FNAL was held in March 2023 to discuss design studies for Mu2e-II, organizing efforts for the next generation muon facility, and identify synergies with other efforts (e… ▽ More The Snowmass report on rare processes and precision measurements recommended Mu2e-II and a next generation muon facility at Fermilab (Advanced Muon Facility) as priorities for the frontier. The Workshop on a future muon program at FNAL was held in March 2023 to discuss design studies for Mu2e-II, organizing efforts for the next generation muon facility, and identify synergies with other efforts (e.g., muon collider). Topics included high-power targetry, status of R&D for Mu2e-II, development of compressor rings, FFA and concepts for muon experiments (conversion, decays, muonium and other opportunities) at AMF. This document summarizes the workshop discussions with a focus on future R&D tasks needed to realize these concepts. △ Less

Submitted 11 September, 2023; originally announced September 2023.

Comments: 68 pages, 36 figures

Report number: FERMILAB-CONF-23-464-PPD, CALT-TH-2023-036

An optimal control approach for the treatment of hepatitis C patients

Authors: Anh-Tuan Nguyen, Hien Tran

Abstract: In this article, the feasibility of using optimal control theory will be studied to develop control theoretic methods for personalized treatment of HCV patients. The mathematical model for HCV progression includes compartments for healthy hepatocytes, infected hepatocytes, infectious virions and noninfectious virions. Methodologies have been used from optimal control theory to design and synthesiz… ▽ More In this article, the feasibility of using optimal control theory will be studied to develop control theoretic methods for personalized treatment of HCV patients. The mathematical model for HCV progression includes compartments for healthy hepatocytes, infected hepatocytes, infectious virions and noninfectious virions. Methodologies have been used from optimal control theory to design and synthesize an open-loop control based treatment regimen for HCV dynamics. △ Less

Submitted 6 September, 2023; v1 submitted 5 September, 2023; originally announced September 2023.

Comments: Accepted for oral presentation at the ICCSE 2014, Ho Chi Minh City, Vietnam

PolyGET: Accelerating Polymer Simulations by Accurate and Generalizable Forcefield with Equivariant Transformer

Authors: Rui Feng, Huan Tran, Aubrey Toland, Binghong Chen, Qi Zhu, Rampi Ramprasad, Chao Zhang

Abstract: Polymer simulation with both accuracy and efficiency is a challenging task. Machine learning (ML) forcefields have been developed to achieve both the accuracy of ab initio methods and the efficiency of empirical force fields. However, existing ML force fields are usually limited to single-molecule settings, and their simulations are not robust enough. In this paper, we present PolyGET, a new frame… ▽ More Polymer simulation with both accuracy and efficiency is a challenging task. Machine learning (ML) forcefields have been developed to achieve both the accuracy of ab initio methods and the efficiency of empirical force fields. However, existing ML force fields are usually limited to single-molecule settings, and their simulations are not robust enough. In this paper, we present PolyGET, a new framework for Polymer Forcefields with Generalizable Equivariant Transformers. PolyGET is designed to capture complex quantum interactions between atoms and generalize across various polymer families, using a deep learning model called Equivariant Transformers. We propose a new training paradigm that focuses exclusively on optimizing forces, which is different from existing methods that jointly optimize forces and energy. This simple force-centric objective function avoids competing objectives between energy and forces, thereby allowing for learning a unified forcefield ML model over different polymer families. We evaluated PolyGET on a large-scale dataset of 24 distinct polymer types and demonstrated state-of-the-art performance in force accuracy and robust MD simulations. Furthermore, PolyGET can simulate large polymers with high fidelity to the reference ab initio DFT method while being able to generalize to unseen polymers. △ Less

Submitted 1 September, 2023; originally announced September 2023.

A Text-based Approach For Link Prediction on Wikipedia Articles

Authors: Anh Hoang Tran, Tam Minh Nguyen, Son T. Luu

Abstract: This paper present our work in the DSAA 2023 Challenge about Link Prediction for Wikipedia Articles. We use traditional machine learning models with POS tags (part-of-speech tags) features extracted from text to train the classification model for predicting whether two nodes has the link. Then, we use these tags to test on various machine learning models. We obtained the results by F1 score at 0.9… ▽ More This paper present our work in the DSAA 2023 Challenge about Link Prediction for Wikipedia Articles. We use traditional machine learning models with POS tags (part-of-speech tags) features extracted from text to train the classification model for predicting whether two nodes has the link. Then, we use these tags to test on various machine learning models. We obtained the results by F1 score at 0.99999 and got 7th place in the competition. Our source code is publicly available at this link: https://github.com/Tam1032/DSAA2023-Challenge-Link-prediction-DS-UIT_SAT △ Less

Submitted 6 November, 2023; v1 submitted 1 September, 2023; originally announced September 2023.

Comments: Accepted by DSAA 2023 Conference in the DSAA Student Competition Section

May the Force be with You: Unified Force-Centric Pre-Training for 3D Molecular Conformations

Authors: Rui Feng, Qi Zhu, Huan Tran, Binghong Chen, Aubrey Toland, Rampi Ramprasad, Chao Zhang

Abstract: Recent works have shown the promise of learning pre-trained models for 3D molecular representation. However, existing pre-training models focus predominantly on equilibrium data and largely overlook off-equilibrium conformations. It is challenging to extend these methods to off-equilibrium data because their training objective relies on assumptions of conformations being the local energy minima. W… ▽ More Recent works have shown the promise of learning pre-trained models for 3D molecular representation. However, existing pre-training models focus predominantly on equilibrium data and largely overlook off-equilibrium conformations. It is challenging to extend these methods to off-equilibrium data because their training objective relies on assumptions of conformations being the local energy minima. We address this gap by proposing a force-centric pretraining model for 3D molecular conformations covering both equilibrium and off-equilibrium data. For off-equilibrium data, our model learns directly from their atomic forces. For equilibrium data, we introduce zero-force regularization and forced-based denoising techniques to approximate near-equilibrium forces. We obtain a unified pre-trained model for 3D molecular representation with over 15 million diverse conformations. Experiments show that, with our pre-training objective, we increase forces accuracy by around 3 times compared to the un-pre-trained Equivariant Transformer model. By incorporating regularizations on equilibrium data, we solved the problem of unstable MD simulations in vanilla Equivariant Transformers, achieving state-of-the-art simulation performance with 2.45 times faster inference time than NequIP. As a powerful molecular encoder, our pre-trained model achieves on-par performance with state-of-the-art property prediction tasks. △ Less

Submitted 23 August, 2023; originally announced August 2023.