Showing 101–150 of 891 results for author: Dai, Y

Towards Large-scale Probabilistic Set Covering Problem: An Efficient Benders Decomposition Approach

Authors: Wei-Kun Chen, Yi-Long Chen, Yu-Hong Dai, Wei Lv

Abstract: In this paper, we investigate the probabilistic set covering problems (PSCP) in which the right-hand side is a random vector ξ and the covering constraint is required to be satisfied with a prespecified probability. We consider the case arising from sample average approximation (or finite discrete distributions). We develop an effective Benders decomposition (BD) algorithm for solving large-scale… ▽ More In this paper, we investigate the probabilistic set covering problems (PSCP) in which the right-hand side is a random vector ξ and the covering constraint is required to be satisfied with a prespecified probability. We consider the case arising from sample average approximation (or finite discrete distributions). We develop an effective Benders decomposition (BD) algorithm for solving large-scale PSCPs, which enjoys two key advantages: (i) the number of variables in the underlying Benders reformulation is independent of the scenario size; and (ii) the Benders cuts can be separated by an efficient combinatorial algorithm. For the special case that ξ is a combination of several independent random blocks/subvectors, we explicitly take this kind of block structure into consideration and develop a more efficient BD algorithm. Numerical results on instances with up to one million scenarios demonstrate the effectiveness of the proposed BD algorithms over a black-box MIP solver's branch-and-cut and automatic BD algorithms and a state-of-the-art algorithm in the literature. △ Less

Submitted 28 February, 2024; originally announced February 2024.

Comments: 13 pages, accepted for publication in IOS 2024

Look Before You Leap: Towards Decision-Aware and Generalizable Tool-Usage for Large Language Models

Authors: Anchun Gui, Jian Li, Yong Dai, Nan Du, Han Xiao

Abstract: Tool-augmented large language models (LLMs) are attracting widespread attention when accessing up-to-date knowledge and alleviating hallucination issues. Nowadays, advanced closed-source LLMs (e.g., ChatGPT) have demonstrated surprising tool-usage capabilities through prompting and in-context learning techniques. To empower the capabilities of open-source LLMs (e.g., LLaMA) in manipulating tools,… ▽ More Tool-augmented large language models (LLMs) are attracting widespread attention when accessing up-to-date knowledge and alleviating hallucination issues. Nowadays, advanced closed-source LLMs (e.g., ChatGPT) have demonstrated surprising tool-usage capabilities through prompting and in-context learning techniques. To empower the capabilities of open-source LLMs (e.g., LLaMA) in manipulating tools, current efforts focus on either template-driven or token-triggered tool-usage. However, the former hampers LLMs' flexibility to address diverse user's queries due to constrained tool interactions, while the latter limits the generalizability when engaging with new tools, since tool-usage learning is based on task- and tool-specific datasets. To alleviate these concerns, in this paper, we propose a decision-aware and generalizable tool-usage framework (DEER). Specifically, we first construct the tool-usage samples with multiple decision branches via an automatic generation pipeline, thereby inspiring the decision-making awareness of LLMs under diverse scenarios. Meanwhile, we propose a novel tool sampling strategy to enhance the generalizability of LLMs over unseen tools. Extensive experiments demonstrate that our proposed DEER is effective and significantly outperforms baselines across various datasets. △ Less

Submitted 28 August, 2024; v1 submitted 26 February, 2024; originally announced February 2024.

Comments: 20 pages, 18 figures

Language-Based User Profiles for Recommendation

Authors: Joyce Zhou, Yijia Dai, Thorsten Joachims

Abstract: Most conventional recommendation methods (e.g., matrix factorization) represent user profiles as high-dimensional vectors. Unfortunately, these vectors lack interpretability and steerability, and often perform poorly in cold-start settings. To address these shortcomings, we explore the use of user profiles that are represented as human-readable text. We propose the Language-based Factorization Mod… ▽ More Most conventional recommendation methods (e.g., matrix factorization) represent user profiles as high-dimensional vectors. Unfortunately, these vectors lack interpretability and steerability, and often perform poorly in cold-start settings. To address these shortcomings, we explore the use of user profiles that are represented as human-readable text. We propose the Language-based Factorization Model (LFM), which is essentially an encoder/decoder model where both the encoder and the decoder are large language models (LLMs). The encoder LLM generates a compact natural-language profile of the user's interests from the user's rating history. The decoder LLM uses this summary profile to complete predictive downstream tasks. We evaluate our LFM approach on the MovieLens dataset, comparing it against matrix factorization and an LLM model that directly predicts from the user's rating history. In cold-start settings, we find that our method can have higher accuracy than matrix factorization. Furthermore, we find that generating a compact and human-readable summary often performs comparably with or better than direct LLM prediction, while enjoying better interpretability and shorter model input length. Our results motivate a number of future research directions and potential improvements. △ Less

Submitted 23 February, 2024; originally announced February 2024.

Comments: 8 pages (4 in appendix), 22 tables/figures (16 in appendix). Accepted to LLM-IGS@WSDM2024 workshop, now sharing this slightly updated revision version with workshop

FinBen: A Holistic Financial Benchmark for Large Language Models

Authors: Qianqian Xie, Weiguang Han, Zhengyu Chen, Ruoyu Xiang, Xiao Zhang, Yueru He, Mengxi Xiao, Dong Li, Yongfu Dai, Duanyu Feng, Yijing Xu, Haoqiang Kang, Ziyan Kuang, Chenhan Yuan, Kailai Yang, Zheheng Luo, Tianlin Zhang, Zhiwei Liu, Guojun Xiong, Zhiyang Deng, Yuechen Jiang, Zhiyuan Yao, Haohang Li, Yangyang Yu, Gang Hu , et al. (9 additional authors not shown)

Abstract: LLMs have transformed NLP and shown promise in various fields, yet their potential in finance is underexplored due to a lack of comprehensive evaluation benchmarks, the rapid development of LLMs, and the complexity of financial tasks. In this paper, we introduce FinBen, the first extensive open-source evaluation benchmark, including 36 datasets spanning 24 financial tasks, covering seven critical… ▽ More LLMs have transformed NLP and shown promise in various fields, yet their potential in finance is underexplored due to a lack of comprehensive evaluation benchmarks, the rapid development of LLMs, and the complexity of financial tasks. In this paper, we introduce FinBen, the first extensive open-source evaluation benchmark, including 36 datasets spanning 24 financial tasks, covering seven critical aspects: information extraction (IE), textual analysis, question answering (QA), text generation, risk management, forecasting, and decision-making. FinBen offers several key innovations: a broader range of tasks and datasets, the first evaluation of stock trading, novel agent and Retrieval-Augmented Generation (RAG) evaluation, and three novel open-source evaluation datasets for text summarization, question answering, and stock trading. Our evaluation of 15 representative LLMs, including GPT-4, ChatGPT, and the latest Gemini, reveals several key findings: While LLMs excel in IE and textual analysis, they struggle with advanced reasoning and complex tasks like text generation and forecasting. GPT-4 excels in IE and stock trading, while Gemini is better at text generation and forecasting. Instruction-tuned LLMs improve textual analysis but offer limited benefits for complex tasks such as QA. FinBen has been used to host the first financial LLMs shared task at the FinNLP-AgentScen workshop during IJCAI-2024, attracting 12 teams. Their novel solutions outperformed GPT-4, showcasing FinBen's potential to drive innovation in financial LLMs. All datasets, results, and codes are released for the research community: https://github.com/The-FinAI/PIXIU. △ Less

Submitted 18 June, 2024; v1 submitted 19 February, 2024; originally announced February 2024.

Comments: 26 pages, 11 figures

Refined Sample Complexity for Markov Games with Independent Linear Function Approximation

Authors: Yan Dai, Qiwen Cui, Simon S. Du

Abstract: Markov Games (MG) is an important model for Multi-Agent Reinforcement Learning (MARL). It was long believed that the "curse of multi-agents" (i.e., the algorithmic performance drops exponentially with the number of agents) is unavoidable until several recent works (Daskalakis et al., 2023; Cui et al., 2023; Wang et al., 2023). While these works resolved the curse of multi-agents, when the state sp… ▽ More Markov Games (MG) is an important model for Multi-Agent Reinforcement Learning (MARL). It was long believed that the "curse of multi-agents" (i.e., the algorithmic performance drops exponentially with the number of agents) is unavoidable until several recent works (Daskalakis et al., 2023; Cui et al., 2023; Wang et al., 2023). While these works resolved the curse of multi-agents, when the state spaces are prohibitively large and (linear) function approximations are deployed, they either had a slower convergence rate of $O(T^{-1/4})$ or brought a polynomial dependency on the number of actions $A_{\max}$ -- which is avoidable in single-agent cases even when the loss functions can arbitrarily vary with time. This paper first refines the AVLPR framework by Wang et al. (2023), with an insight of designing *data-dependent* (i.e., stochastic) pessimistic estimation of the sub-optimality gap, allowing a broader choice of plug-in algorithms. When specialized to MGs with independent linear function approximations, we propose novel *action-dependent bonuses* to cover occasionally extreme estimation errors. With the help of state-of-the-art techniques from the single-agent RL literature, we give the first algorithm that tackles the curse of multi-agents, attains the optimal $O(T^{-1/2})$ convergence rate, and avoids $\text{poly}(A_{\max})$ dependency simultaneously. △ Less

Submitted 11 June, 2024; v1 submitted 10 February, 2024; originally announced February 2024.

Comments: Accepted for presentation at the Conference on Learning Theory (COLT) 2024

LiRank: Industrial Large Scale Ranking Models at LinkedIn

Authors: Fedor Borisyuk, Mingzhou Zhou, Qingquan Song, Siyu Zhu, Birjodh Tiwana, Ganesh Parameswaran, Siddharth Dangi, Lars Hertel, Qiang Xiao, Xiaochen Hou, Yunbo Ouyang, Aman Gupta, Sheallika Singh, Dan Liu, Hailing Cheng, Lei Le, Jonathan Hung, Sathiya Keerthi, Ruoyan Wang, Fengyu Zhang, Mohit Kothari, Chen Zhu, Daqi Sun, Yun Dai, Xun Luan , et al. (9 additional authors not shown)

Abstract: We present LiRank, a large-scale ranking framework at LinkedIn that brings to production state-of-the-art modeling architectures and optimization methods. We unveil several modeling improvements, including Residual DCN, which adds attention and residual connections to the famous DCNv2 architecture. We share insights into combining and tuning SOTA architectures to create a unified model, including… ▽ More We present LiRank, a large-scale ranking framework at LinkedIn that brings to production state-of-the-art modeling architectures and optimization methods. We unveil several modeling improvements, including Residual DCN, which adds attention and residual connections to the famous DCNv2 architecture. We share insights into combining and tuning SOTA architectures to create a unified model, including Dense Gating, Transformers and Residual DCN. We also propose novel techniques for calibration and describe how we productionalized deep learning based explore/exploit methods. To enable effective, production-grade serving of large ranking models, we detail how to train and compress models using quantization and vocabulary compression. We provide details about the deployment setup for large-scale use cases of Feed ranking, Jobs Recommendations, and Ads click-through rate (CTR) prediction. We summarize our learnings from various A/B tests by elucidating the most effective technical approaches. These ideas have contributed to relative metrics improvements across the board at LinkedIn: +0.5% member sessions in the Feed, +1.76% qualified job applications for Jobs search and recommendations, and +4.3% for Ads CTR. We hope this work can provide practical insights and solutions for practitioners interested in leveraging large-scale deep ranking systems. △ Less

Submitted 7 August, 2024; v1 submitted 9 February, 2024; originally announced February 2024.

ACM Class: H.3.3

Enhancing Zero-shot Counting via Language-guided Exemplar Learning

Authors: Mingjie Wang, Jun Zhou, Yong Dai, Eric Buys, Minglun Gong

Abstract: Recently, Class-Agnostic Counting (CAC) problem has garnered increasing attention owing to its intriguing generality and superior efficiency compared to Category-Specific Counting (CSC). This paper proposes a novel ExpressCount to enhance zero-shot object counting by delving deeply into language-guided exemplar learning. Specifically, the ExpressCount is comprised of an innovative Language-oriente… ▽ More Recently, Class-Agnostic Counting (CAC) problem has garnered increasing attention owing to its intriguing generality and superior efficiency compared to Category-Specific Counting (CSC). This paper proposes a novel ExpressCount to enhance zero-shot object counting by delving deeply into language-guided exemplar learning. Specifically, the ExpressCount is comprised of an innovative Language-oriented Exemplar Perceptron and a downstream visual Zero-shot Counting pipeline. Thereinto, the perceptron hammers at exploiting accurate exemplar cues from collaborative language-vision signals by inheriting rich semantic priors from the prevailing pre-trained Large Language Models (LLMs), whereas the counting pipeline excels in mining fine-grained features through dual-branch and cross-attention schemes, contributing to the high-quality similarity learning. Apart from building a bridge between the LLM in vogue and the visual counting tasks, expression-guided exemplar estimation significantly advances zero-shot learning capabilities for counting instances with arbitrary classes. Moreover, devising a FSC-147-Express with annotations of meticulous linguistic expressions pioneers a new venue for developing and validating language-based counting models. Extensive experiments demonstrate the state-of-the-art performance of our ExpressCount, even showcasing the accuracy on par with partial CSC models. △ Less

Submitted 7 February, 2024; originally announced February 2024.

Tensor Completion via Integer Optimization

Authors: Xin Chen, Sukanya Kudva, Yongzheng Dai, Anil Aswani, Chen Chen

Abstract: The main challenge with the tensor completion problem is a fundamental tension between computation power and the information-theoretic sample complexity rate. Past approaches either achieve the information-theoretic rate but lack practical algorithms to compute the corresponding solution, or have polynomial-time algorithms that require an exponentially-larger number of samples for low estimation e… ▽ More The main challenge with the tensor completion problem is a fundamental tension between computation power and the information-theoretic sample complexity rate. Past approaches either achieve the information-theoretic rate but lack practical algorithms to compute the corresponding solution, or have polynomial-time algorithms that require an exponentially-larger number of samples for low estimation error. This paper develops a novel tensor completion algorithm that resolves this tension by achieving both provable convergence (in numerical tolerance) in a linear number of oracle steps and the information-theoretic rate. Our approach formulates tensor completion as a convex optimization problem constrained using a gauge-based tensor norm, which is defined in a way that allows the use of integer linear optimization to solve linear separation problems over the unit-ball in this new norm. Adaptations based on this insight are incorporated into a Frank-Wolfe variant to build our algorithm. We show our algorithm scales-well using numerical experiments on tensors with up to ten million entries. △ Less

Submitted 3 April, 2024; v1 submitted 6 February, 2024; originally announced February 2024.

Dust and Cold Gas Properties of Starburst HyLIRG-Quasars at $z \sim 2.5$

Authors: Feng-Yuan Liu, Y. Sophia Dai, Alain Omont, Daizhong Liu, Pierre Cox, Roberto Neri, Melanie Krips, Chentao Yang, Xue-Bing Wu, Jia-Sheng Huang

Abstract: Some high-z active galactic nuclei (AGNs) are found to reside in extreme star-forming galaxies, such as hyper-luminous infrared galaxies (HyLIRGs), with AGN-removed $L_{\rm{IR}}$ of $>10^{13} L_{\rm{\odot}}$. In this paper, we report NOEMA observations of six apparent starburst HyLIRGs associated with optical quasars at $z\sim2-3$ in the Stripe 82 field, to study their dust and molecular CO proper… ▽ More Some high-z active galactic nuclei (AGNs) are found to reside in extreme star-forming galaxies, such as hyper-luminous infrared galaxies (HyLIRGs), with AGN-removed $L_{\rm{IR}}$ of $>10^{13} L_{\rm{\odot}}$. In this paper, we report NOEMA observations of six apparent starburst HyLIRGs associated with optical quasars at $z\sim2-3$ in the Stripe 82 field, to study their dust and molecular CO properties. Five out of the six candidates are detected with CO(4-3) or CO(5-4) emission, and four in 2mm dust continuum. Based on the linewidth-$L'_{\rm{CO(1-0)}}$ diagnostics, we find that four galaxies are likely unlensed or weakly lensed sources. The molecular gas mass is in the range of $μM_{\rm{H_2}} \sim0.8-9.7\times10^{10} M_{\odot}$ (with $α= 0.8 M_{\odot} (\rm{K km s^{-1} pc^2})^{-1}$ and $μ$ is the unknown possible gravitational magnification factor). We fit their SEDs, after including the observed 2mm fluxes and upper limits, and estimate their apparent (uncorrected for possible lensing effect) star formation rates ($μ$SFRs) to be $\sim400-2500$ $M_{\rm{\odot}} \rm{yr^{-1}}$ with depletion time of $\sim20-110$ Myr. We notice interesting offsets, of $\sim10-40$ kpc spatially or $\sim1000-2000$ km s$^{-1}$ spectroscopically, between the optical quasar and the mm continuum or CO emissions. The observed velocity shift is likely related to the blueshifted broad-emission-line region of quasars, though mergers or recoiling black holes are also possible causes, which can explain the spatial offset and the high intrinsic SFRs in the HyLIRG-quasar systems. △ Less

Submitted 6 February, 2024; originally announced February 2024.

Comments: 22 pages, 6 figures, 7 tables. Accepted for publication in The Astrophysical Journal

Improvement of Frequency Source Phase Noise Reduction Design under Vibration Condition

Authors: Liwei Yin, Yongjiang Shu, Heng Zhang, Yuefei Dai, Xiaopeng Lu, Yunlong Lian, Zhonghua Wang, Yong Ding

Abstract: Reasonable vibration reduction design is an important way to achieve low phase noise index of airborne frequency source output signal. Aiming at the problem of phase noise deterioration of an airborne frequency source under random condition, this paper proposes to improve the vibration reduction mode crystal oscillator and reduce the distance between the barycenter of frequency source and crystal… ▽ More Reasonable vibration reduction design is an important way to achieve low phase noise index of airborne frequency source output signal. Aiming at the problem of phase noise deterioration of an airborne frequency source under random condition, this paper proposes to improve the vibration reduction mode crystal oscillator and reduce the distance between the barycenter of frequency source and crystal oscillator vibration based on the analysis of the relationship between the frequency source and the phase noise of output signal. Experimental results show that the active noise control system achieves 62dB phase noise compensation under the random vibration of 0.04-0.1g*g/Hz amplitude range and 5-2000 Hz frequency range. △ Less

Submitted 16 July, 2024; v1 submitted 6 February, 2024; originally announced February 2024.

Comments: There are many errors. 1.Fig. 2 Block Diagram of Frequency Source Circuit is not correct. 2.C-band C1 signal 6000MHz continuous wave signal is error. 3.Fig. 4 Steady State Phase Noise and Spectrum of 2400MHz before Improvement is error. 4.Table 1 Steady State Phase Noise at each Frequency Point of the Output of the Frequency Source before Improvement is error. 5. Frequency range is error

MSC Class: D.3.2 ACM Class: B.6.2

SUB-PLAY: Adversarial Policies against Partially Observed Multi-Agent Reinforcement Learning Systems

Authors: Oubo Ma, Yuwen Pu, Linkang Du, Yang Dai, Ruo Wang, Xiaolei Liu, Yingcai Wu, Shouling Ji

Abstract: Recent advancements in multi-agent reinforcement learning (MARL) have opened up vast application prospects, such as swarm control of drones, collaborative manipulation by robotic arms, and multi-target encirclement. However, potential security threats during the MARL deployment need more attention and thorough investigation. Recent research reveals that attackers can rapidly exploit the victim's v… ▽ More Recent advancements in multi-agent reinforcement learning (MARL) have opened up vast application prospects, such as swarm control of drones, collaborative manipulation by robotic arms, and multi-target encirclement. However, potential security threats during the MARL deployment need more attention and thorough investigation. Recent research reveals that attackers can rapidly exploit the victim's vulnerabilities, generating adversarial policies that result in the failure of specific tasks. For instance, reducing the winning rate of a superhuman-level Go AI to around 20%. Existing studies predominantly focus on two-player competitive environments, assuming attackers possess complete global state observation. In this study, we unveil, for the first time, the capability of attackers to generate adversarial policies even when restricted to partial observations of the victims in multi-agent competitive environments. Specifically, we propose a novel black-box attack (SUB-PLAY) that incorporates the concept of constructing multiple subgames to mitigate the impact of partial observability and suggests sharing transitions among subpolicies to improve attackers' exploitative ability. Extensive evaluations demonstrate the effectiveness of SUB-PLAY under three typical partial observability limitations. Visualization results indicate that adversarial policies induce significantly different activations of the victims' policy networks. Furthermore, we evaluate three potential defenses aimed at exploring ways to mitigate security threats posed by adversarial policies, providing constructive recommendations for deploying MARL in competitive environments. △ Less

Submitted 26 June, 2024; v1 submitted 6 February, 2024; originally announced February 2024.

Comments: To appear in the ACM Conference on Computer and Communications Security (CCS'24), October 14-18, 2024, Salt Lake City, UT, USA

On the non-universality of heavy quark hadronization in elementary high-energy collisions

Authors: Yuxuan Dai, Shouxing Zhao, Min He

Abstract: It has been traditionally hypothesized that the heavy quark (charm, $c$ and bottom, $b$) fragmentation is universal across different collision systems, based on the notion that hadronization as a soft process should occur at the characteristic non-perturbative QCD scale, $Λ_{QCD}$. However, this universality hypothesis has recently been challenged by the observation that the $c$- and $b$-baryon pr… ▽ More It has been traditionally hypothesized that the heavy quark (charm, $c$ and bottom, $b$) fragmentation is universal across different collision systems, based on the notion that hadronization as a soft process should occur at the characteristic non-perturbative QCD scale, $Λ_{QCD}$. However, this universality hypothesis has recently been challenged by the observation that the $c$- and $b$-baryon production relative to their meson counterparts in minimum bias proton-proton ($pp$) collisions at the LHC energies is significantly enhanced as compared to the electron-positron ($e^+e^-$) collisions. The conception of non-universality is unambiguously reinforced by the latest measurement of the charged-particle multiplicity dependence of the $b$-baryon-to-meson yield ratio, $Λ_b/B$, by the LHCb experiment in $\sqrt{s}=13$\,TeV $pp$ collisions at the LHC, evolving continuously from the saturation value in minimum bias $pp$ collisions toward the small value in $e^+e^-$ collisions as the system size gradually reduces. We address the multiplicity dependence of $b$-baryon production in the canonical statistical hadronization model with input $b$-hadron spectrum augmented with many hitherto unobserved states from quark model predictions. We demonstrate that the decreasing trend of the $Λ_b/B$ toward low multiplicities can be quantitatively understood from the canonical suppression on the yield of $Λ_b$, as caused by the requirement of strict conservation of baryon number in sufficiently small systems. We have therefore proposed a plausible scenario for understanding the origin of the non-universality of heavy quark fragmentation in elementary collisions. △ Less

Submitted 5 February, 2024; originally announced February 2024.

Comments: 6 pages, 3 figures

Zeroth-Order primal-dual Alternating Projection Gradient Algorithms for Nonconvex Minimax Problems with Coupled linear Constraints

Authors: Huiling Zhang, Zi Xu, Yuhong Dai

Abstract: In this paper, we study zeroth-order algorithms for nonconvex minimax problems with coupled linear constraints under the deterministic and stochastic settings, which have attracted wide attention in machine learning, signal processing and many other fields in recent years, e.g., adversarial attacks in resource allocation problems and network flow problems etc. We propose two single-loop algorithms… ▽ More In this paper, we study zeroth-order algorithms for nonconvex minimax problems with coupled linear constraints under the deterministic and stochastic settings, which have attracted wide attention in machine learning, signal processing and many other fields in recent years, e.g., adversarial attacks in resource allocation problems and network flow problems etc. We propose two single-loop algorithms, namely the zero-order primal-dual alternating projected gradient (ZO-PDAPG) algorithm and the zero-order regularized momentum primal-dual projected gradient algorithm (ZO-RMPDPG), for solving deterministic and stochastic nonconvex-(strongly) concave minimax problems with coupled linear constraints. The iteration complexity of the two proposed algorithms to obtain an $\varepsilon$-stationary point are proved to be $\mathcal{O}(\varepsilon ^{-2})$ (resp. $\mathcal{O}(\varepsilon ^{-4})$) for solving nonconvex-strongly concave (resp. nonconvex-concave) minimax problems with coupled linear constraints under deterministic settings and $\tilde{\mathcal{O}}(\varepsilon ^{-3})$ (resp. $\tilde{\mathcal{O}}(\varepsilon ^{-6.5})$) under stochastic settings respectively. To the best of our knowledge, they are the first two zeroth-order algorithms with iterative complexity guarantees for solving nonconvex-(strongly) concave minimax problems with coupled linear constraints under the deterministic and stochastic settings. △ Less

Submitted 26 January, 2024; originally announced February 2024.

Comments: arXiv admin note: text overlap with arXiv:2212.04672

Breaking MLPerf Training: A Case Study on Optimizing BERT

Authors: Yongdeok Kim, Jaehyung Ahn, Myeongwoo Kim, Changin Choi, Heejae Kim, Narankhuu Tuvshinjargal, Seungwon Lee, Yanzi Zhang, Yuan Pei, Xiongzhan Linghu, Jingkun Ma, Lin Chen, Yuehua Dai, Sungjoo Yoo

Abstract: Speeding up the large-scale distributed training is challenging in that it requires improving various components of training including load balancing, communication, optimizers, etc. We present novel approaches for fast large-scale training of BERT model which individually ameliorates each component thereby leading to a new level of BERT training performance. Load balancing is imperative in distri… ▽ More Speeding up the large-scale distributed training is challenging in that it requires improving various components of training including load balancing, communication, optimizers, etc. We present novel approaches for fast large-scale training of BERT model which individually ameliorates each component thereby leading to a new level of BERT training performance. Load balancing is imperative in distributed BERT training since its training datasets are characterized by samples with various lengths. Communication cost, which is proportional to the scale of distributed training, needs to be hidden by useful computation. In addition, the optimizers, e.g., ADAM, LAMB, etc., need to be carefully re-evaluated in the context of large-scale distributed training. We propose two new ideas, (1) local presorting based on dataset stratification for load balancing and (2) bucket-wise gradient clipping before allreduce which allows us to benefit from the overlap of gradient computation and synchronization as well as the fast training of gradient clipping before allreduce. We also re-evaluate existing optimizers via hyperparameter optimization and utilize ADAM, which also contributes to fast training via larger batches than existing methods. Our proposed methods, all combined, give the fastest MLPerf BERT training of 25.1 (22.3) seconds on 1,024 NVIDIA A100 GPUs, which is 1.33x (1.13x) and 1.57x faster than the other top two (one) submissions to MLPerf v1.1 (v2.0). Our implementation and evaluation results are available at MLPerf v1.1~v2.1. △ Less

Submitted 4 February, 2024; originally announced February 2024.

Comments: Total 15 pages (Appendix 3 pages)

Understanding Adam Optimizer via Online Learning of Updates: Adam is FTRL in Disguise

Authors: Kwangjun Ahn, Zhiyu Zhang, Yunbum Kook, Yan Dai

Abstract: Despite the success of the Adam optimizer in practice, the theoretical understanding of its algorithmic components still remains limited. In particular, most existing analyses of Adam show the convergence rate that can be simply achieved by non-adative algorithms like SGD. In this work, we provide a different perspective based on online learning that underscores the importance of Adam's algorithmi… ▽ More Despite the success of the Adam optimizer in practice, the theoretical understanding of its algorithmic components still remains limited. In particular, most existing analyses of Adam show the convergence rate that can be simply achieved by non-adative algorithms like SGD. In this work, we provide a different perspective based on online learning that underscores the importance of Adam's algorithmic components. Inspired by Cutkosky et al. (2023), we consider the framework called online learning of updates/increments, where we choose the updates/increments of an optimizer based on an online learner. With this framework, the design of a good optimizer is reduced to the design of a good online learner. Our main observation is that Adam corresponds to a principled online learning framework called Follow-the-Regularized-Leader (FTRL). Building on this observation, we study the benefits of its algorithmic components from the online learning perspective. △ Less

Submitted 30 May, 2024; v1 submitted 2 February, 2024; originally announced February 2024.

Comments: Accepted at ICML 2024

Embracing Language Inclusivity and Diversity in CLIP through Continual Language Learning

Authors: Bang Yang, Yong Dai, Xuxin Cheng, Yaowei Li, Asif Raza, Yuexian Zou

Abstract: While vision-language pre-trained models (VL-PTMs) have advanced multimodal research in recent years, their mastery in a few languages like English restricts their applicability in broader communities. To this end, there is an increasing interest in developing multilingual VL models via a joint-learning setup, which, however, could be unrealistic due to expensive costs and data availability. In th… ▽ More While vision-language pre-trained models (VL-PTMs) have advanced multimodal research in recent years, their mastery in a few languages like English restricts their applicability in broader communities. To this end, there is an increasing interest in developing multilingual VL models via a joint-learning setup, which, however, could be unrealistic due to expensive costs and data availability. In this work, we propose to extend VL-PTMs' language capacity by continual language learning (CLL), where a model needs to update its linguistic knowledge incrementally without suffering from catastrophic forgetting (CF). We begin our study by introducing a model dubbed CLL-CLIP, which builds upon CLIP, a prevailing VL-PTM that has acquired image-English text alignment. Specifically, CLL-CLIP contains an expandable token embedding layer to handle linguistic differences. It solely trains token embeddings to improve memory stability and is optimized under cross-modal and cross-lingual objectives to learn the alignment between images and multilingual texts. To alleviate CF raised by covariate shift and lexical overlap, we further propose a novel approach that ensures the identical distribution of all token embeddings during initialization and regularizes token embedding learning during training. We construct a CLL benchmark covering 36 languages based on MSCOCO and XM3600 datasets and then evaluate multilingual image-text retrieval performance. Extensive experiments verify the effectiveness of CLL-CLIP and show that our approach can boost CLL-CLIP, e.g., by 6.7% in text-to-image average Recall@1 on XM3600, and improve various state-of-the-art methods consistently. Our code and data are available at \url{https://github.com/yangbang18/CLFM}. △ Less

Submitted 30 January, 2024; originally announced January 2024.

Comments: Accepted by AAAI'2024, 15 pages (with appendix), 7 figures, 10 tables

SmartFRZ: An Efficient Training Framework using Attention-Based Layer Freezing

Authors: Sheng Li, Geng Yuan, Yue Dai, Youtao Zhang, Yanzhi Wang, Xulong Tang

Abstract: There has been a proliferation of artificial intelligence applications, where model training is key to promising high-quality services for these applications. However, the model training process is both time-intensive and energy-intensive, inevitably affecting the user's demand for application efficiency. Layer freezing, an efficient model training technique, has been proposed to improve training… ▽ More There has been a proliferation of artificial intelligence applications, where model training is key to promising high-quality services for these applications. However, the model training process is both time-intensive and energy-intensive, inevitably affecting the user's demand for application efficiency. Layer freezing, an efficient model training technique, has been proposed to improve training efficiency. Although existing layer freezing methods demonstrate the great potential to reduce model training costs, they still remain shortcomings such as lacking generalizability and compromised accuracy. For instance, existing layer freezing methods either require the freeze configurations to be manually defined before training, which does not apply to different networks, or use heuristic freezing criteria that is hard to guarantee decent accuracy in different scenarios. Therefore, there lacks a generic and smart layer freezing method that can automatically perform ``in-situation'' layer freezing for different networks during training processes. To this end, we propose a generic and efficient training framework (SmartFRZ). The core proposed technique in SmartFRZ is attention-guided layer freezing, which can automatically select the appropriate layers to freeze without compromising accuracy. Experimental results show that SmartFRZ effectively reduces the amount of computation in training and achieves significant training acceleration, and outperforms the state-of-the-art layer freezing approaches. △ Less

Submitted 29 January, 2024; originally announced January 2024.

etuner: A Redundancy-Aware Framework for Efficient Continual Learning Application on Edge Devices

Authors: Sheng Li, Geng Yuan, Yawen Wu, Yue Dai, Tianyu Wang, Chao Wu, Alex K. Jones, Jingtong Hu, Yanzhi Wang, Xulong Tang

Abstract: Many emerging applications, such as robot-assisted eldercare and object recognition, generally employ deep learning neural networks (DNNs) and require the deployment of DNN models on edge devices. These applications naturally require i) handling streaming-in inference requests and ii) fine-tuning the deployed models to adapt to possible deployment scenario changes. Continual learning (CL) is widel… ▽ More Many emerging applications, such as robot-assisted eldercare and object recognition, generally employ deep learning neural networks (DNNs) and require the deployment of DNN models on edge devices. These applications naturally require i) handling streaming-in inference requests and ii) fine-tuning the deployed models to adapt to possible deployment scenario changes. Continual learning (CL) is widely adopted to satisfy these needs. CL is a popular deep learning paradigm that handles both continuous model fine-tuning and overtime inference requests. However, an inappropriate model fine-tuning scheme could involve significant redundancy and consume considerable time and energy, making it challenging to apply CL on edge devices. In this paper, we propose ETuner, an efficient edge continual learning framework that optimizes inference accuracy, fine-tuning execution time, and energy efficiency through both inter-tuning and intra-tuning optimizations. Experimental results show that, on average, ETuner reduces overall fine-tuning execution time by 64%, energy consumption by 56%, and improves average inference accuracy by 1.75% over the immediate model fine-tuning approach. △ Less

Submitted 22 August, 2024; v1 submitted 29 January, 2024; originally announced January 2024.

Recognizing Multiple Ingredients in Food Images Using a Single-Ingredient Classification Model

Authors: Kun Fu, Ying Dai

Abstract: Recognizing food images presents unique challenges due to the variable spatial layout and shape changes of ingredients with different cooking and cutting methods. This study introduces an advanced approach for recognizing ingredients segmented from food images. The method localizes the candidate regions of the ingredients using the locating and sliding window techniques. Then, these regions are as… ▽ More Recognizing food images presents unique challenges due to the variable spatial layout and shape changes of ingredients with different cooking and cutting methods. This study introduces an advanced approach for recognizing ingredients segmented from food images. The method localizes the candidate regions of the ingredients using the locating and sliding window techniques. Then, these regions are assigned into ingredient classes using a CNN (Convolutional Neural Network)-based single-ingredient classification model trained on a dataset of single-ingredient images. To address the challenge of processing speed in multi-ingredient recognition, a novel model pruning method is proposed that enhances the efficiency of the classification model. Subsequently, the multi-ingredient identification is achieved through a decision-making scheme, incorporating two novel algorithms. The single-ingredient image dataset, designed in accordance with the book entitled "New Food Ingredients List FOODS 2021", encompasses 9982 images across 110 diverse categories, emphasizing variety in ingredient shapes. In addition, a multi-ingredient image dataset is developed to rigorously evaluate the performance of our approach. Experimental results validate the effectiveness of our method, particularly highlighting its improved capability in recognizing multiple ingredients. This marks a significant advancement in the field of food image analysis. △ Less

Submitted 18 February, 2024; v1 submitted 25 January, 2024; originally announced January 2024.

Comments: 9 pages, 21 figures, 6 tables

WebVoyager: Building an End-to-End Web Agent with Large Multimodal Models

Authors: Hongliang He, Wenlin Yao, Kaixin Ma, Wenhao Yu, Yong Dai, Hongming Zhang, Zhenzhong Lan, Dong Yu

Abstract: The rapid advancement of large language models (LLMs) has led to a new era marked by the development of autonomous applications in real-world scenarios, which drives innovation in creating advanced web agents. Existing web agents typically only handle one input modality and are evaluated only in simplified web simulators or static web snapshots, greatly limiting their applicability in real-world s… ▽ More The rapid advancement of large language models (LLMs) has led to a new era marked by the development of autonomous applications in real-world scenarios, which drives innovation in creating advanced web agents. Existing web agents typically only handle one input modality and are evaluated only in simplified web simulators or static web snapshots, greatly limiting their applicability in real-world scenarios. To bridge this gap, we introduce WebVoyager, an innovative Large Multimodal Model (LMM) powered web agent that can complete user instructions end-to-end by interacting with real-world websites. Moreover, we establish a new benchmark by compiling real-world tasks from 15 popular websites and introduce an automatic evaluation protocol leveraging multimodal understanding abilities of GPT-4V to evaluate open-ended web agents. We show that WebVoyager achieves a 59.1% task success rate on our benchmark, significantly surpassing the performance of both GPT-4 (All Tools) and the WebVoyager (text-only) setups, underscoring the exceptional capability of WebVoyager. The proposed automatic evaluation metric achieves 85.3% agreement with human judgment, indicating its effectiveness in providing reliable and accurate assessments of web agents. △ Less

Submitted 6 June, 2024; v1 submitted 24 January, 2024; originally announced January 2024.

Comments: Accepted to ACL 2024 (main). Code and data is released at https://github.com/MinorJerry/WebVoyager

Interferences effects in polarized nonlinear Breit-Wheeler process

Authors: Jing-Jing Jiang, Ya-Nan Dai, Kai-Hong Zhuang, Yunquan Gao, Suo Tang, Yue-Yue Chen

Abstract: The creation of polarized electron-positron pairs by the nonlinear Breit-Wheeler process in short laser pulses is investigated using the Baier-Katkov semiclassical method beyond local-constant-field approximation (LCFA), which allows for identifying the interferences effects in the positron polarization. When the laser intensity is in the intermediate %multiphoton regime, the interferences of pair… ▽ More The creation of polarized electron-positron pairs by the nonlinear Breit-Wheeler process in short laser pulses is investigated using the Baier-Katkov semiclassical method beyond local-constant-field approximation (LCFA), which allows for identifying the interferences effects in the positron polarization. When the laser intensity is in the intermediate %multiphoton regime, the interferences of pair production in different formation lengths induce an enhancement of pair production probability for spin-down positrons, which significantly affects the polarization of created positrons. The polarization features are distinct from that obtained with LCFA, revealing the invalidity of LCFA in this regime. Meanwhile, the angular distribution for different spin states varies, resulting in an angular-dependent polarization of positrons. The average polarization of positrons at beam center is highly sensitive to the laser's carrier-envelope phase (CEP), which provides a potential alternative way of determining the CEP of strong lasers. The verification of the observed interference phenomenon is possible for the upcoming experiments. △ Less

Submitted 24 January, 2024; originally announced January 2024.

Fermionic signal of vacuum polarization in strong laser fields

Authors: Ya-Nan Dai, Karen Z. Hatsagortsyan, Christoph H. Keitel, Yue-Yue Chen

Abstract: Vacuum polarization (VP) is investigated for the interaction of a polarized $γ$-ray beam of GeV photons with a counterpropagating ultraintense laser pulse. In a conventional setup of a vacuum birefringence measurement, a VP signal is the emerging small circular (linear) polarization of the initially linearly (circularly) polarized probe photons. The pair production via the nonlinear Breit-Wheeler… ▽ More Vacuum polarization (VP) is investigated for the interaction of a polarized $γ$-ray beam of GeV photons with a counterpropagating ultraintense laser pulse. In a conventional setup of a vacuum birefringence measurement, a VP signal is the emerging small circular (linear) polarization of the initially linearly (circularly) polarized probe photons. The pair production via the nonlinear Breit-Wheeler process in such a high-energy environment eliminates part of the $γ$-photons in the outgoing $γ$-beam, increasing the statistical error and decreasing the accuracy of this VP signal. In contrast, we investigate the conversion of the emerging circular polarization of $γ$-photons into longitudinal polarization of the created positrons, considering the latter as the main VP signal. To study the VP effects in the highly nonlinear regime, where the Euler-Heisenberg effective Lagrangian method breaks down, we have developed a Monte-Carlo simulation method, incorporating vacuum birefringence and dichroism via the one-loop QED probabilities in the locally constant field approximation. Our Monte Carlo method will enable the study of VP effects in strong fields of arbitrary configuration. With 10~PW laser systems, we demonstrate the feasibility of detecting the fermionic signal of the VP effect at the 5$σ$ confidence level with a few hours of measurement time. △ Less

Submitted 2 June, 2024; v1 submitted 20 January, 2024; originally announced January 2024.

Transient Magnetoelastic Coupling in CrSBr

Authors: Youn Jue Bae, Taketo Handa, Yanan Dai, Jue Wang, Huicong Liu, Allen Scheie, Daniel G. Chica, Michael E. Ziebel, Andrew D. Kent, Xiaodong Xu, Ka Shen, Xavier Roy, Xiaoyang Zhu

Abstract: Recent research has revealed remarkable properties of the two-dimensional (2D) van der Waals layered crystal CrSBr, which is both a semiconductor and an A-type antiferromagnet. Here we show the role of strong magnetoelastic coupling in the generation and propagation of coherent magnons in CrSBr. Time and spatially resolved magneto-optical Kerr effect (tr-MOKE) microscopy reveals two time-varying t… ▽ More Recent research has revealed remarkable properties of the two-dimensional (2D) van der Waals layered crystal CrSBr, which is both a semiconductor and an A-type antiferromagnet. Here we show the role of strong magnetoelastic coupling in the generation and propagation of coherent magnons in CrSBr. Time and spatially resolved magneto-optical Kerr effect (tr-MOKE) microscopy reveals two time-varying transient strain fields induced by out-of-plane transverse and in-plane longitudinal lattice displacements. These transient strain fields launch coherent wavepackets of magnons, optical and acoustic at 24.6 GHz and 33.4 GHz, respectively. These findings suggest mechanisms for controlling and manipulating coherent magnons from distinct magnetoelastic couplings in this 2D van der Waals magnetic semiconductor. △ Less

Submitted 15 January, 2024; originally announced January 2024.

Comments: 12 pages, 4 figures, SI

Enhanced α particle generation via proton-boron fusion reactions in laser-modulated plasma

Authors: Yihang Zhang, Zhe Zhang, Yufeng Dong, Ke Fang, Haochen Gu, Yu Dai, Wei Qi, Zhigang Deng, Xiaohui Zhang, Lei Yang, Feng Lu, Zheng Huang, Kainan Zhou, Yuchi Wu, Weimin Zhou, Feng Liu, Guoqiang Zhang, Bingjun Li, Xu Zhao, Xiaohui Yuan, Chen Wang, Yutong Li

Abstract: Aneutronic and nonradioactive properties make the proton-boron fusion a prospective candidate for fusion energy production through reactions following p+$^{11}$B$\rightarrow$3$α$ (p-$^{11}$B). However, it is difficult to achieve a thermal fusion ignition, since the low reaction cross-sections for center-of-mass energy below $\sim$100 keV. To realize fusion energy gain, it is essential to consider… ▽ More Aneutronic and nonradioactive properties make the proton-boron fusion a prospective candidate for fusion energy production through reactions following p+$^{11}$B$\rightarrow$3$α$ (p-$^{11}$B). However, it is difficult to achieve a thermal fusion ignition, since the low reaction cross-sections for center-of-mass energy below $\sim$100 keV. To realize fusion energy gain, it is essential to consider utilization of the maximum cross-section at the resonant peak of p-$^{11}$B fusion, and explore the nuclear reactions in plasma environment. In this work, p-$^{11}$B reactions triggered by interactions between energetic proton beams and laser-ablated boron plasma have been investigated. More than 200 times enhancement of $α$ particle emission efficiency (number ratio of escaping $α$ particles and boron nuclei) in plasma has been observed, compared with the cold boron. The proton beam transport path modulated by strong electro-magnetic fields in plasma could dominate the enhanced $α$ particle generation, due to a longer collisional length. In addition, an $α$ particle yield up to 1$\times$10$^{10}$ /sr has been measured via the pitcher-catcher scheme in plasma. This work could benefit understanding of the plasma effects on nuclear reaction dynamics, and also enable opportunities to explore physics in laser fusion associated with advanced fusion fuels. △ Less

Submitted 14 January, 2024; originally announced January 2024.

Volume Transfer: A New Design Concept for Fabric-Based Pneumatic Exosuits

Authors: Chendong Liu, Dapeng Yang, Jiachen Chen, Yiming Dai, Li Jiang, Hong Liu

Abstract: The fabric-based pneumatic exosuit is now a hot research topic because it is lighter and softer than traditional exoskeletons. Existing research focused more on the mechanical properties of the exosuit (e.g., torque and speed), but less on its wearability (e.g., appearance and comfort). This work presents a new design concept for fabric-based pneumatic exosuits Volume Transfer, which means transfe… ▽ More The fabric-based pneumatic exosuit is now a hot research topic because it is lighter and softer than traditional exoskeletons. Existing research focused more on the mechanical properties of the exosuit (e.g., torque and speed), but less on its wearability (e.g., appearance and comfort). This work presents a new design concept for fabric-based pneumatic exosuits Volume Transfer, which means transferring the volume of pneumatic actuators beyond the garments profile to the inside. This allows for a concealed appearance and a larger stress area while maintaining adequate torques. In order to verify this concept, we develop a fabric-based pneumatic exosuit for knee extension assistance. Its profile is only 26mm and its stress area wraps around almost half of the leg. We use a mathematical model and simulation to determine the parameters of the exosuit, avoiding multiple iterations of the prototype. Experiment results show that the exosuit can generate a torque of 7.6Nm at a pressure of 90kPa and produce a significant reduction in the electromyography activity of the knee extensor muscles. We believe that Volume Transfer could be utilized prevalently in future fabric-based pneumatic exosuit designs to achieve a significant improvement in wearability. △ Less

Submitted 11 January, 2024; originally announced January 2024.

FlightLLM: Efficient Large Language Model Inference with a Complete Mapping Flow on FPGAs

Authors: Shulin Zeng, Jun Liu, Guohao Dai, Xinhao Yang, Tianyu Fu, Hongyi Wang, Wenheng Ma, Hanbo Sun, Shiyao Li, Zixiao Huang, Yadong Dai, Jintao Li, Zehao Wang, Ruoyu Zhang, Kairui Wen, Xuefei Ning, Yu Wang

Abstract: Transformer-based Large Language Models (LLMs) have made a significant impact on various domains. However, LLMs' efficiency suffers from both heavy computation and memory overheads. Compression techniques like sparsification and quantization are commonly used to mitigate the gap between LLM's computation/memory overheads and hardware capacity. However, existing GPU and transformer-based accelerato… ▽ More Transformer-based Large Language Models (LLMs) have made a significant impact on various domains. However, LLMs' efficiency suffers from both heavy computation and memory overheads. Compression techniques like sparsification and quantization are commonly used to mitigate the gap between LLM's computation/memory overheads and hardware capacity. However, existing GPU and transformer-based accelerators cannot efficiently process compressed LLMs, due to the following unresolved challenges: low computational efficiency, underutilized memory bandwidth, and large compilation overheads. This paper proposes FlightLLM, enabling efficient LLMs inference with a complete mapping flow on FPGAs. In FlightLLM, we highlight an innovative solution that the computation and memory overhead of LLMs can be solved by utilizing FPGA-specific resources (e.g., DSP48 and heterogeneous memory hierarchy). We propose a configurable sparse DSP chain to support different sparsity patterns with high computation efficiency. Second, we propose an always-on-chip decode scheme to boost memory bandwidth with mixed-precision support. Finally, to make FlightLLM available for real-world LLMs, we propose a length adaptive compilation method to reduce the compilation overhead. Implemented on the Xilinx Alveo U280 FPGA, FlightLLM achieves 6.0$\times$ higher energy efficiency and 1.8$\times$ better cost efficiency against commercial GPUs (e.g., NVIDIA V100S) on modern LLMs (e.g., LLaMA2-7B) using vLLM and SmoothQuant under the batch size of one. FlightLLM beats NVIDIA A100 GPU with 1.2$\times$ higher throughput using the latest Versal VHK158 FPGA. △ Less

Submitted 9 January, 2024; v1 submitted 8 January, 2024; originally announced January 2024.

Comments: Accepted to FPGA'24

Active Galactic Nuclei in a Mid-Infrared Selected Galaxy Sample at z>0.13: [Ne V]3426 Line Emission as a Benchmark

Authors: Zi-Jian Li, Y. Sophia Dai, Jia-Sheng Huang, Stijn Wuyts, Tian-Wen Cao

Abstract: We present a 24 um-selected spectroscopic sample z > 0.13 (median z = 0.41) in the Lockman Hole field, consisting of 4035 spectra. Our aim is to identify AGNs and determine their fraction in this mid-infrared selected sample. In this work, we use the [Ne V]3426 emission line to spectroscopically identify AGNs. Combined with broad-line Type I AGNs selected in our previous study, our sample consists… ▽ More We present a 24 um-selected spectroscopic sample z > 0.13 (median z = 0.41) in the Lockman Hole field, consisting of 4035 spectra. Our aim is to identify AGNs and determine their fraction in this mid-infrared selected sample. In this work, we use the [Ne V]3426 emission line to spectroscopically identify AGNs. Combined with broad-line Type I AGNs selected in our previous study, our sample consists of 887 (22%) spectroscopically confirmed AGNs. We perform a stacking analysis on the remaining spectra, and find that in various MIR-wedge-selected AGN candidates, the stacked spectra still show significant [Ne V]3426 emission, In contrast, no clear [Ne V]3426 signal is detected in non-AGN candidates falling outside the wedges. Assuming a range of AGN mid-IR SED slope of 0.3< alpha <0.7, and an average star-forming relation derived from 65 star-forming templates, we develop a robust method to separate the AGN and star-forming contributions to the mid-IR SEDs using the rest-frame L12 /L1.6 vs L4.5 /L1.6 diagram. We separate the objects into bins of L12 , and find that AGN fraction increases with increasing L12. We also find that the stacked [Ne V]3426 strength scales with L12 . The pure AGN luminosity at 12 um exhibits a positive correlation with the star formation rates, indicating possible co-evolution and common gas supply between the AGN and their host galaxies. Varying population properties across the redshift range explored contribute to the observed correlation. △ Less

Submitted 7 January, 2024; originally announced January 2024.

Comments: 16 pages, 14 figures. Accepted for publication in ApJ

Exploring Multi-Modal Control in Music-Driven Dance Generation

Authors: Ronghui Li, Yuqin Dai, Yachao Zhang, Jun Li, Jian Yang, Jie Guo, Xiu Li

Abstract: Existing music-driven 3D dance generation methods mainly concentrate on high-quality dance generation, but lack sufficient control during the generation process. To address these issues, we propose a unified framework capable of generating high-quality dance movements and supporting multi-modal control, including genre control, semantic control, and spatial control. First, we decouple the dance ge… ▽ More Existing music-driven 3D dance generation methods mainly concentrate on high-quality dance generation, but lack sufficient control during the generation process. To address these issues, we propose a unified framework capable of generating high-quality dance movements and supporting multi-modal control, including genre control, semantic control, and spatial control. First, we decouple the dance generation network from the dance control network, thereby avoiding the degradation in dance quality when adding additional control information. Second, we design specific control strategies for different control information and integrate them into a unified framework. Experimental results show that the proposed dance generation framework outperforms state-of-the-art methods in terms of motion quality and controllability. △ Less

Submitted 1 January, 2024; originally announced January 2024.

Accurate Leukocyte Detection Based on Deformable-DETR and Multi-Level Feature Fusion for Aiding Diagnosis of Blood Diseases

Authors: Yifei Chen, Chenyan Zhang, Ben Chen, Yiyu Huang, Yifei Sun, Changmiao Wang, Xianjun Fu, Yuxing Dai, Feiwei Qin, Yong Peng, Yu Gao

Abstract: In standard hospital blood tests, the traditional process requires doctors to manually isolate leukocytes from microscopic images of patients' blood using microscopes. These isolated leukocytes are then categorized via automatic leukocyte classifiers to determine the proportion and volume of different types of leukocytes present in the blood samples, aiding disease diagnosis. This methodology is n… ▽ More In standard hospital blood tests, the traditional process requires doctors to manually isolate leukocytes from microscopic images of patients' blood using microscopes. These isolated leukocytes are then categorized via automatic leukocyte classifiers to determine the proportion and volume of different types of leukocytes present in the blood samples, aiding disease diagnosis. This methodology is not only time-consuming and labor-intensive, but it also has a high propensity for errors due to factors such as image quality and environmental conditions, which could potentially lead to incorrect subsequent classifications and misdiagnosis. To address these issues, this paper proposes an innovative method of leukocyte detection: the Multi-level Feature Fusion and Deformable Self-attention DETR (MFDS-DETR). To tackle the issue of leukocyte scale disparity, we designed the High-level Screening-feature Fusion Pyramid (HS-FPN), enabling multi-level fusion. This model uses high-level features as weights to filter low-level feature information via a channel attention module and then merges the screened information with the high-level features, thus enhancing the model's feature expression capability. Further, we address the issue of leukocyte feature scarcity by incorporating a multi-scale deformable self-attention module in the encoder and using the self-attention and cross-deformable attention mechanisms in the decoder, which aids in the extraction of the global features of the leukocyte feature maps. The effectiveness, superiority, and generalizability of the proposed MFDS-DETR method are confirmed through comparisons with other cutting-edge leukocyte detection models using the private WBCDD, public LISC and BCCD datasets. Our source code and private WBCCD dataset are available at https://github.com/JustlfC03/MFDS-DETR. △ Less

Submitted 10 January, 2024; v1 submitted 1 January, 2024; originally announced January 2024.

Comments: 15 pages, 11 figures, accept Computers in Biology and Medicine 2024

Journal ref: Computers in Biology and Medicine 2024

Text2Avatar: Text to 3D Human Avatar Generation with Codebook-Driven Body Controllable Attribute

Authors: Chaoqun Gong, Yuqin Dai, Ronghui Li, Achun Bao, Jun Li, Jian Yang, Yachao Zhang, Xiu Li

Abstract: Generating 3D human models directly from text helps reduce the cost and time of character modeling. However, achieving multi-attribute controllable and realistic 3D human avatar generation is still challenging due to feature coupling and the scarcity of realistic 3D human avatar datasets. To address these issues, we propose Text2Avatar, which can generate realistic-style 3D avatars based on the co… ▽ More Generating 3D human models directly from text helps reduce the cost and time of character modeling. However, achieving multi-attribute controllable and realistic 3D human avatar generation is still challenging due to feature coupling and the scarcity of realistic 3D human avatar datasets. To address these issues, we propose Text2Avatar, which can generate realistic-style 3D avatars based on the coupled text prompts. Text2Avatar leverages a discrete codebook as an intermediate feature to establish a connection between text and avatars, enabling the disentanglement of features. Furthermore, to alleviate the scarcity of realistic style 3D human avatar data, we utilize a pre-trained unconditional 3D human avatar generation model to obtain a large amount of 3D avatar pseudo data, which allows Text2Avatar to achieve realistic style generation. Experimental results demonstrate that our method can generate realistic 3D avatars from coupled textual data, which is challenging for other existing methods in this field. △ Less

Submitted 1 January, 2024; originally announced January 2024.

Host galaxy and nuclear properties of IR-selected AGNs with and without outflow signatures

Authors: Gabriel A. Oio, Y. Sophia Dai, C. G. Bornancini, Zi-Jian Li

Abstract: Active galactic nucleus (AGN) driven outflows can have a significant impact on the evolution of the host galaxy. In this work, we compare the properties of galaxies that hosts AGNs with and without outflows. Our sample consists of 103 AGNs identified by mid-IR color-color selection, and confirmed with optical spectroscopy at a redshift range of 0.3 $\lesssim$ z $\lesssim$ 0.9. We fit the [OIII]… ▽ More Active galactic nucleus (AGN) driven outflows can have a significant impact on the evolution of the host galaxy. In this work, we compare the properties of galaxies that hosts AGNs with and without outflows. Our sample consists of 103 AGNs identified by mid-IR color-color selection, and confirmed with optical spectroscopy at a redshift range of 0.3 $\lesssim$ z $\lesssim$ 0.9. We fit the [OIII] $λ$5007 line using spectra from the zCOSMOS survey to identify and to study the occurrence of outflows. We find that ionized outflows are present in $\sim$25\% of our sample, with the largest incidence at the highest [OIII] and X-ray luminosity bins. The fastest outflows are found in the more extended and massive galaxies. We do not observe a difference in the star formation rate of AGNs with outflows compared to AGNs without outflows. From visual inspection and non-parametric morphological studies, we obtain that outflows are preferentially observed in galaxies with elliptical morphologies. △ Less

Submitted 5 March, 2024; v1 submitted 26 December, 2023; originally announced December 2023.

Comments: Published in ApJ, 23 pages, 16 figures

Journal ref: ApJ 962 146 (2024)

Emage: Non-Autoregressive Text-to-Image Generation

Authors: Zhangyin Feng, Runyi Hu, Liangxin Liu, Fan Zhang, Duyu Tang, Yong Dai, Xiaocheng Feng, Jiwei Li, Bing Qin, Shuming Shi

Abstract: Autoregressive and diffusion models drive the recent breakthroughs on text-to-image generation. Despite their huge success of generating high-realistic images, a common shortcoming of these models is their high inference latency - autoregressive models run more than a thousand times successively to produce image tokens and diffusion models convert Gaussian noise into images with many hundreds of d… ▽ More Autoregressive and diffusion models drive the recent breakthroughs on text-to-image generation. Despite their huge success of generating high-realistic images, a common shortcoming of these models is their high inference latency - autoregressive models run more than a thousand times successively to produce image tokens and diffusion models convert Gaussian noise into images with many hundreds of denoising steps. In this work, we explore non-autoregressive text-to-image models that efficiently generate hundreds of image tokens in parallel. We develop many model variations with different learning and inference strategies, initialized text encoders, etc. Compared with autoregressive baselines that needs to run one thousand times, our model only runs 16 times to generate images of competitive quality with an order of magnitude lower inference latency. Our non-autoregressive model with 346M parameters generates an image of 256$\times$256 with about one second on one V100 GPU. △ Less

Submitted 22 December, 2023; originally announced December 2023.

Statistical Machine Learning Meets High-Dimensional Spatiotemporal Challenges -- A Case Study of COVID-19 Modeling

Authors: Binbin Lin, Yimin Dai, Lei Zou, Ning Ning

Abstract: Diverse non-pharmacological interventions (NPIs), serving as the primary approach for COVID-19 control prior to pharmaceutical interventions, showed heterogeneous spatiotemporal effects on pandemic management. Investigating the dynamic compounding impacts of NPIs on pandemic spread is imperative. However, the challenges posed by data availability of high-dimensional human behaviors and the complex… ▽ More Diverse non-pharmacological interventions (NPIs), serving as the primary approach for COVID-19 control prior to pharmaceutical interventions, showed heterogeneous spatiotemporal effects on pandemic management. Investigating the dynamic compounding impacts of NPIs on pandemic spread is imperative. However, the challenges posed by data availability of high-dimensional human behaviors and the complexity of modeling changing and interrelated factors are substantial. To address these challenges, this study analyzed social media data, COVID-19 case rates, Apple mobility data, and the stringency of stay-at-home policies in the United States throughout the year 2020, aiming to (1) uncover the spatiotemporal variations in NPIs during the COVID-19 pandemic utilizing geospatial big data; (2) develop a statistical machine learning model that incorporates spatiotemporal dependencies and temporal lag effects for the detection of relationships; (3) dissect the impacts of NPIs on the pandemic across space and time. Three indices were computed based on Twitter (currently known as X) data: the Negative and Positive Sentiments Adjusted by Demographics (N-SAD and P-SAD) and the Ratio Adjusted by Demographics (RAD), representing negative sentiment, positive sentiment, and public awareness of COVID-19, respectively. The Multivariate Bayesian Structural Time Series Time Lagged model (MBSTS-TL) was proposed to investigate the effects of NPIs, accounting for spatial dependencies and temporal lag effects. The developed MBSTS-TL model exhibited a high degree of accuracy. Determinants of COVID-19 health impacts transitioned from an emphasis on human mobility during the initial outbreak period to a combination of human mobility and stay-at-home policies during the rapid spread phase, and ultimately to the compound of human mobility, stay-at-home policies, and public awareness of COVID-19. △ Less

Submitted 28 November, 2023; originally announced December 2023.

Retrieval-Augmented Generation for Large Language Models: A Survey

Authors: Yunfan Gao, Yun Xiong, Xinyu Gao, Kangxiang Jia, Jinliu Pan, Yuxi Bi, Yi Dai, Jiawei Sun, Meng Wang, Haofen Wang

Abstract: Large Language Models (LLMs) showcase impressive capabilities but encounter challenges like hallucination, outdated knowledge, and non-transparent, untraceable reasoning processes. Retrieval-Augmented Generation (RAG) has emerged as a promising solution by incorporating knowledge from external databases. This enhances the accuracy and credibility of the generation, particularly for knowledge-inten… ▽ More Large Language Models (LLMs) showcase impressive capabilities but encounter challenges like hallucination, outdated knowledge, and non-transparent, untraceable reasoning processes. Retrieval-Augmented Generation (RAG) has emerged as a promising solution by incorporating knowledge from external databases. This enhances the accuracy and credibility of the generation, particularly for knowledge-intensive tasks, and allows for continuous knowledge updates and integration of domain-specific information. RAG synergistically merges LLMs' intrinsic knowledge with the vast, dynamic repositories of external databases. This comprehensive review paper offers a detailed examination of the progression of RAG paradigms, encompassing the Naive RAG, the Advanced RAG, and the Modular RAG. It meticulously scrutinizes the tripartite foundation of RAG frameworks, which includes the retrieval, the generation and the augmentation techniques. The paper highlights the state-of-the-art technologies embedded in each of these critical components, providing a profound understanding of the advancements in RAG systems. Furthermore, this paper introduces up-to-date evaluation framework and benchmark. At the end, this article delineates the challenges currently faced and points out prospective avenues for research and development. △ Less

Submitted 27 March, 2024; v1 submitted 18 December, 2023; originally announced December 2023.

Comments: Ongoing Work

Coupling Fairness and Pruning in a Single Run: a Bi-level Optimization Perspective

Authors: Yucong Dai, Gen Li, Feng Luo, Xiaolong Ma, Yongkai Wu

Abstract: Deep neural networks have demonstrated remarkable performance in various tasks. With a growing need for sparse deep learning, model compression techniques, especially pruning, have gained significant attention. However, conventional pruning techniques can inadvertently exacerbate algorithmic bias, resulting in unequal predictions. To address this, we define a fair pruning task where a sparse model… ▽ More Deep neural networks have demonstrated remarkable performance in various tasks. With a growing need for sparse deep learning, model compression techniques, especially pruning, have gained significant attention. However, conventional pruning techniques can inadvertently exacerbate algorithmic bias, resulting in unequal predictions. To address this, we define a fair pruning task where a sparse model is derived subject to fairness requirements. In particular, we propose a framework to jointly optimize the pruning mask and weight update processes with fairness constraints. This framework is engineered to compress models that maintain performance while ensuring fairness in a single execution. To this end, we formulate the fair pruning problem as a novel constrained bi-level optimization task and derive efficient and effective solving strategies. We design experiments spanning various datasets and settings to validate our proposed method. Our empirical analysis contrasts our framework with several mainstream pruning strategies, emphasizing our method's superiority in maintaining model fairness, performance, and efficiency. △ Less

Submitted 15 December, 2023; originally announced December 2023.

On Diversified Preferences of Large Language Model Alignment

Authors: Dun Zeng, Yong Dai, Pengyu Cheng, Longyue Wang, Tianhao Hu, Wanshun Chen, Nan Du, Zenglin Xu

Abstract: Aligning large language models (LLMs) with human preferences has been recognized as the key to improving LLMs' interaction quality. However, in this pluralistic world, human preferences can be diversified due to annotators' different tastes, which hinders the effectiveness of LLM alignment methods. This paper presents the first quantitative analysis of commonly used human feedback datasets to inve… ▽ More Aligning large language models (LLMs) with human preferences has been recognized as the key to improving LLMs' interaction quality. However, in this pluralistic world, human preferences can be diversified due to annotators' different tastes, which hinders the effectiveness of LLM alignment methods. This paper presents the first quantitative analysis of commonly used human feedback datasets to investigate the impact of diversified preferences on reward modeling. Our analysis reveals a correlation between the calibration performance of reward models (RMs) and the alignment performance of LLMs. We find that diversified preference data negatively affect the calibration performance of RMs on human-shared preferences, such as Harmless\&Helpful, thereby impairing the alignment performance of LLMs. To address the ineffectiveness, we propose a novel Multi-Objective Reward learning method (MORE) to enhance the calibration performance of RMs on shared preferences. We validate our findings by experiments on three models and five human preference datasets. Our method significantly improves the prediction calibration of RMs, leading to better alignment of the Alpaca-7B model with Harmless\&Helpful preferences. Furthermore, the connection between reward calibration and preference alignment performance suggests that calibration error can be adopted as a key metric for evaluating RMs. The open-source code and data are available at https://github.com/dunzeng/MORE. △ Less

Submitted 17 April, 2024; v1 submitted 12 December, 2023; originally announced December 2023.

Comments: preprint

Ground Calibration Result of the Lobster Eye Imager for Astronomy

Authors: Huaqing Cheng, Zhixing Ling, Chen Zhang, Xiaojin Sun, Shengli Sun, Yuan Liu, Yanfeng Dai, Zhenqing Jia, Haiwu Pan, Wenxin Wang, Donghua Zhao, Yifan Chen, Zhiwei Cheng, Wei Fu, Yixiao Han, Junfei Li, Zhengda Li, Xiaohao Ma, Yulong Xue, Ailiang Yan, Qiang Zhang, Yusa Wang, Xiongtao Yang, Zijian Zhao, Weimin Yuan

Abstract: We report on results of the on-ground X-ray calibration of the Lobster Eye Imager for Astronomy (LEIA), an experimental space wide-field (18.6*18.6 square degrees) X-ray telescope built from novel lobster eye mirco-pore optics. LEIA was successfully launched on July 27, 2022 onboard the SATech-01 satellite. To achieve full characterisation of its performance before launch, a series of tests and ca… ▽ More We report on results of the on-ground X-ray calibration of the Lobster Eye Imager for Astronomy (LEIA), an experimental space wide-field (18.6*18.6 square degrees) X-ray telescope built from novel lobster eye mirco-pore optics. LEIA was successfully launched on July 27, 2022 onboard the SATech-01 satellite. To achieve full characterisation of its performance before launch, a series of tests and calibrations have been carried out at different levels of devices, assemblies and the complete module. In this paper, we present the results of the end-to-end calibration campaign of the complete module carried out at the 100-m X-ray Test Facility at IHEP. The PSF, effective area and energy response of the detectors were measured in a wide range of incident directions at several X-ray line energies. The distributions of the PSF and effective areas are roughly uniform across the FoV, in large agreement with the prediction of lobster-eye optics. The mild variations and deviations from the prediction of idealized lobster-eye optics can be understood to be caused by the imperfect shapes and alignment of the micro-pores as well as the obscuration by the supporting frames, which can be well reproduced by MC simulations. The spatial resolution of LEIA defined by the FWHM of the focal spot ranges from 4-8 arcmin with a median of 5.7. The measured effective areas are in range of 2-3 $cm^2$ at ~1.25 keV across the entire FoV, and its dependence on photon energy is in large agreement with simulations. The gains of the CMOS sensors are in range of 6.5-6.9 eV/DN, and the energy resolutions in the range of ~120-140 eV at 1.25 keV and ~170-190 eV at 4.5 keV. These results have been ingested into the calibration database and applied to the analysis of the scientific data acquired by LEIA. This work paves the way for the calibration of the Wide-field X-Ray Telescope modules of the Einstein Probe mission. △ Less

Submitted 11 December, 2023; originally announced December 2023.

Comments: 24 pages, 13 figures. Submitted to Experimental Astronomy

Jointly Explicit and Implicit Cross-Modal Interaction Network for Anterior Chamber Inflammation Diagnosis

Authors: Qian Shao, Ye Dai, Haochao Ying, Kan Xu, Jinhong Wang, Wei Chi, Jian Wu

Abstract: Uveitis demands the precise diagnosis of anterior chamber inflammation (ACI) for optimal treatment. However, current diagnostic methods only rely on a limited single-modal disease perspective, which leads to poor performance. In this paper, we investigate a promising yet challenging way to fuse multimodal data for ACI diagnosis. Notably, existing fusion paradigms focus on empowering implicit modal… ▽ More Uveitis demands the precise diagnosis of anterior chamber inflammation (ACI) for optimal treatment. However, current diagnostic methods only rely on a limited single-modal disease perspective, which leads to poor performance. In this paper, we investigate a promising yet challenging way to fuse multimodal data for ACI diagnosis. Notably, existing fusion paradigms focus on empowering implicit modality interactions (i.e., self-attention and its variants), but neglect to inject explicit modality interactions, especially from clinical knowledge and imaging property. To this end, we propose a jointly Explicit and implicit Cross-Modal Interaction Network (EiCI-Net) for Anterior Chamber Inflammation Diagnosis that uses anterior segment optical coherence tomography (AS-OCT) images, slit-lamp images, and clinical data jointly. Specifically, we first develop CNN-Based Encoders and Tabular Processing Module (TPM) to extract efficient feature representations in different modalities. Then, we devise an Explicit Cross-Modal Interaction Module (ECIM) to generate attention maps as a kind of explicit clinical knowledge based on the tabular feature maps, then integrated them into the slit-lamp feature maps, allowing the CNN-Based Encoder to focus on more effective informativeness of the slit-lamp images. After that, the Implicit Cross-Modal Interaction Module (ICIM), a transformer-based network, further implicitly enhances modality interactions. Finally, we construct a considerable real-world dataset from our collaborative hospital and conduct sufficient experiments to demonstrate the superior performance of our proposed EiCI-Net compared with the state-of-the-art classification methods in various metrics. △ Less

Submitted 19 December, 2023; v1 submitted 11 December, 2023; originally announced December 2023.

Robust Geometry and Reflectance Disentanglement for 3D Face Reconstruction from Sparse-view Images

Authors: Daisheng Jin, Jiangbei Hu, Baixin Xu, Yuxin Dai, Chen Qian, Ying He

Abstract: This paper presents a novel two-stage approach for reconstructing human faces from sparse-view images, a task made challenging by the unique geometry and complex skin reflectance of each individual. Our method focuses on decomposing key facial attributes, including geometry, diffuse reflectance, and specular reflectance, from ambient light. Initially, we create a general facial template from a div… ▽ More This paper presents a novel two-stage approach for reconstructing human faces from sparse-view images, a task made challenging by the unique geometry and complex skin reflectance of each individual. Our method focuses on decomposing key facial attributes, including geometry, diffuse reflectance, and specular reflectance, from ambient light. Initially, we create a general facial template from a diverse collection of individual faces, capturing essential geometric and reflectance characteristics. Guided by this template, we refine each specific face model in the second stage, which further considers the interaction between geometry and reflectance, as well as the subsurface scattering effects on facial skin. Our method enables the reconstruction of high-quality facial representations from as few as three images, offering improved geometric accuracy and reflectance detail. Through comprehensive evaluations and comparisons, our method demonstrates superiority over existing techniques. Our method effectively disentangles geometry and reflectance components, leading to enhanced quality in synthesizing new views and opening up possibilities for applications such as relighting and reflectance editing. We will make the code publicly available. △ Less

Submitted 10 December, 2023; originally announced December 2023.

Comments: 8 pages, 8 figures

Three Pulsars Discovered in Globular Cluster M15 (NGC 7078) with FAST

Authors: Yuxiao Wu, Zhichen Pan, Lei Qian, Scott Ransom, BoJun Wang, Zhen Yan, Jintao Luo, Liyun Zhang, Minghui Li, Dejiang Yin, Baoda Li, Yifeng Li, Yinfeng Dai, Yaowei Li, Xinnan Zhang, Tong Liu, Yu Pan

Abstract: We present the discovery of three pulsars in Globular Cluster M15 (NGC 7078) by the Five-hundred-meter Aperture Spherical radio Telescope (FAST). In the three pulsars, PSR~J2129+1210J (M15J) is a millisecond pulsar with a spinning period of 11.84 ms and a dispersion measure of 66.68 pc cm$^{-3}$. Both PSR~J2129+1210K and L (M15K and L) are long period pulsars with spinning periods of 1928 ms and 3… ▽ More We present the discovery of three pulsars in Globular Cluster M15 (NGC 7078) by the Five-hundred-meter Aperture Spherical radio Telescope (FAST). In the three pulsars, PSR~J2129+1210J (M15J) is a millisecond pulsar with a spinning period of 11.84 ms and a dispersion measure of 66.68 pc cm$^{-3}$. Both PSR~J2129+1210K and L (M15K and L) are long period pulsars with spinning periods of 1928 ms and 3961 ms , respectively, while M15L is the GC pulsar with the longest spinning period till now. The discoveries of M15K and L support the theory that core-collapsed Globular Clusters may contain partially recycled long period pulsars. With the same dataset, the timing solutions of M15A to H were updated, and the timing parameter P1 of M15F is different from the previous results, which is approximately 0.027$\times 10^{-18} ss^{-1}$ from our work and $0.032 \times 10^{-18} ss^{-1}$ from Anderson's\citep{anderson-1993}. As predicted by Rodolfi et al. , the luminosity of M15C kept decreasing and the latest detection in our dataset is on December 20$^{\rm th}$, 2022. We also detected M15I for one more time. The different barycentric spin periods indicate that this pulsar should locate in a binary system, manifesting itself as the exceptional one in such a core-collapsing GC. △ Less

Submitted 10 December, 2023; originally announced December 2023.

Comments: 10 pages, 4 figures, 2 tables, submitted to ApJ Letter

Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving

Authors: Yinwei Dai, Rui Pan, Anand Iyer, Kai Li, Ravi Netravali

Abstract: Machine learning (ML) inference platforms are tasked with balancing two competing goals: ensuring high throughput given many requests, and delivering low-latency responses to support interactive applications. Unfortunately, existing platform knobs (e.g., batch sizes) fail to ease this fundamental tension, and instead only enable users to harshly trade off one property for the other. This paper exp… ▽ More Machine learning (ML) inference platforms are tasked with balancing two competing goals: ensuring high throughput given many requests, and delivering low-latency responses to support interactive applications. Unfortunately, existing platform knobs (e.g., batch sizes) fail to ease this fundamental tension, and instead only enable users to harshly trade off one property for the other. This paper explores an alternate strategy to taming throughput-latency tradeoffs by changing the granularity at which inference is performed. We present Apparate, a system that automatically applies and manages early exits (EEs) in ML models, whereby certain inputs can exit with results at intermediate layers. To cope with the time-varying overhead and accuracy challenges that EEs bring, Apparate repurposes exits to provide continual feedback that powers several novel runtime monitoring and adaptation strategies. Apparate lowers median response latencies by 40.5-91.5% and 10.0-24.2% for diverse CV and NLP workloads, respectively, without affecting throughputs or violating tight accuracy constraints. △ Less

Submitted 8 December, 2023; originally announced December 2023.

Comments: The first two authors contributed equally and are alphabetically ordered

Adaptive Multi-band Modulation for Robust and Low-complexity Faster-than-Nyquist Non-Orthogonal FDM IM-DD System

Authors: Peiji Song, Zhouyi Hu, Yizhan Dai, Yuan Liu, Chao Gao, Chun-Kit Chan

Abstract: Faster-than-Nyquist non-orthogonal frequency-division multiplexing (FTN-NOFDM) is robust against the steep frequency roll-off by saving signal bandwidth. Among the FTN-NOFDM techniques, the non-orthogonal matrix precoding (NOM-p) based FTN has high compatibility with the conventional orthogonal frequency division multiplexing (OFDM), in terms of the advanced digital signal processing already used… ▽ More Faster-than-Nyquist non-orthogonal frequency-division multiplexing (FTN-NOFDM) is robust against the steep frequency roll-off by saving signal bandwidth. Among the FTN-NOFDM techniques, the non-orthogonal matrix precoding (NOM-p) based FTN has high compatibility with the conventional orthogonal frequency division multiplexing (OFDM), in terms of the advanced digital signal processing already used in OFDM. In this work, by dividing the single band into multiple sub-bands in the NOM-p-based FTN-NOFDM system, we propose a novel FTN-NOFDM scheme with adaptive multi-band modulation. The proposed scheme assigns different quadrature amplitude modulation (QAM) levels to different sub-bands, effectively utilizing the low-pass-like channel and reducing the complexity. The impacts of sub-band number and bandwidth compression factor on the bit-error-rate (BER) performance and implementation complexity are experimentally analyzed with a 32.23-Gb/s and 20-km intensity modulation-direct detection (IM-DD) optical transmission system. Results show that the proposed scheme with proper sub-band numbers can lower BER and greatly reduce the complexity compared to the conventional single-band way. △ Less

Submitted 5 December, 2023; originally announced December 2023.

Large electrobending deformation caused by defect dipoles

Authors: Shuo Tian, Bin Li, Yejing Dai

Abstract: Ultrahigh electrostrains (greater than 1%) in several piezoceramic systems have been reported since 2022, which attract more and more interest in the field of piezoelectricity; however, the mechanism is still unclear. Here, we have directly observed a novel electric field-induced bending (electrobending) phenomenon that visually exhibites as an alternating concave-convex deformation under an elect… ▽ More Ultrahigh electrostrains (greater than 1%) in several piezoceramic systems have been reported since 2022, which attract more and more interest in the field of piezoelectricity; however, the mechanism is still unclear. Here, we have directly observed a novel electric field-induced bending (electrobending) phenomenon that visually exhibites as an alternating concave-convex deformation under an electric field of plus or minus 50 kV cm-1, in nonstoichiometric (K0.48Na0.52)0.99NbO2.995 ceramics, which causes the measured ultrahigh electrostrain. It is demonstrated that the electrobending deformation arises from the different stresses due to the stretching or compression of the defect dipoles on the upper and lower surfaces of the ceramics. As a result of the large electrobending deformation, a giant apparent electrostrain of 11.6% is obtained at room temperature, and it can even reach up to 26.0% at 210 degree Celsius, which far exceeds that of all present piezoelectric materials. Our discovery is an important addition and refinement to the field of condensed matter physics, whilst providing a new strategy and shedding light on the design of future precision actuators or intelligent devices. △ Less

Submitted 5 December, 2023; originally announced December 2023.

Voltage-driven 90 switching of bulk perpendicular magnetic anisotropy in ferrimagnets

Authors: Zhengyu Xiao, Ruiwen Xie, Fernando Maccari, Philipp Klaassen, Benedikt Eggert, Di Wang, Yuting Dai, Raquel Lizarraga, Johanna Lill, Tom Helbig, Heiko Wende, Kurt Kummer, Katharina Ollefs, Konstantin Skokov, Hongbin Zhang, Zhiyong Quan, Xiaohong Xu, Robert Kruk, Horst Hahn, Oliver Gutfleisch, Xinglong Ye

Abstract: Rare earth-transition metal ferrimagnets, featuring antiferromagnetically coupled, inequivalent magnetic sublattices, have garnered increasing interest in the burgeoning field of ferrimagnetic spintronics. However, controlling their magnetism with low voltages,a key to reducing power consumption,remains challenging, particularly due to the poorly understood mechanisms underlying bulk perpendicular… ▽ More Rare earth-transition metal ferrimagnets, featuring antiferromagnetically coupled, inequivalent magnetic sublattices, have garnered increasing interest in the burgeoning field of ferrimagnetic spintronics. However, controlling their magnetism with low voltages,a key to reducing power consumption,remains challenging, particularly due to the poorly understood mechanisms underlying bulk perpendicular magnetic anisotropy (PMA). Here, we introduce a method involving voltage-driven hydrogen insertion into interstitial sites between Tb and Co atoms, selectively perturbing the atomic structure and enabling ultra-low-voltage (1.2 V) switching of bulk PMA to in-plane directions in ferrimagnetic films. Combining experimental and theoretical analysis, we find that the anisotropy switching originates from the reorientation of Tb orbital moments induced by the distortion of the crystal field. Initially aligned along Tb-Co bonding directions, the easy magnetization axis undergoes reorientation and switches by 90 deg,as substantiated by ab-initio calculations. Our study not only establishes the groundwork for voltage-controlled magnetic anisotropy in ferrimagnetic films, facilitating the development of electrically-programmable ferrimagnetic spintronics, but also elucidates the atomic origins of PMA in amorphous ferrimagnets, shedding light on a long-standing question in this field. △ Less

Submitted 14 June, 2024; v1 submitted 1 December, 2023; originally announced December 2023.

Comments: 4 Figures in manuscript (15 pages); 16 Figures, two Tables in Supplementary materials (21 pages)

Sample Efficient Reinforcement Learning from Human Feedback via Active Exploration

Authors: Viraj Mehta, Vikramjeet Das, Ojash Neopane, Yijia Dai, Ilija Bogunovic, Jeff Schneider, Willie Neiswanger

Abstract: Preference-based feedback is important for many applications in reinforcement learning where direct evaluation of a reward function is not feasible. A notable recent example arises in reinforcement learning from human feedback (RLHF) on large language models. For many applications of RLHF, the cost of acquiring the human feedback can be substantial. In this work, we take advantage of the fact that… ▽ More Preference-based feedback is important for many applications in reinforcement learning where direct evaluation of a reward function is not feasible. A notable recent example arises in reinforcement learning from human feedback (RLHF) on large language models. For many applications of RLHF, the cost of acquiring the human feedback can be substantial. In this work, we take advantage of the fact that one can often choose contexts at which to obtain human feedback in order to most efficiently identify a good policy, and formalize this as an offline contextual dueling bandit problem. We give an upper-confidence-bound style algorithm for this problem and prove a polynomial worst-case regret bound. We then provide empirical confirmation in a synthetic setting that our approach outperforms existing methods. After, we extend the setting and methodology for practical use in RLHF training of large language models. Here, our method is able to reach better performance with fewer samples of human preferences than multiple baselines on three real-world datasets. △ Less

Submitted 30 November, 2023; originally announced December 2023.

Observations of a Failed Solar Filament Eruption Involving External Reconnection

Authors: Yuehong Chen, Xin Cheng, Jun Chen, Yu Dai, Mingde Ding

Abstract: We report a failed solar filament eruption that involves external magnetic reconnection in a quadrupolar magnetic configuration. The evolution exhibits three kinematic evolution phases: a slow-rise phase, an acceleration phase, and a deceleration phase. In the early slow rise, extreme-ultraviolet (EUV) brightenings appear at the expected null point above the filament and are connected to the outer… ▽ More We report a failed solar filament eruption that involves external magnetic reconnection in a quadrupolar magnetic configuration. The evolution exhibits three kinematic evolution phases: a slow-rise phase, an acceleration phase, and a deceleration phase. In the early slow rise, extreme-ultraviolet (EUV) brightenings appear at the expected null point above the filament and are connected to the outer polarities by the hot loops, indicating the occurrence of a breakout reconnection. Subsequently, the filament is accelerated outward, accompanied by the formation of low-lying high-temperature post-flare loops ($>$ 15 MK), complying with the standard flare model. However, after 2--3 minutes, the erupting filament starts to decelerate and is finally confined in the corona. The important finding is that the confinement is closely related to an external reconnection as evidenced by the formation of high-lying large-scale hot loops ($>$ 10 MK) with their brightened footpoints at the outer polarities, the filament fragmentation and subsequent falling along the newly formed large-scale loops, as well as a hard X-ray source close to one of the outer footpoint brightenings. We propose that, even though the initial breakout reconnection and subsequent flare reconnection commence and accelerate the filament eruption, the following external reconnection between the erupting flux rope and overlying field, as driven by the upward filament eruption, makes the eruption finally failed, as validated by the numerical simulation of a failed flux rope eruption. △ Less

Submitted 29 November, 2023; originally announced November 2023.

Comments: Accepted by ApJ

Surface skyrmions and dual topological Hall effect in antiferromagnetic topological insulator EuCd$_2$As$_2$

Authors: Min Wu, R. Yang, Xiangde Zhu, Yixiong Ren, Ang Qian, Yongjie Xie, Changming Yue, Yong Nie, Xiang Yuan, Ning Wang, Daifeng Tu, Ding Li, Yuyan Han, Zhaosheng Wang, Yaomin Dai, Guolin Zheng, Jianhui Zhou, Wei Ning, Xianggang Qiu, Mingliang Tian

Abstract: In this work, we synthesized single crystal of EuCd$_2$As$_2$, which exhibits A-type antiferromagnetic (AFM) order with in-plane spin orientation below $T_N$ = 9.5~K.Optical spectroscopy and transport measurements suggest its topological insulator (TI) nature with an insulating gap around 0.1eV. Remarkably, a dual topological Hall resistivity that exhibits same magnitude but opposite signs in the… ▽ More In this work, we synthesized single crystal of EuCd$_2$As$_2$, which exhibits A-type antiferromagnetic (AFM) order with in-plane spin orientation below $T_N$ = 9.5~K.Optical spectroscopy and transport measurements suggest its topological insulator (TI) nature with an insulating gap around 0.1eV. Remarkably, a dual topological Hall resistivity that exhibits same magnitude but opposite signs in the positive to negative and negative to positive magnetic field hysteresis branches emerges below 20~K. With magnetic force microscopy (MFM) images and numerical simulations, we attribute the dual topological Hall effect to the Néel-type skyrmions stabilized by the interactions between topological surface states and magnetism, and the sign reversal in different hysteresis branches indicates potential coexistence of skyrmions and antiskyrmions. Our work uncovers a unique two-dimensional (2D) magnetism on the surface of intrinsic AFM TI, providing a promising platform for novel topological quantum states and AFM spintronic applications. △ Less

Submitted 27 November, 2023; originally announced November 2023.

Comments: 7 pages, 3 figures

Charge-density wave transition in magnetic topological semimetal EuAl$_4$

Authors: R. Yang, C. C. Le, P. Zhu, Z. W. Wang, T. Shang, Y. M. Dai, J. P. Hu, M. Dressel

Abstract: The interplay among topology, charge-density wave (CDW), and magnetism can give rise to a plethora of exotic quantum phenomena. Recently, a group of magnetic topological semimetals with tetragonal lattices and CDW order were found to exhibit anomalous magnetic instability, helical spin ordering, and the presence of skyrmions. However, the underlying mechanism responsible for these observations rem… ▽ More The interplay among topology, charge-density wave (CDW), and magnetism can give rise to a plethora of exotic quantum phenomena. Recently, a group of magnetic topological semimetals with tetragonal lattices and CDW order were found to exhibit anomalous magnetic instability, helical spin ordering, and the presence of skyrmions. However, the underlying mechanism responsible for these observations remains unclear. Here, we conducted a comprehensive investigation into the impact of CDW on the topological and magnetic properties of EuAl$_4$ using optical spectroscopy and the first-principles calculations. Through optical spectroscopy, we observed a partial gap (60~meV) on the Fermi surface and an enhanced mid-infrared absorption around 0.4~eV after the CDW transition. Magneto-optical spectroscopy and the first-principles calculations proved that, by affecting the band structure, the CDW order frustrates the antiferromagnetic interactions but strengthened the ferromagnetic ones, which can destabilize the magnetism. With lower symmetry in the CDW ordered state, carriers from the Weyl bands will mediate the anisotropic magnetic interactions promoting the formation of chiral spin textures. Conversely, without the CDW order, the counterpart EuGa$_4$ shows robust collinear antiferromagnetic order. Our findings uncover the pivotal role played by CDW order in arousing intricate magnetism in topological materials and provide valuable insights into controlling topological and magnetic properties through the manipulation of CDW orders. △ Less

Submitted 27 November, 2023; originally announced November 2023.

Comments: 8 pages, 4 figures

Report number: RIKEN-iTHEMS-Report-24

The UV luminosity function at 0.6 < z < 1 from UVCANDELS

Authors: Lei Sun, Xin Wang, Harry I. Teplitz, Vihang Mehta, Anahita Alavi, Marc Rafelski, Rogier A. Windhorst, Claudia Scarlata, Jonathan P. Gardner, Brent M. Smith, Ben Sunnquist, Laura Prichard, Yingjie Cheng, Norman Grogin, Nimish P. Hathi, Matthew Hayes, Anton M. Koekemoer, Bahram Mobasher, Kalina V. Nedkova, Robert O'Connell, Brant Robertson, Sina Taamoli, L. Y. Aaron Yung, Gabriel Brammer, James Colbert , et al. (53 additional authors not shown)

Abstract: UVCANDELS is a HST Cycle-26 Treasury Program awarded 164 orbits of primary ultraviolet (UV) F275W imaging and coordinated parallel optical F435W imaging in four CANDELS fields: GOODS-N, GOODS-S, EGS, and COSMOS, covering a total area of $\sim426$ arcmin$^2$. This is $\sim2.7$ times larger than the area covered by previous deep-field space UV data combined, reaching a depth of about 27 and 28 ABmag… ▽ More UVCANDELS is a HST Cycle-26 Treasury Program awarded 164 orbits of primary ultraviolet (UV) F275W imaging and coordinated parallel optical F435W imaging in four CANDELS fields: GOODS-N, GOODS-S, EGS, and COSMOS, covering a total area of $\sim426$ arcmin$^2$. This is $\sim2.7$ times larger than the area covered by previous deep-field space UV data combined, reaching a depth of about 27 and 28 ABmag ($5σ$ in $0.2"$ apertures) for F275W and F435W, respectively. Along with the new photometric catalogs, we present an analysis of the rest-frame UV luminosity function (LF), relying on our UV-optimized aperture photometry method yielding a factor of $1.5\times$ increase than the H-isophot aperture photometry in the signal-to-noise ratios of galaxies in our F275W imaging. Using well tested photometric redshift measurements we identify 5810 galaxies at redshifts $0.6<z<1$, down to an absolute magnitude of $M_\text{UV} = -14.2$. In order to minimize the effect of uncertainties in estimating the completeness function, especially at the faint-end, we restrict our analysis to sources above $30\%$ completeness, which provides a final sample of 4726 galaxies at $-21.5<M_\text{UV}<-15.5$. We performed a maximum likelihood estimate to derive the best-fit parameters of the UV LF. We report a best-fit faint-end slope of $α= -1.359^{+0.041}_{-0.041}$ at $z \sim 0.8$. Creating sub-samples at $z\sim0.7$ and $z\sim0.9$, we observe a possible evolution of $α$ with redshift. The unobscured UV luminosity density at $M_\text{UV}<-10$ is derived as $ρ_\text{UV}=1.339^{+0.027}_{-0.030}\ (\times10^{26} \text{ergs/s/Hz/Mpc}^3)$ using our best-fit LF parameters. The new F275W and F435 photometric catalogs from UVCANDELS have been made publicly available on the Barbara A. Mikulski Archive for Space Telescopes (MAST). △ Less

Submitted 2 May, 2024; v1 submitted 27 November, 2023; originally announced November 2023.

Comments: 17 pages, 8 figures, Accepted for publication in ApJ

A manometric feature descriptor with linear-SVM to distinguish esophageal contraction vigor

Authors: Jialin Liu, Lu Yan, Xiaowei Liu, Yuzhuo Dai, Fanggen Lu, Yuanting Ma, Muzhou Hou, Zheng Wang

Abstract: n clinical, if a patient presents with nonmechanical obstructive dysphagia, esophageal chest pain, and gastro esophageal reflux symptoms, the physician will usually assess the esophageal dynamic function. High-resolution manometry (HRM) is a clinically commonly used technique for detection of esophageal dynamic function comprehensively and objectively. However, after the results of HRM are obtaine… ▽ More n clinical, if a patient presents with nonmechanical obstructive dysphagia, esophageal chest pain, and gastro esophageal reflux symptoms, the physician will usually assess the esophageal dynamic function. High-resolution manometry (HRM) is a clinically commonly used technique for detection of esophageal dynamic function comprehensively and objectively. However, after the results of HRM are obtained, doctors still need to evaluate by a variety of parameters. This work is burdensome, and the process is complex. We conducted image processing of HRM to predict the esophageal contraction vigor for assisting the evaluation of esophageal dynamic function. Firstly, we used Feature-Extraction and Histogram of Gradients (FE-HOG) to analyses feature of proposal of swallow (PoS) to further extract higher-order features. Then we determine the classification of esophageal contraction vigor normal, weak and failed by using linear-SVM according to these features. Our data set includes 3000 training sets, 500 validation sets and 411 test sets. After verification our accuracy reaches 86.83%, which is higher than other common machine learning methods. △ Less

Submitted 27 November, 2023; originally announced November 2023.