-
Wind from the Hot Accretion Flow and Super-Eddington Accretion Flow
Authors:
Hai Yang,
Feng Yuan
Abstract:
Wind is believed to be widespread in various black hole accretion flows. However, unlike the wind from thin disks, which have substantial observational evidence, the wind from hot accretion flows is difficult to observe due to the extremely high temperatures causing the gas to be almost fully ionized. Its existence was controversial until recent theoretical work demonstrated its presence and stren…
▽ More
Wind is believed to be widespread in various black hole accretion flows. However, unlike the wind from thin disks, which have substantial observational evidence, the wind from hot accretion flows is difficult to observe due to the extremely high temperatures causing the gas to be almost fully ionized. Its existence was controversial until recent theoretical work demonstrated its presence and strength, which was subsequently confirmed by observations. Although there have been some new observations recently, the main progress still comes from theoretical studies. These studies investigate the effects of different magnetic fields and black hole spins on the wind, providing insights into properties such as mass flux and wind velocity. Wind is typically produced locally within the Bondi radius, and even wind generated on a small scale can propagate far beyond this radius. The situation with super-Eddington wind is similar, despite some recent observations, the main advances rely on theoretical studies. Recent research comparing the momentum and energy of wind and jets suggests that wind plays a more crucial role in active galactic nuclei feedback than jets, whether the wind originates from hot accretion flows or super-Eddington accretion flows.
△ Less
Submitted 29 August, 2024;
originally announced August 2024.
-
Long Range Energy-energy Correlator at the LHC
Authors:
Yuxun Guo,
Xiaohui Liu,
Feng Yuan
Abstract:
We study the forward-backward azimuthal angular correlations of hadrons in association with multi-particle production in the central rapidity region in proton-proton collisions at the LHC. We apply the nucleon energy-energy correlator framework, where the spinning gluon distribution introduces a nontrivial $\cos(2φ)$ asymmetries. We will demonstrate that the fundamental helicity structure of QCD a…
▽ More
We study the forward-backward azimuthal angular correlations of hadrons in association with multi-particle production in the central rapidity region in proton-proton collisions at the LHC. We apply the nucleon energy-energy correlator framework, where the spinning gluon distribution introduces a nontrivial $\cos(2φ)$ asymmetries. We will demonstrate that the fundamental helicity structure of QCD amplitudes predicts a unique power counting rule: $\cos(2φ)$ asymmetry starts at ${O}(α_s^2)$ order for dijet, ${O}(α_s)$ for three jet and ${O}(1)$ for four (and more) jet productions. Our results will help us to understand the long standing puzzle of nearside ridge behavior observed in high multiplicity events of $pp$ collisions at the LHC.
△ Less
Submitted 26 August, 2024;
originally announced August 2024.
-
From Halos to Galaxies. VI. Improved halo mass estimation for SDSS groups and measurement of the halo mass function
Authors:
Dingyi Zhao,
Yingjie Peng,
Yipeng Jing,
Xiaohu Yang,
Luis C. Ho,
Alvio Renzini,
Anna R. Gallazzi,
Cheqiu Lyu,
Roberto Maiolino,
Jing Dou,
Zeyu Gao,
Qiusheng Gu,
Filippo Mannucci,
Houjun Mo,
Bitao Wang,
Enci Wang,
Kai Wang,
Yu-Chen Wang,
Bingxiao Xu,
Feng Yuan,
Xingye Zhu
Abstract:
In $Λ$CDM cosmology, galaxies form and evolve in their host dark matter (DM) halos. Halo mass is crucial for understanding the halo-galaxy connection. The abundance matching (AM) technique has been widely used to derive the halo masses of galaxy groups. However, quenching of the central galaxy can decouple the coevolution of its stellar mass and DM halo mass. Different halo assembly histories can…
▽ More
In $Λ$CDM cosmology, galaxies form and evolve in their host dark matter (DM) halos. Halo mass is crucial for understanding the halo-galaxy connection. The abundance matching (AM) technique has been widely used to derive the halo masses of galaxy groups. However, quenching of the central galaxy can decouple the coevolution of its stellar mass and DM halo mass. Different halo assembly histories can also result in significantly different final stellar mass of the central galaxies. These processes can introduce substantial uncertainties in the halo masses derived from the AM method, particularly leading to a systematic bias between groups with star-forming centrals (blue groups) and passive centrals (red groups). To improve, we developed a new machine learning (ML) algorithm that accounts for these effects and is trained on simulations. Our results show that the ML method eliminates the systematic bias in the derived halo masses for blue and red groups and is, on average, $\sim1/3$ more accurate than the AM method. With careful calibration of observable quantities from simulations and observations from SDSS, we apply our ML model to the SDSS Yang et al. groups to derive their halo masses down to $10^{11.5}\mathrm{M_\odot}$ or even lower. The derived SDSS group halo mass function agrees well with the theoretical predictions, and the derived stellar-to-halo mass relations for both red and blue groups matches well with those obtained from direct weak lensing measurements. These new halo mass estimates enable more accurate investigation of the galaxy-halo connection and the role of the halos in galaxy evolution.
△ Less
Submitted 22 August, 2024;
originally announced August 2024.
-
From Halos to Galaxies. X: Decoding Galaxy SEDs with Physical Priors and Accurate Star Formation History Reconstruction
Authors:
Zeyu Gao,
Yingjie Peng,
Kai Wang,
Luis C. Ho,
Alvio Renzini,
Anna R. Gallazzi,
Filippo Mannucci,
Houjun Mo,
Yipeng Jing,
Xiaohu Yang,
Enci Wang,
Dingyi Zhao,
Jing Dou,
Qiusheng Gu,
Cheqiu Lyu,
Roberto Maiolino,
Bitao Wang,
Yu-Chen Wang,
Bingxiao Xu,
Feng Yuan,
Xingye Zhu
Abstract:
The spectral energy distribution (SED) of galaxies is essential for deriving fundamental properties like stellar mass and star formation history (SFH). However, conventional methods, including both parametric and non-parametric approaches, often fail to accurately recover the observed cosmic star formation rate (SFR) density due to oversimplified or unrealistic assumptions about SFH and their inab…
▽ More
The spectral energy distribution (SED) of galaxies is essential for deriving fundamental properties like stellar mass and star formation history (SFH). However, conventional methods, including both parametric and non-parametric approaches, often fail to accurately recover the observed cosmic star formation rate (SFR) density due to oversimplified or unrealistic assumptions about SFH and their inability to account for the complex SFH variations across different galaxy populations. To address this issue, we introduce a novel approach that improves galaxy broad-band SED analysis by incorporating physical priors derived from hydrodynamical simulations. Tests using IllustrisTNG simulations demonstrate that our method can reliably determine galaxy physical properties from broad-band photometry, including stellar mass within 0.05 dex, current SFR within 0.3 dex, and fractional stellar formation time within 0.2 dex, with a negligible fraction of catastrophic failures. When applied to the SDSS main photometric galaxy sample with spectroscopic redshift, our estimates of stellar mass and SFR are consistent with the widely-used MPA-JHU and GSWLC catalogs. Notably, using the derived SFHs of individual SDSS galaxies, we estimate the cosmic SFR density and stellar mass density with remarkable consistency to direct observations up to $z \sim 6$. This marks the first time SFHs derived from SEDs can accurately match observations. Consequently, our method can reliably recover observed spectral indices such as $\rm D_{\rm n}(4000)$ and $\rm Hδ_{\rm A}$ by synthesizing the full spectra of galaxies using the estimated SFHs and metal enrichment histories, relying solely on broad-band photometry as input. Furthermore, this method is extremely computationally efficient compared to conventional approaches.
△ Less
Submitted 14 August, 2024;
originally announced August 2024.
-
Jet definition and TMD factorisation in SIDIS
Authors:
Paul Caucal,
Edmond Iancu,
A. H. Mueller,
Feng Yuan
Abstract:
Using the colour dipole picture of Deep Inelastic Scattering (DIS) and the Colour Glass Condensate effective theory, we study semi-inclusive jet production in DIS at small $x$ in the limit where the photon virtuality $Q^2$ is much larger than the transverse momentum squared $P_\perp^2$ of the produced jet. In this limit, the cross-section is dominated by aligned jet configurations, that is, quark-…
▽ More
Using the colour dipole picture of Deep Inelastic Scattering (DIS) and the Colour Glass Condensate effective theory, we study semi-inclusive jet production in DIS at small $x$ in the limit where the photon virtuality $Q^2$ is much larger than the transverse momentum squared $P_\perp^2$ of the produced jet. In this limit, the cross-section is dominated by aligned jet configurations, that is, quark-antiquark pairs in which one of the fermions -- the would-be struck quark in the Breit frame -- carries most of the longitudinal momentum of the virtual photon. We show that physically meaningful jet definitions in DIS are such that the effective axis of the jet sourced by the struck quark is controlled by its virtuality rather than by its transverse momentum. For such jet definitions, we show that the next-to-leading order (NLO) cross-section admits factorisation in terms of the (sea) quark transverse momentum dependent (TMD) distribution, which in turn satisfies a universal DGLAP and Sudakov evolution.
△ Less
Submitted 6 August, 2024;
originally announced August 2024.
-
Fractional vortices and Ising superconductivity in multiband superconductors
Authors:
Haijiao Ji,
Noah F. Q. Yuan
Abstract:
Inspired by the recent experiments in monolayer iron-based superconductors, we theoretically investigate properties of a two-dimensional multiband superconductor, focusing on two aspects. First, for vortex bound states, the spatial anisotropy and positions of electron density peaks are associated with interband couplings. Second, even with inversion symmetry, there allows a Ising-type spin-orbit c…
▽ More
Inspired by the recent experiments in monolayer iron-based superconductors, we theoretically investigate properties of a two-dimensional multiband superconductor, focusing on two aspects. First, for vortex bound states, the spatial anisotropy and positions of electron density peaks are associated with interband couplings. Second, even with inversion symmetry, there allows a Ising-type spin-orbit coupling, leading to the enhanced in-plane upper critical field.
△ Less
Submitted 4 August, 2024;
originally announced August 2024.
-
Localized stem structures in quasi-resonant two-soliton solutions for the asymmetric Nizhnik-Novikov-Veselov system
Authors:
Feng Yuan,
Jiguang Rao,
Jingsong He,
Yi Cheng
Abstract:
Elastic collisions of solitons generally have a finite phase shift. When the phase shift has a finitely large value, the two vertices of the (2+1)-dimensional 2-soliton are significantly separated due to the phase shift, accompanied by the formation of a local structure connecting the two V-shaped solitons. We define this local structure as the stem structure. This study systematically investigate…
▽ More
Elastic collisions of solitons generally have a finite phase shift. When the phase shift has a finitely large value, the two vertices of the (2+1)-dimensional 2-soliton are significantly separated due to the phase shift, accompanied by the formation of a local structure connecting the two V-shaped solitons. We define this local structure as the stem structure. This study systematically investigates the localized stem structures between two solitons in the (2+1)-dimensional asymmetric Nizhnik-Novikov-Veselov system. These stem structures, arising from quasi-resonant collisions between the solitons, exhibit distinct features of spatial locality and temporal invariance. We explore two scenarios: one characterized by weakly quasi-resonant collisions (i.e. $a_{12}\approx 0$), and the other by strongly quasi-resonant collisions (i.e. $a_{12}\approx +\infty$). Through mathematical analysis, we extract comprehensive insights into the trajectories, amplitudes, and velocities of the soliton arms. Furthermore, we discuss the characteristics of the stem structures, including their length and extreme points. Our findings shed new light on the interaction between solitons in the (2+1)-dimensional asymmetric Nizhnik-Novikov-Veselov system.
△ Less
Submitted 30 July, 2024;
originally announced July 2024.
-
Direct observation of quantum vortex fractionalization in multiband superconductors
Authors:
Yu Zheng,
Quanxin Hu,
Haijiao Ji,
Igor Timoshuk,
Hanxiang Xu,
Yongwei Li,
Ye Gao,
Xin Yu,
Rui Wu,
Xingye Lu,
Vadim Grinenko,
Egor Babaev,
Noah F. Q. Yuan,
Baiqing Lv,
Chi-Ming Yim,
Hong Ding
Abstract:
Magnetic field is expelled from a superconductor, unless it forms quantum vortices, consisting of a core singularity with current circulating around it. The London quantization condition implies that there is one core singularity per quantum of magnetic flux in single-component superconductors, while in multiband materials fractional vortices are possible. Here, we report the first observation of…
▽ More
Magnetic field is expelled from a superconductor, unless it forms quantum vortices, consisting of a core singularity with current circulating around it. The London quantization condition implies that there is one core singularity per quantum of magnetic flux in single-component superconductors, while in multiband materials fractional vortices are possible. Here, we report the first observation of quantum vortex core fractionalization on the potassium terminated surface of multiband superconductor KFe2As2 by scanning tunneling microscopy. We observe splitting of an integer-flux vortex into several fractional vortices, leading to disparity between numbers of flux quanta and vortex cores. Our findings demonstrate that fractionalized core singularities are possible in a multiband superconductor, opening avenue for new experimental platforms with quasiparticles with fractional statistics.
△ Less
Submitted 27 August, 2024; v1 submitted 26 July, 2024;
originally announced July 2024.
-
LLaMAX: Scaling Linguistic Horizons of LLM by Enhancing Translation Capabilities Beyond 100 Languages
Authors:
Yinquan Lu,
Wenhao Zhu,
Lei Li,
Yu Qiao,
Fei Yuan
Abstract:
Large Language Models~(LLMs) demonstrate remarkable translation capabilities in high-resource language tasks, yet their performance in low-resource languages is hindered by insufficient multilingual data during pre-training. To address this, we dedicate 35,000 A100-SXM4-80GB GPU hours in conducting extensive multilingual continual pre-training on the LLaMA series models, enabling translation suppo…
▽ More
Large Language Models~(LLMs) demonstrate remarkable translation capabilities in high-resource language tasks, yet their performance in low-resource languages is hindered by insufficient multilingual data during pre-training. To address this, we dedicate 35,000 A100-SXM4-80GB GPU hours in conducting extensive multilingual continual pre-training on the LLaMA series models, enabling translation support across more than 100 languages. Through a comprehensive analysis of training strategies, such as vocabulary expansion and data augmentation, we develop LLaMAX. Remarkably, without sacrificing its generalization ability, LLaMAX achieves significantly higher translation performance compared to existing open-source LLMs~(by more than 10 spBLEU points) and performs on-par with specialized translation model~(M2M-100-12B) on the Flores-101 benchmark. Extensive experiments indicate that LLaMAX can serve as a robust multilingual foundation model. The code~\footnote{\url{https://github.com/CONE-MT/LLaMAX/.}} and models~\footnote{\url{https://huggingface.co/LLaMAX/.}} are publicly available.
△ Less
Submitted 8 July, 2024;
originally announced July 2024.
-
Unified continuous-time q-learning for mean-field game and mean-field control problems
Authors:
Xiaoli Wei,
Xiang Yu,
Fengyi Yuan
Abstract:
This paper studies the continuous-time q-learning in the mean-field jump-diffusion models from the representative agent's perspective. To overcome the challenge when the population distribution may not be directly observable, we introduce the integrated q-function in decoupled form (decoupled Iq-function) and establish its martingale characterization together with the value function, which provide…
▽ More
This paper studies the continuous-time q-learning in the mean-field jump-diffusion models from the representative agent's perspective. To overcome the challenge when the population distribution may not be directly observable, we introduce the integrated q-function in decoupled form (decoupled Iq-function) and establish its martingale characterization together with the value function, which provides a unified policy evaluation rule for both mean-field game (MFG) and mean-field control (MFC) problems. Moreover, depending on the task to solve the MFG or MFC problem, we can employ the decoupled Iq-function by different means to learn the mean-field equilibrium policy or the mean-field optimal policy respectively. As a result, we devise a unified q-learning algorithm for both MFG and MFC problems by utilizing all test policies stemming from the mean-field interactions. For several examples in the jump-diffusion setting, within and beyond the LQ framework, we can obtain the exact parameterization of the decoupled Iq-functions and the value functions, and illustrate our algorithm from the representative agent's perspective with satisfactory performance.
△ Less
Submitted 5 July, 2024;
originally announced July 2024.
-
From Halos to Galaxies. IX. Estimate of Halo Assembly History for SDSS Galaxy Groups
Authors:
Cheqiu Lyu,
Yingjie Peng,
Yipeng Jing,
Xiaohu Yang,
Luis C. Ho,
Alvio Renzini,
Dingyi Zhao,
Filippo Mannucci,
Houjun Mo,
Kai Wang,
Bitao Wang,
Bingxiao Xu,
Jing Dou,
Anna R. Gallazzi,
Qiusheng Gu,
Roberto Maiolino,
Enci Wang,
Feng Yuan
Abstract:
The properties of the galaxies are tightly connected to their host halo mass and halo assembly history. Accurate measurement of the halo assembly history in observation is challenging but crucial to the understanding of galaxy formation and evolution. The stellar-to-halo mass ratio ($M_*/M_{\mathrm{h}}$) for the centrals has often been used to indicate the halo assembly time $t_{\mathrm{h,50}}$ of…
▽ More
The properties of the galaxies are tightly connected to their host halo mass and halo assembly history. Accurate measurement of the halo assembly history in observation is challenging but crucial to the understanding of galaxy formation and evolution. The stellar-to-halo mass ratio ($M_*/M_{\mathrm{h}}$) for the centrals has often been used to indicate the halo assembly time $t_{\mathrm{h,50}}$ of the group, where $t_{\mathrm{h,50}}$ is the lookback time at which a halo has assembled half of its present-day virial mass. Using mock data from the semi-analytic models, we find that $M_*/M_{\mathrm{h}}$ shows a significant scatter with $t_{\mathrm{h,50}}$, with a strong systematic difference between the group with a star-forming central (blue group) and passive central (red group). To improve the accuracy, we develop machine-learning models to estimate $t_{\mathrm{h,50}}$ for galaxy groups using only observable quantities in the mocks. Since star-formation quenching will decouple the co-growth of the dark matter and baryon, we train our models separately for blue and red groups. Our models have successfully recovered $t_{\mathrm{h,50}}$, within an accuracy of $\sim$ 1.09 Gyr. With careful calibrations of individual observable quantities in the mocks with SDSS observations, we apply the trained models to the SDSS Yang et al. groups and derive the $t_{\mathrm{h,50}}$ for each group for the first time. The derived SDSS $t_{\mathrm{h,50}}$ distributions are in good agreement with that in the mocks, in particular for blue groups. The derived halo assembly history, together with the halo mass, make an important step forward in studying the halo-galaxy connections in observation.
△ Less
Submitted 3 July, 2024;
originally announced July 2024.
-
Optimal consumption under loss-averse multiplicative habit-formation preferences
Authors:
Bahman Angoshtari,
Xiang Yu,
Fengyi Yuan
Abstract:
This paper studies a loss-averse version of the multiplicative habit formation preference and the corresponding optimal investment and consumption strategies over an infinite horizon. The agent's consumption preference is depicted by a general S-shaped utility function of her consumption-to-habit ratio. By considering the concave envelope of the S-shaped utility and the associated dual value funct…
▽ More
This paper studies a loss-averse version of the multiplicative habit formation preference and the corresponding optimal investment and consumption strategies over an infinite horizon. The agent's consumption preference is depicted by a general S-shaped utility function of her consumption-to-habit ratio. By considering the concave envelope of the S-shaped utility and the associated dual value function, we provide a thorough analysis of the HJB equation for the concavified problem via studying a related nonlinear free boundary problem. Based on established properties of the solution to this free boundary problem, we obtain the optimal consumption and investment policies in feedback form. Some new and technical verification arguments are developed to cope with generality of the utility function. The equivalence between the original problem and the concavified problem readily follows from the structure of the feedback policies. We also discuss some quantitative properties of the optimal policies under several commonly used S-shaped utilities, complemented by illustrative numerical examples and their financial implications.
△ Less
Submitted 28 June, 2024;
originally announced June 2024.
-
A surprising excess of radio emission in extremely stable quasars: a unique clue to jet launching?
Authors:
Wen-Yong Kang,
Jun-Xian Wang,
Zhen-Yi Cai,
Hao-Chen Wang,
Wen-Ke Ren,
Mai Liao,
Feng Yuan,
Andrzej Zdziarski,
Xinwu Cao
Abstract:
Quasars are generally divided into jetted radio-loud and non-jetted radio-quiet ones, but why only 10% quasars are radio loud has been puzzling for decades. Other than jet-induced-phenomena, black hole mass, or Eddington ratio, prominent difference between jetted and non-jetted quasars has scarcely been detected. Here we show a unique distinction between them and the mystery of jet launching could…
▽ More
Quasars are generally divided into jetted radio-loud and non-jetted radio-quiet ones, but why only 10% quasars are radio loud has been puzzling for decades. Other than jet-induced-phenomena, black hole mass, or Eddington ratio, prominent difference between jetted and non-jetted quasars has scarcely been detected. Here we show a unique distinction between them and the mystery of jet launching could be disclosed by a prominent excess of radio emission in extremely stable quasars (ESQs, i.e., type 1 quasars with extremely weak variability in UV/optical over 10 years). Specifically, we find that $>$ 25% of the ESQs are detected by the FIRST/VLASS radio survey, while only $\sim$ 6-8% of the control sample, matched in redshift, luminosity, and Eddington ratio, are radio-detected. The excess of radio detection in ESQs has a significance of 4.4 $σ$ (99.9995%), and dominantly occurs at intermediate radio loudness with R $\sim$ 10 - 60. The radio detection fraction of ESQs also tends to increase in the ESQ samples selected with more stringent thresholds. Our results are in contrast to the common view that RL quasars are likely more variable in UV/optical due to jet contribution. New clues/challenge posed by our findings highlight the importance of extensive follow-up observations to probe the nature of jets in ESQs, and theoretical studies on the link between jet launching and ESQs. Moreover, our results makes ESQs, an essential population which has never been explored, unique targets in the burgeoning era of time domain astronomy, like their opposite counterparts of quasars exhibiting extreme variability or changing-look features.
△ Less
Submitted 18 June, 2024;
originally announced June 2024.
-
Semantic-Enhanced Relational Metric Learning for Recommender Systems
Authors:
Mingming Li,
Fuqing Zhu,
Feng Yuan,
Songlin Hu
Abstract:
Recently, relational metric learning methods have been received great attention in recommendation community, which is inspired by the translation mechanism in knowledge graph. Different from the knowledge graph where the entity-to-entity relations are given in advance, historical interactions lack explicit relations between users and items in recommender systems. Currently, many researchers have s…
▽ More
Recently, relational metric learning methods have been received great attention in recommendation community, which is inspired by the translation mechanism in knowledge graph. Different from the knowledge graph where the entity-to-entity relations are given in advance, historical interactions lack explicit relations between users and items in recommender systems. Currently, many researchers have succeeded in constructing the implicit relations to remit this issue. However, in previous work, the learning process of the induction function only depends on a single source of data (i.e., user-item interaction) in a supervised manner, resulting in the co-occurrence relation that is free of any semantic information. In this paper, to tackle the above problem in recommender systems, we propose a joint Semantic-Enhanced Relational Metric Learning (SERML) framework that incorporates the semantic information. Specifically, the semantic signal is first extracted from the target reviews containing abundant item features and personalized user preferences. A novel regression model is then designed via leveraging the extracted semantic signal to improve the discriminative ability of original relation-based training process. On four widely-used public datasets, experimental results demonstrate that SERML produces a competitive performance compared with several state-of-the-art methods in recommender systems.
△ Less
Submitted 7 June, 2024;
originally announced June 2024.
-
Long Range Azimuthal Correlation, Entanglement and Bell Inequality Violation by Spinning Gluons at the LHC
Authors:
Yuxun Guo,
Xiaohui Liu,
Feng Yuan,
Hua Xing Zhu
Abstract:
We apply the recently developed concept of the nucleon energy-energy correlator (NEEC) for the gluon sector to investigate the long-range azimuthal angular correlations in proton-proton collisions at the LHC. The spinning gluon in these collisions will introduce a significant nonzero $\cos(2φ)$ asymmetries in both Higgs Boson and top quark pair productions. The genesis of the $\cos(2φ)$ correlatio…
▽ More
We apply the recently developed concept of the nucleon energy-energy correlator (NEEC) for the gluon sector to investigate the long-range azimuthal angular correlations in proton-proton collisions at the LHC. The spinning gluon in these collisions will introduce a significant nonzero $\cos(2φ)$ asymmetries in both Higgs Boson and top quark pair productions. The genesis of the $\cos(2φ)$ correlation lies in the intricate quantum entanglement. Owing to the substantial $\cos(2φ)$ effect, the NEEC observable in Higgs Boson and $t{\bar t}$ production emerges as a pivotal avenue for delving into quantum entanglement and scrutinizing the Bell inequality at high-energy colliders.
△ Less
Submitted 9 June, 2024;
originally announced June 2024.
-
MindMerger: Efficient Boosting LLM Reasoning in non-English Languages
Authors:
Zixian Huang,
Wenhao Zhu,
Gong Cheng,
Lei Li,
Fei Yuan
Abstract:
Reasoning capabilities are crucial for Large Language Models (LLMs), yet a notable gap exists between English and non-English languages. To bridge this disparity, some works fine-tune LLMs to relearn reasoning capabilities in non-English languages, while others replace non-English inputs with an external model's outputs such as English translation text to circumvent the challenge of LLM understand…
▽ More
Reasoning capabilities are crucial for Large Language Models (LLMs), yet a notable gap exists between English and non-English languages. To bridge this disparity, some works fine-tune LLMs to relearn reasoning capabilities in non-English languages, while others replace non-English inputs with an external model's outputs such as English translation text to circumvent the challenge of LLM understanding non-English. Unfortunately, these methods often underutilize the built-in skilled reasoning and useful language understanding capabilities of LLMs. In order to better utilize the minds of reasoning and language understanding in LLMs, we propose a new method, namely MindMerger, which merges LLMs with the external language understanding capabilities from multilingual models to boost the multilingual reasoning performance. Furthermore, a two-step training scheme is introduced to first train to embeded the external capabilities into LLMs and then train the collaborative utilization of the external capabilities and the built-in capabilities in LLMs. Experiments on three multilingual reasoning datasets and a language understanding dataset demonstrate that MindMerger consistently outperforms all baselines, especially in low-resource languages. Without updating the parameters of LLMs, the average accuracy improved by 6.7% and 8.0% across all languages and low-resource languages on the MGSM dataset, respectively.
△ Less
Submitted 27 May, 2024;
originally announced May 2024.
-
Dual-State Personalized Knowledge Tracing with Emotional Incorporation
Authors:
Shanshan Wang,
Fangzheng Yuan,
Keyang Wang,
Xun Yang,
Xingyi Zhang,
Meng Wang
Abstract:
Knowledge tracing has been widely used in online learning systems to guide the students' future learning. However, most existing KT models primarily focus on extracting abundant information from the question sets and explore the relationships between them, but ignore the personalized student behavioral information in the learning process. This will limit the model's ability to accurately capture t…
▽ More
Knowledge tracing has been widely used in online learning systems to guide the students' future learning. However, most existing KT models primarily focus on extracting abundant information from the question sets and explore the relationships between them, but ignore the personalized student behavioral information in the learning process. This will limit the model's ability to accurately capture the personalized knowledge states of students and reasonably predict their performances. To alleviate this limitation, we explicitly models the personalized learning process by incorporating the emotions, a representative personalized behavior in the learning process, into KT framework. Specifically, we present a novel Dual-State Personalized Knowledge Tracing with Emotional Incorporation model to achieve this goal: Firstly, we incorporate emotional information into the modeling process of knowledge state, resulting in the Knowledge State Boosting Module. Secondly, we design an Emotional State Tracing Module to monitor students' personalized emotional states, and propose an emotion prediction method based on personalized emotional states. Finally, we apply the predicted emotions to enhance students' response prediction. Furthermore, to extend the generalization capability of our model across different datasets, we design a transferred version of DEKT, named Transfer Learning-based Self-loop model (T-DEKT). Extensive experiments show our method achieves the state-of-the-art performance.
△ Less
Submitted 26 May, 2024;
originally announced May 2024.
-
Multi-hop Multi-RIS Wireless Communication Systems: Multi-reflection Path Scheduling and Beamforming
Authors:
Xiaoyan Ma,
Haixia Zhang,
Xianhao Chen,
Yuguang Fangmand Dongfeng Yuan
Abstract:
Reconfigurable intelligent surface (RIS) provides a promising way to proactively augment propagation environments for better transmission performance in wireless communications. Existing multi-RIS works mainly focus on link-level optimization with predetermined transmission paths, which cannot be directly extended to system-level management, since they neither consider the interference caused by u…
▽ More
Reconfigurable intelligent surface (RIS) provides a promising way to proactively augment propagation environments for better transmission performance in wireless communications. Existing multi-RIS works mainly focus on link-level optimization with predetermined transmission paths, which cannot be directly extended to system-level management, since they neither consider the interference caused by undesired scattering of RISs, nor the performance balancing between different transmission paths. To address this, we study an innovative multi-hop multi-RIS communication system, where a base station (BS) transmits information to a set of distributed users over multi-RIS configuration space in a multi-hop manner. The signals for each user are subsequently reflected by the selected RISs via multi-reflection line-of-sight (LoS) links. To ensure that all users have fair access to the system to avoid excessive number of RISs serving one user, we aim to find the optimal beam reflecting path for each user, while judiciously determining the path scheduling strategies with the corresponding beamforming design to ensure the fairness. Due to the presence of interference caused by undesired scattering of RISs, it is highly challenging to solve the formulated multi-RIS multi-path beamforming optimization problem. To solve it, we first derive the optimal RISs' phase shifts and the corresponding reflecting path selection for each user based on its practical deployment location. With the optimized multi-reflection paths, we obtain a feasible user grouping pattern for effective interference mitigation by constructing the maximum independent sets (MISs). Finally, we propose a joint heuristic algorithm to iteratively update the beamforming vectors and the group scheduling policies to maximize the minimum equivalent data rate of all users.
△ Less
Submitted 21 May, 2024;
originally announced May 2024.
-
The Power of Question Translation Training in Multilingual Reasoning: Broadened Scope and Deepened Insights
Authors:
Wenhao Zhu,
Shujian Huang,
Fei Yuan,
Cheng Chen,
Jiajun Chen,
Alexandra Birch
Abstract:
Bridging the significant gap between large language model's English and non-English performance presents a great challenge. While some previous studies attempt to mitigate this gap with translated training data, the recently proposed question alignment approach leverages the model's English expertise to improve multilingual performance with minimum usage of expensive, error-prone translation. In t…
▽ More
Bridging the significant gap between large language model's English and non-English performance presents a great challenge. While some previous studies attempt to mitigate this gap with translated training data, the recently proposed question alignment approach leverages the model's English expertise to improve multilingual performance with minimum usage of expensive, error-prone translation. In this paper, we explore how broadly this method can be applied by examining its effects in reasoning with executable code and reasoning with common sense. We also explore how to apply this approach efficiently to extremely large language models using proxy-tuning. Experiment results on multilingual reasoning benchmarks mGSM, mSVAMP and xCSQA demonstrate that the question alignment approach can be used to boost multilingual performance across diverse reasoning scenarios, model families, and sizes. For instance, when applied to the LLaMA2 models, our method brings an average accuracy improvements of 12.2% on mGSM even with the 70B model. To understand the mechanism of its success, we analyze representation space, chain-of-thought and translation data scales, which reveals how question translation training strengthens language alignment within LLMs and shapes their working patterns.
△ Less
Submitted 29 June, 2024; v1 submitted 2 May, 2024;
originally announced May 2024.
-
Offline Trajectory Generalization for Offline Reinforcement Learning
Authors:
Ziqi Zhao,
Zhaochun Ren,
Liu Yang,
Fajie Yuan,
Pengjie Ren,
Zhumin Chen,
jun Ma,
Xin Xin
Abstract:
Offline reinforcement learning (RL) aims to learn policies from static datasets of previously collected trajectories. Existing methods for offline RL either constrain the learned policy to the support of offline data or utilize model-based virtual environments to generate simulated rollouts. However, these methods suffer from (i) poor generalization to unseen states; and (ii) trivial improvement f…
▽ More
Offline reinforcement learning (RL) aims to learn policies from static datasets of previously collected trajectories. Existing methods for offline RL either constrain the learned policy to the support of offline data or utilize model-based virtual environments to generate simulated rollouts. However, these methods suffer from (i) poor generalization to unseen states; and (ii) trivial improvement from low-qualified rollout simulation. In this paper, we propose offline trajectory generalization through world transformers for offline reinforcement learning (OTTO). Specifically, we use casual Transformers, a.k.a. World Transformers, to predict state dynamics and the immediate reward. Then we propose four strategies to use World Transformers to generate high-rewarded trajectory simulation by perturbing the offline data. Finally, we jointly use offline data with simulated data to train an offline RL algorithm. OTTO serves as a plug-in module and can be integrated with existing offline RL methods to enhance them with better generalization capability of transformers and high-rewarded data augmentation. Conducting extensive experiments on D4RL benchmark datasets, we verify that OTTO significantly outperforms state-of-the-art offline RL methods.
△ Less
Submitted 16 April, 2024;
originally announced April 2024.
-
Superconductivity from On-Chip Metallization on 2D Topological Chalcogenides
Authors:
Yanyu Jia,
Guo Yu,
Tiancheng Song,
Fang Yuan,
Ayelet J Uzan,
Yue Tang,
Pengjie Wang,
Ratnadwip Singha,
Michael Onyszczak,
Zhaoyi Joy Zheng,
Kenji Watanabe,
Takashi Taniguchi,
Leslie M Schoop,
Sanfeng Wu
Abstract:
Two-dimensional (2D) transition metal dichalcogenides (TMDs) is a versatile class of quantum materials of interest to various fields including, e.g., nanoelectronics, optical devices, and topological and correlated quantum matter. Tailoring the electronic properties of TMDs is essential to their applications in many directions. Here, we report that a highly controllable and uniform on-chip 2D meta…
▽ More
Two-dimensional (2D) transition metal dichalcogenides (TMDs) is a versatile class of quantum materials of interest to various fields including, e.g., nanoelectronics, optical devices, and topological and correlated quantum matter. Tailoring the electronic properties of TMDs is essential to their applications in many directions. Here, we report that a highly controllable and uniform on-chip 2D metallization process converts a class of atomically thin TMDs into robust superconductors, a property belonging to none of the starting materials. As examples, we demonstrate the introduction of superconductivity into a class of 2D air-sensitive topological TMDs, including monolayers of Td-WTe2, 1T'-MoTe2 and 2H-MoTe2, as well as their natural and twisted bilayers, metalized with an ultrathin layer of Palladium. This class of TMDs are known to exhibit intriguing topological phases ranging from topological insulator, Weyl semimetal to fractional Chern insulator. The unique, high-quality two-dimensional metallization process is based on our recent findings of the long-distance, non-Fickian in-plane mass transport and chemistry in 2D that occur at relatively low temperatures and in devices fully encapsulated with inert insulating layers. Highly compatible with existing nanofabrication techniques for van der Waals (vdW) stacks, our results offer a route to designing and engineering superconductivity and topological phases in a class of correlated 2D materials.
△ Less
Submitted 30 April, 2024; v1 submitted 28 March, 2024;
originally announced March 2024.
-
Angular dependence in transverse momentum dependent diffractive parton distributions at small-$x$
Authors:
Yoshitaka Hatta,
Feng Yuan
Abstract:
We discuss the angular dependence of the recently proposed transverse momentum dependent quark and gluon diffractive parton distributions at small-$x$. We introduce the difractive versions of the Sivers function and the elliptic gluon Wigner distribution and evaluate them in simple models with gluon saturation and study their geometric scaling properties. We also show that the diffractive version…
▽ More
We discuss the angular dependence of the recently proposed transverse momentum dependent quark and gluon diffractive parton distributions at small-$x$. We introduce the difractive versions of the Sivers function and the elliptic gluon Wigner distribution and evaluate them in simple models with gluon saturation and study their geometric scaling properties. We also show that the diffractive version of the linearly polarized gluon distribution identically vanishes to leading order. These distributions enrich the physics opportunities for measuring semi-inclsuive diffractive DIS processes at the future electron-ion colliders.
△ Less
Submitted 28 March, 2024;
originally announced March 2024.
-
Breaking the Length Barrier: LLM-Enhanced CTR Prediction in Long Textual User Behaviors
Authors:
Binzong Geng,
Zhaoxin Huan,
Xiaolu Zhang,
Yong He,
Liang Zhang,
Fajie Yuan,
Jun Zhou,
Linjian Mo
Abstract:
With the rise of large language models (LLMs), recent works have leveraged LLMs to improve the performance of click-through rate (CTR) prediction. However, we argue that a critical obstacle remains in deploying LLMs for practical use: the efficiency of LLMs when processing long textual user behaviors. As user sequences grow longer, the current efficiency of LLMs is inadequate for training on billi…
▽ More
With the rise of large language models (LLMs), recent works have leveraged LLMs to improve the performance of click-through rate (CTR) prediction. However, we argue that a critical obstacle remains in deploying LLMs for practical use: the efficiency of LLMs when processing long textual user behaviors. As user sequences grow longer, the current efficiency of LLMs is inadequate for training on billions of users and items. To break through the efficiency barrier of LLMs, we propose Behavior Aggregated Hierarchical Encoding (BAHE) to enhance the efficiency of LLM-based CTR modeling. Specifically, BAHE proposes a novel hierarchical architecture that decouples the encoding of user behaviors from inter-behavior interactions. Firstly, to prevent computational redundancy from repeated encoding of identical user behaviors, BAHE employs the LLM's pre-trained shallow layers to extract embeddings of the most granular, atomic user behaviors from extensive user sequences and stores them in the offline database. Subsequently, the deeper, trainable layers of the LLM facilitate intricate inter-behavior interactions, thereby generating comprehensive user embeddings. This separation allows the learning of high-level user representations to be independent of low-level behavior encoding, significantly reducing computational complexity. Finally, these refined user embeddings, in conjunction with correspondingly processed item embeddings, are incorporated into the CTR model to compute the CTR scores. Extensive experimental results show that BAHE reduces training time and memory by five times for CTR models using LLMs, especially with longer user sequences. BAHE has been deployed in a real-world system, allowing for daily updates of 50 million CTR data on 8 A100 GPUs, making LLMs practical for industrial CTR prediction.
△ Less
Submitted 28 March, 2024;
originally announced March 2024.
-
Modeling the inner part of the jet in M87: Confronting jet morphology with theory
Authors:
Hai Yang,
Feng Yuan,
Hui Li,
Yosuke Mizuno,
Fan Guo,
Rusen Lu,
Luis C. Ho,
Xi Lin,
Andrzej A. Zdziarski,
Jieshuang Wang
Abstract:
The formation of jets in black hole accretion systems is a long-standing problem. It has been proposed that a jet can be formed by extracting the rotation energy of the black hole ("BZ-jet") or the accretion flow ("disk-jet"). While both models can produce collimated relativistic outflows, neither has successfully explained the observed jet morphology. By employing general relativistic magnetohydr…
▽ More
The formation of jets in black hole accretion systems is a long-standing problem. It has been proposed that a jet can be formed by extracting the rotation energy of the black hole ("BZ-jet") or the accretion flow ("disk-jet"). While both models can produce collimated relativistic outflows, neither has successfully explained the observed jet morphology. By employing general relativistic magnetohydrodynamic simulations, and considering nonthermal electrons accelerated by magnetic reconnection that is likely driven by magnetic eruption in the underlying accretion flow, we obtain images by radiative transfer calculations and compared them to millimeter observations of the jet in M87. We find that the BZ-jet originating from a magnetically arrested disk around a high-spin black hole can well reproduce the jet morphology, including its width and limb-brightening feature.
△ Less
Submitted 23 March, 2024;
originally announced March 2024.
-
A Survey of Neural Code Intelligence: Paradigms, Advances and Beyond
Authors:
Qiushi Sun,
Zhirui Chen,
Fangzhi Xu,
Kanzhi Cheng,
Chang Ma,
Zhangyue Yin,
Jianing Wang,
Chengcheng Han,
Renyu Zhu,
Shuai Yuan,
Qipeng Guo,
Xipeng Qiu,
Pengcheng Yin,
Xiaoli Li,
Fei Yuan,
Lingpeng Kong,
Xiang Li,
Zhiyong Wu
Abstract:
Neural Code Intelligence -- leveraging deep learning to understand, generate, and optimize code -- holds immense potential for transformative impacts on the whole society. Bridging the gap between Natural Language and Programming Language, this domain has drawn significant attention from researchers in both research communities over the past few years. This survey presents a systematic and chronol…
▽ More
Neural Code Intelligence -- leveraging deep learning to understand, generate, and optimize code -- holds immense potential for transformative impacts on the whole society. Bridging the gap between Natural Language and Programming Language, this domain has drawn significant attention from researchers in both research communities over the past few years. This survey presents a systematic and chronological review of the advancements in code intelligence, encompassing over 50 representative models and their variants, more than 20 categories of tasks, and an extensive coverage of over 680 related works. We follow the historical progression to trace the paradigm shifts across different research phases (e.g., from modeling code with recurrent neural networks to the era of Large Language Models). Concurrently, we highlight the major technical transitions in models, tasks, and evaluations spanning through different stages. For applications, we also observe a co-evolving shift. It spans from initial endeavors to tackling specific scenarios, through exploring a diverse array of tasks during its rapid expansion, to currently focusing on tackling increasingly complex and varied real-world challenges. Building on our examination of the developmental trajectories, we further investigate the emerging synergies between code intelligence and broader machine intelligence, uncovering new cross-domain opportunities and illustrating the substantial influence of code intelligence across various domains. Finally, we delve into both the opportunities and challenges associated with this field, alongside elucidating our insights on the most promising research directions. An ongoing, dynamically updated project and resources associated with this survey have been released at https://github.com/QiushiSun/NCISurvey.
△ Less
Submitted 23 June, 2024; v1 submitted 21 March, 2024;
originally announced March 2024.
-
Deep Learning-Based CSI Feedback for RIS-Aided Massive MIMO Systems with Time Correlation
Authors:
Zhangjie Peng,
Zhaotian Li,
Ruijing Liu,
Cunhua Pan,
Feiniu Yuan,
Jiangzhou Wang
Abstract:
In this paper, we consider an reconfigurable intelligent surface (RIS)-aided frequency division duplex (FDD) massive multiple-input multiple-output (MIMO) downlink system.In the FDD systems, the downlink channel state information (CSI) should be sent to the base station through the feedback link. However, the overhead of CSI feedback occupies substantial uplink bandwidth resources in RIS-aided com…
▽ More
In this paper, we consider an reconfigurable intelligent surface (RIS)-aided frequency division duplex (FDD) massive multiple-input multiple-output (MIMO) downlink system.In the FDD systems, the downlink channel state information (CSI) should be sent to the base station through the feedback link. However, the overhead of CSI feedback occupies substantial uplink bandwidth resources in RIS-aided communication systems. In this work, we propose a deep learning (DL)-based scheme to reduce the overhead of CSI feedback by compressing the cascaded CSI. In the practical RIS-aided communication systems, the cascaded channel at the adjacent slots inevitably has time correlation. We use long short-term memory to learn time correlation, which can help the neural network to improve the recovery quality of the compressed CSI. Moreover, the attention mechanism is introduced to further improve the CSI recovery quality. Simulation results demonstrate that our proposed DLbased scheme can significantly outperform other DL-based methods in terms of the CSI recovery quality
△ Less
Submitted 19 March, 2024;
originally announced March 2024.
-
Coalescence induced late departure of bubbles improves water electrolysis efficiency
Authors:
Tao Wu,
Bo Liu,
Fang Yuan,
Qiang Yang
Abstract:
In this study, we examine the effects of bubble collisions and coalescence on electrolysis performance using micro-electrodes in a 0.5 M H2SO4. We observe that the addition of electrolytes such as HClO4, despite increasing conductivity, significantly reduces energy conversion efficiency by inhibiting bubble coalescence. A phase diagram illustrates the trade-off between improved conductivity and in…
▽ More
In this study, we examine the effects of bubble collisions and coalescence on electrolysis performance using micro-electrodes in a 0.5 M H2SO4. We observe that the addition of electrolytes such as HClO4, despite increasing conductivity, significantly reduces energy conversion efficiency by inhibiting bubble coalescence. A phase diagram illustrates the trade-off between improved conductivity and inhibition of coalescence with varying concentrations of supporting electrolytes (HClO4 or Na2SO4) at different electrolysis current. Contrary to conventional understanding, we find that larger bubbles resulting from coalescence enhance efficiency. This can be attributed to the early release of smaller bubbles, approximately 10 micron in size, facilitated by the coalescence of the surface microbubble and the just-detached large bubble. Additionally, the merge of two bubbles, at a critical velocity of ~2 m/s, enhances agitation at the electrode surface that significantly improves electrolyte transport within the stagnant layer. These findings challenge conventional perspectives on bubble detachment size and suggest innovative approaches to optimize energy consumption in electrolysis, especially in systems where the bubble coalescence is inhibited, such as alkaline water electrolysis and the chlor-alkali industry.
△ Less
Submitted 9 February, 2024;
originally announced March 2024.
-
Local positional graphs and attentive local features for a data and runtime-efficient hierarchical place recognition pipeline
Authors:
Fangming Yuan,
Stefan Schubert,
Peter Protzel,
Peer Neubert
Abstract:
Large-scale applications of Visual Place Recognition (VPR) require computationally efficient approaches. Further, a well-balanced combination of data-based and training-free approaches can decrease the required amount of training data and effort and can reduce the influence of distribution shifts between the training and application phases. This paper proposes a runtime and data-efficient hierarch…
▽ More
Large-scale applications of Visual Place Recognition (VPR) require computationally efficient approaches. Further, a well-balanced combination of data-based and training-free approaches can decrease the required amount of training data and effort and can reduce the influence of distribution shifts between the training and application phases. This paper proposes a runtime and data-efficient hierarchical VPR pipeline that extends existing approaches and presents novel ideas. There are three main contributions: First, we propose Local Positional Graphs (LPG), a training-free and runtime-efficient approach to encode spatial context information of local image features. LPG can be combined with existing local feature detectors and descriptors and considerably improves the image-matching quality compared to existing techniques in our experiments. Second, we present Attentive Local SPED (ATLAS), an extension of our previous local features approach with an attention module that improves the feature quality while maintaining high data efficiency. The influence of the proposed modifications is evaluated in an extensive ablation study. Third, we present a hierarchical pipeline that exploits hyperdimensional computing to use the same local features as holistic HDC-descriptors for fast candidate selection and for candidate reranking. We combine all contributions in a runtime and data-efficient VPR pipeline that shows benefits over the state-of-the-art method Patch-NetVLAD on a large collection of standard place recognition datasets with 15$\%$ better performance in VPR accuracy, 54$\times$ faster feature comparison speed, and 55$\times$ less descriptor storage occupancy, making our method promising for real-world high-performance large-scale VPR in changing environments. Code will be made available with publication of this paper.
△ Less
Submitted 15 March, 2024;
originally announced March 2024.
-
Suppression of Star Formation in Galaxy Pairs
Authors:
Shuai Feng,
Shi-Yin Shen,
Fang-Ting Yuan,
Wen-Xin Zhong,
Wen-Yuan Cui,
Lin-Lin Li
Abstract:
We investigate the suppression of star formation in galaxy pairs based on the isolated galaxy pair sample derived from the SDSS survey. By comparing the star formation rate between late-type galaxies in galaxy pairs and those in the isolated environment, we detect the signal of star formation suppression in galaxy pairs at $d_p < 100$kpc and $200$kpc$ < d_p < 350$kpc. The occurrence of star format…
▽ More
We investigate the suppression of star formation in galaxy pairs based on the isolated galaxy pair sample derived from the SDSS survey. By comparing the star formation rate between late-type galaxies in galaxy pairs and those in the isolated environment, we detect the signal of star formation suppression in galaxy pairs at $d_p < 100$kpc and $200$kpc$ < d_p < 350$kpc. The occurrence of star formation suppression in these late-type galaxies requires their companion galaxies to have an early-type morphology ($n_s > 2.5$). Star formation suppression in wide galaxy pairs with $200$kpc$ < d_p < 350$kpc mainly occurs in massive late-type galaxies, while in close galaxy pairs with $d_p < 100$kpc, it only appears in late-type galaxies with a massive companion ( $\log M_\star > 11.0$), nearly independent of their own stellar mass. Based on these findings, we infer that star formation suppression in wide galaxy pairs is actually a result of galaxy conformity, while in close galaxy pairs, it stems from the influence of hot circum-galactic medium surrounding companion galaxies.
△ Less
Submitted 14 March, 2024;
originally announced March 2024.
-
Empowering Sequential Recommendation from Collaborative Signals and Semantic Relatedness
Authors:
Mingyue Cheng,
Hao Zhang,
Qi Liu,
Fajie Yuan,
Zhi Li,
Zhenya Huang,
Enhong Chen,
Jun Zhou,
Longfei Li
Abstract:
Sequential recommender systems (SRS) could capture dynamic user preferences by modeling historical behaviors ordered in time. Despite effectiveness, focusing only on the \textit{collaborative signals} from behaviors does not fully grasp user interests. It is also significant to model the \textit{semantic relatedness} reflected in content features, e.g., images and text. Towards that end, in this p…
▽ More
Sequential recommender systems (SRS) could capture dynamic user preferences by modeling historical behaviors ordered in time. Despite effectiveness, focusing only on the \textit{collaborative signals} from behaviors does not fully grasp user interests. It is also significant to model the \textit{semantic relatedness} reflected in content features, e.g., images and text. Towards that end, in this paper, we aim to enhance the SRS tasks by effectively unifying collaborative signals and semantic relatedness together. Notably, we empirically point out that it is nontrivial to achieve such a goal due to semantic gap issues. Thus, we propose an end-to-end two-stream architecture for sequential recommendation, named TSSR, to learn user preferences from ID-based and content-based sequence. Specifically, we first present novel hierarchical contrasting module, including coarse user-grained and fine item-grained terms, to align the representations of inter-modality. Furthermore, we also design a two-stream architecture to learn the dependence of intra-modality sequence and the complex interactions of inter-modality sequence, which can yield more expressive capacity in understanding user interests. We conduct extensive experiments on five public datasets. The experimental results show that the TSSR could yield superior performance than competitive baselines. We also make our experimental codes publicly available at https://anonymous.4open.science/r/TSSR-2A27/.
△ Less
Submitted 12 March, 2024;
originally announced March 2024.
-
Azimuthal Angular Correlation of $J/ψ$ Plus Jet Production at the EIC
Authors:
Luca Maxia,
Feng Yuan
Abstract:
By investigating the soft gluon radiation in the $J/ψ$ plus jet photoproduction at the electron-ion collider (EIC), we demonstrate that the azimuthal angular correlations between the leading jet and heavy quarkonium provide a unique probe to the production mechanism of the latter. In particular, a significant $\cos(φ)$ asymmetry is found for the color-singlet channel, whereas it vanishes or has an…
▽ More
By investigating the soft gluon radiation in the $J/ψ$ plus jet photoproduction at the electron-ion collider (EIC), we demonstrate that the azimuthal angular correlations between the leading jet and heavy quarkonium provide a unique probe to the production mechanism of the latter. In particular, a significant $\cos(φ)$ asymmetry is found for the color-singlet channel, whereas it vanishes or has an opposite sign for color-octet production, depending on the jet transverse momentum. Numerical results of $\cos(φ)$ and $\cos(2φ)$ asymmetries employing both the color-singlet model and the nonrelativistic QCD approach are presented for typical kinematics at the future EIC.
△ Less
Submitted 4 March, 2024;
originally announced March 2024.
-
Observational Evidence for Hot Wind Impact on pc-scale in Low-luminosity Active Galactic Nucleus
Authors:
Fangzheng Shi,
Feng Yuan,
Zhiyuan Li,
Zhao Su,
Suoqing Ji
Abstract:
Supermassive black holes in galaxies spend majority of their lifetime in the low-luminosity regime, powered by hot accretion flow. Strong winds launched from the hot accretion flow have the potential to play an important role in active galactic nuclei (AGN) feedback. Direct observational evidence for these hot winds with temperature around 10 keV, has been obtained through the detection of highly…
▽ More
Supermassive black holes in galaxies spend majority of their lifetime in the low-luminosity regime, powered by hot accretion flow. Strong winds launched from the hot accretion flow have the potential to play an important role in active galactic nuclei (AGN) feedback. Direct observational evidence for these hot winds with temperature around 10 keV, has been obtained through the detection of highly ionized iron emission lines with Doppler shifts in two prototypical low-luminosity AGNs, namely M81* and NGC 7213. In this work, we further identify blueshifted H-like O/Ne emission lines in the soft X-ray spectra of these two sources. These lines are interpreted to be associated with additional outflowing components possessing velocity around several $10^3$ km/s and lower temperature (~0.2-0.4 keV). Blue-shifted velocity and the X-ray intensity of these additional outflowing components are hard to be explained by previously detected hot wind freely propagating to larger radii. Through detailed numerical simulations, we find the newly detected blue-shifted emission lines would come from circumnuclear gas shock-heated by the hot wind instead. Hot wind can provide larger ram pressure force on the clumpy circumnuclear gas than the gravitational force from central black hole, effectively impeding the black hole accretion of gas. Our results provide strong evidences for the energy and momentum feedback by the hot AGN wind.
△ Less
Submitted 1 March, 2024;
originally announced March 2024.
-
Mixed-halide perovskite alloys $\text{CsPb}(\text{I}_{1-x}^{}\text{Br}_x^{})_3^{}$ and $\text{CsPb}(\text{Br}_{1-x}^{}\text{Cl}_x^{})_3^{}$: New insight of configuration entropy effect from first principles and phase diagrams
Authors:
Fang Pan,
Junni Zhai,
Jinyu Chen,
Lin Yang,
Hua Dong,
Fang Yuan,
Zhuangde Jiang,
Wei Ren,
Zuo-Guang Ye,
Guo-Xu Zhang,
Jingrui Li
Abstract:
Stability is one of the key issues in mixed-halide perovskite alloys which are promising in emergent optoelectronics. Previous density-functional-theory (DFT) and machine learning studies indicate that the formation-energy convex hulls of these materials are very shallow, and stable alloy compositions are rare. In this work, we revisit this problem using DFT with special focus on the effects of co…
▽ More
Stability is one of the key issues in mixed-halide perovskite alloys which are promising in emergent optoelectronics. Previous density-functional-theory (DFT) and machine learning studies indicate that the formation-energy convex hulls of these materials are very shallow, and stable alloy compositions are rare. In this work, we revisit this problem using DFT with special focus on the effects of configuration and vibration entropies. Allowed by the $20$-atomic models for the $\text{CsPb}(\text{I}_{1-x}^{}\text{Br}_x^{})_3^{}$ and $\text{CsPb}(\text{Br}_{1-x}^{}\text{Cl}_x^{})_3^{}$ series, the partition functions and therewith thermodynamic state functions are calculated by traversing all possible mixed-halide configurations. We can thus evaluate the temperature- and system-dependent configuration entropy, which largely corrects the conventional approach based on the ideal solution model. Finally, temperature-composition phase diagrams that include $α$, $β$, $γ$ and $δ$ phases of both alloys are constructed based on the free energy data, for which the contribution of phonon vibrations is included.
△ Less
Submitted 29 February, 2024;
originally announced February 2024.
-
Continuous Sign Language Recognition Based on Motor attention mechanism and frame-level Self-distillation
Authors:
Qidan Zhu,
Jing Li,
Fei Yuan,
Quan Gan
Abstract:
Changes in facial expression, head movement, body movement and gesture movement are remarkable cues in sign language recognition, and most of the current continuous sign language recognition(CSLR) research methods mainly focus on static images in video sequences at the frame-level feature extraction stage, while ignoring the dynamic changes in the images. In this paper, we propose a novel motor at…
▽ More
Changes in facial expression, head movement, body movement and gesture movement are remarkable cues in sign language recognition, and most of the current continuous sign language recognition(CSLR) research methods mainly focus on static images in video sequences at the frame-level feature extraction stage, while ignoring the dynamic changes in the images. In this paper, we propose a novel motor attention mechanism to capture the distorted changes in local motion regions during sign language expression, and obtain a dynamic representation of image changes. And for the first time, we apply the self-distillation method to frame-level feature extraction for continuous sign language, which improves the feature expression without increasing the computational resources by self-distilling the features of adjacent stages and using the higher-order features as teachers to guide the lower-order features. The combination of the two constitutes our proposed holistic model of CSLR Based on motor attention mechanism and frame-level Self-Distillation (MAM-FSD), which improves the inference ability and robustness of the model. We conduct experiments on three publicly available datasets, and the experimental results show that our proposed method can effectively extract the sign language motion information in videos, improve the accuracy of CSLR and reach the state-of-the-art level.
△ Less
Submitted 29 February, 2024;
originally announced February 2024.
-
A Hierarchical Dataflow-Driven Heterogeneous Architecture for Wireless Baseband Processing
Authors:
Limin Jiang,
Yi Shi,
Haiqin Hu,
Qingyu Deng,
Siyi Xu,
Yintao Liu,
Feng Yuan,
Si Wang,
Yihao Shen,
Fangfang Ye,
Shan Cao,
Zhiyuan Jiang
Abstract:
Wireless baseband processing (WBP) is a key element of wireless communications, with a series of signal processing modules to improve data throughput and counter channel fading. Conventional hardware solutions, such as digital signal processors (DSPs) and more recently, graphic processing units (GPUs), provide various degrees of parallelism, yet they both fail to take into account the cyclical and…
▽ More
Wireless baseband processing (WBP) is a key element of wireless communications, with a series of signal processing modules to improve data throughput and counter channel fading. Conventional hardware solutions, such as digital signal processors (DSPs) and more recently, graphic processing units (GPUs), provide various degrees of parallelism, yet they both fail to take into account the cyclical and consecutive character of WBP. Furthermore, the large amount of data in WBPs cannot be processed quickly in symmetric multiprocessors (SMPs) due to the unpredictability of memory latency. To address this issue, we propose a hierarchical dataflow-driven architecture to accelerate WBP. A pack-and-ship approach is presented under a non-uniform memory access (NUMA) architecture to allow the subordinate tiles to operate in a bundled access and execute manner. We also propose a multi-level dataflow model and the related scheduling scheme to manage and allocate the heterogeneous hardware resources. Experiment results demonstrate that our prototype achieves $2\times$ and $2.3\times$ speedup in terms of normalized throughput and single-tile clock cycles compared with GPU and DSP counterparts in several critical WBP benchmarks. Additionally, a link-level throughput of $288$ Mbps can be achieved with a $45$-core configuration.
△ Less
Submitted 28 February, 2024;
originally announced February 2024.
-
Topological metal and high-order Dirac point in cubic Rashba model
Authors:
Haijiao Ji,
Ning Zhang,
Noah F. Q. Yuan
Abstract:
We investigate the properties of the two-dimensional model with Rashba-type spin-orbit coupling cubic in electron momentum. In the normal phase, edge states emerge on open boundaries. In the superconducting phase, edge states could evolve into gapped fermionic edge states. Applications to realistic materials of interface superconductors are also discussed.
We investigate the properties of the two-dimensional model with Rashba-type spin-orbit coupling cubic in electron momentum. In the normal phase, edge states emerge on open boundaries. In the superconducting phase, edge states could evolve into gapped fermionic edge states. Applications to realistic materials of interface superconductors are also discussed.
△ Less
Submitted 5 February, 2024;
originally announced February 2024.
-
KS-Lottery: Finding Certified Lottery Tickets for Multilingual Language Models
Authors:
Fei Yuan,
Chang Ma,
Shuai Yuan,
Qiushi Sun,
Lei Li
Abstract:
The lottery ticket hypothesis posits the existence of ``winning tickets'' within a randomly initialized neural network. Do winning tickets exist for LLMs in fine-tuning scenarios? How can we find such winning tickets? In this paper, we propose KS-Lottery, a method to identify a small subset of LLM parameters highly effective in multilingual fine-tuning. Our key idea is to use Kolmogorov-Smirnov Te…
▽ More
The lottery ticket hypothesis posits the existence of ``winning tickets'' within a randomly initialized neural network. Do winning tickets exist for LLMs in fine-tuning scenarios? How can we find such winning tickets? In this paper, we propose KS-Lottery, a method to identify a small subset of LLM parameters highly effective in multilingual fine-tuning. Our key idea is to use Kolmogorov-Smirnov Test to analyze the distribution shift of parameters before and after fine-tuning. We further theoretically prove that KS-Lottery can find the certified winning tickets in the embedding layer, fine-tuning on the found parameters is guaranteed to perform as well as full fine-tuning. Comparing KS-Lottery with other parameter-efficient tuning algorithms on translation tasks, the experimental results show that KS-Lottery finds a much smaller set of parameters for fine-tuning while achieving the comparable performance as full fine-tuning LLM. Surprisingly, we find that fine-tuning 18 tokens' embedding of LLaMA suffices to reach the fine-tuning translation performance~\footnote{https://github.com/CONE-MT/KS-Lottery.}.
△ Less
Submitted 3 June, 2024; v1 submitted 5 February, 2024;
originally announced February 2024.
-
HotRAP: Hot Record Retention and Promotion for LSM-trees with tiered storage
Authors:
Jiansheng Qiu,
Fangzhou Yuan,
Huanchen Zhang
Abstract:
The multi-level design of Log-Structured Merge-trees (LSM-trees) naturally fits the tiered storage architecture: the upper levels (recently inserted/updated records) are kept in fast storage to guarantee performance while the lower levels (the majority of records) are placed in slower but cheaper storage to reduce cost. However, frequently accessed records may have been compacted and reside in slo…
▽ More
The multi-level design of Log-Structured Merge-trees (LSM-trees) naturally fits the tiered storage architecture: the upper levels (recently inserted/updated records) are kept in fast storage to guarantee performance while the lower levels (the majority of records) are placed in slower but cheaper storage to reduce cost. However, frequently accessed records may have been compacted and reside in slow storage, and existing algorithms are inefficient in promoting these ``hot'' records to fast storage, leading to compromised read performance. We present HotRAP, a key-value store based on RocksDB that can timely promote hot records individually from slow to fast storage and keep them in fast storage while they are hot. HotRAP uses an on-disk data structure (a specially-made LSM-tree) to track the hotness of keys and includes three pathways to ensure that hot records reach fast storage with short delays. Our experiments show that HotRAP outperforms state-of-the-art LSM-trees on tiered storage by up to 3.3$\times$ compared to the second best for read-only and read-write-balanced workloads with common access skew patterns.
△ Less
Submitted 3 February, 2024;
originally announced February 2024.
-
Ordered magnetic fields around the 3C 84 central black hole
Authors:
G. F. Paraschos,
J. -Y. Kim,
M. Wielgus,
J. Röder,
T. P. Krichbaum,
E. Ros,
I. Agudo,
I. Myserlis,
M. Moscibrodzka,
E. Traianou,
J. A. Zensus,
L. Blackburn,
C. -K. Chan,
S. Issaoun,
M. Janssen,
M. D. Johnson,
V. L. Fish,
K. Akiyama,
A. Alberdi,
W. Alef,
J. C. Algaba,
R. Anantua,
K. Asada,
R. Azulay,
U. Bach
, et al. (258 additional authors not shown)
Abstract:
3C84 is a nearby radio source with a complex total intensity structure, showing linear polarisation and spectral patterns. A detailed investigation of the central engine region necessitates the use of VLBI above the hitherto available maximum frequency of 86GHz. Using ultrahigh resolution VLBI observations at the highest available frequency of 228GHz, we aim to directly detect compact structures a…
▽ More
3C84 is a nearby radio source with a complex total intensity structure, showing linear polarisation and spectral patterns. A detailed investigation of the central engine region necessitates the use of VLBI above the hitherto available maximum frequency of 86GHz. Using ultrahigh resolution VLBI observations at the highest available frequency of 228GHz, we aim to directly detect compact structures and understand the physical conditions in the compact region of 3C84. We used EHT 228GHz observations and, given the limited (u,v)-coverage, applied geometric model fitting to the data. We also employed quasi-simultaneously observed, multi-frequency VLBI data for the source in order to carry out a comprehensive analysis of the core structure. We report the detection of a highly ordered, strong magnetic field around the central, SMBH of 3C84. The brightness temperature analysis suggests that the system is in equipartition. We determined a turnover frequency of $ν_m=(113\pm4)$GHz, a corresponding synchrotron self-absorbed magnetic field of $B_{SSA}=(2.9\pm1.6)$G, and an equipartition magnetic field of $B_{eq}=(5.2\pm0.6)$G. Three components are resolved with the highest fractional polarisation detected for this object ($m_\textrm{net}=(17.0\pm3.9)$%). The positions of the components are compatible with those seen in low-frequency VLBI observations since 2017-2018. We report a steeply negative slope of the spectrum at 228GHz. We used these findings to test models of jet formation, propagation, and Faraday rotation in 3C84. The findings of our investigation into different flow geometries and black hole spins support an advection-dominated accretion flow in a magnetically arrested state around a rapidly rotating supermassive black hole as a model of the jet-launching system in the core of 3C84. However, systematic uncertainties due to the limited (u,v)-coverage, however, cannot be ignored.
△ Less
Submitted 1 February, 2024;
originally announced February 2024.
-
A universal pairing gap measurement proposal by dynamical excitations in 2D doped attractive Fermi-Hubbard model with spin-orbit coupling
Authors:
Huaisong Zhao,
Rui Han,
Ling Qin,
Feng Yuan,
Peng Zou
Abstract:
By calculating dynamical structure factor of two-dimensional doped attractive Fermi-Hubbard model with Rashba spin-orbit coupling, we not only investigate collective modes and single-particle excitations of the system during the phase transition between Bardeen-Cooper-Schrieffer superfluid and topological superfluid, but also propose a universal method to measure pairing gap measurement in an opti…
▽ More
By calculating dynamical structure factor of two-dimensional doped attractive Fermi-Hubbard model with Rashba spin-orbit coupling, we not only investigate collective modes and single-particle excitations of the system during the phase transition between Bardeen-Cooper-Schrieffer superfluid and topological superfluid, but also propose a universal method to measure pairing gap measurement in an optical lattice system. Our numerical results show that the area of the molecular excitation peak at the transferred momentum ${\bf q}=\left[π,π\right]$ is proportional to the square of the pairing gap in the system with Rashba SOC. In particular, this method is very sensitive to the pairing gap. This goes on verifying that this method is universal to measure the pairing gap in a doped optical lattice with Rashba SOC. These theoretical results are important for experimentally measuring the pairing gap and studying the topological superfluid in an optical lattice.
△ Less
Submitted 30 January, 2024;
originally announced January 2024.
-
Dynamic portfolio selection under generalized disappointment aversion
Authors:
Zongxia Liang,
Sheng Wang,
Jianming Xia,
Fengyi Yuan
Abstract:
This paper addresses the continuous-time portfolio selection problem under generalized disappointment aversion (GDA). The implicit definition of the certainty equivalent within GDA preferences introduces time inconsistency to this problem. We provide the sufficient and necessary condition for a strategy to be an equilibrium by a fully nonlinear integral equation. Investigating the existence and un…
▽ More
This paper addresses the continuous-time portfolio selection problem under generalized disappointment aversion (GDA). The implicit definition of the certainty equivalent within GDA preferences introduces time inconsistency to this problem. We provide the sufficient and necessary condition for a strategy to be an equilibrium by a fully nonlinear integral equation. Investigating the existence and uniqueness of the solution to the integral equation, we establish the existence and uniqueness of the equilibrium. Our findings indicate that under disappointment aversion preferences, non-participation in the stock market is the unique equilibrium. The semi-analytical equilibrium strategies obtained under the constant relative risk aversion utility functions reveal that, under GDA preferences, the investment proportion in the stock market consistently remains smaller than the investment proportion under classical expected utility theory. The numerical analysis shows that the equilibrium strategy's monotonicity concerning the two parameters of GDA preference aligns with the monotonicity of the degree of risk aversion.
△ Less
Submitted 4 March, 2024; v1 submitted 16 January, 2024;
originally announced January 2024.
-
Question Translation Training for Better Multilingual Reasoning
Authors:
Wenhao Zhu,
Shujian Huang,
Fei Yuan,
Shuaijie She,
Jiajun Chen,
Alexandra Birch
Abstract:
Large language models show compelling performance on reasoning tasks but they tend to perform much worse in languages other than English. This is unsurprising given that their training data largely consists of English text and instructions. A typical solution is to translate instruction data into all languages of interest, and then train on the resulting multilingual data, which is called translat…
▽ More
Large language models show compelling performance on reasoning tasks but they tend to perform much worse in languages other than English. This is unsurprising given that their training data largely consists of English text and instructions. A typical solution is to translate instruction data into all languages of interest, and then train on the resulting multilingual data, which is called translate-training. This approach not only incurs high cost, but also results in poorly translated data due to the non-standard formatting of mathematical chain-of-thought. In this paper, we explore the benefits of question alignment, where we train the model to translate reasoning questions into English by finetuning on X-English parallel question data. In this way we perform targeted, in-domain language alignment which makes best use of English instruction data to unlock the LLMs' multilingual reasoning abilities. Experimental results on LLaMA2-13B show that question alignment leads to consistent improvements over the translate-training approach: an average improvement of 11.3% and 16.1% accuracy across ten languages on the MGSM and MSVAMP multilingual reasoning benchmarks. The project will be available at: https://github.com/NJUNLP/QAlign.
△ Less
Submitted 29 June, 2024; v1 submitted 15 January, 2024;
originally announced January 2024.
-
Efficient LLM inference solution on Intel GPU
Authors:
Hui Wu,
Yi Gan,
Feng Yuan,
Jing Ma,
Wei Zhu,
Yutao Xu,
Hong Zhu,
Yuhua Zhu,
Xiaoli Liu,
Jinghui Gu,
Peng Zhao
Abstract:
Transformer based Large Language Models (LLMs) have been widely used in many fields, and the efficiency of LLM inference becomes hot topic in real applications. However, LLMs are usually complicatedly designed in model structure with massive operations and perform inference in the auto-regressive mode, making it a challenging task to design a system with high efficiency.
In this paper, we propos…
▽ More
Transformer based Large Language Models (LLMs) have been widely used in many fields, and the efficiency of LLM inference becomes hot topic in real applications. However, LLMs are usually complicatedly designed in model structure with massive operations and perform inference in the auto-regressive mode, making it a challenging task to design a system with high efficiency.
In this paper, we propose an efficient LLM inference solution with low latency and high throughput. Firstly, we simplify the LLM decoder layer by fusing data movement and element-wise operations to reduce the memory access frequency and lower system latency. We also propose a segment KV cache policy to keep key/value of the request and response tokens in separate physical memory for effective device memory management, helping enlarge the runtime batch size and improve system throughput. A customized Scaled-Dot-Product-Attention kernel is designed to match our fusion policy based on the segment KV cache solution. We implement our LLM inference solution on Intel GPU and publish it publicly. Compared with the standard HuggingFace implementation, the proposed solution achieves up to 7x lower token latency and 27x higher throughput for some popular LLMs on Intel GPU.
△ Less
Submitted 23 June, 2024; v1 submitted 19 December, 2023;
originally announced January 2024.
-
The Dark Energy Survey Supernova Program: Cosmological Analysis and Systematic Uncertainties
Authors:
M. Vincenzi,
D. Brout,
P. Armstrong,
B. Popovic,
G. Taylor,
M. Acevedo,
R. Camilleri,
R. Chen,
T. M. Davis,
S. R. Hinton,
L. Kelsey,
R. Kessler,
J. Lee,
C. Lidman,
A. Möller,
H. Qu,
M. Sako,
B. Sanchez,
D. Scolnic,
M. Smith,
M. Sullivan,
P. Wiseman,
J. Asorey,
B. A. Bassett,
D. Carollo
, et al. (71 additional authors not shown)
Abstract:
We present the full Hubble diagram of photometrically-classified Type Ia supernovae (SNe Ia) from the Dark Energy Survey supernova program (DES-SN). DES-SN discovered more than 20,000 SN candidates and obtained spectroscopic redshifts of 7,000 host galaxies. Based on the light-curve quality, we select 1635 photometrically-identified SNe Ia with spectroscopic redshift 0.10$< z <$1.13, which is the…
▽ More
We present the full Hubble diagram of photometrically-classified Type Ia supernovae (SNe Ia) from the Dark Energy Survey supernova program (DES-SN). DES-SN discovered more than 20,000 SN candidates and obtained spectroscopic redshifts of 7,000 host galaxies. Based on the light-curve quality, we select 1635 photometrically-identified SNe Ia with spectroscopic redshift 0.10$< z <$1.13, which is the largest sample of supernovae from any single survey and increases the number of known $z>0.5$ supernovae by a factor of five. In a companion paper, we present cosmological results of the DES-SN sample combined with 194 spectroscopically-classified SNe Ia at low redshift as an anchor for cosmological fits. Here we present extensive modeling of this combined sample and validate the entire analysis pipeline used to derive distances. We show that the statistical and systematic uncertainties on cosmological parameters are $σ_{Ω_M,{\rm stat+sys}}^{Λ{\rm CDM}}=$0.017 in a flat $Λ$CDM model, and $(σ_{Ω_M},σ_w)_{\rm stat+sys}^{w{\rm CDM}}=$(0.082, 0.152) in a flat $w$CDM model. Combining the DES SN data with the highly complementary CMB measurements by Planck Collaboration (2020) reduces uncertainties on cosmological parameters by a factor of 4. In all cases, statistical uncertainties dominate over systematics. We show that uncertainties due to photometric classification make up less than 10% of the total systematic uncertainty budget. This result sets the stage for the next generation of SN cosmology surveys such as the Vera C. Rubin Observatory's Legacy Survey of Space and Time.
△ Less
Submitted 22 January, 2024; v1 submitted 5 January, 2024;
originally announced January 2024.
-
The Dark Energy Survey: Cosmology Results With ~1500 New High-redshift Type Ia Supernovae Using The Full 5-year Dataset
Authors:
DES Collaboration,
T. M. C. Abbott,
M. Acevedo,
M. Aguena,
A. Alarcon,
S. Allam,
O. Alves,
A. Amon,
F. Andrade-Oliveira,
J. Annis,
P. Armstrong,
J. Asorey,
S. Avila,
D. Bacon,
B. A. Bassett,
K. Bechtol,
P. H. Bernardinelli,
G. M. Bernstein,
E. Bertin,
J. Blazek,
S. Bocquet,
D. Brooks,
D. Brout,
E. Buckley-Geer,
D. L. Burke
, et al. (134 additional authors not shown)
Abstract:
We present cosmological constraints from the sample of Type Ia supernovae (SN Ia) discovered during the full five years of the Dark Energy Survey (DES) Supernova Program. In contrast to most previous cosmological samples, in which SN are classified based on their spectra, we classify the DES SNe using a machine learning algorithm applied to their light curves in four photometric bands. Spectroscop…
▽ More
We present cosmological constraints from the sample of Type Ia supernovae (SN Ia) discovered during the full five years of the Dark Energy Survey (DES) Supernova Program. In contrast to most previous cosmological samples, in which SN are classified based on their spectra, we classify the DES SNe using a machine learning algorithm applied to their light curves in four photometric bands. Spectroscopic redshifts are acquired from a dedicated follow-up survey of the host galaxies. After accounting for the likelihood of each SN being a SN Ia, we find 1635 DES SNe in the redshift range $0.10<z<1.13$ that pass quality selection criteria sufficient to constrain cosmological parameters. This quintuples the number of high-quality $z>0.5$ SNe compared to the previous leading compilation of Pantheon+, and results in the tightest cosmological constraints achieved by any SN data set to date. To derive cosmological constraints we combine the DES supernova data with a high-quality external low-redshift sample consisting of 194 SNe Ia spanning $0.025<z<0.10$. Using SN data alone and including systematic uncertainties we find $Ω_{\rm M}=0.352\pm 0.017$ in flat $Λ$CDM. Supernova data alone now require acceleration ($q_0<0$ in $Λ$CDM) with over $5σ$ confidence. We find $(Ω_{\rm M},w)=(0.264^{+0.074}_{-0.096},-0.80^{+0.14}_{-0.16})$ in flat $w$CDM. For flat $w_0w_a$CDM, we find $(Ω_{\rm M},w_0,w_a)=(0.495^{+0.033}_{-0.043},-0.36^{+0.36}_{-0.30},-8.8^{+3.7}_{-4.5})$. Including Planck CMB data, SDSS BAO data, and DES $3\times2$-point data gives $(Ω_{\rm M},w)=(0.321\pm0.007,-0.941\pm0.026)$. In all cases dark energy is consistent with a cosmological constant to within $\sim2σ$. In our analysis, systematic errors on cosmological parameters are subdominant compared to statistical errors; paving the way for future photometrically classified supernova analyses.
△ Less
Submitted 6 June, 2024; v1 submitted 5 January, 2024;
originally announced January 2024.
-
Dynamical excitations of one-dimensional Fulde-Ferrell pairing Fermi superfluid
Authors:
Peng Zou,
Huaisong Zhao,
Feng Yuan,
Shi-Guo Peng
Abstract:
We theoretically investigate a one-dimensional Fulde-Ferrell Fermi superfluid at a finite effective Zeeman field $h$, and study entire dynamical excitations related to density perturbation. By calculating the density dynamic structure factor, we find anisotropic dynamical excitations in both collective modes and single-particle excitations. Along the direction of centre-of-mass momentum $p$, there…
▽ More
We theoretically investigate a one-dimensional Fulde-Ferrell Fermi superfluid at a finite effective Zeeman field $h$, and study entire dynamical excitations related to density perturbation. By calculating the density dynamic structure factor, we find anisotropic dynamical excitations in both collective modes and single-particle excitations. Along the direction of centre-of-mass momentum $p$, there are two obvious gapless collective modes with different speed. The lower collective modes is from the usual gauge symmetry breaking and has a larger speed than the one in the negative direction of $p$. The higher one is due to the direction spontaneous symmetry breaking of centre-of-mass momentum $p$, and separates two kinds of single-particle excitations in the positive $p$ direction. However, this higher mode disappears in the opposite direction of $p$, where two single-particle excitations overlap with each other. These signals of dynamical excitations can do help to distinguish Fulde-Ferrell superfluid from the conventional Bardeen-Cooper-Schrieffer superfluid in the future experiment.
△ Less
Submitted 4 January, 2024;
originally announced January 2024.
-
Multi-Modality is All You Need for Transferable Recommender Systems
Authors:
Youhua Li,
Hanwen Du,
Yongxin Ni,
Pengpeng Zhao,
Qi Guo,
Fajie Yuan,
Xiaofang Zhou
Abstract:
ID-based Recommender Systems (RecSys), where each item is assigned a unique identifier and subsequently converted into an embedding vector, have dominated the designing of RecSys. Though prevalent, such ID-based paradigm is not suitable for developing transferable RecSys and is also susceptible to the cold-start issue. In this paper, we unleash the boundaries of the ID-based paradigm and propose a…
▽ More
ID-based Recommender Systems (RecSys), where each item is assigned a unique identifier and subsequently converted into an embedding vector, have dominated the designing of RecSys. Though prevalent, such ID-based paradigm is not suitable for developing transferable RecSys and is also susceptible to the cold-start issue. In this paper, we unleash the boundaries of the ID-based paradigm and propose a Pure Multi-Modality based Recommender system (PMMRec), which relies solely on the multi-modal contents of the items (e.g., texts and images) and learns transition patterns general enough to transfer across domains and platforms. Specifically, we design a plug-and-play framework architecture consisting of multi-modal item encoders, a fusion module, and a user encoder. To align the cross-modal item representations, we propose a novel next-item enhanced cross-modal contrastive learning objective, which is equipped with both inter- and intra-modality negative samples and explicitly incorporates the transition patterns of user behaviors into the item encoders. To ensure the robustness of user representations, we propose a novel noised item detection objective and a robustness-aware contrastive learning objective, which work together to denoise user sequences in a self-supervised manner. PMMRec is designed to be loosely coupled, so after being pre-trained on the source data, each component can be transferred alone, or in conjunction with other components, allowing PMMRec to achieve versatility under both multi-modality and single-modality transfer learning settings. Extensive experiments on 4 sources and 10 target datasets demonstrate that PMMRec surpasses the state-of-the-art recommenders in both recommendation performance and transferability. Our code and dataset is available at: https://github.com/ICDE24/PMMRec.
△ Less
Submitted 18 December, 2023; v1 submitted 15 December, 2023;
originally announced December 2023.
-
The Hubble Deep Hydrogen Alpha (HDH$α$) Project: I. Catalog of Emission-line Galaxies
Authors:
Shuairu Zhu,
Zhen-Ya Zheng,
James Rhoads,
Junxian Wang,
Linhua Jiang,
Chunyan Jiang,
Fang-Ting Yuan,
P. T. Rahna,
Weida Hu,
Ruqiu Lin,
Huanyuan Shan,
Chun Xu,
Leopoldo Infante,
L. Felipe Barrientos,
Xianzhong Zheng,
Guanwen Fang,
Zhixiong Liang
Abstract:
We present the first results of the Hubble Deep Hydrogen Alpha (HDH$α$) project, which analyzes the space-borne deep H$α$ narrowband imaging data in the GOODS-S region. The HDH$α$ data comprises 72 orbits' images taken with the HST ACS/WFC F658N filter. The exposure time varies across a total area of $\sim$76.1 $\rm{arcmin}^2$, adding up to a total exposure time of 195.7 ks, among which 68.8 ks ar…
▽ More
We present the first results of the Hubble Deep Hydrogen Alpha (HDH$α$) project, which analyzes the space-borne deep H$α$ narrowband imaging data in the GOODS-S region. The HDH$α$ data comprises 72 orbits' images taken with the HST ACS/WFC F658N filter. The exposure time varies across a total area of $\sim$76.1 $\rm{arcmin}^2$, adding up to a total exposure time of 195.7 ks, among which 68.8 ks are spent in the deepest region. These images are aligned, reprojected, and combined to have the same pixel grid as the Hubble Legacy Fields (HLF). The scientific goals of the HDH$α$ include establishing a sample of emission-line galaxies (ELGs) including [O III] emitters at $z\sim$ 0.3, [O II] emitters at $z\sim$ 0.8, and Lyman-$α$ emitters (LAEs) at $z \sim 4.4$, studying the line morphology of ELGs with high resolution imaging data, and statistically analyzing the line luminosity functions and line equivalent-width distributions of ELGs selected with HST. Furthermore, the HDH$α$ project enhances the legacy value of the GOODS-S field by contributing the first HST-based narrowband image to the existing data sets, which includes the HST broadband data and other ancillary data from X-ray to radio taken by other facilities. In this paper, we describe the data reduction process of the HDH$α$, select ELGs based on HST's F658N and broadband data, validate the redshifts of the selected candidates by cross matching with the public spectroscopic catalogs in the GOODS-S, and present a final catalog of the confirmed [O III] emitters at $z\sim$ 0.3, [O II] emitters at $z\sim$ 0.8, and LAEs at $z \sim 4.4$.
△ Less
Submitted 11 December, 2023;
originally announced December 2023.
-
Explore the Nucleon Tomography through Di-hadron Correlation in Opposite Hemisphere in Deep Inelastic Scattering
Authors:
Yuxun Guo,
Feng Yuan
Abstract:
We investigate the correlation of di-hadron productions between the current fragmentation region (CFR) and target fragmentation region (TFR) in deep inelastic scattering as a probe of the nucleon tomography. The QCD factorization and powering counting method are applied to compute the relevant diffractive parton distribution functions in the valence region. In particular, we show that the final st…
▽ More
We investigate the correlation of di-hadron productions between the current fragmentation region (CFR) and target fragmentation region (TFR) in deep inelastic scattering as a probe of the nucleon tomography. The QCD factorization and powering counting method are applied to compute the relevant diffractive parton distribution functions in the valence region. In particular, we show that the final state interaction effects lead to a nonzero longitudinal polarized quark distribution associated with the unpolarized nucleon target. This explains the observed beam single spin asymmetry (BSA) from a recent Jefferson Lab experiment. We further show that the BSA in the single diffractive hadron productions in the TFR, although kinematically suppressed, also exists because of the final state interaction effects.
△ Less
Submitted 1 December, 2023;
originally announced December 2023.
-
Hypergraph Node Representation Learning with One-Stage Message Passing
Authors:
Shilin Qu,
Weiqing Wang,
Yuan-Fang Li,
Xin Zhou,
Fajie Yuan
Abstract:
Hypergraphs as an expressive and general structure have attracted considerable attention from various research domains. Most existing hypergraph node representation learning techniques are based on graph neural networks, and thus adopt the two-stage message passing paradigm (i.e. node -> hyperedge -> node). This paradigm only focuses on local information propagation and does not effectively take i…
▽ More
Hypergraphs as an expressive and general structure have attracted considerable attention from various research domains. Most existing hypergraph node representation learning techniques are based on graph neural networks, and thus adopt the two-stage message passing paradigm (i.e. node -> hyperedge -> node). This paradigm only focuses on local information propagation and does not effectively take into account global information, resulting in less optimal representations. Our theoretical analysis of representative two-stage message passing methods shows that, mathematically, they model different ways of local message passing through hyperedges, and can be unified into one-stage message passing (i.e. node -> node). However, they still only model local information. Motivated by this theoretical analysis, we propose a novel one-stage message passing paradigm to model both global and local information propagation for hypergraphs. We integrate this paradigm into HGraphormer, a Transformer-based framework for hypergraph node representation learning. HGraphormer injects the hypergraph structure information (local information) into Transformers (global information) by combining the attention matrix and hypergraph Laplacian. Extensive experiments demonstrate that HGraphormer outperforms recent hypergraph learning methods on five representative benchmark datasets on the semi-supervised hypernode classification task, setting new state-of-the-art performance, with accuracy improvements between 2.52% and 6.70%. Our code and datasets are available.
△ Less
Submitted 30 November, 2023;
originally announced December 2023.