Showing 151–200 of 3,784 results for author: Liu, B

EasyAnimate: A High-Performance Long Video Generation Method based on Transformer Architecture

Authors: Jiaqi Xu, Xinyi Zou, Kunzhe Huang, Yunkuo Chen, Bo Liu, MengLi Cheng, Xing Shi, Jun Huang

Abstract: This paper presents EasyAnimate, an advanced method for video generation that leverages the power of transformer architecture for high-performance outcomes. We have expanded the DiT framework originally designed for 2D image synthesis to accommodate the complexities of 3D video generation by incorporating a motion module block. It is used to capture temporal dynamics, thereby ensuring the producti… ▽ More This paper presents EasyAnimate, an advanced method for video generation that leverages the power of transformer architecture for high-performance outcomes. We have expanded the DiT framework originally designed for 2D image synthesis to accommodate the complexities of 3D video generation by incorporating a motion module block. It is used to capture temporal dynamics, thereby ensuring the production of consistent frames and seamless motion transitions. The motion module can be adapted to various DiT baseline methods to generate video with different styles. It can also generate videos with different frame rates and resolutions during both training and inference phases, suitable for both images and videos. Moreover, we introduce slice VAE, a novel approach to condense the temporal axis, facilitating the generation of long duration videos. Currently, EasyAnimate exhibits the proficiency to generate videos with 144 frames. We provide a holistic ecosystem for video production based on DiT, encompassing aspects such as data pre-processing, VAE training, DiT models training (both the baseline model and LoRA model), and end-to-end video inference. Code is available at: https://github.com/aigc-apps/EasyAnimate. We are continuously working to enhance the performance of our method. △ Less

Submitted 5 July, 2024; v1 submitted 29 May, 2024; originally announced May 2024.

Comments: 8 pages, 6 figures

On anti-tempered local Arthur packets and a lemma of Arthur

Authors: Baiying Liu, Chi-Heng Lo, Freydoon Shahidi

Abstract: In this paper, following Arthur's ideas, we rework the process of constructing the anti-tempered local Arthur packets for quasi-split classical groups and their pure inner forms. In particular, we present explicit examples illustrating certain gap in a consequential lemma of Arthur and provide a uniform modification, based on the work of Moeglin, Waldspurger, and Xu. In this paper, following Arthur's ideas, we rework the process of constructing the anti-tempered local Arthur packets for quasi-split classical groups and their pure inner forms. In particular, we present explicit examples illustrating certain gap in a consequential lemma of Arthur and provide a uniform modification, based on the work of Moeglin, Waldspurger, and Xu. △ Less

Submitted 20 August, 2024; v1 submitted 27 May, 2024; originally announced May 2024.

Comments: Added Section 8, for more details. Comments are welcome

CLAQ: Pushing the Limits of Low-Bit Post-Training Quantization for LLMs

Authors: Haoyu Wang, Bei Liu, Hang Shao, Bo Xiao, Ke Zeng, Guanglu Wan, Yanmin Qian

Abstract: Parameter quantization for Large Language Models (LLMs) has attracted increasing attentions recently in reducing memory costs and improving computational efficiency. Early approaches have been widely adopted. However, the existing methods suffer from poor performance in low-bit (such as 2 to 3 bits) scenarios. In this paper, we present a novel and effective Column-Level Adaptive weight Quantizatio… ▽ More Parameter quantization for Large Language Models (LLMs) has attracted increasing attentions recently in reducing memory costs and improving computational efficiency. Early approaches have been widely adopted. However, the existing methods suffer from poor performance in low-bit (such as 2 to 3 bits) scenarios. In this paper, we present a novel and effective Column-Level Adaptive weight Quantization (CLAQ) framework by introducing three different types of adaptive strategies for LLM quantization. Firstly, a K-Means clustering based algorithm is proposed that allows dynamic generation of quantization centroids for each column of a parameter matrix. Secondly, we design an outlier-guided adaptive precision search strategy which can dynamically assign varying bit-widths to different columns. Finally, a dynamic outlier reservation scheme is developed to retain some parameters in their original float point precision, in trade off of boosted model performance. Experiments on various mainstream open source LLMs including LLaMA-1, LLaMA-2 and Yi demonstrate that our methods achieve the state-of-the-art results across different bit settings, especially in extremely low-bit scenarios. Code is available at https://github.com/fayuge/CLAQ. △ Less

Submitted 2 June, 2024; v1 submitted 27 May, 2024; originally announced May 2024.

Iteration problem for several chaos in non-autonomous discrete system

Authors: Hongbo Zeng, Chuangxia Huang, Bingwen Liu

Abstract: In this paper we investigate the iteration problem for several chaos in non-autonomous discrete system. Firstly, we prove that the Li-Yorke chaos of a non-autonomous discrete dynamical system is preserved under iterations when $f_{1,\infty}$ converges to $f$, which weakens the condition in the literature that $f_{1,\infty}$ uniformly converges to $f$. Besides, we prove that both DC2' and Kato's ch… ▽ More In this paper we investigate the iteration problem for several chaos in non-autonomous discrete system. Firstly, we prove that the Li-Yorke chaos of a non-autonomous discrete dynamical system is preserved under iterations when $f_{1,\infty}$ converges to $f$, which weakens the condition in the literature that $f_{1,\infty}$ uniformly converges to $f$. Besides, we prove that both DC2' and Kato's chaos of a non-autonomous discrete dynamical system are iteration invariants. Additionally, we give a sufficient condition for non-autonomous discrete dynamical system to be Li-Yorke chaos. Finally, we give an example to show that the DC3 of a non-autonomous discrete dynamical system is not inherited under iterations, which partly answers an open question proposed by Wu and Zhu(Chaos in a class of non-autonomous discrete systems, Appl.Math.Lett. 2013,26:431-436). △ Less

Submitted 27 May, 2024; originally announced May 2024.

Bounding the Dehn surgery number by 10/8

Authors: Beibei Liu, Lisa Piccirillo

Abstract: We provide new examples of 3-manifolds with weight one fundamental group and the same integral homology as the lens space $L(2k,1)$ which are not surgery on any knot in the three-sphere. Our argument uses Furuta's 10/8-theorem, and is simple and combinatorial to apply. We provide new examples of 3-manifolds with weight one fundamental group and the same integral homology as the lens space $L(2k,1)$ which are not surgery on any knot in the three-sphere. Our argument uses Furuta's 10/8-theorem, and is simple and combinatorial to apply. △ Less

Submitted 27 May, 2024; originally announced May 2024.

Comments: 8 pages and comments are welcome!

MSC Class: 57K10; 57K30; 57K40

Provably Mitigating Overoptimization in RLHF: Your SFT Loss is Implicitly an Adversarial Regularizer

Authors: Zhihan Liu, Miao Lu, Shenao Zhang, Boyi Liu, Hongyi Guo, Yingxiang Yang, Jose Blanchet, Zhaoran Wang

Abstract: Aligning generative models with human preference via RLHF typically suffers from overoptimization, where an imperfectly learned reward model can misguide the generative model to output undesired responses. We investigate this problem in a principled manner by identifying the source of the misalignment as a form of distributional shift and uncertainty in learning human preferences. To mitigate over… ▽ More Aligning generative models with human preference via RLHF typically suffers from overoptimization, where an imperfectly learned reward model can misguide the generative model to output undesired responses. We investigate this problem in a principled manner by identifying the source of the misalignment as a form of distributional shift and uncertainty in learning human preferences. To mitigate overoptimization, we first propose a theoretical algorithm that chooses the best policy for an adversarially chosen reward model; one that simultaneously minimizes the maximum likelihood estimation of the loss and a reward penalty term. Here, the reward penalty term is introduced to prevent the policy from choosing actions with spurious high proxy rewards, resulting in provable sample efficiency of the algorithm under a partial coverage style condition. Moving from theory to practice, the proposed algorithm further enjoys an equivalent but surprisingly easy-to-implement reformulation. Using the equivalence between reward models and the corresponding optimal policy, the algorithm features a simple objective that combines: (i) a preference optimization loss that directly aligns the policy with human preference, and (ii) a supervised learning loss that explicitly imitates the policy with a (suitable) baseline distribution. In the context of aligning large language models (LLM), this objective fuses the direct preference optimization (DPO) loss with the supervised fune-tuning (SFT) loss to help mitigate the overoptimization towards undesired responses, for which we name the algorithm Regularized Preference Optimization (RPO). Experiments of aligning LLMs demonstrate the improved performance of RPO compared with DPO baselines. Our work sheds light on the interplay between preference optimization and SFT in tuning LLMs with both theoretical guarantees and empirical evidence. △ Less

Submitted 26 May, 2024; originally announced May 2024.

Comments: 27 pages, 7 figures

Complexity of Multiple-Hamiltonicity in Graphs of Bounded Degree

Authors: Brian Liu, Nathan S. Sheffield, Alek Westover

Abstract: We study the following generalization of the Hamiltonian cycle problem: Given integers $a,b$ and graph $G$, does there exist a closed walk in $G$ that visits every vertex at least $a$ times and at most $b$ times? Equivalently, does there exist a connected $[2a,2b]$ factor of $2b \cdot G$ with all degrees even? This problem is NP-hard for any constants $1 \leq a \leq b$. However, the graphs produce… ▽ More We study the following generalization of the Hamiltonian cycle problem: Given integers $a,b$ and graph $G$, does there exist a closed walk in $G$ that visits every vertex at least $a$ times and at most $b$ times? Equivalently, does there exist a connected $[2a,2b]$ factor of $2b \cdot G$ with all degrees even? This problem is NP-hard for any constants $1 \leq a \leq b$. However, the graphs produced by known reductions have maximum degree growing linearly in $b$. The case $a = b = 1 $ -- i.e. Hamiltonicity -- remains NP-hard even in $3$-regular graphs; a natural question is whether this is true for other $a$, $b$. In this work, we study which $a, b$ permit polynomial time algorithms and which lead to NP-hardness in graphs with constrained degrees. We give tight characterizations for regular graphs and graphs of bounded max-degree, both directed and undirected. △ Less

Submitted 25 May, 2024; originally announced May 2024.

Comments: 16 pages

Accelerating Inference of Retrieval-Augmented Generation via Sparse Context Selection

Authors: Yun Zhu, Jia-Chen Gu, Caitlin Sikora, Ho Ko, Yinxiao Liu, Chu-Cheng Lin, Lei Shu, Liangchen Luo, Lei Meng, Bang Liu, Jindong Chen

Abstract: Large language models (LLMs) augmented with retrieval exhibit robust performance and extensive versatility by incorporating external contexts. However, the input length grows linearly in the number of retrieved documents, causing a dramatic increase in latency. In this paper, we propose a novel paradigm named Sparse RAG, which seeks to cut computation costs through sparsity. Specifically, Sparse R… ▽ More Large language models (LLMs) augmented with retrieval exhibit robust performance and extensive versatility by incorporating external contexts. However, the input length grows linearly in the number of retrieved documents, causing a dramatic increase in latency. In this paper, we propose a novel paradigm named Sparse RAG, which seeks to cut computation costs through sparsity. Specifically, Sparse RAG encodes retrieved documents in parallel, which eliminates latency introduced by long-range attention of retrieved documents. Then, LLMs selectively decode the output by only attending to highly relevant caches auto-regressively, which are chosen via prompting LLMs with special control tokens. It is notable that Sparse RAG combines the assessment of each individual document and the generation of the response into a single process. The designed sparse mechanism in a RAG system can facilitate the reduction of the number of documents loaded during decoding for accelerating the inference of the RAG system. Additionally, filtering out undesirable contexts enhances the model's focus on relevant context, inherently improving its generation quality. Evaluation results of two datasets show that Sparse RAG can strike an optimal balance between generation quality and computational efficiency, demonstrating its generalizability across both short- and long-form generation tasks. △ Less

Submitted 25 May, 2024; originally announced May 2024.

Well-posedness and invariant measures for the stochastically perturbed Landau-Lifshitz-Baryakhtar equation

Authors: Fan Xu, Lei Zhang, Bin Liu

Abstract: In this paper, we study the initial-boundary value problem for the stochastic Landau-Lifshitz-Baryakhtar (SLLBar) equation with Stratonovich-type noise in bounded domains $\mathcal{O}\subset\mathbb{R}^d$, $d=1,2,3$. Our main results can be briefly described as follows: (1) for $d=1,2,3$ and any $\mathbf{u}_0\in\mathbb{H}^1$, the SLLBar equation admits a unique local-in-time pathwise weak solution;… ▽ More In this paper, we study the initial-boundary value problem for the stochastic Landau-Lifshitz-Baryakhtar (SLLBar) equation with Stratonovich-type noise in bounded domains $\mathcal{O}\subset\mathbb{R}^d$, $d=1,2,3$. Our main results can be briefly described as follows: (1) for $d=1,2,3$ and any $\mathbf{u}_0\in\mathbb{H}^1$, the SLLBar equation admits a unique local-in-time pathwise weak solution; (2) for $d=1$ and small-data $\mathbf{u}_0\in\mathbb{H}^1$, the SLLBar equation has a unique global-in-time pathwise weak solution and at least one invariant measure; (3) for $d=1,2$ and small-data $\mathbf{u}_0\in\mathbb{L}^2$, the SLLBar equation possesses a unique global-in-time pathwise very weak solution and at least one invariant measure, while for $d=3$ only the existence of martingale solution is obtained due to the loss of pathwise uniqueness. △ Less

Submitted 12 August, 2024; v1 submitted 24 May, 2024; originally announced May 2024.

Unraveling the dust activity of naked-eye comet C/2022 E3 (ZTF)

Authors: Bin Liu, Xiaodong Liu

Abstract: A morphological and photometric analysis of the naked-eye long-period comet C/2022 E3 (ZTF) before perihelion is presented in this study. The observation images taken by the Zwicky Transient Facility survey telescope from July 2022 to October 2022 show a gradually brightening dust coma and a tail with a clear structure. The morphology of the dust coma reveals nonsteady-state emission with an eject… ▽ More A morphological and photometric analysis of the naked-eye long-period comet C/2022 E3 (ZTF) before perihelion is presented in this study. The observation images taken by the Zwicky Transient Facility survey telescope from July 2022 to October 2022 show a gradually brightening dust coma and a tail with a clear structure. The morphology of the dust coma reveals nonsteady-state emission with an ejection velocity lower than 14 m s$^{-1}$ for particles larger than 100 um. According to the syndyne-synchrone analysis, dust particles larger than about 10 um contribute significantly to the observed tail. The model simulations of the 10 October 2022 image suggest that the radii of large particles lingering near the nucleus range from 0.1 mm to 1 mm. Assuming that the nucleus of comet E3 is a homogeneous sphere with an albedo of 0.1, the photometry analysis sets the lower and upper limits of the nucleus radius to be $0.81\pm0.07$ km and $2.79\pm0.01$ km, respectively. The dust production rates increased continuously from $241\pm3$ kg s$^{-1}$ in July to $476\pm9$ kg s$^{-1}$ in October. The dependence of the ejection velocity $v_{\perp}$ perpendicular to the orbital plane of comet E3 on the particle size $a$ can be simplified as $v_{\perp}\propto a^{-1/2}$, which indicates that the dust emission is likely driven by gas. The water-production rate is inferred as $\sim 368\pm72$ kg s$^{-1}$ in October 2022, which is sustained by an equilibrium-sublimating area of $8.2\times10^6$ m$^2$ at least. The comparative analysis of the characteristics of comet E3 with those of comets belonging to different types shows that the activity profile of long-period comet E3 surprisingly aligns more closely with those of short-period comets within a heliocentric distance range of about [1.7, 3.4] AU, where the images of comet E3 that we used in this study were taken. △ Less

Submitted 24 May, 2024; originally announced May 2024.

DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Data

Authors: Huajian Xin, Daya Guo, Zhihong Shao, Zhizhou Ren, Qihao Zhu, Bo Liu, Chong Ruan, Wenda Li, Xiaodan Liang

Abstract: Proof assistants like Lean have revolutionized mathematical proof verification, ensuring high accuracy and reliability. Although large language models (LLMs) show promise in mathematical reasoning, their advancement in formal theorem proving is hindered by a lack of training data. To address this issue, we introduce an approach to generate extensive Lean 4 proof data derived from high-school and u… ▽ More Proof assistants like Lean have revolutionized mathematical proof verification, ensuring high accuracy and reliability. Although large language models (LLMs) show promise in mathematical reasoning, their advancement in formal theorem proving is hindered by a lack of training data. To address this issue, we introduce an approach to generate extensive Lean 4 proof data derived from high-school and undergraduate-level mathematical competition problems. This approach involves translating natural language problems into formal statements, filtering out low-quality statements, and generating proofs to create synthetic data. After fine-tuning the DeepSeekMath 7B model on this synthetic dataset, which comprises 8 million formal statements with proofs, our model achieved whole-proof generation accuracies of 46.3% with 64 samples and 52% cumulatively on the Lean 4 miniF2F test, surpassing the baseline GPT-4 at 23.0% with 64 samples and a tree search reinforcement learning method at 41.0%. Additionally, our model successfully proved 5 out of 148 problems in the Lean 4 Formalized International Mathematical Olympiad (FIMO) benchmark, while GPT-4 failed to prove any. These results demonstrate the potential of leveraging large-scale synthetic data to enhance theorem-proving capabilities in LLMs. Both the synthetic dataset and the model will be made available to facilitate further research in this promising field. △ Less

Submitted 23 May, 2024; originally announced May 2024.

Study of the decays $χ_{cJ}\toΛ\barΛω$

Authors: BESIII Collaboration, M. Ablikim, M. N. Achasov, P. Adlarson, O. Afedulidis, X. C. Ai, R. Aliberti, A. Amoroso, Q. An, Y. Bai, O. Bakina, I. Balossino, Y. Ban, H. -R. Bao, V. Batozskaya, K. Begzsuren, N. Berger, M. Berlowski, M. Bertani, D. Bettoni, F. Bianchi, E. Bianco, A. Bortone, I. Boyko, R. A. Briere , et al. (638 additional authors not shown)

Abstract: Using $(27.12\pm 0.14)\times10^{8}$ $ψ(3686)$ events collected with the BESIII detector, we present the first observation of the decays $χ_{cJ}\toΛ\barΛω$, where $J=0, 1, 2$, with statistical significances of $11.7 σ, 11.2 σ$, and $11.8 σ$. The branching fractions of these decays are determined to be $\mathcal{B}(χ_{c0}\toΛ\barΛω)=({2.37 \pm 0.22 \pm 0.23}) \times 10^{-4}$,… ▽ More Using $(27.12\pm 0.14)\times10^{8}$ $ψ(3686)$ events collected with the BESIII detector, we present the first observation of the decays $χ_{cJ}\toΛ\barΛω$, where $J=0, 1, 2$, with statistical significances of $11.7 σ, 11.2 σ$, and $11.8 σ$. The branching fractions of these decays are determined to be $\mathcal{B}(χ_{c0}\toΛ\barΛω)=({2.37 \pm 0.22 \pm 0.23}) \times 10^{-4}$, $\mathcal{B}(χ_{c1}\toΛ\barΛω)=({1.01 \pm 0.10 \pm 0.11}) \times 10^{-4}$, and $\mathcal{B}(χ_{c2}\toΛ\barΛω)=({1.40 \pm 0.13 \pm 0.17}) \times 10^{-4}$, where the first uncertainties are statistical and the second are systematic. We observe no clear intermediate structures. △ Less

Submitted 21 May, 2024; originally announced May 2024.

Comments: 11 pages, 10 figures

Assessing Proton-Boron Fusion Feasibility under non-Thermal Equilibrium Conditions: Rider's Inhibition Revisited

Authors: S. J. Liu, D. Wu, B. Liu, Y. -K. M. Peng, J. Q. Dong, T. Y. Liang, Z. M. Sheng

Abstract: Compared to the D-T reaction, the neutron-free proton-boron (p-$^{11}$B) fusion has garnered increasing attention in recent years. However, significant Bremsstrahlung losses pose a formidable challenge in p-$^{11}$B plasmas in achieving $Q>1$ in thermal equilibrium. The primary aim of this study is to corroborate Todd H. Rider's seminal work in the 1997 Physics of Plasmas, who investigated the fea… ▽ More Compared to the D-T reaction, the neutron-free proton-boron (p-$^{11}$B) fusion has garnered increasing attention in recent years. However, significant Bremsstrahlung losses pose a formidable challenge in p-$^{11}$B plasmas in achieving $Q>1$ in thermal equilibrium. The primary aim of this study is to corroborate Todd H. Rider's seminal work in the 1997 Physics of Plasmas, who investigated the feasibility of sustaining p-$^{11}$B fusion under non-thermal equilibrium conditions. Employing a series of simulations with new fusion cross-section, we assessed the minimum recirculating power that must be recycled to maintain the system's non-thermal equilibrium and found that it is substantially greater than the fusion power output, aligning with Rider's conclusions, whether under the conditions of non-Maxwellian electron distribution or Maxwellian electron distribution, reactors reliant on non-equilibrium plasmas for p-$^{11}$B fusion are unlikely to achieve net power production without the aid of highly efficient external heat engines. However, maintaining the ion temperature at 300 keV and the Coulomb logarithm at 15, while increasing the electron temperature beyond 23.33 keV set by Rider, leads to diminished electron-ion energy transfer and heightened Bremsstrahlung radiation. When the electron temperature approaches approximately 140 keV, this progression ultimately leads to a scenario where the power of Bremsstrahlung loss equals the power of electron-ion interactions, yet remains inferior to the fusion power. Consequently, this results in a net gain in energy production. △ Less

Submitted 21 May, 2024; originally announced May 2024.

Can Github issues be solved with Tree Of Thoughts?

Authors: Ricardo La Rosa, Corey Hulse, Bangdi Liu

Abstract: While there have been extensive studies in code generation by large language models (LLM), where benchmarks like HumanEval have been surpassed with an impressive 96.3% success rate, these benchmarks predominantly judge a model's performance on basic function-level code generation and lack the critical thinking and concept of scope required of real-world scenarios such as solving GitHub issues. Thi… ▽ More While there have been extensive studies in code generation by large language models (LLM), where benchmarks like HumanEval have been surpassed with an impressive 96.3% success rate, these benchmarks predominantly judge a model's performance on basic function-level code generation and lack the critical thinking and concept of scope required of real-world scenarios such as solving GitHub issues. This research introduces the application of the Tree of Thoughts (ToT) language model reasoning framework for enhancing the decision-making and problem-solving abilities of LLMs for this complex task. Compared to traditional input-output (IO) prompting and Retrieval Augmented Generation (RAG) techniques, ToT is designed to improve performance by facilitating a structured exploration of multiple reasoning trajectories and enabling self-assessment of potential solutions. We experimentally deploy ToT in tackling a Github issue contained within an instance of the SWE-bench. However, our results reveal that the ToT framework alone is not enough to give LLMs the critical reasoning capabilities to outperform existing methods. In this paper we analyze the potential causes of these shortcomings and identify key areas for improvement such as deepening the thought process and introducing agentic capabilities. The insights of this research are aimed at informing future directions for refining the application of ToT and better harnessing the potential of LLMs in real-world problem-solving scenarios. △ Less

Submitted 20 May, 2024; originally announced May 2024.

Comments: 8 pages, 2 figures, 7 tables

Precision measurement of the branching fraction of \boldmath $J/ψ\rightarrow K^+K^-$ via $ψ(2S)\rightarrow π^+π^-J/ψ$

Authors: BESIII Collaboration, M. Ablikim, M. N. Achasov, P. Adlarson, X. C. Ai, R. Aliberti, A. Amoroso, M. R. An, Q. An, Y. Bai, O. Bakina, I. Balossino, Y. Ban, H. -R. Bao, V. Batozskaya, K. Begzsuren, N. Berger, M. Berlowski, M. Bertani, D. Bettoni, F. Bianchi, E. Bianco, A. Bortone, I. Boyko, R. A. Briere , et al. (604 additional authors not shown)

Abstract: Using a sample of $448.1 \times 10^6$ $ψ(2S)$ events collected with the BESIII detector, we perform a study of the decay $J/ψ\rightarrow K^+K^-$ via $ψ(2S)\rightarrow π^+π^-J/ψ$. The branching fraction of $J/ψ\rightarrow K^+K^-$ is determined to be $\mathcal{B}_{K^+K^-}=(3.072\pm 0.023({\rm stat.})\pm 0.050({\rm syst.}))\times 10^{-4}$, which is consistent with previous measurements but with sig… ▽ More Using a sample of $448.1 \times 10^6$ $ψ(2S)$ events collected with the BESIII detector, we perform a study of the decay $J/ψ\rightarrow K^+K^-$ via $ψ(2S)\rightarrow π^+π^-J/ψ$. The branching fraction of $J/ψ\rightarrow K^+K^-$ is determined to be $\mathcal{B}_{K^+K^-}=(3.072\pm 0.023({\rm stat.})\pm 0.050({\rm syst.}))\times 10^{-4}$, which is consistent with previous measurements but with significantly improved precision. △ Less

Submitted 21 May, 2024; originally announced May 2024.

Comments: to be submitted to PRD

Quantum droplets in dipolar condensate mixtures with arbitrary dipole orientations

Authors: Liang-Jun He, Bo Liu, Yong-Chang Zhang

Abstract: Through considering a two-component dipolar Bose-Einstein condensate, we investigate the influence of the angle between the polarization orientations of the two species on the ground states, and show that the miscibility between the two components can be adjusted not only by the inter-component contact interaction but also by the polarization angle. Particularly, in the presence of an external con… ▽ More Through considering a two-component dipolar Bose-Einstein condensate, we investigate the influence of the angle between the polarization orientations of the two species on the ground states, and show that the miscibility between the two components can be adjusted not only by the inter-component contact interaction but also by the polarization angle. Particularly, in the presence of an external confinement, the two species exhibit a preference for splitting into multiple droplets separated from each other in the immiscible regime, featuring a zig-zag like profile. Furthermore, the number of separated droplets depends solely on the polarization angle. This introduces a promising degree of freedom for exploring emergent states of matter in dipolar quantum gases. △ Less

Submitted 21 May, 2024; originally announced May 2024.

Comments: 9 figures

Context-Enhanced Video Moment Retrieval with Large Language Models

Authors: Weijia Liu, Bo Miao, Jiuxin Cao, Xuelin Zhu, Bo Liu, Mehwish Nasim, Ajmal Mian

Abstract: Current methods for Video Moment Retrieval (VMR) struggle to align complex situations involving specific environmental details, character descriptions, and action narratives. To tackle this issue, we propose a Large Language Model-guided Moment Retrieval (LMR) approach that employs the extensive knowledge of Large Language Models (LLMs) to improve video context representation as well as cross-moda… ▽ More Current methods for Video Moment Retrieval (VMR) struggle to align complex situations involving specific environmental details, character descriptions, and action narratives. To tackle this issue, we propose a Large Language Model-guided Moment Retrieval (LMR) approach that employs the extensive knowledge of Large Language Models (LLMs) to improve video context representation as well as cross-modal alignment, facilitating accurate localization of target moments. Specifically, LMR introduces a context enhancement technique with LLMs to generate crucial target-related context semantics. These semantics are integrated with visual features for producing discriminative video representations. Finally, a language-conditioned transformer is designed to decode free-form language queries, on the fly, using aligned video representations for moment retrieval. Extensive experiments demonstrate that LMR achieves state-of-the-art results, outperforming the nearest competitor by up to 3.28\% and 4.06\% on the challenging QVHighlights and Charades-STA benchmarks, respectively. More importantly, the performance gains are significantly higher for localization of complex queries. △ Less

Submitted 21 May, 2024; originally announced May 2024.

3DSS-Mamba: 3D-Spectral-Spatial Mamba for Hyperspectral Image Classification

Authors: Yan He, Bing Tu, Bo Liu, Jun Li, Antonio Plaza

Abstract: Hyperspectral image (HSI) classification constitutes the fundamental research in remote sensing fields. Convolutional Neural Networks (CNNs) and Transformers have demonstrated impressive capability in capturing spectral-spatial contextual dependencies. However, these architectures suffer from limited receptive fields and quadratic computational complexity, respectively. Fortunately, recent Mamba a… ▽ More Hyperspectral image (HSI) classification constitutes the fundamental research in remote sensing fields. Convolutional Neural Networks (CNNs) and Transformers have demonstrated impressive capability in capturing spectral-spatial contextual dependencies. However, these architectures suffer from limited receptive fields and quadratic computational complexity, respectively. Fortunately, recent Mamba architectures built upon the State Space Model integrate the advantages of long-range sequence modeling and linear computational efficiency, exhibiting substantial potential in low-dimensional scenarios. Motivated by this, we propose a novel 3D-Spectral-Spatial Mamba (3DSS-Mamba) framework for HSI classification, allowing for global spectral-spatial relationship modeling with greater computational efficiency. Technically, a spectral-spatial token generation (SSTG) module is designed to convert the HSI cube into a set of 3D spectral-spatial tokens. To overcome the limitations of traditional Mamba, which is confined to modeling causal sequences and inadaptable to high-dimensional scenarios, a 3D-Spectral-Spatial Selective Scanning (3DSS) mechanism is introduced, which performs pixel-wise selective scanning on 3D hyperspectral tokens along the spectral and spatial dimensions. Five scanning routes are constructed to investigate the impact of dimension prioritization. The 3DSS scanning mechanism combined with conventional mapping operations forms the 3D-spectral-spatial mamba block (3DMB), enabling the extraction of global spectral-spatial semantic representations. Experimental results and analysis demonstrate that the proposed method outperforms the state-of-the-art methods on HSI classification benchmarks. △ Less

Submitted 8 August, 2024; v1 submitted 21 May, 2024; originally announced May 2024.

Revisiting the Tertiary-induced Binary Black Hole Mergers: the Role of Superthermal Wide Tertiary Eccentricity Distributions

Authors: Yubo Su, Bin Liu, Siyao Xu

Abstract: Recent studies show that the eccentricity distribution of wide binaries (semimajor axis $\gtrsim10^3\;\mathrm{AU}$) observed by \emph{Gaia} tends to favor large eccentricities more strongly than the canonical thermal distribution ($P(e) \propto e$) -- such distributions are termed "superthermal". Motivated by this observation, we revisit the formation channel of black hole (BH) binary mergers in t… ▽ More Recent studies show that the eccentricity distribution of wide binaries (semimajor axis $\gtrsim10^3\;\mathrm{AU}$) observed by \emph{Gaia} tends to favor large eccentricities more strongly than the canonical thermal distribution ($P(e) \propto e$) -- such distributions are termed "superthermal". Motivated by this observation, we revisit the formation channel of black hole (BH) binary mergers in triple stellar systems and study the impact of superthermal eccentricity distributions in the outer binaries. We explore the persistence of the highly eccentric outer orbits after each component in a stellar triple has undergone mass loss due to supernova explosions. We find that the outer eccentricity distribution can remain significantly superthermal for modestly hierarchical BH triples satisfying $a_{\rm in}/a_{\rm out}\gtrsim 0.005$ (where $a_{\rm in}$ and $a_{\rm out}$ are the semimajor axes of the inner and outer orbits), and are otherwise shaped by mass-loss induced kicks and dynamical instability. We then study the impact of these different outer eccentricity distributions of the remaining BH triples on mergers via the tertiary-induced channel. Of interest, we find that mergers can sometimes be produced even when the initial stellar orbits are near alignment (not subject to the von-Zeipel-Lidov-Kozai effect; ZLK effect) as long as the system is sufficiently hierarchical. On the other hand, although the impact of the octupole-order ZLK effect is much greater when the outer binary is more eccentric, we find that the merger fraction only changes modestly for extreme outer eccentricity distributions, as the largest eccentricities tend to lead to dynamical instability. △ Less

Submitted 17 July, 2024; v1 submitted 20 May, 2024; originally announced May 2024.

Comments: 19 pages, 13 figures, accepted to ApJ

EdgeLoc: A Communication-Adaptive Parallel System for Real-Time Localization in Infrastructure-Assisted Autonomous Driving

Authors: Boyi Liu, Jingwen Tong, Yufan Zhuang

Abstract: This paper presents EdgeLoc, an infrastructure-assisted, real-time localization system for autonomous driving that addresses the incompatibility between traditional localization methods and deep learning approaches. The system is built on top of the Robot Operating System (ROS) and combines the real-time performance of traditional methods with the high accuracy of deep learning approaches. The sys… ▽ More This paper presents EdgeLoc, an infrastructure-assisted, real-time localization system for autonomous driving that addresses the incompatibility between traditional localization methods and deep learning approaches. The system is built on top of the Robot Operating System (ROS) and combines the real-time performance of traditional methods with the high accuracy of deep learning approaches. The system leverages edge computing capabilities of roadside units (RSUs) for precise localization to enhance on-vehicle localization that is based on the real-time visual odometry. EdgeLoc is a parallel processing system, utilizing a proposed uncertainty-aware pose fusion solution. It achieves communication adaptivity through online learning and addresses fluctuations via window-based detection. Moreover, it achieves optimal latency and maximum improvement by utilizing auto-splitting vehicle-infrastructure collaborative inference, as well as online distribution learning for decision-making. Even with the most basic end-to-end deep neural network for localization estimation, EdgeLoc realizes a 67.75\% reduction in the localization error for real-time local visual odometry, a 29.95\% reduction for non-real-time collaborative inference, and a 30.26\% reduction compared to Kalman filtering. Finally, accuracy-to-latency conversion was experimentally validated, and an overall experiment was conducted on a practical cellular network. The system is open sourced at https://github.com/LoganCome/EdgeAssistedLocalization. △ Less

Submitted 8 June, 2024; v1 submitted 20 May, 2024; originally announced May 2024.

Data quality control system and long-term performance monitor of the LHAASO-KM2A

Authors: Zhen Cao, F. Aharonian, Axikegu, Y. X. Bai, Y. W. Bao, D. Bastieri, X. J. Bi, Y. J. Bi, W. Bian, A. V. Bukevich, Q. Cao, W. Y. Cao, Zhe Cao, J. Chang, J. F. Chang, A. M. Chen, E. S. Chen, H. X. Chen, Liang Chen, Lin Chen, Long Chen, M. J. Chen, M. L. Chen, Q. H. Chen, S. Chen , et al. (263 additional authors not shown)

Abstract: The KM2A is the largest sub-array of the Large High Altitude Air Shower Observatory (LHAASO). It consists of 5216 electromagnetic particle detectors (EDs) and 1188 muon detectors (MDs). The data recorded by the EDs and MDs are used to reconstruct primary information of cosmic ray and gamma-ray showers. This information is used for physical analysis in gamma-ray astronomy and cosmic ray physics. To… ▽ More The KM2A is the largest sub-array of the Large High Altitude Air Shower Observatory (LHAASO). It consists of 5216 electromagnetic particle detectors (EDs) and 1188 muon detectors (MDs). The data recorded by the EDs and MDs are used to reconstruct primary information of cosmic ray and gamma-ray showers. This information is used for physical analysis in gamma-ray astronomy and cosmic ray physics. To ensure the reliability of the LHAASO-KM2A data, a three-level quality control system has been established. It is used to monitor the status of detector units, stability of reconstructed parameters and the performance of the array based on observations of the Crab Nebula and Moon shadow. This paper will introduce the control system and its application on the LHAASO-KM2A data collected from August 2021 to July 2023. During this period, the pointing and angular resolution of the array were stable. From the observations of the Moon shadow and Crab Nebula, the results achieved using the two methods are consistent with each other. According to the observation of the Crab Nebula at energies from 25 TeV to 100 TeV, the time averaged pointing errors are estimated to be $-0.003^{\circ} \pm 0.005^{\circ}$ and $0.001^{\circ} \pm 0.006^{\circ}$ in the R.A. and Dec directions, respectively. △ Less

Submitted 13 June, 2024; v1 submitted 20 May, 2024; originally announced May 2024.

Comments: 15 pages, 9 figures

Improved measurement of the branching fraction of $h_{c}\rightarrowγη^\prime/η$ and search for $h_{c}\rightarrowγπ^0$

Authors: BESIII Collaboration, M. Ablikim, M. N. Achasov, P. Adlarson, O. Afedulidis, X. C. Ai, R. Aliberti, A. Amoroso, Q. An, Y. Bai, O. Bakina, I. Balossino, Y. Ban, H. -R. Bao, V. Batozskaya, K. Begzsuren, N. Berger, M. Berlowski, M. Bertani, D. Bettoni, F. Bianchi, E. Bianco, A. Bortone, I. Boyko, R. A. Briere , et al. (645 additional authors not shown)

Abstract: The processes $h_c\toγP(P = η^\prime,~η,~π^0)$ are studied with a sample of $(27.12\pm0.14)\times10^{8}$ $ψ(3686)$ events collected by the BESIII detector at the BEPCII collider. The decay $h_{c}\rightarrowγη$ is observed for the first time with the significance of $9.0\,σ$, and the branching fraction is determined to be $(3.77\pm0.55\pm0.13\pm0.26)\times10^{-4}$, while… ▽ More The processes $h_c\toγP(P = η^\prime,~η,~π^0)$ are studied with a sample of $(27.12\pm0.14)\times10^{8}$ $ψ(3686)$ events collected by the BESIII detector at the BEPCII collider. The decay $h_{c}\rightarrowγη$ is observed for the first time with the significance of $9.0\,σ$, and the branching fraction is determined to be $(3.77\pm0.55\pm0.13\pm0.26)\times10^{-4}$, while $\mathscr{B}(h_{c}\rightarrowγη^\prime)$ is measured to be $(1.40\pm0.11\pm0.04\pm0.10)\times10^{-3}$, where the first uncertainties are statistical, the second systematic, and the third from the branching fraction of $ψ(3686)\rightarrowπ^{0}h_c$. The combination of these results allows for a precise determination of $R_{h_c}=\frac{\mathscr{B}(h_c\rightarrowγη)}{\mathscr{B}(h_c\rightarrowγη^\prime)}$, which is calculated to be $(27.0\pm4.4\pm1.0)\%$. The results are valuable for gaining a deeper understanding of $η-η^\prime$ mixing, and its manifestation within quantum chromodynamics. No significant signal is found for the decay $h_c\rightarrowγπ^{0}$, and an upper limit is placed on its branching fraction of $\mathscr{B}(h_c\rightarrowγπ^{0})<5.0\times10^{-5}$, at the 90$\%$ confidence level. △ Less

Submitted 26 July, 2024; v1 submitted 19 May, 2024; originally announced May 2024.

Journal ref: J. High Energ. Phys. 08, 180 (2024)

Low-frequency absorption and radio recombination line features of the Galactic Center Lobe

Authors: Natasha Hurley-Walker, L. D. Anderson, M. Luisi, N. M. McClure-Griffiths, Robert A. Benjamin, Michael A. Kuhn, Dylan J. Linville, B. Liu, Catherine Zucker

Abstract: The Galactic center lobe (GCL) is a $\sim 1^\circ$ object located north of the Galactic center. In the mid-infrared (MIR), the GCL appears as two 8.0-micron filaments that roughly define an ellipse. There is strong 24-micron and radio continuum emission in the interior of the ellipse. Due to its morphology and location in the sky, previous authors have argued that the GCL is created by outflows fr… ▽ More The Galactic center lobe (GCL) is a $\sim 1^\circ$ object located north of the Galactic center. In the mid-infrared (MIR), the GCL appears as two 8.0-micron filaments that roughly define an ellipse. There is strong 24-micron and radio continuum emission in the interior of the ellipse. Due to its morphology and location in the sky, previous authors have argued that the GCL is created by outflows from star formation in the central molecular zone or by activity of the central black hole Sgr~A$^*$. We present images of the GCL from the GaLactic and Extragalactic All-sky Murchison Widefield Array survey in radio continuum that show thermal absorption against the Galactic center, incompatible with an interpretation of synchrotron self-absorption. Estimates of the cosmic ray emissivity in this direction allow us to place a distance constraint on the GCL. To be consistent with standard emissivity assumptions, the GCL would be located 2kpc away. At a distance of 8kpc, the synchrotron background emissivity is enhanced by $\sim75$% in the direction of the GCL. We also present radio recombination line data from the Green Bank Telescope that constrains the electron temperature and line widths in this region, which are also more explicable if the GCL lies relatively close. △ Less

Submitted 19 May, 2024; originally announced May 2024.

Comments: 6 figures, accepted to ApJ

Generic Approach to Intrinsic Magnetic Second-order Topological Insulators via Inverted $p-d$ Orbitals

Authors: Zhao Liu, Bing Liu, Yuefeng Yin, Nikhil V. Medhekar

Abstract: The integration of intrinsically magnetic and topologically nontrivial two-dimensional materials holds tantalizing prospects for the exotic quantum anomalous Hall insulators and magnetic second-order topological insulators (SOTIs). Compared with the well-studied nonmagnetic counterparts, the pursuit of intrinsic magnetic SOTIs remains limited. In this work, we address this gap by focusing on… ▽ More The integration of intrinsically magnetic and topologically nontrivial two-dimensional materials holds tantalizing prospects for the exotic quantum anomalous Hall insulators and magnetic second-order topological insulators (SOTIs). Compared with the well-studied nonmagnetic counterparts, the pursuit of intrinsic magnetic SOTIs remains limited. In this work, we address this gap by focusing on $p-d$ orbitals inversion, a fundamental but often overlooked phenomena in the construction of topological materials. We begin by developing a theoretical framework to elucidate $p-d$ orbitals inversion through a combined density-functional theory calculation and Wannier downfolding. Subsequently we showcase the generality of this concept in realizing ferromagnetism SOTIs by identifying two real materials with distinct lattices: 1$T$-VS$_2$ in a hexagonal lattice, and CrAs monolayer in a square lattice. We further compare it with other mechanisms requiring spin-orbit coupling and explore the similarities to topological Kondo insulators. Our findings establish a generic pathway towards intrinsic magnetic SOTIs. △ Less

Submitted 18 May, 2024; originally announced May 2024.

Comments: 4 figures, all comments are welcomed !

How do Primordial Black Holes change the Halo Mass Function and Structure?

Authors: Saiyang Zhang, Volker Bromm, Boyuan Liu

Abstract: We examine the effects of massive primordial black holes (PBHs) on cosmic structure formation, employing both a semi-analytical approach and cosmological simulations. Our simulations incorporate PBHs with a monochromatic mass distribution centered around $10^6 \ \rm M_{\odot}$, constituting a fraction of $10^{-2}$ to $10^{-4}$ of the dark matter (DM) in the universe, with the remainder being colli… ▽ More We examine the effects of massive primordial black holes (PBHs) on cosmic structure formation, employing both a semi-analytical approach and cosmological simulations. Our simulations incorporate PBHs with a monochromatic mass distribution centered around $10^6 \ \rm M_{\odot}$, constituting a fraction of $10^{-2}$ to $10^{-4}$ of the dark matter (DM) in the universe, with the remainder being collision-less particle dark matter (PDM). Additionally, we conduct a $Λ$CDM simulation for comparative analysis with runs that include PBHs. At smaller scales, halos containing PBHs exhibit similar density and velocity dispersion profiles to those without PBHs. Conversely, at larger scales, PBHs can expedite the formation of massive halos and reside at their centers due to the `seed effect'. To analyze the relative distribution of PBH host halos compared to non-PBH halos, we apply nearest-neighbor (NN) statistics. Our results suggest that PBH host halos, through gravitational influence, significantly impact the structure formation process, compared to the $Λ$CDM case, by attracting and engulfing nearby newly-formed minihalos. Should PBHs constitute a fraction of DM significantly larger than $\sim$$10^{-3}$, almost all newly-formed halos will be absorbed by PBH-seeded halos. Consequently, our simulations predict a bimodal feature in the halo mass function, with most of the massive halos containing at least one PBH at their core and the rest being less massive non-PBH halos. △ Less

Submitted 18 May, 2024; originally announced May 2024.

Comments: 16 pages, 12 figures, submitted to ApJ

The Galactic Center Lobe as an HII Region

Authors: L. D. Anderson, Matteo Luisi, B. Liu, Dylan J. Linville, Robert A. Benjamin, Natasha Hurley-Walker, N. M. McClure-Griffiths, Catherine Zucker

Abstract: The Galactic center lobe (GCL) is an object ~1° across that is located north of the Galactic center. In the mid-infrared (MIR) the GCL appears as two 8.0$μ$m filaments between which is strong 24$μ$m and radio continuum emission. Due to its morphology and location in the sky, previous authors have argued that the GCL is located in the Galactic center region, created by outflows from star formation… ▽ More The Galactic center lobe (GCL) is an object ~1° across that is located north of the Galactic center. In the mid-infrared (MIR) the GCL appears as two 8.0$μ$m filaments between which is strong 24$μ$m and radio continuum emission. Due to its morphology and location in the sky, previous authors have argued that the GCL is located in the Galactic center region, created by outflows from star formation or by activity of the central black hole Sagittarius A*. In an associated paper (Hurley-Walker et al., 2024, in press), low-frequency radio emission indicates that the GCL must instead lie foreground to the Galactic center. If the GCL is foreground to the Galactic center, it is likely to be a type of object common throughout the Galactic disk; we here investigate whether its properties are similar to those of Galactic HII regions. We find that the GCL's MIR morphology, MIR flux densities, dust temperatures, and radio recombination line (RRL) properties as traced by the GBT Diffuse Ionized Gas Survey (GDIGS) are consistent with those of known Galactic HII regions, although the derived electron temperature is low. We search for the ionizing source(s) of the possible HII region and identify a stellar cluster candidate (Camargo #1092/Ryu & Lee #532) and a cluster of young stellar objects (SPICY G359.3+0.3) whose members have Gaia parallaxes distances of 1.7${\pm}$0.4kpc. Taken together, the results of our companion paper and those shown here suggest that the GCL has properties consistent with those of an HII region located ~2kpc from the Sun. △ Less

Submitted 17 May, 2024; originally announced May 2024.

Comments: Accepted to ApJ

SMP Challenge: An Overview and Analysis of Social Media Prediction Challenge

Authors: Bo Wu, Peiye Liu, Wen-Huang Cheng, Bei Liu, Zhaoyang Zeng, Jia Wang, Qiushi Huang, Jiebo Luo

Abstract: Social Media Popularity Prediction (SMPP) is a crucial task that involves automatically predicting future popularity values of online posts, leveraging vast amounts of multimodal data available on social media platforms. Studying and investigating social media popularity becomes central to various online applications and requires novel methods of comprehensive analysis, multimodal comprehension, a… ▽ More Social Media Popularity Prediction (SMPP) is a crucial task that involves automatically predicting future popularity values of online posts, leveraging vast amounts of multimodal data available on social media platforms. Studying and investigating social media popularity becomes central to various online applications and requires novel methods of comprehensive analysis, multimodal comprehension, and accurate prediction. SMP Challenge is an annual research activity that has spurred academic exploration in this area. This paper summarizes the challenging task, data, and research progress. As a critical resource for evaluating and benchmarking predictive models, we have released a large-scale SMPD benchmark encompassing approximately half a million posts authored by around 70K users. The research progress analysis provides an overall analysis of the solutions and trends in recent years. The SMP Challenge website (www.smp-challenge.com) provides the latest information and news. △ Less

Submitted 16 May, 2024; originally announced May 2024.

Comments: ACM Multimedia. arXiv admin note: text overlap with arXiv:1910.01795

Beam Pattern Modulation Embedded Hybrid Transceiver Optimization for Integrated Sensing and Communication

Authors: Boxun Liu, Shijian Gao, Zonghui Yang, Xiang Cheng, Liuqing Yang

Abstract: Integrated sensing and communication (ISAC) emerges as a promising technology for B5G/6G, particularly in the millimeter-wave (mmWave) band. However, the widely utilized hybrid architecture in mmWave systems compromises multiplexing gain due to the constraints of limited radio frequency chains. Moreover, additional sensing functionalities exacerbate the impairment of spectrum efficiency (SE). In t… ▽ More Integrated sensing and communication (ISAC) emerges as a promising technology for B5G/6G, particularly in the millimeter-wave (mmWave) band. However, the widely utilized hybrid architecture in mmWave systems compromises multiplexing gain due to the constraints of limited radio frequency chains. Moreover, additional sensing functionalities exacerbate the impairment of spectrum efficiency (SE). In this paper, we present an optimized beam pattern modulation-embedded ISAC (BPM-ISAC) transceiver design, which spares one RF chain for sensing and the others for communication. To compensate for the reduced SE, index modulation across communication beams is applied. We formulate an optimization problem aimed at minimizing the mean squared error (MSE) of the sensing beampattern, subject to a symbol MSE constraint. This problem is then solved by sequentially optimizing the analog and digital parts. Both the multi-aperture structure (MAS) and the multi-beam structure (MBS) are considered for the design of the analog part. We conduct theoretical analysis on the asymptotic pairwise error probability (APEP) and the Cramér-Rao bound (CRB) of direction of arrival (DoA) estimation. Numerical simulations validate the overall enhanced ISAC performance over existing alternatives. △ Less

Submitted 15 May, 2024; originally announced May 2024.

Analytic forms for the $e^+e^-$ annihilation cross sections around a resonance including initial state radiation

Authors: Baoxin Liu, Zhenyu Zhang, Xiang Zhou

Abstract: The exact analytic form of cross sections including initial state radiation with Kuraev-Fadin radiative function are obtained for $e^+e^-$ annihilation around a resonance. Despite accounting for vacuum polarization and center-of-mass energy spread effects, the precision remains below 0.1\%, meeting the accuracy requirements of quantum electrodynamics corrections up to $\mathcal{O}(α^2)$. The analy… ▽ More The exact analytic form of cross sections including initial state radiation with Kuraev-Fadin radiative function are obtained for $e^+e^-$ annihilation around a resonance. Despite accounting for vacuum polarization and center-of-mass energy spread effects, the precision remains below 0.1\%, meeting the accuracy requirements of quantum electrodynamics corrections up to $\mathcal{O}(α^2)$. The analytic forms lead to an enhancement in the precision of experimental measurements of physical parameters, such as branching fractions, and demonstrate significantly improved computational efficiency in the regression procedures. △ Less

Submitted 15 May, 2024; originally announced May 2024.

Deep Blur Multi-Model (DeepBlurMM) -- a strategy to mitigate the impact of image blur on deep learning model performance in histopathology image analysis

Authors: Yujie Xiang, Bojing Liu, Mattias Rantalainen

Abstract: AI-based analysis of histopathology whole slide images (WSIs) is central in computational pathology. However, image quality, including unsharp areas of WSIs, impacts model performance. We investigate the impact of blur and propose a multi-model approach to mitigate negative impact of unsharp image areas. In this study, we use a simulation approach, evaluating model performance under varying levels… ▽ More AI-based analysis of histopathology whole slide images (WSIs) is central in computational pathology. However, image quality, including unsharp areas of WSIs, impacts model performance. We investigate the impact of blur and propose a multi-model approach to mitigate negative impact of unsharp image areas. In this study, we use a simulation approach, evaluating model performance under varying levels of added Gaussian blur to image tiles from >900 H&E-stained breast cancer WSIs. To reduce impact of blur, we propose a novel multi-model approach (DeepBlurMM) where multiple models trained on data with variable amounts of Gaussian blur are used to predict tiles based on their blur levels. Using histological grade as a principal example, we found that models trained with mildly blurred tiles improved performance over the base model when moderate-high blur was present. DeepBlurMM outperformed the base model in presence of moderate blur across all tiles (AUC:0.764 vs. 0.710), and in presence of a mix of low, moderate, and high blur across tiles (AUC:0.821 vs. 0.789). Unsharp image tiles in WSIs impact prediction performance. DeepBlurMM improved prediction performance under some conditions and has the potential to increase quality in both research and clinical applications. △ Less

Submitted 23 May, 2024; v1 submitted 15 May, 2024; originally announced May 2024.

ACM Class: I.4; J.3

Search for the leptonic decays $D^{*+}\to e^+ν_e$ and $D^{*+}\to μ^+ν_μ$

Authors: BESIII Collaboration, M. Ablikim, M. N. Achasov, P. Adlarson, M. Albrecht, R. Aliberti, A. Amoroso, M. R. An, Q. An, Y. Bai, O. Bakina, R. Baldini Ferroli, I. Balossino, Y. Ban, V. Batozskaya, D. Becker, K. Begzsuren, N. Berger, M. Bertani, D. Bettoni, F. Bianchi, E. Bianco, J. Bloms, A. Bortone, I. Boyko , et al. (559 additional authors not shown)

Abstract: We present the first search for the leptonic decays $D^{*+}\to e^+ν_e$ and $D^{*+}\to μ^+ν_μ$ by analyzing a data sample of electron-positron collisions recorded with the BESIII detector at center-of-mass energies between 4.178 and 4.226 GeV, corresponding to an integrated luminosity of 6.32~fb$^{-1}$. No significant signal is observed. The upper limits on the branching fractions for… ▽ More We present the first search for the leptonic decays $D^{*+}\to e^+ν_e$ and $D^{*+}\to μ^+ν_μ$ by analyzing a data sample of electron-positron collisions recorded with the BESIII detector at center-of-mass energies between 4.178 and 4.226 GeV, corresponding to an integrated luminosity of 6.32~fb$^{-1}$. No significant signal is observed. The upper limits on the branching fractions for $D^{*+}\to e^+ν_e$ and $D^{*+}\to μ^+ν_μ$ are set to be $1.1 \times 10^{-5}$ and $4.3 \times 10^{-6}$ at 90\% confidence level, respectively. △ Less

Submitted 14 May, 2024; originally announced May 2024.

Comments: 14 pages, 7 figures

RIGEL: Simulating dwarf galaxies at solar mass resolution with radiative transfer and feedback from individual massive stars

Authors: Yunwei Deng, Hui Li, Boyuan Liu, Rahul Kannan, Aaron Smith, Greg L. Bryan

Abstract: We introduce the RIGEL model, a novel framework to self-consistently model the effects of stellar feedback in the multiphase ISM of dwarf galaxies with radiative transfer (RT) on a star-by-star basis. The RIGEL model integrates detailed implementations of feedback from individual massive stars into the RHD code, AREPO-RT. It forms individual massive stars from the resolved multiphase ISM by sampli… ▽ More We introduce the RIGEL model, a novel framework to self-consistently model the effects of stellar feedback in the multiphase ISM of dwarf galaxies with radiative transfer (RT) on a star-by-star basis. The RIGEL model integrates detailed implementations of feedback from individual massive stars into the RHD code, AREPO-RT. It forms individual massive stars from the resolved multiphase ISM by sampling the IMF and tracks their evolution individually. The lifetimes, photon production rates, mass-loss rates, and wind velocities of these stars are determined by their initial masses and metallicities based on a library that incorporates a variety of stellar models. The RT equations are solved in seven spectral bins accounting for the IR to HeII ionizing bands, using an M1 RT scheme. The thermochemistry model tracks the non-equilibrium H, He chemistry and the equilibrium abundance of CI, CII, OI, OII, and CO to capture the thermodynamics of all ISM phases. We evaluate the performance of the RIGEL model using $1\,{\rm M}_\odot$ resolution simulations of isolated dwarf galaxies. We found that the SFR and ISRF show strong positive correlations to the metallicity of the galaxy. Photoionization and photoheating can reduce the SFR by an order of magnitude by removing the available cold-dense gas fuel for star formation. The ISRF also changes the thermal structure of the ISM. Radiative feedback occurs immediately after the birth of massive stars and rapidly disperses the molecular clouds within 1 Myr. As a consequence, radiative feedback reduces the age spread of star clusters to less than 2 Myr, prohibits the formation of massive star clusters, and shapes the cluster initial mass function to a steep power-law form with a slope of $\sim-2$. The mass-loading factor of the fiducial galaxy has a median of $\sim50$, while turning off radiative feedback reduces this factor by an order of magnitude. △ Less

Submitted 16 May, 2024; v1 submitted 14 May, 2024; originally announced May 2024.

Comments: 27 pages, 18 figures; submitted to A&A; abstract slightly abridged; comments welcome

Cryptography-Based Privacy-Preserving Method for Distributed Optimization over Time-Varying Directed Graphs with Enhanced Efficiency

Authors: Bing Liu, Furan Xie, Li Chai

Abstract: In this paper, we study the privacy-preserving distributed optimization problem, aiming to prevent attackers from stealing the private information of agents. For this purpose, we propose a novel privacy-preserving algorithm based on the Advanced Encryption Standard (AES), which is both secure and computationally efficient. By appropriately constructing the underlying weight matrices, our algorithm… ▽ More In this paper, we study the privacy-preserving distributed optimization problem, aiming to prevent attackers from stealing the private information of agents. For this purpose, we propose a novel privacy-preserving algorithm based on the Advanced Encryption Standard (AES), which is both secure and computationally efficient. By appropriately constructing the underlying weight matrices, our algorithm can be applied to time-varying directed networks. We show that the proposed algorithm can protect an agent's privacy if the agent has at least one legitimate neighbor at the initial iteration. Under the assumption that the objective function is strongly convex and Lipschitz smooth, we rigorously prove that the proposed algorithm has a linear convergence rate. Finally, the effectiveness of the proposed algorithm is demonstrated by numerical simulations of the canonical sensor fusion problem. △ Less

Submitted 14 May, 2024; originally announced May 2024.

Search for the radiative transition $χ_{c1}(3872)\toγψ_2(3823)$

Authors: BESIII Collaboration, M. Ablikim, M. N. Achasov, P. Adlarson, O. Afedulidis, X. C. Ai, R. Aliberti, A. Amoroso, M. R. An, Q. An, Y. Bai, O. Bakina, I. Balossino, Y. Ban, H. -R. Bao, V. Batozskaya, K. Begzsuren, N. Berger, M. Berlowski, M. Bertani, D. Bettoni, F. Bianchi, E. Bianco, A. Bortone, I. Boyko , et al. (635 additional authors not shown)

Abstract: Using 9.0 $\rm fb^{-1}$ of $e^+e^-$ collision data collected at center-of-mass energies from 4.178 to 4.278 GeV with the BESIII detector at the BEPCII collider, we perform the first search for the radiative transition $χ_{c1}(3872)\toγψ_2(3823)$. No $χ_{c1}(3872)\toγψ_2(3823)$ signal is observed. The upper limit on the ratio of branching fractions… ▽ More Using 9.0 $\rm fb^{-1}$ of $e^+e^-$ collision data collected at center-of-mass energies from 4.178 to 4.278 GeV with the BESIII detector at the BEPCII collider, we perform the first search for the radiative transition $χ_{c1}(3872)\toγψ_2(3823)$. No $χ_{c1}(3872)\toγψ_2(3823)$ signal is observed. The upper limit on the ratio of branching fractions $\mathcal{B}(χ_{c1}(3872)\toγψ_2(3823), ψ_2(3823)\toγχ_{c1})/\mathcal{B}(χ_{c1}(3872)\toπ^+π^- J/ψ)$ is set as 0.075 at the 90\% confidence level. Our result contradicts theoretical predictions under the assumption that the $χ_{c1}(3872)$ is the pure charmonium state $χ_{c1}(2P)$. △ Less

Submitted 13 May, 2024; originally announced May 2024.

Comments: 8 pages, 2 figures

Shell structure and shape transition in odd-$Z$ superheavy nuclei with proton numbers $Z=117, 119$: insights from deformed relativistic Hartree-Bogoliubov in continuum

Authors: Y. X. Zhang, B. R. Liu, K. Y. Zhang, J. M. Yao

Abstract: We present a systematic study on the structural properties of odd-$Z$ superheavy nuclei with proton numbers $Z=117, 119$, and neutron numbers $N$ increasing from $N=170$ to the neutron dripline within the framework of axially deformed relativistic Hartree-Bogoliubov theory in continuum (DRHBc). The results are compared with those of even-even superheavy nuclei with proton numbers $Z=118$ and… ▽ More We present a systematic study on the structural properties of odd-$Z$ superheavy nuclei with proton numbers $Z=117, 119$, and neutron numbers $N$ increasing from $N=170$ to the neutron dripline within the framework of axially deformed relativistic Hartree-Bogoliubov theory in continuum (DRHBc). The results are compared with those of even-even superheavy nuclei with proton numbers $Z=118$ and $120$. We analyze various bulk properties of their ground states, including binding energies, quadrupole deformations, root-mean-square radii, nucleon separation energies, and $α$-decay energies. The coexistence of competing prolate and oblate or spherical shapes leads to abrupt changes in both quadrupole deformations and charge radii as functions of neutron numbers. Compared to even-even nuclei, the odd-mass ones exhibit a more complicated transition picture, in which the quantum numbers of $K^π$ of the lowest-energy configuration may change with deformation. This may result in the change of angular momentum in the ground-state to ground-state $α$-decay and thus quench the decay rate in odd-mass nuclei. Moreover, our results demonstrate a pronounced proton shell gap at $Z=120$, instead of $Z=114$, which is consistent with the predictions of most covariant density functional theories. Moreover, large neutron shell gaps are found at $N=172$ and $N=258$ in the four isotopic chains, as well as at $N=184$ in the light two isotopic chains with $Z=117$ and $Z=118$, attributed to the nearly-degenerate $3d$ and $4p$ spin-orbit doublet states due to the presence of bubble structure. △ Less

Submitted 13 May, 2024; originally announced May 2024.

Comments: 15 pages with 18 figures

Journal ref: Phys. Rev. C 110, 024302 (2024)

Discovery of Very-high-energy Gamma-ray Emissions from the Low Luminosity AGN NGC 4278 by LHAASO

Authors: Zhen Cao, F. Aharonian, Q. An, Axikegu, Y. X. Bai, Y. W. Bao, D. Bastieri, X. J. Bi, Y. J. Bi, J. T. Cai, Q. Cao, W. Y. Cao, Zhe Cao, J. Chang, J. F. Chang, A. M. Chen, E. S. Chen, Liang Chen, Lin Chen, Long Chen, M. J. Chen, M. L. Chen, Q. H. Chen, S. H. Chen, S. Z. Chen , et al. (255 additional authors not shown)

Abstract: The first source catalog of Large High Altitude Air Shower Observatory reported the detection of a very-high-energy gamma ray source, 1LHAASO J1219+2915. In this paper a further detailed study of the spectral and temporal behavior of this point-like source have been carried. The best-fit position of the TeV source ($\rm{RA}=185.05^{\circ}\pm0.04^{\circ}$, $\rm{Dec}=29.25^{\circ}\pm0.03^{\circ}$) i… ▽ More The first source catalog of Large High Altitude Air Shower Observatory reported the detection of a very-high-energy gamma ray source, 1LHAASO J1219+2915. In this paper a further detailed study of the spectral and temporal behavior of this point-like source have been carried. The best-fit position of the TeV source ($\rm{RA}=185.05^{\circ}\pm0.04^{\circ}$, $\rm{Dec}=29.25^{\circ}\pm0.03^{\circ}$) is compatible with NGC 4278 within $\sim0.03$ degree. Variation analysis shows an indication of the variability at a few months level in the TeV band, which is consistent with low frequency observations. Based on these observations, we report the detection of TeV $γ$-ray emissions from this low-luminosity AGN NGC 4278. The observations by LHAASO-WCDA during active period has a significance level of 8.8\,$σ$ with best-fit photon spectral index $\varGamma=2.56\pm0.14$ and a flux $f_{1-10\,\rm{TeV}}=(7.0\pm1.1_{\rm{sta}}\pm0.35_{\rm{syst}})\times10^{-13}\,\rm{photons\,cm^{-2}\,s^{-1}}$, or approximately $5\%$ of the Crab Nebula. The discovery of VHE from NGC 4278 indicates that the compact, weak radio jet can efficiently accelerate particles and emit TeV photons. △ Less

Submitted 13 May, 2024; originally announced May 2024.

Comments: 11 pages, 5 figures

The structural-size effect, aging time, and pressure-dependent functional properties of Mn-containing perovskite nanoparticles

Authors: Danyang Su, N. A. Liedienov, V. M. Kalita, I. V. Fesych, Wei Xu, A. V. Bodnaruk, Yu. I. Dzhezherya, Quanjun Li, Bingbing Liu, G. G. Levchenko

Abstract: The properties of nanoparticles are determined by their size and structure. When exposed to external pressure P, their structural properties can change. The improvement or degradation of the properties of the samples depending on time is particularly interesting. The knowledge of the influence of structural-size effect, aging time, and pressure on the behavior of the compounds is essential for fun… ▽ More The properties of nanoparticles are determined by their size and structure. When exposed to external pressure P, their structural properties can change. The improvement or degradation of the properties of the samples depending on time is particularly interesting. The knowledge of the influence of structural-size effect, aging time, and pressure on the behavior of the compounds is essential for fundamental and applied purposes.Therefore, the first attempts have been made to shed light on how the functional properties of the Mn-containing perovskites change depending on them. The nanoparticles of different sizes, from 20 to 70 nm, have been obtained. After 3 years, their structural properties underwent significant changes, including an increase in particle size, bandwidth, and microstrains, as well as a reduction in dislocation density.The greatest change in the structure is observed for the smallest nanoparticles. The phase transition temperatures increase with nanoparticle size, time, and pressure. The aging time has the strongest influence on the changing Curie temperature for the smallest and most magnetically inhomogeneous nanoparticles with dTc/dP = 100 K / GPa. Conversely, the structural-size effect and external pressure have the greatest influence on the biggest and most magnetically uniform nanoparticles with dTc/dP = 91 and 16 K / GPa, respectively. After 3 years, the biggest nanoparticles demonstrate the most stable phase transition temperatures with improved magnetocaloric parameters near room temperature. These structural-size effect, aging time, and pressure are powerful instruments to tune the phase transition temperatures and magnetocaloric effect of the nanoparticles. These outcomes may have implications for the whole class of perovskites and could initiate a new mainstream. △ Less

Submitted 11 May, 2024; originally announced May 2024.

Comments: 57 pages, 33 figures

Measurement of the ${e}^{+}{e}^{-}\to p \bar{p}π^{0}$ cross section at $\sqrt{s}=2.1000-3.0800$ GeV

Authors: BESIII Collaboration, M. Ablikim, M. N. Achasov, P. Adlarson, O. Afedulidis, X. C. Ai, R. Aliberti, A. Amoroso, Q. An, Y. Bai, O. Bakina, I. Balossino, Y. Ban, H. -R. Bao, V. Batozskaya, K. Begzsuren, N. Berger, M. Berlowski, M. Bertani, D. Bettoni, F. Bianchi, E. Bianco, A. Bortone, I. Boyko, R. A. Briere , et al. (639 additional authors not shown)

Abstract: The process $e^{+}e^{-}\to p\bar{p}π^{0}$ is studied at 20 center-of-mass energies ranging from 2.1000 to 3.0800 GeV using 636.8 pb$^{-1}$ of data collected with the BESIII detector operating at the BEPCII collider. The Born cross sections for $e^{+}e^{-}\to p\bar{p}π^{0}$ are measured with high precision. Since the lowest center-of-mass energy, 2.1000 GeV, is less than 90 MeV above the… ▽ More The process $e^{+}e^{-}\to p\bar{p}π^{0}$ is studied at 20 center-of-mass energies ranging from 2.1000 to 3.0800 GeV using 636.8 pb$^{-1}$ of data collected with the BESIII detector operating at the BEPCII collider. The Born cross sections for $e^{+}e^{-}\to p\bar{p}π^{0}$ are measured with high precision. Since the lowest center-of-mass energy, 2.1000 GeV, is less than 90 MeV above the $p\bar{p}π^0$ energy threshold, we can probe the threshold behavior for this reaction. However, no anomalous threshold enhancement is found in the cross sections for $e^{+}e^{-}\to p\bar{p}π^{0}$. △ Less

Submitted 10 May, 2024; originally announced May 2024.

Financial Table Extraction in Image Documents

Authors: William Watson, Bo Liu

Abstract: Table extraction has long been a pervasive problem in financial services. This is more challenging in the image domain, where content is locked behind cumbersome pixel format. Luckily, advances in deep learning for image segmentation, OCR, and sequence modeling provides the necessary heavy lifting to achieve impressive results. This paper presents an end-to-end pipeline for identifying, extracting… ▽ More Table extraction has long been a pervasive problem in financial services. This is more challenging in the image domain, where content is locked behind cumbersome pixel format. Luckily, advances in deep learning for image segmentation, OCR, and sequence modeling provides the necessary heavy lifting to achieve impressive results. This paper presents an end-to-end pipeline for identifying, extracting and transcribing tabular content in image documents, while retaining the original spatial relations with high fidelity. △ Less

Submitted 18 March, 2024; originally announced May 2024.

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

Authors: DeepSeek-AI, Aixin Liu, Bei Feng, Bin Wang, Bingxuan Wang, Bo Liu, Chenggang Zhao, Chengqi Dengr, Chong Ruan, Damai Dai, Daya Guo, Dejian Yang, Deli Chen, Dongjie Ji, Erhang Li, Fangyun Lin, Fuli Luo, Guangbo Hao, Guanting Chen, Guowei Li, H. Zhang, Hanwei Xu, Hao Yang, Haowei Zhang, Honghui Ding , et al. (132 additional authors not shown)

Abstract: We present DeepSeek-V2, a strong Mixture-of-Experts (MoE) language model characterized by economical training and efficient inference. It comprises 236B total parameters, of which 21B are activated for each token, and supports a context length of 128K tokens. DeepSeek-V2 adopts innovative architectures including Multi-head Latent Attention (MLA) and DeepSeekMoE. MLA guarantees efficient inference… ▽ More We present DeepSeek-V2, a strong Mixture-of-Experts (MoE) language model characterized by economical training and efficient inference. It comprises 236B total parameters, of which 21B are activated for each token, and supports a context length of 128K tokens. DeepSeek-V2 adopts innovative architectures including Multi-head Latent Attention (MLA) and DeepSeekMoE. MLA guarantees efficient inference through significantly compressing the Key-Value (KV) cache into a latent vector, while DeepSeekMoE enables training strong models at an economical cost through sparse computation. Compared with DeepSeek 67B, DeepSeek-V2 achieves significantly stronger performance, and meanwhile saves 42.5% of training costs, reduces the KV cache by 93.3%, and boosts the maximum generation throughput to 5.76 times. We pretrain DeepSeek-V2 on a high-quality and multi-source corpus consisting of 8.1T tokens, and further perform Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL) to fully unlock its potential. Evaluation results show that, even with only 21B activated parameters, DeepSeek-V2 and its chat versions still achieve top-tier performance among open-source models. △ Less

Submitted 19 June, 2024; v1 submitted 7 May, 2024; originally announced May 2024.

One nose but two nostrils: Learn to align with sparse connections between two olfactory cortices

Authors: Bo Liu, Shanshan Qin, Venkatesh Murthy, Yuhai Tu

Abstract: The integration of neural representations in the two hemispheres is an important problem in neuroscience. Recent experiments revealed that odor responses in cortical neurons driven by separate stimulation of the two nostrils are highly correlated. This bilateral alignment points to structured inter-hemispheric connections, but detailed mechanism remains unclear. Here, we hypothesized that continuo… ▽ More The integration of neural representations in the two hemispheres is an important problem in neuroscience. Recent experiments revealed that odor responses in cortical neurons driven by separate stimulation of the two nostrils are highly correlated. This bilateral alignment points to structured inter-hemispheric connections, but detailed mechanism remains unclear. Here, we hypothesized that continuous exposure to environmental odors shapes these projections and modeled it as online learning with local Hebbian rule. We found that Hebbian learning with sparse connections achieves bilateral alignment, exhibiting a linear trade-off between speed and accuracy. We identified an inverse scaling relationship between the number of cortical neurons and the inter-hemispheric projection density required for desired alignment accuracy, i.e., more cortical neurons allow sparser inter-hemispheric projections. We next compared the alignment performance of local Hebbian rule and the global stochastic-gradient-descent (SGD) learning for artificial neural networks. We found that although SGD leads to the same alignment accuracy with modestly sparser connectivity, the same inverse scaling relation holds. We showed that their similar performance originates from the fact that the update vectors of the two learning rules align significantly throughout the learning process. This insight may inspire efficient sparse local learning algorithms for more complex problems. △ Less

Submitted 6 May, 2024; originally announced May 2024.

Some Statistical and Data Challenges When Building Early-Stage Digital Experimentation and Measurement Capabilities

Authors: C. H. Bryan Liu

Abstract: Digital experimentation and measurement (DEM) capabilities -- the knowledge and tools necessary to run experiments with digital products, services, or experiences and measure their impact -- are fast becoming part of the standard toolkit of digital/data-driven organisations in guiding business decisions. Many large technology companies report having mature DEM capabilities, and several businesses… ▽ More Digital experimentation and measurement (DEM) capabilities -- the knowledge and tools necessary to run experiments with digital products, services, or experiences and measure their impact -- are fast becoming part of the standard toolkit of digital/data-driven organisations in guiding business decisions. Many large technology companies report having mature DEM capabilities, and several businesses have been established purely to manage experiments for others. Given the growing evidence that data-driven organisations tend to outperform their non-data-driven counterparts, there has never been a greater need for organisations to build/acquire DEM capabilities to thrive in the current digital era. This thesis presents several novel approaches to statistical and data challenges for organisations building DEM capabilities. We focus on the fundamentals associated with building DEM capabilities, which lead to a richer understanding of the underlying assumptions and thus enable us to develop more appropriate capabilities. We address why one should engage in DEM by quantifying the benefits and risks of acquiring DEM capabilities. This is done using a ranking under lower uncertainty model, enabling one to construct a business case. We also examine what ingredients are necessary to run digital experiments. In addition to clarifying the existing literature around statistical tests, datasets, and methods in experimental design and causal inference, we construct an additional dataset and detailed case studies on applying state-of-the-art methods. Finally, we investigate when a digital experiment design would outperform another, leading to an evaluation framework that compares competing designs' data efficiency. △ Less

Submitted 6 May, 2024; originally announced May 2024.

Comments: PhD thesis. Imperial College London. Official library version available on: https://spiral.imperial.ac.uk/handle/10044/1/110307

Annealed adaptive importance sampling method in PINNs for solving high dimensional partial differential equations

Authors: Zhengqi Zhang, Jing Li, Bin Liu

Abstract: Physics-informed neural networks (PINNs) have emerged as powerful tools for solving a wide range of partial differential equations (PDEs). However, despite their user-friendly interface and broad applicability, PINNs encounter challenges in accurately resolving PDEs, especially when dealing with singular cases that may lead to unsatisfactory local minima. To address these challenges and improve so… ▽ More Physics-informed neural networks (PINNs) have emerged as powerful tools for solving a wide range of partial differential equations (PDEs). However, despite their user-friendly interface and broad applicability, PINNs encounter challenges in accurately resolving PDEs, especially when dealing with singular cases that may lead to unsatisfactory local minima. To address these challenges and improve solution accuracy, we propose an innovative approach called Annealed Adaptive Importance Sampling (AAIS) for computing the discretized PDE residuals of the cost functions, inspired by the Expectation Maximization algorithm used in finite mixtures to mimic target density. Our objective is to approximate discretized PDE residuals by strategically sampling additional points in regions with elevated residuals, thus enhancing the effectiveness and accuracy of PINNs. Implemented together with a straightforward resampling strategy within PINNs, our AAIS algorithm demonstrates significant improvements in efficiency across a range of tested PDEs, even with limited training datasets. Moreover, our proposed AAIS-PINN method shows promising capabilities in solving high-dimensional singular PDEs. The adaptive sampling framework introduced here can be integrated into various PINN frameworks. △ Less

Submitted 6 May, 2024; originally announced May 2024.

Towards a Flexible and High-Fidelity Approach to Distributed DNN Training Emulation

Authors: Banruo Liu, Mubarak Adetunji Ojewale, Yuhan Ding, Marco Canini

Abstract: We propose NeuronaBox, a flexible, user-friendly, and high-fidelity approach to emulate DNN training workloads. We argue that to accurately observe performance, it is possible to execute the training workload on a subset of real nodes and emulate the networked execution environment along with the collective communication operations. Initial results from a proof-of-concept implementation show that… ▽ More We propose NeuronaBox, a flexible, user-friendly, and high-fidelity approach to emulate DNN training workloads. We argue that to accurately observe performance, it is possible to execute the training workload on a subset of real nodes and emulate the networked execution environment along with the collective communication operations. Initial results from a proof-of-concept implementation show that NeuronaBox replicates the behavior of actual systems with high accuracy, with an error margin of less than 1% between the emulated measurements and the real system. △ Less

Submitted 5 May, 2024; originally announced May 2024.

Impact of Primordial Black Hole Dark Matter on Gas Properties at Very High Redshift: A Semi-Analytical Model

Authors: C. Casanueva-Villarreal, P. B. Tissera, N. Padilla, B. Liu, V. Bromm, S. Pedrosa, L. Bignone, R. Dominguez-Tenreiro

Abstract: Context. Primordial black holes (PBHs) have been proposed as potential candidates for dark matter (DM) and have garnered significant attention in recent years. Aims. Our objective is to delve into the distinct impact of PBHs on gas properties and their potential role in shaping the cosmic structure. Specifically, we aim to analyze the evolving gas properties while considering the presence of accre… ▽ More Context. Primordial black holes (PBHs) have been proposed as potential candidates for dark matter (DM) and have garnered significant attention in recent years. Aims. Our objective is to delve into the distinct impact of PBHs on gas properties and their potential role in shaping the cosmic structure. Specifically, we aim to analyze the evolving gas properties while considering the presence of accreting PBHs with varying monochromatic masses and in different quantities. By studying the feedback effects produced by this accretion, our final goal is to assess the plausibility of PBHs as candidates for DM. Methods. We develop a semi-analytical model which works on top of the CIELO hydrodynamical simulation around $z\sim23$. This model enables a comprehensive analysis of the evolution of gas properties influenced by PBHs. Our focus lies on the temperature and hydrogen abundances, placing specific emphasis on the region closest to the halo center. We explore PBH masses of $1$, $33$, and $100~\Msun$, located within mass windows where a substantial fraction of DM could exist in the form of PBHs. We investigate various DM fractions composed of these PBHs ($f_{\rm{PBH}}>10^{-4}$). Results. Our findings suggest that the existence of PBHs with masses of $1~\Msun$ and fractions greater than or equal to approximately $10^{-2}$ would be ruled out due to the significant changes induced in gas properties. The same applies to PBHs with a mass of $33~\Msun$ and $100~\Msun$ and fractions greater than approximately $10^{-3}$. These effects are particularly pronounced in the region nearest to the halo center, potentially leading to delayed galaxy formation within haloes. △ Less

Submitted 3 May, 2024; originally announced May 2024.

Journal ref: A&A 688, A183 (2024)

EiG-Search: Generating Edge-Induced Subgraphs for GNN Explanation in Linear Time

Authors: Shengyao Lu, Bang Liu, Keith G. Mills, Jiao He, Di Niu

Abstract: Understanding and explaining the predictions of Graph Neural Networks (GNNs), is crucial for enhancing their safety and trustworthiness. Subgraph-level explanations are gaining attention for their intuitive appeal. However, most existing subgraph-level explainers face efficiency challenges in explaining GNNs due to complex search processes. The key challenge is to find a balance between intuitiven… ▽ More Understanding and explaining the predictions of Graph Neural Networks (GNNs), is crucial for enhancing their safety and trustworthiness. Subgraph-level explanations are gaining attention for their intuitive appeal. However, most existing subgraph-level explainers face efficiency challenges in explaining GNNs due to complex search processes. The key challenge is to find a balance between intuitiveness and efficiency while ensuring transparency. Additionally, these explainers usually induce subgraphs by nodes, which may introduce less-intuitive disconnected nodes in the subgraph-level explanations or omit many important subgraph structures. In this paper, we reveal that inducing subgraph explanations by edges is more comprehensive than other subgraph inducing techniques. We also emphasize the need of determining the subgraph explanation size for each data instance, as different data instances may involve different important substructures. Building upon these considerations, we introduce a training-free approach, named EiG-Search. We employ an efficient linear-time search algorithm over the edge-induced subgraphs, where the edges are ranked by an enhanced gradient-based importance. We conduct extensive experiments on a total of seven datasets, demonstrating its superior performance and efficiency both quantitatively and qualitatively over the leading baselines. △ Less

Submitted 16 May, 2024; v1 submitted 2 May, 2024; originally announced May 2024.

Comments: 19 pages

Journal ref: ICML 2024

LidaRF: Delving into Lidar for Neural Radiance Field on Street Scenes

Authors: Shanlin Sun, Bingbing Zhuang, Ziyu Jiang, Buyu Liu, Xiaohui Xie, Manmohan Chandraker

Abstract: Photorealistic simulation plays a crucial role in applications such as autonomous driving, where advances in neural radiance fields (NeRFs) may allow better scalability through the automatic creation of digital 3D assets. However, reconstruction quality suffers on street scenes due to largely collinear camera motions and sparser samplings at higher speeds. On the other hand, the application often… ▽ More Photorealistic simulation plays a crucial role in applications such as autonomous driving, where advances in neural radiance fields (NeRFs) may allow better scalability through the automatic creation of digital 3D assets. However, reconstruction quality suffers on street scenes due to largely collinear camera motions and sparser samplings at higher speeds. On the other hand, the application often demands rendering from camera views that deviate from the inputs to accurately simulate behaviors like lane changes. In this paper, we propose several insights that allow a better utilization of Lidar data to improve NeRF quality on street scenes. First, our framework learns a geometric scene representation from Lidar, which is fused with the implicit grid-based representation for radiance decoding, thereby supplying stronger geometric information offered by explicit point cloud. Second, we put forth a robust occlusion-aware depth supervision scheme, which allows utilizing densified Lidar points by accumulation. Third, we generate augmented training views from Lidar points for further improvement. Our insights translate to largely improved novel view synthesis under real driving scenes. △ Less

Submitted 4 May, 2024; v1 submitted 1 May, 2024; originally announced May 2024.

Comments: CVPR2024 Highlights

Experimental Aspects of Indefinite Causal Order in Quantum Mechanics

Authors: Lee A. Rozema, Teodor Strömberg, Huan Cao, Yu Guo, Bi-Heng Liu, Philip Walther

Abstract: In the past decade, the toolkit of quantum information has been expanded to include processes in which the basic operations do not have definite causal relations. Originally considered in the context of the unification of quantum mechanics and general relativity, these causally indefinite processes have been shown to offer advantages in a wide variety of quantum information processing tasks, rangi… ▽ More In the past decade, the toolkit of quantum information has been expanded to include processes in which the basic operations do not have definite causal relations. Originally considered in the context of the unification of quantum mechanics and general relativity, these causally indefinite processes have been shown to offer advantages in a wide variety of quantum information processing tasks, ranging from quantum computation to quantum metrology. Here we overview these advantages and the experimental efforts to realise them. We survey both the different experimental techniques employed, as well as theoretical methods developed in support of the experiments, before discussing the interpretations of current experimental results and giving an outlook on the future of the field. △ Less

Submitted 19 July, 2024; v1 submitted 1 May, 2024; originally announced May 2024.

Comments: 22 page review article. Comments welcome!

Journal ref: Nature Reviews Physics (2024)

Adapting Open-Source Large Language Models for Cost-Effective, Expert-Level Clinical Note Generation with On-Policy Reinforcement Learning

Authors: Hanyin Wang, Chufan Gao, Bolun Liu, Qiping Xu, Guleid Hussein, Mohamad El Labban, Kingsley Iheasirim, Hariprasad Korsapati, Chuck Outcalt, Jimeng Sun

Abstract: Proprietary Large Language Models (LLMs) such as GPT-4 and Gemini have demonstrated promising capabilities in clinical text summarization tasks. However, due to patient data privacy concerns and computational costs, many healthcare providers prefer using small, locally-hosted models over external generic LLMs. This study presents a comprehensive domain- and task-specific adaptation process for the… ▽ More Proprietary Large Language Models (LLMs) such as GPT-4 and Gemini have demonstrated promising capabilities in clinical text summarization tasks. However, due to patient data privacy concerns and computational costs, many healthcare providers prefer using small, locally-hosted models over external generic LLMs. This study presents a comprehensive domain- and task-specific adaptation process for the open-source LLaMA-2 13 billion parameter model, enabling it to generate high-quality clinical notes from outpatient patient-doctor dialogues. Our process incorporates continued pre-training, supervised fine-tuning, and reinforcement learning from both AI and human feedback. We introduced a new approach, DistillDirect, for performing on-policy reinforcement learning with Gemini 1.0 Pro as the teacher model. Our resulting model, LLaMA-Clinic, can generate clinical notes comparable in quality to those authored by physicians. In a blinded physician reader study, the majority (90.4%) of individual evaluations rated the notes generated by LLaMA-Clinic as "acceptable" or higher across all three criteria: real-world readiness, completeness, and accuracy. In the more challenging "Assessment and Plan" section, LLaMA-Clinic scored higher (4.2/5) in real-world readiness than physician-authored notes (4.1/5). Our cost analysis for inference shows that our LLaMA-Clinic model achieves a 3.75-fold cost reduction compared to an external generic LLM service. Additionally, we highlight key considerations for future clinical note-generation tasks, emphasizing the importance of pre-defining a best-practice note format, rather than relying on LLMs to determine this for clinical practice. We have made our newly created synthetic clinic dialogue-note dataset and the physician feedback dataset publicly available to foster future research. △ Less

Submitted 9 June, 2024; v1 submitted 25 April, 2024; originally announced May 2024.

Dual-Role AoI-based Incentive Mechanism for HD map Crowdsourcing

Authors: Wentao Ye, Bo Liu, Yuan Luo, Jianwei Huang

Abstract: A high-quality fresh high-definition (HD) map is vital in enhancing transportation efficiency and safety in autonomous driving. Vehicle-based crowdsourcing offers a promising approach for updating HD maps. However, recruiting crowdsourcing vehicles involves making the challenging tradeoff between the HD map freshness and recruitment costs. Existing studies on HD map crowdsourcing often (1) priorit… ▽ More A high-quality fresh high-definition (HD) map is vital in enhancing transportation efficiency and safety in autonomous driving. Vehicle-based crowdsourcing offers a promising approach for updating HD maps. However, recruiting crowdsourcing vehicles involves making the challenging tradeoff between the HD map freshness and recruitment costs. Existing studies on HD map crowdsourcing often (1) prioritize maximizing spatial coverage and (2) overlook the dual role of crowdsourcing vehicles in HD maps, as vehicles serve both as contributors and customers of HD maps. This motivates us to propose the Dual-Role Age of Information (AoI) based Incentive Mechanism (DRAIM) to address these issues. % Specifically, we propose the trajectory age of information, incorporating the expected AoI of the HD map and the trajectory, to quantify a vehicle's HD map usage utility, which is freshness- and trajectory-dependent. DRAIM aims to achieve the company's tradeoff between freshness and recruitment costs. △ Less

Submitted 1 May, 2024; originally announced May 2024.