Showing 151–200 of 551 results for author: Yan, M

Learning Trajectory-Word Alignments for Video-Language Tasks

Authors: Xu Yang, Zhangzikang Li, Haiyang Xu, Hanwang Zhang, Qinghao Ye, Chenliang Li, Ming Yan, Yu Zhang, Fei Huang, Songfang Huang

Abstract: In a video, an object usually appears as the trajectory, i.e., it spans over a few spatial but longer temporal patches, that contains abundant spatiotemporal contexts. However, modern Video-Language BERTs (VDL-BERTs) neglect this trajectory characteristic that they usually follow image-language BERTs (IL-BERTs) to deploy the patch-to-word (P2W) attention that may over-exploit trivial spatial conte… ▽ More In a video, an object usually appears as the trajectory, i.e., it spans over a few spatial but longer temporal patches, that contains abundant spatiotemporal contexts. However, modern Video-Language BERTs (VDL-BERTs) neglect this trajectory characteristic that they usually follow image-language BERTs (IL-BERTs) to deploy the patch-to-word (P2W) attention that may over-exploit trivial spatial contexts and neglect significant temporal contexts. To amend this, we propose a novel TW-BERT to learn Trajectory-Word alignment by a newly designed trajectory-to-word (T2W) attention for solving video-language tasks. Moreover, previous VDL-BERTs usually uniformly sample a few frames into the model while different trajectories have diverse graininess, i.e., some trajectories span longer frames and some span shorter, and using a few frames will lose certain useful temporal contexts. However, simply sampling more frames will also make pre-training infeasible due to the largely increased training burdens. To alleviate the problem, during the fine-tuning stage, we insert a novel Hierarchical Frame-Selector (HFS) module into the video encoder. HFS gradually selects the suitable frames conditioned on the text context for the later cross-modal encoder to learn better trajectory-word alignments. By the proposed T2W attention and HFS, our TW-BERT achieves SOTA performances on text-to-video retrieval tasks, and comparable performances on video question-answering tasks with some VDL-BERTs trained on much more data. The code will be available in the supplementary material. △ Less

Submitted 9 March, 2023; v1 submitted 5 January, 2023; originally announced January 2023.

HiTeA: Hierarchical Temporal-Aware Video-Language Pre-training

Authors: Qinghao Ye, Guohai Xu, Ming Yan, Haiyang Xu, Qi Qian, Ji Zhang, Fei Huang

Abstract: Video-language pre-training has advanced the performance of various downstream video-language tasks. However, most previous methods directly inherit or adapt typical image-language pre-training paradigms to video-language pre-training, thus not fully exploiting the unique characteristic of video, i.e., temporal. In this paper, we propose a Hierarchical Temporal-Aware video-language pre-training fr… ▽ More Video-language pre-training has advanced the performance of various downstream video-language tasks. However, most previous methods directly inherit or adapt typical image-language pre-training paradigms to video-language pre-training, thus not fully exploiting the unique characteristic of video, i.e., temporal. In this paper, we propose a Hierarchical Temporal-Aware video-language pre-training framework, HiTeA, with two novel pre-training tasks for modeling cross-modal alignment between moments and texts as well as the temporal relations of video-text pairs. Specifically, we propose a cross-modal moment exploration task to explore moments in videos, which results in detailed video moment representation. Besides, the inherent temporal relations are captured by aligning video-text pairs as a whole in different time resolutions with multi-modal temporal relation exploration task. Furthermore, we introduce the shuffling test to evaluate the temporal reliance of datasets and video-language pre-training models. We achieve state-of-the-art results on 15 well-established video-language understanding and generation tasks, especially on temporal-oriented datasets (e.g., SSv2-Template and SSv2-Label) with 8.6% and 11.1% improvement respectively. HiTeA also demonstrates strong generalization ability when directly transferred to downstream tasks in a zero-shot manner. Models and demo will be available on ModelScope. △ Less

Submitted 29 December, 2022; originally announced December 2022.

The $S$- and $P$-wave fully charmed tetraquark states and their radial excitations

Authors: Guo-Liang Yu, Zhen-Yu Li, Zhi-Gang Wang, Jie Lu, Meng Yan

Abstract: Inspired by recent progresses in observations of the fully charmed tetraquark states by LHCb, CMS, and ATLAS Collaborations, we perform a systematic study of the ground states and the first radial excitations of the $S$- and $P$-wave $\mathrm{cc}\bar{\mathrm{c}}\bar{\mathrm{c}}$ system. Their mass spectra, root mean square(r.m.s.) radii and radial density distributions are studied with the relativ… ▽ More Inspired by recent progresses in observations of the fully charmed tetraquark states by LHCb, CMS, and ATLAS Collaborations, we perform a systematic study of the ground states and the first radial excitations of the $S$- and $P$-wave $\mathrm{cc}\bar{\mathrm{c}}\bar{\mathrm{c}}$ system. Their mass spectra, root mean square(r.m.s.) radii and radial density distributions are studied with the relativized quark model. The calculations show that there is no stable bound states for the full-charmed tetraquark states, and the r.m.s. radii of these tetraquark states are smaller than 1 fm. Our results support assigning X(6600) structure, $M_{X(6600)}=6552\pm10\pm12$ MeV, as one of the $0^{++}$(1$S$) and $2^{++}$(1$S$) states or their mixtures. Another structure also named as X(6600) by CMS Collaboration, $M_{X(6600)}=6.62\pm0.03^{+0.02}_{-0.01}$ GeV, may arise from the lowest 1$P$ states with $J^{PC}$=$0^{-+}$, $1^{-+}$, and $2^{-+}$. The possible assignments for X(6900) include the $0^{++}$(2$S$), $2^{++}$(2$S$) states, and the highest 1$P$ state with $J^{PC}=0^{-+}$. As for X(7200), it can be interpreted as one of the highest 2$P$ states with $J^{PC}=0^{-+}$, $1^{-+}$, and $2^{-+}$, and the 3$S$ states can not be completely excluded from the candidates. △ Less

Submitted 3 April, 2023; v1 submitted 29 December, 2022; originally announced December 2022.

Comments: to be published in European Physical Journal C

Journal ref: Eur. Phys. J. C (2023) 83:416

Individual pulse emission from the diffuse drifter PSR J1401$-$6357 using the ultrawideband receiver on the Parkes radio telescope

Authors: J. L. Chen, Z. G. Wen, X. F. Duan, D. L. He, N. Wang, H. G. Wang, R. Yuen, J. P. Yuan, W. M. Yan, Z. Wang, C. B. Lv, H. Wang, S. R. Cui

Abstract: In this study, we report on a detailed single pulse analysis of the radio emission from the pulsar J1401$-$6357 (B1358$-$63) based on data observed with the ultrawideband low-frequency receiver on the Parkes radio telescope. In addition to a weak leading component, the integrated pulse profile features a single-humped structure with a slight asymmetry. The frequency evolution of the pulse profile… ▽ More In this study, we report on a detailed single pulse analysis of the radio emission from the pulsar J1401$-$6357 (B1358$-$63) based on data observed with the ultrawideband low-frequency receiver on the Parkes radio telescope. In addition to a weak leading component, the integrated pulse profile features a single-humped structure with a slight asymmetry. The frequency evolution of the pulse profile is studied. Well-defined nulls, with an estimated nulling fraction greater than 2\%, are present across the whole frequency band. No emission is detected with significance above 3$σ$ in the average pulse profile integrated over all null pulses. Using fluctuation spectral analysis, we reveal the existence of temporal-dependent subpulse drifting in this pulsar for the first time. A clear double-peaked feature is present at exactly the alias border across the whole frequency band, which suggests that the apparent drift sense changes during the observation. Our observations provide further confirmation that the phenomena of pulse nulling and subpulse drifting are independent of observing frequency, which suggest that they invoke changes on the global magnetospheric scale. △ Less

Submitted 9 December, 2022; originally announced December 2022.

Comments: 10 pages, 13 figures

FedRolex: Model-Heterogeneous Federated Learning with Rolling Sub-Model Extraction

Authors: Samiul Alam, Luyang Liu, Ming Yan, Mi Zhang

Abstract: Most cross-device federated learning (FL) studies focus on the model-homogeneous setting where the global server model and local client models are identical. However, such constraint not only excludes low-end clients who would otherwise make unique contributions to model training but also restrains clients from training large models due to on-device resource bottlenecks. In this work, we propose F… ▽ More Most cross-device federated learning (FL) studies focus on the model-homogeneous setting where the global server model and local client models are identical. However, such constraint not only excludes low-end clients who would otherwise make unique contributions to model training but also restrains clients from training large models due to on-device resource bottlenecks. In this work, we propose FedRolex, a partial training (PT)-based approach that enables model-heterogeneous FL and can train a global server model larger than the largest client model. At its core, FedRolex employs a rolling sub-model extraction scheme that allows different parts of the global server model to be evenly trained, which mitigates the client drift induced by the inconsistency between individual client models and server model architectures. We show that FedRolex outperforms state-of-the-art PT-based model-heterogeneous FL methods (e.g. Federated Dropout) and reduces the gap between model-heterogeneous and model-homogeneous FL, especially under the large-model large-dataset regime. In addition, we provide theoretical statistical analysis on its advantage over Federated Dropout and evaluate FedRolex on an emulated real-world device distribution to show that FedRolex can enhance the inclusiveness of FL and boost the performance of low-end devices that would otherwise not benefit from FL. Our code is available at: https://github.com/AIoT-MLSys-Lab/FedRolex △ Less

Submitted 20 January, 2023; v1 submitted 3 December, 2022; originally announced December 2022.

Comments: 20 pages, 7 Figures, Published in 36th Conference on Neural Information Processing And Systems

On the Perturbation of Synchrotron Motion in the Micro-Bunching Instability

Authors: Tobias Boltz, Miriam Brosi, Bastian Haerer, Patrik Schönfeldt, Patrick Schreiber, Minjie Yan, Anke-Susanne Müller

Abstract: The self-interaction of short electron bunches with their own radiation field can have a significant impact on the longitudinal beam dynamics in a storage ring. While higher bunch currents increase the power of the emitted CSR which can be provided to dedicated experiments, it simultaneously amplifies the strength of the self-interaction. Eventually, this leads to the formation of dynamically chan… ▽ More The self-interaction of short electron bunches with their own radiation field can have a significant impact on the longitudinal beam dynamics in a storage ring. While higher bunch currents increase the power of the emitted CSR which can be provided to dedicated experiments, it simultaneously amplifies the strength of the self-interaction. Eventually, this leads to the formation of dynamically changing micro-structures within the bunch and thus fluctuating CSR emission, a phenomenon that is generally known as micro-bunching or micro-wave instability. The underlying longitudinal dynamics can be simulated by solving the VFP equation, where the CSR self-interaction can be added as a perturbation to the Hamiltonian. In this contribution, we focus on the perturbation of the synchrotron motion that is caused by introducing this additional wake field. Therefore, we adopt the perspective of a single particle and eventually comment on its implications for collective motion. We explicitly show how the shape of the parallel plates CSR wake potential breaks homogeneity in the longitudinal phase space and propose a quadrupole-like mode as potential seeding mechanism of the micro-bunching instability. Moreover, we consider synchrotron motion above the instability threshold and thereby motivate an approach to control of the occurring micro-bunching dynamics. Using dynamically adjusted RF amplitude modulations we can directly address the continuous CSR-induced perturbation at the timescale of its occurrence, which allows for substantial control over the longitudinal charge distribution. While the approach is not limited to this particular application, we demonstrate how this can significantly mitigate the micro-bunching dynamics directly above the instability threshold. The gained insights are supported and verified using the VFP solver Inovesa and put into context with measurements at KARA. △ Less

Submitted 28 November, 2022; originally announced November 2022.

High-temperature ferromagnetism and strong $π$-conjugation feature in two-dimensional manganese tetranitride

Authors: Ming Yan, Z. Y. Xie, Miao Gao

Abstract: Two-dimensional (2D) magnetic materials have attracted tremendous research interest because of the promising application in the next-generation microelectronic devices. Here, by the first-principles calculations, we propose a two-dimensional ferromagnetic material with high Curie temperature, manganese tetranitride MnN$_4$ monolayer, which is a square-planar lattice made up of only one layer of at… ▽ More Two-dimensional (2D) magnetic materials have attracted tremendous research interest because of the promising application in the next-generation microelectronic devices. Here, by the first-principles calculations, we propose a two-dimensional ferromagnetic material with high Curie temperature, manganese tetranitride MnN$_4$ monolayer, which is a square-planar lattice made up of only one layer of atoms. The structure is demonstrated to be stable by the phonon spectra and the molecular dynamic simulations, and the stability is ascribed to the $π$-d conjugation between $π$ orbital of N=N bond and Mn $d$ orbital. More interestingly, the MnN$_4$ monolayer displays robust 2D ferromagnetism, which originates from the strong exchange couplings between Mn atoms due to the $π$-d conjugation. The high critical temperature of 247 K is determined by solving the Heisenberg model with the Monte Carlo method. △ Less

Submitted 27 November, 2022; originally announced November 2022.

Journal ref: Chin. Phys. B 32, 037104 (2023)

A Scheme to fabricate magnetic graphene-like cobalt nitride CoN4monolayer proposed by first-principles calculations

Authors: Ming Yan, Shuo Zhang, Yanyun Wang, Fengjie Ma

Abstract: We propose a scheme to fabricate the cobalt nitride CoN4 monolayer, a magnetic graphene-like two-dimensional material, in which all Co and N atoms are in a plane. Under the pressure above 40 GPa, the bulk CoN4 is stabilized in a triclinic phase. With the pressure decreasing, the triclinic phase of CoN4 is transformed into an orthorhombic phase, and the latter is a layered compound with large inter… ▽ More We propose a scheme to fabricate the cobalt nitride CoN4 monolayer, a magnetic graphene-like two-dimensional material, in which all Co and N atoms are in a plane. Under the pressure above 40 GPa, the bulk CoN4 is stabilized in a triclinic phase. With the pressure decreasing, the triclinic phase of CoN4 is transformed into an orthorhombic phase, and the latter is a layered compound with large interlayer spacing. At ambient condition, the weak interlayer couplings are so small that single CoN4 layer can be exfoliated by the mechanical method. △ Less

Submitted 27 November, 2022; originally announced November 2022.

Impact of Lattice Strangeness Asymmetry Data in the CTEQ-TEA Global Analysis

Authors: Tie-Jiun Hou, Huey-Wen Lin, Mengshi Yan, C. -P. Yuan

Abstract: We study the impact of lattice data on the determination of the strangeness asymmetry distribution $s_-(x) \equiv s(x) - {\bar s}(x)$ in the general CTEQ-TEA global analysis of parton distribution functions (PDFs) of the proton. Firstly, we find that allowing a nonvanishing $s_-(x)$, at the initial $Q_0=1.3$~GeV scale, in a global PDF analysis leads to a CT18As fit with similar quality to CT18A. S… ▽ More We study the impact of lattice data on the determination of the strangeness asymmetry distribution $s_-(x) \equiv s(x) - {\bar s}(x)$ in the general CTEQ-TEA global analysis of parton distribution functions (PDFs) of the proton. Firstly, we find that allowing a nonvanishing $s_-(x)$, at the initial $Q_0=1.3$~GeV scale, in a global PDF analysis leads to a CT18As fit with similar quality to CT18A. Secondly, including the lattice data in the CT18As\_Lat fit greatly reduces the $s_-$-PDF error band size in the large-$x$ region. To further reduce its error would require more precise lattice data, extended to smaller $x$ values. We take ATLAS 7 TeV $W$ and $Z$ production data, SIDIS di-muon production data, $F_3$ structure function data, E866 NuSea data, and E906 SeaQuest data as examples to illustrate the implication of CT18As and CT18As\_Lat fits. The parametrization dependence for PDF ratio $(s+\bar{s})/(\bar{u}+\bar{d})(x)$ is analyzed with CT18As2 and CT18As2\_Lat fits as results. △ Less

Submitted 20 November, 2022; originally announced November 2022.

Comments: 37 pages, 19 figures. arXiv admin note: text overlap with arXiv:2204.07944

Rethinking the $P_c(4457)^+$ as the $P_ψ^{Δ^+}(4457)$ isoquartet $\bar{D}^* Σ_c$ molecule

Authors: Fang-Zheng Peng, Mao-Jun Yan, Mario Sánchez Sánchez, Manuel Pavon Valderrama

Abstract: The nature of the $P_{c}(4312)$, $P_c(4440)$ and $P_c(4457)$ pentaquarks is a fascinating theoretical question. Within the molecular picture their more usual interpretation is that of $I=\tfrac{1}{2}$ $\bar{D} Σ_c$ and $\bar{D}^* Σ_c$ bound states. Here we argue in favor of interpreting the $P_c(4457)$ pentaquark as a $I=\tfrac{3}{2}$ $\bar{D}^* Σ_c$ bound state (with spin $J=\tfrac{1}{2}$) instea… ▽ More The nature of the $P_{c}(4312)$, $P_c(4440)$ and $P_c(4457)$ pentaquarks is a fascinating theoretical question. Within the molecular picture their more usual interpretation is that of $I=\tfrac{1}{2}$ $\bar{D} Σ_c$ and $\bar{D}^* Σ_c$ bound states. Here we argue in favor of interpreting the $P_c(4457)$ pentaquark as a $I=\tfrac{3}{2}$ $\bar{D}^* Σ_c$ bound state (with spin $J=\tfrac{1}{2}$) instead. Owing to isospin symmetry breaking effects, with this identification the partial decay width of the $P_c(4457)^+$ into $J/ψp$ will be of the same order of magnitude as the $P_{c}(4312)^+$ and $P_c(4440)^+$, in contrast with the considerably larger partial decay width in the $I=\tfrac{1}{2}$ scenario. In turn, this leads to a different hidden-charm molecular pentaquark spectrum, in which there are only four or five $P_ψ^N$ bound states instead of the usual seven, which might explain why the predicted $J=\tfrac{1}{2}$ and $\tfrac{3}{2}$ ($I=\tfrac{1}{2}$) $\bar{D}^* Σ_c^*$ molecular partners of the $P_c(4312)$ and $P_c(4440)$ have not been observed. △ Less

Submitted 16 November, 2022; originally announced November 2022.

Comments: 6 pages, 2 tables

Molecular $P_ψ$ pentaquarks from light-meson exchange saturation

Authors: Zi-Ying Yang, Fang-Zheng Peng, Mao-Jun Yan, Mario Sánchez Sánchez, Manuel Pavon Valderrama

Abstract: Theoretical predictions for the spectrum of heavy meson-baryon bound states are a fundamental tool for disentangling the nature of the different pentaquark states that have been observed in experimental facilities. Here we explore this spectrum in a phenomenological model that describes the heavy meson-baryon interaction in terms of a contact-range interaction, where the coupling strength is satur… ▽ More Theoretical predictions for the spectrum of heavy meson-baryon bound states are a fundamental tool for disentangling the nature of the different pentaquark states that have been observed in experimental facilities. Here we explore this spectrum in a phenomenological model that describes the heavy meson-baryon interaction in terms of a contact-range interaction, where the coupling strength is saturated by the exchange of light scalar and vector mesons, i.e. $σ$, $ρ$ and $ω$ exchanges. Saturation determines the couplings modulo an unknown proportionality constant that can be calibrated from a molecular candidate. If we use the $P_ψ^N(4312)$ as input, we predict a series of molecular pentaquarks including the $P_ψ^N(4440)$ and $P_ψ^N(4457)$, the recent $P_{ψs}^Λ(4338)$ and the $P_{ψs}^Λ(4459)$. △ Less

Submitted 15 November, 2022; originally announced November 2022.

Comments: 8 pages, 3 tables

Zero-shot Image Captioning by Anchor-augmented Vision-Language Space Alignment

Authors: Junyang Wang, Yi Zhang, Ming Yan, Ji Zhang, Jitao Sang

Abstract: CLIP (Contrastive Language-Image Pre-Training) has shown remarkable zero-shot transfer capabilities in cross-modal correlation tasks such as visual classification and image retrieval. However, its performance in cross-modal generation tasks like zero-shot image captioning remains unsatisfied. In this work, we discuss that directly employing CLIP for zero-shot image captioning relies more on the te… ▽ More CLIP (Contrastive Language-Image Pre-Training) has shown remarkable zero-shot transfer capabilities in cross-modal correlation tasks such as visual classification and image retrieval. However, its performance in cross-modal generation tasks like zero-shot image captioning remains unsatisfied. In this work, we discuss that directly employing CLIP for zero-shot image captioning relies more on the textual modality in context and largely ignores the visual information, which we call \emph{contextual language prior}. To address this, we propose Cross-modal Language Models (CLMs) to facilitate unsupervised cross-modal learning. We further propose Anchor Augment to guide the generative model's attention to the fine-grained information in the representation of CLIP. Experiments on MS COCO and Flickr 30K validate the promising performance of proposed approach in both captioning quality and computational efficiency. △ Less

Submitted 14 November, 2022; originally announced November 2022.

A Comprehensive Survey on Distributed Training of Graph Neural Networks

Authors: Haiyang Lin, Mingyu Yan, Xiaochun Ye, Dongrui Fan, Shirui Pan, Wenguang Chen, Yuan Xie

Abstract: Graph neural networks (GNNs) have been demonstrated to be a powerful algorithmic model in broad application fields for their effectiveness in learning over graphs. To scale GNN training up for large-scale and ever-growing graphs, the most promising solution is distributed training which distributes the workload of training across multiple computing nodes. At present, the volume of related research… ▽ More Graph neural networks (GNNs) have been demonstrated to be a powerful algorithmic model in broad application fields for their effectiveness in learning over graphs. To scale GNN training up for large-scale and ever-growing graphs, the most promising solution is distributed training which distributes the workload of training across multiple computing nodes. At present, the volume of related research on distributed GNN training is exceptionally vast, accompanied by an extraordinarily rapid pace of publication. Moreover, the approaches reported in these studies exhibit significant divergence. This situation poses a considerable challenge for newcomers, hindering their ability to grasp a comprehensive understanding of the workflows, computational patterns, communication strategies, and optimization techniques employed in distributed GNN training. As a result, there is a pressing need for a survey to provide correct recognition, analysis, and comparisons in this field. In this paper, we provide a comprehensive survey of distributed GNN training by investigating various optimization techniques used in distributed GNN training. First, distributed GNN training is classified into several categories according to their workflows. In addition, their computational patterns and communication patterns, as well as the optimization techniques proposed by recent work are introduced. Second, the software frameworks and hardware platforms of distributed GNN training are also introduced for a deeper understanding. Third, distributed GNN training is compared with distributed training of deep neural networks, emphasizing the uniqueness of distributed GNN training. Finally, interesting issues and opportunities in this field are discussed. △ Less

Submitted 29 November, 2023; v1 submitted 10 November, 2022; originally announced November 2022.

Comments: To Appear in Proceedings of the IEEE

Cyber-physical interdependent restoration scheduling for active distribution network via ad hoc wireless communication

Authors: Chongyu Wang, Mingyu Yan, Kaiyuan Pang, Fushuan Wen, Fei Teng

Abstract: This paper proposes a post-disaster cyber-physical interdependent restoration scheduling (CPIRS) framework for active distribution networks (ADN) where the simultaneous damages on cyber and physical networks are considered. The ad hoc wireless device-to-device (D2D) communication is leveraged, for the first time, to establish cyber networks instantly after the disaster to support ADN restoration.… ▽ More This paper proposes a post-disaster cyber-physical interdependent restoration scheduling (CPIRS) framework for active distribution networks (ADN) where the simultaneous damages on cyber and physical networks are considered. The ad hoc wireless device-to-device (D2D) communication is leveraged, for the first time, to establish cyber networks instantly after the disaster to support ADN restoration. The repair and operation crew dispatching, the remote-controlled network reconfiguration and the system operation with DERs can be effectively coordinated under the cyber-physical interactions. The uncertain outputs of renewable energy resources (RESs) are represented by budget-constrained polyhedral uncertainty sets. Through implementing linearization techniques on disjunctive expressions, a monolithic mixed-integer linear programming (MILP) based two-stage robust optimization model is formulated and subsequently solved by a customized column-and-constraint generation (C&CG) algorithm. Numerical results on the IEEE 123-node distribution system demonstrate the effectiveness and superiorities of the proposed CPIRS method for ADN. △ Less

Submitted 5 November, 2022; originally announced November 2022.

Hadronic decays of the heavy-quark-spin molecular partner of $T_{cc}^+$

Authors: Zhao-Sai Jia, Mao-Jun Yan, Zhen-Hua Zhang, Pan-Pan Shi, Gang Li, Feng-Kun Guo

Abstract: Starting from the hypothesis that the $T_{cc}^+$ discovered at LHCb is a $D^{\ast+} D^0/D^{\ast 0}D^+$ hadronic molecule, we consider the partial width of its heavy quark spin partner, the $T_{cc}^{\ast +}$ as a $D^{\ast +} D^{\ast 0}$ shallow bound state, decaying into the $D^{\ast}Dπ$ final states including the contributions of the $D^{\ast} D$ and $D^{\ast} π$ final state interaction by using a… ▽ More Starting from the hypothesis that the $T_{cc}^+$ discovered at LHCb is a $D^{\ast+} D^0/D^{\ast 0}D^+$ hadronic molecule, we consider the partial width of its heavy quark spin partner, the $T_{cc}^{\ast +}$ as a $D^{\ast +} D^{\ast 0}$ shallow bound state, decaying into the $D^{\ast}Dπ$ final states including the contributions of the $D^{\ast} D$ and $D^{\ast} π$ final state interaction by using a nonrelativistic effective field theory. Because of the existence of the $T_{cc}^+$ pole, the $I=0$ $D^{\ast} D$ rescattering can give a sizeable correction up to about $40\%$ to the decay widths considering only the tree diagrams, and the $D^{\ast} π$ rescattering correction is about $10\%$. The four-body partial widths of the $T_{cc}^{*+}$ into $D Dππ$ are also explicitly calculated, and we find that the interference effect between different intermediate $D^*Dπ$ states is small. The total width of the $T_{cc}^{*+}$ is predicted to be about 41 keV. △ Less

Submitted 19 April, 2023; v1 submitted 4 November, 2022; originally announced November 2022.

Comments: 31 pages, 10 figues. Results updated and extended, version to be published in Phys. Rev. D

Journal ref: Phys. Rev. D 107, 074029 (2023)

Systematic analysis of doubly charmed baryons $Ξ_{cc}$ and $Ω_{cc}$

Authors: Guo-Liang Yu, Zhen-Yu Li, Zhi-Gang Wang, Jie Lu, Meng Yan

Abstract: In this work, we perform a systematic study of the mass spectra, the root mean square(r.m.s.) radii and the radial density distributions of the doubly charmed baryons $Ξ_{cc}$ and $Ω_{cc}$. The calculations are carried out in the frame work of Godfrey-Isgur (GI) relativized quark model, where the baryon is regarded as a real three-body system of quarks. Our results show that the excited energy of… ▽ More In this work, we perform a systematic study of the mass spectra, the root mean square(r.m.s.) radii and the radial density distributions of the doubly charmed baryons $Ξ_{cc}$ and $Ω_{cc}$. The calculations are carried out in the frame work of Godfrey-Isgur (GI) relativized quark model, where the baryon is regarded as a real three-body system of quarks. Our results show that the excited energy of doubly charmed baryon with $ρ$-mode is lower than those of the $λ$-mode and $λ$-$ρ$ mixing mode, which indicates that the lowest state is dominated by the $ρ$-mode. According to this conclusion, we systematically investigate the mass spectra, the r.m.s. radii of the ground and excited states($1S\sim4S$, $1P\sim4P$, $1D\sim4D$, $1F\sim4F$ and $1G\sim4G$) with $ρ$-mode. Using the wave functions obtained from quark model, we also study the radial density distributions. Finally, with the predicated mass spectra, the Regge trajectories of $Ξ_{cc}$ and $Ω_{cc}$ in the ($J$,$M^{2}$) plane are constructed, and the slopes, intercepts are determined by linear fitting. It is found that model predicted masses fit nicely to the constructed Regge trajectories. △ Less

Submitted 6 July, 2023; v1 submitted 1 November, 2022; originally announced November 2022.

Journal ref: Eur. Phys. J. A (2023) 59:126

Eye-tracking based classification of Mandarin Chinese readers with and without dyslexia using neural sequence models

Authors: Patrick Haller, Andreas Säuberli, Sarah Elisabeth Kiener, Jinger Pan, Ming Yan, Lena Jäger

Abstract: Eye movements are known to reflect cognitive processes in reading, and psychological reading research has shown that eye gaze patterns differ between readers with and without dyslexia. In recent years, researchers have attempted to classify readers with dyslexia based on their eye movements using Support Vector Machines (SVMs). However, these approaches (i) are based on highly aggregated features… ▽ More Eye movements are known to reflect cognitive processes in reading, and psychological reading research has shown that eye gaze patterns differ between readers with and without dyslexia. In recent years, researchers have attempted to classify readers with dyslexia based on their eye movements using Support Vector Machines (SVMs). However, these approaches (i) are based on highly aggregated features averaged over all words read by a participant, thus disregarding the sequential nature of the eye movements, and (ii) do not consider the linguistic stimulus and its interaction with the reader's eye movements. In the present work, we propose two simple sequence models that process eye movements on the entire stimulus without the need of aggregating features across the sentence. Additionally, we incorporate the linguistic stimulus into the model in two ways -- contextualized word embeddings and manually extracted linguistic features. The models are evaluated on a Mandarin Chinese dataset containing eye movements from children with and without dyslexia. Our results show that (i) even for a logographic script such as Chinese, sequence models are able to classify dyslexia on eye gaze sequences, reaching state-of-the-art performance, and (ii) incorporating the linguistic stimulus does not help to improve classification performance. △ Less

Submitted 2 December, 2022; v1 submitted 18 October, 2022; originally announced October 2022.

Communication-Efficient Topologies for Decentralized Learning with $O(1)$ Consensus Rate

Authors: Zhuoqing Song, Weijian Li, Kexin Jin, Lei Shi, Ming Yan, Wotao Yin, Kun Yuan

Abstract: Decentralized optimization is an emerging paradigm in distributed learning in which agents achieve network-wide solutions by peer-to-peer communication without the central server. Since communication tends to be slower than computation, when each agent communicates with only a few neighboring agents per iteration, they can complete iterations faster than with more agents or a central server. Howev… ▽ More Decentralized optimization is an emerging paradigm in distributed learning in which agents achieve network-wide solutions by peer-to-peer communication without the central server. Since communication tends to be slower than computation, when each agent communicates with only a few neighboring agents per iteration, they can complete iterations faster than with more agents or a central server. However, the total number of iterations to reach a network-wide solution is affected by the speed at which the agents' information is ``mixed'' by communication. We found that popular communication topologies either have large maximum degrees (such as stars and complete graphs) or are ineffective at mixing information (such as rings and grids). To address this problem, we propose a new family of topologies, EquiTopo, which has an (almost) constant degree and a network-size-independent consensus rate that is used to measure the mixing efficiency. In the proposed family, EquiStatic has a degree of $Θ(\ln(n))$, where $n$ is the network size, and a series of time-dependent one-peer topologies, EquiDyn, has a constant degree of 1. We generate EquiDyn through a certain random sampling procedure. Both of them achieve an $n$-independent consensus rate. We apply them to decentralized SGD and decentralized gradient tracking and obtain faster communication and better convergence, theoretically and empirically. Our code is implemented through BlueFog and available at \url{https://github.com/kexinjinnn/EquiTopo} △ Less

Submitted 12 March, 2023; v1 submitted 14 October, 2022; originally announced October 2022.

Comments: NeurIPS 2022

Towards Joint Electricity and Data Trading: A Scalable Cooperative Game Theoretic Approach

Authors: Mingyu Yan, Fei Teng

Abstract: This paper, for the first time, proposes a joint electricity and data trading mechanism based on cooperative game theory. All prosumers first submit the parameters associated with both electricity and data to the market operator. The operator utilizes the public and prosumers' private data to forecast the distributed renewable generators (DRGs) and quantify the improvement driven by prosumers' pri… ▽ More This paper, for the first time, proposes a joint electricity and data trading mechanism based on cooperative game theory. All prosumers first submit the parameters associated with both electricity and data to the market operator. The operator utilizes the public and prosumers' private data to forecast the distributed renewable generators (DRGs) and quantify the improvement driven by prosumers' private data in terms of reduced uncertainty set. Then, the operator maximizes the grand coalition's total payoff considering the uncertain generation of DRGs and imputes the payoff to each prosumer based on their contribution to electricity and data sharing. The mathematical formulation of the grand coalition is developed and converted into a second order cone programming problem by using an affinepolicy based robust approach. The stability of such a grand coalition is mathematically proved, i.e., all prosumers are willing to cooperate. Furthermore, to address the scalability challenge of existing payoff imputation methods in the cooperative game, a two stage optimization based approach is proposed, which is converted into a mixed integer second order cone programming and solved by the Benders decomposition. Case studies illustrate all prosumers are motivated to trade electricity and data under the joint trading framework and the proposed imputation method significantly enhances the scalability. △ Less

Submitted 8 October, 2022; originally announced October 2022.

Construction and Applications of Billion-Scale Pre-Trained Multimodal Business Knowledge Graph

Authors: Shumin Deng, Chengming Wang, Zhoubo Li, Ningyu Zhang, Zelin Dai, Hehong Chen, Feiyu Xiong, Ming Yan, Qiang Chen, Mosha Chen, Jiaoyan Chen, Jeff Z. Pan, Bryan Hooi, Huajun Chen

Abstract: Business Knowledge Graphs (KGs) are important to many enterprises today, providing factual knowledge and structured data that steer many products and make them more intelligent. Despite their promising benefits, building business KG necessitates solving prohibitive issues of deficient structure and multiple modalities. In this paper, we advance the understanding of the practical challenges related… ▽ More Business Knowledge Graphs (KGs) are important to many enterprises today, providing factual knowledge and structured data that steer many products and make them more intelligent. Despite their promising benefits, building business KG necessitates solving prohibitive issues of deficient structure and multiple modalities. In this paper, we advance the understanding of the practical challenges related to building KG in non-trivial real-world systems. We introduce the process of building an open business knowledge graph (OpenBG) derived from a well-known enterprise, Alibaba Group. Specifically, we define a core ontology to cover various abstract products and consumption demands, with fine-grained taxonomy and multimodal facts in deployed applications. OpenBG is an open business KG of unprecedented scale: 2.6 billion triples with more than 88 million entities covering over 1 million core classes/concepts and 2,681 types of relations. We release all the open resources (OpenBG benchmarks) derived from it for the community and report experimental results of KG-centric tasks. We also run up an online competition based on OpenBG benchmarks, and has attracted thousands of teams. We further pre-train OpenBG and apply it to many KG- enhanced downstream tasks in business scenarios, demonstrating the effectiveness of billion-scale multimodal knowledge for e-commerce. All the resources with codes have been released at \url{https://github.com/OpenBGBenchmark/OpenBG}. △ Less

Submitted 19 March, 2023; v1 submitted 30 September, 2022; originally announced September 2022.

Comments: OpenBG. Accepted by ICDE 2023. The project is released at https://github.com/OpenBGBenchmark/OpenBG . Website: https://kg.alibaba.com/ , Leaderboard: https://tianchi.aliyun.com/dataset/dataDetail?dataId=122271

Tracking and Reconstructing Hand Object Interactions from Point Cloud Sequences in the Wild

Authors: Jiayi Chen, Mi Yan, Jiazhao Zhang, Yinzhen Xu, Xiaolong Li, Yijia Weng, Li Yi, Shuran Song, He Wang

Abstract: In this work, we tackle the challenging task of jointly tracking hand object pose and reconstructing their shapes from depth point cloud sequences in the wild, given the initial poses at frame 0. We for the first time propose a point cloud based hand joint tracking network, HandTrackNet, to estimate the inter-frame hand joint motion. Our HandTrackNet proposes a novel hand pose canonicalization mod… ▽ More In this work, we tackle the challenging task of jointly tracking hand object pose and reconstructing their shapes from depth point cloud sequences in the wild, given the initial poses at frame 0. We for the first time propose a point cloud based hand joint tracking network, HandTrackNet, to estimate the inter-frame hand joint motion. Our HandTrackNet proposes a novel hand pose canonicalization module to ease the tracking task, yielding accurate and robust hand joint tracking. Our pipeline then reconstructs the full hand via converting the predicted hand joints into a template-based parametric hand model MANO. For object tracking, we devise a simple yet effective module that estimates the object SDF from the first frame and performs optimization-based tracking. Finally, a joint optimization step is adopted to perform joint hand and object reasoning, which alleviates the occlusion-induced ambiguity and further refines the hand pose. During training, the whole pipeline only sees purely synthetic data, which are synthesized with sufficient variations and by depth simulation for the ease of generalization. The whole pipeline is pertinent to the generalization gaps and thus directly transferable to real in-the-wild data. We evaluate our method on two real hand object interaction datasets, e.g. HO3D and DexYCB, without any finetuning. Our experiments demonstrate that the proposed method significantly outperforms the previous state-of-the-art depth-based hand and object pose estimation and tracking methods, running at a frame rate of 9 FPS. △ Less

Submitted 24 September, 2022; originally announced September 2022.

Cloud Feedback on Earth's Long-term Climate Simulated by a Near-global Cloud-permitting Model

Authors: Mingyu Yan, Jun Yang, Yixiao Zhang, Han Huang

Abstract: The Sun becomes brighter with time, but Earth's climate is roughly temperate for life during its long-term history; for early Earth, this is known as the Faint Young Sun Problem (FYSP). Besides the carbonate-silicate feedback, recent researches suggest that a long-term cloud feedback may partially solve the FYSP. However, the general circulation models they used cannot resolve convection and cloud… ▽ More The Sun becomes brighter with time, but Earth's climate is roughly temperate for life during its long-term history; for early Earth, this is known as the Faint Young Sun Problem (FYSP). Besides the carbonate-silicate feedback, recent researches suggest that a long-term cloud feedback may partially solve the FYSP. However, the general circulation models they used cannot resolve convection and clouds explicitly. This study re-investigates the clouds using a near-global cloud-permitting model without cumulus convection parameterization. Our results confirm that a stabilizing shortwave cloud feedback does exist, and its magnitude is $\approx$6 W m$^{-2}$ or 14% of the energy required to offset a 20% fainter Sun than today, or $\approx$10 W m$^{-2}$ or 16% for a 30% fainter Sun. When insolation increases and meanwhile CO$_2$ concentration decreases, low-level clouds increase, acting to stabilize the climate by raising planetary albedo, and vice versa. △ Less

Submitted 6 September, 2022; originally announced September 2022.

Journal ref: Geophysical Research Letters, 49, e2022GL100152 (2022)

Rethinking Efficiency and Redundancy in Training Large-scale Graphs

Authors: Xin Liu, Xunbin Xiong, Mingyu Yan, Runzhen Xue, Shirui Pan, Xiaochun Ye, Dongrui Fan

Abstract: Large-scale graphs are ubiquitous in real-world scenarios and can be trained by Graph Neural Networks (GNNs) to generate representation for downstream tasks. Given the abundant information and complex topology of a large-scale graph, we argue that redundancy exists in such graphs and will degrade the training efficiency. Unfortunately, the model scalability severely restricts the efficiency of tra… ▽ More Large-scale graphs are ubiquitous in real-world scenarios and can be trained by Graph Neural Networks (GNNs) to generate representation for downstream tasks. Given the abundant information and complex topology of a large-scale graph, we argue that redundancy exists in such graphs and will degrade the training efficiency. Unfortunately, the model scalability severely restricts the efficiency of training large-scale graphs via vanilla GNNs. Despite recent advances in sampling-based training methods, sampling-based GNNs generally overlook the redundancy issue. It still takes intolerable time to train these models on large-scale graphs. Thereby, we propose to drop redundancy and improve efficiency of training large-scale graphs with GNNs, by rethinking the inherent characteristics in a graph. In this paper, we pioneer to propose a once-for-all method, termed DropReef, to drop the redundancy in large-scale graphs. Specifically, we first conduct preliminary experiments to explore potential redundancy in large-scale graphs. Next, we present a metric to quantify the neighbor heterophily of all nodes in a graph. Based on both experimental and theoretical analysis, we reveal the redundancy in a large-scale graph, i.e., nodes with high neighbor heterophily and a great number of neighbors. Then, we propose DropReef to detect and drop the redundancy in large-scale graphs once and for all, helping reduce the training time while ensuring no sacrifice in the model accuracy. To demonstrate the effectiveness of DropReef, we apply it to recent state-of-the-art sampling-based GNNs for training large-scale graphs, owing to the high precision of such models. With DropReef leveraged, the training efficiency of models can be greatly promoted. DropReef is highly compatible and is offline performed, benefiting the state-of-the-art sampling-based GNNs in the present and future to a significant extent. △ Less

Submitted 1 September, 2022; originally announced September 2022.

Comments: 11 Pages

Accelerated Sparse Recovery via Gradient Descent with Nonlinear Conjugate Gradient Momentum

Authors: Mengqi Hu, Yifei Lou, Bao Wang, Ming Yan, Xiu Yang, Qiang Ye

Abstract: This paper applies an idea of adaptive momentum for the nonlinear conjugate gradient to accelerate optimization problems in sparse recovery. Specifically, we consider two types of minimization problems: a (single) differentiable function and the sum of a non-smooth function and a differentiable function. In the first case, we adopt a fixed step size to avoid the traditional line search and establi… ▽ More This paper applies an idea of adaptive momentum for the nonlinear conjugate gradient to accelerate optimization problems in sparse recovery. Specifically, we consider two types of minimization problems: a (single) differentiable function and the sum of a non-smooth function and a differentiable function. In the first case, we adopt a fixed step size to avoid the traditional line search and establish the convergence analysis of the proposed algorithm for a quadratic problem. This acceleration is further incorporated with an operator splitting technique to deal with the non-smooth function in the second case. We use the convex $\ell_1$ and the nonconvex $\ell_1-\ell_2$ functionals as two case studies to demonstrate the efficiency of the proposed approaches over traditional methods. △ Less

Submitted 5 April, 2023; v1 submitted 25 August, 2022; originally announced August 2022.

Characterizing and Understanding HGNNs on GPUs

Authors: Mingyu Yan, Mo Zou, Xiaocheng Yang, Wenming Li, Xiaochun Ye, Dongrui Fan, Yuan Xie

Abstract: Heterogeneous graph neural networks (HGNNs) deliver powerful capacity in heterogeneous graph representation learning. The execution of HGNNs is usually accelerated by GPUs. Therefore, characterizing and understanding the execution pattern of HGNNs on GPUs is important for both software and hardware optimizations. Unfortunately, there is no detailed characterization effort of HGNN workloads on GPUs… ▽ More Heterogeneous graph neural networks (HGNNs) deliver powerful capacity in heterogeneous graph representation learning. The execution of HGNNs is usually accelerated by GPUs. Therefore, characterizing and understanding the execution pattern of HGNNs on GPUs is important for both software and hardware optimizations. Unfortunately, there is no detailed characterization effort of HGNN workloads on GPUs. In this paper, we characterize HGNN workloads at inference phase and explore the execution of HGNNs on GPU, to disclose the execution semantic and execution pattern of HGNNs. Given the characterization and exploration, we propose several useful guidelines for both software and hardware optimizations for the efficient execution of HGNNs on GPUs. △ Less

Submitted 9 August, 2022; originally announced August 2022.

Comments: To Appear in IEEE Computer Architecture Letters

Triangle singularity in $B^0\to π^- K^+ X(3872)$ via the $D_{s1}\bar{D} D^*$ loop and possible precise measurement of the $X(3872)$ mass

Authors: Mao-Jun Yan, Ying-Hui Ge, Xiao-Hai Liu

Abstract: We investigate the $B^0\to π^- K^+ X(3872)$ decay via the $D_{s1}(2536)\bar{D} D^*$ rescattering diagram. The line shape of the $K^+X(3872)$ distribution curve around $D_{s1}(2536)\bar{D}$ threshold is very sensitive to the $X(3872)$ mass because the triangle singularity (TS) can be generated from the loop. By means of this characteristic, we can determine whether the $X(3872)$ mass is below or ab… ▽ More We investigate the $B^0\to π^- K^+ X(3872)$ decay via the $D_{s1}(2536)\bar{D} D^*$ rescattering diagram. The line shape of the $K^+X(3872)$ distribution curve around $D_{s1}(2536)\bar{D}$ threshold is very sensitive to the $X(3872)$ mass because the triangle singularity (TS) can be generated from the loop. By means of this characteristic, we can determine whether the $X(3872)$ mass is below or above the $D^{\ast 0}\bar{D}^0$ threshold with high precision. The narrowness of $D_{s1}(2536)$ in the loop is one of the key reasons why the TS mechanism of measuring the $X(3872)$ mass may work. The $X(3872)$ width impact on the $K^+X(3872)$ line shape is also crucial in the TS mechanism. If the width is as large as 1 MeV, the proposed method of measuring the $X(3872)$ mass would be ruined. △ Less

Submitted 8 August, 2022; originally announced August 2022.

Comments: 6 pages, 3 figures

DictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learning

Authors: Qianglong Chen, Feng-Lin Li, Guohai Xu, Ming Yan, Ji Zhang, Yin Zhang

Abstract: Although pre-trained language models (PLMs) have achieved state-of-the-art performance on various natural language processing (NLP) tasks, they are shown to be lacking in knowledge when dealing with knowledge driven tasks. Despite the many efforts made for injecting knowledge into PLMs, this problem remains open. To address the challenge, we propose \textbf{DictBERT}, a novel approach that enhance… ▽ More Although pre-trained language models (PLMs) have achieved state-of-the-art performance on various natural language processing (NLP) tasks, they are shown to be lacking in knowledge when dealing with knowledge driven tasks. Despite the many efforts made for injecting knowledge into PLMs, this problem remains open. To address the challenge, we propose \textbf{DictBERT}, a novel approach that enhances PLMs with dictionary knowledge which is easier to acquire than knowledge graph (KG). During pre-training, we present two novel pre-training tasks to inject dictionary knowledge into PLMs via contrastive learning: \textit{dictionary entry prediction} and \textit{entry description discrimination}. In fine-tuning, we use the pre-trained DictBERT as a plugin knowledge base (KB) to retrieve implicit knowledge for identified entries in an input sequence, and infuse the retrieved knowledge into the input to enhance its representation via a novel extra-hop attention mechanism. We evaluate our approach on a variety of knowledge driven and language understanding tasks, including NER, relation extraction, CommonsenseQA, OpenBookQA and GLUE. Experimental results demonstrate that our model can significantly improve typical PLMs: it gains a substantial improvement of 0.5\%, 2.9\%, 9.0\%, 7.1\% and 3.3\% on BERT-large respectively, and is also effective on RoBERTa-large. △ Less

Submitted 1 August, 2022; originally announced August 2022.

Comments: Accepted by IJCAI 2022

The $P_{ψs}^Λ(4338)$ pentaquark and its partners in the molecular picture

Authors: Mao-Jun Yan, Fang-Zheng Peng, Mario Sánchez Sánchez, Manuel Pavon Valderrama

Abstract: The LHCb collaboration has detected a new hidden-charm pentaquark with the quantum numbers of a $Λ$ baryon: the $P_{ψs}^Λ(4338)$. In the molecular picture this pentaquark will be interpreted as a $\bar{D} Ξ_c$ molecule. Here we briefly comment on the relation of the new $P_{ψs}^Λ(4338)$ with the $P^Λ_{ψs}(4459)$. We find that the $P_{ψs}^Λ(4338)$ and $P_{ψs}^Λ(4459)$ both accept a common molecular… ▽ More The LHCb collaboration has detected a new hidden-charm pentaquark with the quantum numbers of a $Λ$ baryon: the $P_{ψs}^Λ(4338)$. In the molecular picture this pentaquark will be interpreted as a $\bar{D} Ξ_c$ molecule. Here we briefly comment on the relation of the new $P_{ψs}^Λ(4338)$ with the $P^Λ_{ψs}(4459)$. We find that the $P_{ψs}^Λ(4338)$ and $P_{ψs}^Λ(4459)$ both accept a common molecular description in terms of the same parameters, which predicts the existence of a few additional $P_ψ^N$, $P_{ψs}^Λ$, $P_{ψs}^Σ$ and $P_{ψs s}^Ξ$ pentaquarks composed of a charmed antimeson and an antitriplet charmed baryon. The most robust of these predicted pentaquarks is a $P_{ψs}^Λ$ with a mass in the $(4235-4255)\,{\rm MeV}$ range, while other two interesting ones are a $P_ψ^{N}(4150)$ and a $P_ψ^Σ(4335)$, the later basically at the same mass as the $P_ψ^Λ(4338)$, with which it might mix owing to isospin symmetry breaking effects. △ Less

Submitted 22 July, 2022; originally announced July 2022.

Comments: 5 pages, 1 table

X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval

Authors: Yiwei Ma, Guohai Xu, Xiaoshuai Sun, Ming Yan, Ji Zhang, Rongrong Ji

Abstract: Video-text retrieval has been a crucial and fundamental task in multi-modal research. The development of video-text retrieval has been considerably promoted by large-scale multi-modal contrastive pre-training, which primarily focuses on coarse-grained or fine-grained contrast. However, cross-grained contrast, which is the contrast between coarse-grained representations and fine-grained representat… ▽ More Video-text retrieval has been a crucial and fundamental task in multi-modal research. The development of video-text retrieval has been considerably promoted by large-scale multi-modal contrastive pre-training, which primarily focuses on coarse-grained or fine-grained contrast. However, cross-grained contrast, which is the contrast between coarse-grained representations and fine-grained representations, has rarely been explored in prior research. Compared with fine-grained or coarse-grained contrasts, cross-grained contrast calculate the correlation between coarse-grained features and each fine-grained feature, and is able to filter out the unnecessary fine-grained features guided by the coarse-grained feature during similarity calculation, thus improving the accuracy of retrieval. To this end, this paper presents a novel multi-grained contrastive model, namely X-CLIP, for video-text retrieval. However, another challenge lies in the similarity aggregation problem, which aims to aggregate fine-grained and cross-grained similarity matrices to instance-level similarity. To address this challenge, we propose the Attention Over Similarity Matrix (AOSM) module to make the model focus on the contrast between essential frames and words, thus lowering the impact of unnecessary frames and words on retrieval results. With multi-grained contrast and the proposed AOSM module, X-CLIP achieves outstanding performance on five widely-used video-text retrieval datasets, including MSR-VTT (49.3 R@1), MSVD (50.4 R@1), LSMDC (26.1 R@1), DiDeMo (47.8 R@1) and ActivityNet (46.2 R@1). It outperforms the previous state-of-theart by +6.3%, +6.6%, +11.1%, +6.7%, +3.8% relative improvements on these benchmarks, demonstrating the superiority of multi-grained contrast and AOSM. △ Less

Submitted 22 September, 2022; v1 submitted 15 July, 2022; originally announced July 2022.

Comments: 13 pages, 6 figures, ACMMM22

Multi-node Acceleration for Large-scale GCNs

Authors: Gongjian Sun, Mingyu Yan, Duo Wang, Han Li, Wenming Li, Xiaochun Ye, Dongrui Fan, Yuan Xie

Abstract: Limited by the memory capacity and compute power, singe-node graph convolutional neural network (GCN) accelerators cannot complete the execution of GCNs within a reasonable amount of time, due to the explosive size of graphs nowadays. Thus, large-scale GCNs call for a multi-node acceleration system (MultiAccSys) like TPU-Pod for large-scale neural networks. In this work, we aim to scale up single-… ▽ More Limited by the memory capacity and compute power, singe-node graph convolutional neural network (GCN) accelerators cannot complete the execution of GCNs within a reasonable amount of time, due to the explosive size of graphs nowadays. Thus, large-scale GCNs call for a multi-node acceleration system (MultiAccSys) like TPU-Pod for large-scale neural networks. In this work, we aim to scale up single-node GCN accelerators to accelerate GCNs on large-scale graphs. We first identify the communication pattern and challenges of multi-node acceleration for GCNs on large-scale graphs. We observe that (1) coarse-grained communication patterns exist in the execution of GCNs in MultiAccSys, which introduces massive amount of redundant network transmissions and off-chip memory accesses; (2) overall, the acceleration of GCNs in MultiAccSys is bandwidth-bound and latency-tolerant. Guided by these two observations, we then propose MultiGCN, the first MultiAccSys for large-scale GCNs that trades network latency for network bandwidth. Specifically, by leveraging the network latency tolerance, we first propose a topology-aware multicast mechanism with a one put per multicast message-passing model to reduce transmissions and alleviate network bandwidth requirements. Second, we introduce a scatter-based round execution mechanism which cooperates with the multicast mechanism and reduces redundant off-chip memory accesses. Compared to the baseline MultiAccSys, MultiGCN achieves 4~12x speedup using only 28%~68% energy, while reducing 32% transmissions and 73% off-chip memory accesses on average. It not only achieves 2.5~8x speedup over the state-of-the-art multi-GPU solution, but also scales to large-scale graphs as opposed to single-node GCN accelerators. △ Less

Submitted 2 September, 2022; v1 submitted 14 July, 2022; originally announced July 2022.

Comments: To appear in TC

Simple and Efficient Heterogeneous Graph Neural Network

Authors: Xiaocheng Yang, Mingyu Yan, Shirui Pan, Xiaochun Ye, Dongrui Fan

Abstract: Heterogeneous graph neural networks (HGNNs) have powerful capability to embed rich structural and semantic information of a heterogeneous graph into node representations. Existing HGNNs inherit many mechanisms from graph neural networks (GNNs) over homogeneous graphs, especially the attention mechanism and the multi-layer structure. These mechanisms bring excessive complexity, but seldom work stud… ▽ More Heterogeneous graph neural networks (HGNNs) have powerful capability to embed rich structural and semantic information of a heterogeneous graph into node representations. Existing HGNNs inherit many mechanisms from graph neural networks (GNNs) over homogeneous graphs, especially the attention mechanism and the multi-layer structure. These mechanisms bring excessive complexity, but seldom work studies whether they are really effective on heterogeneous graphs. This paper conducts an in-depth and detailed study of these mechanisms and proposes Simple and Efficient Heterogeneous Graph Neural Network (SeHGNN). To easily capture structural information, SeHGNN pre-computes the neighbor aggregation using a light-weight mean aggregator, which reduces complexity by removing overused neighbor attention and avoiding repeated neighbor aggregation in every training epoch. To better utilize semantic information, SeHGNN adopts the single-layer structure with long metapaths to extend the receptive field, as well as a transformer-based semantic fusion module to fuse features from different metapaths. As a result, SeHGNN exhibits the characteristics of simple network structure, high prediction accuracy, and fast training speed. Extensive experiments on five real-world heterogeneous graphs demonstrate the superiority of SeHGNN over the state-of-the-arts on both accuracy and training speed. △ Less

Submitted 31 August, 2023; v1 submitted 6 July, 2022; originally announced July 2022.

Comments: Accepted by AAAI 2023

Self-Referenced Terahertz Semiconductor Dual-Comb Sources

Authors: Ziping Li, Xuhong Ma, Kang Zhou, Chenjie Wang, Xiaoyu Liao, Wen Guan, Shumin Wu, Han Liu, Zhenzhen Zhang, J. C. Cao, Min Li, Ming Yan, Heping Zeng, Hua Li

Abstract: Employing two frequency combs with a slight difference in repetition frequencies, the dual-comb source shows unique advantages in high precision spectroscopy, imaging, ranging, communications, etc. In the terahertz (THz) frequency range, the electrically pumped quantum cascade laser (QCL) offers the possibility of realizing the compact dual-comb source due to its semiconductor-based chip-scale con… ▽ More Employing two frequency combs with a slight difference in repetition frequencies, the dual-comb source shows unique advantages in high precision spectroscopy, imaging, ranging, communications, etc. In the terahertz (THz) frequency range, the electrically pumped quantum cascade laser (QCL) offers the possibility of realizing the compact dual-comb source due to its semiconductor-based chip-scale configuration. Although the active stabilization of a THz QCL dual-comb source was demonstrated by phase locking one of the dual-comb lines, the full stabilization of all dual-comb lines is still challenging. Here, we propose a self-reference method to obtain a fully stabilized dual-comb signal on a pure THz QCL platform. Without using any external locking components, we filter out one dual-comb line and beat it with the whole dual-comb signal, which eliminates the common carrier offset frequency noise and reduces the dual-comb repetition frequency noise. It is experimentally demonstrated that the self-reference technique can significantly improve the long-term stability of the dual-comb signal. A record of the ``maxhold" linewidth of 14.8 kHz (60 s time duration) is obtained by implementing the self-reference technique, while without the self-reference the dual-comb lines show a ``maxhold" linewidth of 2 MHz (15 s time duration). The method provides the simplest way to improve the long-term stability of THz QCL dual-comb sources, which can be further adopted for high precision measurements. △ Less

Submitted 21 June, 2022; originally announced June 2022.

Comments: 15 pages, 4 figures

Journal ref: Laser & Photonics Reviews 2023

Systematic analysis of single heavy baryons $Λ_{Q}$, $Σ_{Q}$ and $Ω_{Q}$

Authors: Guo-Liang Yu, Zhen-Yu Li, Zhi-Gang Wang, Jie Lu, Meng Yan

Abstract: Motivated by great progresses in experiments in searching for the heavy baryons, we systematically analyze the mass spectra and root mean square radius of single heavy baryons $Λ_{Q}$, $Σ_{Q}$ and $Ω_{Q}$. The calculations of the mass spectra are carried out in the frame work of Godfrey-Isgur (GI) relativized quark model, where the baryon is regarded as a three-body system of quarks. Our results s… ▽ More Motivated by great progresses in experiments in searching for the heavy baryons, we systematically analyze the mass spectra and root mean square radius of single heavy baryons $Λ_{Q}$, $Σ_{Q}$ and $Ω_{Q}$. The calculations of the mass spectra are carried out in the frame work of Godfrey-Isgur (GI) relativized quark model, where the baryon is regarded as a three-body system of quarks. Our results show that the mass of single heavy baryon with $λ$-mode is lower than those of the $ρ$-mode and $λ$-$ρ$ mixing mode, which indicates that the lowest state is dominated by the $λ$-mode. Basing on this research, we systematically calculate the mass spectra and the root mean square radius of the baryons with $λ$ excited mode. With these predicated mass spectra, the Regge trajectories in the ($J$,$M^{2}$) plane are constructed, and the slopes, intercepts of the Regge trajectories are obtained by linear fitting. It is found that all available experimental data are well reproduced by model predictions and fit nicely to the constructed Regge trajectories. △ Less

Submitted 3 April, 2023; v1 submitted 16 June, 2022; originally announced June 2022.

Comments: to be published in Nuclear Physics B

Journal ref: Nucl. Phys. B990 (2023) 116183

The discovery of a rotating radio transient J1918$-$0449 with intriguing emission properties with the five hundred meter aperture spherical radio telescope

Authors: J. L. Chen, Z. G. Wen, J. P. Yuan, N. Wang, D. Li, H. G. Wang, W. M. Yan, R. Yuen, P. Wang, Z. Wang, W. W. Zhu, J. R. Niu, C. C. Miao, M. Y. Xue, B. P. Gong

Abstract: In this study, we report on a detailed single pulse analysis of the radio emission from a rotating radio transient (RRAT) J1918$-$0449 which is the first RRAT discovered with the five hundred meter aperture spherical radio telescope (FAST). The sensitive observations were carried out on 30 April 2021 using the FAST with a central frequency of 1250 MHz and a short time resolution of 49.152 $μ$s, wh… ▽ More In this study, we report on a detailed single pulse analysis of the radio emission from a rotating radio transient (RRAT) J1918$-$0449 which is the first RRAT discovered with the five hundred meter aperture spherical radio telescope (FAST). The sensitive observations were carried out on 30 April 2021 using the FAST with a central frequency of 1250 MHz and a short time resolution of 49.152 $μ$s, which forms a reliable basis to probe single pulse emission properties in detail. The source was successively observed for around 2 hours. A total of 83 dispersed bursts with significance above 6$σ$ are detected over 1.8 hours. The source's DM and rotational period are determined to be 116.1$\pm$0.4 \pcm \ and 2479.21$\pm$0.03 ms, respectively. The share of registered pulses from the total number of observed period is 3.12\%. No underlying emission is detected in the averaged off pulse profile. For bursts with fluence larger than 10 Jy ms, the pulse energy follows a power-law distribution with an index of $-3.1\pm0.4$, suggesting the existence of bright pulse emission. We find that the distribution of time between subsequent pulses is consistent with a stationary Poisson process and find no evidence of clustering over the 1.8 h observations, giving a mean burst rate of one burst every 66 s. Close inspection of the detected bright pulses reveals that 21 pulses exhibit well-defined quasi-periodicities. The subpulse drifting is present in non-successive rotations with periodicity of $2.51\pm0.06$ periods. Finally, possible physical mechanisms are discussed. △ Less

Submitted 7 June, 2022; originally announced June 2022.

Comments: 11 pages, 11 figures

Connected and Disconnected Sea Partons from CT18 Parametrization of PDFs

Authors: Tie-Jiun Hou, Mengshi Yan, Jian Liang, Keh-Fei Liu, C. -P. Yuan

Abstract: The separation of the connected and disconnected sea partons, which were uncovered in the Euclidean path-integral formulation of the hadronic tensor, is accommodated with an alternative parametrization of the non-perturbative parton distribution functions in the CT18 global analysis. This is achieved with the help of the distinct small $x$ behaviours of these two sea partons and the constraint fro… ▽ More The separation of the connected and disconnected sea partons, which were uncovered in the Euclidean path-integral formulation of the hadronic tensor, is accommodated with an alternative parametrization of the non-perturbative parton distribution functions in the CT18 global analysis. This is achieved with the help of the distinct small $x$ behaviours of these two sea partons and the constraint from the lattice calculation of the ratio of the strange momentum fraction to that of the $\bar u$ or $\bar d$ in the disconnected insertion. The whole dataset of CT18 is used in this CT18CS fit. The impact of the recent SeaQuest data on the $\bar{d}(x)-\bar{u}(x)$ distribution of CT18CS is also discussed. The separate momentum fractions for the valence, the connected sea and disconnected sea of $u$ and $d$, the strange and the gluon partons are presented at $μ=1.3$ GeV for the first time. They can be compared term-by-term with systematic error controlled lattice calculations. △ Less

Submitted 1 November, 2022; v1 submitted 6 June, 2022; originally announced June 2022.

Comments: Revised manuscript accepted for publication in PRD

Light- and heavy-quark symmetries and the $Y(4230)$, $Y(4360)$, $Y(4500)$, $Y(4620)$ and $X(4630)$ resonances

Authors: Fang-Zheng Peng, Mao-Jun Yan, Mario Sánchez Sánchez, Manuel Pavon Valderrama

Abstract: The heavy hadron spectrum is constrained by symmetries, of which two of the most important ones are heavy-quark spin and SU(3)-flavor symmetries. Here we argue that in the molecular picture the $Y(4230)$ (or $Y(4260)$), the $Y(4360)$ and the recently discovered $Y(4500)$ and $Y(4620)$ vector-like resonances are linked by these two symmetries. By formulating a contact-range effective field theory f… ▽ More The heavy hadron spectrum is constrained by symmetries, of which two of the most important ones are heavy-quark spin and SU(3)-flavor symmetries. Here we argue that in the molecular picture the $Y(4230)$ (or $Y(4260)$), the $Y(4360)$ and the recently discovered $Y(4500)$ and $Y(4620)$ vector-like resonances are linked by these two symmetries. By formulating a contact-range effective field theory for the $D \bar{D}_1$ and $D_s \bar{D}_{s1}$ family of S- and P-wave charmed meson-antimeson systems, we find that if the $Y(4230)$ were to be a pure $D \bar{D}_1$ molecular state, there would be a $D^* \bar{D}_1$ partner with a mass similar to the $Y(4360)$, a $D_s \bar{D}_{s1}$ partner with a mass close to the $Y(4500)$ and three $J=1,2$ $D_s^* \bar{D}_{s1}$ and $J=3$ $D_s^* \bar{D}_{s2}^{*}$ bound states with a mass in the vicinity of $4630\,{\rm MeV}$, of which the first one ($J=1$) might correspond with the $Y(4620)$. The previous predictions can in turn be improved by modifying the assumptions we have used to build the effective field theory. In particular, if we consider the closeness of the $D^* \bar{D}_1$-$D^* \bar{D}_2^*$ and $D_s^* \bar{D}_{s1}$-$D_s^* \bar{D}_{s2}^*$ thresholds and include the related coupled channel dynamics, we predict a $J=2$ positive C-parity state with a mass around $4650\,{\rm MeV}$. This hidden-strange and hidden-charm state might in turn be identified with the $X(4630)$ that has been discovered past year by the LHCb in the $J/ψφ$ invariant mass distribution. △ Less

Submitted 5 January, 2023; v1 submitted 26 May, 2022; originally announced May 2022.

Comments: 21 pages, 7 tables

Journal ref: Phys. Rev. D 107, 016001 (2023)

Cascading Residual Graph Convolutional Network for Multi-Behavior Recommendation

Authors: Mingshi Yan, Zhiyong Cheng, Chen Gao, Jing Sun, Fan Liu, Fuming Sun, Haojie Li

Abstract: Multi-behavior recommendation exploits multiple types of user-item interactions to alleviate the data sparsity problem faced by the traditional models that often utilize only one type of interaction for recommendation. In real scenarios, users often take a sequence of actions to interact with an item, in order to get more information about the item and thus accurately evaluate whether an item fits… ▽ More Multi-behavior recommendation exploits multiple types of user-item interactions to alleviate the data sparsity problem faced by the traditional models that often utilize only one type of interaction for recommendation. In real scenarios, users often take a sequence of actions to interact with an item, in order to get more information about the item and thus accurately evaluate whether an item fits personal preference. Those interaction behaviors often obey a certain order, and different behaviors reveal different information or aspects of user preferences towards the target item. Most existing multi-behavior recommendation methods take the strategy to first extract information from different behaviors separately and then fuse them for final prediction. However, they have not exploited the connections between different behaviors to learn user preferences. Besides, they often introduce complex model structures and more parameters to model multiple behaviors, largely increasing the space and time complexity. In this work, we propose a lightweight multi-behavior recommendation model named Cascading Residual Graph Convolutional Network (CRGCN for short), which can explicitly exploit the connections between different behaviors into the embedding learning process without introducing any additional parameters. In particular, we design a cascading residual graph convolutional network structure, which enables our model to learn user preferences by continuously refining user embeddings across different types of behaviors. The multi-task learning method is adopted to jointly optimize our model based on different behaviors. Extensive experimental results on two real-world benchmark datasets show that CRGCN can substantially outperform state-of-the-art methods. Further studies also analyze the effects of leveraging multi-behaviors in different numbers and orders on the final performance. △ Less

Submitted 8 July, 2023; v1 submitted 25 May, 2022; originally announced May 2022.

mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections

Authors: Chenliang Li, Haiyang Xu, Junfeng Tian, Wei Wang, Ming Yan, Bin Bi, Jiabo Ye, Hehong Chen, Guohai Xu, Zheng Cao, Ji Zhang, Songfang Huang, Fei Huang, Jingren Zhou, Luo Si

Abstract: Large-scale pretrained foundation models have been an emerging paradigm for building artificial intelligence (AI) systems, which can be quickly adapted to a wide range of downstream tasks. This paper presents mPLUG, a new vision-language foundation model for both cross-modal understanding and generation. Most existing pre-trained models suffer from the problems of low computational efficiency and… ▽ More Large-scale pretrained foundation models have been an emerging paradigm for building artificial intelligence (AI) systems, which can be quickly adapted to a wide range of downstream tasks. This paper presents mPLUG, a new vision-language foundation model for both cross-modal understanding and generation. Most existing pre-trained models suffer from the problems of low computational efficiency and information asymmetry brought by the long visual sequence in cross-modal alignment. To address these problems, mPLUG introduces an effective and efficient vision-language architecture with novel cross-modal skip-connections, which creates inter-layer shortcuts that skip a certain number of layers for time-consuming full self-attention on the vision side. mPLUG is pre-trained end-to-end on large-scale image-text pairs with both discriminative and generative objectives. It achieves state-of-the-art results on a wide range of vision-language downstream tasks, such as image captioning, image-text retrieval, visual grounding and visual question answering. mPLUG also demonstrates strong zero-shot transferability when directly transferred to multiple video-language tasks. △ Less

Submitted 25 May, 2022; v1 submitted 24 May, 2022; originally announced May 2022.

Journal ref: EMNLP2022

Parton distributions need representative sampling

Authors: Aurore Courtoy, Joey Huston, Pavel Nadolsky, Keping Xie, Mengshi Yan, C. -P. Yuan

Abstract: In global QCD fits of parton distribution functions (PDFs), a large part of the estimated uncertainty on the PDFs originates from the choices of parametric functional forms and fitting methodology. We argue that these types of uncertainties can be underestimated with common PDF ensembles in high-stake measurements at the Large Hadron Collider and Tevatron. A fruitful approach to quantify these unc… ▽ More In global QCD fits of parton distribution functions (PDFs), a large part of the estimated uncertainty on the PDFs originates from the choices of parametric functional forms and fitting methodology. We argue that these types of uncertainties can be underestimated with common PDF ensembles in high-stake measurements at the Large Hadron Collider and Tevatron. A fruitful approach to quantify these uncertainties is to view them as arising from sampling of allowed PDF solutions in a multidimensional parametric space. This approach applies powerful insights gained in recent statistical studies of large-scale population surveys and quasi-Monte Carlo integration methods. In particular, PDF fits may be affected by the big data paradox, which stipulates that more experimental data do not automatically raise the accuracy of PDFs -- close attention to the data quality and sampling of possible PDF solutions is as essential. To test if the sampling of the PDF uncertainty of an experimental observable is truly representative of all acceptable solutions, we introduce a technique (``a hopscotch scan'') based on a combination of parameter scans and stochastic sampling. With this technique, we show that the PDF uncertainty on key LHC cross sections at 13 TeV obtained with the public NNPDF4.0 fitting code is larger than the nominal uncertainty obtained with the published NNPDF4.0 Monte-Carlo replica sets, when accounting for the likelihood distribution. On the same grounds, the uncertainties on the charm distribution at a large momentum fraction $x$ and gluon PDF at small $x$ are enlarged. In PDF ensembles obtained in the analytic minimization (Hessian) formalism, the tolerance on the PDF uncertainty must be based on sufficiently complete sampling of PDF functional forms and choices of the experiments. △ Less

Submitted 19 February, 2023; v1 submitted 20 May, 2022; originally announced May 2022.

Comments: 26 pages, 10 figures; this version includes expanded discussion added in the journal version and detailed comparisons supplementary to the journal version

Report number: MSUHEP-22-020, PITT-PACC-2210, SMU-HEP-22-03

Journal ref: Phys.Rev.D 107 (2023) 034008

Parameter Choices for Sparse Regularization with the $\ell_1$ Norm

Authors: Qianru Liu, Rui Wang, Yuesheng Xu, Mingsong Yan

Abstract: We consider a regularization problem whose objective function consists of a convex fidelity term and a regularization term determined by the $\ell_1$ norm composed with a linear transform. Empirical results show that the regularization with the $\ell_1$ norm can promote sparsity of a regularized solution. It is the goal of this paper to understand theoretically the effect of the regularization par… ▽ More We consider a regularization problem whose objective function consists of a convex fidelity term and a regularization term determined by the $\ell_1$ norm composed with a linear transform. Empirical results show that the regularization with the $\ell_1$ norm can promote sparsity of a regularized solution. It is the goal of this paper to understand theoretically the effect of the regularization parameter on the sparsity of the regularized solutions. We establish a characterization of the sparsity under the transform matrix of the solution. When the fidelity term has a special structure and the transform matrix coincides with a identity matrix, the resulting characterization can be taken as a regularization parameter choice strategy with which the regularization problem has a solution having a sparsity of a certain level. We study choices of the regularization parameter so that the regularization term alleviates the ill-posedness and promote sparsity of the resulting regularized solution. Numerical experiments demonstrate that choices of the regularization parameters can balance the sparsity of the solutions of the regularization problem and its approximation to the minimizer of the fidelity function. △ Less

Submitted 14 May, 2022; originally announced May 2022.

Arecibo and FAST Timing Follow-up of twelve Millisecond Pulsars Discovered in Commensal Radio Astronomy FAST Survey

Authors: C. C. Miao, W. W. Zhu, D. Li, P. C. C. Freire, J. R. Niu, P. Wang, J. P. Yuan, M. Y. Xue, A. D. Cameron, D. J. Champion, M. Cruces, Y. T. Chen, M. M. Chi, X. F. Cheng, S. J. Dang, M. F. Ding, Y. Feng, Z. Y. Gan, G. Hobbs, M. Kramer, Z. J. Liu, Y. X. Li, Z. K. Luo, X. L. Miao, L. Q. Meng , et al. (24 additional authors not shown)

Abstract: We report the phase-connected timing ephemeris, polarization pulse profiles, Faraday rotation measurements, and Rotating-Vector-Model (RVM) fitting results of twelve millisecond pulsars (MSPs) discovered with the Five-hundred-meter Aperture Spherical radio Telescope (FAST) in the Commensal radio Astronomy FAST survey (CRAFTS). The timing campaigns were carried out with FAST and Arecibo over three… ▽ More We report the phase-connected timing ephemeris, polarization pulse profiles, Faraday rotation measurements, and Rotating-Vector-Model (RVM) fitting results of twelve millisecond pulsars (MSPs) discovered with the Five-hundred-meter Aperture Spherical radio Telescope (FAST) in the Commensal radio Astronomy FAST survey (CRAFTS). The timing campaigns were carried out with FAST and Arecibo over three years. Eleven of the twelve pulsars are in neutron star - white dwarf binary systems, with orbital periods between 2.4 and 100 d. Ten of them have spin periods, companion masses, and orbital eccentricities that are consistent with the theoretical expectations for MSP - Helium white dwarf (He WD) systems. The last binary pulsar (PSR J1912$-$0952) has a significantly smaller spin frequency and a smaller companion mass, the latter could be caused by a low orbital inclination for the system. Its orbital period of 29 days is well within the range of orbital periods where some MSP - He WD systems have shown anomalous eccentricities, however, the eccentricity of PSR J1912$-$0952 is typical of what one finds for the remaining MSP - He WD systems. △ Less

Submitted 9 May, 2022; originally announced May 2022.

Comments: 11 pages, 5 figures, MNRAS accepted

Emission Variation of a Long-period Pulsar Discovered by the Five-hundred-meter Aperture Spherical Radio Telescope (FAST)

Authors: H. M. Tedila, R. Yuen, N. Wang, J. P. Yuan, Z. G. Wen, W. M. Yan, S. Q. Wang, S. J. Dang, D. Li, P. Wang, W. W. Zhu, J. R. Niu, C. C. Miao, M. Y. Xue, L. Zhang, Z. Y. Tu, R. Rejep, J. T. Xie, FAST Collaboration

Abstract: We report on the variation in the single-pulse emission from PSR J1900+4221 (CRAFTS 19C10) observed at frequency centered at 1.25 GHz using the Five-hundred-meter Aperture Spherical radio Telescope. The integrated pulse profile shows two distinct components, referred to here as the leading and trailing components, with the latter component also containing a third weak component. The single-pulse s… ▽ More We report on the variation in the single-pulse emission from PSR J1900+4221 (CRAFTS 19C10) observed at frequency centered at 1.25 GHz using the Five-hundred-meter Aperture Spherical radio Telescope. The integrated pulse profile shows two distinct components, referred to here as the leading and trailing components, with the latter component also containing a third weak component. The single-pulse sequence reveals different emissions demonstrating as nulling, regular, and bright pulses, each with a particular abundance and duration distribution. There also exists pulses that follow a log-normal distribution suggesting the possibility of another emission, in which the pulsar is radiating weakly. Changes in the profile shape are seen across different emissions. We examine the emission variations in the leading and trailing components collectively and separately, and find moderate correlation between the two components. The inclination angle is estimated to be about 7° based on pulse-width, and we discuss that nulling in this pulsar does not seem to show correlation with age and rotation period. △ Less

Submitted 3 May, 2022; originally announced May 2022.

Journal ref: The Astrophysical Journal, 929:171T (10pp), 2022

Precise determination of the 2s22p5-2s2p6 transition energy in fluorine-like nickel utilizing a low-lying dielectronic resonance

Authors: S. X. Wang, Z. K. Huang, W. Q. Wen, W. L. Ma, H. B. Wang, S. Schippers, Z. W. Wu, Y. S. Kozhedub, M. Y. Kaygorodov, A. V. Volotka, K. Wang, C. Y. Zhang, C. Y. Chen, C. Liu, H. K. Huang, L. Shao, L. J. Mao, X. M. Ma, J. Li, M. T. Tang, K. M. Yan, Y. B. Zhou, Y. J. Yuan, J. C. Yang, S. F. Zhang , et al. (2 additional authors not shown)

Abstract: High precision spectroscopy of the low-lying dielectronic resonances in fluorine-like nickel ions were determined by employing the merged electron-ion beam at the heavy-ion storage ring CSRm. The measured dielectronic resonances are identified by comparing with the most recent relativistic calculation utilizing the FAC code. The first resonance at about 86 meV due to the dielectronic recombination… ▽ More High precision spectroscopy of the low-lying dielectronic resonances in fluorine-like nickel ions were determined by employing the merged electron-ion beam at the heavy-ion storage ring CSRm. The measured dielectronic resonances are identified by comparing with the most recent relativistic calculation utilizing the FAC code. The first resonance at about 86 meV due to the dielectronic recombination via (2s2p6[2S1/2]6s)J=1 intermediate state was recognized. The experimental determination of the resonance position at 86 meV reaches an uncertainty of 4 meV, which allows precise determination of the 2s22p5[2P3/2] - 2s2p6[2S1/2] transition energy. The Rydberg binding energy of the 6s electron in the (2s2p6[2S1/2]6s)J=1 state is calculated by the multi-configurational Dirac-HartreeFock and stabilization methods. The determined transition energies are 149.056(4)exp(10)theo and 149.032(4)exp(6)theo, respectively. Moreover, the transition energy has also been calculated by fully relativistic and ab initio approaches. Individual theoretical contributions are evaluated by employing the core-Hartree and Kohn-Sham screening potentials, respectively. High-order QED and correlation effects contribute prominently to the total transition energy. The present DR precision spectroscopy study at the CSRm paves the way for future precision measurements of atomic energy levels with heavier highly charged ions. △ Less

Submitted 25 May, 2022; v1 submitted 3 May, 2022; originally announced May 2022.

Comments: 12 pages, 8 figures

Unified Abstract Syntax Tree Representation Learning for Cross-Language Program Classification

Authors: Kesu Wang, Meng Yan, He Zhang, Haibo Hu

Abstract: Program classification can be regarded as a high-level abstraction of code, laying a foundation for various tasks related to source code comprehension, and has a very wide range of applications in the field of software engineering, such as code clone detection, code smell classification, defects classification, etc. The cross-language program classification can realize code transfer in different p… ▽ More Program classification can be regarded as a high-level abstraction of code, laying a foundation for various tasks related to source code comprehension, and has a very wide range of applications in the field of software engineering, such as code clone detection, code smell classification, defects classification, etc. The cross-language program classification can realize code transfer in different programming languages, and can also promote cross-language code reuse, thereby helping developers to write code quickly and reduce the development time of code transfer. Most of the existing studies focus on the semantic learning of the code, whilst few studies are devoted to cross-language tasks. The main challenge of cross-language program classification is how to extract semantic features of different programming languages. In order to cope with this difficulty, we propose a Unified Abstract Syntax Tree (namely UAST in this paper) neural network. In detail, the core idea of UAST consists of two unified mechanisms. First, UAST learns an AST representation by unifying the AST traversal sequence and graph-like AST structure for capturing semantic code features. Second, we construct a mechanism called unified vocabulary, which can reduce the feature gap between different programming languages, so it can achieve the role of cross-language program classification. Besides, we collect a dataset containing 20,000 files of five programming languages, which can be used as a benchmark dataset for the cross-language program classification task. We have done experiments on two datasets, and the results show that our proposed approach outperforms the state-of-the-art baselines in terms of four evaluation metrics (Precision, Recall, F1-score, and Accuracy). △ Less

Submitted 1 May, 2022; originally announced May 2022.

Journal ref: 30th International Conference on Program Comprehension(ICPC 2022)

A CT18 global PDF fit at the leading order in QCD

Authors: Mengshi Yan, Tie-Jiun Hou, Pavel Nadolsky, C. -P. Yuan

Abstract: In this paper, we present a CT18 PDFs fitted with Leading-Order QCD perturbation theory. The CT18 LO PDFs is obtained within the general CT18 framework, along with two additional treatments being imposed to improve the quality of the fit. We take the $W$-boson charge asymmetry and inclusive single-top production at LHC as examples to illustrate the implication of the CT18 LO PDFs. In this paper, we present a CT18 PDFs fitted with Leading-Order QCD perturbation theory. The CT18 LO PDFs is obtained within the general CT18 framework, along with two additional treatments being imposed to improve the quality of the fit. We take the $W$-boson charge asymmetry and inclusive single-top production at LHC as examples to illustrate the implication of the CT18 LO PDFs. △ Less

Submitted 16 May, 2022; v1 submitted 29 April, 2022; originally announced May 2022.

Realization of the electric-field driven "one-material"-based magnetic tunnel junction using van der Waals antiferromagnetic MnPX3 (X: S, Se)

Authors: Yichen Jin, Mouhui Yan, Yuriy Dedkov, Elena Voloshina

Abstract: Presently a lot of efforts are devoted to the investigation of new two-dimensional magnetic materials, which are considered as promising for the realization of the future electronics and spintronics devices. However, the utilization of these materials in different junctions requires complicated processing that in many cases leads to unwanted parasitic effects influencing the performance of the jun… ▽ More Presently a lot of efforts are devoted to the investigation of new two-dimensional magnetic materials, which are considered as promising for the realization of the future electronics and spintronics devices. However, the utilization of these materials in different junctions requires complicated processing that in many cases leads to unwanted parasitic effects influencing the performance of the junctions. Here, we propose the new elegant approach for the realization of the "one-material"-based magnetic tunnel junction. The several layers of 2D van der Waals MnPX3 (X: S, Se), which is insulating antiferromagnet in its ground state, are used and the effect of the applied external electric filed leads to the half-metallic ferromagnetic states for the outermost layers of the MnPX3 stack. The rich states diagram of such magnetic tunnel junction permits to precisely control its tunneling conductivity. The realized "one-material"-based magnetic tunnel junction allows to avoid all effects connected with the lattice mismatches and carriers scattering effects at the materials interfaces, giving high perspectives for the application of such systems in electronics and spintronics. △ Less

Submitted 29 April, 2022; originally announced April 2022.

Journal ref: J. Mater. Chem. C 10, 3812 (2022)

Characterizing and Understanding Distributed GNN Training on GPUs

Authors: Haiyang Lin, Mingyu Yan, Xiaocheng Yang, Mo Zou, Wenming Li, Xiaochun Ye, Dongrui Fan

Abstract: Graph neural network (GNN) has been demonstrated to be a powerful model in many domains for its effectiveness in learning over graphs. To scale GNN training for large graphs, a widely adopted approach is distributed training which accelerates training using multiple computing nodes. Maximizing the performance is essential, but the execution of distributed GNN training remains preliminarily underst… ▽ More Graph neural network (GNN) has been demonstrated to be a powerful model in many domains for its effectiveness in learning over graphs. To scale GNN training for large graphs, a widely adopted approach is distributed training which accelerates training using multiple computing nodes. Maximizing the performance is essential, but the execution of distributed GNN training remains preliminarily understood. In this work, we provide an in-depth analysis of distributed GNN training on GPUs, revealing several significant observations and providing useful guidelines for both software optimization and hardware optimization. △ Less

Submitted 17 April, 2022; originally announced April 2022.

Comments: To Appear in IEEE Computer Architecture Letters (CAL) 2022

Impact of lattice $s(x)-\bar{s}(x)$ data in the CTEQ-TEA global analysis

Authors: Tie-Jiun Hou, Huey-Wen Lin, Mengshi Yan, C. -P. Yuan

Abstract: We study the impact of the lattice data on the determination of the strangeness asymmetry distribution $s_-(x) \equiv s(x) - {\bar s}(x)$ in the general CTEQ-TEA global analysis of parton distribution functions (PDFs) of the proton. Firstly, we find that allowing a non-vanishing $s_-(x)$, at the initial $Q_0=1.3$ GeV scale, in a global PDF analysis leads to the quality of the CT18As fit similar to… ▽ More We study the impact of the lattice data on the determination of the strangeness asymmetry distribution $s_-(x) \equiv s(x) - {\bar s}(x)$ in the general CTEQ-TEA global analysis of parton distribution functions (PDFs) of the proton. Firstly, we find that allowing a non-vanishing $s_-(x)$, at the initial $Q_0=1.3$ GeV scale, in a global PDF analysis leads to the quality of the CT18As fit similar to CT18A. Secondly, including the lattice data in the CT18As\_Lat fit greatly reduces the $s_-$-PDF error band size in the large $x$ region. To further reduce its error would require more precise lattice data, extended to smaller $x$ values. △ Less

Submitted 17 April, 2022; originally announced April 2022.

WikiDiverse: A Multimodal Entity Linking Dataset with Diversified Contextual Topics and Entity Types

Authors: Xuwu Wang, Junfeng Tian, Min Gui, Zhixu Li, Rui Wang, Ming Yan, Lihan Chen, Yanghua Xiao

Abstract: Multimodal Entity Linking (MEL) which aims at linking mentions with multimodal contexts to the referent entities from a knowledge base (e.g., Wikipedia), is an essential task for many multimodal applications. Although much attention has been paid to MEL, the shortcomings of existing MEL datasets including limited contextual topics and entity types, simplified mention ambiguity, and restricted avai… ▽ More Multimodal Entity Linking (MEL) which aims at linking mentions with multimodal contexts to the referent entities from a knowledge base (e.g., Wikipedia), is an essential task for many multimodal applications. Although much attention has been paid to MEL, the shortcomings of existing MEL datasets including limited contextual topics and entity types, simplified mention ambiguity, and restricted availability, have caused great obstacles to the research and application of MEL. In this paper, we present WikiDiverse, a high-quality human-annotated MEL dataset with diversified contextual topics and entity types from Wikinews, which uses Wikipedia as the corresponding knowledge base. A well-tailored annotation procedure is adopted to ensure the quality of the dataset. Based on WikiDiverse, a sequence of well-designed MEL models with intra-modality and inter-modality attentions are implemented, which utilize the visual information of images more adequately than existing MEL models do. Extensive experimental analyses are conducted to investigate the contributions of different modalities in terms of MEL, facilitating the future research on this task. The dataset and baseline models are available at https://github.com/wangxw5/wikiDiverse. △ Less

Submitted 13 April, 2022; originally announced April 2022.

Tilings of the Sphere by Congruent Quadrilaterals or Triangles

Authors: Ho Man Cheung, Hoi Ping Luk, Min Yan

Abstract: We completely classify edge-to-edge tilings of the sphere by congruent quadrilaterals. As part of the classification, we also present a modern version of the classification of edge-to-edge tilings of the sphere by congruent triangles. Together with our series of papers that classifies edge-to-edge tilings of the sphere by congruent pentagons, we complete the classification of edge-to-edge tilings… ▽ More We completely classify edge-to-edge tilings of the sphere by congruent quadrilaterals. As part of the classification, we also present a modern version of the classification of edge-to-edge tilings of the sphere by congruent triangles. Together with our series of papers that classifies edge-to-edge tilings of the sphere by congruent pentagons, we complete the classification of edge-to-edge tilings of the sphere by congruent polygons. △ Less

Submitted 8 February, 2024; v1 submitted 6 April, 2022; originally announced April 2022.

Comments: 135 pages, 76 figures. slight update on the notations and constructions for tilings

MSC Class: 05B45; 52C20; 51M20