Showing 51–100 of 296 results for author: Zeng, Q

D3Former: Jointly Learning Repeatable Dense Detectors and Feature-enhanced Descriptors via Saliency-guided Transformer

Authors: Junjie Gao, Pengfei Wang, Qiujie Dong, Qiong Zeng, Shiqing Xin, Caiming Zhang

Abstract: Establishing accurate and representative matches is a crucial step in addressing the point cloud registration problem. A commonly employed approach involves detecting keypoints with salient geometric features and subsequently mapping these keypoints from one frame of the point cloud to another. However, methods within this category are hampered by the repeatability of the sampled keypoints. In thi… ▽ More Establishing accurate and representative matches is a crucial step in addressing the point cloud registration problem. A commonly employed approach involves detecting keypoints with salient geometric features and subsequently mapping these keypoints from one frame of the point cloud to another. However, methods within this category are hampered by the repeatability of the sampled keypoints. In this paper, we introduce a saliency-guided trans\textbf{former}, referred to as \textit{D3Former}, which entails the joint learning of repeatable \textbf{D}ense \textbf{D}etectors and feature-enhanced \textbf{D}escriptors. The model comprises a Feature Enhancement Descriptor Learning (FEDL) module and a Repetitive Keypoints Detector Learning (RKDL) module. The FEDL module utilizes a region attention mechanism to enhance feature distinctiveness, while the RKDL module focuses on detecting repeatable keypoints to enhance matching capabilities. Extensive experimental results on challenging indoor and outdoor benchmarks demonstrate that our proposed method consistently outperforms state-of-the-art point cloud matching methods. Notably, tests on 3DLoMatch, even with a low overlap ratio, show that our method consistently outperforms recently published approaches such as RoReg and RoITr. For instance, with the number of extracted keypoints reduced to 250, the registration recall scores for RoReg, RoITr, and our method are 64.3\%, 73.6\%, and 76.5\%, respectively. △ Less

Submitted 20 December, 2023; originally announced December 2023.

Comments: 15 pages, 6 figures

MCANet: Medical Image Segmentation with Multi-Scale Cross-Axis Attention

Authors: Hao Shao, Quansheng Zeng, Qibin Hou, Jufeng Yang

Abstract: Efficiently capturing multi-scale information and building long-range dependencies among pixels are essential for medical image segmentation because of the various sizes and shapes of the lesion regions or organs. In this paper, we present Multi-scale Cross-axis Attention (MCA) to solve the above challenging issues based on the efficient axial attention. Instead of simply connecting axial attentio… ▽ More Efficiently capturing multi-scale information and building long-range dependencies among pixels are essential for medical image segmentation because of the various sizes and shapes of the lesion regions or organs. In this paper, we present Multi-scale Cross-axis Attention (MCA) to solve the above challenging issues based on the efficient axial attention. Instead of simply connecting axial attention along the horizontal and vertical directions sequentially, we propose to calculate dual cross attentions between two parallel axial attentions to capture global information better. To process the significant variations of lesion regions or organs in individual sizes and shapes, we also use multiple convolutions of strip-shape kernels with different kernel sizes in each axial attention path to improve the efficiency of the proposed MCA in encoding spatial information. We build the proposed MCA upon the MSCAN backbone, yielding our network, termed MCANet. Our MCANet with only 4M+ parameters performs even better than most previous works with heavy backbones (e.g., Swin Transformer) on four challenging tasks, including skin lesion segmentation, nuclei segmentation, abdominal multi-organ segmentation, and polyp segmentation. Code is available at https://github.com/haoshao-nku/medical_seg. △ Less

Submitted 19 December, 2023; v1 submitted 14 December, 2023; originally announced December 2023.

Cross Domain LifeLong Sequential Modeling for Online Click-Through Rate Prediction

Authors: Ruijie Hou, Zhaoyang Yang, Yu Ming, Hongyu Lu, Zhuobin Zheng, Yu Chen, Qinsong Zeng, Ming Chen

Abstract: Deep neural networks (DNNs) that incorporated lifelong sequential modeling (LSM) have brought great success to recommendation systems in various social media platforms. While continuous improvements have been made in domain-specific LSM, limited work has been done in cross-domain LSM, which considers modeling of lifelong sequences of both target domain and source domain. In this paper, we propose… ▽ More Deep neural networks (DNNs) that incorporated lifelong sequential modeling (LSM) have brought great success to recommendation systems in various social media platforms. While continuous improvements have been made in domain-specific LSM, limited work has been done in cross-domain LSM, which considers modeling of lifelong sequences of both target domain and source domain. In this paper, we propose Lifelong Cross Network (LCN) to incorporate cross-domain LSM to improve the click-through rate (CTR) prediction in the target domain. The proposed LCN contains a LifeLong Attention Pyramid (LAP) module that comprises of three levels of cascaded attentions to effectively extract interest representations with respect to the candidate item from lifelong sequences. We also propose Cross Representation Production (CRP) module to enforce additional supervision on the learning and alignment of cross-domain representations so that they can be better reused on learning of the CTR prediction in the target domain. We conducted extensive experiments on WeChat Channels industrial dataset as well as on benchmark dataset. Results have revealed that the proposed LCN outperforms existing work in terms of both prediction accuracy and online performance. △ Less

Submitted 17 May, 2024; v1 submitted 11 December, 2023; originally announced December 2023.

Comments: Accepted by KDD 2024

Ascle: A Python Natural Language Processing Toolkit for Medical Text Generation

Authors: Rui Yang, Qingcheng Zeng, Keen You, Yujie Qiao, Lucas Huang, Chia-Chun Hsieh, Benjamin Rosand, Jeremy Goldwasser, Amisha D Dave, Tiarnan D. L. Keenan, Emily Y Chew, Dragomir Radev, Zhiyong Lu, Hua Xu, Qingyu Chen, Irene Li

Abstract: This study introduces Ascle, a pioneering natural language processing (NLP) toolkit designed for medical text generation. Ascle is tailored for biomedical researchers and healthcare professionals with an easy-to-use, all-in-one solution that requires minimal programming expertise. For the first time, Ascle evaluates and provides interfaces for the latest pre-trained language models, encompassing f… ▽ More This study introduces Ascle, a pioneering natural language processing (NLP) toolkit designed for medical text generation. Ascle is tailored for biomedical researchers and healthcare professionals with an easy-to-use, all-in-one solution that requires minimal programming expertise. For the first time, Ascle evaluates and provides interfaces for the latest pre-trained language models, encompassing four advanced and challenging generative functions: question-answering, text summarization, text simplification, and machine translation. In addition, Ascle integrates 12 essential NLP functions, along with query and search capabilities for clinical databases. The toolkit, its models, and associated data are publicly available via https://github.com/Yale-LILY/MedGen. △ Less

Submitted 9 December, 2023; v1 submitted 28 November, 2023; originally announced November 2023.

Comments: 5 figures, 4 tables

Quantum oscillations in kagome metals (Ti, Zr, Hf)V6Sn6 at Van Hove filling

Authors: Miao He, Xitong Xu, Ding Li, Qingqi Zeng, Yonglai Liu, Haitian Zhao, Shiming Zhou, Jianhui Zhou, Zhe Qu

Abstract: Kagome materials have recently drawn great attention due to the interplay between nontrivial band topology, electron correlations, and Van Hove singularities related many-body orders. Here we report three new vanadium-based kagome metals, TiV6Sn6, ZrV6Sn6, and HfV6Sn6, and conduct a comprehensive investigation of their structural, magnetic, and electrical transport properties. All three compounds… ▽ More Kagome materials have recently drawn great attention due to the interplay between nontrivial band topology, electron correlations, and Van Hove singularities related many-body orders. Here we report three new vanadium-based kagome metals, TiV6Sn6, ZrV6Sn6, and HfV6Sn6, and conduct a comprehensive investigation of their structural, magnetic, and electrical transport properties. All three compounds exhibit large unsaturated magnetoresistances and multiband Hall effects at low temperatures, indicating the existence of multiple highly mobile carriers. Both the diagonal and off-diagonal resistivity show quantum oscillations with nontrivial Berry phases and high quantum mobilities. First-principles calculations together with quantum oscillation analyses suggest the Van Hove singularities at the M point for the three compounds all located in close vicinity of the Fermi level, and there also exist multiple topological nontrivial band crossings, including a nodal ring and a massive Dirac cone. Our work extends the kagome AM6X6 family and paves the way for searching possible Van Hove physics in the V kagome lattice. △ Less

Submitted 4 May, 2024; v1 submitted 26 November, 2023; originally announced November 2023.

Journal ref: Phys. Rev. B 109, 155117 (2024)

Segment Together: A Versatile Paradigm for Semi-Supervised Medical Image Segmentation

Authors: Qingjie Zeng, Yutong Xie, Zilin Lu, Mengkang Lu, Yicheng Wu, Yong Xia

Abstract: Annotation scarcity has become a major obstacle for training powerful deep-learning models for medical image segmentation, restricting their deployment in clinical scenarios. To address it, semi-supervised learning by exploiting abundant unlabeled data is highly desirable to boost the model training. However, most existing works still focus on limited medical tasks and underestimate the potential… ▽ More Annotation scarcity has become a major obstacle for training powerful deep-learning models for medical image segmentation, restricting their deployment in clinical scenarios. To address it, semi-supervised learning by exploiting abundant unlabeled data is highly desirable to boost the model training. However, most existing works still focus on limited medical tasks and underestimate the potential of learning across diverse tasks and multiple datasets. Therefore, in this paper, we introduce a \textbf{Ver}satile \textbf{Semi}-supervised framework (VerSemi) to point out a new perspective that integrates various tasks into a unified model with a broad label space, to exploit more unlabeled data for semi-supervised medical image segmentation. Specifically, we introduce a dynamic task-prompted design to segment various targets from different datasets. Next, this unified model is used to identify the foreground regions from all labeled data, to capture cross-dataset semantics. Particularly, we create a synthetic task with a cutmix strategy to augment foreground targets within the expanded label space. To effectively utilize unlabeled data, we introduce a consistency constraint. This involves aligning aggregated predictions from various tasks with those from the synthetic task, further guiding the model in accurately segmenting foreground regions during training. We evaluated our VerSemi model on four public benchmarking datasets. Extensive experiments demonstrated that VerSemi can consistently outperform the second-best method by a large margin (e.g., an average 2.69\% Dice gain on four datasets), setting new SOTA performance for semi-supervised medical image segmentation. The code will be released. △ Less

Submitted 20 November, 2023; originally announced November 2023.

Superconductivity in pressurized trilayer La$_4$Ni$_3$O$_{10-δ}$ single crystals

Authors: Yinghao Zhu, Di Peng, Enkang Zhang, Bingying Pan, Xu Chen, Lixing Chen, Huifen Ren, Feiyang Liu, Yiqing Hao, Nana Li, Zhenfang Xing, Fujun Lan, Jiyuan Han, Junjie Wang, Donghan Jia, Hongliang Wo, Yiqing Gu, Yimeng Gu, Li Ji, Wenbin Wang, Huiyang Gou, Yao Shen, Tianping Ying, Xiaolong Chen, Wenge Yang , et al. (5 additional authors not shown)

Abstract: The pursuit of discovering new high-temperature superconductors that diverge from the copper-based paradigm1-3 carries profound implications for elucidating mechanisms behind superconductivity and may also enable new applications4-8. Here, our investigation reveals that application of pressure effectively suppresses the spin and charge order in trilayer nickelate La4Ni3O10-δ single crystals, leadi… ▽ More The pursuit of discovering new high-temperature superconductors that diverge from the copper-based paradigm1-3 carries profound implications for elucidating mechanisms behind superconductivity and may also enable new applications4-8. Here, our investigation reveals that application of pressure effectively suppresses the spin and charge order in trilayer nickelate La4Ni3O10-δ single crystals, leading to the emergence of superconductivity with a maximum critical temperature (Tc) of around 30 K at 69.0 GPa. The DC susceptibility measurements confirm a substantial diamagnetic response below Tc, indicating the presence of bulk superconductivity with a volume fraction exceeding 80%. In the normal state, we observe a "strange metal" behavior, characterized by a linear temperature-dependent resistance extending up to 300 K. Furthermore, the layer-dependent superconductivity observed hints at a unique interlayer coupling mechanism specific to nickelates, setting them apart from cuprates in this regard. Our findings provide crucial insights into the fundamental mechanisms underpinning superconductivity, while also introducing a new material platform to explore the intricate interplay between the spin/charge order, flat band structures, interlayer coupling, strange metal behavior and high-temperature superconductivity. △ Less

Submitted 9 July, 2024; v1 submitted 13 November, 2023; originally announced November 2023.

Comments: Supplementary information included

Journal ref: Nature 631, 531-536 (2024)

Counting triangles in graphs without vertex disjoint odd cycles

Authors: Jianfeng Hou, Caihong Yang, Qinghou Zeng

Abstract: Given two graphs $H$ and $F$, the maximum possible number of copies of $H$ in an $F$-free graph on $n$ vertices is denoted by $\mathrm{ex}(n, H, F)$. Let $(\ell+1) \cdot F$ denote $\ell+1$ vertex disjoint copies of $F$. In this paper, we determine the exact value of $\mathrm{ex}(n, C_3, (\ell+1)\cdot C_{2k+1})$ and its extremal graph, which generalizes some known results. Given two graphs $H$ and $F$, the maximum possible number of copies of $H$ in an $F$-free graph on $n$ vertices is denoted by $\mathrm{ex}(n, H, F)$. Let $(\ell+1) \cdot F$ denote $\ell+1$ vertex disjoint copies of $F$. In this paper, we determine the exact value of $\mathrm{ex}(n, C_3, (\ell+1)\cdot C_{2k+1})$ and its extremal graph, which generalizes some known results. △ Less

Submitted 29 October, 2023; originally announced October 2023.

Thermal conductivity of MgO in giant planetary interior conditions predicted by deep potential

Authors: Rong Qiu, Qiyu Zeng, Ke Chen, Xiaoxiang Yu, Jiayu Dai

Abstract: Thermal conductivity $κ$ of MgO plays a fundamental role in understanding the thermal evolution and mantle convection in the interior of terrestrial planets. However, previous theoretical calculations deviate from each other and the $κ$ of high-pressure B2 phase remains undetermined. Here, by combining molecular dynamics and deep potential trained with first-principles data, we systematically inve… ▽ More Thermal conductivity $κ$ of MgO plays a fundamental role in understanding the thermal evolution and mantle convection in the interior of terrestrial planets. However, previous theoretical calculations deviate from each other and the $κ$ of high-pressure B2 phase remains undetermined. Here, by combining molecular dynamics and deep potential trained with first-principles data, we systematically investigate the $κ$ of MgO from ambient state to the core-mantle boundary (CMB) of super-Earth with $5M_{\oplus}$. We point out the significance of 4-phonon scatterings and modify the conventional thermal conductivity model of MgO by considering the density-dependent proportion of 3-phonon and 4-phonon scatterings. The $κ$ profiles of MgO in Earth and super-Earth are further estimated. For super-Earth, we predict a significant reduction of $κ$ at the B1-B2 phase transition area near the CMB. This work provides new insights into thermal transport under extreme conditions and an improved thermal model for terrestrial planets. △ Less

Submitted 28 October, 2023; originally announced October 2023.

Comments: 4 figures

Pressure-induced non-monotonic crossover of steady relaxation dynamics in a metallic glass

Authors: Xin Zhang, Hongbo Lou, Beatrice Ruta, Yuriy Chushkin, Federico Zontone, Shubin Li, Dazhe Xu, Tao Liang, Zhidan Zeng, Ho-kwang Mao, Qiaoshi Zeng

Abstract: Relaxation dynamics, as a key to understand glass formation and glassy properties, remains an elusive and challenging issue in condensed matter physics. In this work, in situ high-pressure synchrotron high-energy x-ray photon correlation spectroscopy has been developed to probe the atomic-scale relaxation dynamics of a cerium-based metallic glass during compression. Although the sample density con… ▽ More Relaxation dynamics, as a key to understand glass formation and glassy properties, remains an elusive and challenging issue in condensed matter physics. In this work, in situ high-pressure synchrotron high-energy x-ray photon correlation spectroscopy has been developed to probe the atomic-scale relaxation dynamics of a cerium-based metallic glass during compression. Although the sample density continuously increases, the collective atomic motion initially slows down as generally expected and then counter-intuitively accelerates with further compression (density increase), showing an unusual non-monotonic pressure-induced steady relaxation dynamics crossover at ~3 GPa. Furthermore, by combining in situ high-pressure synchrotron x-ray diffraction, the relaxation dynamics anomaly is evidenced to closely correlate with the dramatic changes in local atomic structures during compression, rather than monotonically scaling with either sample density or overall stress level. These findings could provide new insight into relaxation dynamics and their relationship with local atomic structures of glasses. △ Less

Submitted 25 October, 2023; originally announced October 2023.

Comments: 21 pages, 4 figures

Theoretical evidence of H-He demixing under Jupiter and Saturn conditions

Authors: Xiaoju Chang, Bo Chen, Qiyu Zeng, Han Wang, Kaiguo Chen, Qunchao Tong, Xiaoxiang Yu, Dongdong Kang, Shen Zhang, Fangyu Guo, Yong Hou, Zengxiu Zhao, Yansun Yao, Yanming Ma, Jiayu Dai

Abstract: The immiscibility of hydrogen-helium mixture under the temperature and pressure conditions of planetary interiors is crucial for understanding the structures of gas giant planets (e.g., Jupiter and Saturn). While the experimental probe at such extreme conditions is challenging, theoretical simulation is heavily relied in an effort to unravel the mixing behavior of hydrogen and helium. Here we deve… ▽ More The immiscibility of hydrogen-helium mixture under the temperature and pressure conditions of planetary interiors is crucial for understanding the structures of gas giant planets (e.g., Jupiter and Saturn). While the experimental probe at such extreme conditions is challenging, theoretical simulation is heavily relied in an effort to unravel the mixing behavior of hydrogen and helium. Here we develop a method via a machine learning accelerated molecular dynamics simulation to quantify the physical separation of hydrogen and helium under the conditions of planetary interiors. The immiscibility line achieved with the developed method yields substantially higher demixing temperatures at pressure above 1.5 Mbar than earlier theoretical data, but matches better to the experimental estimate. Our results suggest a possibility that H-He demixing takes place in a large fraction of the interior radii of Jupiter and Saturn, i.e., 27.5% in Jupiter and 48.3% in Saturn. This indication of an H-He immiscible layer hints at the formation of helium rain and offers a potential explanation for the decrease of helium in the atmospheres of Jupiter and Saturn. △ Less

Submitted 5 August, 2024; v1 submitted 20 October, 2023; originally announced October 2023.

Comments: 3 figures, accepted in Nature Communications

Auto-Instruct: Automatic Instruction Generation and Ranking for Black-Box Language Models

Authors: Zhihan Zhang, Shuohang Wang, Wenhao Yu, Yichong Xu, Dan Iter, Qingkai Zeng, Yang Liu, Chenguang Zhu, Meng Jiang

Abstract: Large language models (LLMs) can perform a wide range of tasks by following natural language instructions, without the necessity of task-specific fine-tuning. Unfortunately, the performance of LLMs is greatly influenced by the quality of these instructions, and manually writing effective instructions for each task is a laborious and subjective process. In this paper, we introduce Auto-Instruct, a… ▽ More Large language models (LLMs) can perform a wide range of tasks by following natural language instructions, without the necessity of task-specific fine-tuning. Unfortunately, the performance of LLMs is greatly influenced by the quality of these instructions, and manually writing effective instructions for each task is a laborious and subjective process. In this paper, we introduce Auto-Instruct, a novel method to automatically improve the quality of instructions provided to LLMs. Our method leverages the inherent generative ability of LLMs to produce diverse candidate instructions for a given task, and then ranks them using a scoring model trained on a variety of 575 existing NLP tasks. In experiments on 118 out-of-domain tasks, Auto-Instruct surpasses both human-written instructions and existing baselines of LLM-generated instructions. Furthermore, our method exhibits notable generalizability even with other LLMs that are not incorporated into its training process. △ Less

Submitted 19 October, 2023; originally announced October 2023.

Comments: Accepted to EMNLP 2023 Findings. Work was done before July 2023

Semi-Aerodynamic Model Aided Invariant Kalman Filtering for UAV Full-State Estimation

Authors: Xiaoyu Ye, Fujun Song, Zongyu Zhang, Rui Zhang, Qinghua Zeng

Abstract: Due to the state trajectory-independent features of invariant Kalman filtering (InEKF), it has attracted widespread attention in the research community for its significantly improved state estimation accuracy and convergence under disturbance. In this paper, we formulate the full-source data fusion navigation problem for fixed-wing unmanned aerial vehicle (UAV) within a framework based on error st… ▽ More Due to the state trajectory-independent features of invariant Kalman filtering (InEKF), it has attracted widespread attention in the research community for its significantly improved state estimation accuracy and convergence under disturbance. In this paper, we formulate the full-source data fusion navigation problem for fixed-wing unmanned aerial vehicle (UAV) within a framework based on error state right-invariant extended Kalman filtering (ES-RIEKF) on Lie groups. We merge measurements from a multi-rate onboard sensor network on UAVs to achieve real-time estimation of pose, air flow angles, and wind speed. Detailed derivations are provided, and the algorithm's convergence and accuracy improvements over established methods like Error State EKF (ES-EKF) and Nonlinear Complementary Filter (NCF) are demonstrated using real-flight data from UAVs. Additionally, we introduce a semi-aerodynamic model fusion framework that relies solely on ground-measurable parameters. We design and train an Long Short Term Memory (LSTM) deep network to achieve drift-free prediction of the UAV's angle of attack (AOA) and side-slip angle (SA) using easily obtainable onboard data like control surface deflections, thereby significantly reducing dependency on GNSS or complicated aerodynamic model parameters. Further, we validate the algorithm's robust advantages under GNSS denied, where flight data shows that the maximum positioning error stays within 30 meters over a 130-second denial period. To the best of our knowledge, this study is the first to apply ES-RIEKF to full-source navigation applications for fixed-wing UAVs, aiming to provide engineering references for designers. Our implementations using MATLAB/Simulink will open source. △ Less

Submitted 3 October, 2023; originally announced October 2023.

Discrepancy Matters: Learning from Inconsistent Decoder Features for Consistent Semi-supervised Medical Image Segmentation

Authors: Qingjie Zeng, Yutong Xie, Zilin Lu, Mengkang Lu, Yong Xia

Abstract: Semi-supervised learning (SSL) has been proven beneficial for mitigating the issue of limited labeled data especially on the task of volumetric medical image segmentation. Unlike previous SSL methods which focus on exploring highly confident pseudo-labels or developing consistency regularization schemes, our empirical findings suggest that inconsistent decoder features emerge naturally when two de… ▽ More Semi-supervised learning (SSL) has been proven beneficial for mitigating the issue of limited labeled data especially on the task of volumetric medical image segmentation. Unlike previous SSL methods which focus on exploring highly confident pseudo-labels or developing consistency regularization schemes, our empirical findings suggest that inconsistent decoder features emerge naturally when two decoders strive to generate consistent predictions. Based on the observation, we first analyze the treasure of discrepancy in learning towards consistency, under both pseudo-labeling and consistency regularization settings, and subsequently propose a novel SSL method called LeFeD, which learns the feature-level discrepancy obtained from two decoders, by feeding the discrepancy as a feedback signal to the encoder. The core design of LeFeD is to enlarge the difference by training differentiated decoders, and then learn from the inconsistent information iteratively. We evaluate LeFeD against eight state-of-the-art (SOTA) methods on three public datasets. Experiments show LeFeD surpasses competitors without any bells and whistles such as uncertainty estimation and strong constraints, as well as setting a new state-of-the-art for semi-supervised medical image segmentation. Code is available at \textcolor{cyan}{https://github.com/maxwell0027/LeFeD} △ Less

Submitted 26 September, 2023; originally announced September 2023.

Anomalous thermal transport across the superionic transition in ice

Authors: Rong Qiu, Qiyu Zeng, Han Wang, Dongdong Kang, Xiaoxiang Yu, Jiayu Dai

Abstract: Superionic ices with highly mobile protons within the stable oxygen sub-lattice occupy an important proportion of the phase diagram of ice and widely exist in the interior of icy giants and throughout the universe. Understanding the thermal transport in superionic ice is vital for the thermal evolution of icy planets. However, it is highly challenging due to the extreme thermodynamic conditions an… ▽ More Superionic ices with highly mobile protons within the stable oxygen sub-lattice occupy an important proportion of the phase diagram of ice and widely exist in the interior of icy giants and throughout the universe. Understanding the thermal transport in superionic ice is vital for the thermal evolution of icy planets. However, it is highly challenging due to the extreme thermodynamic conditions and dynamical nature of protons, beyond the capability of the traditional lattice dynamics and empirical potential molecular dynamics approaches. In this work, by utilizing the deep potential molecular dynamics approach, we investigate the thermal conductivity of ice-VII and superionic ice-VII" along the isobar of $p = 30\ \rm{GPa}$. A non-monotonic trend of thermal conductivity with elevated temperature is observed. Through heat flux decomposition and trajectory-based spectra analysis, we show that the thermally-activated proton diffusion in ice-VII and superionic ice-VII" contribute significantly to heat convection, while the broadening in vibrational energy peaks and significant softening of transverse acoustic branches lead to a reduction in heat conduction. The competition between proton diffusion and phonon scattering results in anomalous thermal transport across the superionic transition in ice. This work unravels the important role of proton diffusion in the thermal transport of high-pressure ice. Our approach provides new insights into modeling the thermal transport and atomistic dynamics in superionic materials. △ Less

Submitted 20 September, 2023; originally announced September 2023.

Comments: 5 figures

3D Ultrafast Shear Wave Absolute Vibro-Elastography using a Matrix Array Transducer

Authors: Hoda S. Hashemi, Shahed K. Mohammed, Qi Zeng, Reza Zahiri Azar, Robert N. Rohling, Septimiu E. Salcudean

Abstract: 3D ultrasound imaging provides more spatial information compared to conventional 2D frames by considering the volumes of data. One of the main bottlenecks of 3D imaging is the long data acquisition time which reduces practicality and can introduce artifacts from unwanted patient or sonographer motion. This paper introduces the first shear wave absolute vibro-elastography (S-WAVE) method with real-… ▽ More 3D ultrasound imaging provides more spatial information compared to conventional 2D frames by considering the volumes of data. One of the main bottlenecks of 3D imaging is the long data acquisition time which reduces practicality and can introduce artifacts from unwanted patient or sonographer motion. This paper introduces the first shear wave absolute vibro-elastography (S-WAVE) method with real-time volumetric acquisition using a matrix array transducer. In SWAVE, an external vibration source generates mechanical vibrations inside the tissue. The tissue motion is then estimated and used in solving a wave equation inverse problem to provide the tissue elasticity. A matrix array transducer is used with a Verasonics ultrasound machine and frame rate of 2000 volumes/s to acquire 100 radio frequency (RF) volumes in 0.05 s. Using plane wave (PW) and compounded diverging wave (CDW) imaging methods, we estimate axial, lateral and elevational displacements over 3D volumes. The curl of the displacements is used with local frequency estimation to estimate elasticity in the acquired volumes. Ultrafast acquisition extends substantially the possible S-WAVE excitation frequency range, now up to 800 Hz, enabling new tissue modeling and characterization. The method was validated on three homogeneous liver fibrosis phantoms and on four different inclusions within a heterogeneous phantom. The homogeneous phantom results show less than 8% (PW) and 5% (CDW) difference between the manufacturer values and the corresponding estimated values over a frequency range of 80 Hz to 800 Hz. The estimated elasticity values for the heterogeneous phantom at 400 Hz excitation frequency show average errors of 9% (PW) and 6% (CDW) compared to the provided average values by MRE. Furthermore, both imaging methods were able to detect the inclusions within the elasticity volumes. △ Less

Submitted 22 May, 2023; originally announced September 2023.

UMMAFormer: A Universal Multimodal-adaptive Transformer Framework for Temporal Forgery Localization

Authors: Rui Zhang, Hongxia Wang, Mingshan Du, Hanqing Liu, Yang Zhou, Qiang Zeng

Abstract: The emergence of artificial intelligence-generated content (AIGC) has raised concerns about the authenticity of multimedia content in various fields. However, existing research for forgery content detection has focused mainly on binary classification tasks of complete videos, which has limited applicability in industrial settings. To address this gap, we propose UMMAFormer, a novel universal trans… ▽ More The emergence of artificial intelligence-generated content (AIGC) has raised concerns about the authenticity of multimedia content in various fields. However, existing research for forgery content detection has focused mainly on binary classification tasks of complete videos, which has limited applicability in industrial settings. To address this gap, we propose UMMAFormer, a novel universal transformer framework for temporal forgery localization (TFL) that predicts forgery segments with multimodal adaptation. Our approach introduces a Temporal Feature Abnormal Attention (TFAA) module based on temporal feature reconstruction to enhance the detection of temporal differences. We also design a Parallel Cross-Attention Feature Pyramid Network (PCA-FPN) to optimize the Feature Pyramid Network (FPN) for subtle feature enhancement. To evaluate the proposed method, we contribute a novel Temporal Video Inpainting Localization (TVIL) dataset specifically tailored for video inpainting scenes. Our experiments show that our approach achieves state-of-the-art performance on benchmark datasets, including Lav-DF, TVIL, and Psynd, significantly outperforming previous methods. The code and data are available at https://github.com/ymhzyj/UMMAFormer/. △ Less

Submitted 28 August, 2023; originally announced August 2023.

Comments: 11 pages, 8 figures, 66 references. This paper has been accepted for ACM MM 2023

MSC Class: 68T45 ACM Class: I.4

Journal ref: Proceedings of the 31st ACM International Conference on Multimedia (MM '23), October 29-November 3, 2023

Full-scale ab initio simulations of laser-driven atomistic dynamics

Authors: Qiyu Zeng, Bo Chen, Shen Zhang, Dongdong Kang, Han Wang, Xiaoxiang Yu, Jiayu Dai

Abstract: The coupling of excited states and ionic dynamics is the basic and challenging point for the materials response at extreme conditions. In laboratory, the intense laser produces transient nature and complexity with highly nonequilibrium states, making it extremely difficult and interesting for both experimental measurements and theoretical methods. With the inclusion of laser-excited states, we ext… ▽ More The coupling of excited states and ionic dynamics is the basic and challenging point for the materials response at extreme conditions. In laboratory, the intense laser produces transient nature and complexity with highly nonequilibrium states, making it extremely difficult and interesting for both experimental measurements and theoretical methods. With the inclusion of laser-excited states, we extended ab initio method into the direct simulations of whole laser-driven microscopic dynamics from solid to liquid. We constructed the framework of combining the electron-temperaturedependent deep neural network potential energy surface with hybrid atomistic-continuum approach, controlling non-adiabatic energy exchange and atomistic dynamics, which enables consistent interpretation of experimental data. By large scale ab inito simulations, we demonstrate that the nonthermal effects introduced by hot electrons play a dominant role in modulating the lattice dynamics, thermodynamic pathway, and structural transformation. We highlight that the present work provides a path to realistic computational studies of laser-driven processes, thus bridging the gap between experiments and simulations. △ Less

Submitted 28 October, 2023; v1 submitted 26 August, 2023; originally announced August 2023.

Comments: 4 figures

Large Language Models on Wikipedia-Style Survey Generation: an Evaluation in NLP Concepts

Authors: Fan Gao, Hang Jiang, Rui Yang, Qingcheng Zeng, Jinghui Lu, Moritz Blum, Dairui Liu, Tianwei She, Yuang Jiang, Irene Li

Abstract: Educational materials such as survey articles in specialized fields like computer science traditionally require tremendous expert inputs and are therefore expensive to create and update. Recently, Large Language Models (LLMs) have achieved significant success across various general tasks. However, their effectiveness and limitations in the education domain are yet to be fully explored. In this wor… ▽ More Educational materials such as survey articles in specialized fields like computer science traditionally require tremendous expert inputs and are therefore expensive to create and update. Recently, Large Language Models (LLMs) have achieved significant success across various general tasks. However, their effectiveness and limitations in the education domain are yet to be fully explored. In this work, we examine the proficiency of LLMs in generating succinct survey articles specific to the niche field of NLP in computer science, focusing on a curated list of 99 topics. Automated benchmarks reveal that GPT-4 surpasses its predecessors, inluding GPT-3.5, PaLM2, and LLaMa2 by margins ranging from 2% to 20% in comparison to the established ground truth. We compare both human and GPT-based evaluation scores and provide in-depth analysis. While our findings suggest that GPT-created surveys are more contemporary and accessible than human-authored ones, certain limitations were observed. Notably, GPT-4, despite often delivering outstanding content, occasionally exhibited lapses like missing details or factual errors. At last, we compared the rating behavior between humans and GPT-4 and found systematic bias in using GPT evaluation. △ Less

Submitted 23 May, 2024; v1 submitted 20 August, 2023; originally announced August 2023.

Journal ref: ACL 2024 Findings

Realizing In-Memory Baseband Processing for Ultra-Fast and Energy-Efficient 6G

Authors: Qunsong Zeng, Jiawei Liu, Mingrui Jiang, Jun Lan, Yi Gong, Zhongrui Wang, Yida Li, Can Li, Jim Ignowski, Kaibin Huang

Abstract: To support emerging applications ranging from holographic communications to extended reality, next-generation mobile wireless communication systems require ultra-fast and energy-efficient baseband processors. Traditional complementary metal-oxide-semiconductor (CMOS)-based baseband processors face two challenges in transistor scaling and the von Neumann bottleneck. To address these challenges, in-… ▽ More To support emerging applications ranging from holographic communications to extended reality, next-generation mobile wireless communication systems require ultra-fast and energy-efficient baseband processors. Traditional complementary metal-oxide-semiconductor (CMOS)-based baseband processors face two challenges in transistor scaling and the von Neumann bottleneck. To address these challenges, in-memory computing-based baseband processors using resistive random-access memory (RRAM) present an attractive solution. In this paper, we propose and demonstrate RRAM-implemented in-memory baseband processing for the widely adopted multiple-input-multiple-output orthogonal frequency division multiplexing (MIMO-OFDM) air interface. Its key feature is to execute the key operations, including discrete Fourier transform (DFT) and MIMO detection using linear minimum mean square error (L-MMSE) and zero forcing (ZF), in one-step. In addition, RRAM-based channel estimation module is proposed and discussed. By prototyping and simulations, we demonstrate the feasibility of RRAM-based full-fledged communication system in hardware, and reveal it can outperform state-of-the-art baseband processors with a gain of 91.2$\times$ in latency and 671$\times$ in energy efficiency by large-scale simulations. Our results pave a potential pathway for RRAM-based in-memory computing to be implemented in the era of the sixth generation (6G) mobile communications. △ Less

Submitted 19 August, 2023; originally announced August 2023.

Comments: arXiv admin note: text overlap with arXiv:2205.03561

Small Object Detection via Coarse-to-fine Proposal Generation and Imitation Learning

Authors: Xiang Yuan, Gong Cheng, Kebing Yan, Qinghua Zeng, Junwei Han

Abstract: The past few years have witnessed the immense success of object detection, while current excellent detectors struggle on tackling size-limited instances. Concretely, the well-known challenge of low overlaps between the priors and object regions leads to a constrained sample pool for optimization, and the paucity of discriminative information further aggravates the recognition. To alleviate the afo… ▽ More The past few years have witnessed the immense success of object detection, while current excellent detectors struggle on tackling size-limited instances. Concretely, the well-known challenge of low overlaps between the priors and object regions leads to a constrained sample pool for optimization, and the paucity of discriminative information further aggravates the recognition. To alleviate the aforementioned issues, we propose CFINet, a two-stage framework tailored for small object detection based on the Coarse-to-fine pipeline and Feature Imitation learning. Firstly, we introduce Coarse-to-fine RPN (CRPN) to ensure sufficient and high-quality proposals for small objects through the dynamic anchor selection strategy and cascade regression. Then, we equip the conventional detection head with a Feature Imitation (FI) branch to facilitate the region representations of size-limited instances that perplex the model in an imitation manner. Moreover, an auxiliary imitation loss following supervised contrastive learning paradigm is devised to optimize this branch. When integrated with Faster RCNN, CFINet achieves state-of-the-art performance on the large-scale small object detection benchmarks, SODA-D and SODA-A, underscoring its superiority over baseline detector and other mainstream detection approaches. △ Less

Submitted 18 August, 2023; originally announced August 2023.

Comments: Camera-ready version for ICCV2023. Our code will be available at https://github.com/shaunyuan22/CFINet

Journal ref: Proceedings of the IEEE/CVF International Conference on Computer Vision. 2023: 6317-6327

Efficient Multiuser AI Downloading via Reusable Knowledge Broadcasting

Authors: Hai Wu, Qunsong Zeng, Kaibin Huang

Abstract: For the 6G mobile networks, in-situ model downloading has emerged as an important use case to enable real-time adaptive artificial intelligence on edge devices. However, the simultaneous downloading of diverse and high-dimensional models to multiple devices over wireless links presents a significant communication bottleneck. To overcome the bottleneck, we propose the framework of model broadcastin… ▽ More For the 6G mobile networks, in-situ model downloading has emerged as an important use case to enable real-time adaptive artificial intelligence on edge devices. However, the simultaneous downloading of diverse and high-dimensional models to multiple devices over wireless links presents a significant communication bottleneck. To overcome the bottleneck, we propose the framework of model broadcasting and assembling (MBA), which represents the first attempt on leveraging reusable knowledge, referring to shared parameters among tasks, to enable parameter broadcasting to reduce communication overhead. The MBA framework comprises two key components. The first, the MBA protocol, defines the system operations including parameter selection from a model library, power control for broadcasting, and model assembling at devices. The second component is the joint design of parameter-selection-and-power-control (PS-PC), which provides guarantees on devices' model performance and minimizes the downloading latency. The corresponding optimization problem is simplified by decomposition into the sequential PS and PC sub-problems without compromising its optimality. The PS sub-problem is solved efficiently by designing two efficient algorithms. On one hand, the low-complexity algorithm of greedy parameter selection features the construction of candidate model sets and a selection metric, both of which are designed under the criterion of maximum reusable knowledge among tasks. On the other hand, the optimal tree-search algorithm gains its efficiency via the proposed construction of a compact binary tree pruned using model architecture constraints and an intelligent branch-and-bound search. Given optimal PS, the optimal PC policy is derived in closed form. Extensive experiments demonstrate the substantial reduction in downloading latency achieved by the proposed MBA compared to traditional model downloading. △ Less

Submitted 28 July, 2023; originally announced July 2023.

Comments: Submitted to IEEE for possible publication

Higher-order Topological Insulators and Semimetals in Three Dimensions without Crystalline Counterparts

Authors: Yu-Feng Mao, Yu-Liang Tao, Jiong-Hao Wang, Qi-Bo Zeng, Yong Xu

Abstract: Quasicrystals allow for symmetries that are impossible in crystalline materials, such as eight-fold rotational symmetry, enabling the existence of novel higher-order topological insulators in two dimensions without crystalline counterparts. However, it remains an open question whether three-dimensional higher-order topological insulators and Weyl-like semimetals without crystalline counterparts ca… ▽ More Quasicrystals allow for symmetries that are impossible in crystalline materials, such as eight-fold rotational symmetry, enabling the existence of novel higher-order topological insulators in two dimensions without crystalline counterparts. However, it remains an open question whether three-dimensional higher-order topological insulators and Weyl-like semimetals without crystalline counterparts can exist. Here, we demonstrate the existence of a second-order topological insulator by constructing and exploring a three-dimensional model Hamiltonian in a stack of Ammann-Beenker tiling quasicrystalline lattices. The topological phase has eight chiral hinge modes that lead to quantized longitudinal conductances of $4 e^2/h$. We show that the topological phase is characterized by the winding number of the quadrupole moment. We further establish the existence of a second-order topological insulator with time-reversal symmetry, characterized by a $\mathbb{Z}_2$ topological invariant. Finally, we propose a model that exhibits a higher-order Weyl-like semimetal phase, demonstrating both hinge and surface Fermi arcs. Our findings highlight that quasicrystals in three dimensions can give rise to higher-order topological insulators and semimetal phases that are unattainable in crystals. △ Less

Submitted 18 October, 2023; v1 submitted 27 July, 2023; originally announced July 2023.

Comments: 7 pages, 6 figures

Journal ref: Phys. Rev. B 109, 134205 (2024)

On the expected number of critical points of locally isotropic Gaussian random fields

Authors: Hao Xu, Haoran Yang, Qiang Zeng

Abstract: We consider locally isotropic Gaussian random fields on the $N$-dimensional Euclidean space for fixed $N$. Using the so called Gaussian Orthogonally Invariant matrices first studied by Mallows in 1961 which include the celebrated Gaussian Orthogonal Ensemble (GOE), we establish the Kac--Rice representation of expected number of critical points of non-isotropic Gaussian fields, complementing the is… ▽ More We consider locally isotropic Gaussian random fields on the $N$-dimensional Euclidean space for fixed $N$. Using the so called Gaussian Orthogonally Invariant matrices first studied by Mallows in 1961 which include the celebrated Gaussian Orthogonal Ensemble (GOE), we establish the Kac--Rice representation of expected number of critical points of non-isotropic Gaussian fields, complementing the isotropic case obtained by Cheng and Schwartzman in 2018. In the limit $N=\infty$, we show that such a representation can be always given by GOE matrices, as conjectured by Auffinger and Zeng in 2020. △ Less

Submitted 30 January, 2024; v1 submitted 23 July, 2023; originally announced July 2023.

MaxCut in graphs with sparse neighborhoods

Authors: Jinghua Deng, Jianfeng Hou, Siwei Lin, Qinghou Zeng

Abstract: Let $G$ be a graph with $m$ edges and let $\mathrm{mc}(G)$ denote the size of a largest cut of $G$. The difference $\mathrm{mc}(G)-m/2$ is called the surplus $\mathrm{sp}(G)$ of $G$. A fundamental problem in MaxCut is to determine $\mathrm{sp}(G)$ for $G$ without specific structure, and the degree sequence $d_1,\ldots,d_n$ of $G$ plays a key role in getting lower bounds of $\mathrm{sp}(G)$. A clas… ▽ More Let $G$ be a graph with $m$ edges and let $\mathrm{mc}(G)$ denote the size of a largest cut of $G$. The difference $\mathrm{mc}(G)-m/2$ is called the surplus $\mathrm{sp}(G)$ of $G$. A fundamental problem in MaxCut is to determine $\mathrm{sp}(G)$ for $G$ without specific structure, and the degree sequence $d_1,\ldots,d_n$ of $G$ plays a key role in getting lower bounds of $\mathrm{sp}(G)$. A classical example, given by Shearer, is that $\mathrm{sp}(G)=Ω(\sum_{i=1}^n\sqrt d_i)$ for triangle-free graphs $G$, implying that $\mathrm{sp}(G)=Ω(m^{3/4})$. It was extended to graphs with sparse neighborhoods by Alon, Krivelevich and Sudakov. In this paper, we establish a novel and stronger result for a more general family of graphs with sparse neighborhoods. Our result can derive many well-known bounds on surplus of $H$-free graphs for different $H$, such as triangles, even cycles, graphs having a vertex whose removal makes them acyclic, or complete bipartite graphs $K_{s,t}$ with $s\in \{2,3\}$. It can also deduce many new (tight) bounds on $\mathrm{sp}(G)$ in $H$-free graphs $G$ when $H$ is any graph having a vertex whose removal results in a bipartite graph with relatively small Turán number, especially the even wheel. This contributes to a conjecture raised by Alon, Krivelevich and Sudakov. Moreover, we obtain new families of graphs $H$ such that $\mathrm{sp}(G)=Ω(m^{3/4+ε(H)})$ for some constant $ε(H)>0$ in $H$-free graphs $G$, giving evidences to a conjecture suggested by Alon, Bollobás, Krivelevich and Sudakov. △ Less

Submitted 21 August, 2023; v1 submitted 18 July, 2023; originally announced July 2023.

MinT: Boosting Generalization in Mathematical Reasoning via Multi-View Fine-Tuning

Authors: Zhenwen Liang, Dian Yu, Xiaoman Pan, Wenlin Yao, Qingkai Zeng, Xiangliang Zhang, Dong Yu

Abstract: Reasoning in mathematical domains remains a significant challenge for relatively small language models (LMs). Many current methods focus on specializing LMs in mathematical reasoning and rely heavily on knowledge distillation from powerful but inefficient large LMs (LLMs). In this work, we explore a new direction that avoids over-reliance on LLM teachers, introducing a multi-view fine-tuning metho… ▽ More Reasoning in mathematical domains remains a significant challenge for relatively small language models (LMs). Many current methods focus on specializing LMs in mathematical reasoning and rely heavily on knowledge distillation from powerful but inefficient large LMs (LLMs). In this work, we explore a new direction that avoids over-reliance on LLM teachers, introducing a multi-view fine-tuning method that efficiently exploits existing mathematical problem datasets with diverse annotation styles. Our approach uniquely considers the various annotation formats as different "views" and leverages them in training the model. By postpending distinct instructions to input questions, models can learn to generate solutions in diverse formats in a flexible manner. Experimental results show that our strategy enables a LLaMA-7B model to outperform prior approaches that utilize knowledge distillation, as well as carefully established baselines. Additionally, the proposed method grants the models promising generalization ability across various views and datasets, and the capability to learn from inaccurate or incomplete noisy data. We hope our multi-view training paradigm could inspire future studies in other machine reasoning domains. △ Less

Submitted 16 July, 2023; originally announced July 2023.

Bundle-specific Tractogram Distribution Estimation Using Higher-order Streamline Differential Equation

Authors: Yuanjing Feng, Lei Xie, Jingqiang Wang, Qiyuan Tian, Jianzhong He, Qingrun Zeng, Fei Gao

Abstract: Tractography traces the peak directions extracted from fiber orientation distribution (FOD) suffering from ambiguous spatial correspondences between diffusion directions and fiber geometry, which is prone to producing erroneous tracks while missing true positive connections. The peaks-based tractography methods 'locally' reconstructed streamlines in 'single to single' manner, thus lacking of globa… ▽ More Tractography traces the peak directions extracted from fiber orientation distribution (FOD) suffering from ambiguous spatial correspondences between diffusion directions and fiber geometry, which is prone to producing erroneous tracks while missing true positive connections. The peaks-based tractography methods 'locally' reconstructed streamlines in 'single to single' manner, thus lacking of global information about the trend of the whole fiber bundle. In this work, we propose a novel tractography method based on a bundle-specific tractogram distribution function by using a higher-order streamline differential equation, which reconstructs the streamline bundles in 'cluster to cluster' manner. A unified framework for any higher-order streamline differential equation is presented to describe the fiber bundles with disjoint streamlines defined based on the diffusion tensor vector field. At the global level, the tractography process is simplified as the estimation of bundle-specific tractogram distribution (BTD) coefficients by minimizing the energy optimization model, and is used to characterize the relations between BTD and diffusion tensor vector under the prior guidance by introducing the tractogram bundle information to provide anatomic priors. Experiments are performed on simulated Hough, Sine, Circle data, ISMRM 2015 Tractography Challenge data, FiberCup data, and in vivo data from the Human Connectome Project (HCP) data for qualitative and quantitative evaluation. The results demonstrate that our approach can reconstruct the complex global fiber bundles directly. BTD reduces the error deviation and accumulation at the local level and shows better results in reconstructing long-range, twisting, and large fanning tracts. △ Less

Submitted 17 August, 2024; v1 submitted 6 July, 2023; originally announced July 2023.

The near room-temperature upsurge of electrical resistivity in Lu-H-N is not superconductivity, but a metal-to-poor-conductor transition

Authors: Di Peng, Qiaoshi Zeng, Fujun Lan, Zhenfang Xing, Yang Ding, Ho-kwang Mao

Abstract: Since the discovery of superconductivity in mercury at 4 K in 1911, searching for materials with superconductivity at higher temperatures towards practical conditions has been a primary enduring goal. The recent report of room-temperature superconductivity at near-ambient pressure in nitrogen-doped lutetium hydride (Lu-H-N) by Dasenbrock-Gammon et al. (Hereafter referred as D-G) seems a great step… ▽ More Since the discovery of superconductivity in mercury at 4 K in 1911, searching for materials with superconductivity at higher temperatures towards practical conditions has been a primary enduring goal. The recent report of room-temperature superconductivity at near-ambient pressure in nitrogen-doped lutetium hydride (Lu-H-N) by Dasenbrock-Gammon et al. (Hereafter referred as D-G) seems a great step approaching the ultimate goal. Specifically, they claimed evidence of superconductivity on Lu-H-N with a maximum Tc of 294 K at 1 GPa. However, the failure to observe the drastic temperature-dependent resistance change above 200 K in high-pressure synthesized Lu-H-N compounds, a prerequisite for superconductivity, by researchers worldwide in all independent follow-up studies casts a heavy shadow on the authenticity of the claims. The sober questions are: what is the sample that produces the sharp resistance jump near room temperature? What are the reasons for the non-reproducibility of others who follow the D-G method of synthesis and the inscrutable low success rate (35%) in synthesizing the right sample even for the authors in Ref. 1? What causes the observed sharp resistance jump? Here, with a well-controlled experiment protocol, we repeatedly reproduced the near room-temperature sudden change of electrical resistance in the Lu-H-N sample, and we could quantitatively compare its behavior with the initial pure Lu in a normal metallic state. These results enable us to scrutinize the origin for the near-room temperature sharp resistance change, which is attributed to a metal-to-poor-conductor transition rather than superconductivity. △ Less

Submitted 30 June, 2023; originally announced July 2023.

Comments: 6 pages, 1 figure

Journal ref: Matter and Radiation at Extremes 8, 058401 (2023)

C-PMI: Conditional Pointwise Mutual Information for Turn-level Dialogue Evaluation

Authors: Liliang Ren, Mankeerat Sidhu, Qi Zeng, Revanth Gangi Reddy, Heng Ji, ChengXiang Zhai

Abstract: Existing reference-free turn-level evaluation metrics for chatbots inadequately capture the interaction between the user and the system. Consequently, they often correlate poorly with human evaluations. To address this issue, we propose a novel model-agnostic approach that leverages Conditional Pointwise Mutual Information (C-PMI) to measure the turn-level interaction between the system and the us… ▽ More Existing reference-free turn-level evaluation metrics for chatbots inadequately capture the interaction between the user and the system. Consequently, they often correlate poorly with human evaluations. To address this issue, we propose a novel model-agnostic approach that leverages Conditional Pointwise Mutual Information (C-PMI) to measure the turn-level interaction between the system and the user based on a given evaluation dimension. Experimental results on the widely used FED dialogue evaluation dataset demonstrate that our approach significantly improves the correlation with human judgment compared with existing evaluation systems. By replacing the negative log-likelihood-based scorer with our proposed C-PMI scorer, we achieve a relative 62.6% higher Spearman correlation on average for the FED evaluation metric. Our code is publicly available at https://github.com/renll/C-PMI. △ Less

Submitted 1 September, 2023; v1 submitted 27 June, 2023; originally announced June 2023.

Comments: Published at ACL2023 DialDoc Workshop; Updated Results

Wannier-Stark localization in one-dimensional amplitude-chirped lattices

Authors: Qi-Bo Zeng, Bo Hou, Han Xiao

Abstract: We study the Wannier-Stark (WS) localization in one-dimensional amplitude-chirped lattices with the $j$th onsite potential modulated by a function $Fj\cos(2παj)$, where $F$ is the external field with a period determined by $α=p/q$ ($p$ and $q$ are coprime integers). In the Hermitian (or non-Hermitian) systems with real (or imaginary) fields, we can obtain real (or imaginary) WS ladders in the eige… ▽ More We study the Wannier-Stark (WS) localization in one-dimensional amplitude-chirped lattices with the $j$th onsite potential modulated by a function $Fj\cos(2παj)$, where $F$ is the external field with a period determined by $α=p/q$ ($p$ and $q$ are coprime integers). In the Hermitian (or non-Hermitian) systems with real (or imaginary) fields, we can obtain real (or imaginary) WS ladders in the eigenenergy spectrum. In most cases with $q \geq 2$, there are multiple WS ladders with all the eigenstates localized in the strong field limit. However, in the lattices with $q=4$, the energy-dependent localization phenomenon emerges due to the presence of both spatially periodic and linearly increasing behaviors in the onsite potential. About half the number of eigenstates are gathered at the band center and can extend over a wide region or even the full range of the lattice, even when the field becomes very strong. Moreover, in the non-Hermitian lattices with odd $q$, some of the WS ladders become doubly degenerate, where the eigenstates are evenly distributed at two neighboring sites in a wide regime of field strength. Our work opens an avenue for exploring WS localization in both Hermitian and non-Hermitian amplitude-chirped lattices. △ Less

Submitted 21 September, 2023; v1 submitted 8 June, 2023; originally announced June 2023.

Comments: 8 pages, 9 figures (including supplementary)

Journal ref: Phys. Rev. B 108, 104207 (2023)

Towards Fairness in Personalized Ads Using Impression Variance Aware Reinforcement Learning

Authors: Aditya Srinivas Timmaraju, Mehdi Mashayekhi, Mingliang Chen, Qi Zeng, Quintin Fettes, Wesley Cheung, Yihan Xiao, Manojkumar Rangasamy Kannadasan, Pushkar Tripathi, Sean Gahagan, Miranda Bogen, Rob Roudani

Abstract: Variances in ad impression outcomes across demographic groups are increasingly considered to be potentially indicative of algorithmic bias in personalized ads systems. While there are many definitions of fairness that could be applicable in the context of personalized systems, we present a framework which we call the Variance Reduction System (VRS) for achieving more equitable outcomes in Meta's a… ▽ More Variances in ad impression outcomes across demographic groups are increasingly considered to be potentially indicative of algorithmic bias in personalized ads systems. While there are many definitions of fairness that could be applicable in the context of personalized systems, we present a framework which we call the Variance Reduction System (VRS) for achieving more equitable outcomes in Meta's ads systems. VRS seeks to achieve a distribution of impressions with respect to selected protected class (PC) attributes that more closely aligns the demographics of an ad's eligible audience (a function of advertiser targeting criteria) with the audience who sees that ad, in a privacy-preserving manner. We first define metrics to quantify fairness gaps in terms of ad impression variances with respect to PC attributes including gender and estimated race. We then present the VRS for re-ranking ads in an impression variance-aware manner. We evaluate VRS via extensive simulations over different parameter choices and study the effect of the VRS on the chosen fairness metric. We finally present online A/B testing results from applying VRS to Meta's ads systems, concluding with a discussion of future work. We have deployed the VRS to all users in the US for housing ads, resulting in significant improvement in our fairness metric. VRS is the first large-scale deployed framework for pursuing fairness for multiple PC attributes in online advertising. △ Less

Submitted 8 June, 2023; v1 submitted 5 June, 2023; originally announced June 2023.

Comments: 11 pages, 7 figure, KDD 2023

Large Language Models Are Partially Primed in Pronoun Interpretation

Authors: Suet-Ying Lam, Qingcheng Zeng, Kexun Zhang, Chenyu You, Rob Voigt

Abstract: While a large body of literature suggests that large language models (LLMs) acquire rich linguistic representations, little is known about whether they adapt to linguistic biases in a human-like way. The present study probes this question by asking whether LLMs display human-like referential biases using stimuli and procedures from real psycholinguistic experiments. Recent psycholinguistic studies… ▽ More While a large body of literature suggests that large language models (LLMs) acquire rich linguistic representations, little is known about whether they adapt to linguistic biases in a human-like way. The present study probes this question by asking whether LLMs display human-like referential biases using stimuli and procedures from real psycholinguistic experiments. Recent psycholinguistic studies suggest that humans adapt their referential biases with recent exposure to referential patterns; closely replicating three relevant psycholinguistic experiments from Johnson & Arnold (2022) in an in-context learning (ICL) framework, we found that InstructGPT adapts its pronominal interpretations in response to the frequency of referential patterns in the local discourse, though in a limited fashion: adaptation was only observed relative to syntactic but not semantic biases. By contrast, FLAN-UL2 fails to generate meaningful patterns. Our results provide further evidence that contemporary LLMs discourse representations are sensitive to syntactic patterns in the local context but less so to semantic patterns. Our data and code are available at \url{https://github.com/zkx06111/llm_priming}. △ Less

Submitted 26 May, 2023; originally announced May 2023.

Comments: Accepted at Findings of ACL 2023

Scientific Opinion Summarization: Paper Meta-review Generation Dataset, Methods, and Evaluation

Authors: Qi Zeng, Mankeerat Sidhu, Ansel Blume, Hou Pong Chan, Lu Wang, Heng Ji

Abstract: Opinions in scientific research papers can be divergent, leading to controversies among reviewers. However, most existing datasets for opinion summarization are centered around product reviews and assume that the analyzed opinions are non-controversial, failing to account for the variability seen in other contexts such as academic papers, political debates, or social media discussions. To address… ▽ More Opinions in scientific research papers can be divergent, leading to controversies among reviewers. However, most existing datasets for opinion summarization are centered around product reviews and assume that the analyzed opinions are non-controversial, failing to account for the variability seen in other contexts such as academic papers, political debates, or social media discussions. To address this gap, we propose the task of scientific opinion summarization, where research paper reviews are synthesized into meta-reviews. To facilitate this task, we introduce the ORSUM dataset covering 15,062 paper meta-reviews and 57,536 paper reviews from 47 conferences. Furthermore, we propose the Checklist-guided Iterative Introspection approach, which breaks down scientific opinion summarization into several stages, iteratively refining the summary under the guidance of questions from a checklist. Our experiments show that (1) human-written summaries do not always satisfy all necessary criteria such as depth of discussion, and identifying consensus and controversy for the specific domain, and (2) the combination of task decomposition and iterative self-refinement shows strong potential for enhancing the opinions and can be applied to other complex text generation using black-box LLMs. △ Less

Submitted 15 June, 2024; v1 submitted 23 May, 2023; originally announced May 2023.

Comments: IJCAI 2024 AI4Research Workshop

Interpretable Automatic Fine-grained Inconsistency Detection in Text Summarization

Authors: Hou Pong Chan, Qi Zeng, Heng Ji

Abstract: Existing factual consistency evaluation approaches for text summarization provide binary predictions and limited insights into the weakness of summarization systems. Therefore, we propose the task of fine-grained inconsistency detection, the goal of which is to predict the fine-grained types of factual errors in a summary. Motivated by how humans inspect factual inconsistency in summaries, we prop… ▽ More Existing factual consistency evaluation approaches for text summarization provide binary predictions and limited insights into the weakness of summarization systems. Therefore, we propose the task of fine-grained inconsistency detection, the goal of which is to predict the fine-grained types of factual errors in a summary. Motivated by how humans inspect factual inconsistency in summaries, we propose an interpretable fine-grained inconsistency detection model, FineGrainFact, which explicitly represents the facts in the documents and summaries with semantic frames extracted by semantic role labeling, and highlights the related semantic frames to predict inconsistency. The highlighted semantic frames help verify predicted error types and correct inconsistent summaries. Experiment results demonstrate that our model outperforms strong baselines and provides evidence to support or refute the summary. △ Less

Submitted 23 May, 2023; originally announced May 2023.

Comments: Accepted by ACL Findings 2023. Code and data are available at https://github.com/kenchan0226/fineGrainedFact

Adaptive Privacy-Preserving Coded Computing With Hierarchical Task Partitioning

Authors: Qicheng Zeng, Zhaojun Nan, Sheng Zhou

Abstract: Distributed computing is known as an emerging and efficient technique to support various intelligent services, such as large-scale machine learning. However, privacy leakage and random delays from straggling servers pose significant challenges. To address these issues, coded computing, a promising solution that combines coding theory with distributed computing, recovers computation tasks with resu… ▽ More Distributed computing is known as an emerging and efficient technique to support various intelligent services, such as large-scale machine learning. However, privacy leakage and random delays from straggling servers pose significant challenges. To address these issues, coded computing, a promising solution that combines coding theory with distributed computing, recovers computation tasks with results from a subset of workers. In this paper, we propose the adaptive privacy-preserving coded computing (APCC) strategy, which can adaptively provide accurate or approximated results according to the form of computation functions, so as to suit diverse types of computation tasks. We prove that APCC achieves complete data privacy preservation and demonstrate its optimality in terms of encoding rate, defined as the ratio between the computation loads of tasks before and after encoding. To further alleviate the straggling effect and reduce delay, we integrate hierarchical task partitioning and task cancellation into the coding design of APCC. The corresponding partitioning problems are formulated as mixed-integer nonlinear programming (MINLP) problems with the objective of minimizing task completion delay. We propose a low-complexity maximum value descent (MVD) algorithm to optimally solve these problems. Simulation results show that APCC can reduce task completion delay by a range of 20.3% to 47.5% when compared to other state-of-the-art benchmarks. △ Less

Submitted 30 October, 2023; v1 submitted 11 May, 2023; originally announced May 2023.

Comments: 15 pages, 8 figures

Controlled entanglement source for quantum cryptography

Authors: Qiang Zeng, Haoyang Wang, Huihong Yuan, Yuanbin Fan, Lai Zhou, Yuanfei Gao, Haiqiang Ma, Zhiliang Yuan

Abstract: Quantum entanglement has become an essential resource in quantum information processing. Existing works employ entangled quantum states to perform various tasks, while little attention is paid to the control of the resource. In this work, we propose a simple protocol to upgrade an entanglement source with access control through phase randomization at the optical pump. The enhanced source can effec… ▽ More Quantum entanglement has become an essential resource in quantum information processing. Existing works employ entangled quantum states to perform various tasks, while little attention is paid to the control of the resource. In this work, we propose a simple protocol to upgrade an entanglement source with access control through phase randomization at the optical pump. The enhanced source can effectively control all users in utilizing the entanglement resource to implement quantum cryptography. In addition, we show this control can act as a practical countermeasure against memory attack on device-independent quantum key distribution at a negligible cost. To demonstrate the feasibility of our protocol, we implement an experimental setup using just off-the-shelf components and characterize its performance accordingly. △ Less

Submitted 3 May, 2023; originally announced May 2023.

Comments: 9 pages, 7 figures, comments are welcome! Looking forward to collaborations!

Weakly distance-regular digraphs whose underlying graphs are distance-regular, I

Authors: Yuefeng Yang, Qing Zeng, Kaishun Wang

Abstract: Weakly distance-regular digraphs are a natural directed version of distance-regular graphs. In [8], the third author and Suzuki proposed a question when an orientation of a distance-regular graph defines a weakly distance-regular digraph. In this paper, we initiate this project, and classify all commutative weakly distance-regular digraphs whose underlying graphs are Hamming graphs, folded n-cubes… ▽ More Weakly distance-regular digraphs are a natural directed version of distance-regular graphs. In [8], the third author and Suzuki proposed a question when an orientation of a distance-regular graph defines a weakly distance-regular digraph. In this paper, we initiate this project, and classify all commutative weakly distance-regular digraphs whose underlying graphs are Hamming graphs, folded n-cubes and Doob graphs, respectively. △ Less

Submitted 10 April, 2024; v1 submitted 29 April, 2023; originally announced May 2023.

Gaussian eigenstate pinning in non-Hermitian quantum mechanics

Authors: Qi-Bo Zeng, Rong Lü

Abstract: We study a one-dimensional system subjected to a linearly varying imaginary vector potential, which is described by the single-particle continuous Schrödinger equation and is analytically solved. The eigenenergy spectrum is found to be real under open boundary condition (OBC) but forms a parabola in the complex energy plane under periodic boundary condition (PBC). The eigenstates always exhibit a… ▽ More We study a one-dimensional system subjected to a linearly varying imaginary vector potential, which is described by the single-particle continuous Schrödinger equation and is analytically solved. The eigenenergy spectrum is found to be real under open boundary condition (OBC) but forms a parabola in the complex energy plane under periodic boundary condition (PBC). The eigenstates always exhibit a modulated Gaussian distribution and are all pinned on the same position, which is determined by the imaginary vector potential and boundary conditions. These behaviors are in sharp contrast to the non-Hermitian skin effect (NHSE) in systems with constant imaginary vector potential, where the eigenstates are exponentially distributed under OBC but become extended under PBC. We further demonstrate that even though the spectrum under PBC is an open curve, the Gaussian type of NHSE still has a topological origin and is characterized by a nonvanishing winding number in the PBC spectrum. The energies interior to the parabola can support localized edge states under semi-infinite boundary condition. The corresponding tight-binding lattice models also show similar properties, except that the PBC spectrum forms closed loops. Our work opens a door for the study of quantum systems with spatially varying imaginary vector potentials. △ Less

Submitted 30 June, 2023; v1 submitted 28 April, 2023; originally announced April 2023.

Comments: 7 pages, 3 figures

Journal ref: Phys. Rev. A 107, 062221 (2023)

DeePMD-kit v2: A software package for Deep Potential models

Authors: Jinzhe Zeng, Duo Zhang, Denghui Lu, Pinghui Mo, Zeyu Li, Yixiao Chen, Marián Rynik, Li'ang Huang, Ziyao Li, Shaochen Shi, Yingze Wang, Haotian Ye, Ping Tuo, Jiabin Yang, Ye Ding, Yifan Li, Davide Tisi, Qiyu Zeng, Han Bao, Yu Xia, Jiameng Huang, Koki Muraoka, Yibo Wang, Junhan Chang, Fengbo Yuan , et al. (22 additional authors not shown)

Abstract: DeePMD-kit is a powerful open-source software package that facilitates molecular dynamics simulations using machine learning potentials (MLP) known as Deep Potential (DP) models. This package, which was released in 2017, has been widely used in the fields of physics, chemistry, biology, and material science for studying atomistic systems. The current version of DeePMD-kit offers numerous advanced… ▽ More DeePMD-kit is a powerful open-source software package that facilitates molecular dynamics simulations using machine learning potentials (MLP) known as Deep Potential (DP) models. This package, which was released in 2017, has been widely used in the fields of physics, chemistry, biology, and material science for studying atomistic systems. The current version of DeePMD-kit offers numerous advanced features such as DeepPot-SE, attention-based and hybrid descriptors, the ability to fit tensile properties, type embedding, model deviation, Deep Potential - Range Correction (DPRc), Deep Potential Long Range (DPLR), GPU support for customized operators, model compression, non-von Neumann molecular dynamics (NVNMD), and improved usability, including documentation, compiled binary packages, graphical user interfaces (GUI), and application programming interfaces (API). This article presents an overview of the current major version of the DeePMD-kit package, highlighting its features and technical details. Additionally, the article benchmarks the accuracy and efficiency of different models and discusses ongoing developments. △ Less

Submitted 18 April, 2023; originally announced April 2023.

Comments: 51 pages, 2 figures

ACM Class: J.2

Journal ref: J. Chem. Phys. 159, 054801 (2023)

Improved Naive Bayes with Mislabeled Data

Authors: Qianhan Zeng, Yingqiu Zhu, Xuening Zhu, Feifei Wang, Weichen Zhao, Shuning Sun, Meng Su, Hansheng Wang

Abstract: Labeling mistakes are frequently encountered in real-world applications. If not treated well, the labeling mistakes can deteriorate the classification performances of a model seriously. To address this issue, we propose an improved Naive Bayes method for text classification. It is analytically simple and free of subjective judgements on the correct and incorrect labels. By specifying the generatin… ▽ More Labeling mistakes are frequently encountered in real-world applications. If not treated well, the labeling mistakes can deteriorate the classification performances of a model seriously. To address this issue, we propose an improved Naive Bayes method for text classification. It is analytically simple and free of subjective judgements on the correct and incorrect labels. By specifying the generating mechanism of incorrect labels, we optimize the corresponding log-likelihood function iteratively by using an EM algorithm. Our simulation and experiment results show that the improved Naive Bayes method greatly improves the performances of the Naive Bayes method with mislabeled data. △ Less

Submitted 13 April, 2023; originally announced April 2023.

Regression-based Deep-Learning predicts molecular biomarkers from pathology slides

Authors: Omar S. M. El Nahhas, Chiara M. L. Loeffler, Zunamys I. Carrero, Marko van Treeck, Fiona R. Kolbinger, Katherine J. Hewitt, Hannah S. Muti, Mara Graziani, Qinghe Zeng, Julien Calderaro, Nadina Ortiz-Brüchle, Tanwei Yuan, Michael Hoffmeister, Hermann Brenner, Alexander Brobeil, Jorge S. Reis-Filho, Jakob Nikolas Kather

Abstract: Deep Learning (DL) can predict biomarkers from cancer histopathology. Several clinically approved applications use this technology. Most approaches, however, predict categorical labels, whereas biomarkers are often continuous measurements. We hypothesized that regression-based DL outperforms classification-based DL. Therefore, we developed and evaluated a new self-supervised attention-based weakly… ▽ More Deep Learning (DL) can predict biomarkers from cancer histopathology. Several clinically approved applications use this technology. Most approaches, however, predict categorical labels, whereas biomarkers are often continuous measurements. We hypothesized that regression-based DL outperforms classification-based DL. Therefore, we developed and evaluated a new self-supervised attention-based weakly supervised regression method that predicts continuous biomarkers directly from images in 11,671 patients across nine cancer types. We tested our method for multiple clinically and biologically relevant biomarkers: homologous repair deficiency (HRD) score, a clinically used pan-cancer biomarker, as well as markers of key biological processes in the tumor microenvironment. Using regression significantly enhances the accuracy of biomarker prediction, while also improving the interpretability of the results over classification. In a large cohort of colorectal cancer patients, regression-based prediction scores provide a higher prognostic value than classification-based scores. Our open-source regression approach offers a promising alternative for continuous biomarker analysis in computational pathology. △ Less

Submitted 11 April, 2023; originally announced April 2023.

DecentRAN: Decentralized Radio Access Network for 5.5G and beyond

Authors: Hao Xu, Xun Liu, Qinghai Zeng, Qiang Li, Shibin Ge, Guohua Zhou, Raymond Forbes

Abstract: Radio Access Network faces challenges from privacy and flexible wide area and local area network access. RAN is limited from providing local service directly due to centralized design of cellular network and concerns of user privacy and data security. DecentRAN or Decentralized Radio Access Network offers an alternative perspective to cope with the emerging demands of 5G Non-public Network and the… ▽ More Radio Access Network faces challenges from privacy and flexible wide area and local area network access. RAN is limited from providing local service directly due to centralized design of cellular network and concerns of user privacy and data security. DecentRAN or Decentralized Radio Access Network offers an alternative perspective to cope with the emerging demands of 5G Non-public Network and the hybrid deployment of 5GS and Wi-Fi in the campus network. Starting from Public key as an Identity, independent mutual authentication between UE and RAN are made possible in a privacy-preserving manner. With the introduction of decentralized architecture and network functions using blockchain and smart contracts, DecentRAN has ability to provide users with locally managed, end-to-end encrypted 5G NPN and the potential connectivity to Local Area Network via campus routers. Furthermore, the performance regarding throughput and latency are discussed, offering the deployment guidance for DecentRAN. △ Less

Submitted 30 March, 2023; originally announced March 2023.

SmartBook: AI-Assisted Situation Report Generation for Intelligence Analysts

Authors: Revanth Gangi Reddy, Daniel Lee, Yi R. Fung, Khanh Duy Nguyen, Qi Zeng, Manling Li, Ziqi Wang, Clare Voss, Heng Ji

Abstract: Timely and comprehensive understanding of emerging events is crucial for effective decision-making; automating situation report generation can significantly reduce the time, effort, and cost for intelligence analysts. In this work, we identify intelligence analysts' practices and preferences for AI assistance in situation report generation to guide the design strategies for an effective, trust-bui… ▽ More Timely and comprehensive understanding of emerging events is crucial for effective decision-making; automating situation report generation can significantly reduce the time, effort, and cost for intelligence analysts. In this work, we identify intelligence analysts' practices and preferences for AI assistance in situation report generation to guide the design strategies for an effective, trust-building interface that aligns with their thought processes and needs. Next, we introduce SmartBook, an automated framework designed to generate situation reports from large volumes of news data, creating structured reports by automatically discovering event-related strategic questions. These reports include multiple hypotheses (claims), summarized and grounded to sources with factual evidence, to promote in-depth situation understanding. Our comprehensive evaluation of SmartBook, encompassing a user study alongside a content review with an editing study, reveals SmartBook's effectiveness in generating accurate and relevant situation reports. Qualitative evaluations indicate over 80% of questions probe for strategic information, and over 90% of summaries produce tactically useful content, being consistently favored over summaries from a large language model integrated with web search. The editing study reveals that minimal information is removed from the generated text (under 2.5%), suggesting that SmartBook provides analysts with a valuable foundation for situation reports △ Less

Submitted 27 May, 2024; v1 submitted 24 March, 2023; originally announced March 2023.

Comments: Preprint

The Chocolate Chip Cookie Model: dust-to-metal ratio of HII regions

Authors: Jiafeng Lu, Shiyin Shen, Fangting Yuan, Qi Zeng

Abstract: Using a sample of face-on star-forming galaxies selected from the Sloan Digital Sky Survey, we statistically derive the typical optical depth $τ_{\rm{cl}}$ of individual HII regions based on the ``Chocolate Chip Cookie" model of Lu2022. By binning galaxies into stellar mass and gas-phase metallicity bins and interpreting $τ_{\rm{cl}}$ as the dust to gas ratio (DGR) of HII regions, we further inves… ▽ More Using a sample of face-on star-forming galaxies selected from the Sloan Digital Sky Survey, we statistically derive the typical optical depth $τ_{\rm{cl}}$ of individual HII regions based on the ``Chocolate Chip Cookie" model of Lu2022. By binning galaxies into stellar mass and gas-phase metallicity bins and interpreting $τ_{\rm{cl}}$ as the dust to gas ratio (DGR) of HII regions, we further investigate the correlations among DGR and stellar mass, gas-phase metallicity respectively. We find that DGR increases monotonically with the stellar mass of galaxies. At a given stellar mass, DGR shows a linear correlation with the gas-phase metallicity, which implies a constant dust to metal ratio (DTM) of galaxies at a given stellar mass. These results adequately indicate that the DTM of galaxies is simply a function of their stellar masses. In terms of gas-phase metallicity, because of the mass-metalliciy relation, DTM increases with increasing metallicity with a power-law index 1.45 in the low metallicity region, while remains constant at the high metallicity end. △ Less

Submitted 3 April, 2023; v1 submitted 22 March, 2023; originally announced March 2023.

Comments: 9 pages, 4 figures

Turning Noises to Fingerprint-Free "Credentials": Secure and Usable Drone Authentication

Authors: Chuxiong Wu, Qiang Zeng

Abstract: Drones have been widely used in various services, such as delivery and surveillance. Authentication forms the foundation of the security of these services. However, drones are expensive and may carry important payloads. To avoid being captured by attackers, drones should keep a safe distance from the verifier before authentication succeeds. This makes authentication methods that only work in very… ▽ More Drones have been widely used in various services, such as delivery and surveillance. Authentication forms the foundation of the security of these services. However, drones are expensive and may carry important payloads. To avoid being captured by attackers, drones should keep a safe distance from the verifier before authentication succeeds. This makes authentication methods that only work in very close proximity not applicable. Our work leverages drone noises for authentication. While using sounds for authentication is highly usable, how to handle various attacks that manipulate sounds is an \emph{unresolved challenge}. It is also unclear how to ensure robustness under various environmental sounds. Being the first in the literature, we address the two major challenges by exploiting unique characteristics of drone noises. We thereby build an authentication system that does \emph{not} rely on any drone sound fingerprints, keeps resilient to attacks, and is robust under environmental sounds. An extensive evaluation demonstrates its security and usability. △ Less

Submitted 10 April, 2024; v1 submitted 17 February, 2023; originally announced February 2023.

Comments: Accepted by IEEE Transactions on Mobile Computing

Foresee What You Will Learn: Data Augmentation for Domain Generalization in Non-stationary Environment

Authors: Qiuhao Zeng, Wei Wang, Fan Zhou, Charles Ling, Boyu Wang

Abstract: Existing domain generalization aims to learn a generalizable model to perform well even on unseen domains. For many real-world machine learning applications, the data distribution often shifts gradually along domain indices. For example, a self-driving car with a vision system drives from dawn to dusk, with the sky darkening gradually. Therefore, the system must be able to adapt to changes in ambi… ▽ More Existing domain generalization aims to learn a generalizable model to perform well even on unseen domains. For many real-world machine learning applications, the data distribution often shifts gradually along domain indices. For example, a self-driving car with a vision system drives from dawn to dusk, with the sky darkening gradually. Therefore, the system must be able to adapt to changes in ambient illumination and continue to drive safely on the road. In this paper, we formulate such problems as Evolving Domain Generalization, where a model aims to generalize well on a target domain by discovering and leveraging the evolving pattern of the environment. We then propose Directional Domain Augmentation (DDA), which simulates the unseen target features by mapping source data as augmentations through a domain transformer. Specifically, we formulate DDA as a bi-level optimization problem and solve it through a novel meta-learning approach in the representation space. We evaluate the proposed method on both synthetic datasets and realworld datasets, and empirical results show that our approach can outperform other existing methods. △ Less

Submitted 8 March, 2023; v1 submitted 18 January, 2023; originally announced January 2023.

Comments: 12 pages, 6 figures, accepted by AAAI 2023

Towards Transcervical Ultrasound Image Guidance for Transoral Robotic Surgery

Authors: Wanwen Chen, Megha Kalia, Qi Zeng, Emily H. T. Pang, Razeyeh Bagherinasab, Thomas D. Milner, Farahna Sabiq, Eitan Prisman, Septimiu E. Salcudean

Abstract: Purpose: Trans-oral robotic surgery (TORS) using the da Vinci surgical robot is a new minimally-invasive surgery method to treat oropharyngeal tumors, but it is a challenging operation. Augmented reality (AR) based on intra-operative ultrasound (US) has the potential to enhance the visualization of the anatomy and cancerous tumors to provide additional tools for decision-making in surgery. Methods… ▽ More Purpose: Trans-oral robotic surgery (TORS) using the da Vinci surgical robot is a new minimally-invasive surgery method to treat oropharyngeal tumors, but it is a challenging operation. Augmented reality (AR) based on intra-operative ultrasound (US) has the potential to enhance the visualization of the anatomy and cancerous tumors to provide additional tools for decision-making in surgery. Methods: We propose and carry out preliminary evaluations of a US-guided AR system for TORS, with the transducer placed on the neck for a transcervical view. Firstly, we perform a novel MRI-transcervical 3D US registration study. Secondly, we develop a US-robot calibration method with an optical tracker and an AR system to display the anatomy mesh model in the real-time endoscope images inside the surgeon console. Results: Our AR system reaches a mean projection error of 26.81 and 27.85 pixels for the projection from the US to stereo cameras in a water bath experiment. The average target registration error for MRI to 3D US is 8.90 mm for the 3D US transducer and 5.85 mm for freehand 3D US, and the average distance between the vessel centerlines is 2.32 mm. Conclusion: We demonstrate the first proof-of-concept transcervical US-guided AR system for TORS and the feasibility of trans-cervical 3D US-MRI registration. Our results show that trans-cervical 3D US is a promising technique for TORS image guidance. △ Less

Submitted 31 March, 2023; v1 submitted 29 November, 2022; originally announced November 2022.

Comments: 12 pages, 8 figures. Accepted by Information Processing for Computer Assisted Interventions (IPCAI 2023)

Extremal graphs for the suspension of edge-critical graphs

Authors: Jianfeng Hou, Heng Li, Qinghou Zeng

Abstract: The Turán number of a graph $H$, $\text{ex}(n,H)$, is the maximum number of edges in an $n$-vertex graph that does not contain $H$ as a subgraph. For a vertex $v$ and a multi-set $\mathcal{F}$ of graphs, the suspension $\mathcal{F}+v$ of $\mathcal{F}$ is the graph obtained by connecting the vertex $v$ to all vertices of $F$ for each $F\in \mathcal{F}$. For two integers $k\ge1$ and $r\ge2$, let… ▽ More The Turán number of a graph $H$, $\text{ex}(n,H)$, is the maximum number of edges in an $n$-vertex graph that does not contain $H$ as a subgraph. For a vertex $v$ and a multi-set $\mathcal{F}$ of graphs, the suspension $\mathcal{F}+v$ of $\mathcal{F}$ is the graph obtained by connecting the vertex $v$ to all vertices of $F$ for each $F\in \mathcal{F}$. For two integers $k\ge1$ and $r\ge2$, let $H_i$ be a graph containing a critical edge with chromatic number $r$ for any $i\in\{1,\ldots,k\}$, and let $H=\{H_1,\ldots,H_k\}+v$. In this paper, we determine $\text{ex}(n, H)$ and characterize all the extremal graphs for sufficiently large $n$. This generalizes a result of Chen, Gould, Pfender and Wei on intersecting cliques. We also obtain a stability theorem for $H$, extending a result of Roberts and Scott on graphs containing a critical edge. △ Less

Submitted 15 November, 2022; originally announced November 2022.

GreenPLM: Cross-Lingual Transfer of Monolingual Pre-Trained Language Models at Almost No Cost

Authors: Qingcheng Zeng, Lucas Garay, Peilin Zhou, Dading Chong, Yining Hua, Jiageng Wu, Yikang Pan, Han Zhou, Rob Voigt, Jie Yang

Abstract: Large pre-trained models have revolutionized natural language processing (NLP) research and applications, but high training costs and limited data resources have prevented their benefits from being shared equally amongst speakers of all the world's languages. To address issues of cross-linguistic access to such models and reduce energy consumption for sustainability during large-scale model traini… ▽ More Large pre-trained models have revolutionized natural language processing (NLP) research and applications, but high training costs and limited data resources have prevented their benefits from being shared equally amongst speakers of all the world's languages. To address issues of cross-linguistic access to such models and reduce energy consumption for sustainability during large-scale model training, this study proposes an effective and energy-efficient framework called GreenPLM that uses bilingual lexicons to directly "translate" pre-trained language models of one language into another at almost no additional cost. We validate this approach in 18 languages' BERT models and show that this framework is comparable to, if not better than, other heuristics with high training costs. In addition, given lightweight continued pre-training on limited data where available, this framework outperforms the original monolingual language models in six out of seven tested languages with up to 200x less pre-training efforts. Aiming at the Leave No One Behind Principle (LNOB), our approach manages to reduce inequalities between languages and energy consumption greatly. We make our codes and models publicly available here: \url{https://github.com/qcznlp/GreenPLMs} △ Less

Submitted 26 May, 2023; v1 submitted 13 November, 2022; originally announced November 2022.

Comments: Accepted at IJCAI 2023 AI and Social Good Track

Two stability theorems for $\mathcal{K}_{\ell + 1}^{r}$-saturated hypergraphs

Authors: Jianfeng Hou, Heng Li, Caihong Yang, Qinghou Zeng, Yixiao Zhang

Abstract: An $\mathcal{F}$-saturated $r$-graph is a maximal $r$-graph not containing any member of $\mathcal{F}$ as a subgraph. Let $\mathcal{K}_{\ell + 1}^{r}$ be the collection of all $r$-graphs $F$ with at most $\binom{\ell+1}{2}$ edges such that for some $\left(\ell+1\right)$-set $S$ every pair $\{u, v\} \subset S$ is covered by an edge in $F$. Our first result shows that for each $\ell \geq r \geq 2$ e… ▽ More An $\mathcal{F}$-saturated $r$-graph is a maximal $r$-graph not containing any member of $\mathcal{F}$ as a subgraph. Let $\mathcal{K}_{\ell + 1}^{r}$ be the collection of all $r$-graphs $F$ with at most $\binom{\ell+1}{2}$ edges such that for some $\left(\ell+1\right)$-set $S$ every pair $\{u, v\} \subset S$ is covered by an edge in $F$. Our first result shows that for each $\ell \geq r \geq 2$ every $\mathcal{K}_{\ell+1}^{r}$-saturated $r$-graph on $n$ vertices with $t_{r}(n, \ell) - o(n^{r-1+1/\ell})$ edges contains a complete $\ell$-partite subgraph on $(1-o(1))n$ vertices, which extends a stability theorem for $K_{\ell+1}$-saturated graphs given by Popielarz, Sahasrabudhe and Snyder. We also show that the bound is best possible. Our second result is motivated by a celebrated theorem of Andrásfai, Erdős and Sós which states that for $\ell \geq 2$ every $K_{\ell+1}$-free graph $G$ on $n$ vertices with minimum degree $δ(G) > \frac{3\ell-4}{3\ell-1}n$ is $\ell$-partite. We give a hypergraph version of it. The \emph{minimum positive co-degree} of an $r$-graph $\mathcal{H}$, denoted by $δ_{r-1}^{+}(\mathcal{H})$, is the maximum $k$ such that if $S$ is an $(r-1)$-set contained in a edge of $\mathcal{H}$, then $S$ is contained in at least $k$ distinct edges of $\mathcal{H}$. Let $\ell\ge 3$ be an integer and $\mathcal{H}$ be a $\mathcal{K}_{\ell+1}^3$-saturated $3$-graph on $n$ vertices. We prove that if either $\ell \ge 4$ and $δ_{2}^{+}(\mathcal{H}) > \frac{3\ell-7}{3\ell-1}n$; or $\ell = 3$ and $δ_{2}^{+}(\mathcal{H}) > 2n/7$, then $\mathcal{H}$ is $\ell$-partite; and the bound is best possible. This is the first stability result on minimum positive co-degree for hypergraphs. △ Less

Submitted 5 November, 2022; originally announced November 2022.