Showing 51–100 of 336 results for author: Shi, T

Magnon Damping Minimum and Logarithmic Scaling in a Kondo-Heisenberg Model

Authors: Yuan Gao, Junsen Wang, Qiaoyi Li, Qing-Bo Yan, Tao Shi, Wei Li

Abstract: Recently, an anomalous temperature evolution of spin wave excitations has been observed in a van der Waals metallic ferromagnet Fe$_3$GeTe$_2$ (FGT) [S. Bao, et al., Phys. Rev. X 12, 011022 (2022)], whose theoretical understanding yet remains elusive. Here we study the spin dynamics of a ferromagnetic Kondo-Heisenberg lattice model at finite temperature, and propose a mechanism of magnon damping t… ▽ More Recently, an anomalous temperature evolution of spin wave excitations has been observed in a van der Waals metallic ferromagnet Fe$_3$GeTe$_2$ (FGT) [S. Bao, et al., Phys. Rev. X 12, 011022 (2022)], whose theoretical understanding yet remains elusive. Here we study the spin dynamics of a ferromagnetic Kondo-Heisenberg lattice model at finite temperature, and propose a mechanism of magnon damping that explains the intriguing experimental results. In particular, we find the magnon damping rate $γ(T)$ firstly decreases as temperature lowers, due to the reduced magnon-magnon scatterings. It then reaches a minimum at $T_{\rm d}^*$, and rises up again following a logarithmic scaling $γ(T) \sim \ln{(T_0/T)}$ (with $T_0$ a constant) for $T < T_{\rm d}^*$, which can be attributed to electron-magnon scatterings of spin-flip type. Moreover, we obtain the phase diagram containing the ferromagnetic and Kondo insulator phases by varying the Kondo coupling, which may be relevant for experiments on pressured FGT. The presence of a magnon damping minimum and logarithmic scaling at low temperature indicates the emergence of the Kondo effect reflected in the collective excitations of local moments in a Kondo lattice system. △ Less

Submitted 1 January, 2024; originally announced January 2024.

Beyond Efficiency: A Systematic Survey of Resource-Efficient Large Language Models

Authors: Guangji Bai, Zheng Chai, Chen Ling, Shiyu Wang, Jiaying Lu, Nan Zhang, Tingwei Shi, Ziyang Yu, Mengdan Zhu, Yifei Zhang, Carl Yang, Yue Cheng, Liang Zhao

Abstract: The burgeoning field of Large Language Models (LLMs), exemplified by sophisticated models like OpenAI's ChatGPT, represents a significant advancement in artificial intelligence. These models, however, bring forth substantial challenges in the high consumption of computational, memory, energy, and financial resources, especially in environments with limited resource capabilities. This survey aims t… ▽ More The burgeoning field of Large Language Models (LLMs), exemplified by sophisticated models like OpenAI's ChatGPT, represents a significant advancement in artificial intelligence. These models, however, bring forth substantial challenges in the high consumption of computational, memory, energy, and financial resources, especially in environments with limited resource capabilities. This survey aims to systematically address these challenges by reviewing a broad spectrum of techniques designed to enhance the resource efficiency of LLMs. We categorize methods based on their optimization focus: computational, memory, energy, financial, and network resources and their applicability across various stages of an LLM's lifecycle, including architecture design, pretraining, finetuning, and system design. Additionally, the survey introduces a nuanced categorization of resource efficiency techniques by their specific resource types, which uncovers the intricate relationships and mappings between various resources and corresponding optimization techniques. A standardized set of evaluation metrics and datasets is also presented to facilitate consistent and fair comparisons across different models and techniques. By offering a comprehensive overview of the current sota and identifying open research avenues, this survey serves as a foundational reference for researchers and practitioners, aiding them in developing more sustainable and efficient LLMs in a rapidly evolving landscape. △ Less

Submitted 3 January, 2024; v1 submitted 31 December, 2023; originally announced January 2024.

Comments: Preprint. GitHub repo: https://github.com/tiingweii-shii/Awesome-Resource-Efficient-LLM-Papers

Preliminary Study on Incremental Learning for Large Language Model-based Recommender Systems

Authors: Tianhao Shi, Yang Zhang, Zhijian Xu, Chong Chen, Fuli Feng, Xiangnan He, Qi Tian

Abstract: Adapting Large Language Models for Recommendation (LLM4Rec) has shown promising results. However, the challenges of deploying LLM4Rec in real-world scenarios remain largely unexplored. In particular, recommender models need incremental adaptation to evolving user preferences, while the suitability of traditional incremental learning methods within LLM4Rec remains ambiguous due to the unique charac… ▽ More Adapting Large Language Models for Recommendation (LLM4Rec) has shown promising results. However, the challenges of deploying LLM4Rec in real-world scenarios remain largely unexplored. In particular, recommender models need incremental adaptation to evolving user preferences, while the suitability of traditional incremental learning methods within LLM4Rec remains ambiguous due to the unique characteristics of Large Language Models (LLMs). In this study, we empirically evaluate two commonly employed incremental learning strategies (full retraining and fine-tuning) for LLM4Rec. Surprisingly, neither approach shows significant improvements in the performance of LLM4Rec. Instead of dismissing the role of incremental learning, we attribute the lack of anticipated performance enhancement to a mismatch between the LLM4Rec architecture and incremental learning: LLM4Rec employs a single adaptation module for learning recommendations, limiting its ability to simultaneously capture long-term and short-term user preferences in the incremental learning context. To test this speculation, we introduce a Long- and Short-term Adaptation-aware Tuning (LSAT) framework for incremental learning in LLM4Rec. Unlike the single adaptation module approach, LSAT utilizes two distinct adaptation modules to independently learn long-term and short-term user preferences. Empirical results verify that LSAT enhances performance, thereby validating our speculation. We release our code at: https://github.com/TianhaoShi2001/LSAT. △ Less

Submitted 30 July, 2024; v1 submitted 24 December, 2023; originally announced December 2023.

Comments: accepted in the short paper track of the 2024 ACM International Conference on Information and Knowledge Management (CIKM 2024)

A Fully Data-Driven Approach for Realistic Traffic Signal Control Using Offline Reinforcement Learning

Authors: Jianxiong Li, Shichao Lin, Tianyu Shi, Chujie Tian, Yu Mei, Jian Song, Xianyuan Zhan, Ruimin Li

Abstract: The optimization of traffic signal control (TSC) is critical for an efficient transportation system. In recent years, reinforcement learning (RL) techniques have emerged as a popular approach for TSC and show promising results for highly adaptive control. However, existing RL-based methods suffer from notably poor real-world applicability and hardly have any successful deployments. The reasons for… ▽ More The optimization of traffic signal control (TSC) is critical for an efficient transportation system. In recent years, reinforcement learning (RL) techniques have emerged as a popular approach for TSC and show promising results for highly adaptive control. However, existing RL-based methods suffer from notably poor real-world applicability and hardly have any successful deployments. The reasons for such failures are mostly due to the reliance on over-idealized traffic simulators for policy optimization, as well as using unrealistic fine-grained state observations and reward signals that are not directly obtainable from real-world sensors. In this paper, we propose a fully Data-Driven and simulator-free framework for realistic Traffic Signal Control (D2TSC). Specifically, we combine well-established traffic flow theory with machine learning to construct a reward inference model to infer the reward signals from coarse-grained traffic data. With the inferred rewards, we further propose a sample-efficient offline RL method to enable direct signal control policy learning from historical offline datasets of real-world intersections. To evaluate our approach, we collect historical traffic data from a real-world intersection, and develop a highly customized simulation environment that strictly follows real data characteristics. We demonstrate through extensive experiments that our approach achieves superior performance over conventional and offline RL baselines, and also enjoys much better real-world applicability. △ Less

Submitted 27 November, 2023; originally announced November 2023.

Comments: 15 pages, 6 figures

Dimensionality reduction of networked systems with separable coupling-dynamics: theory and applications

Authors: Chengyi Tu, Ying Fan, Tianyu Shi

Abstract: Complex dynamical systems are prevalent in various domains, but their analysis and prediction are hindered by their high dimensionality and nonlinearity. Dimensionality reduction techniques can simplify the system dynamics by reducing the number of variables, but most existing methods do not account for networked systems with separable coupling-dynamics, where the interaction between nodes can be… ▽ More Complex dynamical systems are prevalent in various domains, but their analysis and prediction are hindered by their high dimensionality and nonlinearity. Dimensionality reduction techniques can simplify the system dynamics by reducing the number of variables, but most existing methods do not account for networked systems with separable coupling-dynamics, where the interaction between nodes can be decomposed into a function of the node state and a function of the neighbor state. Here, we present a novel dimensionality reduction framework that can effectively capture the global dynamics of these networks by projecting them onto a low-dimensional system. We derive the reduced system's equation and stability conditions, and propose an error metric to quantify the reduction accuracy. We demonstrate our framework on two examples of networked systems with separable coupling-dynamics: a modified susceptible-infected-susceptible model with direct infection and a modified Michaelis-Menten model with activation and inhibition. We conduct numerical experiments on synthetic and empirical networks to validate and evaluate our framework, and find a good agreement between the original and reduced systems. We also investigate the effects of different network structures and parameters on the system dynamics and the reduction error. Our framework offers a general and powerful tool for studying complex dynamical networks with separable coupling-dynamics. △ Less

Submitted 27 November, 2023; originally announced November 2023.

Comments: 15 pages, 5 figures

Can Language Model Moderators Improve the Health of Online Discourse?

Authors: Hyundong Cho, Shuai Liu, Taiwei Shi, Darpan Jain, Basem Rizk, Yuyang Huang, Zixun Lu, Nuan Wen, Jonathan Gratch, Emilio Ferrara, Jonathan May

Abstract: Conversational moderation of online communities is crucial to maintaining civility for a constructive environment, but it is challenging to scale and harmful to moderators. The inclusion of sophisticated natural language generation modules as a force multiplier to aid human moderators is a tantalizing prospect, but adequate evaluation approaches have so far been elusive. In this paper, we establis… ▽ More Conversational moderation of online communities is crucial to maintaining civility for a constructive environment, but it is challenging to scale and harmful to moderators. The inclusion of sophisticated natural language generation modules as a force multiplier to aid human moderators is a tantalizing prospect, but adequate evaluation approaches have so far been elusive. In this paper, we establish a systematic definition of conversational moderation effectiveness grounded on moderation literature and establish design criteria for conducting realistic yet safe evaluation. We then propose a comprehensive evaluation framework to assess models' moderation capabilities independently of human intervention. With our framework, we conduct the first known study of language models as conversational moderators, finding that appropriately prompted models that incorporate insights from social science can provide specific and fair feedback on toxic behavior but struggle to influence users to increase their levels of respect and cooperation. △ Less

Submitted 6 May, 2024; v1 submitted 16 November, 2023; originally announced November 2023.

Comments: 9 pages, NAACL 2024 Main

Online Continual Knowledge Learning for Language Models

Authors: Yuhao Wu, Tongjun Shi, Karthick Sharma, Chun Wei Seah, Shuhao Zhang

Abstract: Large Language Models (LLMs) serve as repositories of extensive world knowledge, enabling them to perform tasks such as question-answering and fact-checking. However, this knowledge can become obsolete as global contexts change. In this paper, we introduce a novel problem in the realm of continual learning: Online Continual Knowledge Learning (OCKL). This problem formulation aims to manage the dyn… ▽ More Large Language Models (LLMs) serve as repositories of extensive world knowledge, enabling them to perform tasks such as question-answering and fact-checking. However, this knowledge can become obsolete as global contexts change. In this paper, we introduce a novel problem in the realm of continual learning: Online Continual Knowledge Learning (OCKL). This problem formulation aims to manage the dynamic nature of world knowledge in LMs under real-time constraints. We propose a new benchmark and evaluation metric designed to measure both the rate of new knowledge acquisition and the retention of previously learned knowledge. Our empirical evaluation, conducted using a variety of state-of-the-art methods, establishes robust base-lines for OCKL. Our results reveal that existing continual learning approaches are unfortunately insufficient for tackling the unique challenges posed by OCKL. We identify key factors that influence the trade-off between knowledge acquisition and retention, thereby advancing our understanding of how to train LMs in a continually evolving environment. △ Less

Submitted 16 November, 2023; originally announced November 2023.

Safer-Instruct: Aligning Language Models with Automated Preference Data

Authors: Taiwei Shi, Kai Chen, Jieyu Zhao

Abstract: Reinforcement learning from human feedback (RLHF) is a vital strategy for enhancing model capability in language models. However, annotating preference data for RLHF is a resource-intensive and creativity-demanding process, while existing automatic generation methods face limitations in data diversity and quality. In response, we present Safer-Instruct, a novel pipeline for automatically construct… ▽ More Reinforcement learning from human feedback (RLHF) is a vital strategy for enhancing model capability in language models. However, annotating preference data for RLHF is a resource-intensive and creativity-demanding process, while existing automatic generation methods face limitations in data diversity and quality. In response, we present Safer-Instruct, a novel pipeline for automatically constructing large-scale preference data. Our approach leverages reversed instruction tuning, instruction induction, and expert model evaluation to efficiently generate high-quality preference data without human annotators. To verify the effectiveness of Safer-Instruct, we apply the pipeline to construct a safety preference dataset as a case study. Finetuning an Alpaca model on this synthetic dataset not only demonstrates improved harmlessness but also outperforms models fine-tuned on human-annotated safety preference data, all the while maintaining a competitive edge in downstream tasks. Importantly, our Safer-Instruct framework is versatile and can be applied to generate preference data across various domains, extending its utility beyond safety preferences. It addresses the challenges in preference data acquisition and advances the development of more capable and responsible AI systems. For dataset and code implementation, see https://github.com/uscnlp-lime/safer-instruct △ Less

Submitted 31 March, 2024; v1 submitted 14 November, 2023; originally announced November 2023.

Comments: 16 pages. NAACL 2024 Camera-ready

A Physics-informed Machine Learning-based Control Method for Nonlinear Dynamic Systems with Highly Noisy Measurements

Authors: Mason Ma, Jiajie Wu, Chase Post, Tony Shi, Jingang Yi, Tony Schmitz, Hong Wang

Abstract: This study presents a physics-informed machine learning-based control method for nonlinear dynamic systems with highly noisy measurements. Existing data-driven control methods that use machine learning for system identification cannot effectively cope with highly noisy measurements, resulting in unstable control performance. To address this challenge, the present study extends current physics-info… ▽ More This study presents a physics-informed machine learning-based control method for nonlinear dynamic systems with highly noisy measurements. Existing data-driven control methods that use machine learning for system identification cannot effectively cope with highly noisy measurements, resulting in unstable control performance. To address this challenge, the present study extends current physics-informed machine learning capabilities for modeling nonlinear dynamics with control and integrates them into a model predictive control framework. To demonstrate the capability of the proposed method we test and validate with two noisy nonlinear dynamic systems: the chaotic Lorenz 3 system, and turning machine tool. Analysis of the results illustrate that the proposed method outperforms state-of-the-art benchmarks as measured by both modeling accuracy and control performance for nonlinear dynamic systems under high-noise conditions. △ Less

Submitted 11 November, 2023; originally announced November 2023.

Can AI Mitigate Human Perceptual Biases? A Pilot Study

Authors: Ross Geuy, Nate Rising, Tiancheng Shi, Meng Ling, Jian Chen

Abstract: We present results from a pilot experiment to measure if machine recommendations can debias human perceptual biases in visualization tasks. We specifically studied the ``pull-down'' effect, i.e., people underestimate the average position of lines, for the task of estimating the ensemble average of data points in line charts. These line charts can show for example temperature or precipitation in 12… ▽ More We present results from a pilot experiment to measure if machine recommendations can debias human perceptual biases in visualization tasks. We specifically studied the ``pull-down'' effect, i.e., people underestimate the average position of lines, for the task of estimating the ensemble average of data points in line charts. These line charts can show for example temperature or precipitation in 12 months. Six participants estimated ensemble averages with or without an AI assistant. The assistant, when available, responded at three different speeds to assemble the conditions of a human collaborator who may delay his or her responses. Our pilot study showed that participants were faster with AI assistance in ensemble tasks, compared to the baseline without AI assistance. Although ``pull-down'' biases were reduced, the effect of AI assistance was not statistically significant. Also, delaying AI responses had no significant impact on human decision accuracy. We discuss the implications of these preliminary results for subsequent studies. △ Less

Submitted 10 October, 2023; originally announced November 2023.

Comments: This paper was accepted IEEE VIS 2023 VISxVISION Workshop

Inverse identification framework for cohesive zone model incorporating failure mode based on multi-island genetic algorithm

Authors: Tianxiang Shi, Miao Pang, Yangyang Wang, Yongqiang Zhang

Abstract: Composite interfaces are commonly simulated by cohesive zone models with the key challenge being the calibration of interfacial parameters. A new framework is presented in this paper to derive the characteristic of any cohesive zone model. This approach employs the multi-island genetic algorithm to obtain the interface parameters aligning closely with the experimental observations. The introduced… ▽ More Composite interfaces are commonly simulated by cohesive zone models with the key challenge being the calibration of interfacial parameters. A new framework is presented in this paper to derive the characteristic of any cohesive zone model. This approach employs the multi-island genetic algorithm to obtain the interface parameters aligning closely with the experimental observations. The introduced framework innovatively formulates an objective function, considering both the congruence of the load-displacement curve and the alignment with the failure mode of model. The framework combines machine learning and multi-objective optimization. A method using the interface debonding length to quantify the failure mode of the model is proposed. To demonstrate the feasibility of the proposed framework, the newly strength-based cohesive zone model is taken as an example, and key parameters and damage evolution are identified accurately. The inverse algorithm is used to identify the interface parameters of both the double cantilever beam experiment and the four-point bending test. The robustness and accuracy of the framework are validated through the double cantilever beam test. The findings indicate that the numerical results align closely with the experimental data, confirming that the interface parameters identified by the proposed framework can reproduce the performance of the adhesive joints. △ Less

Submitted 1 November, 2023; originally announced November 2023.

PsyCoT: Psychological Questionnaire as Powerful Chain-of-Thought for Personality Detection

Authors: Tao Yang, Tianyuan Shi, Fanqi Wan, Xiaojun Quan, Qifan Wang, Bingzhe Wu, Jiaxiang Wu

Abstract: Recent advances in large language models (LLMs), such as ChatGPT, have showcased remarkable zero-shot performance across various NLP tasks. However, the potential of LLMs in personality detection, which involves identifying an individual's personality from their written texts, remains largely unexplored. Drawing inspiration from Psychological Questionnaires, which are carefully designed by psychol… ▽ More Recent advances in large language models (LLMs), such as ChatGPT, have showcased remarkable zero-shot performance across various NLP tasks. However, the potential of LLMs in personality detection, which involves identifying an individual's personality from their written texts, remains largely unexplored. Drawing inspiration from Psychological Questionnaires, which are carefully designed by psychologists to evaluate individual personality traits through a series of targeted items, we argue that these items can be regarded as a collection of well-structured chain-of-thought (CoT) processes. By incorporating these processes, LLMs can enhance their capabilities to make more reasonable inferences on personality from textual input. In light of this, we propose a novel personality detection method, called PsyCoT, which mimics the way individuals complete psychological questionnaires in a multi-turn dialogue manner. In particular, we employ a LLM as an AI assistant with a specialization in text analysis. We prompt the assistant to rate individual items at each turn and leverage the historical rating results to derive a conclusive personality preference. Our experiments demonstrate that PsyCoT significantly improves the performance and robustness of GPT-3.5 in personality detection, achieving an average F1 score improvement of 4.23/10.63 points on two benchmark datasets compared to the standard prompting method. Our code is available at https://github.com/TaoYang225/PsyCoT. △ Less

Submitted 4 November, 2023; v1 submitted 31 October, 2023; originally announced October 2023.

Comments: Accepted to Findings of EMNLP 2023

Exploring Iterative Refinement with Diffusion Models for Video Grounding

Authors: Xiao Liang, Tao Shi, Yaoyuan Liang, Te Tao, Shao-Lun Huang

Abstract: Video grounding aims to localize the target moment in an untrimmed video corresponding to a given sentence query. Existing methods typically select the best prediction from a set of predefined proposals or directly regress the target span in a single-shot manner, resulting in the absence of a systematical prediction refinement process. In this paper, we propose DiffusionVG, a novel framework with… ▽ More Video grounding aims to localize the target moment in an untrimmed video corresponding to a given sentence query. Existing methods typically select the best prediction from a set of predefined proposals or directly regress the target span in a single-shot manner, resulting in the absence of a systematical prediction refinement process. In this paper, we propose DiffusionVG, a novel framework with diffusion models that formulates video grounding as a conditional generation task, where the target span is generated from Gaussian noise inputs and interatively refined in the reverse diffusion process. During training, DiffusionVG progressively adds noise to the target span with a fixed forward diffusion process and learns to recover the target span in the reverse diffusion process. In inference, DiffusionVG can generate the target span from Gaussian noise inputs by the learned reverse diffusion process conditioned on the video-sentence representations. Without bells and whistles, our DiffusionVG demonstrates superior performance compared to existing well-crafted models on mainstream Charades-STA, ActivityNet Captions and TACoS benchmarks. △ Less

Submitted 29 December, 2023; v1 submitted 26 October, 2023; originally announced October 2023.

SSLCL: An Efficient Model-Agnostic Supervised Contrastive Learning Framework for Emotion Recognition in Conversations

Authors: Tao Shi, Xiao Liang, Yaoyuan Liang, Xinyi Tong, Shao-Lun Huang

Abstract: Emotion recognition in conversations (ERC) is a rapidly evolving task within the natural language processing community, which aims to detect the emotions expressed by speakers during a conversation. Recently, a growing number of ERC methods have focused on leveraging supervised contrastive learning (SCL) to enhance the robustness and generalizability of learned features. However, current SCL-based… ▽ More Emotion recognition in conversations (ERC) is a rapidly evolving task within the natural language processing community, which aims to detect the emotions expressed by speakers during a conversation. Recently, a growing number of ERC methods have focused on leveraging supervised contrastive learning (SCL) to enhance the robustness and generalizability of learned features. However, current SCL-based approaches in ERC are impeded by the constraint of large batch sizes and the lack of compatibility with most existing ERC models. To address these challenges, we propose an efficient and model-agnostic SCL framework named Supervised Sample-Label Contrastive Learning with Soft-HGR Maximal Correlation (SSLCL), which eliminates the need for a large batch size and can be seamlessly integrated with existing ERC models without introducing any model-specific assumptions. Specifically, we introduce a novel perspective on utilizing label representations by projecting discrete labels into dense embeddings through a shallow multilayer perceptron, and formulate the training objective to maximize the similarity between sample features and their corresponding ground-truth label embeddings, while minimizing the similarity between sample features and label embeddings of disparate classes. Moreover, we innovatively adopt the Soft-HGR maximal correlation as a measure of similarity between sample features and label embeddings, leading to significant performance improvements over conventional similarity measures. Additionally, multimodal cues of utterances are effectively leveraged by SSLCL as data augmentations to boost model performances. Extensive experiments on two ERC benchmark datasets, IEMOCAP and MELD, demonstrate the compatibility and superiority of our proposed SSLCL framework compared to existing state-of-the-art SCL methods. Our code is available at \url{https://github.com/TaoShi1998/SSLCL}. △ Less

Submitted 10 December, 2023; v1 submitted 25 October, 2023; originally announced October 2023.

Bayesian Domain Invariant Learning via Posterior Generalization of Parameter Distributions

Authors: Shiyu Shen, Bin Pan, Tianyang Shi, Tao Li, Zhenwei Shi

Abstract: Domain invariant learning aims to learn models that extract invariant features over various training domains, resulting in better generalization to unseen target domains. Recently, Bayesian Neural Networks have achieved promising results in domain invariant learning, but most works concentrate on aligning features distributions rather than parameter distributions. Inspired by the principle of Baye… ▽ More Domain invariant learning aims to learn models that extract invariant features over various training domains, resulting in better generalization to unseen target domains. Recently, Bayesian Neural Networks have achieved promising results in domain invariant learning, but most works concentrate on aligning features distributions rather than parameter distributions. Inspired by the principle of Bayesian Neural Network, we attempt to directly learn the domain invariant posterior distribution of network parameters. We first propose a theorem to show that the invariant posterior of parameters can be implicitly inferred by aggregating posteriors on different training domains. Our assumption is more relaxed and allows us to extract more domain invariant information. We also propose a simple yet effective method, named PosTerior Generalization (PTG), that can be used to estimate the invariant parameter distribution. PTG fully exploits variational inference to approximate parameter distributions, including the invariant posterior and the posteriors on training domains. Furthermore, we develop a lite version of PTG for widespread applications. PTG shows competitive performance on various domain generalization benchmarks on DomainBed. Additionally, PTG can use any existing domain generalization methods as its prior, and combined with previous state-of-the-art method the performance can be further improved. Code will be made public. △ Less

Submitted 24 October, 2023; originally announced October 2023.

CoAnnotating: Uncertainty-Guided Work Allocation between Human and Large Language Models for Data Annotation

Authors: Minzhi Li, Taiwei Shi, Caleb Ziems, Min-Yen Kan, Nancy F. Chen, Zhengyuan Liu, Diyi Yang

Abstract: Annotated data plays a critical role in Natural Language Processing (NLP) in training models and evaluating their performance. Given recent developments in Large Language Models (LLMs), models such as ChatGPT demonstrate zero-shot capability on many text-annotation tasks, comparable with or even exceeding human annotators. Such LLMs can serve as alternatives for manual annotation, due to lower cos… ▽ More Annotated data plays a critical role in Natural Language Processing (NLP) in training models and evaluating their performance. Given recent developments in Large Language Models (LLMs), models such as ChatGPT demonstrate zero-shot capability on many text-annotation tasks, comparable with or even exceeding human annotators. Such LLMs can serve as alternatives for manual annotation, due to lower costs and higher scalability. However, limited work has leveraged LLMs as complementary annotators, nor explored how annotation work is best allocated among humans and LLMs to achieve both quality and cost objectives. We propose CoAnnotating, a novel paradigm for Human-LLM co-annotation of unstructured texts at scale. Under this framework, we utilize uncertainty to estimate LLMs' annotation capability. Our empirical study shows CoAnnotating to be an effective means to allocate work from results on different datasets, with up to 21% performance improvement over random baseline. For code implementation, see https://github.com/SALT-NLP/CoAnnotating. △ Less

Submitted 24 October, 2023; originally announced October 2023.

Dual-Feedback Knowledge Retrieval for Task-Oriented Dialogue Systems

Authors: Tianyuan Shi, Liangzhi Li, Zijian Lin, Tao Yang, Xiaojun Quan, Qifan Wang

Abstract: Efficient knowledge retrieval plays a pivotal role in ensuring the success of end-to-end task-oriented dialogue systems by facilitating the selection of relevant information necessary to fulfill user requests. However, current approaches generally integrate knowledge retrieval and response generation, which poses scalability challenges when dealing with extensive knowledge bases. Taking inspiratio… ▽ More Efficient knowledge retrieval plays a pivotal role in ensuring the success of end-to-end task-oriented dialogue systems by facilitating the selection of relevant information necessary to fulfill user requests. However, current approaches generally integrate knowledge retrieval and response generation, which poses scalability challenges when dealing with extensive knowledge bases. Taking inspiration from open-domain question answering, we propose a retriever-generator architecture that harnesses a retriever to retrieve pertinent knowledge and a generator to generate system responses.~Due to the lack of retriever training labels, we propose relying on feedback from the generator as pseudo-labels to train the retriever. To achieve this, we introduce a dual-feedback mechanism that generates both positive and negative feedback based on the output of the generator. Our method demonstrates superior performance in task-oriented dialogue tasks, as evidenced by experimental results on three benchmark datasets. △ Less

Submitted 22 October, 2023; originally announced October 2023.

Comments: Accepted to EMNLP 2023 (Main Conference)

An extremely bad-cavity laser

Authors: Jia Zhang, Tiantian Shi, Jianxiang Miao, Deshui Yu, Jingbiao Chen

Abstract: Lasing in the bad-cavity regime has promising applications in precision measurement and frequency metrology due to the reduced sensitivity of the laser frequency to cavity length fluctuations. Thus far, relevant studies have been mainly focused on conventional cavities whose finesse is high enough that the resonance linewidth is sufficiently narrow compared to the cavity's free spectral range, tho… ▽ More Lasing in the bad-cavity regime has promising applications in precision measurement and frequency metrology due to the reduced sensitivity of the laser frequency to cavity length fluctuations. Thus far, relevant studies have been mainly focused on conventional cavities whose finesse is high enough that the resonance linewidth is sufficiently narrow compared to the cavity's free spectral range, though still in the bad-cavity regime. However, lasing output from the cavity whose finesse is close to the limit of 2 has never been experimentally accessed. Here, we demonstrate an extremely bad-cavity laser, analyze the physical mechanisms limiting cavity finesse, and report on the worst ever laser cavity with finesse reaching 2.01. The optical cavity has a reflectance close to zero and only provides a weak optical feedback. The laser power can be as high as tens of $μ$W and the spectral linewidth reaches a few kHz, over one thousand times narrower than the gain bandwidth. In addition, the measurement of cavity pulling reveals a pulling coefficient of 0.0148, the lowest value ever achieved for a continuous wave laser. Our findings open up an unprecedentedly innovative perspective for future new ultra-stable lasers, which could possibly trigger the future discoveries in optical clocks, cavity QED, continuous wave superradiant laser, and explorations of quantum manybody physics. △ Less

Submitted 22 October, 2023; originally announced October 2023.

Be Bayesian by Attachments to Catch More Uncertainty

Authors: Shiyu Shen, Bin Pan, Tianyang Shi, Tao Li, Zhenwei Shi

Abstract: Bayesian Neural Networks (BNNs) have become one of the promising approaches for uncertainty estimation due to the solid theorical foundations. However, the performance of BNNs is affected by the ability of catching uncertainty. Instead of only seeking the distribution of neural network weights by in-distribution (ID) data, in this paper, we propose a new Bayesian Neural Network with an Attached st… ▽ More Bayesian Neural Networks (BNNs) have become one of the promising approaches for uncertainty estimation due to the solid theorical foundations. However, the performance of BNNs is affected by the ability of catching uncertainty. Instead of only seeking the distribution of neural network weights by in-distribution (ID) data, in this paper, we propose a new Bayesian Neural Network with an Attached structure (ABNN) to catch more uncertainty from out-of-distribution (OOD) data. We first construct a mathematical description for the uncertainty of OOD data according to the prior distribution, and then develop an attached Bayesian structure to integrate the uncertainty of OOD data into the backbone network. ABNN is composed of an expectation module and several distribution modules. The expectation module is a backbone deep network which focuses on the original task, and the distribution modules are mini Bayesian structures which serve as attachments of the backbone. In particular, the distribution modules aim at extracting the uncertainty from both ID and OOD data. We further provide theoretical analysis for the convergence of ABNN, and experimentally validate its superiority by comparing with some state-of-the-art uncertainty estimation methods Code will be made available. △ Less

Submitted 12 April, 2024; v1 submitted 19 October, 2023; originally announced October 2023.

Viscosity solutions to a Cauchy type problem for timelike Lorentzian eikonal equation

Authors: Siyao Zhu, Xiaojun Cui, Tianqi Shi

Abstract: In this paper, we propose a Cauchy type problem to the timelike Lorentzian eikonal equation on a globally hyperbolic space-time. For this equation, as the value of the solution on a Cauchy surface is known, we prove the existence of viscosity solutions on the past set (future set) of the Cauchy surface. Furthermore, when the time orientation of viscosity solution is consistent, the uniqueness and… ▽ More In this paper, we propose a Cauchy type problem to the timelike Lorentzian eikonal equation on a globally hyperbolic space-time. For this equation, as the value of the solution on a Cauchy surface is known, we prove the existence of viscosity solutions on the past set (future set) of the Cauchy surface. Furthermore, when the time orientation of viscosity solution is consistent, the uniqueness and stability of viscosity solutions are also obtained. △ Less

Submitted 12 October, 2023; originally announced October 2023.

Comments: arXiv admin note: text overlap with arXiv:2309.15006

A corner-cube-feedback Faraday laser with 8 kHz linewidth

Authors: Zhiyang Wang, Zijie Liu, Jianxiang Miao, Hangbo Shi, Xiaomin Qin, Xiaolei Guan, Jia Zhang, Pengyuan Chang, Tiantian Shi, Jingbiao Chen

Abstract: A single-mode Cs atom 852 nm Faraday laser based on the corner cube feedback is demonstrated, and termed as corner-cube-feedback Faraday laser. Using the corner-cube retroreflector as external cavity feedback element in Faraday laser, mechanical robustness can be greatly improved due to the precise reflection of the incident light beam back to its original direction. This Faraday laser can achieve… ▽ More A single-mode Cs atom 852 nm Faraday laser based on the corner cube feedback is demonstrated, and termed as corner-cube-feedback Faraday laser. Using the corner-cube retroreflector as external cavity feedback element in Faraday laser, mechanical robustness can be greatly improved due to the precise reflection of the incident light beam back to its original direction. This Faraday laser can achieve laser oscillation at a large angle, which between the incident light and the optical axis of corner cube, ranging from +3° to -3°. The most probable linewidth is 8 kHz measured by heterodyne beating with two identical lasers. Moreover, its output frequency remains close to the Cs atomic Doppler-broadened transition line, even though the diode current changes from 55 mA to 155 mA and the diode working temperature varies from 11.8 to 37.2 degrees Celsius. The corner-cube-feedback Faraday laser with high mechanical robustness as well as narrow linewidth can be widely used in quantum precision measurement, such as atomic clocks, atomic gravimeters, and atomic magnetometers, etc. △ Less

Submitted 6 July, 2024; v1 submitted 28 August, 2023; originally announced September 2023.

Identifying Reaction-Aware Driving Styles of Stochastic Model Predictive Controlled Vehicles by Inverse Reinforcement Learning

Authors: Ni Dang, Tao Shi, Zengjie Zhang, Wanxin Jin, Marion Leibold, Martin Buss

Abstract: The driving style of an Autonomous Vehicle (AV) refers to how it behaves and interacts with other AVs. In a multi-vehicle autonomous driving system, an AV capable of identifying the driving styles of its nearby AVs can reliably evaluate the risk of collisions and make more reasonable driving decisions. However, there has not been a consistent definition of driving styles for an AV in the literatur… ▽ More The driving style of an Autonomous Vehicle (AV) refers to how it behaves and interacts with other AVs. In a multi-vehicle autonomous driving system, an AV capable of identifying the driving styles of its nearby AVs can reliably evaluate the risk of collisions and make more reasonable driving decisions. However, there has not been a consistent definition of driving styles for an AV in the literature, although it is considered that the driving style is encoded in the AV's trajectories and can be identified using Maximum Entropy Inverse Reinforcement Learning (ME-IRL) methods as a cost function. Nevertheless, an important indicator of the driving style, i.e., how an AV reacts to its nearby AVs, is not fully incorporated in the feature design of previous ME-IRL methods. In this paper, we describe the driving style as a cost function of a series of weighted features. We design additional novel features to capture the AV's reaction-aware characteristics. Then, we identify the driving styles from the demonstration trajectories generated by the Stochastic Model Predictive Control (SMPC) using a modified ME-IRL method with our newly proposed features. The proposed method is validated using MATLAB simulation and an off-the-shelf experiment. △ Less

Submitted 23 August, 2023; originally announced August 2023.

Effects of $p$-wave Interactions on Borromean Efimov Trimers in Heavy-Light Fermi Systems

Authors: Cai-Yun Zhao, Hui-Li Han, Ting-Yun Shi

Abstract: We investigate the effects of $p$-wave interactions on Efimov trimers in systems comprising two identical heavy fermions and a light particle, with mass ratios larger than $13.6$. Our focus lies on the borromean regime where the ground-state trimer exists in the absence of dimers. Using pair-wise Lennard-Jones potentials and concentrating on the $L^π = 1^{-}$ symmetry, we explore the critical valu… ▽ More We investigate the effects of $p$-wave interactions on Efimov trimers in systems comprising two identical heavy fermions and a light particle, with mass ratios larger than $13.6$. Our focus lies on the borromean regime where the ground-state trimer exists in the absence of dimers. Using pair-wise Lennard-Jones potentials and concentrating on the $L^π = 1^{-}$ symmetry, we explore the critical value of the interspecies $s$-wave scattering length $a_{c}$ at which the borromean state appears in several two-component particle systems. We study the universal properties of $a_{c}$ and the influence of $p$-wave fermion-fermion interactions on its value. Our findings show that, in the absence of $p$-wave fermion-fermion interactions, $a_{c}$ is universally determined by the van der Waals radius and mass ratio. However, when attractive interactions between the two fermions are introduced, the formation of the borromean state becomes favored over the absence of $p$-wave fermion-fermion interaction. Furthermore, we demonstrate that the $p$-wave Efimov effects persist even when the fermion-fermion interaction is taken to the $p$-wave unitary limit. △ Less

Submitted 24 July, 2023; originally announced July 2023.

Light-Driven Nanoscale Vectorial Currents

Authors: Jacob Pettine, Prashant Padmanabhan, Teng Shi, Lauren Gingras, Luke McClintock, Chun-Chieh Chang, Kevin W. C. Kwock, Long Yuan, Yue Huang, John Nogan, Jon K. Baldwin, Peter Adel, Ronald Holzwarth, Abul K. Azad, Filip Ronning, Antoinette J. Taylor, Rohit P. Prasankumar, Shi-Zeng Lin, Hou-Tong Chen

Abstract: Controlled charge flows are fundamental to many areas of science and technology, serving as carriers of energy and information, as probes of material properties and dynamics, and as a means of revealing or even inducing broken symmetries. Emerging methods for light-based current control offer promising routes beyond the speed and adaptability limitations of conventional voltage-driven systems. How… ▽ More Controlled charge flows are fundamental to many areas of science and technology, serving as carriers of energy and information, as probes of material properties and dynamics, and as a means of revealing or even inducing broken symmetries. Emerging methods for light-based current control offer promising routes beyond the speed and adaptability limitations of conventional voltage-driven systems. However, optical generation and manipulation of currents at nanometer spatial scales remains a basic challenge and a crucial step towards scalable optoelectronic systems for microelectronics and information science. Here, we introduce vectorial optoelectronic metasurfaces in which ultrafast light pulses induce local directional charge flows around symmetry-broken plasmonic nanostructures, with tunable responses and arbitrary patterning down to sub-diffractive nanometer scales. Local symmetries and vectorial current distributions are revealed by polarization- and wavelength-sensitive electrical readout and terahertz (THz) emission, while spatially-tailored global currents are demonstrated in the direct generation of elusive broadband THz vector beams. We show that in graphene, a detailed interplay between electrodynamic, thermodynamic, and hydrodynamic degrees of freedom gives rise to rapidly-evolving nanoscale driving forces and charge flows under extreme temporal and spatial confinement. These results set the stage for versatile patterning and optical control over nanoscale currents in materials diagnostics, THz spectroscopies, nano-magnetism, and ultrafast information processing. △ Less

Submitted 21 October, 2023; v1 submitted 21 July, 2023; originally announced July 2023.

Journal ref: Nature 626, 984-989 (2024)

NTIRE 2023 Quality Assessment of Video Enhancement Challenge

Authors: Xiaohong Liu, Xiongkuo Min, Wei Sun, Yulun Zhang, Kai Zhang, Radu Timofte, Guangtao Zhai, Yixuan Gao, Yuqin Cao, Tengchuan Kou, Yunlong Dong, Ziheng Jia, Yilin Li, Wei Wu, Shuming Hu, Sibin Deng, Pengxiang Xiao, Ying Chen, Kai Li, Kai Zhao, Kun Yuan, Ming Sun, Heng Cong, Hao Wang, Lingzhi Fu , et al. (47 additional authors not shown)

Abstract: This paper reports on the NTIRE 2023 Quality Assessment of Video Enhancement Challenge, which will be held in conjunction with the New Trends in Image Restoration and Enhancement Workshop (NTIRE) at CVPR 2023. This challenge is to address a major challenge in the field of video processing, namely, video quality assessment (VQA) for enhanced videos. The challenge uses the VQA Dataset for Perceptual… ▽ More This paper reports on the NTIRE 2023 Quality Assessment of Video Enhancement Challenge, which will be held in conjunction with the New Trends in Image Restoration and Enhancement Workshop (NTIRE) at CVPR 2023. This challenge is to address a major challenge in the field of video processing, namely, video quality assessment (VQA) for enhanced videos. The challenge uses the VQA Dataset for Perceptual Video Enhancement (VDPVE), which has a total of 1211 enhanced videos, including 600 videos with color, brightness, and contrast enhancements, 310 videos with deblurring, and 301 deshaked videos. The challenge has a total of 167 registered participants. 61 participating teams submitted their prediction results during the development phase, with a total of 3168 submissions. A total of 176 submissions were submitted by 37 participating teams during the final testing phase. Finally, 19 participating teams submitted their models and fact sheets, and detailed the methods they used. Some methods have achieved better results than baseline methods, and the winning methods have demonstrated superior prediction performance. △ Less

Submitted 18 July, 2023; originally announced July 2023.

Alioth: A Machine Learning Based Interference-Aware Performance Monitor for Multi-Tenancy Applications in Public Cloud

Authors: Tianyao Shi, Yingxuan Yang, Yunlong Cheng, Xiaofeng Gao, Zhen Fang, Yongqiang Yang

Abstract: Multi-tenancy in public clouds may lead to co-location interference on shared resources, which possibly results in performance degradation of cloud applications. Cloud providers want to know when such events happen and how serious the degradation is, to perform interference-aware migrations and alleviate the problem. However, virtual machines (VM) in Infrastructure-as-a-Service public clouds are b… ▽ More Multi-tenancy in public clouds may lead to co-location interference on shared resources, which possibly results in performance degradation of cloud applications. Cloud providers want to know when such events happen and how serious the degradation is, to perform interference-aware migrations and alleviate the problem. However, virtual machines (VM) in Infrastructure-as-a-Service public clouds are black-boxes to providers, where application-level performance information cannot be acquired. This makes performance monitoring intensely challenging as cloud providers can only rely on low-level metrics such as CPU usage and hardware counters. We propose a novel machine learning framework, Alioth, to monitor the performance degradation of cloud applications. To feed the data-hungry models, we first elaborate interference generators and conduct comprehensive co-location experiments on a testbed to build Alioth-dataset which reflects the complexity and dynamicity in real-world scenarios. Then we construct Alioth by (1) augmenting features via recovering low-level metrics under no interference using denoising auto-encoders, (2) devising a transfer learning model based on domain adaptation neural network to make models generalize on test cases unseen in offline training, and (3) developing a SHAP explainer to automate feature selection and enhance model interpretability. Experiments show that Alioth achieves an average mean absolute error of 5.29% offline and 10.8% when testing on applications unseen in the training stage, outperforming the baseline methods. Alioth is also robust in signaling quality-of-service violation under dynamicity. Finally, we demonstrate a possible application of Alioth's interpretability, providing insights to benefit the decision-making of cloud operators. The dataset and code of Alioth have been released on GitHub. △ Less

Submitted 17 July, 2023; originally announced July 2023.

Comments: Accepted by 2023 IEEE International Parallel & Distributed Processing Symposium (IPDPS)

Journal ref: 2023 IEEE International Parallel & Distributed Processing Symposium (IPDPS), pp. 908-917

FreeCOS: Self-Supervised Learning from Fractals and Unlabeled Images for Curvilinear Object Segmentation

Authors: Tianyi Shi, Xiaohuan Ding, Liang Zhang, Xin Yang

Abstract: Curvilinear object segmentation is critical for many applications. However, manually annotating curvilinear objects is very time-consuming and error-prone, yielding insufficiently available annotated datasets for existing supervised methods and domain adaptation methods. This paper proposes a self-supervised curvilinear object segmentation method that learns robust and distinctive features from fr… ▽ More Curvilinear object segmentation is critical for many applications. However, manually annotating curvilinear objects is very time-consuming and error-prone, yielding insufficiently available annotated datasets for existing supervised methods and domain adaptation methods. This paper proposes a self-supervised curvilinear object segmentation method that learns robust and distinctive features from fractals and unlabeled images (FreeCOS). The key contributions include a novel Fractal-FDA synthesis (FFS) module and a geometric information alignment (GIA) approach. FFS generates curvilinear structures based on the parametric Fractal L-system and integrates the generated structures into unlabeled images to obtain synthetic training images via Fourier Domain Adaptation. GIA reduces the intensity differences between the synthetic and unlabeled images by comparing the intensity order of a given pixel to the values of its nearby neighbors. Such image alignment can explicitly remove the dependency on absolute intensity values and enhance the inherent geometric characteristics which are common in both synthetic and real images. In addition, GIA aligns features of synthetic and real images via the prediction space adaptation loss (PSAL) and the curvilinear mask contrastive loss (CMCL). Extensive experimental results on four public datasets, i.e., XCAD, DRIVE, STARE and CrackTree demonstrate that our method outperforms the state-of-the-art unsupervised methods, self-supervised methods and traditional methods by a large margin. The source code of this work is available at https://github.com/TY-Shi/FreeCOS. △ Less

Submitted 14 July, 2023; originally announced July 2023.

Comments: Accepted by ICCV 2023

Role of negative-energy states on the E2-M1 polarizability of optical clocks

Authors: Fang-Fei Wu, Ting-Yun Shi, Wei-Tou Ni, Li-Yan Tang

Abstract: The theoretical calculations of the dynamic E2-M1 polarizability at the magic wavelength of the Sr optical clock are inconsistent with experimental results. We investigate role of negative-energy states in the E2 and M1 polarizabilities. Our result for E2-M1 polarizability difference $-$7.74(3.92)$\times$10$^{-5}$ a.u. is dominated by the contribution from negative-energy states to M1 polarizabili… ▽ More The theoretical calculations of the dynamic E2-M1 polarizability at the magic wavelength of the Sr optical clock are inconsistent with experimental results. We investigate role of negative-energy states in the E2 and M1 polarizabilities. Our result for E2-M1 polarizability difference $-$7.74(3.92)$\times$10$^{-5}$ a.u. is dominated by the contribution from negative-energy states to M1 polarizability and has the same sign as and consistent with all the experimental values. In addition, we apply the present calculations to various other optical clocks, further confirming the importance of negative-energy states to the M1 polarizability. △ Less

Submitted 14 June, 2023; originally announced June 2023.

Comments: 7 pages, 3 figures, arXiv admin note: this is an extended version of arXiv:2301.06740

Identifying Subgroups of ICU Patients Using End-to-End Multivariate Time-Series Clustering Algorithm Based on Real-World Vital Signs Data

Authors: Tongyue Shi, Zhilong Zhang, Wentie Liu, Junhua Fang, Jianguo Hao, Shuai Jin, Huiying Zhao, Guilan Kong

Abstract: This study employed the MIMIC-IV database as data source to investigate the use of dynamic, high-frequency, multivariate time-series vital signs data, including temperature, heart rate, mean blood pressure, respiratory rate, and SpO2, monitored first 8 hours data in the ICU stay. Various clustering algorithms were compared, and an end-to-end multivariate time series clustering system called Time2F… ▽ More This study employed the MIMIC-IV database as data source to investigate the use of dynamic, high-frequency, multivariate time-series vital signs data, including temperature, heart rate, mean blood pressure, respiratory rate, and SpO2, monitored first 8 hours data in the ICU stay. Various clustering algorithms were compared, and an end-to-end multivariate time series clustering system called Time2Feat, combined with K-Means, was chosen as the most effective method to cluster patients in the ICU. In clustering analysis, data of 8,080 patients admitted between 2008 and 2016 was used for model development and 2,038 patients admitted between 2017 and 2019 for model validation. By analyzing the differences in clinical mortality prognosis among different categories, varying risks of ICU mortality and hospital mortality were found between different subgroups. Furthermore, the study visualized the trajectory of vital signs changes. The findings of this study provide valuable insights into the potential use of multivariate time-series clustering systems in patient management and monitoring in the ICU setting. △ Less

Submitted 11 July, 2023; v1 submitted 3 June, 2023; originally announced June 2023.

Improving the generalizability and robustness of large-scale traffic signal control

Authors: Tianyu Shi, Francois-Xavier Devailly, Denis Larocque, Laurent Charlin

Abstract: A number of deep reinforcement-learning (RL) approaches propose to control traffic signals. In this work, we study the robustness of such methods along two axes. First, sensor failures and GPS occlusions create missing-data challenges and we show that recent methods remain brittle in the face of these missing data. Second, we provide a more systematic study of the generalization ability of RL meth… ▽ More A number of deep reinforcement-learning (RL) approaches propose to control traffic signals. In this work, we study the robustness of such methods along two axes. First, sensor failures and GPS occlusions create missing-data challenges and we show that recent methods remain brittle in the face of these missing data. Second, we provide a more systematic study of the generalization ability of RL methods to new networks with different traffic regimes. Again, we identify the limitations of recent approaches. We then propose using a combination of distributional and vanilla reinforcement learning through a policy ensemble. Building upon the state-of-the-art previous model which uses a decentralized approach for large-scale traffic signal control with graph convolutional networks (GCNs), we first learn models using a distributional reinforcement learning (DisRL) approach. In particular, we use implicit quantile networks (IQN) to model the state-action return distribution with quantile regression. For traffic signal control problems, an ensemble of standard RL and DisRL yields superior performance across different scenarios, including different levels of missing sensor data and traffic flow patterns. Furthermore, the learning scheme of the resulting model can improve zero-shot transferability to different road network structures, including both synthetic networks and real-world networks (e.g., Luxembourg, Manhattan). We conduct extensive experiments to compare our approach to multi-agent reinforcement learning and traditional transportation approaches. Results show that the proposed method improves robustness and generalizability in the face of missing data, varying road networks, and traffic flows. △ Less

Submitted 7 June, 2023; v1 submitted 2 June, 2023; originally announced June 2023.

Ultracold field-linked tetratomic molecules

Authors: Xing-Yan Chen, Shrestha Biswas, Sebastian Eppelt, Andreas Schindewolf, Fulin Deng, Tao Shi, Su Yi, Timon A. Hilker, Immanuel Bloch, Xin-Yu Luo

Abstract: Ultracold polyatomic molecules offer intriguing new opportunities in cold chemistry, precision measurements, and quantum information processing, thanks to their rich internal structure. However, their increased complexity compared to diatomic molecules presents a formidable challenge to employ conventional cooling techniques. Here, we demonstrate a new approach to create ultracold polyatomic molec… ▽ More Ultracold polyatomic molecules offer intriguing new opportunities in cold chemistry, precision measurements, and quantum information processing, thanks to their rich internal structure. However, their increased complexity compared to diatomic molecules presents a formidable challenge to employ conventional cooling techniques. Here, we demonstrate a new approach to create ultracold polyatomic molecules by electroassociation in a degenerate Fermi gas of microwave-dressed polar molecules through a field-linked resonance. Starting from ground state NaK molecules, we create around $1.1\times 10^3$ tetratomic (NaK)$_2$ molecules, with a phase space density of $0.040(3)$ at a temperature of $134(3)\,\text{nK}$, more than $3000$ times colder than previously realized tetratomic molecules. We observe a maximum tetramer lifetime of $8(2)\,\text{ms}$ in free space without a notable change in the presence of an optical dipole trap, indicating these tetramers are collisionally stable. The measured binding energy and lifetime agree well with parameter-free calculations, which outlines pathways to further increase the lifetime of the tetramers. Moreover, we directly image the dissociated tetramers through microwave-field modulation to probe the anisotropy of their wave function in momentum space. Our result demonstrates a universal tool for assembling ultracold polyatomic molecules from smaller polar molecules, which is a crucial step towards Bose--Einstein condensation (BEC) of polyatomic molecules and towards a new crossover from a dipolar Bardeen-Cooper-Schrieffer (BCS) superfluid to a BEC of tetramers. Additionally, the long-lived FL state provides an ideal starting point for deterministic optical transfer to deeply bound tetramer states. △ Less

Submitted 1 June, 2023; originally announced June 2023.

Journal ref: Nature 626, 283 (2024)

Channelized analog microwave short-time Fourier transform in the optical domain with improved measurement performance

Authors: Xiaowei Li, Taixia Shi, Dong Ma, Yang Chen

Abstract: In this article, analog microwave short-time Fourier transform (STFT) with improved measurement performance is implemented in the optical domain by employing stimulated Brillouin scattering (SBS) and channelization. By jointly using three optical frequency combs and filter- and SBS-based frequency-to-time mapping (FTTM), the time-frequency information of the signal under test (SUT) in different fr… ▽ More In this article, analog microwave short-time Fourier transform (STFT) with improved measurement performance is implemented in the optical domain by employing stimulated Brillouin scattering (SBS) and channelization. By jointly using three optical frequency combs and filter- and SBS-based frequency-to-time mapping (FTTM), the time-frequency information of the signal under test (SUT) in different frequency intervals is measured in different channels. Then, by using the channel label introduced through subcarriers after photodetection, the obtained low-speed electrical pulses in different channels mixed in the time domain are distinguished and the time-frequency information of the SUT in different channels is respectively obtained and spliced to implement the STFT. For the first time, channelization measurement technology is introduced in the STFT system based on frequency sweeping and FTTM, greatly reducing the frequency-sweep range of the required frequency-sweep signal to the analysis bandwidth divided by the number of channels. In addition, channelization can also be used to improve the time and frequency resolution of the STFT system. A proof-of-concept experiment is performed. 12-GHz and 10-GHz analysis bandwidth is implemented by using a 4-GHz frequency-sweep signal and 3 channels and a 2-GHz frequency-sweep signal and 5 channels. Measurement performance improvement is also demonstrated. △ Less

Submitted 24 May, 2023; originally announced May 2023.

Comments: 18 pages, 9 figures, 1 table

Dual-band polarized upconversion photoluminescence enhanced by resonant dielectric metasurfaces

Authors: Ziwei Feng, Tan Shi, Guangzhou Geng, Junjie Li, Zi-Lan Deng, Yuri Kivshar, Xiangping Li

Abstract: Lanthanide-doped upconversion nanoparticles emerged recently as an attractive material platform underpinning a broad range of innovative applications such as optical cryptography, luminescent probes, and lasing. However, the intricate 4f-associated electronic transition in upconversion nanoparticles leads only to a weak photoluminescence intensity and unpolarized emission, hindering many applicati… ▽ More Lanthanide-doped upconversion nanoparticles emerged recently as an attractive material platform underpinning a broad range of innovative applications such as optical cryptography, luminescent probes, and lasing. However, the intricate 4f-associated electronic transition in upconversion nanoparticles leads only to a weak photoluminescence intensity and unpolarized emission, hindering many applications that demand ultrabright and polarized light sources. Here, we uncover a new strategy for achieving ultrabright and dual-band polarized upconversion photoluminescence. We employ resonant dielectric metasurfaces supporting high-quality resonant modes at dual upconversion bands enabling two-order-of-magnitude amplification of upconversion emissions. We demonstrate that dual-band resonances can be selectively switched on polarization, endowing cross-polarization controlled upconversion luminescence with ultra-high degrees of polarization, reaching approximately 0.86 and 0.91 at dual emission wavelengths of 540 nm and 660 nm, respectively. Our strategy offers an effective approach for enhancing photon upconversion processes paving the way toward efficient low-threshold polarization upconversion lasers. △ Less

Submitted 15 May, 2023; originally announced May 2023.

Reformulating CTR Prediction: Learning Invariant Feature Interactions for Recommendation

Authors: Yang Zhang, Tianhao Shi, Fuli Feng, Wenjie Wang, Dingxian Wang, Xiangnan He, Yongdong Zhang

Abstract: Click-Through Rate (CTR) prediction plays a core role in recommender systems, serving as the final-stage filter to rank items for a user. The key to addressing the CTR task is learning feature interactions that are useful for prediction, which is typically achieved by fitting historical click data with the Empirical Risk Minimization (ERM) paradigm. Representative methods include Factorization Mac… ▽ More Click-Through Rate (CTR) prediction plays a core role in recommender systems, serving as the final-stage filter to rank items for a user. The key to addressing the CTR task is learning feature interactions that are useful for prediction, which is typically achieved by fitting historical click data with the Empirical Risk Minimization (ERM) paradigm. Representative methods include Factorization Machines and Deep Interest Network, which have achieved wide success in industrial applications. However, such a manner inevitably learns unstable feature interactions, i.e., the ones that exhibit strong correlations in historical data but generalize poorly for future serving. In this work, we reformulate the CTR task -- instead of pursuing ERM on historical data, we split the historical data chronologically into several periods (a.k.a, environments), aiming to learn feature interactions that are stable across periods. Such feature interactions are supposed to generalize better to predict future behavior data. Nevertheless, a technical challenge is that existing invariant learning solutions like Invariant Risk Minimization are not applicable, since the click data entangles both environment-invariant and environment-specific correlations. To address this dilemma, we propose Disentangled Invariant Learning (DIL) which disentangles feature embeddings to capture the two types of correlations separately. To improve the modeling efficiency, we further design LightDIL which performs the disentanglement at the higher level of the feature field. Extensive experiments demonstrate the effectiveness of DIL in learning stable feature interactions for CTR. We release the code at https://github.com/zyang1580/DIL. △ Less

Submitted 26 April, 2023; originally announced April 2023.

Comments: 11 pages, 6 Postscript figures, to be published in SIGIR2023

Non-Hermitian Waveguide Cavity QED with Tunable Atomic Mirrors

Authors: Wei Nie, Tao Shi, Yu-xi Liu, Franco Nori

Abstract: Optical mirrors determine cavity properties by means of light reflection. Imperfect reflection gives rise to open cavities with photon loss. We study an open cavity made of atom-dimer mirrors with a tunable reflection spectrum. We find that the atomic cavity shows anti-$\mathcal{PT}$ symmetry. The anti-$\mathcal{PT}$ phase transition controlled by atomic couplings in mirrors indicates the emergenc… ▽ More Optical mirrors determine cavity properties by means of light reflection. Imperfect reflection gives rise to open cavities with photon loss. We study an open cavity made of atom-dimer mirrors with a tunable reflection spectrum. We find that the atomic cavity shows anti-$\mathcal{PT}$ symmetry. The anti-$\mathcal{PT}$ phase transition controlled by atomic couplings in mirrors indicates the emergence of two degenerate cavity supermodes. Interestingly, a threshold of mirror reflection is identified for realizing strong coherent cavity-atom coupling. This reflection threshold reveals the criterion of atomic mirrors to produce a good cavity. Moreover, cavity quantum electrodynamics with a probe atom shows mirror-tuned properties, including reflection-dependent polaritons formed by the cavity and probe atom. Our work presents a non-Hermitian theory of an anti-$\mathcal{PT}$ atomic cavity, which may have applications in quantum optics and quantum computation. △ Less

Submitted 11 September, 2023; v1 submitted 25 April, 2023; originally announced April 2023.

Comments: 8 pages, 5 figures

Journal ref: Phys. Rev. Lett. 131, 103602 (2023)

ASM: Adaptive Skinning Model for High-Quality 3D Face Modeling

Authors: Kai Yang, Hong Shang, Tianyang Shi, Xinghan Chen, Jingkai Zhou, Zhongqian Sun, Wei Yang

Abstract: The research fields of parametric face model and 3D face reconstruction have been extensively studied. However, a critical question remains unanswered: how to tailor the face model for specific reconstruction settings. We argue that reconstruction with multi-view uncalibrated images demands a new model with stronger capacity. Our study shifts attention from data-dependent 3D Morphable Models (3DMM… ▽ More The research fields of parametric face model and 3D face reconstruction have been extensively studied. However, a critical question remains unanswered: how to tailor the face model for specific reconstruction settings. We argue that reconstruction with multi-view uncalibrated images demands a new model with stronger capacity. Our study shifts attention from data-dependent 3D Morphable Models (3DMM) to an understudied human-designed skinning model. We propose Adaptive Skinning Model (ASM), which redefines the skinning model with more compact and fully tunable parameters. With extensive experiments, we demonstrate that ASM achieves significantly improved capacity than 3DMM, with the additional advantage of model size and easy implementation for new topology. We achieve state-of-the-art performance with ASM for multi-view reconstruction on the Florence MICC Coop benchmark. Our quantitative analysis demonstrates the importance of a high-capacity model for fully exploiting abundant information from multi-view input in reconstruction. Furthermore, our model with physical-semantic parameters can be directly utilized for real-world applications, such as in-game avatar creation. As a result, our work opens up new research direction for parametric face model and facilitates future research on multi-view reconstruction. △ Less

Submitted 8 October, 2023; v1 submitted 19 April, 2023; originally announced April 2023.

Comments: 18 pages

Microwave shielding of bosonic NaRb molecules

Authors: Junyu Lin, Guanghua Chen, Mucan Jin, Zhaopeng Shi, Fulin Deng, Wenxian Zhang, Goulven Quéméner, Tao Shi, Su Yi, Dajun Wang

Abstract: Recent years have witnessed tremendous progresses in creating and manipulating ground-state ultracold polar molecules. However, the two-body loss regardless of the chemical reactivities is still a hurdle for many future explorations. Here, we investigate the loss suppression of non-reactive bosonic $^{23}$Na$^{87}$Rb molecules with a circular polarized microwave blue-detuned to the rotational tran… ▽ More Recent years have witnessed tremendous progresses in creating and manipulating ground-state ultracold polar molecules. However, the two-body loss regardless of the chemical reactivities is still a hurdle for many future explorations. Here, we investigate the loss suppression of non-reactive bosonic $^{23}$Na$^{87}$Rb molecules with a circular polarized microwave blue-detuned to the rotational transition. We achieve suppression of the loss by two orders of magnitude with the lowest two-body loss rate coefficient reduced to $3\times10^{-12}~\rm{cm^3/s}$. Meanwhile, the elastic collision rate coefficient is increased to the $10^{-8}~\rm{cm^3/s}$ level. The large good-to-bad collision ratio has allowed us to carry out evaporative cooling of $^{23}$Na$^{87}$Rb with an efficiency of 1.7(2), increasing the phase-space density by a factor of 10. With further improvements, this technique holds great promises for creating a Bose-Einstein condensate of ultracold polar molecules. △ Less

Submitted 30 April, 2023; v1 submitted 17 April, 2023; originally announced April 2023.

Comments: 11 pages, 8 figures. Figure 3(c) is updated based on the calculation in Appendix D2. The 1st version was submitted on 17 Apr 2023

Journal ref: Phys. Rev. X 13, 031032 (2023)

Life Regression based Patch Slimming for Vision Transformers

Authors: Jiawei Chen, Lin Chen, Jiang Yang, Tianqi Shi, Lechao Cheng, Zunlei Feng, Mingli Song

Abstract: Vision transformers have achieved remarkable success in computer vision tasks by using multi-head self-attention modules to capture long-range dependencies within images. However, the high inference computation cost poses a new challenge. Several methods have been proposed to address this problem, mainly by slimming patches. In the inference stage, these methods classify patches into two classes,… ▽ More Vision transformers have achieved remarkable success in computer vision tasks by using multi-head self-attention modules to capture long-range dependencies within images. However, the high inference computation cost poses a new challenge. Several methods have been proposed to address this problem, mainly by slimming patches. In the inference stage, these methods classify patches into two classes, one to keep and the other to discard in multiple layers. This approach results in additional computation at every layer where patches are discarded, which hinders inference acceleration. In this study, we tackle the patch slimming problem from a different perspective by proposing a life regression module that determines the lifespan of each image patch in one go. During inference, the patch is discarded once the current layer index exceeds its life. Our proposed method avoids additional computation and parameters in multiple layers to enhance inference speed while maintaining competitive performance. Additionally, our approach requires fewer training epochs than other patch slimming methods. △ Less

Submitted 10 April, 2023; originally announced April 2023.

Comments: 8 pages,4 figures

Tighter upper bounds on the critical temperature of two-dimensional superconductors and superfluids from the BCS to the Bose regime

Authors: Tingting Shi, Wei Zhang, C. A. R. Sá de Melo

Abstract: We discuss standard and tighter upper bounds on the critical temperature $T_c$ of two-dimensional (2D) superconductors and superfluids versus particle density $n$ or filling factor $ν$ for continuum and lattice systems from the Bardeen-Cooper-Schrieffer (BCS) to Bose regime. We discuss only one-band Hamiltonians, where the transition from the normal to superconducting (superfluid) phase is governe… ▽ More We discuss standard and tighter upper bounds on the critical temperature $T_c$ of two-dimensional (2D) superconductors and superfluids versus particle density $n$ or filling factor $ν$ for continuum and lattice systems from the Bardeen-Cooper-Schrieffer (BCS) to Bose regime. We discuss only one-band Hamiltonians, where the transition from the normal to superconducting (superfluid) phase is governed by Berezinskii-Kosterlitz-Thouless (BKT) mechanism of vortex-antivortex binding, such that a direct relation between the superfluid density tensor and $T_c$ exists. We demonstrate that it is imperative to consider at least the full effect of phase fluctuations of order parameter for superconductivity (superfluidity) to establish tighter bounds. Using the renormalization group, we obtain phase-fluctuation critical temperature $T_c^θ$, a much tighter upper bound to critical temperature supremum $T_c^{\rm sup}$ than standard critical temperature upper bound $T_c^{\rm up1}$ from Ferrell-Glover-Tinkham sum rule. We go beyond textbook phase-fluctuation theories and show that chemical potential renormalization, order parameter equation, and Nelson-Kosterlitz relation need to be solved self-consistently and simultaneously with renormalization group flow equation to produce $T_c^θ$ over the entire BCS-Bose crossover. We note that an analytic theory including modulus fluctuations of the order parameter valid throughout the BCS-Bose evolution is still lacking, but the inclusion of modulus fluctuations can only produce a critical temperature lower than $T_c^θ$ and thus produce an even tighter bound to $T_c^{\rm sup}$. We conclude by indicating that if the measured critical temperature exceeds $T_c^θ$ in experiments involving 2D single-band systems, then a non-BKT mechanism must be invoked to describe the superconducting (superfluid) transition. △ Less

Submitted 20 March, 2023; originally announced March 2023.

Comments: 12 pages, 5 figures, a long version of the short paper listed on arXiv:2203.05478

Measurement of hyperfine structure and the Zemach radius in $\rm^6Li^+$ using optical Ramsey technique

Authors: Wei Sun, Pei-Pei Zhang, Peng-peng Zhou, Shao-long Chen, Zhi-qiang Zhou, Yao Huang, Xiao-Qiu Qi, Zong-Chao Yan, Ting-Yun Shi, G. W. F. Drake, Zhen-Xiang Zhong, Hua Guan, Ke-lin Gao

Abstract: We investigate the $2\,^3\!S_1$--$2\,^3\!P_J$ ($J = 0, 1, 2$) transitions in $\rm^6Li^+$ using the optical Ramsey technique and achieve the most precise values of the hyperfine splittings of the $2\,^3\!S_1$ and $2\,^3\!P_J$ states, with smallest uncertainty of about 10~kHz. The present results reduce the uncertainties of previous experiments by a factor of 5 for the $2\,^3\!S_1$ state and a facto… ▽ More We investigate the $2\,^3\!S_1$--$2\,^3\!P_J$ ($J = 0, 1, 2$) transitions in $\rm^6Li^+$ using the optical Ramsey technique and achieve the most precise values of the hyperfine splittings of the $2\,^3\!S_1$ and $2\,^3\!P_J$ states, with smallest uncertainty of about 10~kHz. The present results reduce the uncertainties of previous experiments by a factor of 5 for the $2\,^3\!S_1$ state and a factor of 50 for the $2\,^3\!P_J$ states, and are in better agreement with theoretical values. Combining our measured hyperfine intervals of the $2\,^3\!S_1$ state with the latest quantum electrodynamic (QED) calculations, the improved Zemach radius of the $\rm^6Li$ nucleus is determined to be 2.44(2)~fm, with the uncertainty entirely due to the uncalculated QED effects of order $mα^7$. The result is in sharp disagreement with the value 3.71(16) fm determined from simple models of the nuclear charge and magnetization distribution. We call for a more definitive nuclear physics value of the $\rm^6Li$ Zemach radius. △ Less

Submitted 18 March, 2023; v1 submitted 14 March, 2023; originally announced March 2023.

Comments: 6 pages, 6 figures

Precision Measurement of M1 Optical Clock Transition in Ni12+

Authors: Shaolong Chen, Zhiqiang Zhou, Jiguang Li, Tingxian Zhang, Chengbin Li, Tingyun Shi, Yao Huang, Kelin Gao, Hua Guan

Abstract: Highly charged ions (HCIs) have drawn significant interest in quantum metrology and in search for new physics. Among these, Ni12+ is considered as one of the most promising candidates for the next generation of HCI optical clocks, due to its two E1-forbidden transitions M1 and E2, which occur in the visible spectral range. In this work, we used the Shanghai-Wuhan Electron Beam Ion Trap to perform… ▽ More Highly charged ions (HCIs) have drawn significant interest in quantum metrology and in search for new physics. Among these, Ni12+ is considered as one of the most promising candidates for the next generation of HCI optical clocks, due to its two E1-forbidden transitions M1 and E2, which occur in the visible spectral range. In this work, we used the Shanghai-Wuhan Electron Beam Ion Trap to perform a high-precision measurement of the M1 transition wavelength. Our approach involved an improved calibration scheme for the spectra, utilizing auxiliary Ar+ lines for calibration and correction. Our final measured result of the M1 transition wavelength demonstrates a five-fold improvement in accuracy compared to our previous findings, reaching the sub-picometer level accuracy. In combination with our rigorous atomic-structure calculations to capture the electron correlations and relativistic effects, the quantum electrodynamic (QED) corrections were extracted. Moreover, comparing with an estimate of the one-electron QED contributions by using the GRASP2018 package, we found that the present experimental accuracy is high enough for testing the higher-order QED corrections for such a complex system with four electrons in the p subshell. △ Less

Submitted 9 September, 2023; v1 submitted 8 March, 2023; originally announced March 2023.

Comments: 15 pages, 5 figures

Universal Three-Body Physics for Ultracold $^{87}$Rb-$^{40}$K Mixtures with Finite-range Interactions

Authors: Ning-Ning Gao, Hui-Li Han, Ting-Yun Shi

Abstract: The breakdown of Efimov universal relations between resonances and interference features in ultracold $^{40}$K-$^{87}$Rb mixtures has sparked much discussion. In this study, we investigate the atom-dimer elastic scattering and three-body recombination (TBR) rates with $J=0$ symmetry for a $^{87}$Rb-$^{87}$Rb-$^{40}$K system to understand the mechanisms underlying this breakdown. We use the R-matri… ▽ More The breakdown of Efimov universal relations between resonances and interference features in ultracold $^{40}$K-$^{87}$Rb mixtures has sparked much discussion. In this study, we investigate the atom-dimer elastic scattering and three-body recombination (TBR) rates with $J=0$ symmetry for a $^{87}$Rb-$^{87}$Rb-$^{40}$K system to understand the mechanisms underlying this breakdown. We use the R-matrix propagation method in a hyperspherical coordinate frame with the Lennard-Jones model potential describing the interactions between atoms. We extract the atom-dimer scattering length, cross sections and three-body recombination rates with a finite intraspecies scattering length. An atom-dimer elastic scattering resonance at negative interspecies scattering length is found, which is due to the presence of the near-threshold trimer state at the atom-dimer threshold ($^{40}$K + $^{87}$Rb$^{87}$Rb). In addition, we predict an Efimov recombination minima at positive interspecies scattering length, which is outside the range of previous measurements. Our calculations show that the breakdown of the universal relations predicted by zero-range theory can be attributed to the effective range corrections and finite intraspecies scattering length. The present results help elucidate the universal relations between Efimov features as well as the importance of finite-range corrections for mixed systems. △ Less

Submitted 19 February, 2023; v1 submitted 16 February, 2023; originally announced February 2023.

Comments: 20 pages,10 figures

Weakly Supervised Headline Dependency Parsing

Authors: Adrian Benton, Tianze Shi, Ozan İrsoy, Igor Malioutov

Abstract: English news headlines form a register with unique syntactic properties that have been documented in linguistics literature since the 1930s. However, headlines have received surprisingly little attention from the NLP syntactic parsing community. We aim to bridge this gap by providing the first news headline corpus of Universal Dependencies annotated syntactic dependency trees, which enables us to… ▽ More English news headlines form a register with unique syntactic properties that have been documented in linguistics literature since the 1930s. However, headlines have received surprisingly little attention from the NLP syntactic parsing community. We aim to bridge this gap by providing the first news headline corpus of Universal Dependencies annotated syntactic dependency trees, which enables us to evaluate existing state-of-the-art dependency parsers on news headlines. To improve English news headline parsing accuracies, we develop a projection method to bootstrap silver training data from unlabeled news headline-article lead sentence pairs. Models trained on silver headline parses demonstrate significant improvements in performance over models trained solely on gold-annotated long-form texts. Ultimately, we find that, although projected silver training data improves parser performance across different news outlets, the improvement is moderated by constructions idiosyncratic to outlet. △ Less

Submitted 24 January, 2023; originally announced January 2023.

Comments: Findings of EMNLP 2022

ACM Class: I.2.7

Journal ref: In Proceedings of Findings of EMNLP 2022

Contributions of negative-energy states to the E2-M1 polarizability of the Sr clock

Authors: Fang-Fei Wu, Ting-Yun Shi, Li-Yan Tang

Abstract: With the improvement of high-precision optical clock, the higher-order multipolar interaction between atoms and light needs quantitative evaluation. However for the Sr clock, the differential dynamic E2-M1 polarizability at the magic wavelength has contradictions among available theoretical and experimental results. Recently, the new experimental measurement of S. Dörscher {\em et al.} [arXiv: 221… ▽ More With the improvement of high-precision optical clock, the higher-order multipolar interaction between atoms and light needs quantitative evaluation. However for the Sr clock, the differential dynamic E2-M1 polarizability at the magic wavelength has contradictions among available theoretical and experimental results. Recently, the new experimental measurement of S. Dörscher {\em et al.} [arXiv: 2210. 14727] is consistent with measurement of Ushijima {\em et al.}, which poses new challenges to theory and urgently calls for theoretical explanations. In present work, we investigate contributions of negative-energy states to the E2 and M1 polarizabilities. We find that for the M1 polarizability, the contribution from negative-energy states is crucial and dominant. Our new theoretical result for E2-M1 polarizability difference is $-7.74(3.92)\times 10^{-5}$ a.u., which is in good agreement with the recent experiment of S. Dörscher et al., so the inconsistency problem of E2-M1 polarizability in the Sr clock between theory and experiment is eliminated. △ Less

Submitted 8 March, 2023; v1 submitted 17 January, 2023; originally announced January 2023.

Comments: 5 pages, 1 figure

Application of the correlated B-spline basis functions to the leading relativistic and QED corrections of helium

Authors: Hao Fang, Yong-Hui Zhang, Pei-Pei Zhang, Ting-Yun Shi

Abstract: B-spline functions have been widely used in computational atomic physics. Different from the traditional B-spline basis (a simple product of two B-splines), the recently developed correlated B-spline basis functions(C-BSBF), in which the interelectronic coordinate $r_{12}$ is included explicitly, have greatly improved the computational accuracy of polarizability [S. J. Yang \textit{et al}., Phys.… ▽ More B-spline functions have been widely used in computational atomic physics. Different from the traditional B-spline basis (a simple product of two B-splines), the recently developed correlated B-spline basis functions(C-BSBF), in which the interelectronic coordinate $r_{12}$ is included explicitly, have greatly improved the computational accuracy of polarizability [S. J. Yang \textit{et al}., Phys. Rev. A \textbf{95}, 062505 (2017)] and bethe logarithm [ S. J. Yang \textit{et al}., Phys. Rev. A \textbf{100}, 042509 (2019)] for singlet states of helium. Here, we report the extension of the C-BSBF to the leading relativistic and QED correction calculations for energy levels of the $1\,^1S$, $2\,^1S$, $2\,^3S$, and $3\,^3S$ states of helium. The relativistic kinetic term $p_{1}^{4}$, contact potential $δ^{3}(r_{1})$, $δ^{3}(r_{12})$ and Araki-Sucher correction $\langle 1/r_{12}^{3} \rangle$ are calculated by using the global operator method, in which $r_{12}^n$ and $r_{12}^n\ln r_{12}$ involved are calculated with the generalization of Laplace's expansions. The obtained values for the ground state are $δE_{rel}/α^{2}=-$1.951 754 7(2) and $δE_{QED}/α^{3}=$57.288 165(2), consistent with previous results, which opens the possibility of calculating higher-order relativistic and QED effects using the C-BSBF. △ Less

Submitted 13 January, 2023; originally announced January 2023.

A Voigt laser operating on $^{87}$Rb 780 nm transition

Authors: Zijie Liu, Xiaolei Guan, Xiaomin Qin, Zhiyang Wang, Hangbo Shi, Jia Zhang, Jianxiang Miao, Tiantian Shi, Anhong Dang, Jingbiao Chen

Abstract: We report the development of laser systems -- a "Voigt laser" -- using a Voigt anomalous dispersion optical filter as the frequency-selective element, working at the wavelength of 780 nm of $^{87}$Rb-D2 resonance line. Compared with Faraday anomalous dispersion optical filter, the Voigt anomalous dispersion optical filter can generate a stronger and more uniform magnetic field with a compact size… ▽ More We report the development of laser systems -- a "Voigt laser" -- using a Voigt anomalous dispersion optical filter as the frequency-selective element, working at the wavelength of 780 nm of $^{87}$Rb-D2 resonance line. Compared with Faraday anomalous dispersion optical filter, the Voigt anomalous dispersion optical filter can generate a stronger and more uniform magnetic field with a compact size of magnet, and obtains a transmission spectrum with narrower linewidth and more stable lineprofile. In this case, the frequency stability of the Voigt laser reaches 5$\times$10$^{-9}$ at the averaging time of 200 s, and the wavelength fluctuation of 8-hours free operation is $\pm$0.1 pm. Besides, the Voigt laser has greater immunity to diode current than the Faraday laser, with a wavelength fluctuation of $\pm$0.5 pm in the current range from 73 mA to 150 mA. Finally, the Voigt laser frequency can be controlled by the cell temperature of the Voigt optical filter, which is expected to achieve a frequency detuning of 20 GHz. Consequently, the Voigt laser, whose frequency could correspond to the atomic transition frequency by tuning the cell temperature, obtains good robustness to the current and temperature fluctuation of laser diode, and could realize a compact optical standard for precise measurement once stabilized by modulation transfer spectroscopy. △ Less

Submitted 4 January, 2023; originally announced January 2023.

Comments: 4 pages, 5 figures. The following article has been submitted to [Appled Physics Letters]

Ultra-narrowband interference circuits enable low-noise and high-rate photon counting for InGaAs/InP avalanche photodiodes

Authors: Yuanbin Fan, Tingting Shi, Weijie Ji, Lai Zhou, Yang Ji, Zhiliang Yuan

Abstract: Afterpulsing noise in InGaAs/InP single photon avalanche photodiodes (APDs) is caused by carrier trapping and can be suppressed successfully through limiting the avalanche charge via sub-nanosecond gating. Detection of faint avalanches requires an electronic circuit that is able to effectively remove the gate-induced capacitive response while keeping photon signals intact. Here we demonstrate a no… ▽ More Afterpulsing noise in InGaAs/InP single photon avalanche photodiodes (APDs) is caused by carrier trapping and can be suppressed successfully through limiting the avalanche charge via sub-nanosecond gating. Detection of faint avalanches requires an electronic circuit that is able to effectively remove the gate-induced capacitive response while keeping photon signals intact. Here we demonstrate a novel ultra-narrowband interference circuit (UNIC) that can reject the capacitive response by up to 80 dB per stage with little distortion to avalanche signals. Cascading two UNIC's in a readout circuit, we were able to enable high count rate of up to 700 MC/s and low afterpulsing of 0.5 % at a detection efficiency of 25.3 % for 1.25 GHz sinusoidally gated InGaAs/InP APDs. At -30 degree C, we measured 1 % afterpulsing at a detection efficiency of 21.2 %. △ Less

Submitted 14 February, 2023; v1 submitted 4 January, 2023; originally announced January 2023.

Journal ref: Optics Express 2023

Neural Story Planning

Authors: Anbang Ye, Christopher Cui, Taiwei Shi, Mark O. Riedl

Abstract: Automated plot generation is the challenge of generating a sequence of events that will be perceived by readers as the plot of a coherent story. Traditional symbolic planners plan a story from a goal state and guarantee logical causal plot coherence but rely on a library of hand-crafted actions with their preconditions and effects. This closed world setting limits the length and diversity of what… ▽ More Automated plot generation is the challenge of generating a sequence of events that will be perceived by readers as the plot of a coherent story. Traditional symbolic planners plan a story from a goal state and guarantee logical causal plot coherence but rely on a library of hand-crafted actions with their preconditions and effects. This closed world setting limits the length and diversity of what symbolic planners can generate. On the other hand, pre-trained neural language models can generate stories with great diversity, while being generally incapable of ending a story in a specified manner and can have trouble maintaining coherence. In this paper, we present an approach to story plot generation that unifies causal planning with neural language models. We propose to use commonsense knowledge extracted from large language models to recursively expand a story plot in a backward chaining fashion. Specifically, our system infers the preconditions for events in the story and then events that will cause those conditions to become true. We performed automatic evaluation to measure narrative coherence as indicated by the ability to answer questions about whether different events in the story are causally related to other events. Results indicate that our proposed method produces more coherent plotlines than several strong baselines. △ Less

Submitted 16 December, 2022; originally announced December 2022.

Fast Rule-Based Decoding: Revisiting Syntactic Rules in Neural Constituency Parsing

Authors: Tianyu Shi, Zhicheng Wang, Liyin Xiao, Cong Liu

Abstract: Most recent studies on neural constituency parsing focus on encoder structures, while few developments are devoted to decoders. Previous research has demonstrated that probabilistic statistical methods based on syntactic rules are particularly effective in constituency parsing, whereas syntactic rules are not used during the training of neural models in prior work probably due to their enormous co… ▽ More Most recent studies on neural constituency parsing focus on encoder structures, while few developments are devoted to decoders. Previous research has demonstrated that probabilistic statistical methods based on syntactic rules are particularly effective in constituency parsing, whereas syntactic rules are not used during the training of neural models in prior work probably due to their enormous computation requirements. In this paper, we first implement a fast CKY decoding procedure harnessing GPU acceleration, based on which we further derive a syntactic rule-based (rule-constrained) CKY decoding. In the experiments, our method obtains 95.89 and 92.52 F1 on the datasets of PTB and CTB respectively, which shows significant improvements compared with previous approaches. Besides, our parser achieves strong and competitive cross-domain performance in zero-shot settings. △ Less

Submitted 16 December, 2022; originally announced December 2022.

BCS-BEC crossover in a quasi-two-dimensional Fermi superfluid

Authors: Jing Zhou, Tingting Shi, Xia-Ji Liu, Hui Hu, Wei Zhang

Abstract: We study the crossover from the Bardeen-Cooper-Shrieffer (BCS) regime to the Bose-Einstein-condensation (BEC) regime in a quasi-two-dimensional quantum gas of ultracold fermionic atoms. Using an effective two-dimensional Hamiltonian with renormalized interactions between atoms and dressed molecules within a Gaussian pair fluctuation theory, we investigate how Fermi superfluidity is affected by red… ▽ More We study the crossover from the Bardeen-Cooper-Shrieffer (BCS) regime to the Bose-Einstein-condensation (BEC) regime in a quasi-two-dimensional quantum gas of ultracold fermionic atoms. Using an effective two-dimensional Hamiltonian with renormalized interactions between atoms and dressed molecules within a Gaussian pair fluctuation theory, we investigate how Fermi superfluidity is affected by reduced dimensionality at zero temperature in a wide range of crossover. We observe that the order parameter and pair size show universal relations with the chemical potential on the BCS side, irrespective of dimensionality. However, such universal dependences break down towards the BEC limit with increasing interaction strength. This results reveal the notable effect of reduced dimenionality on pairing physics, which can also be observed in the sound velocity and convexity parameter of the Goldstone mode. We compare our results with the latest experiments in both ${}^{6}$Li atomic gases and layered nitrides LixZrNCl and find good agreements. △ Less

Submitted 23 November, 2022; originally announced November 2022.

Comments: 11 pages, 7 fugures