-
Structural Optimization of Lightweight Bipedal Robot via SERL
Authors:
Yi Cheng,
Chenxi Han,
Yuheng Min,
Linqi Ye,
Houde Liu,
Hang Liu
Abstract:
Designing a bipedal robot is a complex and challenging task, especially when dealing with a multitude of structural parameters. Traditional design methods often rely on human intuition and experience. However, such approaches are time-consuming, labor-intensive, lack theoretical guidance and hard to obtain optimal design results within vast design spaces, thus failing to full exploit the inherent…
▽ More
Designing a bipedal robot is a complex and challenging task, especially when dealing with a multitude of structural parameters. Traditional design methods often rely on human intuition and experience. However, such approaches are time-consuming, labor-intensive, lack theoretical guidance and hard to obtain optimal design results within vast design spaces, thus failing to full exploit the inherent performance potential of robots. In this context, this paper introduces the SERL (Structure Evolution Reinforcement Learning) algorithm, which combines reinforcement learning for locomotion tasks with evolution algorithms. The aim is to identify the optimal parameter combinations within a given multidimensional design space. Through the SERL algorithm, we successfully designed a bipedal robot named Wow Orin, where the optimal leg length are obtained through optimization based on body structure and motor torque. We have experimentally validated the effectiveness of the SERL algorithm, which is capable of optimizing the best structure within specified design space and task conditions. Additionally, to assess the performance gap between our designed robot and the current state-of-the-art robots, we compared Wow Orin with mainstream bipedal robots Cassie and Unitree H1. A series of experimental results demonstrate the Outstanding energy efficiency and performance of Wow Orin, further validating the feasibility of applying the SERL algorithm to practical design.
△ Less
Submitted 28 August, 2024;
originally announced August 2024.
-
Submodular Maximization Approaches for Equitable Client Selection in Federated Learning
Authors:
Andrés Catalino Castillo Jiménez,
Ege C. Kaya,
Lintao Ye,
Abolfazl Hashemi
Abstract:
In a conventional Federated Learning framework, client selection for training typically involves the random sampling of a subset of clients in each iteration. However, this random selection often leads to disparate performance among clients, raising concerns regarding fairness, particularly in applications where equitable outcomes are crucial, such as in medical or financial machine learning tasks…
▽ More
In a conventional Federated Learning framework, client selection for training typically involves the random sampling of a subset of clients in each iteration. However, this random selection often leads to disparate performance among clients, raising concerns regarding fairness, particularly in applications where equitable outcomes are crucial, such as in medical or financial machine learning tasks. This disparity typically becomes more pronounced with the advent of performance-centric client sampling techniques. This paper introduces two novel methods, namely SUBTRUNC and UNIONFL, designed to address the limitations of random client selection. Both approaches utilize submodular function maximization to achieve more balanced models. By modifying the facility location problem, they aim to mitigate the fairness concerns associated with random selection. SUBTRUNC leverages client loss information to diversify solutions, while UNIONFL relies on historical client selection data to ensure a more equitable performance of the final model. Moreover, these algorithms are accompanied by robust theoretical guarantees regarding convergence under reasonable assumptions. The efficacy of these methods is demonstrated through extensive evaluations across heterogeneous scenarios, revealing significant improvements in fairness as measured by a client dissimilarity metric.
△ Less
Submitted 27 August, 2024; v1 submitted 24 August, 2024;
originally announced August 2024.
-
Engineering biphoton spectral wavefunction in a silicon micro-ring resonator with split resonances
Authors:
Liao Ye,
Haoran Ma,
Xiaoqing Guo,
Fanjie Ruan,
Yuehai Wang,
Jianyi Yang
Abstract:
Frequency-time is a degree of freedom suitable for photonic high-dimensional entanglement, with advantages such as compatibility with single-mode devices and insensitivity to dispersion. The engineering control of the frequency-time amplitude of a photon's electric field has been demonstrated on platforms with second-order optical nonlinearity. For integrated photonic platforms with only third-ord…
▽ More
Frequency-time is a degree of freedom suitable for photonic high-dimensional entanglement, with advantages such as compatibility with single-mode devices and insensitivity to dispersion. The engineering control of the frequency-time amplitude of a photon's electric field has been demonstrated on platforms with second-order optical nonlinearity. For integrated photonic platforms with only third-order optical nonlinearity, the engineered generation of the state remains unexplored. Here, we demonstrate a cavity-enhanced photon-pair source on the silicon-on-insulator (SOI) platform that can generate both separable states and controllable entangled states in the frequency domain without post-manipulation. By choosing different resonance combinations and employing on-chip optical field differentiation, we achieve independent control over two functions that affect the joint spectral intensity (JSI) of the state. A semi-analytical model is derived to simulate the biphoton spectral wavefunction in the presence of resonance splitting and pump differentiation, and its parameters can be fully determined through fitting-based parameter extraction from the resonator's measured linear response. The measured spectral purity for the separable state is $95.5\pm 1.2\%$, while the measured JSIs for the entangled states show two- or four-peaked functions in two-dimensional frequency space. The experiments and simulations demonstrate the capacity to manipulate the frequency-domain wavefunction in a silicon-based device, which is promising for applications like quantum information processing using pulsed temporal-mode encoding or long-distance quantum key distribution.
△ Less
Submitted 24 August, 2024;
originally announced August 2024.
-
Controlling nonergodicity in quantum many-body systems by reinforcement learning
Authors:
Li-Li Ye,
Ying-Cheng Lai
Abstract:
Finding optimal control strategies to suppress quantum thermalization for arbitrarily initial states, the so-called quantum nonergodicity control, is important for quantum information science and technologies. Previous control methods largely relied on theoretical model of the target quantum system, but invertible model approximations and inaccuracies can lead to control failures. We develop a mod…
▽ More
Finding optimal control strategies to suppress quantum thermalization for arbitrarily initial states, the so-called quantum nonergodicity control, is important for quantum information science and technologies. Previous control methods largely relied on theoretical model of the target quantum system, but invertible model approximations and inaccuracies can lead to control failures. We develop a model-free and deep-reinforcement learning (DRL) framework for quantum nonergodicity control. It is a machine-learning method with the unique focus on balancing exploration and exploitation strategies to maximize the cumulative rewards so as to preserve the initial memory in the time-dependent nonergodic metrics over a long stretch of time. We use the paradigmatic one-dimensional tilted Fermi-Hubbard system to demonstrate that the DRL agent can efficiently learn the quantum many-body system solely through the interactions with the environment. The optimal policy obtained by the DRL provides broader control scenarios for managing nonergodicity in the phase diagram as compared to, e.g., the specific protocol for Wannier-Stark localization. The continuous control protocols and observations are experimentally feasible. The model-free nature of DRL and its versatile search space for control functions render promising nonergodicity control in more complex quantum many-body systems.
△ Less
Submitted 21 August, 2024;
originally announced August 2024.
-
Does Current Deepfake Audio Detection Model Effectively Detect ALM-based Deepfake Audio?
Authors:
Yuankun Xie,
Chenxu Xiong,
Xiaopeng Wang,
Zhiyong Wang,
Yi Lu,
Xin Qi,
Ruibo Fu,
Yukun Liu,
Zhengqi Wen,
Jianhua Tao,
Guanjun Li,
Long Ye
Abstract:
Currently, Audio Language Models (ALMs) are rapidly advancing due to the developments in large language models and audio neural codecs. These ALMs have significantly lowered the barrier to creating deepfake audio, generating highly realistic and diverse types of deepfake audio, which pose severe threats to society. Consequently, effective audio deepfake detection technologies to detect ALM-based a…
▽ More
Currently, Audio Language Models (ALMs) are rapidly advancing due to the developments in large language models and audio neural codecs. These ALMs have significantly lowered the barrier to creating deepfake audio, generating highly realistic and diverse types of deepfake audio, which pose severe threats to society. Consequently, effective audio deepfake detection technologies to detect ALM-based audio have become increasingly critical. This paper investigate the effectiveness of current countermeasure (CM) against ALM-based audio. Specifically, we collect 12 types of the latest ALM-based deepfake audio and utilizing the latest CMs to evaluate. Our findings reveal that the latest codec-trained CM can effectively detect ALM-based audio, achieving 0% equal error rate under most ALM test conditions, which exceeded our expectations. This indicates promising directions for future research in ALM-based deepfake audio detection.
△ Less
Submitted 20 August, 2024;
originally announced August 2024.
-
Temporal Variability and Multi-Viewed Self-Supervised Representations to Tackle the ASVspoof5 Deepfake Challenge
Authors:
Yuankun Xie,
Xiaopeng Wang,
Zhiyong Wang,
Ruibo Fu,
Zhengqi Wen,
Haonan Cheng,
Long Ye
Abstract:
ASVspoof5, the fifth edition of the ASVspoof series, is one of the largest global audio security challenges. It aims to advance the development of countermeasure (CM) to discriminate bonafide and spoofed speech utterances. In this paper, we focus on addressing the problem of open-domain audio deepfake detection, which corresponds directly to the ASVspoof5 Track1 open condition. At first, we compre…
▽ More
ASVspoof5, the fifth edition of the ASVspoof series, is one of the largest global audio security challenges. It aims to advance the development of countermeasure (CM) to discriminate bonafide and spoofed speech utterances. In this paper, we focus on addressing the problem of open-domain audio deepfake detection, which corresponds directly to the ASVspoof5 Track1 open condition. At first, we comprehensively investigate various CM on ASVspoof5, including data expansion, data augmentation, and self-supervised learning (SSL) features. Due to the high-frequency gaps characteristic of the ASVspoof5 dataset, we introduce Frequency Mask, a data augmentation method that masks specific frequency bands to improve CM robustness. Combining various scale of temporal information with multiple SSL features, our experiments achieved a minDCF of 0.0158 and an EER of 0.55% on the ASVspoof 5 Track 1 evaluation progress set.
△ Less
Submitted 13 August, 2024;
originally announced August 2024.
-
How to Train the Teacher Model for Effective Knowledge Distillation
Authors:
Shayan Mohajer Hamidi,
Xizhen Deng,
Renhao Tan,
Linfeng Ye,
Ahmed Hussein Salamah
Abstract:
Recently, it was shown that the role of the teacher in knowledge distillation (KD) is to provide the student with an estimate of the true Bayes conditional probability density (BCPD). Notably, the new findings propose that the student's error rate can be upper-bounded by the mean squared error (MSE) between the teacher's output and BCPD. Consequently, to enhance KD efficacy, the teacher should be…
▽ More
Recently, it was shown that the role of the teacher in knowledge distillation (KD) is to provide the student with an estimate of the true Bayes conditional probability density (BCPD). Notably, the new findings propose that the student's error rate can be upper-bounded by the mean squared error (MSE) between the teacher's output and BCPD. Consequently, to enhance KD efficacy, the teacher should be trained such that its output is close to BCPD in MSE sense. This paper elucidates that training the teacher model with MSE loss equates to minimizing the MSE between its output and BCPD, aligning with its core responsibility of providing the student with a BCPD estimate closely resembling it in MSE terms. In this respect, through a comprehensive set of experiments, we demonstrate that substituting the conventional teacher trained with cross-entropy loss with one trained using MSE loss in state-of-the-art KD methods consistently boosts the student's accuracy, resulting in improvements of up to 2.6\%.
△ Less
Submitted 25 July, 2024;
originally announced July 2024.
-
LLaVolta: Efficient Multi-modal Models via Stage-wise Visual Context Compression
Authors:
Jieneng Chen,
Luoxin Ye,
Ju He,
Zhao-Yang Wang,
Daniel Khashabi,
Alan Yuille
Abstract:
While significant advancements have been made in compressed representations for text embeddings in large language models (LLMs), the compression of visual tokens in large multi-modal models (LMMs) has remained a largely overlooked area. In this work, we present the study on the analysis of redundancy concerning visual tokens and efficient training within these models. Our initial experiments show…
▽ More
While significant advancements have been made in compressed representations for text embeddings in large language models (LLMs), the compression of visual tokens in large multi-modal models (LMMs) has remained a largely overlooked area. In this work, we present the study on the analysis of redundancy concerning visual tokens and efficient training within these models. Our initial experiments show that eliminating up to 70% of visual tokens at the testing stage by simply average pooling only leads to a minimal 3% reduction in visual question answering accuracy on the GQA benchmark, indicating significant redundancy in visual context. Addressing this, we introduce Visual Context Compressor, which reduces the number of visual tokens during training to enhance training efficiency without sacrificing performance. To minimize information loss caused by the compression on visual tokens while maintaining training efficiency, we develop LLaVolta as a lite training scheme. LLaVolta incorporates stage-wise visual context compression to progressively compress the visual tokens from heavily to lightly, and finally no compression at the end of training, yielding no loss of information when testing. Extensive experiments demonstrate that our approach enhances the performance of MLLMs in both image-language and video-language understanding, while also significantly cutting training costs. Code is available at https://github.com/Beckschen/LLaVolta
△ Less
Submitted 28 June, 2024;
originally announced June 2024.
-
Einstein-Podolsky-Rosen Steering Criterion and Monogamy Relation via Correlation Matrices in Tripartite Systems
Authors:
Li-Juan Li,
Xiao-Gang Fan,
Xue-Ke Song,
Liu Ye,
Dong Wang
Abstract:
Quantum steering is considered as one of the most well-known nonlocal phenomena in quantum mechanics. Unlike entanglement and Bell non-locality, the asymmetry of quantum steering makes it vital for one-sided device-independent quantum information processing. Although there has been much progress on steering detection for bipartite systems, the criterion for EPR steering in tripartite systems remai…
▽ More
Quantum steering is considered as one of the most well-known nonlocal phenomena in quantum mechanics. Unlike entanglement and Bell non-locality, the asymmetry of quantum steering makes it vital for one-sided device-independent quantum information processing. Although there has been much progress on steering detection for bipartite systems, the criterion for EPR steering in tripartite systems remains challenging and inadequate. In this paper, we firstly derive a novel and promising steering criterion for any three-qubit states via correlation matrix. Furthermore, we propose the monogamy relation between the tripartite steering of system and the bipartite steering of subsystems based on the derived criterion. Finally, as illustrations, we demonstrate the performance of the steering criterion and the monogamy relation by means of several representative examples. We believe that the results and methods presented in this work could be beneficial to capture genuine multipartite steering in the near future.
△ Less
Submitted 10 July, 2024; v1 submitted 19 June, 2024;
originally announced June 2024.
-
OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI
Authors:
Zhen Huang,
Zengzhi Wang,
Shijie Xia,
Xuefeng Li,
Haoyang Zou,
Ruijie Xu,
Run-Ze Fan,
Lyumanshan Ye,
Ethan Chern,
Yixin Ye,
Yikai Zhang,
Yuqing Yang,
Ting Wu,
Binjie Wang,
Shichao Sun,
Yang Xiao,
Yiyuan Li,
Fan Zhou,
Steffi Chern,
Yiwei Qin,
Yan Ma,
Jiadi Su,
Yixiu Liu,
Yuxiang Zheng,
Shaoting Zhang
, et al. (3 additional authors not shown)
Abstract:
The evolution of Artificial Intelligence (AI) has been significantly accelerated by advancements in Large Language Models (LLMs) and Large Multimodal Models (LMMs), gradually showcasing potential cognitive reasoning abilities in problem-solving and scientific discovery (i.e., AI4Science) once exclusive to human intellect. To comprehensively evaluate current models' performance in cognitive reasoni…
▽ More
The evolution of Artificial Intelligence (AI) has been significantly accelerated by advancements in Large Language Models (LLMs) and Large Multimodal Models (LMMs), gradually showcasing potential cognitive reasoning abilities in problem-solving and scientific discovery (i.e., AI4Science) once exclusive to human intellect. To comprehensively evaluate current models' performance in cognitive reasoning abilities, we introduce OlympicArena, which includes 11,163 bilingual problems across both text-only and interleaved text-image modalities. These challenges encompass a wide range of disciplines spanning seven fields and 62 international Olympic competitions, rigorously examined for data leakage. We argue that the challenges in Olympic competition problems are ideal for evaluating AI's cognitive reasoning due to their complexity and interdisciplinary nature, which are essential for tackling complex scientific challenges and facilitating discoveries. Beyond evaluating performance across various disciplines using answer-only criteria, we conduct detailed experiments and analyses from multiple perspectives. We delve into the models' cognitive reasoning abilities, their performance across different modalities, and their outcomes in process-level evaluations, which are vital for tasks requiring complex reasoning with lengthy solutions. Our extensive evaluations reveal that even advanced models like GPT-4o only achieve a 39.97% overall accuracy, illustrating current AI limitations in complex reasoning and multimodal integration. Through the OlympicArena, we aim to advance AI towards superintelligence, equipping it to address more complex challenges in science and beyond. We also provide a comprehensive set of resources to support AI research, including a benchmark dataset, an open-source annotation platform, a detailed evaluation tool, and a leaderboard with automatic submission features.
△ Less
Submitted 18 June, 2024;
originally announced June 2024.
-
Nonlinear saturation of reversed shear Alfven eigenmode via high-frequency quasi-mode generation
Authors:
Zhiwen Cheng,
Guangyu Wei,
Lei Ye,
Zhiyong Qiu
Abstract:
A nonlinear saturation mechanism for reversed shear Alfven eigenmode (RSAE) is proposed and analysed, and is shown to be of relevance to typical reactor parameter region. The saturation is achieved through the generation of high-frequency quasi-mode due to nonlinear coupling of two RSAEs, which is then damped due to coupling with the shear Alfven continuum, and leads to the nonlinear saturation of…
▽ More
A nonlinear saturation mechanism for reversed shear Alfven eigenmode (RSAE) is proposed and analysed, and is shown to be of relevance to typical reactor parameter region. The saturation is achieved through the generation of high-frequency quasi-mode due to nonlinear coupling of two RSAEs, which is then damped due to coupling with the shear Alfven continuum, and leads to the nonlinear saturation of the primary RSAEs . An estimation of the nonlinear damping rate is also provided.
△ Less
Submitted 9 June, 2024;
originally announced June 2024.
-
Error analysis of vertical test for CEPC 650 MHz superconducting radio-frequency cavity
Authors:
Lingxi Ye,
Peng Sha,
Zhenghui Mi,
Feisi He,
Jiyuan Zhai
Abstract:
Hundreds of 650 MHz superconducting radio-frequency (SRF) cavities with high intrinsic quality factor (Q0) and accelerating gradient (Eacc) will be adopted for Circular Electron Positron Collider (CEPC). The values of Q0 and Eacc are obtained during vertical test at 2.0 K. Hence, high accuracy of vertical test is essential for evaluating the performance of SRF cavity. The 650 MHz SRF cavities achi…
▽ More
Hundreds of 650 MHz superconducting radio-frequency (SRF) cavities with high intrinsic quality factor (Q0) and accelerating gradient (Eacc) will be adopted for Circular Electron Positron Collider (CEPC). The values of Q0 and Eacc are obtained during vertical test at 2.0 K. Hence, high accuracy of vertical test is essential for evaluating the performance of SRF cavity. The 650 MHz SRF cavities achieved very high Q0 (6E10) and Eacc (40 MV/m) during the vertical test. In our study, the error analysis of vertical test was conducted in the scalar case, in order to achieve high accuracy. The uncertainties of vertical test were obtained through calculation, which was approximately 3% for Eacc and less than 5% for Q0. This result was reasonable and acceptable.
△ Less
Submitted 9 June, 2024;
originally announced June 2024.
-
Entanglement engineering of optomechanical systems by reinforcement learning
Authors:
Li-Li Ye,
Christian Arenz,
Joseph M. Lukens,
Ying-Cheng Lai
Abstract:
Entanglement is fundamental to quantum information science and technology, yet controlling and manipulating entanglement -- so-called entanglement engineering -- for arbitrary quantum systems remains a formidable challenge. There are two difficulties: the fragility of quantum entanglement and its experimental characterization. We develop a model-free deep reinforcement-learning (RL) approach to en…
▽ More
Entanglement is fundamental to quantum information science and technology, yet controlling and manipulating entanglement -- so-called entanglement engineering -- for arbitrary quantum systems remains a formidable challenge. There are two difficulties: the fragility of quantum entanglement and its experimental characterization. We develop a model-free deep reinforcement-learning (RL) approach to entanglement engineering, in which feedback control together with weak continuous measurement and partial state observation is exploited to generate and maintain desired entanglement. We employ quantum optomechanical systems with linear or nonlinear photon-phonon interactions to demonstrate the workings of our machine-learning-based entanglement engineering protocol. In particular, the RL agent sequentially interacts with one or multiple parallel quantum optomechanical environments, collects trajectories, and updates the policy to maximize the accumulated reward to create and stabilize quantum entanglement over an arbitrary amount of time. The machine-learning-based model-free control principle is applicable to the entanglement engineering of experimental quantum systems in general.
△ Less
Submitted 2 July, 2024; v1 submitted 6 June, 2024;
originally announced June 2024.
-
Generalized Source Tracing: Detecting Novel Audio Deepfake Algorithm with Real Emphasis and Fake Dispersion Strategy
Authors:
Yuankun Xie,
Ruibo Fu,
Zhengqi Wen,
Zhiyong Wang,
Xiaopeng Wang,
Haonnan Cheng,
Long Ye,
Jianhua Tao
Abstract:
With the proliferation of deepfake audio, there is an urgent need to investigate their attribution. Current source tracing methods can effectively distinguish in-distribution (ID) categories. However, the rapid evolution of deepfake algorithms poses a critical challenge in the accurate identification of out-of-distribution (OOD) novel deepfake algorithms. In this paper, we propose Real Emphasis an…
▽ More
With the proliferation of deepfake audio, there is an urgent need to investigate their attribution. Current source tracing methods can effectively distinguish in-distribution (ID) categories. However, the rapid evolution of deepfake algorithms poses a critical challenge in the accurate identification of out-of-distribution (OOD) novel deepfake algorithms. In this paper, we propose Real Emphasis and Fake Dispersion (REFD) strategy for audio deepfake algorithm recognition, demonstrating its effectiveness in discriminating ID samples while identifying OOD samples. For effective OOD detection, we first explore current post-hoc OOD methods and propose NSD, a novel OOD approach in identifying novel deepfake algorithms through the similarity consideration of both feature and logits scores. REFD achieves 86.83% F1-score as a single system in Audio Deepfake Detection Challenge 2023 Track3, showcasing its state-of-the-art performance.
△ Less
Submitted 8 June, 2024; v1 submitted 5 June, 2024;
originally announced June 2024.
-
Metamagnetic multiband Hall effect in Ising antiferromagnet ErGa$_2$
Authors:
Takashi Kurumaji,
Shiang Fang,
Linda Ye,
Shunsuke Kitou,
Joseph G. Checkelsky
Abstract:
Frustrated rare-earth-based intermetallics provide a promising platform for emergent magnetotransport properties through exchange coupling between conduction electrons and localized rare-earth magnetic moments. Metamagnetism, the abrupt change of magnetization under an external magnetic field, is a signature of first-order magnetic phase transitions; recently, metamagnetic transitions in frustrate…
▽ More
Frustrated rare-earth-based intermetallics provide a promising platform for emergent magnetotransport properties through exchange coupling between conduction electrons and localized rare-earth magnetic moments. Metamagnetism, the abrupt change of magnetization under an external magnetic field, is a signature of first-order magnetic phase transitions; recently, metamagnetic transitions in frustrated rare earths intermetallics have attracted interest for their accompanying nontrivial spin structures (e.g. skyrmions) and associated non-linear and topological Hall effects. Here, we present metamagnetism-induced Hall anomalies in single-crystalline ErGa$_2$, which recalls features arising from the topological Hall effect but wherein the strong Ising type anisotropy of Er moments prohibit noncoplanar spin structures. We show that the observed anomalies are neither due to anomalous Hall effect nor topological Hall effect, instead, can be accounted for via 4f-5d interactions which produce a band-dependent mobility modulation. This leads to a pronounced multiband Hall response across the magnetization process -- a metamagnetic multiband Hall effect that resembles a topological-Hall-like response but without nontrivial origins. The present findings may be of general relevance in itinerant metamagnetic systems regardless of coplanar/non-coplanar nature of spins and are important for the accurate identification of Hall signals due to emergent magnetic fields.
△ Less
Submitted 28 May, 2024;
originally announced May 2024.
-
Adversarial Training via Adaptive Knowledge Amalgamation of an Ensemble of Teachers
Authors:
Shayan Mohajer Hamidi,
Linfeng Ye
Abstract:
Adversarial training (AT) is a popular method for training robust deep neural networks (DNNs) against adversarial attacks. Yet, AT suffers from two shortcomings: (i) the robustness of DNNs trained by AT is highly intertwined with the size of the DNNs, posing challenges in achieving robustness in smaller models; and (ii) the adversarial samples employed during the AT process exhibit poor generaliza…
▽ More
Adversarial training (AT) is a popular method for training robust deep neural networks (DNNs) against adversarial attacks. Yet, AT suffers from two shortcomings: (i) the robustness of DNNs trained by AT is highly intertwined with the size of the DNNs, posing challenges in achieving robustness in smaller models; and (ii) the adversarial samples employed during the AT process exhibit poor generalization, leaving DNNs vulnerable to unforeseen attack types. To address these dual challenges, this paper introduces adversarial training via adaptive knowledge amalgamation of an ensemble of teachers (AT-AKA). In particular, we generate a diverse set of adversarial samples as the inputs to an ensemble of teachers; and then, we adaptively amalgamate the logtis of these teachers to train a generalized-robust student. Through comprehensive experiments, we illustrate the superior efficacy of AT-AKA over existing AT methods and adversarial robustness distillation techniques against cutting-edge attacks, including AutoAttack.
△ Less
Submitted 21 May, 2024;
originally announced May 2024.
-
Enhancing Interaction Modeling with Agent Selection and Physical Methods for Trajectory Prediction
Authors:
Shiji Huang,
Lei Ye,
Min Chen,
Wenhai Luo,
Chenqi Xu,
Deyuan Liang,
Dihong Wang
Abstract:
In this study, we address the limitations inherent in most existing vehicle trajectory prediction methodologies that indiscriminately incorporate all agents within a predetermined proximity when accounting for inter-agent interactions. These approaches commonly employ attention-based architecture or graph neural networks for encoding interactions, which introduces three challenges: (i) The indiscr…
▽ More
In this study, we address the limitations inherent in most existing vehicle trajectory prediction methodologies that indiscriminately incorporate all agents within a predetermined proximity when accounting for inter-agent interactions. These approaches commonly employ attention-based architecture or graph neural networks for encoding interactions, which introduces three challenges: (i) The indiscriminate selection of all nearby agents substantially escalates the computational demands of the model, particularly in those interaction-rich scenarios. (ii) Moreover, the simplistic feature extraction of current time agents falls short of adequately capturing the nuanced dynamics of interactions. (iii) Compounded by the inherently low interpretability of attention mechanism and graph neural networks, there is a propensity for the model to allocate unreliable correlation coefficients to certain agents, adversely impacting the accuracy of trajectory predictions. To mitigate these issues, we introduce ASPILin, a novel approach that enhances the selection of interacting agents by considering their current and future lanes, extending this consideration across all historical frames. Utilizing the states of the agents, we estimate the nearest future distance between agents and the time needed to reach this distance. Then, combine these with their current distances to derive a physical correlation coefficient to encode interactions. Experiments conducted on popular trajectory prediction datasets demonstrate that our method is efficient and straightforward, outperforming other state-of-the-art methods.
△ Less
Submitted 21 May, 2024;
originally announced May 2024.
-
Evaluating extractable work of quantum batteries via entropic uncertainty relations
Authors:
Meng-Long Song,
Xue-Ke Song,
Liu Ye,
Dong Wang
Abstract:
In this study, we investigate the effectiveness of entropic uncertainty relations (EURs) in discerning the energy variation in quantum batteries (QBs) modelled by battery-charger-field in the presence of bosonic and fermionic reservoirs. Our results suggest that the extractable works (exergy and ergotropy) have versatile characteristics in different scenarios, resulting in a complex relationship b…
▽ More
In this study, we investigate the effectiveness of entropic uncertainty relations (EURs) in discerning the energy variation in quantum batteries (QBs) modelled by battery-charger-field in the presence of bosonic and fermionic reservoirs. Our results suggest that the extractable works (exergy and ergotropy) have versatile characteristics in different scenarios, resulting in a complex relationship between tightness and extractable work. It is worth noting that the tightness of the lower bound of entropic uncertainty can be a good indicator for energy conversion efficiency in charging QBs. Furthermore, we disclose how the EUR including uncertainty and lower bound contributes to energy conversion efficiency in the QB system. It is believed that these findings will be beneficial for better understanding the role of quantum uncertainty in evaluating quantum battery performance.
△ Less
Submitted 4 June, 2024; v1 submitted 12 May, 2024;
originally announced May 2024.
-
Storypark: Leveraging Large Language Models to Enhance Children Story Learning Through Child-AI collaboration Storytelling
Authors:
Lyumanshan Ye,
Jiandong Jiang,
Danni Chang,
Pengfei Liu
Abstract:
Interactive storytelling has been widely adopted by educators in teaching activities of young children. Such a teaching method combines storytelling with active child participation, benefiting their expressive abilities, creative thinking, and understanding of stories. Interactive storytelling requires facilitators to unidirectionally narrate the story content and encourage children's participatio…
▽ More
Interactive storytelling has been widely adopted by educators in teaching activities of young children. Such a teaching method combines storytelling with active child participation, benefiting their expressive abilities, creative thinking, and understanding of stories. Interactive storytelling requires facilitators to unidirectionally narrate the story content and encourage children's participation in story plot creation and interpretation of central themes through multi-sensory interactive methods such as questioning and drawing. However, providing tailored guidance based on diverse feedback from children during interactive storytelling poses challenges for most facilitators. These challenges include expanding story plot development based on children's ideas, using drawings to visualize children's thoughts, and interpreting the story's central themes based on children's thinking. This necessitates facilitators to possess strong imaginative, associative, domain knowledge, and drawing skills. Large language models have demonstrated their potential in facilitating responsive and participatory dialogues, offering new design possibilities to address the challenges faced by facilitators in interactive storytelling. In this study, our goal is to leverage large language models to design an interactive storytelling system that provides children with plot frameworks and interpretations of central themes during the interactive storytelling process. Through user experiments involving 20 child participants, we evaluate this interactive system's usability, learning effectiveness, and user experience. The user study shows that Storypark improves learning outcomes in understanding story key ideas, generalization, and transfer. And high engagement and willingness to use of participants demonstrate that StoryPark provides children with a positive learning experience.
△ Less
Submitted 13 May, 2024; v1 submitted 10 May, 2024;
originally announced May 2024.
-
Deep-learning design of graphene metasurfaces for quantum control and Dirac electron holography
Authors:
Chen-Di Han,
Li-Li Ye,
Zin Lin,
Vassilios Kovanis,
Ying-Cheng Lai
Abstract:
Metasurfaces are sub-wavelength patterned layers for controlling waves in physical systems. In optics, meta-surfaces are created by materials with different dielectric constants and are capable of unconventional functionalities. We develop a deep-learning framework for Dirac-material metasurface design for controlling electronic waves. The metasurface is a configuration of circular graphene quantu…
▽ More
Metasurfaces are sub-wavelength patterned layers for controlling waves in physical systems. In optics, meta-surfaces are created by materials with different dielectric constants and are capable of unconventional functionalities. We develop a deep-learning framework for Dirac-material metasurface design for controlling electronic waves. The metasurface is a configuration of circular graphene quantum dots, each created by an electric potential. Employing deep convolutional neural networks, we show that the original scattering wave can be reconstructed with fidelity over 95$\%$, suggesting the feasibility of Dirac electron holography. Additional applications such as plane wave generation, designing broadband, and multi-functionality graphene metasurface systems are illustrated.
△ Less
Submitted 1 May, 2024;
originally announced May 2024.
-
The Codecfake Dataset and Countermeasures for the Universally Detection of Deepfake Audio
Authors:
Yuankun Xie,
Yi Lu,
Ruibo Fu,
Zhengqi Wen,
Zhiyong Wang,
Jianhua Tao,
Xin Qi,
Xiaopeng Wang,
Yukun Liu,
Haonan Cheng,
Long Ye,
Yi Sun
Abstract:
With the proliferation of Audio Language Model (ALM) based deepfake audio, there is an urgent need for generalized detection methods. ALM-based deepfake audio currently exhibits widespread, high deception, and type versatility, posing a significant challenge to current audio deepfake detection (ADD) models trained solely on vocoded data. To effectively detect ALM-based deepfake audio, we focus on…
▽ More
With the proliferation of Audio Language Model (ALM) based deepfake audio, there is an urgent need for generalized detection methods. ALM-based deepfake audio currently exhibits widespread, high deception, and type versatility, posing a significant challenge to current audio deepfake detection (ADD) models trained solely on vocoded data. To effectively detect ALM-based deepfake audio, we focus on the mechanism of the ALM-based audio generation method, the conversion from neural codec to waveform. We initially construct the Codecfake dataset, an open-source large-scale dataset, including 2 languages, over 1M audio samples, and various test conditions, focus on ALM-based audio detection. As countermeasure, to achieve universal detection of deepfake audio and tackle domain ascent bias issue of original SAM, we propose the CSAM strategy to learn a domain balanced and generalized minima. In our experiments, we first demonstrate that ADD model training with the Codecfake dataset can effectively detects ALM-based audio. Furthermore, our proposed generalization countermeasure yields the lowest average Equal Error Rate (EER) of 0.616% across all test conditions compared to baseline models. The dataset and associated code are available online.
△ Less
Submitted 15 May, 2024; v1 submitted 8 May, 2024;
originally announced May 2024.
-
Quadruped robot traversing 3D complex environments with limited perception
Authors:
Yi Cheng,
Hang Liu,
Guoping Pan,
Linqi Ye,
Houde Liu,
Bin Liang
Abstract:
Traversing 3-D complex environments has always been a significant challenge for legged locomotion. Existing methods typically rely on external sensors such as vision and lidar to preemptively react to obstacles by acquiring environmental information. However, in scenarios like nighttime or dense forests, external sensors often fail to function properly, necessitating robots to rely on propriocepti…
▽ More
Traversing 3-D complex environments has always been a significant challenge for legged locomotion. Existing methods typically rely on external sensors such as vision and lidar to preemptively react to obstacles by acquiring environmental information. However, in scenarios like nighttime or dense forests, external sensors often fail to function properly, necessitating robots to rely on proprioceptive sensors to perceive diverse obstacles in the environment and respond promptly. This task is undeniably challenging. Our research finds that methods based on collision detection can enhance a robot's perception of environmental obstacles. In this work, we propose an end-to-end learning-based quadruped robot motion controller that relies solely on proprioceptive sensing. This controller can accurately detect, localize, and agilely respond to collisions in unknown and complex 3D environments, thereby improving the robot's traversability in complex environments. We demonstrate in both simulation and real-world experiments that our method enables quadruped robots to successfully traverse challenging obstacles in various complex environments.
△ Less
Submitted 14 July, 2024; v1 submitted 28 April, 2024;
originally announced April 2024.
-
Agile and versatile bipedal robot tracking control through reinforcement learning
Authors:
Jiayi Li,
Linqi Ye,
Yi Cheng,
Houde Liu,
Bin Liang
Abstract:
The remarkable athletic intelligence displayed by humans in complex dynamic movements such as dancing and gymnastics suggests that the balance mechanism in biological beings is decoupled from specific movement patterns. This decoupling allows for the execution of both learned and unlearned movements under certain constraints while maintaining balance through minor whole-body coordination. To repli…
▽ More
The remarkable athletic intelligence displayed by humans in complex dynamic movements such as dancing and gymnastics suggests that the balance mechanism in biological beings is decoupled from specific movement patterns. This decoupling allows for the execution of both learned and unlearned movements under certain constraints while maintaining balance through minor whole-body coordination. To replicate this balance ability and body agility, this paper proposes a versatile controller for bipedal robots. This controller achieves ankle and body trajectory tracking across a wide range of gaits using a single small-scale neural network, which is based on a model-based IK solver and reinforcement learning. We consider a single step as the smallest control unit and design a universally applicable control input form suitable for any single-step variation. Highly flexible gait control can be achieved by combining these minimal control units with high-level policy through our extensible control interface. To enhance the trajectory-tracking capability of our controller, we utilize a three-stage training curriculum. After training, the robot can move freely between target footholds at varying distances and heights. The robot can also maintain static balance without repeated stepping to adjust posture. Finally, we evaluate the tracking accuracy of our controller on various bipedal tasks, and the effectiveness of our control framework is verified in the simulation environment.
△ Less
Submitted 12 April, 2024;
originally announced April 2024.
-
Quantum Generative Adversarial Networks in a Silicon Photonic Chip with Maximum Expressibility
Authors:
Haoran Ma,
Liao Ye,
Fanjie Ruan,
Zichao Zhao,
Maohui Li,
Yuehai Wang,
Jianyi Yang
Abstract:
Generative adversarial networks (GANs) have achieved remarkable success with realistic tasks such as creating realistic images, texts, and audio. Combining GANs and quantum computing, quantum GANs are thought to have an exponential advantage over their classical counterparts due to the stronger expressibility of quantum circuits. In this research, a two-qubit silicon quantum photonic chip is creat…
▽ More
Generative adversarial networks (GANs) have achieved remarkable success with realistic tasks such as creating realistic images, texts, and audio. Combining GANs and quantum computing, quantum GANs are thought to have an exponential advantage over their classical counterparts due to the stronger expressibility of quantum circuits. In this research, a two-qubit silicon quantum photonic chip is created, capable of executing arbitrary controlled-unitary (CU) operations and generating any 2-qubit pure state, thus making it an excellent platform for quantum GANs. To capture complex data patterns, a hybrid generator is proposed to inject nonlinearity into quantum GANs. As a demonstration, three generative tasks, covering both pure quantum versions of GANs (PQ-GAN) and hybrid quantum-classical GANs (HQC-GANs), are successfully carried out on the chip, including high-fidelity single-qubit state learning, classical distributions loading, and compressed image production. The experiment results prove that silicon quantum photonic chips have great potential in generative learning applications.
△ Less
Submitted 8 April, 2024;
originally announced April 2024.
-
Valley edge states as bound states in the continuum
Authors:
Shunda Yin,
Liping Ye,
Hailong He,
Xueqin Huang,
Manzhu Ke,
Weiyin Deng,
Jiuyang Lu,
Zhengyou Liu
Abstract:
Bound states in the continuum (BICs) are spatially localized states with energy embedded in the continuum spectrum of extended states. The combination of BICs physics and nontrivial band topology theory giving rise to topological BICs, which are robust against disorders and meanwhile of the merit of conventional BICs, is attracting wide attention recently. Here, we report valley edge states as top…
▽ More
Bound states in the continuum (BICs) are spatially localized states with energy embedded in the continuum spectrum of extended states. The combination of BICs physics and nontrivial band topology theory giving rise to topological BICs, which are robust against disorders and meanwhile of the merit of conventional BICs, is attracting wide attention recently. Here, we report valley edge states as topological BICs, which appear at domain wall between two distinct valley topological phases. The robustness of such BICs is demonstrated. The simulations and experiments show great agreement. Our findings of valley related topological BICs shed light on both BICs and valley physics, and may foster innovative applications of topological acoustic devices.
△ Less
Submitted 8 April, 2024;
originally announced April 2024.
-
Boosting Conversational Question Answering with Fine-Grained Retrieval-Augmentation and Self-Check
Authors:
Linhao Ye,
Zhikai Lei,
Jianghao Yin,
Qin Chen,
Jie Zhou,
Liang He
Abstract:
Retrieval-Augmented Generation (RAG) aims to generate more reliable and accurate responses, by augmenting large language models (LLMs) with the external vast and dynamic knowledge. Most previous work focuses on using RAG for single-round question answering, while how to adapt RAG to the complex conversational setting wherein the question is interdependent on the preceding context is not well studi…
▽ More
Retrieval-Augmented Generation (RAG) aims to generate more reliable and accurate responses, by augmenting large language models (LLMs) with the external vast and dynamic knowledge. Most previous work focuses on using RAG for single-round question answering, while how to adapt RAG to the complex conversational setting wherein the question is interdependent on the preceding context is not well studied. In this paper, we propose a conversation-level RAG approach, which incorporates fine-grained retrieval augmentation and self-check for conversational question answering (CQA). In particular, our approach consists of three components, namely conversational question refiner, fine-grained retriever and self-check based response generator, which work collaboratively for question understanding and relevant information acquisition in conversational settings. Extensive experiments demonstrate the great advantages of our approach over the state-of-the-art baselines. Moreover, we also release a Chinese CQA dataset with new features including reformulated question, extracted keyword, retrieved paragraphs and their helpfulness, which facilitates further researches in RAG enhanced CQA.
△ Less
Submitted 27 March, 2024;
originally announced March 2024.
-
FedSR: A Semi-Decentralized Federated Learning Algorithm for Non-IIDness in IoT System
Authors:
Jianjun Huang,
Lixin Ye,
Li Kang
Abstract:
In the Industrial Internet of Things (IoT), a large amount of data will be generated every day. Due to privacy and security issues, it is difficult to collect all these data together to train deep learning models, thus the federated learning, a distributed machine learning paradigm that protects data privacy, has been widely used in IoT. However, in practical federated learning, the data distribut…
▽ More
In the Industrial Internet of Things (IoT), a large amount of data will be generated every day. Due to privacy and security issues, it is difficult to collect all these data together to train deep learning models, thus the federated learning, a distributed machine learning paradigm that protects data privacy, has been widely used in IoT. However, in practical federated learning, the data distributions usually have large differences across devices, and the heterogeneity of data will deteriorate the performance of the model. Moreover, federated learning in IoT usually has a large number of devices involved in training, and the limited communication resource of cloud servers become a bottleneck for training. To address the above issues, in this paper, we combine centralized federated learning with decentralized federated learning to design a semi-decentralized cloud-edge-device hierarchical federated learning framework, which can mitigate the impact of data heterogeneity, and can be deployed at lage scale in IoT. To address the effect of data heterogeneity, we use an incremental subgradient optimization algorithm in each ring cluster to improve the generalization ability of the ring cluster models. Our extensive experiments show that our approach can effectively mitigate the impact of data heterogeneity and alleviate the communication bottleneck in cloud servers.
△ Less
Submitted 19 March, 2024;
originally announced March 2024.
-
Quantum coherence and entanglement under the influence of decoherence
Authors:
Wen-Yang Sun,
A-Min Ding,
Juan He,
Jiadong Shi,
Le Wang,
Hui-Fang Xu,
Dong Wang,
Liu Ye
Abstract:
In this work, we delve into the dynamic traits of the relative entropy of quantum coherence (REQC) as the quantum system interacts with the different noisy channels, drawing comparisons with entanglement (concurrence). The research results demonstrate the broader prevalence and stronger robustness of the REQC as opposed to concurrence. It's worth noting that the bit flip channel cannot uphold a co…
▽ More
In this work, we delve into the dynamic traits of the relative entropy of quantum coherence (REQC) as the quantum system interacts with the different noisy channels, drawing comparisons with entanglement (concurrence). The research results demonstrate the broader prevalence and stronger robustness of the REQC as opposed to concurrence. It's worth noting that the bit flip channel cannot uphold a constant nonzero frozen the REQC, besides, the concurrence follows a pattern of temporary reduction to zero, followed by recovery after a certain time span. More importantly, the REQC maintains its presence consistently until reaching a critical threshold, whereas concurrence experiences completely attenuation to zero under the influence of phase damping and amplitude damping channels.
△ Less
Submitted 29 February, 2024;
originally announced February 2024.
-
Elastocaloric evidence for a multicomponent superconductor stabilized within the nematic state in Ba(Fe$_{1-x}$Co$_x$)$_2$As$_2$
Authors:
Sayak Ghosh,
Matthias S. Ikeda,
Anzumaan R. Chakraborty,
Thanapat Worasaran,
Florian Theuss,
Luciano B. Peralta,
P. M. Lozano,
Jong-Woo Kim,
Philip J. Ryan,
Linda Ye,
Aharon Kapitulnik,
Steven A. Kivelson,
B. J. Ramshaw,
Rafael M. Fernandes,
Ian R. Fisher
Abstract:
The iron-based high-$T_c$ superconductors exhibit rich phase diagrams with intertwined phases, including magnetism, nematicity and superconductivity. The superconducting $T_c$ in many of these materials is maximized in the regime of strong nematic fluctuations, making the role of nematicity in influencing the superconductivity a topic of intense research. Here, we use the AC elastocaloric effect (…
▽ More
The iron-based high-$T_c$ superconductors exhibit rich phase diagrams with intertwined phases, including magnetism, nematicity and superconductivity. The superconducting $T_c$ in many of these materials is maximized in the regime of strong nematic fluctuations, making the role of nematicity in influencing the superconductivity a topic of intense research. Here, we use the AC elastocaloric effect (ECE) to map out the phase diagram of Ba(Fe$_{1-x}$Co$_x$)$_2$As$_2$ near optimal doping. The ECE signature at $T_c$ on the overdoped side, where superconductivity condenses without any nematic order, is quantitatively consistent with other thermodynamic probes that indicate a single-component superconducting state. In contrast, on the slightly underdoped side, where superconductivity condenses within the nematic phase, ECE reveals a second thermodynamic transition proximate to and below $T_c$. We rule out magnetism and re-entrant tetragonality as the origin of this transition, and find that our observations strongly suggest a phase transition into a multicomponent superconducting state. This implies the existence of a sub-dominant pairing instability that competes strongly with the dominant $s^\pm$ instability. Our results thus motivate a re-examination of the pairing state and its interplay with nematicity in this extensively studied iron-based superconductor, while also demonstrating the power of ECE in uncovering strain-tuned phase diagrams of quantum materials.
△ Less
Submitted 27 February, 2024;
originally announced February 2024.
-
Disorder-induced local strain distribution in Y-substituted TmVO4
Authors:
Yuntian Li,
Mark P. Zic,
Linda Ye,
W. Joe Meese,
Pierre Massat,
Yanbing Zhu,
Rafael M. Fernandes,
Ian R. Fisher
Abstract:
We report an investigation of the effect of substitution of Y for Tm in $Tm_{1-x}Y_xVO4$ via low-temperature heat capacity measurements, with the yttrium content $x$ varying from $0$ to $0.997$. Because the Tm ions support a local quadrupolar (nematic) moment, they act as reporters of the local strain state in the material, with the splitting of the ion's non-Kramers crystal field groundstate prop…
▽ More
We report an investigation of the effect of substitution of Y for Tm in $Tm_{1-x}Y_xVO4$ via low-temperature heat capacity measurements, with the yttrium content $x$ varying from $0$ to $0.997$. Because the Tm ions support a local quadrupolar (nematic) moment, they act as reporters of the local strain state in the material, with the splitting of the ion's non-Kramers crystal field groundstate proportional to the quadrature sum of the in-plane tetragonal symmetry-breaking transverse and longitudinal strains experienced by each ion individually. Analysis of the heat capacity therefore provides detailed insights into the distribution of local strains that arise as a consequence of the chemical substitution. These local strains suppress long-range quadrupole order for $x>0.22$, and result in a broad Schottky-like feature for higher concentrations. Heat capacity data are compared to expectations for a distribution of uncorrelated (random) strains. For dilute Tm concentrations, the heat capacity cannot be accounted for by randomly distributed strains, demonstrating the presence of significant strain correlations between sites. For intermediate Tm concentrations, these correlations must still exist, but the data cannot be distinguished from that which would be obtained from a 2D Gaussian distribution. The cross-over between these limits is discussed in terms of the interplay of key length scales in the substituted material. The central result of this work, that local strains arising from chemical substitution are not uncorrelated, has implications for the range of validity of theoretical models based on random effective fields that are used to describe such chemically substituted materials, particularly when electronic nematic correlations are present.
△ Less
Submitted 26 February, 2024;
originally announced February 2024.
-
An experimental scheme for determining the Berry phase in two-dimensional quantum materials with a flat band
Authors:
Li-Li Ye,
Cheng-Zhen Wang,
Ying-Cheng Lai
Abstract:
Experimentally feasible methods to determine the Berry phase, a fundamental quantity characterizing a quantum material, are often needed in applications. We develop an approach to detecting the Berry phase by using a class of two-dimensional (2D) Dirac materials with a flat band, the $α$-$\mathcal{T}_3$ lattices. The properties of this class of quantum materials are controlled by a single paramete…
▽ More
Experimentally feasible methods to determine the Berry phase, a fundamental quantity characterizing a quantum material, are often needed in applications. We develop an approach to detecting the Berry phase by using a class of two-dimensional (2D) Dirac materials with a flat band, the $α$-$\mathcal{T}_3$ lattices. The properties of this class of quantum materials are controlled by a single parameter $0 \le α\le 1$, where the left and right endpoints correspond to graphene with pseudospin-1/2 and the dice lattice with pseudospin-1 Dirac-Weyl quasiparticles, respectively, and each specific value of $α$ represents a material with a unique Berry phase. Applying a constant electric field to the $α$-$\mathcal{T}_3$ lattice, we calculate the resulting electric current and find a one-to-one correspondence between the current and the Berry phase in both the linear and nonlinear response regimes. In the linear (Kubo) regime, the main physics is the Zitterbewegung effect. In the nonlinear regime, the Schwinger mechanism dominates. Beyond the nonlinear regime, Bloch-Zener oscillations can arise. Measuring the current thus provides an effective and experimentally feasible way to determine the Berry phase for this spectrum of 2D quantum materials.
△ Less
Submitted 21 August, 2024; v1 submitted 23 February, 2024;
originally announced February 2024.
-
ChunkAttention: Efficient Self-Attention with Prefix-Aware KV Cache and Two-Phase Partition
Authors:
Lu Ye,
Ze Tao,
Yong Huang,
Yang Li
Abstract:
Self-attention is an essential component of large language models (LLM) but a significant source of inference latency for long sequences. In multi-tenant LLM serving scenarios, the compute and memory operation cost of self-attention can be optimized by using the probability that multiple LLM requests have shared system prompts in prefixes. In this paper, we introduce ChunkAttention, a prefix-aware…
▽ More
Self-attention is an essential component of large language models (LLM) but a significant source of inference latency for long sequences. In multi-tenant LLM serving scenarios, the compute and memory operation cost of self-attention can be optimized by using the probability that multiple LLM requests have shared system prompts in prefixes. In this paper, we introduce ChunkAttention, a prefix-aware self-attention module that can detect matching prompt prefixes across multiple requests and share their key/value tensors in memory at runtime to improve the memory utilization of KV cache. This is achieved by breaking monolithic key/value tensors into smaller chunks and structuring them into the auxiliary prefix tree. Consequently, on top of the prefix-tree based KV cache, we design an efficient self-attention kernel, where a two-phase partition algorithm is implemented to improve the data locality during self-attention computation in the presence of shared system prompts. Experiments show that ChunkAttention can speed up the self-attention kernel by 3.2-4.8$\times$ compared to the state-of-the-art implementation, with the length of the system prompt ranging from 1024 to 4096.
△ Less
Submitted 1 August, 2024; v1 submitted 23 February, 2024;
originally announced February 2024.
-
Spin-dependent edge states in two-dimensional Dirac materials with a flat band
Authors:
Li-Li Ye,
Chen-Di Han,
Ying-Cheng Lai
Abstract:
The phenomenon of spin-dependent quantum scattering in two-dimensional (2D) pseudospin-1/2 Dirac materials leading to a relativistic quantum chimera was recently uncovered. We investigate spin-dependent Dirac electron optics in 2D pseudospin-1 Dirac materials, where the energy-band structure consists of a pair of Dirac cones and a flat band. In particular, with a suitable combination of external e…
▽ More
The phenomenon of spin-dependent quantum scattering in two-dimensional (2D) pseudospin-1/2 Dirac materials leading to a relativistic quantum chimera was recently uncovered. We investigate spin-dependent Dirac electron optics in 2D pseudospin-1 Dirac materials, where the energy-band structure consists of a pair of Dirac cones and a flat band. In particular, with a suitable combination of external electric fields and a magnetic exchange field, electrons with a specific spin orientation (e.g., spin-down) can be trapped in a class of long-lived edge modes, generating resonant scattering. The spin-dependent edge states are a unique feature of flat-band Dirac materials and have no classical correspondence. However, electrons with the opposite spin (i.e., spin up) undergo conventional quantum scattering with a classical correspondence, which can be understood in the framework of Dirac electron optics. A consequence is that the spin-down electrons produce a large scattering probability with broad scattering angle distribution in both near- and far-field regions, while the spin-up electrons display the opposite behavior. Such characteristically different behaviors of the electrons with opposite spins lead to spin polarization that can be as high as nearly 100%.
△ Less
Submitted 21 August, 2024; v1 submitted 21 February, 2024;
originally announced February 2024.
-
Irregular Bloch Zener oscillations in two-dimensional flat-band Dirac materials
Authors:
Li-Li Ye,
Ying-Cheng Lai
Abstract:
When a static electrical field is applied to a two-dimensional (2D) Dirac material, Landau-Zener transition (LZT) and Bloch-Zener oscillations can occur. Employing alpha-T3 lattices as a paradigm for a broad class of 2D Dirac materials, we uncover two phenomena. First, due to the arbitrarily small energy gaps near a Dirac point that make it more likely for LZTs to occur than in other regions of th…
▽ More
When a static electrical field is applied to a two-dimensional (2D) Dirac material, Landau-Zener transition (LZT) and Bloch-Zener oscillations can occur. Employing alpha-T3 lattices as a paradigm for a broad class of 2D Dirac materials, we uncover two phenomena. First, due to the arbitrarily small energy gaps near a Dirac point that make it more likely for LZTs to occur than in other regions of the Brillouin zone, the distribution of differential LZT probability in the momentum space can form a complicated morphological pattern. Second, a change in the LZT morphology as induced by a mutual switching of the two distinct Dirac points can lead to irregular Bloch-Zener oscillations characterized by a non-smooth behavior in the time evolution of the electrical current density associated with the oscillation. These phenomena are due to mixed interference of quantum states in multiple bands modulated by the geometric and dynamic phases. We demonstrate that the adiabatic-impulse model describing Landau-Zener-Stuckelberg interferometry can be exploited to calculate the phases, due to the equivalence between the alpha-T3 lattice subject to a constant electrical field and strongly periodically driven two- or three-level systems. The degree of irregularity of Bloch-Zener oscillations can be harnessed by selecting the morphology pattern, which is potentially experimentally realizable.
△ Less
Submitted 21 August, 2024; v1 submitted 21 February, 2024;
originally announced February 2024.
-
Optical properties of two dimensional Dirac Weyl materials with a flatband
Authors:
Li-Li Ye,
Chen-Di Han,
Ying-Cheng Lai
Abstract:
The emergence of a flat band in Dirac-Weyl materials offers new possibilities for electronic transitions, leading to stronger interaction with light. As a result, the optical conductivity can be significantly enhanced in these flat-band materials as compared with graphene, making them potentially better candidates for optical sensing and modulation. Recently, a comprehensive theory for the optical…
▽ More
The emergence of a flat band in Dirac-Weyl materials offers new possibilities for electronic transitions, leading to stronger interaction with light. As a result, the optical conductivity can be significantly enhanced in these flat-band materials as compared with graphene, making them potentially better candidates for optical sensing and modulation. Recently, a comprehensive theory for the optical conductivity of a spectrum of flat-band Dirac-Weyl materials has been developed, with explicit formulas for both the real and imaginary parts of the conductivity derived through two independent approaches. This Perspective offers a review of the development. An understanding of the optical properties of the flat-band Dirac-Weyl materials paves the way for optical device applications in the terahertz-frequency domain.
△ Less
Submitted 21 February, 2024;
originally announced February 2024.
-
Geometry-induced wavefunction collapse
Authors:
Li-Li Ye,
Chen-Di Han,
Liang Huang,
Ying-Cheng Lai
Abstract:
When a quantum particle moves in a curved space, a geometric potential can arise. In spite of a long history of extensive theoretical studies, to experimentally observe the geometric potential remains to be a challenge. What are the physically observable consequences of such a geometric potential? Solving the Schrodinger equation on a truncated conic surface, we uncover a class of quantum scatteri…
▽ More
When a quantum particle moves in a curved space, a geometric potential can arise. In spite of a long history of extensive theoretical studies, to experimentally observe the geometric potential remains to be a challenge. What are the physically observable consequences of such a geometric potential? Solving the Schrodinger equation on a truncated conic surface, we uncover a class of quantum scattering states that bear a strong resemblance with the quasi-resonant states associated with atomic collapse about a Coulomb impurity, a remarkable quantum phenomenon in which an infinite number of quasi-resonant states emerge. A characteristic defining feature of such collapse states is the infinite oscillations of the local density of states (LDOS) about the zero energy point separating the scattering from the bound states. The emergence of such states in the curved (Riemannian) space requires neither a relativistic quantum mechanism nor any Coulomb impurity: they have zero angular momentum and their origin is purely geometrical - henceforth the term geometry-induced wavefunction collapse. We establish the collapsing nature of these states through a detailed comparative analysis of the behavior of the LDOS for both the zero and finite angular-momentum states as well as the corresponding classical picture. Potential experimental schemes to realize the geometry-induced collapse states are articulated. Not only has our study uncovered an intrinsic connection between the geometric potential and atomic collapse, it also provides a method to experimentally observe and characterize geometric potentials arising from different subfields of physics. For example, in nanoscience and nanotechnology, curved geometry has become increasingly common. Our finding suggests that wavefunction collapse should be an important factor of consideration in designing and developing nanodevices.
△ Less
Submitted 21 August, 2024; v1 submitted 21 February, 2024;
originally announced February 2024.
-
Stack Representation of Finitely Presented Heyting Pretoposes I
Authors:
Lingyuan Ye
Abstract:
This is the first of a series of papers on stack representation of finitely presented Heyting pretoposes. In this paper, we provide the first step by constructing a (2, 1)-site, which can be thought of as the site of finite Kripke frames, such that the (2,1)-category of finitely presented Heyting pretoposes contravariantly embeds into the (2,1)- topos of stacks on this (2, 1)-site. This provides a…
▽ More
This is the first of a series of papers on stack representation of finitely presented Heyting pretoposes. In this paper, we provide the first step by constructing a (2, 1)-site, which can be thought of as the site of finite Kripke frames, such that the (2,1)-category of finitely presented Heyting pretoposes contravariantly embeds into the (2,1)- topos of stacks on this (2, 1)-site. This provides an entry point to use categorical and higher sheaf-theoretic tools to study the properties of certain classes of intuitionistic first-order theories.
△ Less
Submitted 20 February, 2024;
originally announced February 2024.
-
Weak-measurement-based pseudospin pointer: A cost-effective scheme for precision measurement
Authors:
Ling Ye,
Lan Luo,
An Wang,
Rongchun Ge,
Zhiyou Zhang
Abstract:
As an essential component of state-of-the-art quantum technologies, fast and efficient quantum measurements are in persistent demand over time. We present a proof-of-principle experiment on a new dimensionless pseudo-spin pointer based on weak measurement. In the context of optical parameter estimation, we demonstrate that the parametric distribution's moment is obtained experimentally by employin…
▽ More
As an essential component of state-of-the-art quantum technologies, fast and efficient quantum measurements are in persistent demand over time. We present a proof-of-principle experiment on a new dimensionless pseudo-spin pointer based on weak measurement. In the context of optical parameter estimation, we demonstrate that the parametric distribution's moment is obtained experimentally by employing the dimensionless pointer without measuring the distribution literally. In addition to the sheer liberation of experimental expense, the photon-countering-based pointer is well-calibrated for the detection of weak signals. We show that for signals $3$-$4$ orders of weaker in strength than the area-array camera method, an order of improvement in precision is achieved experimentally.
△ Less
Submitted 12 June, 2024; v1 submitted 3 February, 2024;
originally announced February 2024.
-
Theory of Electron Spin Resonance Spectroscopy in Scanning Tunneling Microscope
Authors:
Lyuzhou Ye,
Xiao Zheng,
Xin Xu
Abstract:
The integration of scanning tunneling microscopy (STM) and electron spin resonance (ESR) spectroscopy has emerged as a powerful and innovative tool for discerning spin excitations and spin-spin interactions within atoms and molecules adsorbed on surfaces. However, the origin of the STM-ESR signal and the underlying mechanisms that govern the essential features of the measured spectra have remained…
▽ More
The integration of scanning tunneling microscopy (STM) and electron spin resonance (ESR) spectroscopy has emerged as a powerful and innovative tool for discerning spin excitations and spin-spin interactions within atoms and molecules adsorbed on surfaces. However, the origin of the STM-ESR signal and the underlying mechanisms that govern the essential features of the measured spectra have remained elusive, thereby significantly impeding the future development of the STM-ESR approach. Here, we construct a model to carry out precise numerical simulations of STM-ESR spectra for a single hydrogenated Ti adatom and a hydrogenated Ti dimer, achieving excellent agreement with experimental observations. We further develop an analytic theory that elucidates the fundamental origin of the signal as well as the essential features in the measured spectra. These new theoretical developments establish a solid foundation for the on-demand detection and manipulation of atomic-scale spin states, with promising implications for cutting-edge applications in spin sensing, quantum information, and quantum computing.
△ Less
Submitted 7 February, 2024; v1 submitted 2 February, 2024;
originally announced February 2024.
-
Relations of rotation and chromospheric activity to stellar age for FGK dwarfs from Kepler and LAMOST
Authors:
Lifei Ye,
Shaolan Bi,
Jinghua Zhang,
Tiancheng Sun,
Liu Long,
Zhishuai Ge,
Tanda Li,
Xianfei Zhang,
Xunzhou Chen,
Yaguang Li,
Jianzhao Zhou,
Maosheng Xiang
Abstract:
The empirical relations between rotation period, chromospheric activity, and age can be used to estimate stellar age. To calibrate these relations, we present a catalog, including the masses and ages of 52,321 FGK dwarfs, 47,489 chromospheric activity index $logR^{+}_{HK}$, 6,077 rotation period $P_{rot}$ and variability amplitude $S_{ph}$, based on data from LAMOST DR7, Kepler and Gaia DR3. We fi…
▽ More
The empirical relations between rotation period, chromospheric activity, and age can be used to estimate stellar age. To calibrate these relations, we present a catalog, including the masses and ages of 52,321 FGK dwarfs, 47,489 chromospheric activity index $logR^{+}_{HK}$, 6,077 rotation period $P_{rot}$ and variability amplitude $S_{ph}$, based on data from LAMOST DR7, Kepler and Gaia DR3. We find a pronounced correlation among $P_{rot}$, age, and [Fe/H] throughout the main-sequence phase for F dwarfs. However, the decrease of $logR^{+}_{HK}$ over time is not significant except for those with [Fe/H] $<$ $-$0.1. For G dwarfs, both $P_{rot}$ and $logR^{+}_{HK}$ are reliable age probes in the ranges $\sim$ 2-11 Gyr and $\sim$ 2-13 Gyr, respectively. K dwarfs exhibit a prominent decrease in $logR^{+}_{HK}$ within the age range of $\sim$ 3-13 Gyr when the relation of $P_{rot}-τ$ is invalid. These relations are very important for promptly estimating the age of a vast number of stars, thus serving as a powerful tool in advancing the fields of exoplanet properties, stellar evolution, and Galactic-archaeology.
△ Less
Submitted 27 January, 2024;
originally announced January 2024.
-
Detection of Solar-like Oscillations in Sub-giant and Red Giant Stars Using 2-minute Cadence TESS Data
Authors:
Jianzhao Zhou,
Shaolan Bi,
Jie Yu,
Yaguang Li,
Xianfei Zhang,
Tanda Li,
Liu Long,
Mengjie Li,
Tiancheng Sun,
Lifei Ye
Abstract:
Based on all 2-minute cadence $TESS$ light curves from Sector 1 to 60, we provide a catalog of 8,651 solar-like oscillators, including frequency at maximum power ($ν_{\rm max}$, with its median precision, $σ$=5.39\%), large frequency separation ($Δν$, $σ$=6.22\%), seismically derived masses, radii, and surface gravity. In this sample, we have detected 2,173 new oscillators and added 4,373 new…
▽ More
Based on all 2-minute cadence $TESS$ light curves from Sector 1 to 60, we provide a catalog of 8,651 solar-like oscillators, including frequency at maximum power ($ν_{\rm max}$, with its median precision, $σ$=5.39\%), large frequency separation ($Δν$, $σ$=6.22\%), seismically derived masses, radii, and surface gravity. In this sample, we have detected 2,173 new oscillators and added 4,373 new $Δν$ measurements. Our seismic parameters are consistent with those from $Kepler$, $K2$, and previous $TESS$ data. The median fractional residual in $ν_{\rm max}$ is $1.63\%$ with a scatter of $14.75\%$, and in $Δν$ it is $0.11\%$ with a scatter of $10.76\%$. We have detected 476 solar-like oscillators with $ν_{\rm max}$ exceeding the $Nyquist$ frequency of $Kepler$ long-cadence data during the evolutionary phases of sub-giant and the base of the red-giant branch, which provide a valuable resource for understanding angular momentum transport.
△ Less
Submitted 20 January, 2024;
originally announced January 2024.
-
ConceptThread: Visualizing Threaded Concepts in MOOC Videos
Authors:
Zhiguang Zhou,
Li Ye,
Lihong Cai,
Lei Wang,
Yigang Wang,
Yongheng Wang,
Wei Chen,
Yong Wang
Abstract:
Massive Open Online Courses (MOOCs) platforms are becoming increasingly popular in recent years. Online learners need to watch the whole course video on MOOC platforms to learn the underlying new knowledge, which is often tedious and time-consuming due to the lack of a quick overview of the covered knowledge and their structures. In this paper, we propose ConceptThread, a visual analytics approach…
▽ More
Massive Open Online Courses (MOOCs) platforms are becoming increasingly popular in recent years. Online learners need to watch the whole course video on MOOC platforms to learn the underlying new knowledge, which is often tedious and time-consuming due to the lack of a quick overview of the covered knowledge and their structures. In this paper, we propose ConceptThread, a visual analytics approach to effectively show the concepts and the relations among them to facilitate effective online learning. Specifically, given that the majority of MOOC videos contain slides, we first leverage video processing and speech analysis techniques, including shot recognition, speech recognition and topic modeling, to extract core knowledge concepts and construct the hierarchical and temporal relations among them. Then, by using a metaphor of thread, we present a novel visualization to intuitively display the concepts based on video sequential flow, and enable learners to perform interactive visual exploration of concepts. We conducted a quantitative study, two case studies, and a user study to extensively evaluate ConceptThread. The results demonstrate the effectiveness and usability of ConceptThread in providing online learners with a quick understanding of the knowledge content of MOOC videos.
△ Less
Submitted 20 January, 2024;
originally announced January 2024.
-
Bayes Conditional Distribution Estimation for Knowledge Distillation Based on Conditional Mutual Information
Authors:
Linfeng Ye,
Shayan Mohajer Hamidi,
Renhao Tan,
En-Hui Yang
Abstract:
It is believed that in knowledge distillation (KD), the role of the teacher is to provide an estimate for the unknown Bayes conditional probability distribution (BCPD) to be used in the student training process. Conventionally, this estimate is obtained by training the teacher using maximum log-likelihood (MLL) method. To improve this estimate for KD, in this paper we introduce the concept of cond…
▽ More
It is believed that in knowledge distillation (KD), the role of the teacher is to provide an estimate for the unknown Bayes conditional probability distribution (BCPD) to be used in the student training process. Conventionally, this estimate is obtained by training the teacher using maximum log-likelihood (MLL) method. To improve this estimate for KD, in this paper we introduce the concept of conditional mutual information (CMI) into the estimation of BCPD and propose a novel estimator called the maximum CMI (MCMI) method. Specifically, in MCMI estimation, both the log-likelihood and CMI of the teacher are simultaneously maximized when the teacher is trained. Through Eigen-CAM, it is further shown that maximizing the teacher's CMI value allows the teacher to capture more contextual information in an image cluster. Via conducting a thorough set of experiments, we show that by employing a teacher trained via MCMI estimation rather than one trained via MLL estimation in various state-of-the-art KD frameworks, the student's classification accuracy consistently increases, with the gain of up to 3.32\%. This suggests that the teacher's BCPD estimate provided by MCMI method is more accurate than that provided by MLL method. In addition, we show that such improvements in the student's accuracy are more drastic in zero-shot and few-shot settings. Notably, the student's accuracy increases with the gain of up to 5.72\% when 5\% of the training samples are available to the student (few-shot), and increases from 0\% to as high as 84\% for an omitted class (zero-shot). The code is available at \url{https://github.com/iclr2024mcmi/ICLRMCMI}.
△ Less
Submitted 7 March, 2024; v1 submitted 16 January, 2024;
originally announced January 2024.
-
Robustness Against Adversarial Attacks via Learning Confined Adversarial Polytopes
Authors:
Shayan Mohajer Hamidi,
Linfeng Ye
Abstract:
Deep neural networks (DNNs) could be deceived by generating human-imperceptible perturbations of clean samples. Therefore, enhancing the robustness of DNNs against adversarial attacks is a crucial task. In this paper, we aim to train robust DNNs by limiting the set of outputs reachable via a norm-bounded perturbation added to a clean sample. We refer to this set as adversarial polytope, and each c…
▽ More
Deep neural networks (DNNs) could be deceived by generating human-imperceptible perturbations of clean samples. Therefore, enhancing the robustness of DNNs against adversarial attacks is a crucial task. In this paper, we aim to train robust DNNs by limiting the set of outputs reachable via a norm-bounded perturbation added to a clean sample. We refer to this set as adversarial polytope, and each clean sample has a respective adversarial polytope. Indeed, if the respective polytopes for all the samples are compact such that they do not intersect the decision boundaries of the DNN, then the DNN is robust against adversarial samples. Hence, the inner-working of our algorithm is based on learning \textbf{c}onfined \textbf{a}dversarial \textbf{p}olytopes (CAP). By conducting a thorough set of experiments, we demonstrate the effectiveness of CAP over existing adversarial robustness methods in improving the robustness of models against state-of-the-art attacks including AutoAttack.
△ Less
Submitted 20 January, 2024; v1 submitted 15 January, 2024;
originally announced January 2024.
-
Observation of Higher Order Nodal Line Semimetal in Phononic Crystals
Authors:
Qiyun Ma,
Zhenhang Pu,
Liping Ye,
Jiuyang Lu,
Xueqin Huang,
Manzhu Ke,
Hailong He,
Weiyin Deng,
Zhengyou Liu
Abstract:
Higher-order topological insulators and semimetals, which generalize the conventional bulk-boundary correspondence, have attracted extensive research interest. Among them, higher-order Weyl semimetals feature two-fold linear crossing points in three-dimensional (3D) momentum space, 2D Fermi-arc surface states, and 1D hinge states. Higher-order nodal-point semimetals possessing Weyl points or Dirac…
▽ More
Higher-order topological insulators and semimetals, which generalize the conventional bulk-boundary correspondence, have attracted extensive research interest. Among them, higher-order Weyl semimetals feature two-fold linear crossing points in three-dimensional (3D) momentum space, 2D Fermi-arc surface states, and 1D hinge states. Higher-order nodal-point semimetals possessing Weyl points or Dirac points have been implemented. However, higher-order nodal-line or nodal-surface semimetals remain to be further explored in experiments in spite of many previous theoretical efforts. In this work, we realize a second-order nodal-line semimetal in 3D phononic crystals. The bulk nodal lines, 2D drumhead surface states guaranteed by Zak phases, and 1D flat hinge states attributed to kz-dependent quadrupole moments, are observed in simulations and experiments. Our findings of nondispersive surface and hinge states may promote applications in acoustic sensing and energy harvesting.
△ Less
Submitted 12 January, 2024; v1 submitted 9 January, 2024;
originally announced January 2024.
-
HEOM-QUICK2: a general-purpose simulator for fermionic many-body open quantum systems -- An Update
Authors:
Daochi Zhang,
Lyuzhou Ye,
Jiaan Cao,
Yao Wang,
Rui-Xue Xu,
Xiao Zheng,
YiJing Yan
Abstract:
Many-body open quantum systems (OQS) have a profound impact on various subdisciplines of physics, chemistry, and biology. Thus, the development of a computer program capable of accurately, efficiently, and versatilely simulating many-body OQS is highly desirable. In recent years, we have focused on the advancement of numerical algorithms based on the fermionic hierarchical equations of motion (HEO…
▽ More
Many-body open quantum systems (OQS) have a profound impact on various subdisciplines of physics, chemistry, and biology. Thus, the development of a computer program capable of accurately, efficiently, and versatilely simulating many-body OQS is highly desirable. In recent years, we have focused on the advancement of numerical algorithms based on the fermionic hierarchical equations of motion (HEOM) theory. Being in-principle exact, this approach allows for the precise characterization of many-body correlations, non-Markovian memory, and non-equilibrium thermodynamic conditions. These efforts now lead to the establishment of a new computer program, HEOM for QUantum Impurity with a Correlated Kernel, version 2 (HEOM-QUICK2), which, to the best of our knowledge, is currently the only general-purpose simulator for fermionic many-body OQS. Compared with version 1, the HEOM-QUICK2 program features more efficient solvers for stationary states, more accurate treatment of non-Markovian memory, and improved numerical stability for long-time dissipative dynamics. Integrated with quantum chemistry software, HEOM-QUICK2 has become a valuable theoretical tool for the precise simulation of realistic many-body OQS, particularly the single atomic or molecular junctions. Furthermore, the unprecedented precision achieved by HEOM-QUICK2 enables accurate simulation of low-energy spin excitations and coherent spin relaxation. The unique usefulness of HEOM-QUICK2 is demonstrated through several examples of strongly correlated quantum impurity systems under non-equilibrium conditions. Thus, the new HEOM-QUICK2 program offers a powerful and comprehensive tool for studying many-body OQS with exotic quantum phenomena and exploring applications in various disciplines.
△ Less
Submitted 3 January, 2024;
originally announced January 2024.
-
Towards Model-Free LQR Control over Rate-Limited Channels
Authors:
Aritra Mitra,
Lintao Ye,
Vijay Gupta
Abstract:
Given the success of model-free methods for control design in many problem settings, it is natural to ask how things will change if realistic communication channels are utilized for the transmission of gradients or policies. While the resulting problem has analogies with the formulations studied under the rubric of networked control systems, the rich literature in that area has typically assumed t…
▽ More
Given the success of model-free methods for control design in many problem settings, it is natural to ask how things will change if realistic communication channels are utilized for the transmission of gradients or policies. While the resulting problem has analogies with the formulations studied under the rubric of networked control systems, the rich literature in that area has typically assumed that the model of the system is known. As a step towards bridging the fields of model-free control design and networked control systems, we ask: \textit{Is it possible to solve basic control problems - such as the linear quadratic regulator (LQR) problem - in a model-free manner over a rate-limited channel?} Toward answering this question, we study a setting where a worker agent transmits quantized policy gradients (of the LQR cost) to a server over a noiseless channel with a finite bit-rate. We propose a new algorithm titled Adaptively Quantized Gradient Descent (\texttt{AQGD}), and prove that above a certain finite threshold bit-rate, \texttt{AQGD} guarantees exponentially fast convergence to the globally optimal policy, with \textit{no deterioration of the exponent relative to the unquantized setting}. More generally, our approach reveals the benefits of adaptive quantization in preserving fast linear convergence rates, and, as such, may be of independent interest to the literature on compressed optimization.
△ Less
Submitted 1 August, 2024; v1 submitted 2 January, 2024;
originally announced January 2024.
-
Thermal transport measurements of the charge density wave transition in CsV$_3$Sb$_5$
Authors:
Erik D. Kountz,
Chaitanya R. Murthy,
Dong Chen,
Linda Ye,
Mark Zic,
Claudia Felser,
Ian R. Fisher,
Steven A. Kivelson,
Aharon Kapitulnik
Abstract:
We study thermalization and thermal transport in single crystals of CsV$_3$Sb$_5$ through the CDW transition by directly measuring thermal diffusivity ($D$), thermal conductivity ($κ$), resistivity ($ρ$), and specific heat ($c$). Commensurate with previous reports, we observe a sharp, narrow anomaly in specific heat associated with a first order transition that results in a CDW state below…
▽ More
We study thermalization and thermal transport in single crystals of CsV$_3$Sb$_5$ through the CDW transition by directly measuring thermal diffusivity ($D$), thermal conductivity ($κ$), resistivity ($ρ$), and specific heat ($c$). Commensurate with previous reports, we observe a sharp, narrow anomaly in specific heat associated with a first order transition that results in a CDW state below $\sim94$ K. While a corresponding sharp anomaly in thermal diffusivity is also observed, resistivity and thermal conductivity only exhibit small steps at the transition, where the feature is sharp for resistivity and broader for thermal conductivity. Scrutinizing the thermal Einstein relation $κ=cD$, we find that this relation is satisfied in the entire temperature range, except in a narrow range around the transition. The Wiedemann-Franz law seems to work outside the critical region as well. Below the transition and persisting below the two-phase regime we find strong resemblance between the resistivity anomaly and the specific heat, which may point to a secondary electronic order parameter that emerges continuously below the transition.
△ Less
Submitted 27 December, 2023;
originally announced December 2023.
-
Nonreciprocal Photon-Phonon Entanglement in Kerr-Modified Spinning Cavity Magnomechanics
Authors:
Jiaojiao Chen,
Xiao-Gang Fan,
Wei Xiong,
Dong Wang,
Liu Ye
Abstract:
Cavity magnomechanics has shown great potential in studying macroscopic quantum effects, especially for quantum entanglement, which is a key resource for quantum information science. Here we propose to realize magnon mediated nonreciprocal photon-phonon entanglement, which exhibits asymmetry when opposite magnetic or driving fields are respectively applied to the magnons with the Kerr effect or th…
▽ More
Cavity magnomechanics has shown great potential in studying macroscopic quantum effects, especially for quantum entanglement, which is a key resource for quantum information science. Here we propose to realize magnon mediated nonreciprocal photon-phonon entanglement, which exhibits asymmetry when opposite magnetic or driving fields are respectively applied to the magnons with the Kerr effect or the photons with the Sagnac effect. We find that the mean magnon number can selectively exhibit nonreciprocal linear or nonlinear (bistable) behavior with the strength of the strong driving field on the cavity. Assisted by this driving field, the magnon-phonon coupling is greatly enhanced, leading to the nonreciprocal photon-phonon entanglement via the swapping interaction between the magnons and photons. This nonreciprocal entanglement can be significantly enhanced with the magnon Kerr and Sagnac effects. Given the available parameters, the nonreciprocal photon-phonon entanglement can be preserved at $\sim3$ K, showing remarkable resilience against the bath temperature. The result reveals that our paper holds promise in developing various nonreciprocal devices with both the magnon Kerr and Sagnac effects in cavity magnomechanics.
△ Less
Submitted 11 April, 2024; v1 submitted 9 December, 2023;
originally announced December 2023.
-
Bounding Lifts of Markoff Triples mod $p$
Authors:
Elisa Bellah,
Siran Chen,
Elena Fuchs,
Lynnelle Ye
Abstract:
In 2016, Bourgain, Gamburd, and Sarnak proved that Strong Approximation holds for the Markoff surface in most cases. That is, the modulo $p$ solutions to the equation $X_1^2+X_2^2+X_3^2=3X_1X_2X_3$ are covered by the integer solutions for most primes $p$. In this paper, we provide upper bounds on lifts of mod $p$ points of the Markoff surface by analyzing the growth along paths in the Markoff mod…
▽ More
In 2016, Bourgain, Gamburd, and Sarnak proved that Strong Approximation holds for the Markoff surface in most cases. That is, the modulo $p$ solutions to the equation $X_1^2+X_2^2+X_3^2=3X_1X_2X_3$ are covered by the integer solutions for most primes $p$. In this paper, we provide upper bounds on lifts of mod $p$ points of the Markoff surface by analyzing the growth along paths in the Markoff mod $p$ graphs. Our first upper bound follows the algorithm given in the paper of Bourgain, Gamburd, and Sarnak, which constructs a path of possibly long length but where points grow relatively slowly. Our second bound considers paths in these graphs of short length but possibly large growth. We then provide numerical evidence and heuristic arguments for how these bounds might be improved.
△ Less
Submitted 19 November, 2023;
originally announced November 2023.