Showing 151–200 of 1,459 results for author: Luo, H

PULSAR: Simultaneous Many-Row Activation for Reliable and High-Performance Computing in Off-the-Shelf DRAM Chips

Authors: Ismail Emir Yuksel, Yahya Can Tugrul, F. Nisa Bostanci, Abdullah Giray Yaglikci, Ataberk Olgun, Geraldo F. Oliveira, Melina Soysal, Haocong Luo, Juan Gomez Luna, Mohammad Sadrosadati, Onur Mutlu

Abstract: Data movement between the processor and the main memory is a first-order obstacle against improving performance and energy efficiency in modern systems. To address this obstacle, Processing-using-Memory (PuM) is a promising approach where bulk-bitwise operations are performed leveraging intrinsic analog properties within the DRAM array and massive parallelism across DRAM columns. Unfortunately, 1)… ▽ More Data movement between the processor and the main memory is a first-order obstacle against improving performance and energy efficiency in modern systems. To address this obstacle, Processing-using-Memory (PuM) is a promising approach where bulk-bitwise operations are performed leveraging intrinsic analog properties within the DRAM array and massive parallelism across DRAM columns. Unfortunately, 1) modern off-the-shelf DRAM chips do not officially support PuM operations, and 2) existing techniques of performing PuM operations on off-the-shelf DRAM chips suffer from two key limitations. First, these techniques have low success rates, i.e., only a small fraction of DRAM columns can correctly execute PuM operations because they operate beyond manufacturer-recommended timing constraints, causing these operations to be highly susceptible to noise and process variation. Second, these techniques have limited compute primitives, preventing them from fully leveraging parallelism across DRAM columns and thus hindering their performance benefits. We propose PULSAR, a new technique to enable high-success-rate and high-performance PuM operations in off-the-shelf DRAM chips. PULSAR leverages our new observation that a carefully crafted sequence of DRAM commands simultaneously activates up to 32 DRAM rows. PULSAR overcomes the limitations of existing techniques by 1) replicating the input data to improve the success rate and 2) enabling new bulk bitwise operations (e.g., many-input majority, Multi-RowInit, and Bulk-Write) to improve the performance. Our analysis on 120 off-the-shelf DDR4 chips from two major manufacturers shows that PULSAR achieves a 24.18% higher success rate and 121% higher performance over seven arithmetic-logic operations compared to FracDRAM, a state-of-the-art off-the-shelf DRAM-based PuM technique. △ Less

Submitted 18 March, 2024; v1 submitted 5 December, 2023; originally announced December 2023.

Normalized solutions for nonautonomous Schrödinger-Poisson equations

Authors: Yating Xu, Huxiao Luo

Abstract: In this paper, we study the existence of normalized solutions for the nonautonomous Schrödinger-Poisson equations \begin{equation}\nonumber -Δu+λu +\left(\vert x \vert ^{-1} * \vert u \vert ^{2} \right) u=A(x)|u|^{p-2}u,\quad \text{in}~\R^3, \end{equation} where $λ\in\R$, $A \in L^\infty(\R^3)$ satisfies some mild conditions. Due to the nonconstant potential $A$, we use Pohozaev manifold to recove… ▽ More In this paper, we study the existence of normalized solutions for the nonautonomous Schrödinger-Poisson equations \begin{equation}\nonumber -Δu+λu +\left(\vert x \vert ^{-1} * \vert u \vert ^{2} \right) u=A(x)|u|^{p-2}u,\quad \text{in}~\R^3, \end{equation} where $λ\in\R$, $A \in L^\infty(\R^3)$ satisfies some mild conditions. Due to the nonconstant potential $A$, we use Pohozaev manifold to recover the compactness for a minimizing sequence. For $p\in (2,3)$, $p\in(3,\frac{10}{3})$ and $p\in(\frac{10}{3}, 6)$, we adopt different analytical techniques to overcome the difficulties due to the presence of three terms in the corresponding energy functional which scale differently, respectively. △ Less

Submitted 1 December, 2023; originally announced December 2023.

Maximum principles for nonlinear integro-differential equations and symmetry of solutions

Authors: Huxiao Luo, Meiqing Xu

Abstract: In this paper, we study the semilinear integro-differential equations \begin{equation*} \mathcal{L}_{K}u(x)\equiv C_n\text{P.V.}\int_{\R^n}\left(u(x)-u(y)\right)K(x-y)dy=f(x,u), \end{equation*} and the full nonlinear integro-differential equations \begin{equation*} F_{G,K}u(x)\equiv C_n\text{P.V.}\int_{\R^n}G(u(x)-u(y))K(x-y)dy=f(x,u), \end{equation*} where $K(\cdot)$ is a symmetric jumping kernel… ▽ More In this paper, we study the semilinear integro-differential equations \begin{equation*} \mathcal{L}_{K}u(x)\equiv C_n\text{P.V.}\int_{\R^n}\left(u(x)-u(y)\right)K(x-y)dy=f(x,u), \end{equation*} and the full nonlinear integro-differential equations \begin{equation*} F_{G,K}u(x)\equiv C_n\text{P.V.}\int_{\R^n}G(u(x)-u(y))K(x-y)dy=f(x,u), \end{equation*} where $K(\cdot)$ is a symmetric jumping kernel and $K(\cdot)\geq C|\cdot|^{-n-α}$, $G(\cdot)$ is some nonlinear function without non-degenerate condition. We adopt the direct method of moving planes to study the symmetry and monotonicity of solutions for the integro-differential equations, and investigate the limit of some non-local operators $\mathcal{L}_{K}$ as $α\to2.$ Our results extended some results obtained in \cite{CL} and \cite{CLLG}. △ Less

Submitted 1 December, 2023; originally announced December 2023.

Comments: arXiv admin note: text overlap with arXiv:1705.04891 by other authors

Uniqueness and nondegeneracy of ground states for the Schrödinger-Newton equation with power nonlinearity

Authors: Huxiao Luo

Abstract: In this article, we study the Schrödinger-Newton equation \begin{equation} -Δu+λu=\frac{1}{4π}\left(\frac{1}{|x|}\star u^{2}\right)u+|u|^{q-2}u \quad \text{in}~\mathbb{R}^3, \end{equation} where $λ\in\mathbb{R}_+$, $q\in (2,3)\cup(3, 6)$. By investigating limit profiles of ground states as $λ\to0^+$ or $λ\to+\infty$, we prove the uniqueness of ground states. By the action of the linearized eqautio… ▽ More In this article, we study the Schrödinger-Newton equation \begin{equation} -Δu+λu=\frac{1}{4π}\left(\frac{1}{|x|}\star u^{2}\right)u+|u|^{q-2}u \quad \text{in}~\mathbb{R}^3, \end{equation} where $λ\in\mathbb{R}_+$, $q\in (2,3)\cup(3, 6)$. By investigating limit profiles of ground states as $λ\to0^+$ or $λ\to+\infty$, we prove the uniqueness of ground states. By the action of the linearized eqaution with respect to decomposition into spherical harmonics, we obtain the nondegeneracy of ground states. △ Less

Submitted 1 December, 2023; originally announced December 2023.

Comments: arXiv admin note: text overlap with arXiv:2112.05869 by other authors

Learning Anatomically Consistent Embedding for Chest Radiography

Authors: Ziyu Zhou, Haozhe Luo, Jiaxuan Pang, Xiaowei Ding, Michael Gotway, Jianming Liang

Abstract: Self-supervised learning (SSL) approaches have recently shown substantial success in learning visual representations from unannotated images. Compared with photographic images, medical images acquired with the same imaging protocol exhibit high consistency in anatomy. To exploit this anatomical consistency, this paper introduces a novel SSL approach, called PEAC (patch embedding of anatomical cons… ▽ More Self-supervised learning (SSL) approaches have recently shown substantial success in learning visual representations from unannotated images. Compared with photographic images, medical images acquired with the same imaging protocol exhibit high consistency in anatomy. To exploit this anatomical consistency, this paper introduces a novel SSL approach, called PEAC (patch embedding of anatomical consistency), for medical image analysis. Specifically, in this paper, we propose to learn global and local consistencies via stable grid-based matching, transfer pre-trained PEAC models to diverse downstream tasks, and extensively demonstrate that (1) PEAC achieves significantly better performance than the existing state-of-the-art fully/self-supervised methods, and (2) PEAC captures the anatomical structure consistency across views of the same patient and across patients of different genders, weights, and healthy statuses, which enhances the interpretability of our method for medical image analysis. △ Less

Submitted 11 June, 2024; v1 submitted 30 November, 2023; originally announced December 2023.

Comments: BMVC 2023, oral

Electronic Phase Propagation Speed in BaFe$_2$As$_2$ Revealed by Dilatometry

Authors: Xin Qin, Xingyu Wang, Wenshan Hong, Mengqiao Geng, Yuan Li, Huiqian Luo, Shiliang Li, Yang Liu

Abstract: Thermal expansion offers deep insights into phase transitions in condensed matter physics. Utilizing an advanced AC-temperature dilatometer with picometer resolution, this study clearly resolves the antiferromagnetic and structural transition in BaFe$_2$As$_2$. The implementation of temperature oscillation reveals a hysteresis near the transition temperature $T_\mathrm{N}$ with unprecedented resol… ▽ More Thermal expansion offers deep insights into phase transitions in condensed matter physics. Utilizing an advanced AC-temperature dilatometer with picometer resolution, this study clearly resolves the antiferromagnetic and structural transition in BaFe$_2$As$_2$. The implementation of temperature oscillation reveals a hysteresis near the transition temperature $T_\mathrm{N}$ with unprecedented resolution. Unexpectedly, we find that the hysteretic width exhibits a universal dependence on the parameters of temperature oscillation and the sample's longidutinal dimension, which in turn reveals a finite transition speed. Our quantitative analysis shows that this phase boundary propagates at a mere 188 $μ$m/s - a speed seven orders of magnitude slower than acoustic waves. It suggests a hidden thermodynamic constraint imposed by the electronic degrees of freedom. Our research not only sheds light on the dynamics of phase transitions between different correlated phases, but also establishes high precision dilatometry as a powerful tool for material studies. This measurement technique, when properly modified, can be extended to studies of other material properties such as piezoelectric, magneto-restriction, elastic modulus, etc. △ Less

Submitted 26 March, 2024; v1 submitted 30 November, 2023; originally announced November 2023.

Vector-Quantized Prompt Learning for Paraphrase Generation

Authors: Haotian Luo, Yixin Liu, Peidong Liu, Xianggen Liu

Abstract: Deep generative modeling of natural languages has achieved many successes, such as producing fluent sentences and translating from one language into another. However, the development of generative modeling techniques for paraphrase generation still lags behind largely due to the challenges in addressing the complex conflicts between expression diversity and semantic preservation. This paper propos… ▽ More Deep generative modeling of natural languages has achieved many successes, such as producing fluent sentences and translating from one language into another. However, the development of generative modeling techniques for paraphrase generation still lags behind largely due to the challenges in addressing the complex conflicts between expression diversity and semantic preservation. This paper proposes to generate diverse and high-quality paraphrases by exploiting the pre-trained models with instance-dependent prompts. To learn generalizable prompts, we assume that the number of abstract transforming patterns of paraphrase generation (governed by prompts) is finite and usually not large. Therefore, we present vector-quantized prompts as the cues to control the generation of pre-trained models. Extensive experiments demonstrate that the proposed method achieves new state-of-art results on three benchmark datasets, including Quora, Wikianswers, and MSCOCO. We will release all the code upon acceptance. △ Less

Submitted 25 November, 2023; originally announced November 2023.

Comments: EMNLP Findings, 2023

VGSG: Vision-Guided Semantic-Group Network for Text-based Person Search

Authors: Shuting He, Hao Luo, Wei Jiang, Xudong Jiang, Henghui Ding

Abstract: Text-based Person Search (TBPS) aims to retrieve images of target pedestrian indicated by textual descriptions. It is essential for TBPS to extract fine-grained local features and align them crossing modality. Existing methods utilize external tools or heavy cross-modal interaction to achieve explicit alignment of cross-modal fine-grained features, which is inefficient and time-consuming. In this… ▽ More Text-based Person Search (TBPS) aims to retrieve images of target pedestrian indicated by textual descriptions. It is essential for TBPS to extract fine-grained local features and align them crossing modality. Existing methods utilize external tools or heavy cross-modal interaction to achieve explicit alignment of cross-modal fine-grained features, which is inefficient and time-consuming. In this work, we propose a Vision-Guided Semantic-Group Network (VGSG) for text-based person search to extract well-aligned fine-grained visual and textual features. In the proposed VGSG, we develop a Semantic-Group Textual Learning (SGTL) module and a Vision-guided Knowledge Transfer (VGKT) module to extract textual local features under the guidance of visual local clues. In SGTL, in order to obtain the local textual representation, we group textual features from the channel dimension based on the semantic cues of language expression, which encourages similar semantic patterns to be grouped implicitly without external tools. In VGKT, a vision-guided attention is employed to extract visual-related textual features, which are inherently aligned with visual cues and termed vision-guided textual features. Furthermore, we design a relational knowledge transfer, including a vision-language similarity transfer and a class probability transfer, to adaptively propagate information of the vision-guided textual features to semantic-group textual features. With the help of relational knowledge transfer, VGKT is capable of aligning semantic-group textual features with corresponding visual features without external tools and complex pairwise interaction. Experimental results on two challenging benchmarks demonstrate its superiority over state-of-the-art methods. △ Less

Submitted 13 November, 2023; originally announced November 2023.

Comments: Accepted to IEEE TIP

Quantumness and quantum to classical transition in the generalized Rabi model

Authors: Wei-Feng Zhuang, Yun-Tong Yang, Hong-Gang Luo, Ming Gong, Guang-Can Guo

Abstract: The quantum to classical transition (QCT) is one of the central mysteries in quantum physics. This process is generally interpreted as state collapse from measurement or decoherence from interacting with the environment. Here we define the quantumness of a Hamiltonian by the free energy difference between its quantum and classical descriptions, which vanishes during QCT. We apply this criterion to… ▽ More The quantum to classical transition (QCT) is one of the central mysteries in quantum physics. This process is generally interpreted as state collapse from measurement or decoherence from interacting with the environment. Here we define the quantumness of a Hamiltonian by the free energy difference between its quantum and classical descriptions, which vanishes during QCT. We apply this criterion to the many-body Rabi model and study its scaling law across the phase transition, finding that not only the temperature and Planck constant, but also all the model parameters are important for this transition. We show that the Jaynes-Cummings and anti Jaynes-Cummings models exhibit greater quantumness than the Rabi model. Moreover, we show that the rotating wave and anti-rotating wave terms in this model have opposite quantumness in QCT. We demonstrate that the quantumness may be enhanced or suppressed at the critical point. Finally, we estimate the quantumness of the Rabi model in current trapped ion experiments. The quantumness provides an important tool to characterize the QCT in a vast number of many-body models. △ Less

Submitted 12 November, 2023; originally announced November 2023.

Comments: 6 pages, 5 figures

Dual-Branch Reconstruction Network for Industrial Anomaly Detection with RGB-D Data

Authors: Chenyang Bi, Yueyang Li, Haichi Luo

Abstract: Unsupervised anomaly detection methods are at the forefront of industrial anomaly detection efforts and have made notable progress. Previous work primarily used 2D information as input, but multi-modal industrial anomaly detection based on 3D point clouds and RGB images is just beginning to emerge. The regular approach involves utilizing large pre-trained models for feature representation and stor… ▽ More Unsupervised anomaly detection methods are at the forefront of industrial anomaly detection efforts and have made notable progress. Previous work primarily used 2D information as input, but multi-modal industrial anomaly detection based on 3D point clouds and RGB images is just beginning to emerge. The regular approach involves utilizing large pre-trained models for feature representation and storing them in memory banks. However, the above methods require a longer inference time and higher memory usage, which cannot meet the real-time requirements of the industry. To overcome these issues, we propose a lightweight dual-branch reconstruction network(DBRN) based on RGB-D input, learning the decision boundary between normal and abnormal examples. The requirement for alignment between the two modalities is eliminated by using depth maps instead of point cloud input. Furthermore, we introduce an importance scoring module in the discriminative network to assist in fusing features from these two modalities, thereby obtaining a comprehensive discriminative result. DBRN achieves 92.8% AUROC with high inference efficiency on the MVTec 3D-AD dataset without large pre-trained models and memory banks. △ Less

Submitted 12 November, 2023; originally announced November 2023.

Comments: 8 pages, 5 figures

CL-Flow:Strengthening the Normalizing Flows by Contrastive Learning for Better Anomaly Detection

Authors: Shunfeng Wang, Yueyang Li, Haichi Luo, Chenyang Bi

Abstract: In the anomaly detection field, the scarcity of anomalous samples has directed the current research emphasis towards unsupervised anomaly detection. While these unsupervised anomaly detection methods offer convenience, they also overlook the crucial prior information embedded within anomalous samples. Moreover, among numerous deep learning methods, supervised methods generally exhibit superior per… ▽ More In the anomaly detection field, the scarcity of anomalous samples has directed the current research emphasis towards unsupervised anomaly detection. While these unsupervised anomaly detection methods offer convenience, they also overlook the crucial prior information embedded within anomalous samples. Moreover, among numerous deep learning methods, supervised methods generally exhibit superior performance compared to unsupervised methods. Considering the reasons mentioned above, we propose a self-supervised anomaly detection approach that combines contrastive learning with 2D-Flow to achieve more precise detection outcomes and expedited inference processes. On one hand, we introduce a novel approach to anomaly synthesis, yielding anomalous samples in accordance with authentic industrial scenarios, alongside their surrogate annotations. On the other hand, having obtained a substantial number of anomalous samples, we enhance the 2D-Flow framework by incorporating contrastive learning, leveraging diverse proxy tasks to fine-tune the network. Our approach enables the network to learn more precise mapping relationships from self-generated labels while retaining the lightweight characteristics of the 2D-Flow. Compared to mainstream unsupervised approaches, our self-supervised method demonstrates superior detection accuracy, fewer additional model parameters, and faster inference speed. Furthermore, the entire training and inference process is end-to-end. Our approach showcases new state-of-the-art results, achieving a performance of 99.6\% in image-level AUROC on the MVTecAD dataset and 96.8\% in image-level AUROC on the BTAD dataset. △ Less

Submitted 12 November, 2023; originally announced November 2023.

Comments: 6 pages,6 figures

Effects of detection-beam focal offset on displacement detection in optical tweezers

Authors: Anni Chen, Hui Luo, Zhijie Chen, Haining Feng, Tengfang Kuang, Hui An, Xiang Han, Wei Xiong, Guangzong Xiao

Abstract: A high-resolution displacement detection can be achieved by analyzing the scattered light of the trapping beams from the particle in optical tweezers. In some applications where trapping and displacement detection need to be separated, a detection beam can be introduced for independent displacement detection. However, the detection beam focus possibly deviates from the centre of the particle, whic… ▽ More A high-resolution displacement detection can be achieved by analyzing the scattered light of the trapping beams from the particle in optical tweezers. In some applications where trapping and displacement detection need to be separated, a detection beam can be introduced for independent displacement detection. However, the detection beam focus possibly deviates from the centre of the particle, which will affect the performance of the displacement detection. In this paper, we detect the radial displacement of the particle by utilizing the forward scattered light of the detection beam from the particle. The effects of the lateral and axial offsets between the detection beam focus and the particle centre on the displacement detection are analyzed by the simulation and experiment. The results show that the lateral offsets will decrease the detection sensitivity and linear range and aggravate the crosstalk between the x-direction signal and y-direction signal of QPD. The axial offsets also affect the detection sensitivity, an optimal axial offset can improve the sensitivity of the displacement detection substantially. In addition, the influence of system parameters, such as particle radius a, numerical aperture of the condenser NAc and numerical aperture of the objective NAo on the optimal axial offset are discussed. A combination of conventional optical tweezers instrument and a detection beam provides a more flexible working point, allowing for the active modulation of the sensitivity and linear range of the displacement detection. This work would be of great interest for improving the accuracy of the displacement and force detection performed by the optical tweezers. △ Less

Submitted 10 November, 2023; originally announced November 2023.

Comments: 10 pages,11 figures

Strong electron-phonon coupling in Ba$_{1-x}$Sr$_x$Ni$_2$As$_2$

Authors: Linxing Song, Jianguo Si, Tom Fennell, Uwe Stuhr, Guochu Deng, Jinchen Wang, Juanjuan Liu, Lijie Hao, Huiqian Luo, Miao Liu, Sheng Meng, Shiliang Li

Abstract: The charge density wave (CDW) or nematicity has been found to coexist with superconductivity in many systems. It is thus interesting that the superconducting transition temperature $T_c$ in the doped BaNi$_2$As$_2$ system can be enhanced up to six times as the CDW or nematicity in the undoped compound is suppressed. Here we show that the transverse acoustic phonons of Ba$_{1-x}$Sr$_x$Ni$_2$As$_2$… ▽ More The charge density wave (CDW) or nematicity has been found to coexist with superconductivity in many systems. It is thus interesting that the superconducting transition temperature $T_c$ in the doped BaNi$_2$As$_2$ system can be enhanced up to six times as the CDW or nematicity in the undoped compound is suppressed. Here we show that the transverse acoustic phonons of Ba$_{1-x}$Sr$_x$Ni$_2$As$_2$ are strongly damped in a wide doping range and over the whole $Q$ range, which excludes its origin from either CDW or nematicity. The damping of TA phonons can be understood as large electron-phonon coupling and possible strong hybridization between acoustic and optical phonons as shown by the first-principle calculations. The superconductivity can be quantitatively reproduced by the change of electron-phonon coupling constant calculated by the McMillan equation in the BCS framework, which suggests that no quantum fluctuations of any order is needed to promote the superconductivity. On the contrary, the change of $T_c$ in this system should be understood as the six-fold suppression of superconductivity in undoped compounds. △ Less

Submitted 24 March, 2024; v1 submitted 6 November, 2023; originally announced November 2023.

Comments: 8 pages, 4 figures

Journal ref: Phys. Rev. B 109, 104518 (2024)

ProSG: Using Prompt Synthetic Gradients to Alleviate Prompt Forgetting of RNN-like Language Models

Authors: Haotian Luo, Kunming Wu, Cheng Dai, Sixian Ding, Xinhao Chen

Abstract: RNN-like language models are getting renewed attention from NLP researchers in recent years and several models have made significant progress, which demonstrates performance comparable to traditional transformers. However, due to the recurrent nature of RNNs, this kind of language model can only store information in a set of fixed-length state vectors. As a consequence, they still suffer from forg… ▽ More RNN-like language models are getting renewed attention from NLP researchers in recent years and several models have made significant progress, which demonstrates performance comparable to traditional transformers. However, due to the recurrent nature of RNNs, this kind of language model can only store information in a set of fixed-length state vectors. As a consequence, they still suffer from forgetfulness though after a lot of improvements and optimizations, when given complex instructions or prompts. As the prompted generation is the main and most concerned function of LMs, solving the problem of forgetting in the process of generation is no wonder of vital importance. In this paper, focusing on easing the prompt forgetting during generation, we proposed an architecture to teach the model memorizing prompt during generation by synthetic gradient. To force the model to memorize the prompt, we derive the states that encode the prompt, then transform it into model parameter modification using low-rank gradient approximation, which hard-codes the prompt into model parameters temporarily. We construct a dataset for experiments, and the results have demonstrated the effectiveness of our method in solving the problem of forgetfulness in the process of prompted generation. We will release all the code upon acceptance. △ Less

Submitted 3 November, 2023; originally announced November 2023.

Phase transitions in the Haldane-Hubbard model

Authors: Wan-Xiu He, Rubem Mondaini, Hong-Gang Luo, Xiaoqun Wang, Shijie Hu

Abstract: The Haldane-Hubbard model is a prime example of the combined effects of band topology and electronic interaction. We revisit its spinful phase diagram at half-filling as a consensus on the presence of SU($2$) symmetry is currently lacking. To start, we utilize the Hartree-Fock mean-field method, which offers a direct understanding of symmetry breaking through the effective mass term that can acqui… ▽ More The Haldane-Hubbard model is a prime example of the combined effects of band topology and electronic interaction. We revisit its spinful phase diagram at half-filling as a consensus on the presence of SU($2$) symmetry is currently lacking. To start, we utilize the Hartree-Fock mean-field method, which offers a direct understanding of symmetry breaking through the effective mass term that can acquire spin dependence. Our results, in agreement with previous studies, provide an instructive insight into the regime where the Chern number $C=1$, with only one spin species remaining topological. Besides that, we numerically study the phase diagram of the Haldane-Hubbard model via a large-scale infinite-density matrix renormalization group (iDMRG) method. The phase boundaries are determined by the Chern number and the correlation lengths obtained from the transfer-matrix spectrum. Unlike previous studies, the iDMRG method investigates the Haldane-Hubbard model on a thin and infinitely long cylinder and examines scenarios consistent with the two-dimensional thermodynamic limit. Here, the phase diagram we obtained qualitatively goes beyond the Hartree-Fock scope, particularly in the $C=1$ region, and serves as a quantitative benchmark for further theoretical and experimental investigations. △ Less

Submitted 3 November, 2023; originally announced November 2023.

Comments: 12 pages, 9 figures

Journal ref: Phys. Rev. B 109, 035126 (2024)

Moving Target Sensing for ISAC Systems in Clutter Environment

Authors: Dongqi Luo, Huihui Wu, Hongliang Luo, Bo Lin, Feifei Gao

Abstract: In this paper, we consider the moving target sensing problem for integrated sensing and communication (ISAC) systems in clutter environment. Scatterers produce strong clutter, deteriorating the performance of ISAC systems in practice. Given that scatterers are typically stationary and the targets of interest are usually moving, we here focus on sensing the moving targets. Specifically, we adopt a… ▽ More In this paper, we consider the moving target sensing problem for integrated sensing and communication (ISAC) systems in clutter environment. Scatterers produce strong clutter, deteriorating the performance of ISAC systems in practice. Given that scatterers are typically stationary and the targets of interest are usually moving, we here focus on sensing the moving targets. Specifically, we adopt a scanning beam to search for moving target candidates. For the received signal in each scan, we employ high-pass filtering in the Doppler domain to suppress the clutter within the echo, thereby identifying candidate moving targets according to the power of filtered signal. Then, we adopt root-MUSIC-based algorithms to estimate the angle, range, and radial velocity of these candidate moving targets. Subsequently, we propose a target detection algorithm to reject false targets. Simulation results validate the effectiveness of these proposed methods. △ Less

Submitted 3 November, 2023; originally announced November 2023.

Integrated Sensing and Communications in Clutter Environment

Authors: Hongliang Luo, Yucong Wang, Dongqi Luo, Jianwei Zhao, Huihui Wu, Shaodan Ma, Feifei Gao

Abstract: In this paper, we propose a practical integrated sensing and communications (ISAC) framework to sense dynamic targets from clutter environment while ensuring users communications quality. To implement communications function and sensing function simultaneously, we design multiple communications beams that can communicate with the users as well as one sensing beam that can rotate and scan the entir… ▽ More In this paper, we propose a practical integrated sensing and communications (ISAC) framework to sense dynamic targets from clutter environment while ensuring users communications quality. To implement communications function and sensing function simultaneously, we design multiple communications beams that can communicate with the users as well as one sensing beam that can rotate and scan the entire space. To minimize the interference of sensing beam on existing communications systems, we divide the service area into sensing beam for sensing (S4S) sector and communications beam for sensing (C4S) sector, and provide beamforming design and power allocation optimization strategies for each type sector. Unlike most existing ISAC studies that ignore the interference of static environmental clutter on target sensing, we construct a mixed sensing channel model that includes both static environment and dynamic targets. When base station receives the echo signals, the mean phasor cancellation (MPC) method is employed to filter out the interference from static environmental clutter and to extract the effective dynamic target echoes. Then a complete and practical dynamic target sensing scheme is designed to detect the presence of dynamic targets and to estimate their angles, distances, and velocities. In particular, dynamic target detection and angle estimation are realized through angle-Doppler spectrum estimation (ADSE) and joint detection over multiple subcarriers (MSJD), while distance and velocity estimation are realized through the extended subspace algorithm. Simulation results demonstrate the effectiveness of the proposed scheme and its superiority over the existing methods that ignore environmental clutter. △ Less

Submitted 5 February, 2024; v1 submitted 2 November, 2023; originally announced November 2023.

Re-weighting Tokens: A Simple and Effective Active Learning Strategy for Named Entity Recognition

Authors: Haocheng Luo, Wei Tan, Ngoc Dang Nguyen, Lan Du

Abstract: Active learning, a widely adopted technique for enhancing machine learning models in text and image classification tasks with limited annotation resources, has received relatively little attention in the domain of Named Entity Recognition (NER). The challenge of data imbalance in NER has hindered the effectiveness of active learning, as sequence labellers lack sufficient learning signals. To addre… ▽ More Active learning, a widely adopted technique for enhancing machine learning models in text and image classification tasks with limited annotation resources, has received relatively little attention in the domain of Named Entity Recognition (NER). The challenge of data imbalance in NER has hindered the effectiveness of active learning, as sequence labellers lack sufficient learning signals. To address these challenges, this paper presents a novel reweighting-based active learning strategy that assigns dynamic smoothed weights to individual tokens. This adaptable strategy is compatible with various token-level acquisition functions and contributes to the development of robust active learners. Experimental results on multiple corpora demonstrate the substantial performance improvement achieved by incorporating our re-weighting strategy into existing acquisition functions, validating its practical efficacy. △ Less

Submitted 1 November, 2023; originally announced November 2023.

Last-Iterate Convergence Properties of Regret-Matching Algorithms in Games

Authors: Yang Cai, Gabriele Farina, Julien Grand-Clément, Christian Kroer, Chung-Wei Lee, Haipeng Luo, Weiqiang Zheng

Abstract: Algorithms based on regret matching, specifically regret matching$^+$ (RM$^+$), and its variants are the most popular approaches for solving large-scale two-player zero-sum games in practice. Unlike algorithms such as optimistic gradient descent ascent, which have strong last-iterate and ergodic convergence properties for zero-sum games, virtually nothing is known about the last-iterate properties… ▽ More Algorithms based on regret matching, specifically regret matching$^+$ (RM$^+$), and its variants are the most popular approaches for solving large-scale two-player zero-sum games in practice. Unlike algorithms such as optimistic gradient descent ascent, which have strong last-iterate and ergodic convergence properties for zero-sum games, virtually nothing is known about the last-iterate properties of regret-matching algorithms. Given the importance of last-iterate convergence for numerical optimization reasons and relevance as modeling real-word learning in games, in this paper, we study the last-iterate convergence properties of various popular variants of RM$^+$. First, we show numerically that several practical variants such as simultaneous RM$^+$, alternating RM$^+$, and simultaneous predictive RM$^+$, all lack last-iterate convergence guarantees even on a simple $3\times 3$ game. We then prove that recent variants of these algorithms based on a smoothing technique do enjoy last-iterate convergence: we prove that extragradient RM$^{+}$ and smooth Predictive RM$^+$ enjoy asymptotic last-iterate convergence (without a rate) and $1/\sqrt{t}$ best-iterate convergence. Finally, we introduce restarted variants of these algorithms, and show that they enjoy linear-rate last-iterate convergence. △ Less

Submitted 1 November, 2023; originally announced November 2023.

Discovery of four pulsars in a pilot survey at intermediate Galactic latitudes with FAST

Authors: Q. J. Zhi, J. T. Bai, S. Dai, X. Xu, S. J. Dang, L. H. Shang, R. S. Zhao, D. Li, W. W. Zhu, N. Wang, J. P. Yuan, P. Wang, L. Zhang, Y. Feng, J. B. Wang, S. Q. Wang, Q. D. Wu, A. J. Dong, H. Yang, J. Tian, W. Q. Zhong, X. H. Luo, Miroslav D. Filipovi, G. J. Qiao

Abstract: We present the discovery and timing results of four pulsars discovered in a pilot survey at intermediate Galactic latitudes with the Five-hundred Aperture Spherical Telescope (FAST). Among these pulsars, two belong to the category of millisecond pulsars (MSPs) with spin periods of less than 20 ms. The other two fall under the classification of "mildly recycled" pulsars, with massive white dwarfs a… ▽ More We present the discovery and timing results of four pulsars discovered in a pilot survey at intermediate Galactic latitudes with the Five-hundred Aperture Spherical Telescope (FAST). Among these pulsars, two belong to the category of millisecond pulsars (MSPs) with spin periods of less than 20 ms. The other two fall under the classification of "mildly recycled" pulsars, with massive white dwarfs as companions. Remarkably, this small survey, covering an area of 4.7 $deg^2$ , led to the discovery of four recycled pulsars. Such success underscores the immense potential of future surveys at intermediate Galactic latitudes. In order to assess the potential yield of MSPs, we conducted population simulations and found that both FAST and Parkes new phased array feed surveys, focusing on intermediate Galactic latitudes, have the capacity to uncover several hundred new MSPs. △ Less

Submitted 28 December, 2023; v1 submitted 1 November, 2023; originally announced November 2023.

Comments: 7 pages, 4 figures, 2 tables, accepted to ApJ

Topological Learning for Motion Data via Mixed Coordinates

Authors: Hengrui Luo, Jisu Kim, Alice Patania, Mikael Vejdemo-Johansson

Abstract: Topology can extract the structural information in a dataset efficiently. In this paper, we attempt to incorporate topological information into a multiple output Gaussian process model for transfer learning purposes. To achieve this goal, we extend the framework of circular coordinates into a novel framework of mixed valued coordinates to take linear trends in the time series into consideration.… ▽ More Topology can extract the structural information in a dataset efficiently. In this paper, we attempt to incorporate topological information into a multiple output Gaussian process model for transfer learning purposes. To achieve this goal, we extend the framework of circular coordinates into a novel framework of mixed valued coordinates to take linear trends in the time series into consideration. One of the major challenges to learn from multiple time series effectively via a multiple output Gaussian process model is constructing a functional kernel. We propose to use topologically induced clustering to construct a cluster based kernel in a multiple output Gaussian process model. This kernel not only incorporates the topological structural information, but also allows us to put forward a unified framework using topological information in time and motion series. △ Less

Submitted 30 October, 2023; originally announced October 2023.

Comments: 7 pages, 4 figures

Journal ref: 2021 IEEE International Conference on Big Data (Big Data)

Multiband superconductivity and a deep gap minimum from the specific heat in KCa$_2$(Fe$_{1-x}$Ni$_x$)$_4$As$_4$F$_2$ ($x$ = 0, 0.05, 0.13)

Authors: Yiwen Li, Zhengyan Zhu, Yongze Ye, Wenshan Hong, Yang Li, Shiliang Li, Huiqian Luo, Hai-Hu Wen

Abstract: Specific heat can explore low-energy quasiparticle excitations of superconductors, so it is a powerful tool for bulk measurement on the superconducting gap structure and pairing symmetry. Here, we report an in-depth investigation on the specific heat of the multiband superconductors KCa$_2$(Fe$_{1-x}$Ni$_x$)$_4$As$_4$F$_2$ ($x$ = 0, 0.05, 0.13) single crystals and the overdoped non-superconducting… ▽ More Specific heat can explore low-energy quasiparticle excitations of superconductors, so it is a powerful tool for bulk measurement on the superconducting gap structure and pairing symmetry. Here, we report an in-depth investigation on the specific heat of the multiband superconductors KCa$_2$(Fe$_{1-x}$Ni$_x$)$_4$As$_4$F$_2$ ($x$ = 0, 0.05, 0.13) single crystals and the overdoped non-superconducting one with $x$ = 0.17. Clear specific heat anomalies can be observed at the superconducting transition temperature of 33.6 K and 28.8 K for the samples with $x$ = 0 and $x$ = 0.05, respectively. For the two samples, the magnetic field induced specific heat coefficient $Δγ(H)$ in the low-temperature limit increases rapidly below 2 T, then it rises slowly above 2 T. Using the non-superconducting sample with $x$ = 0.17 as a reference, the specific heat of phonon background for various superconducting samples can be obtained and subtracted, which allows us to extract the electronic specific heat of the superconducting samples. Through comparative analyses, it is found that the energy gap structure including two $s$-wave gaps and an extended $s$-wave gap with large anisotropy can reasonably describe the electronic specific heat data. According to these results, we suggest that at least one anisotropic superconducting gap with a deep gap minimum should exist in this multiband system. With the doping of Ni, the superconducting transition temperature of the sample decreases along with the decrease of the large $s$-wave gap, but the extended $s$-wave gap increases due to the enlarged electron pockets via adding more electrons. Despite these changes, the general properties of the gap structure remain unchanged versus doping Ni. △ Less

Submitted 19 January, 2024; v1 submitted 29 October, 2023; originally announced October 2023.

Journal ref: Physical Review B 109, 014506 (2024)

Deep Learning Enables Large Depth-of-Field Images for Sub-Diffraction-Limit Scanning Superlens Microscopy

Authors: Hui Sun, Hao Luo, Feifei Wang, Qingjiu Chen, Meng Chen, Xiaoduo Wang, Haibo Yu, Guanglie Zhang, Lianqing Liu, Jianping Wang, Dapeng Wu, Wen Jung Li

Abstract: Scanning electron microscopy (SEM) is indispensable in diverse applications ranging from microelectronics to food processing because it provides large depth-of-field images with a resolution beyond the optical diffraction limit. However, the technology requires coating conductive films on insulator samples and a vacuum environment. We use deep learning to obtain the mapping relationship between op… ▽ More Scanning electron microscopy (SEM) is indispensable in diverse applications ranging from microelectronics to food processing because it provides large depth-of-field images with a resolution beyond the optical diffraction limit. However, the technology requires coating conductive films on insulator samples and a vacuum environment. We use deep learning to obtain the mapping relationship between optical super-resolution (OSR) images and SEM domain images, which enables the transformation of OSR images into SEM-like large depth-of-field images. Our custom-built scanning superlens microscopy (SSUM) system, which requires neither coating samples by conductive films nor a vacuum environment, is used to acquire the OSR images with features down to ~80 nm. The peak signal-to-noise ratio (PSNR) and structural similarity index measure values indicate that the deep learning method performs excellently in image-to-image translation, with a PSNR improvement of about 0.74 dB over the optical super-resolution images. The proposed method provides a high level of detail in the reconstructed results, indicating that it has broad applicability to chip-level defect detection, biological sample analysis, forensics, and various other fields. △ Less

Submitted 27 October, 2023; originally announced October 2023.

Comments: 13 pages,7 figures

Orbital-angular-momentum dependent speckles for spatial mode sorting and multiplexed data transmission

Authors: Rui Ma, Ke Hai Luo, Zhao Wang, Jing Song He, Wei Li Zhang, Dian Yuan Fan, Anderson S. L. Gomes, Jun Liu

Abstract: Characterizing the orbital angular momentum (OAM) of a vortex beam is critically important for OAM-encoded data transfer. However, in typical OAM-based applications where vortex beams transmit through diffusers, the accompanying scattering effect tends to be either deliberately prevented, or characterized and then modulated actively based on complex wavefront shaping and interferometry techniques.… ▽ More Characterizing the orbital angular momentum (OAM) of a vortex beam is critically important for OAM-encoded data transfer. However, in typical OAM-based applications where vortex beams transmit through diffusers, the accompanying scattering effect tends to be either deliberately prevented, or characterized and then modulated actively based on complex wavefront shaping and interferometry techniques. Here, we aim to investigate the characteristics of blurred speckles obtained after a vortex beam transmits through a ground glass diffuser. It is theoretically and experimentally demonstrated that a cross-correlation annulus can be identified by implementing the cross-correlation operation between speckle patterns corresponding to vortex beams with different OAM values. Besides, it is worth noting that, the size of the cross-correlation annulus is determined by the absolute value of the topological charge difference between the two corresponding vortex beams. Based on this mechanism, the OAM modes can be easily sorted from the incoherently measured OAM-dependent speckles as well as their cross-correlation. Furthermore, to make full use of the orthogonal feature of the OAM-dependent speckles, demultiplexing of OAM-encoded data transfer is verified using a ground glass diffuser. Both 8-bit grayscale and 24-bit RGB OAM-encoded data transfers are carried out in experiments with superior error rates. We can conclude that the OAM-dependent speckles can be not only utilized as a competitive candidate for the OAM mode sorting function in a simple way but also provide an efficient method for the demultiplexing of OAM-encoded data transfer in a practical application. △ Less

Submitted 26 October, 2023; originally announced October 2023.

PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimization

Authors: Xinyuan Wang, Chenxi Li, Zhen Wang, Fan Bai, Haotian Luo, Jiayou Zhang, Nebojsa Jojic, Eric P. Xing, Zhiting Hu

Abstract: Highly effective, task-specific prompts are often heavily engineered by experts to integrate detailed instructions and domain insights based on a deep understanding of both instincts of large language models (LLMs) and the intricacies of the target task. However, automating the generation of such expert-level prompts remains elusive. Existing prompt optimization methods tend to overlook the depth… ▽ More Highly effective, task-specific prompts are often heavily engineered by experts to integrate detailed instructions and domain insights based on a deep understanding of both instincts of large language models (LLMs) and the intricacies of the target task. However, automating the generation of such expert-level prompts remains elusive. Existing prompt optimization methods tend to overlook the depth of domain knowledge and struggle to efficiently explore the vast space of expert-level prompts. Addressing this, we present PromptAgent, an optimization method that autonomously crafts prompts equivalent in quality to those handcrafted by experts. At its core, PromptAgent views prompt optimization as a strategic planning problem and employs a principled planning algorithm, rooted in Monte Carlo tree search, to strategically navigate the expert-level prompt space. Inspired by human-like trial-and-error exploration, PromptAgent induces precise expert-level insights and in-depth instructions by reflecting on model errors and generating constructive error feedback. Such a novel framework allows the agent to iteratively examine intermediate prompts (states), refine them based on error feedbacks (actions), simulate future rewards, and search for high-reward paths leading to expert prompts. We apply PromptAgent to 12 tasks spanning three practical domains: BIG-Bench Hard (BBH), as well as domain-specific and general NLP tasks, showing it significantly outperforms strong Chain-of-Thought and recent prompt optimization baselines. Extensive analyses emphasize its capability to craft expert-level, detailed, and domain-insightful prompts with great efficiency and generalizability. △ Less

Submitted 7 December, 2023; v1 submitted 25 October, 2023; originally announced October 2023.

Comments: 34 pages, 10 figures

Read Disturbance in High Bandwidth Memory: A Detailed Experimental Study on HBM2 DRAM Chips

Authors: Ataberk Olgun, Majd Osseiran, Abdullah Giray Yaglikci, Yahya Can Tugrul, Haocong Luo, Steve Rhyner, Behzad Salami, Juan Gomez Luna, Onur Mutlu

Abstract: We experimentally demonstrate the effects of read disturbance (RowHammer and RowPress) and uncover the inner workings of undocumented read disturbance defense mechanisms in High Bandwidth Memory (HBM). Detailed characterization of six real HBM2 DRAM chips in two different FPGA boards shows that (1) the read disturbance vulnerability significantly varies between different HBM2 chips and between dif… ▽ More We experimentally demonstrate the effects of read disturbance (RowHammer and RowPress) and uncover the inner workings of undocumented read disturbance defense mechanisms in High Bandwidth Memory (HBM). Detailed characterization of six real HBM2 DRAM chips in two different FPGA boards shows that (1) the read disturbance vulnerability significantly varies between different HBM2 chips and between different components (e.g., 3D-stacked channels) inside a chip, (2) DRAM rows at the end and in the middle of a bank are more resilient to read disturbance, (3) fewer additional activations are sufficient to induce more read disturbance bitflips in a DRAM row if the row exhibits the first bitflip at a relatively high activation count, (4) a modern HBM2 chip implements undocumented read disturbance defenses that track potential aggressor rows based on how many times they are activated. We describe how our findings could be leveraged to develop more powerful read disturbance attacks and more efficient defense mechanisms. We open source all our code and data to facilitate future research at https://github.com/CMU-SAFARI/HBM-Read-Disturbance. △ Less

Submitted 2 May, 2024; v1 submitted 23 October, 2023; originally announced October 2023.

Comments: To appear in DSN 2024

Superconductivity in the high-entropy ceramics Ti0.2Zr0.2Nb0.2Mo0.2Ta0.2Cx with possible nontrivial band topology

Authors: Lingyong Zeng, Xunwu Hu, Yazhou Zhou, Mebrouka Boubeche, Ruixin Guo, Yang Liu, Si-Chun Luo, Shu Guo, Kuan Li, Peifeng Yu, Chao Zhang, Wei-Ming Guo, Liling Sun, Dao-Xin Yao, Huixia Luo

Abstract: Topological superconductors have drawn significant interest from the scientific community due to the accompanying Majorana fermions. Here, we report the discovery of electronic structure and superconductivity in high-entropy ceramics Ti0.2Zr0.2Nb0.2Mo0.2Ta0.2Cx (x = 1 and 0.8) combined with experiments and first-principles calculations. The Ti0.2Zr0.2Nb0.2Mo0.2Ta0.2Cx high-entropy ceramics show bu… ▽ More Topological superconductors have drawn significant interest from the scientific community due to the accompanying Majorana fermions. Here, we report the discovery of electronic structure and superconductivity in high-entropy ceramics Ti0.2Zr0.2Nb0.2Mo0.2Ta0.2Cx (x = 1 and 0.8) combined with experiments and first-principles calculations. The Ti0.2Zr0.2Nb0.2Mo0.2Ta0.2Cx high-entropy ceramics show bulk type-II superconductivity with Tc about 4.00 K (x = 1) and 2.65 K (x = 0.8), respectively. The specific heat jump is equal to 1.45 (x = 1) and 1.52 (x = 0.8), close to the expected value of 1.43 for the BCS superconductor in the weak coupling limit. The high-pressure resistance measurements show that a robust superconductivity against high physical pressure in Ti0.2Zr0.2Nb0.2Mo0.2Ta0.2C, with a slight Tc variation of 0.3 K within 82.5 GPa. Furthermore, the first-principles calculations indicate that the Dirac-like point exists in the electronic band structures of Ti0.2Zr0.2Nb0.2Mo0.2Ta0.2C, which is potentially a topological superconductor. The Dirac-like point is mainly contributed by the d orbitals of transition metals M and the p orbitals of C. The high-entropy ceramics provide an excellent platform for the fabrication of novel quantum devices, and our study may spark significant future physics investigations in this intriguing material. △ Less

Submitted 22 October, 2023; originally announced October 2023.

Comments: 28 pages, 7 figures,The manuscript with the same title will be published by Advanced Science

ABACuS: All-Bank Activation Counters for Scalable and Low Overhead RowHammer Mitigation

Authors: Ataberk Olgun, Yahya Can Tugrul, Nisa Bostanci, Ismail Emir Yuksel, Haocong Luo, Steve Rhyner, Abdullah Giray Yaglikci, Geraldo F. Oliveira, Onur Mutlu

Abstract: We introduce ABACuS, a new low-cost hardware-counter-based RowHammer mitigation technique that performance-, energy-, and area-efficiently scales with worsening RowHammer vulnerability. We observe that both benign workloads and RowHammer attacks tend to access DRAM rows with the same row address in multiple DRAM banks at around the same time. Based on this observation, ABACuS's key idea is to use… ▽ More We introduce ABACuS, a new low-cost hardware-counter-based RowHammer mitigation technique that performance-, energy-, and area-efficiently scales with worsening RowHammer vulnerability. We observe that both benign workloads and RowHammer attacks tend to access DRAM rows with the same row address in multiple DRAM banks at around the same time. Based on this observation, ABACuS's key idea is to use a single shared row activation counter to track activations to the rows with the same row address in all DRAM banks. Unlike state-of-the-art RowHammer mitigation mechanisms that implement a separate row activation counter for each DRAM bank, ABACuS implements fewer counters (e.g., only one) to track an equal number of aggressor rows. Our evaluations show that ABACuS securely prevents RowHammer bitflips at low performance/energy overhead and low area cost. We compare ABACuS to four state-of-the-art mitigation mechanisms. At a near-future RowHammer threshold of 1000, ABACuS incurs only 0.58% (0.77%) performance and 1.66% (2.12%) DRAM energy overheads, averaged across 62 single-core (8-core) workloads, requiring only 9.47 KiB of storage per DRAM rank. At the RowHammer threshold of 1000, the best prior low-area-cost mitigation mechanism incurs 1.80% higher average performance overhead than ABACuS, while ABACuS requires 2.50X smaller chip area to implement. At a future RowHammer threshold of 125, ABACuS performs very similarly to (within 0.38% of the performance of) the best prior performance- and energy-efficient RowHammer mitigation mechanism while requiring 22.72X smaller chip area. ABACuS is freely and openly available at https://github.com/CMU-SAFARI/ABACuS. △ Less

Submitted 2 May, 2024; v1 submitted 15 October, 2023; originally announced October 2023.

Comments: To appear in USENIX Security '24

Order-disorder phase transition and elastic-to-plastic vortex creep crossover in a triclinic iron pnictide superconductor (Ca0.85La0.15)10(Pt3As8)(Fe2As2)5

Authors: Shyam Sundar, P. V. Lopes, S. Salem-Sugui, Jr., Z. -Z. Li, W. -S. Hong, H. -Q. Luo, S. -L. Li, L. Ghivelder

Abstract: Vortex matter in layered high-$T_c$ superconductors, including iron-pnictides, undergo several thermodynamic phase transitions due to the complex interplay of pinning energy, thermal energy and elastic energy. Moreover, the presence of anisotropy makes their vortex physics even more intriguing. Here, we report a detailed vortex dynamics study, using dc magnetization measurements, in a triclinic ir… ▽ More Vortex matter in layered high-$T_c$ superconductors, including iron-pnictides, undergo several thermodynamic phase transitions due to the complex interplay of pinning energy, thermal energy and elastic energy. Moreover, the presence of anisotropy makes their vortex physics even more intriguing. Here, we report a detailed vortex dynamics study, using dc magnetization measurements, in a triclinic iron-pnictide superconductor (Ca$_{0.85}$La$_{0.15}$)$_{10}$(Pt$_3$As$_8$)(Fe$_2$As$_2$)$_5$, with a superconducting transition temperature, T$_c$ $\sim$ 31 K. A second magnetization peak (SMP) feature is observed for magnetic field perpendicular ($H$$\parallel$$c$) and parallel ($H$$\parallel$$ab$) to the crystal plane. However, its fundamental origin is quite different in both directions. For $H$$\parallel$$c$, the SMP can be well explained using an elastic-to-plastic vortex creep crossover, using collective creep theory. In addition, a possible rhombic-to-square vortex lattice phase transition is also observed for fields in between the onset-field and peak-field related to the SMP. On the other hand, for $H$$\parallel$$ab$, a clear signature of an order-disorder vortex phase transition is observed in the isothermal $M$($H$) measurements at $T$ $\geq$ 6 K. The disordered phase exhibits the characteristics of entangled pinned vortex-liquid. We construct a comprehensive vortex phase diagram by displaying characteristic temperatures and magnetic fields for both crystal geometries in this unique superconducting compound. Our study sheds light on the intricate vortex dynamics and pinning in an iron-pnictide superconductor with triclinic symmetry. △ Less

Submitted 14 October, 2023; originally announced October 2023.

Comments: 14 Pages, 9 Figures

Journal ref: Scientific Reports 13, 16273 (2023)

An explicit evolution from Néel to striped antiferromagnetic states in the spin-1/2 $J_{1}$-$J_{2}$ Heisenberg model on the square lattice

Authors: Yun-Tong Yang, Fu-Zhou Chen, Chen Cheng, Hong-Gang Luo

Abstract: The frustrated spin-$1/2$ $J_1-J_2$ Heisenberg model on the square lattice has been extensively studied since 1988 because of its close relationship to the high-temperature superconductivity in cuprates and more importantly involved novel phase of matter in its own right, namely, quantum spin liquid (QSL), one of hot topics in condensed matter physics in recent years. However, the phase diagram of… ▽ More The frustrated spin-$1/2$ $J_1-J_2$ Heisenberg model on the square lattice has been extensively studied since 1988 because of its close relationship to the high-temperature superconductivity in cuprates and more importantly involved novel phase of matter in its own right, namely, quantum spin liquid (QSL), one of hot topics in condensed matter physics in recent years. However, the phase diagram of the model, particularly in the maximally frustrated regime $J_2/J_1 \sim 0.5$, is quite controversial, and more seriously the nature of the QSL is not clear at all. Here we provide a pattern picture, on one hand, to show explicitly how the system evolves from the Néel antiferromagnetic (AFM) state at small $J_2$ to the striped AFM one at large $J_2$; on the other hand, to uncover the nature of the QSL if it exists in the intermediate $J_2$ coupling regime. For simplicity, we show our results by taking the square lattice $L=L_x \times L_y$ with size $L_x=L_y=4$ here and periodic boundary condition is considered, and furthermore, exact diagonalization is employed to confirm the correctness of our picture. Our results indicate that the highly frustration regime is characterized by diagonal two-domain, while the Néel AFM state has a diagonal single-domain and the striped AFM state shows itself as a diagonal four-domain, namely, completely diagonal antiferromagnetic order, in the present case. Increasing the system size, the number of the diagonal domains increases correspondingly, but the diagonal single-domain for the Néel AFM state and the diagonal $L_{x(y)}$-domain for the striped AFM state remain unchanged. Our results shed light on the understanding of the QSL. △ Less

Submitted 13 October, 2023; originally announced October 2023.

Comments: 6 pages, 4 figures

ChatKBQA: A Generate-then-Retrieve Framework for Knowledge Base Question Answering with Fine-tuned Large Language Models

Authors: Haoran Luo, Haihong E, Zichen Tang, Shiyao Peng, Yikai Guo, Wentai Zhang, Chenghao Ma, Guanting Dong, Meina Song, Wei Lin, Yifan Zhu, Luu Anh Tuan

Abstract: Knowledge Base Question Answering (KBQA) aims to answer natural language questions over large-scale knowledge bases (KBs), which can be summarized into two crucial steps: knowledge retrieval and semantic parsing. However, three core challenges remain: inefficient knowledge retrieval, mistakes of retrieval adversely impacting semantic parsing, and the complexity of previous KBQA methods. To tackle… ▽ More Knowledge Base Question Answering (KBQA) aims to answer natural language questions over large-scale knowledge bases (KBs), which can be summarized into two crucial steps: knowledge retrieval and semantic parsing. However, three core challenges remain: inefficient knowledge retrieval, mistakes of retrieval adversely impacting semantic parsing, and the complexity of previous KBQA methods. To tackle these challenges, we introduce ChatKBQA, a novel and simple generate-then-retrieve KBQA framework, which proposes first generating the logical form with fine-tuned LLMs, then retrieving and replacing entities and relations with an unsupervised retrieval method, to improve both generation and retrieval more directly. Experimental results show that ChatKBQA achieves new state-of-the-art performance on standard KBQA datasets, WebQSP, and CWQ. This work can also be regarded as a new paradigm for combining LLMs with knowledge graphs (KGs) for interpretable and knowledge-required question answering. Our code is publicly available. △ Less

Submitted 30 May, 2024; v1 submitted 13 October, 2023; originally announced October 2023.

Comments: Accepted by Findings of ACL 2024

Journal ref: ACL 2024

Electrical and thermal control of Fabry-Pérot cavities mediated by Casimir forces

Authors: Lixin Ge, Bingzhong Li, Hao Luo, Ke Gong

Abstract: Dynamic tuning of optical cavities is highly desired in many photonic systems. Here, we show that Fabry-Pérot(FP) cavities can be actively controlled by the Casimir force. The optical FP cavities consist of a gold nanoplate confronted to an electrical-connecting multi-layer substrate in a liquid environment. The gold nanoplate can be stably suspended due to the balance of repulsive and attractive… ▽ More Dynamic tuning of optical cavities is highly desired in many photonic systems. Here, we show that Fabry-Pérot(FP) cavities can be actively controlled by the Casimir force. The optical FP cavities consist of a gold nanoplate confronted to an electrical-connecting multi-layer substrate in a liquid environment. The gold nanoplate can be stably suspended due to the balance of repulsive and attractive Casimir forces. Moreover, the suspension distance are modulated strongly by the electric gating or temperature of the system. As a result, we could shift the resonant wavelengthes of the cavities with tens of nanometers at optical frequencies. Finally, we analyze the influence of Brownian motion on the equilibrium distances. Due to the high Q-factor of the FP cavities, our proposed system offers a remarkable platform to experimentally investigate the thermal Casimir effect at sub-micrometer separations △ Less

Submitted 12 October, 2023; originally announced October 2023.

Comments: 6 pages, 5 figures

BC4LLM: Trusted Artificial Intelligence When Blockchain Meets Large Language Models

Authors: Haoxiang Luo, Jian Luo, Athanasios V. Vasilakos

Abstract: In recent years, artificial intelligence (AI) and machine learning (ML) are reshaping society's production methods and productivity, and also changing the paradigm of scientific research. Among them, the AI language model represented by ChatGPT has made great progress. Such large language models (LLMs) serve people in the form of AI-generated content (AIGC) and are widely used in consulting, healt… ▽ More In recent years, artificial intelligence (AI) and machine learning (ML) are reshaping society's production methods and productivity, and also changing the paradigm of scientific research. Among them, the AI language model represented by ChatGPT has made great progress. Such large language models (LLMs) serve people in the form of AI-generated content (AIGC) and are widely used in consulting, healthcare, and education. However, it is difficult to guarantee the authenticity and reliability of AIGC learning data. In addition, there are also hidden dangers of privacy disclosure in distributed AI training. Moreover, the content generated by LLMs is difficult to identify and trace, and it is difficult to cross-platform mutual recognition. The above information security issues in the coming era of AI powered by LLMs will be infinitely amplified and affect everyone's life. Therefore, we consider empowering LLMs using blockchain technology with superior security features to propose a vision for trusted AI. This paper mainly introduces the motivation and technical route of blockchain for LLM (BC4LLM), including reliable learning corpus, secure training process, and identifiable generated content. Meanwhile, this paper also reviews the potential applications and future challenges, especially in the frontier communication networks field, including network resource allocation, dynamic spectrum sharing, and semantic communication. Based on the above work combined and the prospect of blockchain and LLMs, it is expected to help the early realization of trusted AI and provide guidance for the academic community. △ Less

Submitted 9 October, 2023; originally announced October 2023.

Text2NKG: Fine-Grained N-ary Relation Extraction for N-ary relational Knowledge Graph Construction

Authors: Haoran Luo, Haihong E, Yuhao Yang, Tianyu Yao, Yikai Guo, Zichen Tang, Wentai Zhang, Kaiyang Wan, Shiyao Peng, Meina Song, Wei Lin

Abstract: Beyond traditional binary relational facts, n-ary relational knowledge graphs (NKGs) are comprised of n-ary relational facts containing more than two entities, which are closer to real-world facts with broader applications. However, the construction of NKGs still significantly relies on manual labor, and n-ary relation extraction still remains at a course-grained level, which is always in a single… ▽ More Beyond traditional binary relational facts, n-ary relational knowledge graphs (NKGs) are comprised of n-ary relational facts containing more than two entities, which are closer to real-world facts with broader applications. However, the construction of NKGs still significantly relies on manual labor, and n-ary relation extraction still remains at a course-grained level, which is always in a single schema and fixed arity of entities. To address these restrictions, we propose Text2NKG, a novel fine-grained n-ary relation extraction framework for n-ary relational knowledge graph construction. We introduce a span-tuple classification approach with hetero-ordered merging to accomplish fine-grained n-ary relation extraction in different arity. Furthermore, Text2NKG supports four typical NKG schemas: hyper-relational schema, event-based schema, role-based schema, and hypergraph-based schema, with high flexibility and practicality. Experimental results demonstrate that Text2NKG outperforms the previous state-of-the-art model by nearly 20\% points in the $F_1$ scores on the fine-grained n-ary relation extraction benchmark in the hyper-relational schema. Our code and datasets are publicly available. △ Less

Submitted 12 October, 2023; v1 submitted 8 October, 2023; originally announced October 2023.

Comments: Preprint

Online Learning in Contextual Second-Price Pay-Per-Click Auctions

Authors: Mengxiao Zhang, Haipeng Luo

Abstract: We study online learning in contextual pay-per-click auctions where at each of the $T$ rounds, the learner receives some context along with a set of ads and needs to make an estimate on their click-through rate (CTR) in order to run a second-price pay-per-click auction. The learner's goal is to minimize her regret, defined as the gap between her total revenue and that of an oracle strategy that al… ▽ More We study online learning in contextual pay-per-click auctions where at each of the $T$ rounds, the learner receives some context along with a set of ads and needs to make an estimate on their click-through rate (CTR) in order to run a second-price pay-per-click auction. The learner's goal is to minimize her regret, defined as the gap between her total revenue and that of an oracle strategy that always makes perfect CTR predictions. We first show that $\sqrt{T}$-regret is obtainable via a computationally inefficient algorithm and that it is unavoidable since our algorithm is no easier than the classical multi-armed bandit problem. A by-product of our results is a $\sqrt{T}$-regret bound for the simpler non-contextual setting, improving upon a recent work of [Feng et al., 2023] by removing the inverse CTR dependency that could be arbitrarily large. Then, borrowing ideas from recent advances on efficient contextual bandit algorithms, we develop two practically efficient contextual auction algorithms: the first one uses the exponential weight scheme with optimistic square errors and maintains the same $\sqrt{T}$-regret bound, while the second one reduces the problem to online regression via a simple epsilon-greedy strategy, albeit with a worse regret bound. Finally, we conduct experiments on a synthetic dataset to showcase the effectiveness and superior performance of our algorithms. △ Less

Submitted 8 October, 2023; originally announced October 2023.

Phase Synchrony Component Self-Organization in Brain Computer Interface

Authors: Xu Niu, Na Lu, Huan Luo, Ruofan Yan

Abstract: Phase synchrony information plays a crucial role in analyzing functional brain connectivity and identifying brain activities. A widely adopted feature extraction pipeline, composed of preprocessing, selection of EEG acquisition channels, and phase locking value (PLV) calculation, has achieved success in motor imagery classification (MI). However, this pipeline is manual and reliant on expert knowl… ▽ More Phase synchrony information plays a crucial role in analyzing functional brain connectivity and identifying brain activities. A widely adopted feature extraction pipeline, composed of preprocessing, selection of EEG acquisition channels, and phase locking value (PLV) calculation, has achieved success in motor imagery classification (MI). However, this pipeline is manual and reliant on expert knowledge, limiting its convenience and adaptability to different application scenarios. Moreover, most studies have employed mediocre data-independent spatial filters to suppress noise, impeding the exploration of more significant phase synchronization phenomena. To address the issues, we propose the concept of phase synchrony component self-organization, which enables the adaptive learning of data-dependent spatial filters for automating both the preprocessing and channel selection procedures. Based on this concept, the first deep learning end-to-end network is developed, which directly extracts phase synchrony-based features from raw EEG signals and perform classification. The network learns optimal filters during training, which are obtained when the network achieves peak classification results. Extensive experiments have demonstrated that our network outperforms state-of-the-art methods. Remarkably, through the learned optimal filters, significant phase synchronization phenomena can be observed. Specifically, by calculating the PLV between a pair of signals extracted from each sample using two of the learned spatial filters, we have obtained an average PLV exceeding 0.87 across all tongue MI samples. This high PLV indicates a groundbreaking discovery in the synchrony pattern of tongue MI. △ Less

Submitted 11 October, 2023; v1 submitted 21 September, 2023; originally announced October 2023.

On the Hardness of $\sf{S|LWE\rangle}$ with Gaussian and Other Amplitudes

Authors: Yilei Chen, Zihan Hu, Qipeng Liu, Han Luo, Yaxin Tu

Abstract: The learning with errors problem (LWE) is one of the most important building blocks for post-quantum cryptography. To better understand the quantum hardness of LWE, it is crucial to explore quantum variants of LWE, show quantum algorithms for those variants, or prove they are as hard as standard LWE. To this end, Chen, Liu, and Zhandry [Eurocrypt 2022] define the $\sf{S|LWE\rangle}$ problem, whi… ▽ More The learning with errors problem (LWE) is one of the most important building blocks for post-quantum cryptography. To better understand the quantum hardness of LWE, it is crucial to explore quantum variants of LWE, show quantum algorithms for those variants, or prove they are as hard as standard LWE. To this end, Chen, Liu, and Zhandry [Eurocrypt 2022] define the $\sf{S|LWE\rangle}$ problem, which encodes the error of LWE samples into quantum amplitudes. They then show efficient quantum algorithms for $\sf{S|LWE\rangle}$ with a few interesting amplitudes. However, the hardness of the most interesting amplitude, Gaussian, was not addressed by Chen et al., or only known for some restricted settings (for example, when the number of $\sf{S|LWE\rangle}$ samples is very small, it is well known that $\sf{S|LWE\rangle}$ is as hard as standard LWE). In this paper, we show new hardness and algorithms for $\sf{S|LWE\rangle}$ with Gaussian and other amplitudes. Our main results are 1. There exist quantum reductions from standard LWE or worst-case GapSVP to $\sf{S|LWE\rangle}$ with Gaussian amplitude with unknown phase, and arbitrarily many $\sf{S|LWE\rangle}$ samples. 2. There is a $2^{\widetilde{O}(\sqrt{n})}$-time algorithm for $\sf{S|LWE\rangle}$ with Gaussian amplitude with known phase, given $2^{\widetilde{O}(\sqrt{n})}$ many quantum samples. The algorithm is modified from Kuperberg's sieve, and in fact works for more general amplitudes as long as the amplitudes and phases are completely known. One way of interpreting our result is: to show a sub-exponential time quantum algorithm for standard LWE, all we need is to handle phases in $\sf{S|LWE\rangle}$ amplitudes better, either in the algorithm or the reduction. △ Less

Submitted 1 October, 2023; originally announced October 2023.

Comments: 40 pages, 3 figures

Self-Specialization: Uncovering Latent Expertise within Large Language Models

Authors: Junmo Kang, Hongyin Luo, Yada Zhu, Jacob Hansen, James Glass, David Cox, Alan Ritter, Rogerio Feris, Leonid Karlinsky

Abstract: Recent works have demonstrated the effectiveness of self-alignment in which a large language model is aligned to follow general instructions using instructional data generated from the model itself starting from a handful of human-written seeds. Instead of general alignment, in this work, we focus on self-alignment for expert domain specialization (e.g., biomedicine, finance). As a preliminary, we… ▽ More Recent works have demonstrated the effectiveness of self-alignment in which a large language model is aligned to follow general instructions using instructional data generated from the model itself starting from a handful of human-written seeds. Instead of general alignment, in this work, we focus on self-alignment for expert domain specialization (e.g., biomedicine, finance). As a preliminary, we quantitively show the marginal effect that generic instruction-following training has on downstream expert domains' performance. To remedy this, we propose self-specialization - allowing for effective model specialization while achieving cross-task generalization by leveraging only a few labeled seeds. Self-specialization offers a data- and parameter-efficient way of "carving out" an expert model out of a generalist pre-trained LLM. Exploring a variety of popular open large models as a base for specialization, our experimental results in both biomedical and financial domains show that our self-specialized models outperform their base models by a large margin, and even larger models that are generally instruction-tuned or that have been adapted to the target domain by other means. △ Less

Submitted 5 June, 2024; v1 submitted 29 September, 2023; originally announced October 2023.

Comments: ACL 2024 (Findings; Long Paper)

Symbiotic PBFT Consensus: Cognitive Backscatter Communications-enabled Wireless PBFT Consensus

Authors: Haoxiang Luo, Qianqian Zhang, Hongfang Yu, Gang Sun, Shizhong Xu

Abstract: Wireless blockchain networks have played an important role in many network scenarios, among which wireless Practical Byzantine Fault Tolerance (PBFT) consensus is regarded as one of the most important consensus mechanisms. It enables nodes in wireless networks to reach consistency without any trusted entity. However, due to the instability of wireless communication links, the reliability of the PB… ▽ More Wireless blockchain networks have played an important role in many network scenarios, among which wireless Practical Byzantine Fault Tolerance (PBFT) consensus is regarded as one of the most important consensus mechanisms. It enables nodes in wireless networks to reach consistency without any trusted entity. However, due to the instability of wireless communication links, the reliability of the PBFT consensus will be seriously affected. Meanwhile, it is difficult for nodes in wireless scenarios to obtain a timely energy supply. The high-energy-consumption blockchain functions will quickly consume the power of nodes, thus, affecting consensus performance. Fortunately, the symbiotic radio (SR) system enabled by cognitive backscatter communications can provide a solution to the above problems. In SR, the secondary transmitter (STx) transmits messages by modulating its information over the radio frequency (RF) signal of the primary transmitter (PTx) with extremely low energy consumption, and the STx can provide multipath gain to the PTx in return. In our paper, we propose the symbiotic PBFT (S-PBFT) consensus benefited from the mutualistic transmission in SR, which can increase the consensus security by 54.82%, and save energy consumption by about 10%. △ Less

Submitted 7 August, 2023; originally announced September 2023.

Comments: IEEE Global Communications Conference 2023

Exploring Small Language Models with Prompt-Learning Paradigm for Efficient Domain-Specific Text Classification

Authors: Hengyu Luo, Peng Liu, Stefan Esping

Abstract: Domain-specific text classification faces the challenge of scarce labeled data due to the high cost of manual labeling. Prompt-learning, known for its efficiency in few-shot scenarios, is proposed as an alternative to traditional fine-tuning methods. And besides, although large language models (LLMs) have gained prominence, small language models (SLMs, with under 1B parameters) offer significant c… ▽ More Domain-specific text classification faces the challenge of scarce labeled data due to the high cost of manual labeling. Prompt-learning, known for its efficiency in few-shot scenarios, is proposed as an alternative to traditional fine-tuning methods. And besides, although large language models (LLMs) have gained prominence, small language models (SLMs, with under 1B parameters) offer significant customizability, adaptability, and cost-effectiveness for domain-specific tasks, given industry constraints. In this study, we investigate the potential of SLMs combined with prompt-learning paradigm for domain-specific text classification, specifically within customer-agent interactions in retail. Our evaluations show that, in few-shot settings when prompt-based model fine-tuning is possible, T5-base, a typical SLM with 220M parameters, achieve approximately 75% accuracy with limited labeled data (up to 15% of full data), which shows great potentials of SLMs with prompt-learning. Based on this, We further validate the effectiveness of active few-shot sampling and the ensemble strategy in the prompt-learning pipeline that contribute to a remarkable performance gain. Besides, in zero-shot settings with a fixed model, we underscore a pivotal observation that, although the GPT-3.5-turbo equipped with around 154B parameters garners an accuracy of 55.16%, the power of well designed prompts becomes evident when the FLAN-T5-large, a model with a mere 0.5% of GPT-3.5-turbo's parameters, achieves an accuracy exceeding 31% with the optimized prompt, a leap from its sub-18% performance with an unoptimized one. Our findings underscore the promise of prompt-learning in classification tasks with SLMs, emphasizing the benefits of active few-shot sampling, and ensemble strategies in few-shot settings, and the importance of prompt engineering in zero-shot settings. △ Less

Submitted 26 September, 2023; originally announced September 2023.

Comments: 10 pages excluding appendix and reference

Joint Audio and Speech Understanding

Authors: Yuan Gong, Alexander H. Liu, Hongyin Luo, Leonid Karlinsky, James Glass

Abstract: Humans are surrounded by audio signals that include both speech and non-speech sounds. The recognition and understanding of speech and non-speech audio events, along with a profound comprehension of the relationship between them, constitute fundamental cognitive capabilities. For the first time, we build a machine learning model, called LTU-AS, that has a conceptually similar universal audio perce… ▽ More Humans are surrounded by audio signals that include both speech and non-speech sounds. The recognition and understanding of speech and non-speech audio events, along with a profound comprehension of the relationship between them, constitute fundamental cognitive capabilities. For the first time, we build a machine learning model, called LTU-AS, that has a conceptually similar universal audio perception and advanced reasoning ability. Specifically, by integrating Whisper as a perception module and LLaMA as a reasoning module, LTU-AS can simultaneously recognize and jointly understand spoken text, speech paralinguistics, and non-speech audio events - almost everything perceivable from audio signals. △ Less

Submitted 10 December, 2023; v1 submitted 25 September, 2023; originally announced September 2023.

Comments: Accepted at ASRU 2023. Code, dataset, and pretrained models are at https://github.com/yuangongnd/ltu. Interactive demo at https://huggingface.co/spaces/yuangongfdu/ltu-2

Beam Squint Assisted User Localization in Near-Field Integrated Sensing and Communications Systems

Authors: Hongliang Luo, Feifei Gao, Wanmai Yuan, Shun Zhang

Abstract: Integrated sensing and communication (ISAC) has been regarded as a key technology for 6G wireless communications, in which large-scale multiple input and multiple output (MIMO) array with higher and wider frequency bands will be adopted. However, recent studies show that the beam squint phenomenon can not be ignored in wideband MIMO system, which generally deteriorates the communications performan… ▽ More Integrated sensing and communication (ISAC) has been regarded as a key technology for 6G wireless communications, in which large-scale multiple input and multiple output (MIMO) array with higher and wider frequency bands will be adopted. However, recent studies show that the beam squint phenomenon can not be ignored in wideband MIMO system, which generally deteriorates the communications performance. In this paper, we find that with the aid of true-time-delay lines (TTDs), the range and trajectory of the beam squint in near-field communications systems can be freely controlled, and hence it is possible to reversely utilize the beam squint for user localization. We derive the trajectory equation for near-field beam squint points and design a way to control such trajectory. With the proposed design, beamforming from different subcarriers would purposely point to different angles and different distances, such that users from different positions would receive the maximum power at different subcarriers. Hence, one can simply localize multiple users from the beam squint effect in frequency domain, and thus reduce the beam sweeping overhead as compared to the conventional time domain beam search based approach. Furthermore, we utilize the phase difference of the maximum power subcarriers received by the user at different frequencies in several times beam sweeping to obtain a more accurate distance estimation result, ultimately realizing high accuracy and low beam sweeping overhead user localization. Simulation results demonstrate the effectiveness of the proposed schemes. △ Less

Submitted 25 September, 2023; originally announced September 2023.

Comments: This paper has been accepted by IEEE Transactions on Wireless Communications (TWC) on 18 September 2023

Integrated Sensing and Communications for IoT: Synergies with Key 6G Technology Enablers

Authors: Aryan Kaushik, Rohit Singh, Ming Li, Honghao Luo, Shalanika Dayarathna, Rajitha Senanayake, Xueli An, Richard A. Stirling-Gallacher, Wonjae Shin, Marco Di Renzo

Abstract: The Internet of Things (IoT) and wireless generations have been evolving simultaneously for the past few decades. Built upon wireless communication and sensing technologies, IoT networks are usually evaluated based on metrics that measure the device ability to sense information and effectively share it with the network, which makes Integrated Sensing and Communication (ISAC) a pivotal candidate fo… ▽ More The Internet of Things (IoT) and wireless generations have been evolving simultaneously for the past few decades. Built upon wireless communication and sensing technologies, IoT networks are usually evaluated based on metrics that measure the device ability to sense information and effectively share it with the network, which makes Integrated Sensing and Communication (ISAC) a pivotal candidate for the sixth-generation (6G) IoT standards. This paper reveals several innovative aspects of ISAC from an IoT perspective in 6G, empowering various modern IoT use cases and key technology enablers. Moreover, we address the challenges and future potential of ISAC-enabled IoT, including synergies with Reconfigurable Intelligent Surfaces (RIS), Artificial Intelligence (AI), and key updates of ISAC-IoT in 6G standardization. Furthermore, several evolutionary concepts are introduced to open future research in 6G ISAC-IoT, including the interplay with Non-Terrestrial Networks (NTN) and Orthogonal Time-Frequency Space (OTFS) modulation. △ Less

Submitted 23 September, 2023; originally announced September 2023.

Comments: 7 pages, 6 figures

Superconductivity in the cobalt-doped V3Si A15 intermetallic compound

Authors: Lingyong Zeng, Huawei Zhou, Hong Du, Ruidan Zhong, Ruixin Guo, Shu Guo, Wanzhen Su, Kuan Li, Chao Zhang, Peifeng Yu, Huixia Luo

Abstract: The A15 structure of superconductors is a prototypical type-II superconductor that has generated considerable interest since the early history of superconducting materials. This paper discusses the superconducting properties of previously unreported V3-xCoxSi alloys. It is found that the lattice parameter decreases with increasing cobalt-doped content and leads to an increased residual resistivity… ▽ More The A15 structure of superconductors is a prototypical type-II superconductor that has generated considerable interest since the early history of superconducting materials. This paper discusses the superconducting properties of previously unreported V3-xCoxSi alloys. It is found that the lattice parameter decreases with increasing cobalt-doped content and leads to an increased residual resistivity ratio (RRR) value of the V3-xCoxSi system. Meanwhile, the superconducting transition temperature (Tc) cobalt-doped content. Furthermore, the fitted data show that the increase of cobalt-doped content also reduces the lower/upper critical fields of the V3-xCoxSi system. Type-II superconductivity is demonstrated on all V3-xCoxSi samples. With higher Co-doped content, V3-xCoxSi alloys may have superconducting and structural phase transitions at low-temperature regions. As the electron/atom (e/a) ratio increases, the Tc variation trend of V3Si is as pronounced as in crystalline alloys and monotonically follows the trend observed for amorphous superconductors. △ Less

Submitted 20 September, 2023; originally announced September 2023.

Comments: 20 pages, 7 figures

Journal ref: Supercond. Sci. Technol.2023,36,035003

Natural Language Embedded Programs for Hybrid Language Symbolic Reasoning

Authors: Tianhua Zhang, Jiaxin Ge, Hongyin Luo, Yung-Sung Chuang, Mingye Gao, Yuan Gong, Xixin Wu, Yoon Kim, Helen Meng, James Glass

Abstract: How can we perform computations over natural language representations to solve tasks that require symbolic and numeric reasoning? We propose natural language embedded programs (NLEP) as a unifying framework for addressing math/symbolic reasoning, natural language understanding, and instruction following tasks. Our approach prompts a language model to generate full Python programs that define funct… ▽ More How can we perform computations over natural language representations to solve tasks that require symbolic and numeric reasoning? We propose natural language embedded programs (NLEP) as a unifying framework for addressing math/symbolic reasoning, natural language understanding, and instruction following tasks. Our approach prompts a language model to generate full Python programs that define functions over data structures which contain natural language representations of structured knowledge. A Python interpreter then executes the generated code and prints the output. Despite using a task-general prompt, we find that this approach can improve upon strong baselines across a range of different tasks including math and symbolic reasoning, text classification, question answering, and instruction following. We found that the generated programs are interpretable since they outline the exact reasoning process followed by the program interpreter. △ Less

Submitted 28 March, 2024; v1 submitted 19 September, 2023; originally announced September 2023.

Comments: NAACL 2024

A Unifying Perspective on Non-Stationary Kernels for Deeper Gaussian Processes

Authors: Marcus M. Noack, Hengrui Luo, Mark D. Risser

Abstract: The Gaussian process (GP) is a popular statistical technique for stochastic function approximation and uncertainty quantification from data. GPs have been adopted into the realm of machine learning in the last two decades because of their superior prediction abilities, especially in data-sparse scenarios, and their inherent ability to provide robust uncertainty estimates. Even so, their performanc… ▽ More The Gaussian process (GP) is a popular statistical technique for stochastic function approximation and uncertainty quantification from data. GPs have been adopted into the realm of machine learning in the last two decades because of their superior prediction abilities, especially in data-sparse scenarios, and their inherent ability to provide robust uncertainty estimates. Even so, their performance highly depends on intricate customizations of the core methodology, which often leads to dissatisfaction among practitioners when standard setups and off-the-shelf software tools are being deployed. Arguably the most important building block of a GP is the kernel function which assumes the role of a covariance operator. Stationary kernels of the Matérn class are used in the vast majority of applied studies; poor prediction performance and unrealistic uncertainty quantification are often the consequences. Non-stationary kernels show improved performance but are rarely used due to their more complicated functional form and the associated effort and expertise needed to define and tune them optimally. In this perspective, we want to help ML practitioners make sense of some of the most common forms of non-stationarity for Gaussian processes. We show a variety of kernels in action using representative datasets, carefully study their properties, and compare their performances. Based on our findings, we propose a new kernel that combines some of the identified advantages of existing kernels. △ Less

Submitted 18 September, 2023; originally announced September 2023.

Reconstructing bifurcation diagrams of chaotic circuits with reservoir computing

Authors: Haibo Luo, Yao Du, Huawei Fan, Xuan Wang, Jianzhong Guo, Xingang Wang

Abstract: Model-free reconstruction of the bifurcation diagrams of Chua's circuits by the technique of parameter-aware reservoir computing is investigated. We demonstrate that: (1) reservoir computer can be utilized as a noise filter to recover the system trajectory from noisy signals; (2) for a single Chua circuit, the machine trained by the noisy time series measured at several sampling states is capable… ▽ More Model-free reconstruction of the bifurcation diagrams of Chua's circuits by the technique of parameter-aware reservoir computing is investigated. We demonstrate that: (1) reservoir computer can be utilized as a noise filter to recover the system trajectory from noisy signals; (2) for a single Chua circuit, the machine trained by the noisy time series measured at several sampling states is capable of reconstructing the whole bifurcation diagram of the circuit with a high precision; (3) for two coupled chaotic Chua circuits of mismatched parameters, the machine trained by the noisy time series measured at several coupling strengths is able to anticipate the variation of the synchronization degree of the coupled circuits with respect to the coupling strength over a wide range. The studies verify the capability of the technique of parameter-aware reservoir computing in learning the dynamics of chaotic circuits from noisy signals, signifying the potential application of this technique in reconstructing the bifurcation diagram of real-world chaotic systems. △ Less

Submitted 12 September, 2023; originally announced September 2023.

Comments: 9 pages, 6 figures

Superconductivity in the bcc-type High-entropy Alloy TiHfNbTaMo

Authors: Lingyong Zeng, Jie Zhan, Mebrouka Boubeche, Kuan Li, Longfu Li, Peifeng Yu, Kangwang Wang, Chao Zhang, Kui Jin, Yan Sun, Huixia Luo

Abstract: X-ray powder diffraction, electrical resistivity, magnetization, and thermodynamic measurements were conducted to investigate the structure and superconducting properties of TiHfNbTaMo, a novel high-entropy alloy possessing a valence electron count (VEC) of 4.8. The TiHfNbTaMo HEA was discovered to have a body-centered cubic structure and a microscopically homogeneous distribution of the constitue… ▽ More X-ray powder diffraction, electrical resistivity, magnetization, and thermodynamic measurements were conducted to investigate the structure and superconducting properties of TiHfNbTaMo, a novel high-entropy alloy possessing a valence electron count (VEC) of 4.8. The TiHfNbTaMo HEA was discovered to have a body-centered cubic structure and a microscopically homogeneous distribution of the constituent elements. This material shows type-II superconductivity with Tc = 3.42 K, lower critical field with 22.8 mT, and upper critical field with 3.95 T. Low-temperature specific heat measurements show that the alloy is a conventional s-wave type with a moderately coupled superconductor. First-principles calculations show that the density of states (DOS) of the TiHfNbTaMo alloy is dominated by hybrid d orbitals of these five metal elements. Additionally, the TiHfNbTaMo HEA exhibits three van Hove singularities. Furthermore, the VEC and the composition of the elements (especially the Nb elemental content) affect the Tc of the bcc-type HEA. △ Less

Submitted 18 September, 2023; originally announced September 2023.

Comments: 19 pages, 6 figures,The manuscript with the same title will be published by Advanced Quantum Technologies

Journal ref: Advanced Quantum Technologies,2023

SCT: A Simple Baseline for Parameter-Efficient Fine-Tuning via Salient Channels

Authors: Henry Hengyuan Zhao, Pichao Wang, Yuyang Zhao, Hao Luo, Fan Wang, Mike Zheng Shou

Abstract: Pre-trained vision transformers have strong representation benefits to various downstream tasks. Recently, many parameter-efficient fine-tuning (PEFT) methods have been proposed, and their experiments demonstrate that tuning only 1\% extra parameters could surpass full fine-tuning in low-data resource scenarios. However, these methods overlook the task-specific information when fine-tuning diverse… ▽ More Pre-trained vision transformers have strong representation benefits to various downstream tasks. Recently, many parameter-efficient fine-tuning (PEFT) methods have been proposed, and their experiments demonstrate that tuning only 1\% extra parameters could surpass full fine-tuning in low-data resource scenarios. However, these methods overlook the task-specific information when fine-tuning diverse downstream tasks. In this paper, we propose a simple yet effective method called "Salient Channel Tuning" (SCT) to leverage the task-specific information by forwarding the model with the task images to select partial channels in a feature map that enables us to tune only 1/8 channels leading to significantly lower parameter costs. Experiments on 19 visual transfer learning downstream tasks demonstrate that our SCT outperforms full fine-tuning on 18 out of 19 tasks by adding only 0.11M parameters of the ViT-B, which is 780$\times$ fewer than its full fine-tuning counterpart. Furthermore, experiments on domain generalization and few-shot classification further demonstrate the effectiveness and generic of our approach. The code is available at https://github.com/showlab/SCT. △ Less

Submitted 29 April, 2024; v1 submitted 15 September, 2023; originally announced September 2023.

Comments: This work has been accepted by IJCV

OccupancyDETR: Using DETR for Mixed Dense-sparse 3D Occupancy Prediction

Authors: Yupeng Jia, Jie He, Runze Chen, Fang Zhao, Haiyong Luo

Abstract: Visual-based 3D semantic occupancy perception is a key technology for robotics, including autonomous vehicles, offering an enhanced understanding of the environment by 3D. This approach, however, typically requires more computational resources than BEV or 2D methods. We propose a novel 3D semantic occupancy perception method, OccupancyDETR, which utilizes a DETR-like object detection, a mixed dens… ▽ More Visual-based 3D semantic occupancy perception is a key technology for robotics, including autonomous vehicles, offering an enhanced understanding of the environment by 3D. This approach, however, typically requires more computational resources than BEV or 2D methods. We propose a novel 3D semantic occupancy perception method, OccupancyDETR, which utilizes a DETR-like object detection, a mixed dense-sparse 3D occupancy decoder. Our approach distinguishes between foreground and background within a scene. Initially, foreground objects are detected using the DETR-like object detection. Subsequently, queries for both foreground and background objects are fed into the mixed dense-sparse 3D occupancy decoder, performing upsampling in dense and sparse methods, respectively. Finally, a MaskFormer is utilized to infer the semantics of the background voxels. Our approach strikes a balance between efficiency and accuracy, achieving faster inference times, lower resource consumption, and improved performance for small object detection. We demonstrate the effectiveness of our proposed method on the SemanticKITTI dataset, showcasing an mIoU of 14 and a processing speed of 10 FPS, thereby presenting a promising solution for real-time 3D semantic occupancy perception. △ Less

Submitted 18 May, 2024; v1 submitted 15 September, 2023; originally announced September 2023.