Showing 151–200 of 998 results for author: Wei, Z

A Low-Cost Multi-Band Waveform Security Framework in Resource-Constrained Communications

Authors: Tongyang Xu, Zhongxiang Wei, Tianhua Xu, Gan Zheng

Abstract: Traditional physical layer secure beamforming is achieved via precoding before signal transmission using channel state information (CSI). However, imperfect CSI will compromise the performance with imperfect beamforming and potential information leakage. In addition, multiple RF chains and antennas are needed to support the narrow beam generation, which complicates hardware implementation and is n… ▽ More Traditional physical layer secure beamforming is achieved via precoding before signal transmission using channel state information (CSI). However, imperfect CSI will compromise the performance with imperfect beamforming and potential information leakage. In addition, multiple RF chains and antennas are needed to support the narrow beam generation, which complicates hardware implementation and is not suitable for resource-constrained Internet-of-Things (IoT) devices. Moreover, with the advancement of hardware and artificial intelligence (AI), low-cost and intelligent eavesdropping to wireless communications is becoming increasingly detrimental. In this paper, we propose a multi-carrier based multi-band waveform-defined security (WDS) framework, independent from CSI and RF chains, to defend against AI eavesdropping. Ideally, the continuous variations of sub-band structures lead to an infinite number of spectral features, which can potentially prevent brute-force eavesdropping. Sub-band spectral pattern information is efficiently constructed at legitimate users via a proposed chaotic sequence generator. A novel security metric, termed signal classification accuracy (SCA), is used to evaluate the security robustness under AI eavesdropping. Communication error probability and complexity are also investigated to show the reliability and practical capability of the proposed framework. Finally, compared to traditional secure beamforming techniques, the proposed multi-band WDS framework reduces power consumption by up to six times. △ Less

Submitted 1 February, 2024; originally announced February 2024.

CauESC: A Causal Aware Model for Emotional Support Conversation

Authors: Wei Chen, Hengxu Lin, Qun Zhang, Xiaojin Zhang, Xiang Bai, Xuanjing Huang, Zhongyu Wei

Abstract: Emotional Support Conversation aims at reducing the seeker's emotional distress through supportive response. Existing approaches have two limitations: (1) They ignore the emotion causes of the distress, which is important for fine-grained emotion understanding; (2) They focus on the seeker's own mental state rather than the emotional dynamics during interaction between speakers. To address these i… ▽ More Emotional Support Conversation aims at reducing the seeker's emotional distress through supportive response. Existing approaches have two limitations: (1) They ignore the emotion causes of the distress, which is important for fine-grained emotion understanding; (2) They focus on the seeker's own mental state rather than the emotional dynamics during interaction between speakers. To address these issues, we propose a novel framework CauESC, which firstly recognizes the emotion causes of the distress, as well as the emotion effects triggered by the causes, and then understands each strategy of verbal grooming independently and integrates them skillfully. Experimental results on the benchmark dataset demonstrate the effectiveness of our approach and show the benefits of emotion understanding from cause to effect and independent-integrated strategy modeling. △ Less

Submitted 31 January, 2024; originally announced January 2024.

Comments: 15 pages, 5 figures

ACM Class: I.2.7

Masked Pre-trained Model Enables Universal Zero-shot Denoiser

Authors: Xiaoxiao Ma, Zhixiang Wei, Yi Jin, Pengyang Ling, Tianle Liu, Ben Wang, Junkang Dai, Huaian Chen, Enhong Chen

Abstract: In this work, we observe that the model, which is trained on vast general images using masking strategy, has been naturally embedded with the distribution knowledge regarding natural images, and thus spontaneously attains the underlying potential for strong image denoising. Based on this observation, we propose a novel zero-shot denoising paradigm, i.e., Masked Pre-train then Iterative fill (MPI).… ▽ More In this work, we observe that the model, which is trained on vast general images using masking strategy, has been naturally embedded with the distribution knowledge regarding natural images, and thus spontaneously attains the underlying potential for strong image denoising. Based on this observation, we propose a novel zero-shot denoising paradigm, i.e., Masked Pre-train then Iterative fill (MPI). MPI pre-trains a model with masking and fine-tunes it for denoising of a single image with unseen noise degradation. Concretely, the proposed MPI comprises two key procedures: 1) Masked Pre-training involves training a model on multiple natural images with random masks to gather generalizable representations, allowing for practical applications in varying noise degradation and even in distinct image types. 2) Iterative filling is devised to efficiently fuse pre-trained knowledge for denoising. Similar to but distinct from pre-training, random masking is retained to bridge the gap, but only the predicted parts covered by masks are assembled for efficiency, which enables high-quality denoising within a limited number of iterations. Comprehensive experiments across various noisy scenarios underscore the notable advances of proposed MPI over previous approaches with a marked reduction in inference time. Code is available at https://github.com/krennic999/MPI.git. △ Less

Submitted 26 January, 2024; originally announced January 2024.

Comments: 11 pages, 9 figures

Ultra-broadband near-field Josephson microwave microscopy

Authors: Ping Zhang, Yang-Yang Lyu, Jingjing Lv, Zihan Wei, Shixian Chen, Chenguang Wang, Hongmei Du, Dingding Li, Zixi Wang, Shoucheng Hou, Runfeng Su, Hancong Sun, Yuan Du, Li Du, Liming Gao, Yong-Lei Wang, Huabing Wang, Peiheng Wu

Abstract: Advanced microwave technologies constitute the foundation of a wide range of modern sciences, including quantum computing, microwave photonics, spintronics, etc. To facilitate the design of chip-based microwave devices, there is an increasing demand for state-of-the-art microscopic techniques capable of characterizing the near-field microwave distribution and performance. In this work, we integrat… ▽ More Advanced microwave technologies constitute the foundation of a wide range of modern sciences, including quantum computing, microwave photonics, spintronics, etc. To facilitate the design of chip-based microwave devices, there is an increasing demand for state-of-the-art microscopic techniques capable of characterizing the near-field microwave distribution and performance. In this work, we integrate Josephson junctions onto a nano-sized quartz tip, forming a highly sensitive microwave mixer on-tip. This allows us to conduct spectroscopic imaging of near-field microwave distributions with high spatial resolution. Leveraging its microwave-sensitive characteristics, our Josephson microscope achieves a broad detecting bandwidth of up to 200 GHz with remarkable frequency and intensity sensitivities. Our work emphasizes the benefits of utilizing the Josephson microscope as a real-time, non-destructive technique to advance integrated microwave electronics. △ Less

Submitted 23 January, 2024; originally announced January 2024.

LR-CNN: Lightweight Row-centric Convolutional Neural Network Training for Memory Reduction

Authors: Zhigang Wang, Hangyu Yang, Ning Wang, Chuanfei Xu, Jie Nie, Zhiqiang Wei, Yu Gu, Ge Yu

Abstract: In the last decade, Convolutional Neural Network with a multi-layer architecture has advanced rapidly. However, training its complex network is very space-consuming, since a lot of intermediate data are preserved across layers, especially when processing high-dimension inputs with a big batch size. That poses great challenges to the limited memory capacity of current accelerators (e.g., GPUs). Exi… ▽ More In the last decade, Convolutional Neural Network with a multi-layer architecture has advanced rapidly. However, training its complex network is very space-consuming, since a lot of intermediate data are preserved across layers, especially when processing high-dimension inputs with a big batch size. That poses great challenges to the limited memory capacity of current accelerators (e.g., GPUs). Existing efforts mitigate such bottleneck by external auxiliary solutions with additional hardware costs, and internal modifications with potential accuracy penalty. Differently, our analysis reveals that computations intra- and inter-layers exhibit the spatial-temporal weak dependency and even complete independency features. That inspires us to break the traditional layer-by-layer (column) dataflow rule. Now operations are novelly re-organized into rows throughout all convolution layers. This lightweight design allows a majority of intermediate data to be removed without any loss of accuracy. We particularly study the weak dependency between two consecutive rows. For the resulting skewed memory consumption, we give two solutions with different favorite scenarios. Evaluations on two representative networks confirm the effectiveness. We also validate that our middle dataflow optimization can be smoothly embraced by existing works for better memory reduction. △ Less

Submitted 21 January, 2024; originally announced January 2024.

Accelerating Heterogeneous Tensor Parallelism via Flexible Workload Control

Authors: Zhigang Wang, Xu Zhang, Ning Wang, Chuanfei Xu, Jie Nie, Zhiqiang Wei, Yu Gu, Ge Yu

Abstract: Transformer-based models are becoming deeper and larger recently. For better scalability, an underlying training solution in industry is to split billions of parameters (tensors) into many tasks and then run them across homogeneous accelerators (e.g., GPUs). However, such dedicated compute cluster is prohibitively expensive in academia and moderate companies. An economic replacement is to aggregat… ▽ More Transformer-based models are becoming deeper and larger recently. For better scalability, an underlying training solution in industry is to split billions of parameters (tensors) into many tasks and then run them across homogeneous accelerators (e.g., GPUs). However, such dedicated compute cluster is prohibitively expensive in academia and moderate companies. An economic replacement is to aggregate existing heterogeneous devices and share resources among multi-tenants. Nevertheless, static hardware configurations and dynamic resource contention definitely cause straggling tasks, which heavily slows down the overall training efficiency. Existing works feature contributions mainly tailored for traditional data parallelism. They cannot work well for the new tensor parallelism due to strict communication and correctness constraints. In this paper we first present ZERO-resizing, a novel dynamic workload balancing technique without any data migration. We tune workloads in real-time by temporarily resizing matrices involved in core tensor-related computations. We particularly design data imputation and priority selection policies to respectively satisfy consistency constraint required by normal training and reduce the accuracy loss. We also give a lightweight data migration technique without loss of accuracy, to cope with heavy heterogeneity. Our final SEMI-migration solution is built on top of these two techniques and can adaptively distinguish their respective balancing missions, to achieve an overall success in efficiency and accuracy. Extensive experiments on the representative Colossal-AI platform validate the effectiveness of our proposals. △ Less

Submitted 21 January, 2024; originally announced January 2024.

Comments: 13 pages

Scaling Relations of Spectrum Form Factor and Krylov Complexity at Finite Temperature

Authors: Chengming Tan, Zhiyang Wei, Ren Zhang

Abstract: In the study of quantum chaos diagnostics, considerable attention has been attributed to the Krylov complexity and spectrum form factor (SFF) for systems at infinite temperature. These investigations have unveiled universal properties of quantum chaotic systems. By extending the analysis to include the finite temperature effects on the Krylov complexity and SFF, we demonstrate that the Lanczos coe… ▽ More In the study of quantum chaos diagnostics, considerable attention has been attributed to the Krylov complexity and spectrum form factor (SFF) for systems at infinite temperature. These investigations have unveiled universal properties of quantum chaotic systems. By extending the analysis to include the finite temperature effects on the Krylov complexity and SFF, we demonstrate that the Lanczos coefficients $b_n$, which are associated with the Wightman inner product, display consistency with the universal hypothesis presented in PRX 9, 041017 (2019). This result contrasts with the behavior of Lanczos coefficients associated with the standard inner product. Our results indicate that the slope $α$ of the $b_n$ is bounded by $πk_BT$, where $k_B$ is the Boltzmann constant and $T$ the temperature. We also investigate the SFF, which characterizes the two-point correlation of the spectrum and encapsulates an indicator of ergodicity denoted by $g$ in chaotic systems. Our analysis demonstrates that as the temperature decreases, the value of $g$ decreases as well. Considering that $α$ also represents the operator growth rate, we establish a quantitative relationship between ergodicity indicator and Lanczos coefficients slope. To support our findings, we provide evidence using the Gaussian orthogonal ensemble and a random spin model. Our work deepens the understanding of the finite temperature effects on Krylov complexity, SFF, and the connection between ergodicity and operator growth. △ Less

Submitted 19 January, 2024; originally announced January 2024.

Comments: 9 pages, 5 figures

High Confidence Level Inference is Almost Free using Parallel Stochastic Optimization

Authors: Wanrong Zhu, Zhipeng Lou, Ziyang Wei, Wei Biao Wu

Abstract: Uncertainty quantification for estimation through stochastic optimization solutions in an online setting has gained popularity recently. This paper introduces a novel inference method focused on constructing confidence intervals with efficient computation and fast convergence to the nominal level. Specifically, we propose to use a small number of independent multi-runs to acquire distribution info… ▽ More Uncertainty quantification for estimation through stochastic optimization solutions in an online setting has gained popularity recently. This paper introduces a novel inference method focused on constructing confidence intervals with efficient computation and fast convergence to the nominal level. Specifically, we propose to use a small number of independent multi-runs to acquire distribution information and construct a t-based confidence interval. Our method requires minimal additional computation and memory beyond the standard updating of estimates, making the inference process almost cost-free. We provide a rigorous theoretical guarantee for the confidence interval, demonstrating that the coverage is approximately exact with an explicit convergence rate and allowing for high confidence level inference. In particular, a new Gaussian approximation result is developed for the online estimators to characterize the coverage properties of our confidence intervals in terms of relative errors. Additionally, our method also allows for leveraging parallel computing to further accelerate calculations using multiple cores. It is easy to implement and can be integrated with existing stochastic algorithms without the need for complicated modifications. △ Less

Submitted 17 January, 2024; originally announced January 2024.

On the best constants of the noncommutative Littlewood-Paley-Stein inequalities

Authors: Zhenguo Wei, Hao Zhang

Abstract: Let $1<p<\infty$. Let $\{T_t\}_{t>0}$ be a noncommutative symmetric diffusion semigroup on a semifinite von Neumann algebra $\mathcal{M}$, and let $\{P_t\}_{t>0}$ be its associated subordinated Poisson semigroup. The celebrated noncommutative Littlewood-Paley-Stein inequality asserts that for any $x\in L_p(\mathcal{M})$, \begin{equation*} α_p^{-1}\|x\|_{p}\le \|x\|_{p,P}\le β_p \|x\|_{p}, \e… ▽ More Let $1<p<\infty$. Let $\{T_t\}_{t>0}$ be a noncommutative symmetric diffusion semigroup on a semifinite von Neumann algebra $\mathcal{M}$, and let $\{P_t\}_{t>0}$ be its associated subordinated Poisson semigroup. The celebrated noncommutative Littlewood-Paley-Stein inequality asserts that for any $x\in L_p(\mathcal{M})$, \begin{equation*} α_p^{-1}\|x\|_{p}\le \|x\|_{p,P}\le β_p \|x\|_{p}, \end{equation*} where $\|\cdot\|_{p,P}$ is the $L_p(\mathcal{M})$-norm of square functions associated with $\{P_t\}_{t>0}$, and $α_p, β_p$ are the best constants only depending on $p$. We show that as $p\to \infty$, $$ β_p\lesssim p, $$ and $p$ is the optimal possible order of $β_p$ as well. We also obtain some lower and upper bounds of $α_p$ and $β_p$ in the other cases. △ Less

Submitted 16 January, 2024; originally announced January 2024.

Boundedness of operator-valued commutators involving martingale paraproducts

Authors: Zhenguo Wei, Hao Zhang

Abstract: Let $1<p<\infty$. We show the boundedness of operator-valued commutators $[π_a,M_b]$ on the noncommutative $L_p(L_\infty(\mathbb{R})\otimes \mathcal{M})$ for any von Neumann algebra $\mathcal{M}$, where $π_a$ is the $d$-adic martingale paraproduct with symbol $a\in BMO^d(\mathbb{R})$ and $M_b$ is the noncommutative left multiplication operator with $b\in BMO^d_\mathcal{M}(\mathbb{R})$. Besides, we… ▽ More Let $1<p<\infty$. We show the boundedness of operator-valued commutators $[π_a,M_b]$ on the noncommutative $L_p(L_\infty(\mathbb{R})\otimes \mathcal{M})$ for any von Neumann algebra $\mathcal{M}$, where $π_a$ is the $d$-adic martingale paraproduct with symbol $a\in BMO^d(\mathbb{R})$ and $M_b$ is the noncommutative left multiplication operator with $b\in BMO^d_\mathcal{M}(\mathbb{R})$. Besides, we consider the extrapolation property of semicommutative $d$-adic martingale paraproducts in terms of the $BMO^d_\mathcal{M}(\mathbb{R})$ space. △ Less

Submitted 16 January, 2024; originally announced January 2024.

Human vs. LMMs: Exploring the Discrepancy in Emoji Interpretation and Usage in Digital Communication

Authors: Hanjia Lyu, Weihong Qi, Zhongyu Wei, Jiebo Luo

Abstract: Leveraging Large Multimodal Models (LMMs) to simulate human behaviors when processing multimodal information, especially in the context of social media, has garnered immense interest due to its broad potential and far-reaching implications. Emojis, as one of the most unique aspects of digital communication, are pivotal in enriching and often clarifying the emotional and tonal dimensions. Yet, ther… ▽ More Leveraging Large Multimodal Models (LMMs) to simulate human behaviors when processing multimodal information, especially in the context of social media, has garnered immense interest due to its broad potential and far-reaching implications. Emojis, as one of the most unique aspects of digital communication, are pivotal in enriching and often clarifying the emotional and tonal dimensions. Yet, there is a notable gap in understanding how these advanced models, such as GPT-4V, interpret and employ emojis in the nuanced context of online interaction. This study intends to bridge this gap by examining the behavior of GPT-4V in replicating human-like use of emojis. The findings reveal a discernible discrepancy between human and GPT-4V behaviors, likely due to the subjective nature of human interpretation and the limitations of GPT-4V's English-centric training, suggesting cultural biases and inadequate representation of non-English cultures. △ Less

Submitted 15 April, 2024; v1 submitted 16 January, 2024; originally announced January 2024.

Comments: Accepted for publication in ICWSM 2024

A note on Rational Maps with three branching points on the Riemann sphere

Authors: Zhiqiang Wei, Yingyi Wu, Bin Xu

Abstract: Studying the existence of rational functions with given branching datum is a classical problem in the field of complex analysis and algebraic geometry. This problem dates back to Hurwitz and remains open to this day. In this paper, we utilize complex analysis to establish a property of rational functions with 3 branching points on the Riemann sphere. Given two compact Riemann surfaces $M$ and $N$,… ▽ More Studying the existence of rational functions with given branching datum is a classical problem in the field of complex analysis and algebraic geometry. This problem dates back to Hurwitz and remains open to this day. In this paper, we utilize complex analysis to establish a property of rational functions with 3 branching points on the Riemann sphere. Given two compact Riemann surfaces $M$ and $N$, a pair $(d,\mathcal{D})$ of an integer $d\geq2$ and a collection $\mathcal{D}$ of nontrivial partitions of $d$ is called a candidate branching datum if it satisfies the Riemann-Hurwitz formula. And a candidate branching datum is exceptional if there does not exist a rational function realization it. As applications, we present some new types of exceptional branching datum. These results cover some previous results mentioned in \cite{EKS84,PP06,Zhu19}. We also deduce the realizability of a certain type of candidate branching datum on the Riemann sphere. △ Less

Submitted 28 May, 2024; v1 submitted 12 January, 2024; originally announced January 2024.

Comments: 9 pages. We have revised certain sentences, corrected several errors, and added additional content to enhance the clarity and depth of our paper. Comments are welcome

MSC Class: 57M12

Exploiting Polarized Material Cues for Robust Car Detection

Authors: Wen Dong, Haiyang Mei, Ziqi Wei, Ao Jin, Sen Qiu, Qiang Zhang, Xin Yang

Abstract: Car detection is an important task that serves as a crucial prerequisite for many automated driving functions. The large variations in lighting/weather conditions and vehicle densities of the scenes pose significant challenges to existing car detection algorithms to meet the highly accurate perception demand for safety, due to the unstable/limited color information, which impedes the extraction of… ▽ More Car detection is an important task that serves as a crucial prerequisite for many automated driving functions. The large variations in lighting/weather conditions and vehicle densities of the scenes pose significant challenges to existing car detection algorithms to meet the highly accurate perception demand for safety, due to the unstable/limited color information, which impedes the extraction of meaningful/discriminative features of cars. In this work, we present a novel learning-based car detection method that leverages trichromatic linear polarization as an additional cue to disambiguate such challenging cases. A key observation is that polarization, characteristic of the light wave, can robustly describe intrinsic physical properties of the scene objects in various imaging conditions and is strongly linked to the nature of materials for cars (e.g., metal and glass) and their surrounding environment (e.g., soil and trees), thereby providing reliable and discriminative features for robust car detection in challenging scenes. To exploit polarization cues, we first construct a pixel-aligned RGB-Polarization car detection dataset, which we subsequently employ to train a novel multimodal fusion network. Our car detection network dynamically integrates RGB and polarization features in a request-and-complement manner and can explore the intrinsic material properties of cars across all learning samples. We extensively validate our method and demonstrate that it outperforms state-of-the-art detection methods. Experimental results show that polarization is a powerful cue for car detection. △ Less

Submitted 4 January, 2024; originally announced January 2024.

Comments: Accepted by AAAI 2024

Generalized Spectral Form Factor in Random Matrix Theory

Authors: Zhiyang Wei, Chengming Tan, Ren Zhang

Abstract: The spectral form factor (SFF) plays a crucial role in revealing the statistical properties of energy level distributions in complex systems. It is one of the tools to diagnose quantum chaos and unravel the universal dynamics therein. The definition of SFF in most literature only encapsulates the two-level correlation. In this manuscript, we extend the definition of SSF to include the high-order c… ▽ More The spectral form factor (SFF) plays a crucial role in revealing the statistical properties of energy level distributions in complex systems. It is one of the tools to diagnose quantum chaos and unravel the universal dynamics therein. The definition of SFF in most literature only encapsulates the two-level correlation. In this manuscript, we extend the definition of SSF to include the high-order correlation. Specifically, we introduce the standard deviation of energy levels to define correlation functions, from which the generalized spectral form factor (GSFF) can be obtained by Fourier transforms. GSFF provides a more comprehensive knowledge of the dynamics of chaotic systems. Using random matrices as examples, we demonstrate new dynamics features that are encoded in GSFF. Remarkably, the GSFF is complex, and both the real and imaginary parts exhibit universal dynamics. For instance, in the two-level correlated case, the real part of GSFF shows a dip-ramp-plateau structure akin to the conventional counterpart, and the imaginary part for different system sizes converges in the long time limit. For the two-level GSFF, the closed analytical forms of the real part are obtained and consistent with numerical results. The results of the imaginary part are obtained by numerical calculation. Similar analyses are extended to three-level GSFF. △ Less

Submitted 14 January, 2024; v1 submitted 4 January, 2024; originally announced January 2024.

Comments: 10 pages, 6 figures

Consideration of non-phase-matched nonlinear effects in the design of quasi-phase-matching crystals for optical parametric oscillators

Authors: Zihua Zheng, Ziwen Tang, Zhiyi Wei, Jinghua Sun

Abstract: Femtosecond optical parametric oscillators (OPOs) are widely used in ultrafast nonlinear frequency conversion and quantum information. However, conventional OPOs based on quasi-phase-matching (QPM) crystals have many parasitic non-phase-matched processes which decreases the conversion efficiency. Here, we propose nine-wave coupled equations (NWCEs) to simulate all phase-matched and non-phase-match… ▽ More Femtosecond optical parametric oscillators (OPOs) are widely used in ultrafast nonlinear frequency conversion and quantum information. However, conventional OPOs based on quasi-phase-matching (QPM) crystals have many parasitic non-phase-matched processes which decreases the conversion efficiency. Here, we propose nine-wave coupled equations (NWCEs) to simulate all phase-matched and non-phase-matched interactions in QPM crystals to improve conventional three-wave coupled equations (TWCEs), especially for the situation of high intensity ultrashort pulses and complexly structured crystals. We discuss how to design the poling period of QPM crystal to maximize the conversion efficiency of signal light for a given OPO system. The simulation reveals that the OPO based on chirped periodically poled lithium niobate (CPPLN) with certain chirp rate has higher signal wave conversion efficiency than that of a PPLN, and demonstrates that NWCEs illustrates more details of the pulse evolution in the OPO cavity. Starting from a CPPLN, an aperiodically poled lithium niobate (APPLN) design is available by modifying the domain lengths of the crystal and optimizing the OPO output power via dynamical optimization algorithm. The results show that by using a properly designed APPLN crystal, a 1600nm OPO, when pumped by a femtosecond laser with 1030nm central wavelength, 150 femtosecond pulse duration and 5 GW/cm2 power intensity at the focus, can achieve very efficient output with a signal light conversion efficiency of 50.6%, which is higher than that of PPLN (25.2%) and CPPLN (40.2%). The scheme in this paper will provide a reference for the design of nonlinear QPM crystals of OPOs and will help to understand the complex nonlinear dynamical behavior in OPO cavities. △ Less

Submitted 15 April, 2024; v1 submitted 3 January, 2024; originally announced January 2024.

Comments: 23 pages

Approximating Single-Source Personalized PageRank with Absolute Error Guarantees

Authors: Zhewei Wei, Ji-Rong Wen, Mingji Yang

Abstract: Personalized PageRank (PPR) is an extensively studied and applied node proximity measure in graphs. For a pair of nodes $s$ and $t$ on a graph $G=(V,E)$, the PPR value $π(s,t)$ is defined as the probability that an $α$-discounted random walk from $s$ terminates at $t$, where the walk terminates with probability $α$ at each step. We study the classic Single-Source PPR query, which asks for PPR appr… ▽ More Personalized PageRank (PPR) is an extensively studied and applied node proximity measure in graphs. For a pair of nodes $s$ and $t$ on a graph $G=(V,E)$, the PPR value $π(s,t)$ is defined as the probability that an $α$-discounted random walk from $s$ terminates at $t$, where the walk terminates with probability $α$ at each step. We study the classic Single-Source PPR query, which asks for PPR approximations from a given source node $s$ to all nodes in the graph. Specifically, we aim to provide approximations with absolute error guarantees, ensuring that the resultant PPR estimates $\hatπ(s,t)$ satisfy $\max_{t\in V}\big|\hatπ(s,t)-π(s,t)\big|\le\varepsilon$ for a given error bound $\varepsilon$. We propose an algorithm that achieves this with high probability, with an expected running time of - $\widetilde{O}\big(\sqrt{m}/\varepsilon\big)$ for directed graphs, where $m=|E|$; - $\widetilde{O}\big(\sqrt{d_{\mathrm{max}}}/\varepsilon\big)$ for undirected graphs, where $d_{\mathrm{max}}$ is the maximum node degree in the graph; - $\widetilde{O}\left(n^{γ-1/2}/\varepsilon\right)$ for power-law graphs, where $n=|V|$ and $γ\in\left(\frac{1}{2},1\right)$ is the extent of the power law. These sublinear bounds improve upon existing results. We also study the case when degree-normalized absolute error guarantees are desired, requiring $\max_{t\in V}\big|\hatπ(s,t)/d(t)-π(s,t)/d(t)\big|\le\varepsilon_d$ for a given error bound $\varepsilon_d$, where the graph is undirected and $d(t)$ is the degree of node $t$. We give an algorithm that provides this error guarantee with high probability, achieving an expected complexity of $\widetilde{O}\left(\sqrt{\sum_{t\in V}π(s,t)/d(t)}\big/\varepsilon_d\right)$. This improves over the previously known $O(1/\varepsilon_d)$ complexity. △ Less

Submitted 1 January, 2024; originally announced January 2024.

Comments: 25 pages, ICDT 2024

Jatmo: Prompt Injection Defense by Task-Specific Finetuning

Authors: Julien Piet, Maha Alrashed, Chawin Sitawarin, Sizhe Chen, Zeming Wei, Elizabeth Sun, Basel Alomair, David Wagner

Abstract: Large Language Models (LLMs) are attracting significant research attention due to their instruction-following abilities, allowing users and developers to leverage LLMs for a variety of tasks. However, LLMs are vulnerable to prompt-injection attacks: a class of attacks that hijack the model's instruction-following abilities, changing responses to prompts to undesired, possibly malicious ones. In th… ▽ More Large Language Models (LLMs) are attracting significant research attention due to their instruction-following abilities, allowing users and developers to leverage LLMs for a variety of tasks. However, LLMs are vulnerable to prompt-injection attacks: a class of attacks that hijack the model's instruction-following abilities, changing responses to prompts to undesired, possibly malicious ones. In this work, we introduce Jatmo, a method for generating task-specific models resilient to prompt-injection attacks. Jatmo leverages the fact that LLMs can only follow instructions once they have undergone instruction tuning. It harnesses a teacher instruction-tuned model to generate a task-specific dataset, which is then used to fine-tune a base model (i.e., a non-instruction-tuned model). Jatmo only needs a task prompt and a dataset of inputs for the task: it uses the teacher model to generate outputs. For situations with no pre-existing datasets, Jatmo can use a single example, or in some cases none at all, to produce a fully synthetic dataset. Our experiments on seven tasks show that Jatmo models provide similar quality of outputs on their specific task as standard LLMs, while being resilient to prompt injections. The best attacks succeeded in less than 0.5% of cases against our models, versus 87% success rate against GPT-3.5-Turbo. We release Jatmo at https://github.com/wagner-group/prompt-injection-defense. △ Less

Submitted 8 January, 2024; v1 submitted 29 December, 2023; originally announced December 2023.

Comments: 24 pages, 6 figures

Square Moiré Superlattices in Twisted Two-Dimensional Halide Perovskites

Authors: Shuchen Zhang, Linrui Jin, Yuan Lu, Linghai Zhang, Jiaqi Yang, Qiuchen Zhao, Dewei Sun, Joshua J. P. Thompson, Biao Yuan, Ke Ma, Akriti, Jee Yung Park, Yoon Ho Lee, Zitang Wei, Blake P. Finkenauer, Daria D. Blach, Sarath Kumar, Hailin Peng, Arun Mannodi-Kanakkithodi, Yi Yu, Ermin Malic, Gang Lu, Letian Dou, Libai Huang

Abstract: Moiré superlattices have emerged as a new platform for studying strongly correlated quantum phenomena, but these systems have been largely limited to van der Waals layer two-dimensional (2D) materials. Here we introduce moiré superlattices leveraging ultra-thin, ligand-free halide perovskites, facilitated by ionic interactions. Square moiré superlattices with varying periodic lengths are clearly v… ▽ More Moiré superlattices have emerged as a new platform for studying strongly correlated quantum phenomena, but these systems have been largely limited to van der Waals layer two-dimensional (2D) materials. Here we introduce moiré superlattices leveraging ultra-thin, ligand-free halide perovskites, facilitated by ionic interactions. Square moiré superlattices with varying periodic lengths are clearly visualized through high-resolution transmission electron microscopy. Twist-angle-dependent transient photoluminescence microscopy and electrical characterizations indicate the emergence of localized bright excitons and trapped charge carriers near a twist angle of ~10°. The localized excitons are accompanied by enhanced exciton emission, attributed to an increased oscillator strength by a theoretically forecasted flat band. This work illustrates the potential of extended ionic interaction in realizing moiré physics at room temperature, broadening the horizon for future investigations. △ Less

Submitted 27 December, 2023; originally announced December 2023.

Semantic-aware SAM for Point-Prompted Instance Segmentation

Authors: Zhaoyang Wei, Pengfei Chen, Xuehui Yu, Guorong Li, Jianbin Jiao, Zhenjun Han

Abstract: Single-point annotation in visual tasks, with the goal of minimizing labelling costs, is becoming increasingly prominent in research. Recently, visual foundation models, such as Segment Anything (SAM), have gained widespread usage due to their robust zero-shot capabilities and exceptional annotation performance. However, SAM's class-agnostic output and high confidence in local segmentation introdu… ▽ More Single-point annotation in visual tasks, with the goal of minimizing labelling costs, is becoming increasingly prominent in research. Recently, visual foundation models, such as Segment Anything (SAM), have gained widespread usage due to their robust zero-shot capabilities and exceptional annotation performance. However, SAM's class-agnostic output and high confidence in local segmentation introduce 'semantic ambiguity', posing a challenge for precise category-specific segmentation. In this paper, we introduce a cost-effective category-specific segmenter using SAM. To tackle this challenge, we have devised a Semantic-Aware Instance Segmentation Network (SAPNet) that integrates Multiple Instance Learning (MIL) with matching capability and SAM with point prompts. SAPNet strategically selects the most representative mask proposals generated by SAM to supervise segmentation, with a specific focus on object category information. Moreover, we introduce the Point Distance Guidance and Box Mining Strategy to mitigate inherent challenges: 'group' and 'local' issues in weakly supervised segmentation. These strategies serve to further enhance the overall segmentation performance. The experimental results on Pascal VOC and COCO demonstrate the promising performance of our proposed SAPNet, emphasizing its semantic matching capabilities and its potential to advance point-prompted instance segmentation. The code will be made publicly available. △ Less

Submitted 26 May, 2024; v1 submitted 26 December, 2023; originally announced December 2023.

Comments: 16 pages, 8 figures, CVPR2024

Masked Contrastive Reconstruction for Cross-modal Medical Image-Report Retrieval

Authors: Zeqiang Wei, Kai Jin, Xiuzhuang Zhou

Abstract: Cross-modal medical image-report retrieval task plays a significant role in clinical diagnosis and various medical generative tasks. Eliminating heterogeneity between different modalities to enhance semantic consistency is the key challenge of this task. The current Vision-Language Pretraining (VLP) models, with cross-modal contrastive learning and masked reconstruction as joint training tasks, ca… ▽ More Cross-modal medical image-report retrieval task plays a significant role in clinical diagnosis and various medical generative tasks. Eliminating heterogeneity between different modalities to enhance semantic consistency is the key challenge of this task. The current Vision-Language Pretraining (VLP) models, with cross-modal contrastive learning and masked reconstruction as joint training tasks, can effectively enhance the performance of cross-modal retrieval. This framework typically employs dual-stream inputs, using unmasked data for cross-modal contrastive learning and masked data for reconstruction. However, due to task competition and information interference caused by significant differences between the inputs of the two proxy tasks, the effectiveness of representation learning for intra-modal and cross-modal features is limited. In this paper, we propose an efficient VLP framework named Masked Contrastive and Reconstruction (MCR), which takes masked data as the sole input for both tasks. This enhances task connections, reducing information interference and competition between them, while also substantially decreasing the required GPU memory and training time. Moreover, we introduce a new modality alignment strategy named Mapping before Aggregation (MbA). Unlike previous methods, MbA maps different modalities to a common feature space before conducting local feature aggregation, thereby reducing the loss of fine-grained semantic information necessary for improved modality alignment. Qualitative and quantitative experiments conducted on the MIMIC-CXR dataset validate the effectiveness of our approach, demonstrating state-of-the-art performance in medical cross-modal retrieval tasks. △ Less

Submitted 26 December, 2023; v1 submitted 25 December, 2023; originally announced December 2023.

Sensing-Enhanced Secure Communication: Joint Time Allocation and Beamforming Design

Authors: Dongfang Xu, Yiming Xu, Zhiqiang Wei, Shenghui Song, Derrick Wing Kwan Ng

Abstract: The integration of sensing and communication enables wireless communication systems to serve environment-aware applications. In this paper, we propose to leverage sensing to enhance physical layer security (PLS) in multiuser communication systems in the presence of a suspicious target. To this end, we develop a two-phase framework to first estimate the location of the potential eavesdropper by sen… ▽ More The integration of sensing and communication enables wireless communication systems to serve environment-aware applications. In this paper, we propose to leverage sensing to enhance physical layer security (PLS) in multiuser communication systems in the presence of a suspicious target. To this end, we develop a two-phase framework to first estimate the location of the potential eavesdropper by sensing and then utilize the estimated information to enhance PLS for communication. In particular, in the first phase, a dual-functional radar and communication (DFRC) base station (BS) exploits a sensing signal to mitigate the sensing information uncertainty of the potential eavesdropper. Then, in the second phase, to facilitate joint sensing and secure communication, the DFRC BS employs beamforming and artificial noise to enhance secure communication. The design objective is to maximize the system sum rate while alleviating the information leakage by jointly optimizing the time allocation and beamforming policy. Capitalizing on monotonic optimization theory, we develop a two-layer globally optimal algorithm to reveal the performance upper bound of the considered system. Simulation results show that the proposed scheme achieves a significant sum rate gain over two baseline schemes that adopt existing techniques. Moreover, our results unveil that ISAC is a promising paradigm for enhancing secure communication in wireless networks. △ Less

Submitted 23 December, 2023; originally announced December 2023.

Comments: 9 pages,3 figures

Argue with Me Tersely: Towards Sentence-Level Counter-Argument Generation

Authors: Jiayu Lin, Rong Ye, Meng Han, Qi Zhang, Ruofei Lai, Xinyu Zhang, Zhao Cao, Xuanjing Huang, Zhongyu Wei

Abstract: Counter-argument generation -- a captivating area in computational linguistics -- seeks to craft statements that offer opposing views. While most research has ventured into paragraph-level generation, sentence-level counter-argument generation beckons with its unique constraints and brevity-focused challenges. Furthermore, the diverse nature of counter-arguments poses challenges for evaluating mod… ▽ More Counter-argument generation -- a captivating area in computational linguistics -- seeks to craft statements that offer opposing views. While most research has ventured into paragraph-level generation, sentence-level counter-argument generation beckons with its unique constraints and brevity-focused challenges. Furthermore, the diverse nature of counter-arguments poses challenges for evaluating model performance solely based on n-gram-based metrics. In this paper, we present the ArgTersely benchmark for sentence-level counter-argument generation, drawing from a manually annotated dataset from the ChangeMyView debate forum. We also propose Arg-LlaMA for generating high-quality counter-argument. For better evaluation, we trained a BERT-based evaluator Arg-Judge with human preference data. We conducted comparative experiments involving various baselines such as LlaMA, Alpaca, GPT-3, and others. The results show the competitiveness of our proposed framework and evaluator in counter-argument generation tasks. Code and data are available at https://github.com/amazingljy1206/ArgTersely. △ Less

Submitted 21 December, 2023; originally announced December 2023.

Comments: EMNLP2023, main conference

Imagining density distribution of molecular orbitals in IR+XUV co-rotating circular laser fields by frequency-domain theory

Authors: Yu-Hong Li, Facheng Jin, Yujun Yang, Fei Li, Ying-Chun Guo, Zhi-Yi Wei, Jing Chen, Xiaojun Liu, Bingbing Wang

Abstract: We have investigated the angle-resolved ATI spectrum of oriented molecules in the IR+XUV co-rotating circular laser fields. According to the different roles of IR and XUV laser in the ionization process, we purposefully adjust the photon energy of XUV and the intensity of IR laser to make the ionization spectrum of the molecule distributed in a suitable momentum region. Moreover, under the same la… ▽ More We have investigated the angle-resolved ATI spectrum of oriented molecules in the IR+XUV co-rotating circular laser fields. According to the different roles of IR and XUV laser in the ionization process, we purposefully adjust the photon energy of XUV and the intensity of IR laser to make the ionization spectrum of the molecule distributed in a suitable momentum region. Moreover, under the same laser conditions, the background fringes in the ionization spectrum of the molecule can be removed by using the ionization spectrum of the atom with the same ionization energy as the molecule, so that the molecular orbital density distribution in the suitable momentum region can be obtained. That is, for any unknown molecule, as long as the ionization energy of the molecule can be measured, the density distribution of the molecular orbital can be imaged in a definite momentum region by adjusting the laser field conditions, which may shed light on the experimental detection of molecular orbitals. △ Less

Submitted 12 January, 2024; v1 submitted 20 December, 2023; originally announced December 2023.

ClassLIE: Structure- and Illumination-Adaptive Classification for Low-Light Image Enhancement

Authors: Zixiang Wei, Yiting Wang, Lichao Sun, Athanasios V. Vasilakos, Lin Wang

Abstract: Low-light images often suffer from limited visibility and multiple types of degradation, rendering low-light image enhancement (LIE) a non-trivial task. Some endeavors have been recently made to enhance low-light images using convolutional neural networks (CNNs). However, they have low efficiency in learning the structural information and diverse illumination levels at the local regions of an imag… ▽ More Low-light images often suffer from limited visibility and multiple types of degradation, rendering low-light image enhancement (LIE) a non-trivial task. Some endeavors have been recently made to enhance low-light images using convolutional neural networks (CNNs). However, they have low efficiency in learning the structural information and diverse illumination levels at the local regions of an image. Consequently, the enhanced results are affected by unexpected artifacts, such as unbalanced exposure, blur, and color bias. To this end, this paper proposes a novel framework, called ClassLIE, that combines the potential of CNNs and transformers. It classifies and adaptively learns the structural and illumination information from the low-light images in a holistic and regional manner, thus showing better enhancement performance. Our framework first employs a structure and illumination classification (SIC) module to learn the degradation information adaptively. In SIC, we decompose an input image into an illumination map and a reflectance map. A class prediction block is then designed to classify the degradation information by calculating the structure similarity scores on the reflectance map and mean square error on the illumination map. As such, each input image can be divided into patches with three enhancement difficulty levels. Then, a feature learning and fusion (FLF) module is proposed to adaptively learn the feature information with CNNs for different enhancement difficulty levels while learning the long-range dependencies for the patches in a holistic manner. Experiments on five benchmark datasets consistently show our ClassLIE achieves new state-of-the-art performance, with 25.74 PSNR and 0.92 SSIM on the LOL dataset. △ Less

Submitted 20 December, 2023; originally announced December 2023.

Optimal BER Minimum Precoder Design for OTFS-Based ISAC Systems

Authors: Jun Wu, Weijie Yuan, Zhiqiang Wei, Jinjin Yan, Derrick Wing Kwan Ng

Abstract: This paper investigates the bit error rate (BER) minimum pre-coder design for an orthogonal time frequency space (OTFS)-based integrated sensing and communications (ISAC) system, which is considered as a promising technique for enabling future wireless networks. In particular, the BER minimum problem takes into account the maximized available transmission power and the required sensing performance… ▽ More This paper investigates the bit error rate (BER) minimum pre-coder design for an orthogonal time frequency space (OTFS)-based integrated sensing and communications (ISAC) system, which is considered as a promising technique for enabling future wireless networks. In particular, the BER minimum problem takes into account the maximized available transmission power and the required sensing performance. We devise the precoder from the perspective of delay-Doppler (DD) domain by exploiting the equivalent DD channel. To address the non-convex design problem, we resort to minimizing the lower bound of the derived average BER. Afterwards, we propose a computationally iterative method to solve the dual problem at low cost. Simulation results verify the effectiveness of our proposed precoder and reveal the interplay between sensing and communication for dual-functional precoder design. △ Less

Submitted 19 December, 2023; originally announced December 2023.

ToViLaG: Your Visual-Language Generative Model is Also An Evildoer

Authors: Xinpeng Wang, Xiaoyuan Yi, Han Jiang, Shanlin Zhou, Zhihua Wei, Xing Xie

Abstract: Warning: this paper includes model outputs showing offensive content. Recent large-scale Visual-Language Generative Models (VLGMs) have achieved unprecedented improvement in multimodal image/text generation. However, these models might also generate toxic content, e.g., offensive text and pornography images, raising significant ethical risks. Despite exhaustive studies on toxic degeneration of lan… ▽ More Warning: this paper includes model outputs showing offensive content. Recent large-scale Visual-Language Generative Models (VLGMs) have achieved unprecedented improvement in multimodal image/text generation. However, these models might also generate toxic content, e.g., offensive text and pornography images, raising significant ethical risks. Despite exhaustive studies on toxic degeneration of language models, this problem remains largely unexplored within the context of visual-language generation. This work delves into the propensity for toxicity generation and susceptibility to toxic data across various VLGMs. For this purpose, we built ToViLaG, a dataset comprising 32K co-toxic/mono-toxic text-image pairs and 1K innocuous but evocative text that tends to stimulate toxicity. Furthermore, we propose WInToRe, a novel toxicity metric tailored to visual-language generation, which theoretically reflects different aspects of toxicity considering both input and output. On such a basis, we benchmarked the toxicity of a diverse spectrum of VLGMs and discovered that some models do more evil than expected while some are more vulnerable to infection, underscoring the necessity of VLGMs detoxification. Therefore, we develop an innovative bottleneck-based detoxification method. Our method could reduce toxicity while maintaining comparable generation quality, providing a promising initial solution to this line of research. △ Less

Submitted 13 December, 2023; originally announced December 2023.

Comments: Accepted by EMNLP 2023 (Main Conference), Oral Presentation

Atomic-site dependent pairing gap in monolayer FeSe/SrTiO$_3$(001)- ($\sqrt{13} \times \sqrt{13}$)

Authors: Cui Ding, Zhongxu Wei, Wenfeng Dong, Hai Feng, Mingxia Shi, Lili Wang, Jin-Feng Jia, Qi-Kun Xue

Abstract: The interfacial FeSe/TiO$_{2-δ}$ coupling induces high-temperature superconductivity in monolayer FeSe films. Using cryogenic atomically resolved scanning tunneling microscopy/spectroscopy, we obtained atomic-site dependent surface density of states, work function, and pairing gap in the monolayer FeSe on SrTiO$_3$(001)-($\sqrt{13} \times \sqrt{13}$)-33.7$°$ surface. Our results disclosed the out-… ▽ More The interfacial FeSe/TiO$_{2-δ}$ coupling induces high-temperature superconductivity in monolayer FeSe films. Using cryogenic atomically resolved scanning tunneling microscopy/spectroscopy, we obtained atomic-site dependent surface density of states, work function, and pairing gap in the monolayer FeSe on SrTiO$_3$(001)-($\sqrt{13} \times \sqrt{13}$)-33.7$°$ surface. Our results disclosed the out-of-plane Se-Fe-Se triple layer gradient variation, switched DOS for Fe sites on and off TiO$_{5\square}$, and inequivalent Fe sublattices, which gives global spatial modulation of pairing gap contaminant with the ($\sqrt{13} \times \sqrt{13}$) pattern. Moreover, the coherent lattice coupling induces strong inversion asymmetry and in-plane anisotropy in the monolayer FeSe, which is demonstrated to correlate with the particle-hole asymmetry in coherence peaks. The strong atomic-scale correlations in lattice and electronic structure, and pairing gap in particular, put constraints on exploring the unconventional high-temperature superconductivity emerging from interface coupling, e.g., strong demand for atomic-scale interface engineering and characterization. △ Less

Submitted 28 February, 2024; v1 submitted 17 December, 2023; originally announced December 2023.

K-ESConv: Knowledge Injection for Emotional Support Dialogue Systems via Prompt Learning

Authors: Wei Chen, Gang Zhao, Xiaojin Zhang, Xiang Bai, Xuanjing Huang, Zhongyu Wei

Abstract: Automatic psychological counseling requires mass of professional knowledge that can be found in online counseling forums. Motivated by this, we propose K-ESConv, a novel prompt learning based knowledge injection method for emotional support dialogue system, transferring forum knowledge to response generation. We evaluate our model on an emotional support dataset ESConv, where the model retrieves a… ▽ More Automatic psychological counseling requires mass of professional knowledge that can be found in online counseling forums. Motivated by this, we propose K-ESConv, a novel prompt learning based knowledge injection method for emotional support dialogue system, transferring forum knowledge to response generation. We evaluate our model on an emotional support dataset ESConv, where the model retrieves and incorporates knowledge from external professional emotional Q\&A forum. Experiment results show that the proposed method outperforms existing baselines on both automatic evaluation and human evaluation, which shows that our approach significantly improves the correlation and diversity of responses and provides more comfort and better suggestion for the seeker. △ Less

Submitted 16 December, 2023; originally announced December 2023.

Auto-Prox: Training-Free Vision Transformer Architecture Search via Automatic Proxy Discovery

Authors: Zimian Wei, Lujun Li, Peijie Dong, Zheng Hui, Anggeng Li, Menglong Lu, Hengyue Pan, Zhiliang Tian, Dongsheng Li

Abstract: The substantial success of Vision Transformer (ViT) in computer vision tasks is largely attributed to the architecture design. This underscores the necessity of efficient architecture search for designing better ViTs automatically. As training-based architecture search methods are computationally intensive, there is a growing interest in training-free methods that use zero-cost proxies to score Vi… ▽ More The substantial success of Vision Transformer (ViT) in computer vision tasks is largely attributed to the architecture design. This underscores the necessity of efficient architecture search for designing better ViTs automatically. As training-based architecture search methods are computationally intensive, there is a growing interest in training-free methods that use zero-cost proxies to score ViTs. However, existing training-free approaches require expert knowledge to manually design specific zero-cost proxies. Moreover, these zero-cost proxies exhibit limitations to generalize across diverse domains. In this paper, we introduce Auto-Prox, an automatic proxy discovery framework, to address the problem. First, we build the ViT-Bench-101, which involves different ViT candidates and their actual performance on multiple datasets. Utilizing ViT-Bench-101, we can evaluate zero-cost proxies based on their score-accuracy correlation. Then, we represent zero-cost proxies with computation graphs and organize the zero-cost proxy search space with ViT statistics and primitive operations. To discover generic zero-cost proxies, we propose a joint correlation metric to evolve and mutate different zero-cost proxy candidates. We introduce an elitism-preserve strategy for search efficiency to achieve a better trade-off between exploitation and exploration. Based on the discovered zero-cost proxy, we conduct a ViT architecture search in a training-free manner. Extensive experiments demonstrate that our method generalizes well to different datasets and achieves state-of-the-art results both in ranking correlation and final accuracy. Codes can be found at https://github.com/lilujunai/Auto-Prox-AAAI24. △ Less

Submitted 14 December, 2023; originally announced December 2023.

Comments: Accepetd by AAAI2024

Using eye tracking to investigate what native Chinese speakers notice about linguistic landscape images

Authors: Zichao Wei, Yewei Qin

Abstract: Linguistic landscape is an important field in sociolinguistic research. Eye tracking technology is a common technology in psychological research. There are few cases of using eye movement to study linguistic landscape. This paper uses eye tracking technology to study the actual fixation of the linguistic landscape and finds that in the two dimensions of fixation time and fixation times, the fixati… ▽ More Linguistic landscape is an important field in sociolinguistic research. Eye tracking technology is a common technology in psychological research. There are few cases of using eye movement to study linguistic landscape. This paper uses eye tracking technology to study the actual fixation of the linguistic landscape and finds that in the two dimensions of fixation time and fixation times, the fixation of native Chinese speakers to the linguistic landscape is higher than that of the general landscape. This paper argues that this phenomenon is due to the higher information density of linguistic landscapes. At the same time, the article also discusses other possible reasons for this phenomenon. △ Less

Submitted 2 July, 2024; v1 submitted 14 December, 2023; originally announced December 2023.

ACM Class: J.4

Cost Minimization for Equilibrium Transition

Authors: Haoqiang Huang, Zihe Wang, Zhide Wei, Jie Zhang

Abstract: In this paper, we delve into the problem of using monetary incentives to encourage players to shift from an initial Nash equilibrium to a more favorable one within a game. Our main focus revolves around computing the minimum reward required to facilitate this equilibrium transition. The game involves a single row player who possesses $m$ strategies and $k$ column players, each endowed with $n$ str… ▽ More In this paper, we delve into the problem of using monetary incentives to encourage players to shift from an initial Nash equilibrium to a more favorable one within a game. Our main focus revolves around computing the minimum reward required to facilitate this equilibrium transition. The game involves a single row player who possesses $m$ strategies and $k$ column players, each endowed with $n$ strategies. Our findings reveal that determining whether the minimum reward is zero is NP-complete, and computing the minimum reward becomes APX-hard. Nonetheless, we bring some positive news, as this problem can be efficiently handled if either $k$ or $n$ is a fixed constant. Furthermore, we have devised an approximation algorithm with an additive error that runs in polynomial time. Lastly, we explore a specific case wherein the utility functions exhibit single-peaked characteristics, and we successfully demonstrate that the optimal reward can be computed in polynomial time. △ Less

Submitted 11 December, 2023; originally announced December 2023.

Comments: To appear in the proceeding of AAAI2024

Cross-BERT for Point Cloud Pretraining

Authors: Xin Li, Peng Li, Zeyong Wei, Zhe Zhu, Mingqiang Wei, Junhui Hou, Liangliang Nan, Jing Qin, Haoran Xie, Fu Lee Wang

Abstract: Introducing BERT into cross-modal settings raises difficulties in its optimization for handling multiple modalities. Both the BERT architecture and training objective need to be adapted to incorporate and model information from different modalities. In this paper, we address these challenges by exploring the implicit semantic and geometric correlations between 2D and 3D data of the same objects/sc… ▽ More Introducing BERT into cross-modal settings raises difficulties in its optimization for handling multiple modalities. Both the BERT architecture and training objective need to be adapted to incorporate and model information from different modalities. In this paper, we address these challenges by exploring the implicit semantic and geometric correlations between 2D and 3D data of the same objects/scenes. We propose a new cross-modal BERT-style self-supervised learning paradigm, called Cross-BERT. To facilitate pretraining for irregular and sparse point clouds, we design two self-supervised tasks to boost cross-modal interaction. The first task, referred to as Point-Image Alignment, aims to align features between unimodal and cross-modal representations to capture the correspondences between the 2D and 3D modalities. The second task, termed Masked Cross-modal Modeling, further improves mask modeling of BERT by incorporating high-dimensional semantic information obtained by cross-modal interaction. By performing cross-modal interaction, Cross-BERT can smoothly reconstruct the masked tokens during pretraining, leading to notable performance enhancements for downstream tasks. Through empirical evaluation, we demonstrate that Cross-BERT outperforms existing state-of-the-art methods in 3D downstream applications. Our work highlights the effectiveness of leveraging cross-modal 2D knowledge to strengthen 3D point cloud representation and the transferable capability of BERT across modalities. △ Less

Submitted 8 December, 2023; originally announced December 2023.

Stronger, Fewer, & Superior: Harnessing Vision Foundation Models for Domain Generalized Semantic Segmentation

Authors: Zhixiang Wei, Lin Chen, Yi Jin, Xiaoxiao Ma, Tianle Liu, Pengyang Ling, Ben Wang, Huaian Chen, Jinjin Zheng

Abstract: In this paper, we first assess and harness various Vision Foundation Models (VFMs) in the context of Domain Generalized Semantic Segmentation (DGSS). Driven by the motivation that Leveraging Stronger pre-trained models and Fewer trainable parameters for Superior generalizability, we introduce a robust fine-tuning approach, namely Rein, to parameter-efficiently harness VFMs for DGSS. Built upon a s… ▽ More In this paper, we first assess and harness various Vision Foundation Models (VFMs) in the context of Domain Generalized Semantic Segmentation (DGSS). Driven by the motivation that Leveraging Stronger pre-trained models and Fewer trainable parameters for Superior generalizability, we introduce a robust fine-tuning approach, namely Rein, to parameter-efficiently harness VFMs for DGSS. Built upon a set of trainable tokens, each linked to distinct instances, Rein precisely refines and forwards the feature maps from each layer to the next layer within the backbone. This process produces diverse refinements for different categories within a single image. With fewer trainable parameters, Rein efficiently fine-tunes VFMs for DGSS tasks, surprisingly surpassing full parameter fine-tuning. Extensive experiments across various settings demonstrate that Rein significantly outperforms state-of-the-art methods. Remarkably, with just an extra 1% of trainable parameters within the frozen backbone, Rein achieves a mIoU of 78.4% on the Cityscapes, without accessing any real urban-scene datasets.Code is available at https://github.com/w1oves/Rein.git. △ Less

Submitted 18 April, 2024; v1 submitted 7 December, 2023; originally announced December 2023.

Strongly coupled edge states in a graphene quantum Hall interferometer

Authors: Thomas Werkmeister, James R. Ehrets, Yuval Ronen, Marie E. Wesson, Danial Najafabadi, Zezhu Wei, Kenji Watanabe, Takashi Taniguchi, D. E. Feldman, Bertrand I. Halperin, Amir Yacoby, Philip Kim

Abstract: Electronic interferometers using the chiral, one-dimensional (1D) edge channels of the quantum Hall effect (QHE) can demonstrate a wealth of fundamental phenomena. The recent observation of phase jumps in a Fabry-Pérot (FP) interferometer revealed anyonic quasiparticle exchange statistics in the fractional QHE. When multiple integer edge channels are involved, FP interferometers have exhibited ano… ▽ More Electronic interferometers using the chiral, one-dimensional (1D) edge channels of the quantum Hall effect (QHE) can demonstrate a wealth of fundamental phenomena. The recent observation of phase jumps in a Fabry-Pérot (FP) interferometer revealed anyonic quasiparticle exchange statistics in the fractional QHE. When multiple integer edge channels are involved, FP interferometers have exhibited anomalous Aharonov-Bohm (AB) interference frequency doubling, suggesting putative pairing of electrons into 2e quasiparticles. Here, we use a highly tunable graphene-based QHE FP interferometer to observe the connection between interference phase jumps and AB frequency doubling, unveiling how strong repulsive interaction between edge channels leads to the apparent pairing phenomena. By tuning electron density in-situ from filling factor ν<2 to ν>7, we tune the interaction strength and observe periodic interference phase jumps leading to AB frequency doubling. Our observations demonstrate that the combination of repulsive interaction between the spin-split ν=2 edge channels and charge quantization is sufficient to explain the frequency doubling, through a near-perfect charge screening between the localized and extended edge channels. Our results show that interferometers are sensitive probes of microscopic interactions and enable future experiments studying correlated electrons in 1D channels using our highly tunable platform. △ Less

Submitted 24 January, 2024; v1 submitted 5 December, 2023; originally announced December 2023.

Comments: 26 pages, 13 figures

A 5G DMRS-based Signal for Integrated Sensing and Communication System

Authors: Zhiqing Wei, Fengyun Li, Haotian Liu, Xu Chen, Huici Wu, Kaifeng Han, Zhiyong Feng

Abstract: Integrated sensing and communication (ISAC) is considered as the potential key technology of the future mobile communication systems. The signal design is fundamental for the ISAC system. The reference signals in mobile communication systems have good detection performance, which is worth further research. Existing studies applied the single reference signal to radar sensing. In this paper, a mult… ▽ More Integrated sensing and communication (ISAC) is considered as the potential key technology of the future mobile communication systems. The signal design is fundamental for the ISAC system. The reference signals in mobile communication systems have good detection performance, which is worth further research. Existing studies applied the single reference signal to radar sensing. In this paper, a multiple reference signals collaborative sensing scheme is designed. Specifically, we jointly apply channel state information reference signal (CSI-RS), positioning reference signal (PRS) and demodulation reference signal (DMRS) in radar sensing, which improve the performance of radar sensing via obtaining continuous time-frequency resource mapping. Crámer-Rao lower bound (CRLB) of the joint reference signal for distance and velocity estimation is derived. The impacts of carrier frequency and subcarrier spacing on the performance of distance and velocity estimation are revealed. The results of simulation experiments show that compared with the single reference signal sensing scheme, the multiple reference signals collaborative sensing scheme effectively improves the sensing accuracy. Moreover, because of the discontinuous OFDM symbols, the accuracy of velocity estimation could be further improved via compressed sensing (CS). This paper has verified that multiple reference signals, instead of single reference signal, have much more superior performance on radar sensing, which is a practical and efficient approach in designing ISAC signal. △ Less

Submitted 2 March, 2024; v1 submitted 1 November, 2023; originally announced December 2023.

Cooperation Based Joint Active and Passive Sensing with Asynchronous Transceivers for Perceptive Mobile Networks

Authors: Wangjun Jiang, Zhiqing Wei, Shaoshi Yang, Zhiyong Feng, Ping Zhang

Abstract: Perceptive mobile network (PMN) is an emerging concept for next-generation wireless networks capable of conducting integrated sensing and communication (ISAC). A major challenge for realizing high performance sensing in PMNs is how to deal with spatially separated asynchronous transceivers. Asynchronicity results in timing offsets (TOs) and carrier frequency offsets (CFOs), which further cause amb… ▽ More Perceptive mobile network (PMN) is an emerging concept for next-generation wireless networks capable of conducting integrated sensing and communication (ISAC). A major challenge for realizing high performance sensing in PMNs is how to deal with spatially separated asynchronous transceivers. Asynchronicity results in timing offsets (TOs) and carrier frequency offsets (CFOs), which further cause ambiguity in ranging and velocity sensing. Most existing algorithms mitigate TOs and CFOs based on the line-of-sight (LOS) propagation path between sensing transceivers. However, LOS paths may not exist in realistic scenarios. In this paper, we propose a cooperation based joint active and passive sensing scheme for the non-LOS (NLOS) scenarios having asynchronous transceivers. This scheme relies on the cross-correlation cooperative sensing (CCCS) algorithm, which regards active sensing as a reference and mitigates TOs and CFOs by correlating active and passive sensing information. Another major challenge for realizing high performance sensing in PMNs is how to realize high accuracy angle-of-arrival (AoA) estimation with low complexity. Correspondingly, we propose a low complexity AoA algorithm based on cooperative sensing, which comprises coarse AoA estimation and fine AoA estimation. Analytical and numerical simulation results verify the performance advantages of the proposed CCCS algorithm and the low complexity AoA estimation algorithm. △ Less

Submitted 12 October, 2023; originally announced December 2023.

Comments: 31 pages, 8 figures

On the Effectiveness of Large Language Models in Domain-Specific Code Generation

Authors: Yalan Lin, Meng Chen, Yuhan Hu, Hongyu Zhang, Chengcheng Wan, Zhao Wei, Yong Xu, Juhong Wang, Xiaodong Gu

Abstract: Large language models (LLMs) such as ChatGPT have shown remarkable capabilities in code generation. Despite significant achievements, they rely on enormous training data to acquire a broad spectrum of open-domain knowledge. Besides, their evaluation revolves around open-domain benchmarks like HumanEval, which primarily consist of programming contests. Therefore, it is hard to fully characterize th… ▽ More Large language models (LLMs) such as ChatGPT have shown remarkable capabilities in code generation. Despite significant achievements, they rely on enormous training data to acquire a broad spectrum of open-domain knowledge. Besides, their evaluation revolves around open-domain benchmarks like HumanEval, which primarily consist of programming contests. Therefore, it is hard to fully characterize the intricacies and challenges associated with particular domains (e.g., web, game, and math). In this paper, we conduct an in-depth study of the LLMs in domain-specific code generation. Our results demonstrate that LLMs exhibit sub-optimal performance in generating domain-specific code, due to their limited proficiency in utilizing domain-specific libraries. We further observe that incorporating API knowledge as prompts can empower LLMs to generate more professional code. Based on these findings, we further investigate how to effectively incorporate API knowledge into the code generation process. We experiment with three strategies for incorporating domain knowledge, namely, external knowledge inquirer, chain-of-thought prompting, and chain-of-thought fine-tuning. We refer to these strategies as a new code generation approach called DomCoder. Experimental results show that all strategies of DomCoder lead to improvement in the effectiveness of domain-specific code generation under certain settings. △ Less

Submitted 25 August, 2024; v1 submitted 4 December, 2023; originally announced December 2023.

Comments: Accepted by the ACM Transactions on Software Engineering and Methodology (TOSEM 2024)

Hi-ArG: Exploring the Integration of Hierarchical Argumentation Graphs in Language Pretraining

Authors: Jingcong Liang, Rong Ye, Meng Han, Qi Zhang, Ruofei Lai, Xinyu Zhang, Zhao Cao, Xuanjing Huang, Zhongyu Wei

Abstract: The knowledge graph is a structure to store and represent knowledge, and recent studies have discussed its capability to assist language models for various applications. Some variations of knowledge graphs aim to record arguments and their relations for computational argumentation tasks. However, many must simplify semantic types to fit specific schemas, thus losing flexibility and expression abil… ▽ More The knowledge graph is a structure to store and represent knowledge, and recent studies have discussed its capability to assist language models for various applications. Some variations of knowledge graphs aim to record arguments and their relations for computational argumentation tasks. However, many must simplify semantic types to fit specific schemas, thus losing flexibility and expression ability. In this paper, we propose the Hierarchical Argumentation Graph (Hi-ArG), a new structure to organize arguments. We also introduce two approaches to exploit Hi-ArG, including a text-graph multi-modal model GreaseArG and a new pre-training framework augmented with graph information. Experiments on two argumentation tasks have shown that after further pre-training and fine-tuning, GreaseArG supersedes same-scale language models on these tasks, while incorporating graph information during further pre-training can also improve the performance of vanilla language models. Code for this paper is available at https://github.com/ljcleo/Hi-ArG . △ Less

Submitted 1 December, 2023; originally announced December 2023.

Comments: to be published in EMNLP 2023

Hydrating and dehydrating dynamics process as an ion entering a carbon nanotube

Authors: Zhenyu Wei, Yunfei Chen

Abstract: Ion transport within confined environments, like nanopores and nanotubes, is pivotal for advancing a range of applications, including biosensors, seawater desalination, and energy storage devices. Existing research does not sufficiently delve into the alterations in ion hydration structure, a key element that significantly influences ion transport properties in such confined environments. Here, we… ▽ More Ion transport within confined environments, like nanopores and nanotubes, is pivotal for advancing a range of applications, including biosensors, seawater desalination, and energy storage devices. Existing research does not sufficiently delve into the alterations in ion hydration structure, a key element that significantly influences ion transport properties in such confined environments. Here, we report a theoretical model comprehensively considering the interplay between ions and nanotubes. By incorporating the effect of orientational competition, our model effectively predicts both the change in hydration structure and the free energy profile during an ion's transition from bulk water into a nanotube. These predictions match closely with the results from molecular dynamics simulations. △ Less

Submitted 29 November, 2023; originally announced November 2023.

Comments: 4 pages, 3 figures

Capacity and Delay of Unmanned Aerial Vehicle Networks with Mobility

Authors: Zhiqing Wei, Zhiyong Feng, Haibo Zhou, Li Wang, Huici Wu

Abstract: Unmanned aerial vehicles (UAVs) are widely exploited in environment monitoring, search-and-rescue, etc. However, the mobility and short flight duration of UAVs bring challenges for UAV networking. In this paper, we study the UAV networks with n UAVs acting as aerial sensors. UAVs generally have short flight duration and need to frequently get energy replenishment from the control station. Hence th… ▽ More Unmanned aerial vehicles (UAVs) are widely exploited in environment monitoring, search-and-rescue, etc. However, the mobility and short flight duration of UAVs bring challenges for UAV networking. In this paper, we study the UAV networks with n UAVs acting as aerial sensors. UAVs generally have short flight duration and need to frequently get energy replenishment from the control station. Hence the returning UAVs bring the data of the UAVs along the returning paths to the control station with a store-carry-and-forward (SCF) mode. A critical range for the distance between the UAV and the control station is discovered. Within the critical range, the per-node capacity of the SCF mode is O(n/log n) times higher than that of the multi-hop mode. However, the per-node capacity of the SCF mode outside the critical range decreases with the distance between the UAV and the control station. To eliminate the critical range, a mobility control scheme is proposed such that the capacity scaling laws of the SCF mode are the same for all UAVs, which improves the capacity performance of UAV networks. Moreover, the delay of the SCF mode is derived. The impact of the size of the entire region, the velocity of UAVs, the number of UAVs and the flight duration of UAVs on the delay of SCF mode is analyzed. This paper reveals that the mobility and short flight duration of UAVs have beneficial effects on the performance of UAV networks, which may motivate the study of SCF schemes for UAV networks. △ Less

Submitted 25 November, 2023; originally announced November 2023.

Comments: 14 pages, 10 figures, IEEE Internet of Things Journal

Spectrum Sharing between UAV-based Wireless Mesh Networks and Ground Networks

Authors: Zhiqing Wei, Zijun Guo, Zhiyong Feng, Jialin Zhu, Caijun Zhong, Qihui Wu, Huici Wu

Abstract: The unmanned aerial vehicle (UAV)-based wireless mesh networks can economically provide wireless services for the areas with disasters. However, the capacity of air-to-air communications is limited due to the multi-hop transmissions. In this paper, the spectrum sharing between UAV-based wireless mesh networks and ground networks is studied to improve the capacity of the UAV networks. Considering t… ▽ More The unmanned aerial vehicle (UAV)-based wireless mesh networks can economically provide wireless services for the areas with disasters. However, the capacity of air-to-air communications is limited due to the multi-hop transmissions. In this paper, the spectrum sharing between UAV-based wireless mesh networks and ground networks is studied to improve the capacity of the UAV networks. Considering the distribution of UAVs as a three-dimensional (3D) homogeneous Poisson point process (PPP) within a vertical range, the stochastic geometry is applied to analyze the impact of the height of UAVs, the transmit power of UAVs, the density of UAVs and the vertical range, etc., on the coverage probability of ground network user and UAV network user, respectively. The optimal height of UAVs is numerically achieved in maximizing the capacity of UAV networks with the constraint of the coverage probability of ground network user. This paper provides a basic guideline for the deployment of UAV-based wireless mesh networks. △ Less

Submitted 25 November, 2023; originally announced November 2023.

Comments: 6 pages, 6 figures

The Performance Analysis of Spectrum Sharing between UAV enabled Wireless Mesh Networks and Ground Networks

Authors: Zhiqing Wei, Jialin Zhu, Zijun Guo, Fan Ning

Abstract: Unmanned aerial vehicle (UAV) has the advantages of large coverage and flexibility, which could be applied in disaster management to provide wireless services to the rescuers and victims. When UAVs forms an aerial mesh network, line-of-sight (LoS) air-to-air (A2A) communications have long transmission distance, which extends the coverage of multiple UAVs. However, the capacity of UAV is constraine… ▽ More Unmanned aerial vehicle (UAV) has the advantages of large coverage and flexibility, which could be applied in disaster management to provide wireless services to the rescuers and victims. When UAVs forms an aerial mesh network, line-of-sight (LoS) air-to-air (A2A) communications have long transmission distance, which extends the coverage of multiple UAVs. However, the capacity of UAV is constrained due to the multiple hop transmissions in aerial mesh networks. In this paper, spectrum sharing between UAV enabled wireless mesh networks and ground networks is studied to improve the capacity of UAV networks. Considering two-dimensional (2D) and three-dimensional (3D) homogeneous Poisson point process (PPP) modeling for the distribution of UAVs within a vertical range Δh, stochastic geometry is applied to analyze the impact of the height of UAVs, the transmit power of UAVs, the density of UAVs and the vertical range, etc., on the coverage probability of ground network user and UAV network user. Besides, performance improvement of spectrum sharing with directional antenna is verified. With the object function of maximizing the transmission capacity, the optimal altitude of UAVs is obtained. This paper provides a theoretical guideline for the spectrum sharing of UAV enabled wireless mesh networks, which may contribute significant value to the study of spectrum sharing mechanisms for UAV enabled wireless mesh networks. △ Less

Submitted 25 November, 2023; originally announced November 2023.

Comments: 12 pages, 13 figures, IEEE Sensors Journal

Code Search Debiasing:Improve Search Results beyond Overall Ranking Performance

Authors: Sheng Zhang, Hui Li, Yanlin Wang, Zhao Wei, Yong Xiu, Juhong Wang, Rongong Ji

Abstract: Code search engine is an essential tool in software development. Many code search methods have sprung up, focusing on the overall ranking performance of code search. In this paper, we study code search from another perspective by analyzing the bias of code search models. Biased code search engines provide poor user experience, even though they show promising overall performance. Due to different d… ▽ More Code search engine is an essential tool in software development. Many code search methods have sprung up, focusing on the overall ranking performance of code search. In this paper, we study code search from another perspective by analyzing the bias of code search models. Biased code search engines provide poor user experience, even though they show promising overall performance. Due to different development conventions (e.g., prefer long queries or abbreviations), some programmers will find the engine useful, while others may find it hard to get desirable search results. To mitigate biases, we develop a general debiasing framework that employs reranking to calibrate search results. It can be easily plugged into existing engines and handle new code search biases discovered in the future. Experiments show that our framework can effectively reduce biases. Meanwhile, the overall ranking performance of code search gets improved after debiasing. △ Less

Submitted 16 February, 2024; v1 submitted 24 November, 2023; originally announced November 2023.

Comments: 11 pages

TVT: Training-Free Vision Transformer Search on Tiny Datasets

Authors: Zimian Wei, Hengyue Pan, Lujun Li, Peijie Dong, Zhiliang Tian, Xin Niu, Dongsheng Li

Abstract: Training-free Vision Transformer (ViT) architecture search is presented to search for a better ViT with zero-cost proxies. While ViTs achieve significant distillation gains from CNN teacher models on small datasets, the current zero-cost proxies in ViTs do not generalize well to the distillation training paradigm according to our experimental observations. In this paper, for the first time, we inv… ▽ More Training-free Vision Transformer (ViT) architecture search is presented to search for a better ViT with zero-cost proxies. While ViTs achieve significant distillation gains from CNN teacher models on small datasets, the current zero-cost proxies in ViTs do not generalize well to the distillation training paradigm according to our experimental observations. In this paper, for the first time, we investigate how to search in a training-free manner with the help of teacher models and devise an effective Training-free ViT (TVT) search framework. Firstly, we observe that the similarity of attention maps between ViT and ConvNet teachers affects distill accuracy notably. Thus, we present a teacher-aware metric conditioned on the feature attention relations between teacher and student. Additionally, TVT employs the L2-Norm of the student's weights as the student-capability metric to improve ranking consistency. Finally, TVT searches for the best ViT for distilling with ConvNet teachers via our teacher-aware metric and student-capability metric, resulting in impressive gains in efficiency and effectiveness. Extensive experiments on various tiny datasets and search spaces show that our TVT outperforms state-of-the-art training-free search methods. The code will be released. △ Less

Submitted 24 November, 2023; originally announced November 2023.

Numerical investigation of effective nonlinear coefficient model for coupled third harmonic generation

Authors: Zihua Zheng, Ziwen Tang, Zhiyi Wei, Jinghua Sun

Abstract: In this paper, the optimal solution of effective nonlinear coefficient of quasi-phase-matching (QPM) crystals for coupled third harmonic generation (CTHG) was numerically investigated. The effective nonlinear coefficient of CTHG was converted to an Ising model for optimizing domain length distributions of aperiodically poled lithium niobate (APPLN) crystals with lengths as 0.5 mm and 1 mm, and fun… ▽ More In this paper, the optimal solution of effective nonlinear coefficient of quasi-phase-matching (QPM) crystals for coupled third harmonic generation (CTHG) was numerically investigated. The effective nonlinear coefficient of CTHG was converted to an Ising model for optimizing domain length distributions of aperiodically poled lithium niobate (APPLN) crystals with lengths as 0.5 mm and 1 mm, and fundamental wavelengths ranging from 1000 nm to 6000 nm. A method for reconstructing crystal domain poling weight curve of coupled nonlinear processes was also proposed, which demonstrated the optimal conversion ratio between two coupled nonlinear processes at each place along the crystal. In addition, by applying the semidefinite programming, the upper bound on the effective nonlinear coefficients deff for different fundamental wavelengths were calculated. The research can be extended to any coupled dual \c{hi}(2) process and will help us to understand better the dynamics of coupled nonlinear interactions based on QPM crystals. △ Less

Submitted 6 March, 2024; v1 submitted 22 November, 2023; originally announced November 2023.

Comments: 16 pages

Entanglement Phase Transition in Holographic Pseudo Entropy

Authors: Hiroki Kanda, Taishi Kawamoto, Yu-ki Suzuki, Tadashi Takayanagi, Kenya Tasuki, Zixia Wei

Abstract: In this paper, we present holographic descriptions of entanglement phase transition using AdS/BCFT. First, we analytically calculate the holographic pseudo entropy in the AdS/BCFT model with a brane localized scalar field and show the entanglement phase transition behavior where the time evolution of entropy changes from the linear growth to the trivial one via a critical logarithmic evolution. In… ▽ More In this paper, we present holographic descriptions of entanglement phase transition using AdS/BCFT. First, we analytically calculate the holographic pseudo entropy in the AdS/BCFT model with a brane localized scalar field and show the entanglement phase transition behavior where the time evolution of entropy changes from the linear growth to the trivial one via a critical logarithmic evolution. In this model, the imaginary valued scalar field localized on the brane controls the phase transition, which is analogous to the amount of projections in the measurement induced phase transition. Next, we study the AdS/BCFT model with a brane localized gauge field, where the phase transition looks different in that there is no logarithmically evolving critical point. Finally, we discuss a bulk analog of the above model by considering a double Wick rotation of the Janus solution. We compute the holographic pseudo entropy in this model and show that the entropy grows logarithmically. △ Less

Submitted 22 November, 2023; originally announced November 2023.

Comments: 60+21 pages, 36 figures

Report number: YITP-23-148

Journal ref: JHEP 03 (2024) 060

A Safer Vision-based Autonomous Planning System for Quadrotor UAVs with Dynamic Obstacle Trajectory Prediction and Its Application with LLMs

Authors: Jiageng Zhong, Ming Li, Yinliang Chen, Zihang Wei, Fan Yang, Haoran Shen

Abstract: For intelligent quadcopter UAVs, a robust and reliable autonomous planning system is crucial. Most current trajectory planning methods for UAVs are suitable for static environments but struggle to handle dynamic obstacles, which can pose challenges and even dangers to flight. To address this issue, this paper proposes a vision-based planning system that combines tracking and trajectory prediction… ▽ More For intelligent quadcopter UAVs, a robust and reliable autonomous planning system is crucial. Most current trajectory planning methods for UAVs are suitable for static environments but struggle to handle dynamic obstacles, which can pose challenges and even dangers to flight. To address this issue, this paper proposes a vision-based planning system that combines tracking and trajectory prediction of dynamic obstacles to achieve efficient and reliable autonomous flight. We use a lightweight object detection algorithm to identify dynamic obstacles and then use Kalman Filtering to track and estimate their motion states. During the planning phase, we not only consider static obstacles but also account for the potential movements of dynamic obstacles. For trajectory generation, we use a B-spline-based trajectory search algorithm, which is further optimized with various constraints to enhance safety and alignment with the UAV's motion characteristics. We conduct experiments in both simulation and real-world environments, and the results indicate that our approach can successfully detect and avoid obstacles in dynamic environments in real-time, offering greater reliability compared to existing approaches. Furthermore, with the advancements in Natural Language Processing (NLP) technology demonstrating exceptional zero-shot generalization capabilities, more user-friendly human-machine interactions have become feasible, and this study also explores the integration of autonomous planning systems with Large Language Models (LLMs). △ Less

Submitted 23 December, 2023; v1 submitted 21 November, 2023; originally announced November 2023.

On Error Bounds of Inequalities in Asplund Spaces

Authors: Zhou Wei, Michel Théra, Jen-Chih Yao

Abstract: Error bounds are central objects in optimization theory and its applications. They were for a long time restricted only to the theory before becoming over the course of time a field of itself. This paper is devoted to the study of error bounds of a general inequality defined by a proper lower semicontinuous function on an Asplund space. Even though the results of the dual characterization on the e… ▽ More Error bounds are central objects in optimization theory and its applications. They were for a long time restricted only to the theory before becoming over the course of time a field of itself. This paper is devoted to the study of error bounds of a general inequality defined by a proper lower semicontinuous function on an Asplund space. Even though the results of the dual characterization on the error bounds of a general inequality (if one drops the convexity assumption) may not be valid, several necessary dual conditions are still obtained in terms of Fréchet/Mordukhovich subdifferentials of the concerned function at points in the solution set. Moreover, for an inequality defined by a composite-convex function that is to say by a function which is the composition of a convex function with a smooth mapping, such dual conditions also turn out to be sufficient to have the error bound property. Our work is an extension of results on dual characterizations of convex inequalities to the possibly non-convex case. △ Less

Submitted 16 November, 2023; originally announced November 2023.

Photonics for Neuromorphic Computing: Fundamentals, Devices, and Opportunities

Authors: Renjie Li, Yuanhao Gong, Hai Huang, Yuze Zhou, Sixuan Mao, Zhijian Wei, Zhaoyu Zhang

Abstract: In the dynamic landscape of Artificial Intelligence (AI), two notable phenomena are becoming predominant: the exponential growth of large AI model sizes and the explosion of massive amount of data. Meanwhile, scientific research such as quantum computing and protein synthesis increasingly demand higher computing capacities. Neuromorphic computing, inspired by the mechanism and functionality of hum… ▽ More In the dynamic landscape of Artificial Intelligence (AI), two notable phenomena are becoming predominant: the exponential growth of large AI model sizes and the explosion of massive amount of data. Meanwhile, scientific research such as quantum computing and protein synthesis increasingly demand higher computing capacities. Neuromorphic computing, inspired by the mechanism and functionality of human brains, uses physical artificial neurons to do computations and is drawing widespread attention. Conventional electronic computing has experienced certain difficulties, particularly concerning the latency, crosstalk, and energy consumption of digital processors. As the Moore's law approaches its terminus, there is a urgent need for alternative computing architectures that can satisfy this growing computing demand and break through the von Neumann model. Recently, the expansion of optoelectronic devices on photonic integration platforms has led to significant growth in photonic computing, where photonic integrated circuits (PICs) have enabled ultrafast artificial neural networks (ANN) with sub-nanosecond latencies, low heat dissipation, and high parallelism. Such non-von Neumann photonic computing systems hold the promise to cater to the escalating requirements of AI and scientific computing. In this review, we study recent advancements in integrated photonic neuromorphic systems, and from the perspective of materials and device engineering, we lay out the scientific and technological breakthroughs necessary to advance the state-of-the-art. In particular, we examine various technologies and devices employed in neuromorphic photonic AI accelerators, spanning from traditional optics to PICs. We evaluate the performances of different designs by energy efficiency in operations per joule (OP/J) and compute density in operations per squared millimeter per ... △ Less

Submitted 2 July, 2024; v1 submitted 16 November, 2023; originally announced November 2023.

Comments: Advanced Materials Accepted

Journal ref: LAdv. Mater. n/a, 2312825 (2024)

Explicit Change Relation Learning for Change Detection in VHR Remote Sensing Images

Authors: Dalong Zheng, Zebin Wu, Jia Liu, Chih-Cheng Hung, Zhihui Wei

Abstract: Change detection has always been a concerned task in the interpretation of remote sensing images. It is essentially a unique binary classification task with two inputs, and there is a change relationship between these two inputs. At present, the mining of change relationship features is usually implicit in the network architectures that contain single-branch or two-branch encoders. However, due to… ▽ More Change detection has always been a concerned task in the interpretation of remote sensing images. It is essentially a unique binary classification task with two inputs, and there is a change relationship between these two inputs. At present, the mining of change relationship features is usually implicit in the network architectures that contain single-branch or two-branch encoders. However, due to the lack of artificial prior design for change relationship features, these networks cannot learn enough change semantic information and lose more accurate change detection performance. So we propose a network architecture NAME for the explicit mining of change relation features. In our opinion, the change features of change detection should be divided into pre-changed image features, post-changed image features and change relation features. In order to fully mine these three kinds of change features, we propose the triple branch network combining the transformer and convolutional neural network (CNN) to extract and fuse these change features from two perspectives of global information and local information, respectively. In addition, we design the continuous change relation (CCR) branch to further obtain the continuous and detail change relation features to improve the change discrimination capability of the model. The experimental results show that our network performs better, in terms of F1, IoU, and OA, than those of the existing advanced networks for change detection on four public very high-resolution (VHR) remote sensing datasets. Our source code is available at https://github.com/DalongZ/NAME. △ Less

Submitted 14 November, 2023; originally announced November 2023.