Showing 1–50 of 321 results for author: Jin, K

MTFinEval:A Multi-domain Chinese Financial Benchmark with Eurypalynous questions

Authors: Xinyu Liu, Ke Jin

Abstract: With the emergence of more and more economy-specific LLMS, how to measure whether they can be safely invested in production becomes a problem. Previous research has primarily focused on evaluating the performance of LLMs within specific application scenarios. However, these benchmarks cannot reflect the theoretical level and generalization ability, and the backward datasets are increasingly unsuit… ▽ More With the emergence of more and more economy-specific LLMS, how to measure whether they can be safely invested in production becomes a problem. Previous research has primarily focused on evaluating the performance of LLMs within specific application scenarios. However, these benchmarks cannot reflect the theoretical level and generalization ability, and the backward datasets are increasingly unsuitable for problems in real scenarios. In this paper, we have compiled a new benchmark, MTFinEval, focusing on the LLMs' basic knowledge of economics, which can always be used as a basis for judgment. To examine only theoretical knowledge as much as possible, MTFinEval is build with foundational questions from university textbooks,and exam papers in economics and management major. Aware of the overall performance of LLMs do not depend solely on one subdiscipline of economics, MTFinEval comprise 360 questions refined from six major disciplines of economics, and reflect capabilities more comprehensively. Experiment result shows all LLMs perform poorly on MTFinEval, which proves that our benchmark built on basic knowledge is very successful. Our research not only offers guidance for selecting the appropriate LLM for specific use cases, but also put forward increase the rigor reliability of LLMs from the basics. △ Less

Submitted 20 August, 2024; originally announced August 2024.

Prometheus Chatbot: Knowledge Graph Collaborative Large Language Model for Computer Components Recommendation

Authors: Yunsheng Wang, Songhao Chen, Kevin Jin

Abstract: Knowledge graphs (KGs) are essential in applications such as network alignment, question-answering, and recommender systems (RSs) since they offer structured relational data that facilitate the inference of indirect relationships. However, the development of KG-based RSs capable of processing user inputs in natural language faces significant challenges. Firstly, natural language processing units m… ▽ More Knowledge graphs (KGs) are essential in applications such as network alignment, question-answering, and recommender systems (RSs) since they offer structured relational data that facilitate the inference of indirect relationships. However, the development of KG-based RSs capable of processing user inputs in natural language faces significant challenges. Firstly, natural language processing units must effectively handle the ambiguity and variability in human language to interpret user intents accurately. Secondly, the system must precisely identify and link entities, like product names, to their corresponding nodes in KGs. To overcome these challenges, supported by Lenovo, we developed a novel chatbot called "Prometheus," which integrates a KG with a large language model (LLM), specifically designed for recommending computer components. This chatbot can accurately decode user requests and deliver personalized recommendations derived from KGs, ensuring precise comprehension and response to their computer setup needs. △ Less

Submitted 30 July, 2024; v1 submitted 28 July, 2024; originally announced July 2024.

Unified Description of Charge Density Waves in Electron- and Hole-doped Cuprate Superconductors

Authors: Jaewon Choi, Sijia Tu, Abhishek Nag, Charles C. Tam, Sahil Tippireddy, Stefano Agrestini, Zefeng Lin, Mirian Garcia-Fernandez, Kui Jin, Ke-Jin Zhou

Abstract: High-temperature cuprates superconductors are characterised by the complex interplay between superconductivity (SC) and charge density wave (CDW) in the context of intertwined competing orders. In contrast to abundant studies for hole-doped cuprates, the exact nature of CDW and its relationship to SC was much less explored in electron-doped counterparts. Here, we performed resonant inelastic x-ray… ▽ More High-temperature cuprates superconductors are characterised by the complex interplay between superconductivity (SC) and charge density wave (CDW) in the context of intertwined competing orders. In contrast to abundant studies for hole-doped cuprates, the exact nature of CDW and its relationship to SC was much less explored in electron-doped counterparts. Here, we performed resonant inelastic x-ray scattering (RIXS) experiments to investigate the relationship between CDW and SC in electron-doped La$_{2-x}$Ce$_x$CuO$_4$. The short-range CDW order with a correlation length $\sim35$~Å~was found in a wide range of temperature and doping concentration. Near the optimal doping, the CDW order is weakened inside the SC phase, implying an intimate relationship between the two orders. This interplay has been commonly reported in hole-doped La-based cuprates near the optimal doping. We reconciled the diverging behaviour of CDW across the superconducting phase in various cuprate materials by introducing the CDW correlation length as a key parameter. Our study paves the way for establishing a unified picture to describe the phenomenology of CDW and its relationship with SC in the cuprate family. △ Less

Submitted 22 July, 2024; originally announced July 2024.

Comments: 24 pages 5 figures; Supplementary Materials available upon request

Impact of electron correlations on two-particle charge response in electron- and hole-doped cuprates

Authors: Abhishek Nag, Luciano Zinni, Jaewon Choi, J. Li, Sijia Tu, A. C. Walters, S. Agrestini, S. M. Hayden, Matías Bejas, Zefeng Lin, H. Yamase, Kui Jin, M. García-Fernández, J. Fink, Andrés Greco, Ke-Jin Zhou

Abstract: Estimating many-body effects that deviate from an independent particle approach, has long been a key research interest in condensed matter physics. Layered cuprates are prototypical systems, where electron-electron interactions are found to strongly affect the dynamics of single-particle excitations. It is however, still unclear how the electron correlations influence charge excitations, such as p… ▽ More Estimating many-body effects that deviate from an independent particle approach, has long been a key research interest in condensed matter physics. Layered cuprates are prototypical systems, where electron-electron interactions are found to strongly affect the dynamics of single-particle excitations. It is however, still unclear how the electron correlations influence charge excitations, such as plasmons, which have been variously treated with either weak or strong correlation models. In this work, we demonstrate the hybridised nature of collective valence charge fluctuations leading to dispersing acoustic-like plasmons in hole-doped La$_{1.84}$Sr$_{0.16}$CuO$_{4}$ and electron-doped La$_{1.84}$Ce$_{0.16}$CuO$_{4}$ using the two-particle probe, resonant inelastic x-ray scattering. We then describe the plasmon dispersions in both systems, within both the weak mean-field Random Phase Approximation (RPA) and strong coupling $t$-$J$-$V$ models. The $t$-$J$-$V$ model, which includes the correlation effects implicitly, accurately describes the plasmon dispersions as resonant excitations outside the single-particle intra-band continuum. In comparison, a quantitative description of the plasmon dispersion in the RPA approach is obtained only upon explicit consideration of re-normalized electronic band parameters. Our comparative analysis shows that electron correlations significantly impact the low-energy plasmon excitations across the cuprate doping phase diagram, even at long wavelengths. Thus, complementary information on the evolution of electron correlations, influenced by the rich electronic phases in condensed matter systems, can be extracted through the study of two-particle charge response. △ Less

Submitted 22 July, 2024; originally announced July 2024.

Comments: 6 Figures

User-Creator Feature Dynamics in Recommender Systems with Dual Influence

Authors: Tao Lin, Kun Jin, Andrew Estornell, Xiaoying Zhang, Yiling Chen, Yang Liu

Abstract: Recommender systems present relevant contents to users and help content creators reach their target audience. The dual nature of these systems influences both users and creators: users' preferences are affected by the items they are recommended, while creators are incentivized to alter their contents such that it is recommended more frequently. We define a model, called user-creator feature dynami… ▽ More Recommender systems present relevant contents to users and help content creators reach their target audience. The dual nature of these systems influences both users and creators: users' preferences are affected by the items they are recommended, while creators are incentivized to alter their contents such that it is recommended more frequently. We define a model, called user-creator feature dynamics, to capture the dual influences of recommender systems. We prove that a recommender system with dual influence is guaranteed to polarize, causing diversity loss in the system. We then investigate, both theoretically and empirically, approaches for mitigating polarization and promoting diversity in recommender systems. Unexpectedly, we find that common diversity-promoting approaches do not work in the presence of dual influence, while relevancy-optimizing methods like top-$k$ recommendation can prevent polarization and improve diversity of the system. △ Less

Submitted 19 July, 2024; originally announced July 2024.

How to beat a Bayesian adversary

Authors: Zihan Ding, Kexin Jin, Jonas Latz, Chenguang Liu

Abstract: Deep neural networks and other modern machine learning models are often susceptible to adversarial attacks. Indeed, an adversary may often be able to change a model's prediction through a small, directed perturbation of the model's input - an issue in safety-critical applications. Adversarially robust machine learning is usually based on a minmax optimisation problem that minimises the machine lea… ▽ More Deep neural networks and other modern machine learning models are often susceptible to adversarial attacks. Indeed, an adversary may often be able to change a model's prediction through a small, directed perturbation of the model's input - an issue in safety-critical applications. Adversarially robust machine learning is usually based on a minmax optimisation problem that minimises the machine learning loss under maximisation-based adversarial attacks. In this work, we study adversaries that determine their attack using a Bayesian statistical approach rather than maximisation. The resulting Bayesian adversarial robustness problem is a relaxation of the usual minmax problem. To solve this problem, we propose Abram - a continuous-time particle system that shall approximate the gradient flow corresponding to the underlying learning problem. We show that Abram approximates a McKean-Vlasov process and justify the use of Abram by giving assumptions under which the McKean-Vlasov process finds the minimiser of the Bayesian adversarial robustness problem. We discuss two ways to discretise Abram and show its suitability in benchmark adversarial deep learning experiments. △ Less

Submitted 11 July, 2024; originally announced July 2024.

MSC Class: 90C15; 65C35; 68T07

Low-Complexity SVM Signal Recovery in Bandwidth-Limited 100Gb/s PAM4 PON Upstream

Authors: Liyan Wu, Yanlu Huang, Kai Jin, Shangya Han, Kun Xu, Yanni Ou

Abstract: We proposed a low-complexity SVM-based signal recovery algorithm and evaluated it in 100G-PON with 25G-class devices. For the first time, it experimentally achieved 24 dB power budget @ FEC threshold 1E-3 over 40 km SMF, improving receiver sensitivity over 2 dB compared to FFE&DFE. We proposed a low-complexity SVM-based signal recovery algorithm and evaluated it in 100G-PON with 25G-class devices. For the first time, it experimentally achieved 24 dB power budget @ FEC threshold 1E-3 over 40 km SMF, improving receiver sensitivity over 2 dB compared to FFE&DFE. △ Less

Submitted 4 July, 2024; originally announced July 2024.

Consistency Purification: Effective and Efficient Diffusion Purification towards Certified Robustness

Authors: Yiquan Li, Zhongzhu Chen, Kun Jin, Jiongxiao Wang, Bo Li, Chaowei Xiao

Abstract: Diffusion Purification, purifying noised images with diffusion models, has been widely used for enhancing certified robustness via randomized smoothing. However, existing frameworks often grapple with the balance between efficiency and effectiveness. While the Denoising Diffusion Probabilistic Model (DDPM) offers an efficient single-step purification, it falls short in ensuring purified images res… ▽ More Diffusion Purification, purifying noised images with diffusion models, has been widely used for enhancing certified robustness via randomized smoothing. However, existing frameworks often grapple with the balance between efficiency and effectiveness. While the Denoising Diffusion Probabilistic Model (DDPM) offers an efficient single-step purification, it falls short in ensuring purified images reside on the data manifold. Conversely, the Stochastic Diffusion Model effectively places purified images on the data manifold but demands solving cumbersome stochastic differential equations, while its derivative, the Probability Flow Ordinary Differential Equation (PF-ODE), though solving simpler ordinary differential equations, still requires multiple computational steps. In this work, we demonstrated that an ideal purification pipeline should generate the purified images on the data manifold that are as much semantically aligned to the original images for effectiveness in one step for efficiency. Therefore, we introduced Consistency Purification, an efficiency-effectiveness Pareto superior purifier compared to the previous work. Consistency Purification employs the consistency model, a one-step generative model distilled from PF-ODE, thus can generate on-manifold purified images with a single network evaluation. However, the consistency model is designed not for purification thus it does not inherently ensure semantic alignment between purified and original images. To resolve this issue, we further refine it through Consistency Fine-tuning with LPIPS loss, which enables more aligned semantic meaning while keeping the purified images on data manifold. Our comprehensive experiments demonstrate that our Consistency Purification framework achieves state-of the-art certified robustness and efficiency compared to baseline methods. △ Less

Submitted 30 June, 2024; originally announced July 2024.

LUT-boosted CDR and Equalization for Burst-mode 50/100 Gbit/s Bandwidth-limited Flexible PON

Authors: Yanlu Huang, Liyan Wu, Shangya Han, Kai Jin, Kun Xu, Yanni Ou

Abstract: We proposed and experimentally demonstrated a look-up table boosted fast CDR and equalization scheme for the burst-mode 50/100 Gbps bandwidth-limited flexible PON, requiring no preamble for convergence and achieved the same bit error rate performance as in the case of long preambles. We proposed and experimentally demonstrated a look-up table boosted fast CDR and equalization scheme for the burst-mode 50/100 Gbps bandwidth-limited flexible PON, requiring no preamble for convergence and achieved the same bit error rate performance as in the case of long preambles. △ Less

Submitted 28 June, 2024; originally announced June 2024.

Addressing Polarization and Unfairness in Performative Prediction

Authors: Kun Jin, Tian Xie, Yang Liu, Xueru Zhang

Abstract: When machine learning (ML) models are used in applications that involve humans (e.g., online recommendation, school admission, hiring, lending), the model itself may trigger changes in the distribution of targeted data it aims to predict. Performative prediction (PP) is a framework that explicitly considers such model-dependent distribution shifts when learning ML models. While significant efforts… ▽ More When machine learning (ML) models are used in applications that involve humans (e.g., online recommendation, school admission, hiring, lending), the model itself may trigger changes in the distribution of targeted data it aims to predict. Performative prediction (PP) is a framework that explicitly considers such model-dependent distribution shifts when learning ML models. While significant efforts have been devoted to finding performative stable (PS) solutions in PP for system robustness, their societal implications are less explored and it is unclear whether PS solutions are aligned with social norms such as fairness. In this paper, we set out to examine the fairness property of PS solutions in performative prediction. We first show that PS solutions can incur severe polarization effects and group-wise loss disparity. Although existing fairness mechanisms commonly used in literature can help mitigate unfairness, they may fail and disrupt the stability under model-dependent distribution shifts. We thus propose novel fairness intervention mechanisms that can simultaneously achieve both stability and fairness in PP settings. Both theoretical analysis and experiments are provided to validate the proposed method. △ Less

Submitted 24 June, 2024; originally announced June 2024.

Scheduling two types of jobs with minimum makespan

Authors: Song Cao, Kai Jin

Abstract: We consider scheduling two types of jobs (A-job and B-job) to $p$ machines and minimizing their makespan. A group of same type of jobs processed consecutively by a machine is called a batch. For machine $v$, processing $x$ A-jobs in a batch takes $k^A_vx^2$ time units for a given speed $k^A_v$, and processing $x$ B-jobs in a batch takes $k^B_vx^2$ time units for a given speed $k^B_v$. We give an… ▽ More We consider scheduling two types of jobs (A-job and B-job) to $p$ machines and minimizing their makespan. A group of same type of jobs processed consecutively by a machine is called a batch. For machine $v$, processing $x$ A-jobs in a batch takes $k^A_vx^2$ time units for a given speed $k^A_v$, and processing $x$ B-jobs in a batch takes $k^B_vx^2$ time units for a given speed $k^B_v$. We give an $O(n^2p\log(n))$ algorithm based on dynamic programming and binary search for solving this problem, where $n$ denotes the maximal number of A-jobs and B-jobs to be distributed to the machines. Our algorithm also fits the easier linear case where each batch of length $x$ of $A$-jobs takes $k^A_v x$ time units and each batch of length $x$ of $B$-jobs takes $k^B_vx$ time units. The running time is the same as the above case. △ Less

Submitted 14 June, 2024; originally announced June 2024.

McEval: Massively Multilingual Code Evaluation

Authors: Linzheng Chai, Shukai Liu, Jian Yang, Yuwei Yin, Ke Jin, Jiaheng Liu, Tao Sun, Ge Zhang, Changyu Ren, Hongcheng Guo, Zekun Wang, Boyang Wang, Xianjie Wu, Bing Wang, Tongliang Li, Liqun Yang, Sufeng Duan, Zhoujun Li

Abstract: Code large language models (LLMs) have shown remarkable advances in code understanding, completion, and generation tasks. Programming benchmarks, comprised of a selection of code challenges and corresponding test cases, serve as a standard to evaluate the capability of different LLMs in such tasks. However, most existing benchmarks primarily focus on Python and are still restricted to a limited nu… ▽ More Code large language models (LLMs) have shown remarkable advances in code understanding, completion, and generation tasks. Programming benchmarks, comprised of a selection of code challenges and corresponding test cases, serve as a standard to evaluate the capability of different LLMs in such tasks. However, most existing benchmarks primarily focus on Python and are still restricted to a limited number of languages, where other languages are translated from the Python samples (e.g. MultiPL-E) degrading the data diversity. To further facilitate the research of code LLMs, we propose a massively multilingual code benchmark covering 40 programming languages (McEval) with 16K test samples, which substantially pushes the limits of code LLMs in multilingual scenarios. The benchmark contains challenging code completion, understanding, and generation evaluation tasks with finely curated massively multilingual instruction corpora McEval-Instruct. In addition, we introduce an effective multilingual coder mCoder trained on McEval-Instruct to support multilingual programming language generation. Extensive experimental results on McEval show that there is still a difficult journey between open-source models and closed-source LLMs (e.g. GPT-series models) in numerous languages. The instruction corpora, evaluation benchmark, and leaderboard are available at \url{https://mceval.github.io/}. △ Less

Submitted 11 June, 2024; originally announced June 2024.

Comments: 22 pages

Measuring Fairness in Large-Scale Recommendation Systems with Missing Labels

Authors: Yulong Dong, Kun Jin, Xinghai Hu, Yang Liu

Abstract: In large-scale recommendation systems, the vast array of items makes it infeasible to obtain accurate user preferences for each product, resulting in a common issue of missing labels. Typically, only items previously recommended to users have associated ground truth data. Although there is extensive research on fairness concerning fully observed user-item interactions, the challenge of fairness in… ▽ More In large-scale recommendation systems, the vast array of items makes it infeasible to obtain accurate user preferences for each product, resulting in a common issue of missing labels. Typically, only items previously recommended to users have associated ground truth data. Although there is extensive research on fairness concerning fully observed user-item interactions, the challenge of fairness in scenarios with missing labels remains underexplored. Previous methods often treat these samples missing labels as negative, which can significantly deviate from the ground truth fairness metrics. Our study addresses this gap by proposing a novel method employing a small randomized traffic to estimate fairness metrics accurately. We present theoretical bounds for the estimation error of our fairness metric and support our findings with empirical evidence on real data. Our numerical experiments on synthetic and TikTok's real-world data validate our theory and show the efficiency and effectiveness of our novel methods. To the best of our knowledge, we are the first to emphasize the necessity of random traffic in dataset collection for recommendation fairness, the first to publish a fairness-related dataset from TikTok and to provide reliable estimates of fairness metrics in the context of large-scale recommendation systems with missing labels. △ Less

Submitted 7 June, 2024; originally announced June 2024.

Simple $k$-crashing Plan with a Good Approximation Ratio

Authors: Ruixi Luo, Kai Jin, Zelin Ye

Abstract: In project management, a project is typically described as an activity-on-edge network (AOE network), where each activity / job is represented as an edge of some network $N$ (which is a DAG). Some jobs must be finished before others can be started, as described by the topology structure of $N$. It is known that job $j_i$ in normal speed would require $b_i$ days to be finished after it is started.… ▽ More In project management, a project is typically described as an activity-on-edge network (AOE network), where each activity / job is represented as an edge of some network $N$ (which is a DAG). Some jobs must be finished before others can be started, as described by the topology structure of $N$. It is known that job $j_i$ in normal speed would require $b_i$ days to be finished after it is started. Given the network $N$ with the associated edge lengths $b_1,\ldots,b_m$, the duration of the project is determined, which equals the length of the critical path (namely, the longest path) of $N$. To speed up the project (i.e. reduce the duration), the manager can crash a few jobs (namely, reduce the length of the corresponding edges) by investing extra resources into that job. However, the time for completing $j_i$ has a lower bound due to technological limits -- it requires at least $a_i$ days to be completed. Moreover, it is expensive to buy resources. Given $N$ and an integer $k\geq 1$, the $k$-crashing problem asks the minimum amount of resources required to speed up the project by $k$ days. We show a simple and efficient algorithm with an approximation ratio $\frac{1}{1}+\ldots+\frac{1}{k}$ for this problem. We also study a related problem called $k$-LIS, in which we are given a sequence $ω$ of numbers and we aim to find $k$ disjoint increasing subsequence of $ω$ with the largest total length. We show a $(1-\frac{1}{e})$-approximation algorithm which is simple and efficient. △ Less

Submitted 16 April, 2024; originally announced April 2024.

ACM Class: K.6.1

Multi-News+: Cost-efficient Dataset Cleansing via LLM-based Data Annotation

Authors: Juhwan Choi, Jungmin Yun, Kyohoon Jin, YoungBin Kim

Abstract: The quality of the dataset is crucial for ensuring optimal performance and reliability of downstream task models. However, datasets often contain noisy data inadvertently included during the construction process. Numerous attempts have been made to correct this issue through human annotators. However, hiring and managing human annotators is expensive and time-consuming. As an alternative, recent s… ▽ More The quality of the dataset is crucial for ensuring optimal performance and reliability of downstream task models. However, datasets often contain noisy data inadvertently included during the construction process. Numerous attempts have been made to correct this issue through human annotators. However, hiring and managing human annotators is expensive and time-consuming. As an alternative, recent studies are exploring the use of large language models (LLMs) for data annotation. In this study, we present a case study that extends the application of LLM-based data annotation to enhance the quality of existing datasets through a cleansing strategy. Specifically, we leverage approaches such as chain-of-thought (CoT) and majority voting to imitate human annotation and classify unrelated documents from the Multi-News dataset, which is widely used for the multi-document summarization task. Through our proposed cleansing method, we introduce an enhanced Multi-News+. By employing LLMs for data cleansing, we demonstrate an efficient and effective approach to improving dataset quality without relying on expensive human annotation efforts. △ Less

Submitted 15 April, 2024; originally announced April 2024.

JDEC: JPEG Decoding via Enhanced Continuous Cosine Coefficients

Authors: Woo Kyoung Han, Sunghoon Im, Jaedeok Kim, Kyong Hwan Jin

Abstract: We propose a practical approach to JPEG image decoding, utilizing a local implicit neural representation with continuous cosine formulation. The JPEG algorithm significantly quantizes discrete cosine transform (DCT) spectra to achieve a high compression rate, inevitably resulting in quality degradation while encoding an image. We have designed a continuous cosine spectrum estimator to address the… ▽ More We propose a practical approach to JPEG image decoding, utilizing a local implicit neural representation with continuous cosine formulation. The JPEG algorithm significantly quantizes discrete cosine transform (DCT) spectra to achieve a high compression rate, inevitably resulting in quality degradation while encoding an image. We have designed a continuous cosine spectrum estimator to address the quality degradation issue that restores the distorted spectrum. By leveraging local DCT formulations, our network has the privilege to exploit dequantization and upsampling simultaneously. Our proposed model enables decoding compressed images directly across different quality factors using a single pre-trained model without relying on a conventional JPEG decoder. As a result, our proposed network achieves state-of-the-art performance in flexible color image JPEG artifact removal tasks. Our source code is available at https://github.com/WooKyoungHan/JDEC. △ Less

Submitted 2 April, 2024; originally announced April 2024.

Self-Rectifying Diffusion Sampling with Perturbed-Attention Guidance

Authors: Donghoon Ahn, Hyoungwon Cho, Jaewon Min, Wooseok Jang, Jungwoo Kim, SeonHwa Kim, Hyun Hee Park, Kyong Hwan Jin, Seungryong Kim

Abstract: Recent studies have demonstrated that diffusion models are capable of generating high-quality samples, but their quality heavily depends on sampling guidance techniques, such as classifier guidance (CG) and classifier-free guidance (CFG). These techniques are often not applicable in unconditional generation or in various downstream tasks such as image restoration. In this paper, we propose a novel… ▽ More Recent studies have demonstrated that diffusion models are capable of generating high-quality samples, but their quality heavily depends on sampling guidance techniques, such as classifier guidance (CG) and classifier-free guidance (CFG). These techniques are often not applicable in unconditional generation or in various downstream tasks such as image restoration. In this paper, we propose a novel sampling guidance, called Perturbed-Attention Guidance (PAG), which improves diffusion sample quality across both unconditional and conditional settings, achieving this without requiring additional training or the integration of external modules. PAG is designed to progressively enhance the structure of samples throughout the denoising process. It involves generating intermediate samples with degraded structure by substituting selected self-attention maps in diffusion U-Net with an identity matrix, by considering the self-attention mechanisms' ability to capture structural information, and guiding the denoising process away from these degraded samples. In both ADM and Stable Diffusion, PAG surprisingly improves sample quality in conditional and even unconditional scenarios. Moreover, PAG significantly improves the baseline performance in various downstream tasks where existing guidances such as CG or CFG cannot be fully utilized, including ControlNet with empty prompts and image restoration such as inpainting and deblurring. △ Less

Submitted 26 March, 2024; originally announced March 2024.

Comments: Project page is available at https://ku-cvlab.github.io/Perturbed-Attention-Guidance

Enhancing Effectiveness and Robustness in a Low-Resource Regime via Decision-Boundary-aware Data Augmentation

Authors: Kyohoon Jin, Junho Lee, Juhwan Choi, Sangmin Song, Youngbin Kim

Abstract: Efforts to leverage deep learning models in low-resource regimes have led to numerous augmentation studies. However, the direct application of methods such as mixup and cutout to text data, is limited due to their discrete characteristics. While methods using pretrained language models have exhibited efficiency, they require additional considerations for robustness. Inspired by recent studies on d… ▽ More Efforts to leverage deep learning models in low-resource regimes have led to numerous augmentation studies. However, the direct application of methods such as mixup and cutout to text data, is limited due to their discrete characteristics. While methods using pretrained language models have exhibited efficiency, they require additional considerations for robustness. Inspired by recent studies on decision boundaries, this paper proposes a decision-boundary-aware data augmentation strategy to enhance robustness using pretrained language models. The proposed technique first focuses on shifting the latent features closer to the decision boundary, followed by reconstruction to generate an ambiguous version with a soft label. Additionally, mid-K sampling is suggested to enhance the diversity of the generated sentences. This paper demonstrates the performance of the proposed augmentation strategy compared to other methods through extensive experiments. Furthermore, the ablation study reveals the effect of soft labels and mid-K sampling and the extensibility of the method with curriculum data augmentation. △ Less

Submitted 22 March, 2024; originally announced March 2024.

Comments: Accepted at LREC-COLING 2024

Can ChatGPT Support Developers? An Empirical Evaluation of Large Language Models for Code Generation

Authors: Kailun Jin, Chung-Yu Wang, Hung Viet Pham, Hadi Hemmati

Abstract: Large language models (LLMs) have demonstrated notable proficiency in code generation, with numerous prior studies showing their promising capabilities in various development scenarios. However, these studies mainly provide evaluations in research settings, which leaves a significant gap in understanding how effectively LLMs can support developers in real-world. To address this, we conducted an em… ▽ More Large language models (LLMs) have demonstrated notable proficiency in code generation, with numerous prior studies showing their promising capabilities in various development scenarios. However, these studies mainly provide evaluations in research settings, which leaves a significant gap in understanding how effectively LLMs can support developers in real-world. To address this, we conducted an empirical analysis of conversations in DevGPT, a dataset collected from developers' conversations with ChatGPT (captured with the Share Link feature on platforms such as GitHub). Our empirical findings indicate that the current practice of using LLM-generated code is typically limited to either demonstrating high-level concepts or providing examples in documentation, rather than to be used as production-ready code. These findings indicate that there is much future work needed to improve LLMs in code generation before they can be integral parts of modern software development. △ Less

Submitted 16 March, 2024; v1 submitted 18 February, 2024; originally announced February 2024.

Comments: 4 pages, 3 figures, 21st International Conference on Mining Software Repositories (MSR '24), April 15-16, 2024, Lisbon, Portugal

ACM Class: I.2.2

SoftEDA: Rethinking Rule-Based Data Augmentation with Soft Labels

Authors: Juhwan Choi, Kyohoon Jin, Junho Lee, Sangmin Song, Youngbin Kim

Abstract: Rule-based text data augmentation is widely used for NLP tasks due to its simplicity. However, this method can potentially damage the original meaning of the text, ultimately hurting the performance of the model. To overcome this limitation, we propose a straightforward technique for applying soft labels to augmented data. We conducted experiments across seven different classification tasks and em… ▽ More Rule-based text data augmentation is widely used for NLP tasks due to its simplicity. However, this method can potentially damage the original meaning of the text, ultimately hurting the performance of the model. To overcome this limitation, we propose a straightforward technique for applying soft labels to augmented data. We conducted experiments across seven different classification tasks and empirically demonstrated the effectiveness of our proposed approach. We have publicly opened our source code for reproducibility. △ Less

Submitted 8 February, 2024; originally announced February 2024.

Comments: ICLR 2023 Tiny Papers

AutoAugment Is What You Need: Enhancing Rule-based Augmentation Methods in Low-resource Regimes

Authors: Juhwan Choi, Kyohoon Jin, Junho Lee, Sangmin Song, Youngbin Kim

Abstract: Text data augmentation is a complex problem due to the discrete nature of sentences. Although rule-based augmentation methods are widely adopted in real-world applications because of their simplicity, they suffer from potential semantic damage. Previous researchers have suggested easy data augmentation with soft labels (softEDA), employing label smoothing to mitigate this problem. However, finding… ▽ More Text data augmentation is a complex problem due to the discrete nature of sentences. Although rule-based augmentation methods are widely adopted in real-world applications because of their simplicity, they suffer from potential semantic damage. Previous researchers have suggested easy data augmentation with soft labels (softEDA), employing label smoothing to mitigate this problem. However, finding the best factor for each model and dataset is challenging; therefore, using softEDA in real-world applications is still difficult. In this paper, we propose adapting AutoAugment to solve this problem. The experimental results suggest that the proposed method can boost existing augmentation methods and that rule-based methods can enhance cutting-edge pre-trained language models. We offer the source code. △ Less

Submitted 8 February, 2024; originally announced February 2024.

Comments: EACL 2024 Student Research Workshop

GPTs Are Multilingual Annotators for Sequence Generation Tasks

Authors: Juhwan Choi, Eunju Lee, Kyohoon Jin, YoungBin Kim

Abstract: Data annotation is an essential step for constructing new datasets. However, the conventional approach of data annotation through crowdsourcing is both time-consuming and expensive. In addition, the complexity of this process increases when dealing with low-resource languages owing to the difference in the language pool of crowdworkers. To address these issues, this study proposes an autonomous an… ▽ More Data annotation is an essential step for constructing new datasets. However, the conventional approach of data annotation through crowdsourcing is both time-consuming and expensive. In addition, the complexity of this process increases when dealing with low-resource languages owing to the difference in the language pool of crowdworkers. To address these issues, this study proposes an autonomous annotation method by utilizing large language models, which have been recently demonstrated to exhibit remarkable performance. Through our experiments, we demonstrate that the proposed method is not just cost-efficient but also applicable for low-resource language annotation. Additionally, we constructed an image captioning dataset using our approach and are committed to open this dataset for future study. We have opened our source code for further study and reproducibility. △ Less

Submitted 8 February, 2024; originally announced February 2024.

Comments: EACL 2024 Findings: Camera-ready version

Timed-Elastic-Band Based Variable Splitting for Autonomous Trajectory Planning

Authors: Hao Zhu, Kefan Jin, Rui Gao, Jialin Wang, C. -J. Richard Shi

Abstract: Existing trajectory planning methods are struggling to handle the issue of autonomous track swinging during navigation, resulting in significant errors when reaching the destination. In this article, we address autonomous trajectory planning problems, which aims at developing innovative solutions to enhance the adaptability and robustness of unmanned systems in navigating complex and dynamic envir… ▽ More Existing trajectory planning methods are struggling to handle the issue of autonomous track swinging during navigation, resulting in significant errors when reaching the destination. In this article, we address autonomous trajectory planning problems, which aims at developing innovative solutions to enhance the adaptability and robustness of unmanned systems in navigating complex and dynamic environments. We first introduce the variable splitting (VS) method as a constrained optimization method to reimagine the renowned Timed-Elastic-Band (TEB) algorithm, resulting in a novel collision avoidance approach named Timed-Elastic-Band based variable splitting (TEB-VS). The proposed TEB-VS demonstrates superior navigation stability, while maintaining nearly identical resource consumption to TEB. We then analyze the convergence of the proposed TEB-VS method. To evaluate the effectiveness and efficiency of TEB-VS, extensive experiments have been conducted using TurtleBot2 in both simulated environments and real-world datasets. △ Less

Submitted 5 February, 2024; originally announced February 2024.

Non-orthogonal cavity modes near exceptional points in the far field

Authors: Jingnan Yang, Shushu Shi, Sai Yan, Rui Zhu, Xiaoming Zhao, Yi Qin, Bowen Fu, Xiqing Chen, Hancong Li, Zhanchun Zuo, Kuijuan Jin, Qihuang Gong, Xiulai Xu

Abstract: Non-orthogonal eigenstates are a fundamental feature of non-Hermitian systems and are accompanied by the emergence of nontrivial features. However, the platforms to explore non-Hermitian mode couplings mainly measure near-field effects, and the far-field behaviour remain mostly unexplored. Here, we study how a microcavity with non-Hermitian mode coupling exhibits eigenstate non-orthogonality by in… ▽ More Non-orthogonal eigenstates are a fundamental feature of non-Hermitian systems and are accompanied by the emergence of nontrivial features. However, the platforms to explore non-Hermitian mode couplings mainly measure near-field effects, and the far-field behaviour remain mostly unexplored. Here, we study how a microcavity with non-Hermitian mode coupling exhibits eigenstate non-orthogonality by investigating the spatial field and the far-field polarization of cavity modes. The non-Hermiticity arises from asymmetric backscattering, which is controlled by integrating two scatterers of different size and location into a microdisk. We observe that the spatial field overlaps of two modes increases abruptly to its maximum value, whilst different far-field elliptical polarizations of two modes coalesce when approaching an exceptional point. We demonstrate such features experimentally by measuring the far-field polarization from the fabricated microdisks. Our work reveals the non-orthogonality in the far-field degree of freedom, and the integrability of the microdisks paves a way to integrate more non-Hermitian optical properties into nanophotonic systems. △ Less

Submitted 6 January, 2024; originally announced January 2024.

Comments: 11pages, 4 figures

Journal ref: Communications Physics,7,13 (2024)

Microscopic Origin of Chiral Charge Density Wave in TiSe2

Authors: Hyeonjung Kim, Kyung-Hwan Jin, Han Woong Yeom

Abstract: Chiral charge density wave (CDW) is widely observed in low dimensional systems to be entangled with various emerging phases but its microscopic origin has been elusive. We reinvestigate the representative but debated chiral CDW of TiSe$_{2}$ using scanning tunneling microscopy (STM) and density functional theory (DFT) calculations. Our STM data reveal unambiguously the chiral distortion of the top… ▽ More Chiral charge density wave (CDW) is widely observed in low dimensional systems to be entangled with various emerging phases but its microscopic origin has been elusive. We reinvestigate the representative but debated chiral CDW of TiSe$_{2}$ using scanning tunneling microscopy (STM) and density functional theory (DFT) calculations. Our STM data reveal unambiguously the chiral distortion of the topmost Se layer in domains of opposite chirality, which are interfaced with a novel domain wall. DFT calculations find the atomic structure of the chiral CDW, which has a $C2$ symmetry with the inversion and reflection symmetry broken. The chirality is determined by the helicity of Se-Ti bond distortions and their translation between neighboring layers. The present structure reproduces well the STM images with lower energy than the prevailing non-chiral $P\bar{3}c1$ structure model. Our result provides the atomistic understanding of the CDW chirality in TiSe$_{2}$, which can be referred to in a wide class of monolayer and layered materials with CDW. △ Less

Submitted 3 January, 2024; originally announced January 2024.

Masked Contrastive Reconstruction for Cross-modal Medical Image-Report Retrieval

Authors: Zeqiang Wei, Kai Jin, Xiuzhuang Zhou

Abstract: Cross-modal medical image-report retrieval task plays a significant role in clinical diagnosis and various medical generative tasks. Eliminating heterogeneity between different modalities to enhance semantic consistency is the key challenge of this task. The current Vision-Language Pretraining (VLP) models, with cross-modal contrastive learning and masked reconstruction as joint training tasks, ca… ▽ More Cross-modal medical image-report retrieval task plays a significant role in clinical diagnosis and various medical generative tasks. Eliminating heterogeneity between different modalities to enhance semantic consistency is the key challenge of this task. The current Vision-Language Pretraining (VLP) models, with cross-modal contrastive learning and masked reconstruction as joint training tasks, can effectively enhance the performance of cross-modal retrieval. This framework typically employs dual-stream inputs, using unmasked data for cross-modal contrastive learning and masked data for reconstruction. However, due to task competition and information interference caused by significant differences between the inputs of the two proxy tasks, the effectiveness of representation learning for intra-modal and cross-modal features is limited. In this paper, we propose an efficient VLP framework named Masked Contrastive and Reconstruction (MCR), which takes masked data as the sole input for both tasks. This enhances task connections, reducing information interference and competition between them, while also substantially decreasing the required GPU memory and training time. Moreover, we introduce a new modality alignment strategy named Mapping before Aggregation (MbA). Unlike previous methods, MbA maps different modalities to a common feature space before conducting local feature aggregation, thereby reducing the loss of fine-grained semantic information necessary for improved modality alignment. Qualitative and quantitative experiments conducted on the MIMIC-CXR dataset validate the effectiveness of our approach, demonstrating state-of-the-art performance in medical cross-modal retrieval tasks. △ Less

Submitted 26 December, 2023; v1 submitted 25 December, 2023; originally announced December 2023.

Metal-to-insulator transition in oxide semimetals by anion doping

Authors: Haitao Hong, Huimin Zhang, Shan Lin, Jeffrey A. Dhas, Binod Paudel, Shuai Xu, Shengru Chen, Ting Cui, Yiyan Fan, Dongke Rong, Qiao Jin, Zihua Zhu, Yingge Du, Scott A. Chambers, Chen Ge, Can Wang, Qinghua Zhang, Le Wang, Kui-juan Jin, Shuai Dong, Er-Jia Guo

Abstract: Oxide semimetals exhibiting both nontrivial topological characteristics stand as exemplary parent compounds and multiple degrees of freedom, offering great promise for the realization of novel electronic states. In this study, we present compelling evidence of profound structural and transport phase shifts in a recently uncovered oxide semimetal, SrNbO3, achieved through effective in-situ anion do… ▽ More Oxide semimetals exhibiting both nontrivial topological characteristics stand as exemplary parent compounds and multiple degrees of freedom, offering great promise for the realization of novel electronic states. In this study, we present compelling evidence of profound structural and transport phase shifts in a recently uncovered oxide semimetal, SrNbO3, achieved through effective in-situ anion doping. Notably, a remarkable increase in resistivity of more than three orders of magnitude at room temperature is observed upon nitrogen-doping. The extent of electronic modulation in SrNbO3 is strongly correlated with the misfit strain, underscoring its phase instability to both chemical doping and crystallographic symmetry variations. Using first-principles calculations, we discern that elevating the level of nitrogen doping induces an upward shift in the conductive bands of SrNbO3-dNd. Consequently, a transition from a metallic state to an insulating state becomes apparent as the nitrogen concentration reaches a threshold of 1/3. This investigation sheds light on the potential of anion engineering in oxide semimetals, offering pathways for manipulating their physical properties. These insights hold promise for future applications that harness these materials for tailored functionalities. △ Less

Submitted 27 November, 2023; originally announced November 2023.

Comments: 18 pages, 4 figures

Strain mediated phase crossover in Ruddlesden Popper nickelates

Authors: Ting Cui, Songhee Choi, Ting Lin, Chen Liu, Gang Wang, Ningning Wang, Shengru Chen, Haitao Hong, Dongke Rong, Qianying Wang, Qiao Jin, Jia-Ou Wang, Lin Gu, Chen Ge, Can Wang, Jin Guang Cheng, Qinghua Zhang, Liang Si, Kui-juan Jin, Er-Jia Guo

Abstract: Recent progress on the signatures of pressure-induced high temperature superconductivity in Ruddlesden Popper (RP) nickelates (Lan+1NinO3n+1) has attracted growing interest in both theoretical calculations and experimental efforts. The fabrication of high-quality single crystalline RP nickelate thin films is critical for possible reducing the superconducting transition pressure and advancing appli… ▽ More Recent progress on the signatures of pressure-induced high temperature superconductivity in Ruddlesden Popper (RP) nickelates (Lan+1NinO3n+1) has attracted growing interest in both theoretical calculations and experimental efforts. The fabrication of high-quality single crystalline RP nickelate thin films is critical for possible reducing the superconducting transition pressure and advancing applications in microelectronics in the future. In this study, we report the observations of an active phase transition in RP nickelate films induced by misfit strain. We found that RP nickelate films favor the perovskite structure (n = infinite) under tensile strains, while compressive strains stabilize the La3Ni2O7 (n = 2) phase. The selection of distinct phases is governed by the strain dependent formation energy and electronic configuration. In compressively strained La3Ni2O7, we experimentally determined splitting energy is ~0.2 eV and electrons prefer to occupy in-plane orbitals. First principles calculations unveil a robust coupling between strain effects and the valence state of Ni ions in RP nickelates, suggesting a dual driving force for the inevitable phase co-existence transition in RP nickelates. Our work underscores the sensitivity of RP nickelate formation to epitaxial strain, presenting a significant challenge in fabricating pure-phase RP nickelate films. Therefore, special attention to stacking defects and grain boundaries between different RP phases is essential when discussing the pressure-induced superconductivity in RP nickelates. △ Less

Submitted 22 November, 2023; originally announced November 2023.

Comments: 29 pages, 5 figures, one supplementary materials

Quantum Griffiths singularity in three-dimensional superconductor to Anderson critical insulator transition

Authors: Shichao Qi, Yi Liu, Ziqiao Wang, Fucong Chen, Qian Li, Haoran Ji, Rao Li, Yanan Li, Jingchao Fang, Haiwen Liu, Fa Wang, Kui Jin, X. C. Xie, Jian Wang

Abstract: Disorder is ubiquitous in real materials and can have dramatic effects on quantum phase transitions. Originating from the disorder enhanced quantum fluctuation, quantum Griffiths singularity (QGS) has been revealed as a universal phenomenon in quantum criticality of low-dimensional superconductors. However, due to the weak fluctuation effect, QGS is very challenging to detect experimentally in thr… ▽ More Disorder is ubiquitous in real materials and can have dramatic effects on quantum phase transitions. Originating from the disorder enhanced quantum fluctuation, quantum Griffiths singularity (QGS) has been revealed as a universal phenomenon in quantum criticality of low-dimensional superconductors. However, due to the weak fluctuation effect, QGS is very challenging to detect experimentally in three-dimensional (3D) superconducting systems. Here we report the discovery of QGS associated with the quantum phase transition from 3D superconductor to Anderson critical insulator in a spinel oxide MgTi2O4 (MTO). Under both perpendicular and parallel magnetic field, the dynamical critical exponent diverges when approaching the quantum critical point, demonstrating the existence of 3D QGS. Among 3D superconductors, MTO shows relatively strong fluctuation effect featured as a wide superconducting transition region. The enhanced fluctuation, which may arise from the mobility edge of Anderson localization, finally leads to the occurrence of 3D quantum phase transition and QGS. Our findings offer a new perspective to understand quantum phase transitions in strongly disordered 3D systems. △ Less

Submitted 11 November, 2023; originally announced November 2023.

Highly Anisotropic Elastic Properties of Suspended Black Arsenic Nanoribbons

Authors: Yunfei Yu, Guoshuai Du, Shang Chen, Jingjing Zhang, Yubing Du, Qinglin Xia, Ke Jin, Yabin Chen

Abstract: Anisotropy, as an exotic degree of freedom, enables us to discover the emergent two-dimensional (2D) layered nanomaterials with low in-plane symmetry and to explore their outstanding properties and promising applications. 2D black arsenic (b-As) with puckered structure has garnered increasing attention these years owing to its extreme anisotropy with respect to the electrical, thermal, and optical… ▽ More Anisotropy, as an exotic degree of freedom, enables us to discover the emergent two-dimensional (2D) layered nanomaterials with low in-plane symmetry and to explore their outstanding properties and promising applications. 2D black arsenic (b-As) with puckered structure has garnered increasing attention these years owing to its extreme anisotropy with respect to the electrical, thermal, and optical properties. However, the investigation on mechanical properties of 2D b-As is still lacking, despite much effort on theoretical simulations. Herein, we report the highly anisotropic elastic properties of suspended b-As nanoribbons via atomic force microscope-based nanoindentation. It was found that the extracted Young's modulus of b-As nanoribbons exhibits remarkable anisotropy, which approximates to 72.2 +- 5.4 and 44.3 +- 1.4 GPa along zigzag and armchair directions, respectively. The anisotropic ratio reaches up to ~ 1.6. We expect that these results could lay a solid foundation for the potential applications of 2D anisotropic nanomaterials in the next-generation nanomechanics and optoelectronics. △ Less

Submitted 31 October, 2023; originally announced October 2023.

Comments: 17 pages, 5 figures

Evolution of the magnetic excitations in electron-doped $\mathrm{La}_{2-x} \mathrm{Ce}_x \mathrm{CuO}_{4}$

Authors: X. T. Li, S. J. Tu, L. Chaix, C. Fawaz, M. d'Astuto, X. Li, F. Yakhou-Harris, K. Kummer, N. B. Brookes, M. Garcia-Fernandez, K. J. Zhou, Z. F. Lin, J. Yuan, K. Jin, M. P. M. Dean, X. Liu

Abstract: We investigated the high energy spin excitations in electron-doped $\mathrm{La}_{2-x} \mathrm{Ce}_x \mathrm{CuO}_{4}$, a cuprate superconductor, by resonant inelastic x-ray scattering (RIXS) measurements. Efforts were paid to disentangle the paramagnon signal from non-spin-flip spectral weight mixing in the RIXS spectrum at $\bf{Q_{\|}}$ = $(0.6π, 0)$ and $(0.9π, 0)$ along the (1 0) direction. Our… ▽ More We investigated the high energy spin excitations in electron-doped $\mathrm{La}_{2-x} \mathrm{Ce}_x \mathrm{CuO}_{4}$, a cuprate superconductor, by resonant inelastic x-ray scattering (RIXS) measurements. Efforts were paid to disentangle the paramagnon signal from non-spin-flip spectral weight mixing in the RIXS spectrum at $\bf{Q_{\|}}$ = $(0.6π, 0)$ and $(0.9π, 0)$ along the (1 0) direction. Our results show that, for doping level x from 0.07 to 0.185, the variation of the paramagnon excitation energy is marginal. We discuss the implication of our results in connection with the evolution of the electron correlation strength in this system. △ Less

Submitted 17 January, 2024; v1 submitted 19 October, 2023; originally announced October 2023.

Comments: in press on Phys. Rev. Lett

Journal ref: Phys. Rev. Lett. 132, 056002 (2024)

Mesh Represented Recycle Learning for 3D Hand Pose and Mesh Estimation

Authors: Bosang Kim, Jonghyun Kim, Hyotae Lee, Lanying Jin, Jeongwon Ha, Dowoo Kwon, Jungpyo Kim, Wonhyeok Im, KyungMin Jin, Jungho Lee

Abstract: In general, hand pose estimation aims to improve the robustness of model performance in the real-world scenes. However, it is difficult to enhance the robustness since existing datasets are obtained in restricted environments to annotate 3D information. Although neural networks quantitatively achieve a high estimation accuracy, unsatisfied results can be observed in visual quality. This discrepanc… ▽ More In general, hand pose estimation aims to improve the robustness of model performance in the real-world scenes. However, it is difficult to enhance the robustness since existing datasets are obtained in restricted environments to annotate 3D information. Although neural networks quantitatively achieve a high estimation accuracy, unsatisfied results can be observed in visual quality. This discrepancy between quantitative results and their visual qualities remains an open issue in the hand pose representation. To this end, we propose a mesh represented recycle learning strategy for 3D hand pose and mesh estimation which reinforces synthesized hand mesh representation in a training phase. To be specific, a hand pose and mesh estimation model first predicts parametric 3D hand annotations (i.e., 3D keypoint positions and vertices for hand mesh) with real-world hand images in the training phase. Second, synthetic hand images are generated with self-estimated hand mesh representations. After that, the synthetic hand images are fed into the same model again. Thus, the proposed learning strategy simultaneously improves quantitative results and visual qualities by reinforcing synthetic mesh representation. To encourage consistency between original model output and its recycled one, we propose self-correlation loss which maximizes the accuracy and reliability of our learning strategy. Consequently, the model effectively conducts self-refinement on hand pose estimation by learning mesh representation from its own output. To demonstrate the effectiveness of our learning strategy, we provide extensive experiments on FreiHAND dataset. Notably, our learning strategy improves the performance on hand pose and mesh estimation without any extra computational burden during the inference. △ Less

Submitted 18 October, 2023; originally announced October 2023.

A singlet-triplet hole-spin qubit in MOS silicon

Authors: S. D. Liles, D. J. Halverson, Z. Wang, A. Shamim, R. S. Eggli, I. K. Jin, J. Hillier, K. Kumar, I. Vorreiter, M. Rendell, J. H. Huang, C. C. Escott, F. E. Hudson, W. H. Lim, D. Culcer, A. S. Dzurak, A. R. Hamilton

Abstract: Holes in silicon quantum dots are promising for spin qubit applications due to the strong intrinsic spin-orbit coupling. The spin-orbit coupling produces complex hole-spin dynamics, providing opportunities to further optimize spin qubits. Here, we demonstrate a singlet-triplet qubit using hole states in a planar metal-oxide-semiconductor double quantum dot. We observe rapid qubit control with sing… ▽ More Holes in silicon quantum dots are promising for spin qubit applications due to the strong intrinsic spin-orbit coupling. The spin-orbit coupling produces complex hole-spin dynamics, providing opportunities to further optimize spin qubits. Here, we demonstrate a singlet-triplet qubit using hole states in a planar metal-oxide-semiconductor double quantum dot. We observe rapid qubit control with singlet-triplet oscillations up to 400 MHz. The qubit exhibits promising coherence, with a maximum dephasing time of 600 ns, which is enhanced to 1.3 us using refocusing techniques. We investigate the magnetic field anisotropy of the eigenstates, and determine a magnetic field orientation to improve the qubit initialisation fidelity. These results present a step forward for spin qubit technology, by implementing a high quality singlet-triplet hole-spin qubit in planar architecture suitable for scaling up to 2D arrays of coupled qubits. △ Less

Submitted 14 October, 2023; originally announced October 2023.

CLIP for Lightweight Semantic Segmentation

Authors: Ke Jin, Wankou Yang

Abstract: The large-scale pretrained model CLIP, trained on 400 million image-text pairs, offers a promising paradigm for tackling vision tasks, albeit at the image level. Later works, such as DenseCLIP and LSeg, extend this paradigm to dense prediction, including semantic segmentation, and have achieved excellent results. However, the above methods either rely on CLIP-pretrained visual backbones or use non… ▽ More The large-scale pretrained model CLIP, trained on 400 million image-text pairs, offers a promising paradigm for tackling vision tasks, albeit at the image level. Later works, such as DenseCLIP and LSeg, extend this paradigm to dense prediction, including semantic segmentation, and have achieved excellent results. However, the above methods either rely on CLIP-pretrained visual backbones or use none-pretrained but heavy backbones such as Swin, while falling ineffective when applied to lightweight backbones. The reason for this is that the lightweitht networks, feature extraction ability of which are relatively limited, meet difficulty embedding the image feature aligned with text embeddings perfectly. In this work, we present a new feature fusion module which tackles this problem and enables language-guided paradigm to be applied to lightweight networks. Specifically, the module is a parallel design of CNN and transformer with a two-way bridge in between, where CNN extracts spatial information and visual context of the feature map from the image encoder, and the transformer propagates text embeddings from the text encoder forward. The core of the module is the bidirectional fusion of visual and text feature across the bridge which prompts their proximity and alignment in embedding space. The module is model-agnostic, which can not only make language-guided lightweight semantic segmentation practical, but also fully exploit the pretrained knowledge of language priors and achieve better performance than previous SOTA work, such as DenseCLIP, whatever the vision backbone is. Extensive experiments have been conducted to demonstrate the superiority of our method. △ Less

Submitted 11 October, 2023; originally announced October 2023.

Experimental observation of highly anisotropic elastic properties of two-dimensional black arsenic

Authors: Jingjing Zhang, Shang Chen, Guoshuai Du, Yunfei Yu, Wuxiao Han, Qinglin Xia, Ke Jin, Yabin Chen

Abstract: Anisotropic two-dimensional layered materials with low-symmetric lattices have attracted increasing attention due to their unique orientation-dependent mechanical properties. Black arsenic (b-As), with the puckered structure, exhibits extreme in-plane anisotropy in optical, electrical and thermal properties. However, experimental research on mechanical properties of b-As is very rare, although the… ▽ More Anisotropic two-dimensional layered materials with low-symmetric lattices have attracted increasing attention due to their unique orientation-dependent mechanical properties. Black arsenic (b-As), with the puckered structure, exhibits extreme in-plane anisotropy in optical, electrical and thermal properties. However, experimental research on mechanical properties of b-As is very rare, although theoretical calculations predicted the exotic elastic properties of b-As, such as anisotropic Young's modulus and negative Poisson's ratio. Herein, experimental observations on highly anisotropic elastic properties of b-As were demonstrated using our developed in situ tensile straining setup based on the effective microelectromechanical system. The cyclic and repeatable load-displacement curves proved that Young's modulus along zigzag direction was ~1.6 times greater than that along armchair direction, while the anisotropic ratio of ultimate strain reached ~2.5, attributed to hinge structure in armchair direction. This study could provide significant insights to design novel anisotropic materials and explore their potential applications in nanomechanics and nanodevices. △ Less

Submitted 27 September, 2023; originally announced September 2023.

Comments: 19 pages, 5 figures

Emergent Quantum Phenomena of Noncentrosymmetric Charge-Density Wave in 1T-Transition Metal Dichalcogenides

Authors: Cheong-Eung Ahn, Kyung-Hwan Jin, Young-Jae Choi, Jae Whan Park, Han Woong Yeom, Ara Go, Yong Baek Kim, Gil Young Cho

Abstract: 1T-transition metal dichalcogenides (TMD) have been an exciting platform for exploring the intertwinement of charge density waves and strong correlation phenomena. While the David star structure has been conventionally considered as the underlying charge order in the literature, recent scanning tunneling probe experiments on several monolayer 1T-TMD materials have motivated a new, alternative stru… ▽ More 1T-transition metal dichalcogenides (TMD) have been an exciting platform for exploring the intertwinement of charge density waves and strong correlation phenomena. While the David star structure has been conventionally considered as the underlying charge order in the literature, recent scanning tunneling probe experiments on several monolayer 1T-TMD materials have motivated a new, alternative structure, namely the anion-centered David star structure. In this Letter, we show that this novel anion-centered David star structure manifestly breaks inversion symmetry, resulting in flat bands with pronounced Rashba spin-orbit couplings. These distinctive features unlock novel possibilities and functionalities for 1T-TMDs, including the giant spin Hall effect, the emergence of Chern bands, and spin liquid that spontaneously breaks crystalline rotational symmetry. Our findings establish promising avenues for exploring emerging quantum phenomena of monolayer 1T-TMDs with this novel noncentrosymmetric structure. △ Less

Submitted 14 June, 2024; v1 submitted 27 September, 2023; originally announced September 2023.

Comments: 4.5+12 pages, 4+14 figures

Journal ref: Phys. Rev. Lett. 132, 226401 (2024)

BroadBEV: Collaborative LiDAR-camera Fusion for Broad-sighted Bird's Eye View Map Construction

Authors: Minsu Kim, Giseop Kim, Kyong Hwan Jin, Sunwook Choi

Abstract: A recent sensor fusion in a Bird's Eye View (BEV) space has shown its utility in various tasks such as 3D detection, map segmentation, etc. However, the approach struggles with inaccurate camera BEV estimation, and a perception of distant areas due to the sparsity of LiDAR points. In this paper, we propose a broad BEV fusion (BroadBEV) that addresses the problems with a spatial synchronization app… ▽ More A recent sensor fusion in a Bird's Eye View (BEV) space has shown its utility in various tasks such as 3D detection, map segmentation, etc. However, the approach struggles with inaccurate camera BEV estimation, and a perception of distant areas due to the sparsity of LiDAR points. In this paper, we propose a broad BEV fusion (BroadBEV) that addresses the problems with a spatial synchronization approach of cross-modality. Our strategy aims to enhance camera BEV estimation for a broad-sighted perception while simultaneously improving the completion of LiDAR's sparsity in the entire BEV space. Toward that end, we devise Point-scattering that scatters LiDAR BEV distribution to camera depth distribution. The method boosts the learning of depth estimation of the camera branch and induces accurate location of dense camera features in BEV space. For an effective BEV fusion between the spatially synchronized features, we suggest ColFusion that applies self-attention weights of LiDAR and camera BEV features to each other. Our extensive experiments demonstrate that BroadBEV provides a broad-sighted BEV perception with remarkable performance gains. △ Less

Submitted 8 November, 2023; v1 submitted 20 September, 2023; originally announced September 2023.

Superconductivity in the bcc-type High-entropy Alloy TiHfNbTaMo

Authors: Lingyong Zeng, Jie Zhan, Mebrouka Boubeche, Kuan Li, Longfu Li, Peifeng Yu, Kangwang Wang, Chao Zhang, Kui Jin, Yan Sun, Huixia Luo

Abstract: X-ray powder diffraction, electrical resistivity, magnetization, and thermodynamic measurements were conducted to investigate the structure and superconducting properties of TiHfNbTaMo, a novel high-entropy alloy possessing a valence electron count (VEC) of 4.8. The TiHfNbTaMo HEA was discovered to have a body-centered cubic structure and a microscopically homogeneous distribution of the constitue… ▽ More X-ray powder diffraction, electrical resistivity, magnetization, and thermodynamic measurements were conducted to investigate the structure and superconducting properties of TiHfNbTaMo, a novel high-entropy alloy possessing a valence electron count (VEC) of 4.8. The TiHfNbTaMo HEA was discovered to have a body-centered cubic structure and a microscopically homogeneous distribution of the constituent elements. This material shows type-II superconductivity with Tc = 3.42 K, lower critical field with 22.8 mT, and upper critical field with 3.95 T. Low-temperature specific heat measurements show that the alloy is a conventional s-wave type with a moderately coupled superconductor. First-principles calculations show that the density of states (DOS) of the TiHfNbTaMo alloy is dominated by hybrid d orbitals of these five metal elements. Additionally, the TiHfNbTaMo HEA exhibits three van Hove singularities. Furthermore, the VEC and the composition of the elements (especially the Nb elemental content) affect the Tc of the bcc-type HEA. △ Less

Submitted 18 September, 2023; originally announced September 2023.

Comments: 19 pages, 6 figures,The manuscript with the same title will be published by Advanced Quantum Technologies

Journal ref: Advanced Quantum Technologies,2023

Implicit Neural Image Stitching

Authors: Minsu Kim, Jaewon Lee, Byeonghun Lee, Sunghoon Im, Kyong Hwan Jin

Abstract: Existing frameworks for image stitching often provide visually reasonable stitchings. However, they suffer from blurry artifacts and disparities in illumination, depth level, etc. Although the recent learning-based stitchings relax such disparities, the required methods impose sacrifice of image qualities failing to capture high-frequency details for stitched images. To address the problem, we pro… ▽ More Existing frameworks for image stitching often provide visually reasonable stitchings. However, they suffer from blurry artifacts and disparities in illumination, depth level, etc. Although the recent learning-based stitchings relax such disparities, the required methods impose sacrifice of image qualities failing to capture high-frequency details for stitched images. To address the problem, we propose a novel approach, implicit Neural Image Stitching (NIS) that extends arbitrary-scale super-resolution. Our method estimates Fourier coefficients of images for quality-enhancing warps. Then, the suggested model blends color mismatches and misalignment in the latent space and decodes the features into RGB values of stitched images. Our experiments show that our approach achieves improvement in resolving the low-definition imaging of the previous deep image stitching with favorable accelerated image-enhancing methods. Our source code is available at https://github.com/minshu-kim/NIS. △ Less

Submitted 21 January, 2024; v1 submitted 4 September, 2023; originally announced September 2023.

Learning Residual Elastic Warps for Image Stitching under Dirichlet Boundary Condition

Authors: Minsu Kim, Yongjun Lee, Woo Kyoung Han, Kyong Hwan Jin

Abstract: Trendy suggestions for learning-based elastic warps enable the deep image stitchings to align images exposed to large parallax errors. Despite the remarkable alignments, the methods struggle with occasional holes or discontinuity between overlapping and non-overlapping regions of a target image as the applied training strategy mostly focuses on overlap region alignment. As a result, they require a… ▽ More Trendy suggestions for learning-based elastic warps enable the deep image stitchings to align images exposed to large parallax errors. Despite the remarkable alignments, the methods struggle with occasional holes or discontinuity between overlapping and non-overlapping regions of a target image as the applied training strategy mostly focuses on overlap region alignment. As a result, they require additional modules such as seam finder and image inpainting for hiding discontinuity and filling holes, respectively. In this work, we suggest Recurrent Elastic Warps (REwarp) that address the problem with Dirichlet boundary condition and boost performances by residual learning for recurrent misalign correction. Specifically, REwarp predicts a homography and a Thin-plate Spline (TPS) under the boundary constraint for discontinuity and hole-free image stitching. Our experiments show the favorable aligns and the competitive computational costs of REwarp compared to the existing stitching methods. Our source code is available at https://github.com/minshu-kim/REwarp. △ Less

Submitted 18 October, 2023; v1 submitted 4 September, 2023; originally announced September 2023.

Extremely strong coupling s-wave superconductivity in the medium-entropy alloy TiHfNbTa

Authors: Lingyong Zeng, Xunwu Hu, Mebrouka Boubeche, Kuan Li, Longfu Li, Peifei Yu, Kangwang Wang, Chao Zhang, Kui Jin, DaoXin Yao, Huixia Luo

Abstract: Here we report a TiHfNbTa bulk medium-entropy alloy (MEA) superconductor crystallized in the body-centered cubic structure, which is synthesized by an arc melting method. Superconducting properties of the TiHfNbTa are studied by employing magnetic susceptibility, resistivity, and specific heat measurements. Experimental results show a bulk superconducting transition temperature (Tc) of around 6.75… ▽ More Here we report a TiHfNbTa bulk medium-entropy alloy (MEA) superconductor crystallized in the body-centered cubic structure, which is synthesized by an arc melting method. Superconducting properties of the TiHfNbTa are studied by employing magnetic susceptibility, resistivity, and specific heat measurements. Experimental results show a bulk superconducting transition temperature (Tc) of around 6.75 K. The lower and upper crit-ical fields for TiHfNbTa are 45.8 mT and 10.46 T, respectively. First-principles calculations show that the d electron of Ti, Hf, Nb, and Ta is the main contribution near the Fermi level. Our results indicate that the superconductivity is a conven-tional s-wave type with extremely strong coupling. The extremely strong coupling behavior in the s-wave type TiHfNbTa MEA superconductor is unusual because it generally happens in cuprates, pnictides, and other unconventional superconductors. △ Less

Submitted 28 August, 2023; originally announced August 2023.

Comments: 21 pages, 6 figures

Journal ref: Sci. China-Phys. Mech. Astron.2023,66(7),277412

Planning with Logical Graph-based Language Model for Instruction Generation

Authors: Fan Zhang, Kebing Jin, Hankz Hankui Zhuo

Abstract: Despite the superior performance of large language models to generate natural language texts, it is hard to generate texts with correct logic according to a given task, due to the difficulties for neural models to capture implied rules from free-form texts. In this paper, we propose a novel graph-based language model, Logical-GLM, to infuse logic into language models for more valid text generation… ▽ More Despite the superior performance of large language models to generate natural language texts, it is hard to generate texts with correct logic according to a given task, due to the difficulties for neural models to capture implied rules from free-form texts. In this paper, we propose a novel graph-based language model, Logical-GLM, to infuse logic into language models for more valid text generation and interpretability. Specifically, we first capture information from natural language instructions and construct logical bayes graphs that generally describe domains. Next, we generate logical skeletons to guide language model training, infusing domain knowledge into language models. Finally, we alternately optimize the searching policy of graphs and language models until convergence. The experimental results show that Logical-GLM is both effective and efficient compared with traditional language models, despite using smaller-scale training data and fewer parameters. Our approach can generate instructional texts with more correct logic owing to the internalized domain knowledge. Moreover, the usage of logical graphs reflects the inner mechanism of the language models, which improves the interpretability of black-box models. △ Less

Submitted 5 July, 2024; v1 submitted 26 August, 2023; originally announced August 2023.

Comments: 9 pages, 8 figures

Phases and magnetism at the microscale in compounds containing nominal Pb10-xCux(PO4)6O

Authors: Chang Liu, Wenxin Cheng, Xiaoxiao Zhang, Juan Xu, Jiaxin Li, Qiuyan Shi, Changhong Yuan, Li Xu, Honglin Zhou, Shilin Zhu, Jianping Sun, Wei Wu, Jianlin Luo, Kui Jin, Yangmu Li

Abstract: Achieving superconductivity at room temperature could lead to substantial advancements in industry and technology. Recently, a compound known as Cu-doped lead-apatite, Pb10-xCux(PO4)6O (0.9 < x < 1.1), referred to as "LK-99", has been reported to exhibit unusual electrical and magnetic behaviors that appear to resemble a superconducting transition above room temperature. In this work we collected… ▽ More Achieving superconductivity at room temperature could lead to substantial advancements in industry and technology. Recently, a compound known as Cu-doped lead-apatite, Pb10-xCux(PO4)6O (0.9 < x < 1.1), referred to as "LK-99", has been reported to exhibit unusual electrical and magnetic behaviors that appear to resemble a superconducting transition above room temperature. In this work we collected multiphase samples containing the nominal Pb10-xCux(PO4)6O phase (no superconductivity observed in our measured samples), synthesized by three independent groups, and studied their chemical, magnetic, and electrical properties at the microscale to overcome difficulties in bulk measurements. Through the utilization of optical, scanning electron, atomic force, and scanning diamond nitrogen-vacancy microscopy techniques, we are able to establish a link between local magnetic properties and specific microscale chemical phases. Our findings indicate that while the Pb10-xCux(PO4)6O phase seems to have a mixed magnetism contribution, a significant fraction of the diamagnetic response can be attributed to Cu-rich regions (e.g., Cu2S derived from a reagent used in the synthesis). Additionally, our electrical measurements reveal the phenomenon of current path switch and a change in resistance states of Cu2S. This provides a potential explanation for the electrical behavior observed in compounds related to Pb10-xCux(PO4)6O. △ Less

Submitted 17 August, 2023; v1 submitted 15 August, 2023; originally announced August 2023.

Comments: 14 pages, 5 figures; Physical Review Materials

Journal ref: Phys. Rev. Materials 7, 084804 (2023)

Ongoing EEG artifact correction using blind source separation

Authors: Nicole Ille, Yoshiaki Nakao, Yano Shumpei, Toshiyuki Taura, Arndt Ebert, Harald Bornfleth, Suguru Asagi, Kanoko Kozawa, Izumi Itabashi, Takafumi Sato, Rie Sakuraba, Rie Tsuda, Yosuke Kakisaka, Kazutaka Jin, Nobukazu Nakasato

Abstract: Objective: Analysis of the electroencephalogram (EEG) for epileptic spike and seizure detection or brain-computer interfaces can be severely hampered by the presence of artifacts. The aim of this study is to describe and evaluate a fast automatic algorithm for ongoing correction of artifacts in continuous EEG recordings, which can be applied offline and online. Methods: The automatic algorithm for… ▽ More Objective: Analysis of the electroencephalogram (EEG) for epileptic spike and seizure detection or brain-computer interfaces can be severely hampered by the presence of artifacts. The aim of this study is to describe and evaluate a fast automatic algorithm for ongoing correction of artifacts in continuous EEG recordings, which can be applied offline and online. Methods: The automatic algorithm for ongoing correction of artifacts is based on fast blind source separation. It uses a sliding window technique with overlapping epochs and features in the spatial, temporal and frequency domain to detect and correct ocular, cardiac, muscle and powerline artifacts. Results: The approach was validated in an independent evaluation study on publicly available continuous EEG data with 2035 marked artifacts. Validation confirmed that 88% of the artifacts could be removed successfully (ocular: 81%, cardiac: 84%, muscle: 98%, powerline: 100%). It outperformed state-of-the-art algorithms both in terms of artifact reduction rates and computation time. Conclusions: Fast ongoing artifact correction successfully removed a good proportion of artifacts, while preserving most of the EEG signals. Significance: The presented algorithm may be useful for ongoing correction of artifacts, e.g., in online systems for epileptic spike and seizure detection or brain-computer interfaces. △ Less

Submitted 29 June, 2023; originally announced June 2023.

Comments: 16 pages, 4 figures, 3 tables

Journal ref: Clinical Neurophysiology 158 (2024) 149-158

Suspended dry pick-up and flip-over assembly for van der Waals heterostructures with ultra-clean surfaces

Authors: Keda Jin, Tobias Wichmann, Sabine Wenzel, Tomas Samuely, Oleksander Onufriienko, Pavol Szabó, Kenji Watanabe, Takashi Taniguchi, Jiaqiang Yan, F. Stefan Tautz, Felix Lüpke, Markus Ternes, Jose Martinez-Castro

Abstract: Van der Waals heterostructures are an excellent platform for studying intriguing interface phenomena, such as moiré and proximity effects. Surface science techniques like scanning tunneling microscopy (STM) have proven a powerful tool to study such heterostructures but have so far been hampered because of their high sensitivity to surface contamination. Here, we report a dry polymer-based assembly… ▽ More Van der Waals heterostructures are an excellent platform for studying intriguing interface phenomena, such as moiré and proximity effects. Surface science techniques like scanning tunneling microscopy (STM) have proven a powerful tool to study such heterostructures but have so far been hampered because of their high sensitivity to surface contamination. Here, we report a dry polymer-based assembly technique to fabricate van der Waals heterostructures with atomically clean surfaces. The key features of our suspended dry pick-up and flip-over technique are 1) the heterostructure surface never comes into contact with polymers, 2) it is entirely solvent-free, 3) it is entirely performed in a glovebox, and 4) it only requires temperatures below 130$^{\circ}$. By performing ambient atomic force microscopy and atomically-resolved scanning tunneling microscopy on example heterostructures, we demonstrate that we can fabricate air-sensitive heterostructures with ultra-clean interfaces and surfaces. Due to the lack of polymer melting, the technique is further compatible with heterostructure assembly under ultra-high vacuum conditions, which promises ultimate heterostructure quality. △ Less

Submitted 17 June, 2023; originally announced June 2023.

Journal ref: Adv. Mater. Interfaces 2023, 2300658

PlayBest: Professional Basketball Player Behavior Synthesis via Planning with Diffusion

Authors: Xiusi Chen, Wei-Yao Wang, Ziniu Hu, David Reynoso, Kun Jin, Mingyan Liu, P. Jeffrey Brantingham, Wei Wang

Abstract: Dynamically planning in complex systems has been explored to improve decision-making in various domains. Professional basketball serves as a compelling example of a dynamic spatio-temporal game, encompassing context-dependent decision-making. However, processing the diverse on-court signals and navigating the vast space of potential actions and outcomes make it difficult for existing approaches to… ▽ More Dynamically planning in complex systems has been explored to improve decision-making in various domains. Professional basketball serves as a compelling example of a dynamic spatio-temporal game, encompassing context-dependent decision-making. However, processing the diverse on-court signals and navigating the vast space of potential actions and outcomes make it difficult for existing approaches to swiftly identify optimal strategies in response to evolving circumstances. In this study, we formulate the sequential decision-making process as a conditional trajectory generation process. Based on the formulation, we introduce PlayBest (PLAYer BEhavior SynThesis), a method to improve player decision-making. We extend the diffusion probabilistic model to learn challenging environmental dynamics from historical National Basketball Association (NBA) player motion tracking data. To incorporate data-driven strategies, an auxiliary value function is trained with corresponding rewards. To accomplish reward-guided trajectory generation, we condition the diffusion model on the value function via classifier-guided sampling. We validate the effectiveness of PlayBest through simulation studies, contrasting the generated trajectories with those employed by professional basketball teams. Our results reveal that the model excels at generating reasonable basketball trajectories that produce efficient plays. Moreover, the synthesized play strategies exhibit an alignment with professional tactics, highlighting the model's capacity to capture the intricate dynamics of basketball games. △ Less

Submitted 16 July, 2024; v1 submitted 6 June, 2023; originally announced June 2023.

Comments: CIKM 2024

Enhancing Point Annotations with Superpixel and Confidence Learning Guided for Improving Semi-Supervised OCT Fluid Segmentation

Authors: Tengjin Weng, Yang Shen, Kai Jin, Zhiming Cheng, Yunxiang Li, Gewen Zhang, Shuai Wang, Yaqi Wang

Abstract: Automatic segmentation of fluid in Optical Coherence Tomography (OCT) images is beneficial for ophthalmologists to make an accurate diagnosis. Although semi-supervised OCT fluid segmentation networks enhance their performance by introducing additional unlabeled data, the performance enhancement is limited. To address this, we propose Superpixel and Confident Learning Guide Point Annotations Networ… ▽ More Automatic segmentation of fluid in Optical Coherence Tomography (OCT) images is beneficial for ophthalmologists to make an accurate diagnosis. Although semi-supervised OCT fluid segmentation networks enhance their performance by introducing additional unlabeled data, the performance enhancement is limited. To address this, we propose Superpixel and Confident Learning Guide Point Annotations Network (SCLGPA-Net) based on the teacher-student architecture, which can learn OCT fluid segmentation from limited fully-annotated data and abundant point-annotated data. Specifically, we use points to annotate fluid regions in unlabeled OCT images and the Superpixel-Guided Pseudo-Label Generation (SGPLG) module generates pseudo-labels and pixel-level label trust maps from the point annotations. The label trust maps provide an indication of the reliability of the pseudo-labels. Furthermore, we propose the Confident Learning Guided Label Refinement (CLGLR) module identifies error information in the pseudo-labels and leads to further refinement. Experiments on the RETOUCH dataset show that we are able to reduce the need for fully-annotated data by 94.22\%, closing the gap with the best fully supervised baselines to a mean IoU of only 2\%. Furthermore, We constructed a private 2D OCT fluid segmentation dataset for evaluation. Compared with other methods, comprehensive experimental results demonstrate that the proposed method can achieve excellent performance in OCT fluid segmentation. △ Less

Submitted 30 November, 2023; v1 submitted 5 June, 2023; originally announced June 2023.

Comments: Submission to BSPC

DSGD-CECA: Decentralized SGD with Communication-Optimal Exact Consensus Algorithm

Authors: Lisang Ding, Kexin Jin, Bicheng Ying, Kun Yuan, Wotao Yin

Abstract: Decentralized Stochastic Gradient Descent (SGD) is an emerging neural network training approach that enables multiple agents to train a model collaboratively and simultaneously. Rather than using a central parameter server to collect gradients from all the agents, each agent keeps a copy of the model parameters and communicates with a small number of other agents to exchange model updates. Their c… ▽ More Decentralized Stochastic Gradient Descent (SGD) is an emerging neural network training approach that enables multiple agents to train a model collaboratively and simultaneously. Rather than using a central parameter server to collect gradients from all the agents, each agent keeps a copy of the model parameters and communicates with a small number of other agents to exchange model updates. Their communication, governed by the communication topology and gossip weight matrices, facilitates the exchange of model updates. The state-of-the-art approach uses the dynamic one-peer exponential-2 topology, achieving faster training times and improved scalability than the ring, grid, torus, and hypercube topologies. However, this approach requires a power-of-2 number of agents, which is impractical at scale. In this paper, we remove this restriction and propose \underline{D}ecentralized \underline{SGD} with \underline{C}ommunication-optimal \underline{E}xact \underline{C}onsensus \underline{A}lgorithm (DSGD-CECA), which works for any number of agents while still achieving state-of-the-art properties. In particular, DSGD-CECA incurs a unit per-iteration communication overhead and an $\tilde{O}(n^3)$ transient iteration complexity. Our proof is based on newly discovered properties of gossip weight matrices and a novel approach to combine them with DSGD's convergence analysis. Numerical experiments show the efficiency of DSGD-CECA. △ Less

Submitted 31 May, 2023; originally announced June 2023.

Sequential Condition Evolved Interaction Knowledge Graph for Traditional Chinese Medicine Recommendation

Authors: Jingjin Liu, Hankz Hankui Zhuo, Kebing Jin, Jiamin Yuan, Zhimin Yang, Zhengan Yao

Abstract: Traditional Chinese Medicine (TCM) has a rich history of utilizing natural herbs to treat a diversity of illnesses. In practice, TCM diagnosis and treatment are highly personalized and organically holistic, requiring comprehensive consideration of the patient's state and symptoms over time. However, existing TCM recommendation approaches overlook the changes in patient status and only explore pote… ▽ More Traditional Chinese Medicine (TCM) has a rich history of utilizing natural herbs to treat a diversity of illnesses. In practice, TCM diagnosis and treatment are highly personalized and organically holistic, requiring comprehensive consideration of the patient's state and symptoms over time. However, existing TCM recommendation approaches overlook the changes in patient status and only explore potential patterns between symptoms and prescriptions. In this paper, we propose a novel Sequential Condition Evolved Interaction Knowledge Graph (SCEIKG), a framework that treats the model as a sequential prescription-making problem by considering the dynamics of the patient's condition across multiple visits. In addition, we incorporate an interaction knowledge graph to enhance the accuracy of recommendations by considering the interactions between different herbs and the patient's condition. Experimental results on a real-world dataset demonstrate that our approach outperforms existing TCM recommendation methods, achieving state-of-the-art performance. △ Less

Submitted 6 October, 2023; v1 submitted 28 May, 2023; originally announced May 2023.

Robust Optical Data Encryption by Projection-Photoaligned Polymer-Stabilized-Liquid-Crystals

Authors: Siying Liu, Saleh Alfarhan, Wenbo Wang, Shuai Feng, Yuxiang Zhu, Luyang Liu, Kenan Song, Sui Yang, Kailong Jin, Xiangfan Chen

Abstract: The emerging Internet of Things (IoTs) invokes increasing security demands that require robust encryption or anti-counterfeiting technologies. Albeit being acknowledged as efficacious solutions in processing elaborate graphical information via multiple degrees of freedom, optical data encryption and anti-counterfeiting techniques are typically inept in delivering satisfactory performance without c… ▽ More The emerging Internet of Things (IoTs) invokes increasing security demands that require robust encryption or anti-counterfeiting technologies. Albeit being acknowledged as efficacious solutions in processing elaborate graphical information via multiple degrees of freedom, optical data encryption and anti-counterfeiting techniques are typically inept in delivering satisfactory performance without compromising the desired ease-of-processibility or compatibility, thus leading to the exploration of novel materials and devices that are competent. Here, a robust optical data encryption technique is demonstrated utilizing polymer-stabilized-liquid-crystals (PSLCs) combined with projection photoalignment and photopatterning methods. The PSLCs possess implicit optical patterns encoded via photoalignment, as well as explicit geometries produced via photopatterning. Furthermore, the PSLCs demonstrate improved robustness against harsh chemical environments and thermal stability, and can be directly deployed onto various rigid and flexible substrates. Based on this, it is demonstrated that single PSLC is apt to carry intricate information, or serve as exclusive watermark with both implicit features and explicit geometries. Moreover, a novel, generalized design strategy is developed, for the first time, to encode intricate and exclusive information with enhanced security by spatially programming the photoalignment patterns of a pair of cascade PSLCs, which further illustrates the promising capabilies of PSLCs in optical data encryption and anti-counterfeiting. △ Less

Submitted 24 May, 2023; originally announced May 2023.