Showing 1–50 of 753 results for author: Zou, B

Toward Robust Early Detection of Alzheimer's Disease via an Integrated Multimodal Learning Approach

Authors: Yifei Chen, Shenghao Zhu, Zhaojie Fang, Chang Liu, Binfeng Zou, Yuhe Wang, Shuo Chang, Fan Jia, Feiwei Qin, Jin Fan, Yong Peng, Changmiao Wang

Abstract: Alzheimer's Disease (AD) is a complex neurodegenerative disorder marked by memory loss, executive dysfunction, and personality changes. Early diagnosis is challenging due to subtle symptoms and varied presentations, often leading to misdiagnosis with traditional unimodal diagnostic methods due to their limited scope. This study introduces an advanced multimodal classification model that integrates… ▽ More Alzheimer's Disease (AD) is a complex neurodegenerative disorder marked by memory loss, executive dysfunction, and personality changes. Early diagnosis is challenging due to subtle symptoms and varied presentations, often leading to misdiagnosis with traditional unimodal diagnostic methods due to their limited scope. This study introduces an advanced multimodal classification model that integrates clinical, cognitive, neuroimaging, and EEG data to enhance diagnostic accuracy. The model incorporates a feature tagger with a tabular data coding architecture and utilizes the TimesBlock module to capture intricate temporal patterns in Electroencephalograms (EEG) data. By employing Cross-modal Attention Aggregation module, the model effectively fuses Magnetic Resonance Imaging (MRI) spatial information with EEG temporal data, significantly improving the distinction between AD, Mild Cognitive Impairment, and Normal Cognition. Simultaneously, we have constructed the first AD classification dataset that includes three modalities: EEG, MRI, and tabular data. Our innovative approach aims to facilitate early diagnosis and intervention, potentially slowing the progression of AD. The source code and our private ADMC dataset are available at https://github.com/JustlfC03/MSTNet. △ Less

Submitted 29 August, 2024; originally announced August 2024.

Comments: 5 pages, 2 figures

LN-Gen: Rectal Lymph Nodes Generation via Anatomical Features

Authors: Weidong Guo, Hantao Zhang, Shouhong Wan, Bingbing Zou, Wanqin Wang, Peiquan Jin

Abstract: Accurate segmentation of rectal lymph nodes is crucial for the staging and treatment planning of rectal cancer. However, the complexity of the surrounding anatomical structures and the scarcity of annotated data pose significant challenges. This study introduces a novel lymph node synthesis technique aimed at generating diverse and realistic synthetic rectal lymph node samples to mitigate the reli… ▽ More Accurate segmentation of rectal lymph nodes is crucial for the staging and treatment planning of rectal cancer. However, the complexity of the surrounding anatomical structures and the scarcity of annotated data pose significant challenges. This study introduces a novel lymph node synthesis technique aimed at generating diverse and realistic synthetic rectal lymph node samples to mitigate the reliance on manual annotation. Unlike direct diffusion methods, which often produce masks that are discontinuous and of suboptimal quality, our approach leverages an implicit SDF-based method for mask generation, ensuring the production of continuous, stable, and morphologically diverse masks. Experimental results demonstrate that our synthetic data significantly improves segmentation performance. Our work highlights the potential of diffusion model for accurately synthesizing structurally complex lesions, such as lymph nodes in rectal cancer, alleviating the challenge of limited annotated data in this field and aiding in advancements in rectal cancer diagnosis and treatment. △ Less

Submitted 27 August, 2024; originally announced August 2024.

Comments: 8 pages

CCAT: Prime-Cam Optics Overview and Status Update

Authors: Zachary B. Huber, Lawrence T. Lin, Eve M. Vavagiakis, Rodrigo G. Freundt, Victoria Butler, Scott C. Chapman, Steve K. Choi, Abigail T. Crites, Cody J. Duell, Patricio A. Gallardo, Anthony I. Huber, Ben Keller, Alicia Middleton, Michael D. Niemack, Thomas Nikola, John Orlowski-Scherer, Ema Smith, Gordon Stacey, Samantha Walker, Bugao Zou

Abstract: Prime-Cam is a first-generation science instrument for the CCAT Observatory's six-meter aperture Fred Young Submillimeter Telescope (FYST). FYST's crossed-Dragone design provides high optical throughput to take advantage of its unique site at 5600 m on Cerro Chajnantor in Chile's Atacama Desert to reach mapping speeds over ten times greater than current and near-term submillimeter experiments. Hou… ▽ More Prime-Cam is a first-generation science instrument for the CCAT Observatory's six-meter aperture Fred Young Submillimeter Telescope (FYST). FYST's crossed-Dragone design provides high optical throughput to take advantage of its unique site at 5600 m on Cerro Chajnantor in Chile's Atacama Desert to reach mapping speeds over ten times greater than current and near-term submillimeter experiments. Housing up to seven independent instrument modules in its 1.8-meter diameter cryostat, Prime-Cam will combine broadband polarization-sensitive modules and spectrometer modules designed for observations in several frequency windows between 210 GHz and 850 GHz to study a wide range of astrophysical questions from Big Bang cosmology to the formation of stars and galaxies in the Epoch of Reionization and beyond. In order to cover this range of frequencies and observation modes, each of the modules contains a set of cold reimaging optics that is optimized for the science goals of that module. These optical setups include several filters, three or four anti-reflection-coated silicon lenses, and a Lyot stop to control the field of view and illumination of the primary mirror, satisfy a series of mechanical constraints, and maximize optical performance within each passband. We summarize the design considerations and trade-offs for the optics in these modules and provide a status update on the fabrication of the Prime-Cam receiver and the design of its 1 K and 100 mK thermal BUSs. △ Less

Submitted 30 July, 2024; originally announced July 2024.

Comments: 10 pages, 6 figures, presented at SPIE Millimeter, Submillimeter, and Far-Infrared Detectors and Instrumentation for Astronomy XII

GFE-Mamba: Mamba-based AD Multi-modal Progression Assessment via Generative Feature Extraction from MCI

Authors: Zhaojie Fang, Shenghao Zhu, Yifei Chen, Binfeng Zou, Fan Jia, Linwei Qiu, Chang Liu, Yiyu Huang, Xiang Feng, Feiwei Qin, Changmiao Wang, Yeru Wang, Jin Fan, Changbiao Chu, Wan-Zhen Wu, Hu Zhao

Abstract: Alzheimer's Disease (AD) is an irreversible neurodegenerative disorder that often progresses from Mild Cognitive Impairment (MCI), leading to memory loss and significantly impacting patients' lives. Clinical trials indicate that early targeted interventions for MCI patients can potentially slow or halt the development and progression of AD. Previous research has shown that accurate medical classif… ▽ More Alzheimer's Disease (AD) is an irreversible neurodegenerative disorder that often progresses from Mild Cognitive Impairment (MCI), leading to memory loss and significantly impacting patients' lives. Clinical trials indicate that early targeted interventions for MCI patients can potentially slow or halt the development and progression of AD. Previous research has shown that accurate medical classification requires the inclusion of extensive multimodal data, such as assessment scales and various neuroimaging techniques like Magnetic Resonance Imaging (MRI) and Positron Emission Tomography (PET). However, consistently tracking the diagnosis of the same individual over time and simultaneously collecting multimodal data poses significant challenges. To address this issue, we introduce GFE-Mamba, a classifier based on Generative Feature Extraction (GFE). This classifier effectively integrates data from assessment scales, MRI, and PET, enabling deeper multimodal fusion. It efficiently extracts both long and short sequence information and incorporates additional information beyond the pixel space. This approach not only improves classification accuracy but also enhances the interpretability and stability of the model. We constructed datasets of over 3000 samples based on the Alzheimer's Disease Neuroimaging Initiative (ADNI) for a two-step training process. Our experimental results demonstrate that the GFE-Mamba model is effective in predicting the conversion from MCI to AD and outperforms several state-of-the-art methods. Our source code and ADNI dataset processing code are available at https://github.com/Tinysqua/GFE-Mamba. △ Less

Submitted 22 July, 2024; originally announced July 2024.

Comments: 35 pages, 4 figures

VGBench: Evaluating Large Language Models on Vector Graphics Understanding and Generation

Authors: Bocheng Zou, Mu Cai, Jianrui Zhang, Yong Jae Lee

Abstract: In the realm of vision models, the primary mode of representation is using pixels to rasterize the visual world. Yet this is not always the best or unique way to represent visual content, especially for designers and artists who depict the world using geometry primitives such as polygons. Vector graphics (VG), on the other hand, offer a textual representation of visual content, which can be more c… ▽ More In the realm of vision models, the primary mode of representation is using pixels to rasterize the visual world. Yet this is not always the best or unique way to represent visual content, especially for designers and artists who depict the world using geometry primitives such as polygons. Vector graphics (VG), on the other hand, offer a textual representation of visual content, which can be more concise and powerful for content like cartoons, sketches and scientific figures. Recent studies have shown promising results on processing vector graphics with capable Large Language Models (LLMs). However, such works focus solely on qualitative results, understanding, or a specific type of vector graphics. We propose VGBench, a comprehensive benchmark for LLMs on handling vector graphics through diverse aspects, including (a) both visual understanding and generation, (b) evaluation of various vector graphics formats, (c) diverse question types, (d) wide range of prompting techniques, (e) under multiple LLMs and (f) comparison with VLMs on rasterized representations. Evaluating on our collected 4279 understanding and 5845 generation samples, we find that LLMs show strong capability on both aspects while exhibiting less desirable performance on low-level formats (SVG). Both data and evaluation pipeline will be open-sourced at https://vgbench.github.io. △ Less

Submitted 29 August, 2024; v1 submitted 15 July, 2024; originally announced July 2024.

Comments: Project Page: https://vgbench.github.io

Self-Prior Guided Mamba-UNet Networks for Medical Image Super-Resolution

Authors: Zexin Ji, Beiji Zou, Xiaoyan Kui, Pierre Vera, Su Ruan

Abstract: In this paper, we propose a self-prior guided Mamba-UNet network (SMamba-UNet) for medical image super-resolution. Existing methods are primarily based on convolutional neural networks (CNNs) or Transformers. CNNs-based methods fail to capture long-range dependencies, while Transformer-based approaches face heavy calculation challenges due to their quadratic computational complexity. Recently, Sta… ▽ More In this paper, we propose a self-prior guided Mamba-UNet network (SMamba-UNet) for medical image super-resolution. Existing methods are primarily based on convolutional neural networks (CNNs) or Transformers. CNNs-based methods fail to capture long-range dependencies, while Transformer-based approaches face heavy calculation challenges due to their quadratic computational complexity. Recently, State Space Models (SSMs) especially Mamba have emerged, capable of modeling long-range dependencies with linear computational complexity. Inspired by Mamba, our approach aims to learn the self-prior multi-scale contextual features under Mamba-UNet networks, which may help to super-resolve low-resolution medical images in an efficient way. Specifically, we obtain self-priors by perturbing the brightness inpainting of the input image during network training, which can learn detailed texture and brightness information that is beneficial for super-resolution. Furthermore, we combine Mamba with Unet network to mine global features at different levels. We also design an improved 2D-Selective-Scan (ISS2D) module to divide image features into different directional sequences to learn long-range dependencies in multiple directions, and adaptively fuse sequence information to enhance super-resolved feature representation. Both qualitative and quantitative experimental results demonstrate that our approach outperforms current state-of-the-art methods on two public medical datasets: the IXI and fastMRI. △ Less

Submitted 8 July, 2024; originally announced July 2024.

Deform-Mamba Network for MRI Super-Resolution

Authors: Zexin Ji, Beiji Zou, Xiaoyan Kui, Pierre Vera, Su Ruan

Abstract: In this paper, we propose a new architecture, called Deform-Mamba, for MR image super-resolution. Unlike conventional CNN or Transformer-based super-resolution approaches which encounter challenges related to the local respective field or heavy computational cost, our approach aims to effectively explore the local and global information of images. Specifically, we develop a Deform-Mamba encoder wh… ▽ More In this paper, we propose a new architecture, called Deform-Mamba, for MR image super-resolution. Unlike conventional CNN or Transformer-based super-resolution approaches which encounter challenges related to the local respective field or heavy computational cost, our approach aims to effectively explore the local and global information of images. Specifically, we develop a Deform-Mamba encoder which is composed of two branches, modulated deform block and vision Mamba block. We also design a multi-view context module in the bottleneck layer to explore the multi-view contextual content. Thanks to the extracted features of the encoder, which include content-adaptive local and efficient global information, the vision Mamba decoder finally generates high-quality MR images. Moreover, we introduce a contrastive edge loss to promote the reconstruction of edge and contrast related content. Quantitative and qualitative experimental results indicate that our approach on IXI and fastMRI datasets achieves competitive performance. △ Less

Submitted 8 July, 2024; originally announced July 2024.

WANCO: Weak Adversarial Networks for Constrained Optimization problems

Authors: Gang Bao, Dong Wang, Boyi Zou

Abstract: This paper focuses on integrating the networks and adversarial training into constrained optimization problems to develop a framework algorithm for constrained optimization problems. For such problems, we first transform them into minimax problems using the augmented Lagrangian method and then use two (or several) deep neural networks(DNNs) to represent the primal and dual variables respectively.… ▽ More This paper focuses on integrating the networks and adversarial training into constrained optimization problems to develop a framework algorithm for constrained optimization problems. For such problems, we first transform them into minimax problems using the augmented Lagrangian method and then use two (or several) deep neural networks(DNNs) to represent the primal and dual variables respectively. The parameters in the neural networks are then trained by an adversarial process. The proposed architecture is relatively insensitive to the scale of values of different constraints when compared to penalty based deep learning methods. Through this type of training, the constraints are imposed better based on the augmented Lagrangian multipliers. Extensive examples for optimization problems with scalar constraints, nonlinear constraints, partial differential equation constraints, and inequality constraints are considered to show the capability and robustness of the proposed method, with applications ranging from Ginzburg--Landau energy minimization problems, partition problems, fluid-solid topology optimization, to obstacle problems. △ Less

Submitted 4 July, 2024; originally announced July 2024.

Comments: 24 pages, 18 figures

Fleet Size and Spill for UAM Operation under Uncertain Demand

Authors: Shangqing Cao, Xuan Jiang, Emin Burak Onat, Bo Zou, Mark Hansen, Raja Sengupta, Anjan Chakrabarty

Abstract: Variation and imbalance in demand poses significant challenges to Urban Air Mobility (UAM) operations, affecting strategic decisions such as fleet sizing. To study the implications of demand variation on UAM fleet operations, we propose a stochastic passenger arrival time generation model that uses real-world data to infer demand distributions, and two integer programs that compute the zero-spill… ▽ More Variation and imbalance in demand poses significant challenges to Urban Air Mobility (UAM) operations, affecting strategic decisions such as fleet sizing. To study the implications of demand variation on UAM fleet operations, we propose a stochastic passenger arrival time generation model that uses real-world data to infer demand distributions, and two integer programs that compute the zero-spill fleet size and the spill-minimizing flight schedules and charging policies, respectively. Our numerical experiment on a two-vertiport network shows that spill in relatively inelastic to fleet size and that the driving factor behind spill is the imbalance in demand. △ Less

Submitted 1 July, 2024; originally announced July 2024.

Observation of the Electromagnetic Dalitz Transition $h_c \rightarrow e^+e^-η_c$

Authors: BESIII Collaboration, M. Ablikim, M. N. Achasov, P. Adlarson, S. Ahmed, M. Albrecht, R. Aliberti, A. Amoroso, M. R. An, Q. An, X. H. Bai, Y. Bai, O. Bakina, R. Baldini Ferroli, I. Balossino, Y. Ban, K. Begzsuren, N. Berger, M. Bertani, D. Bettoni, F. Bianchi, J. Bloms, A. Bortone, I. Boyko, R. A. Briere , et al. (495 additional authors not shown)

Abstract: Using $(27.12\pm 0.14)\times10^8$ $ψ(3686)$ decays and data samples of $e^+e^-$ collisions with $\sqrt{s}$ from 4.130 to 4.780~GeV collected with the BESIII detector, we report the first observation of the electromagnetic Dalitz transition $h_c\to e^+e^-η_c$ with a statistical significance of $5.4σ$. We measure the ratio of the branching fractions… ▽ More Using $(27.12\pm 0.14)\times10^8$ $ψ(3686)$ decays and data samples of $e^+e^-$ collisions with $\sqrt{s}$ from 4.130 to 4.780~GeV collected with the BESIII detector, we report the first observation of the electromagnetic Dalitz transition $h_c\to e^+e^-η_c$ with a statistical significance of $5.4σ$. We measure the ratio of the branching fractions $\frac{\mathcal{B}(h_c\rightarrow e^+e^-η_c)}{\mathcal{B}(h_c\rightarrow γη_c)}$ separately for the $h_c$ samples produced via $ψ(3686)\toπ^0h_c$ and $e^+e^-\toπ^+π^-h_c$. The average ratio is determined to be $(0.59\pm0.10(\text{stat.})\pm0.04(\text{syst.}))\%$, where the uncertainty includes both statistical and systematic components. △ Less

Submitted 2 July, 2024; v1 submitted 28 June, 2024; originally announced July 2024.

CCAT: Detector Noise Limited Performance of the RFSoC-based Readout Electronics for mm/sub-mm/far-IR KIDs

Authors: Adrian K. Sinclair, James Burgoyne, Anthony I. Huber, Colin Murphy, Steve K. Choi, Cody J. Duell, Zachary B. Huber, Yaqiong Li, Scott C. Chapman, Michael D. Niemack, Thomas Nikola, Eve M. Vavagiakis, Samantha Walker, Jordan D. Wheeler, Jason Austermann, Lawrence Lin, Ruixuan Xie, Bugao Zou, Philip D. Mauskopf

Abstract: The Fred Young Submillimeter Telescope (FYST), on Cerro Chajnantor in the Atacama desert of Chile, will conduct wide-field and small deep-field surveys of the sky with more than 100,000 detectors on the Prime-Cam instrument. Kinetic inductance detectors (KIDs) were chosen as the primary sensor technology for their high density focal plane packing. Additionally, they benefit from low cost, ease of… ▽ More The Fred Young Submillimeter Telescope (FYST), on Cerro Chajnantor in the Atacama desert of Chile, will conduct wide-field and small deep-field surveys of the sky with more than 100,000 detectors on the Prime-Cam instrument. Kinetic inductance detectors (KIDs) were chosen as the primary sensor technology for their high density focal plane packing. Additionally, they benefit from low cost, ease of fabrication, and simplified cryogenic readout, which are all beneficial for successful deployment at scale. The cryogenic multiplexing complexity is pulled out of the cryostat and is instead pushed into the digital signal processing of the room temperature electronics. Using the Xilinx Radio Frequency System on a Chip (RFSoC), a highly multiplexed KID readout was developed for the first light Prime-Cam and commissioning Mod-Cam instruments. We report on the performance of the RFSoC-based readout with multiple detector arrays in various cryogenic setups. Specifically we demonstrate detector noise limited performance of the RFSoC-based readout under the expected optical loading conditions. △ Less

Submitted 21 June, 2024; originally announced June 2024.

Comments: draft submitted to SPIE

SCKansformer: Fine-Grained Classification of Bone Marrow Cells via Kansformer Backbone and Hierarchical Attention Mechanisms

Authors: Yifei Chen, Zhu Zhu, Shenghao Zhu, Linwei Qiu, Binfeng Zou, Fan Jia, Yunpeng Zhu, Chenyan Zhang, Zhaojie Fang, Feiwei Qin, Jin Fan, Changmiao Wang, Yu Gao, Gang Yu

Abstract: The incidence and mortality rates of malignant tumors, such as acute leukemia, have risen significantly. Clinically, hospitals rely on cytological examination of peripheral blood and bone marrow smears to diagnose malignant tumors, with accurate blood cell counting being crucial. Existing automated methods face challenges such as low feature expression capability, poor interpretability, and redund… ▽ More The incidence and mortality rates of malignant tumors, such as acute leukemia, have risen significantly. Clinically, hospitals rely on cytological examination of peripheral blood and bone marrow smears to diagnose malignant tumors, with accurate blood cell counting being crucial. Existing automated methods face challenges such as low feature expression capability, poor interpretability, and redundant feature extraction when processing high-dimensional microimage data. We propose a novel fine-grained classification model, SCKansformer, for bone marrow blood cells, which addresses these challenges and enhances classification accuracy and efficiency. The model integrates the Kansformer Encoder, SCConv Encoder, and Global-Local Attention Encoder. The Kansformer Encoder replaces the traditional MLP layer with the KAN, improving nonlinear feature representation and interpretability. The SCConv Encoder, with its Spatial and Channel Reconstruction Units, enhances feature representation and reduces redundancy. The Global-Local Attention Encoder combines Multi-head Self-Attention with a Local Part module to capture both global and local features. We validated our model using the Bone Marrow Blood Cell Fine-Grained Classification Dataset (BMCD-FGCD), comprising over 10,000 samples and nearly 40 classifications, developed with a partner hospital. Comparative experiments on our private dataset, as well as the publicly available PBC and ALL-IDB datasets, demonstrate that SCKansformer outperforms both typical and advanced microcell classification methods across all datasets. Our source code and private BMCD-FGCD dataset are available at https://github.com/JustlfC03/SCKansformer. △ Less

Submitted 14 June, 2024; originally announced June 2024.

Comments: 15 pages, 6 figures

Review of the low-lying excited baryons $Σ^*(1/2^-)$

Authors: En Wang, Li-Sheng Geng, Jia-Jun Wu, Ju-Jun Xie, Bing-Song Zou

Abstract: Strong empirical and phenomenological indications exist for large sea-quark admixtures in the low-lying excited baryons. Investigating the low-lying excited baryon $Σ^*(1/2^-)$ is important to determine the nature of the low-lying excited baryons. We review the experimental and theoretical progress on the studies of the $Σ^*(1/2^-)$. Although several candidates have received intensive discussions,… ▽ More Strong empirical and phenomenological indications exist for large sea-quark admixtures in the low-lying excited baryons. Investigating the low-lying excited baryon $Σ^*(1/2^-)$ is important to determine the nature of the low-lying excited baryons. We review the experimental and theoretical progress on the studies of the $Σ^*(1/2^-)$. Although several candidates have received intensive discussions, such as $Σ(1620)$ and $Σ(1480)$, their existence needs further confirmation. Following the prediction of the unquenched quark models for the $Σ^*(1/2^-)$, many theoretical works suggested the existence of these states in various processes. Future experimental measurements could shed light on the existence of the low-lying excited $Σ^*(1/2^-)$ state. △ Less

Submitted 11 June, 2024; originally announced June 2024.

Comments: 8 pages, 2 figures

CCAT: Comparisons of 280 GHz TiN and Al Kinetic Inductance Detector Arrays

Authors: Cody J. Duell, Jason Austermann, James Beall, James R. Burgoyne, Scott C. Chapman, Steve K. Choi, Rodrigo G. Freundt, Jiansong Gao, Christopher Groppi, Anthony I. Huber, Zachary B. Huber, Johannes Hubmayr, Ben Keller, Yaqiong Li, Lawrence T. Lin, Justin Matthewson, Philip Mauskopf, Alicia Middleton, Colin C. Murphy, Michael D. Niemack, Thomas Nikola, Adrian K. Sinclair, Ema Smith, Jeff van Lanen, Anna Vaskuri , et al. (5 additional authors not shown)

Abstract: The CCAT Collaboration's six-meter Fred Young Submillimeter Telescope is scheduled to begin observing in the Chilean Atacama in 2025, targeting a variety of science goals throughout cosmic history. Prime-Cam is a 1.8-meter diameter cryostat that will host up to seven independent instrument modules designed for simultaneous spectroscopic and broadband, polarimetric surveys at millimeter to submilli… ▽ More The CCAT Collaboration's six-meter Fred Young Submillimeter Telescope is scheduled to begin observing in the Chilean Atacama in 2025, targeting a variety of science goals throughout cosmic history. Prime-Cam is a 1.8-meter diameter cryostat that will host up to seven independent instrument modules designed for simultaneous spectroscopic and broadband, polarimetric surveys at millimeter to submillimeter wavelengths. The first of these instrument modules, the 280 GHz module, will include ${\sim}$10,000 kinetic inductance detectors (KIDs) across three arrays. While the first array was fabricated out of tri-layer TiN/Ti/TiN, the other two arrays were fabricated out of a single layer of Al. This combination of materials within the same instrument provides a unique opportunity to directly compare the performance and noise properties of two different detector materials that are seeing increasing use within the field. We present preliminary comparisons here based on lab testing, along with a discussion of the potential impacts on operation when observing and translating raw data to science-grade maps. △ Less

Submitted 10 June, 2024; originally announced June 2024.

Comments: 6 pages, 3 figures, conference proceedings submitted to the Journal of Low Temperature Physics

Unveiling the Dynamics of Information Interplay in Supervised Learning

Authors: Kun Song, Zhiquan Tan, Bochao Zou, Huimin Ma, Weiran Huang

Abstract: In this paper, we use matrix information theory as an analytical tool to analyze the dynamics of the information interplay between data representations and classification head vectors in the supervised learning process. Specifically, inspired by the theory of Neural Collapse, we introduce matrix mutual information ratio (MIR) and matrix entropy difference ratio (HDR) to assess the interactions of… ▽ More In this paper, we use matrix information theory as an analytical tool to analyze the dynamics of the information interplay between data representations and classification head vectors in the supervised learning process. Specifically, inspired by the theory of Neural Collapse, we introduce matrix mutual information ratio (MIR) and matrix entropy difference ratio (HDR) to assess the interactions of data representation and class classification heads in supervised learning, and we determine the theoretical optimal values for MIR and HDR when Neural Collapse happens. Our experiments show that MIR and HDR can effectively explain many phenomena occurring in neural networks, for example, the standard supervised training dynamics, linear mode connectivity, and the performance of label smoothing and pruning. Additionally, we use MIR and HDR to gain insights into the dynamics of grokking, which is an intriguing phenomenon observed in supervised training, where the model demonstrates generalization capabilities long after it has learned to fit the training data. Furthermore, we introduce MIR and HDR as loss terms in supervised and semi-supervised learning to optimize the information interactions among samples and classification heads. The empirical results provide evidence of the method's effectiveness, demonstrating that the utilization of MIR and HDR not only aids in comprehending the dynamics throughout the training process but can also enhances the training procedure itself. △ Less

Submitted 6 June, 2024; originally announced June 2024.

Comments: Accepted by ICML 2024

Towards establishing best practice in the analysis of hydrogen and deuterium by atom probe tomography

Authors: Baptiste Gault, Aparna Saksena, Xavier Sauvage, Paul Bagot, Leonardo S. Aota, Jonas Arlt, Lisa T. Belkacemi, Torben Boll, Yi-Sheng Chen, Luke Daly, Milos B. Djukic, James O. Douglas, Maria J. Duarte, Peter J. Felfer, Richard G. Forbes, Jing Fu, Hazel M. Gardner, Ryota Gemma, Stephan S. A. Gerstl, Yilun Gong, Guillaume Hachet, Severin Jakob, Benjamin M. Jenkins, Megan E. Jones, Heena Khanchandani , et al. (20 additional authors not shown)

Abstract: As hydrogen is touted as a key player in the decarbonization of modern society, it is critical to enable quantitative H analysis at high spatial resolution, if possible at the atomic scale. Indeed, H has a known deleterious impact on the mechanical properties (strength, ductility, toughness) of most materials that can hinder their use as part of the infrastructure of a hydrogen-based economy. Enab… ▽ More As hydrogen is touted as a key player in the decarbonization of modern society, it is critical to enable quantitative H analysis at high spatial resolution, if possible at the atomic scale. Indeed, H has a known deleterious impact on the mechanical properties (strength, ductility, toughness) of most materials that can hinder their use as part of the infrastructure of a hydrogen-based economy. Enabling H mapping, including local hydrogen concentration analyses at specific microstructural features, is essential for understanding the multiple ways that H affect the properties of materials, including for instance embrittlement mechanisms and their synergies, but also spatial mapping and quantification of hydrogen isotopes is essential to accurately predict tritium inventory of future fusion power plants, ensuring their safe and efficient operation for example. Atom probe tomography (APT) has the intrinsic capabilities for detecting hydrogen (H), and deuterium (D), and in principle the capacity for performing quantitative mapping of H within a material's microstructure. Yet the accuracy and precision of H analysis by APT remain affected by the influence of residual hydrogen from the ultra-high vacuum chamber that can obscure the signal of H from within the material, along with a complex field evaporation behavior. The present article reports the essence of discussions at a focused workshop held at the Max-Planck Institute for Sustainable Materials in April 2024. The workshop was organized to pave the way to establishing best practices in reporting APT data for the analysis of H. We first summarize the key aspects of the intricacies of H analysis by APT and propose a path for better reporting of the relevant data to support interpretation of APT-based H analysis in materials. △ Less

Submitted 21 May, 2024; originally announced May 2024.

A Two-layer Stochastic Game Approach to Reinsurance Contracting and Competition

Authors: Zongxia Liang, Yi Xia, Bin Zou

Abstract: We introduce a two-layer stochastic game model to study reinsurance contracting and competition in a market with one insurer and two competing reinsurers. The insurer negotiates with both reinsurers simultaneously for proportional reinsurance contracts that are priced using the variance premium principle; the reinsurance contracting between the insurer and each reinsurer is modeled as a Stackelb… ▽ More We introduce a two-layer stochastic game model to study reinsurance contracting and competition in a market with one insurer and two competing reinsurers. The insurer negotiates with both reinsurers simultaneously for proportional reinsurance contracts that are priced using the variance premium principle; the reinsurance contracting between the insurer and each reinsurer is modeled as a Stackelberg game. The two reinsurers compete for business from the insurer and optimize the so-called relative performance, instead of their own surplus; the competition game between the two reinsurers is settled by a non-cooperative Nash game. We obtain a sufficient and necessary condition, related to the competition degrees of the two reinsurers, for the existence of an equilibrium. We show that the equilibrium, if exists, is unique, and the equilibrium strategy of each player is constant, fully characterized in semi-closed form. Additionally, we obtain interesting sensitivity results for the equilibrium strategies through both an analytical and numerical study. △ Less

Submitted 10 May, 2024; originally announced May 2024.

Exploration of the LHCb $P_c$ states and possible resonances in a unitary coupled-channel model

Authors: Chao-Wei Shen, Deborah Rönchen, Ulf-G. Meißner, Bing-Song Zou, Yu-Fei Wang

Abstract: We extend our previous study of the interactions of $\bar{D}^{(*)} Λ_c - \bar{D}^{(*)}Σ_c^{(*)}$ within an analytic, unitary, coupled-channel approach by including the $J/ψp$ channel and performing fits to the $J/ψp$ invariant mass distributions in the $Λ_b^0 \to J/ψp K^-$ decay by the LHCb Collaboration. We take into account the contributions of $t$-channel pseudoscalar and vector meson exchanges… ▽ More We extend our previous study of the interactions of $\bar{D}^{(*)} Λ_c - \bar{D}^{(*)}Σ_c^{(*)}$ within an analytic, unitary, coupled-channel approach by including the $J/ψp$ channel and performing fits to the $J/ψp$ invariant mass distributions in the $Λ_b^0 \to J/ψp K^-$ decay by the LHCb Collaboration. We take into account the contributions of $t$-channel pseudoscalar and vector meson exchanges and $u$-channel baryon exchanges in this work, and a series of bound states and resonances with different spin-parities are dynamically generated. According to the results, four states have a significant impact on the physical observables, with two having a spin-parity of $1/2^-$ and the other two having $3/2^-$. These states can be associated with the LHCb hidden-charm pentaquarks. We further provide the coupling strength between each pole and different channels, which provides some insights on how to search for them in future experiments. Moreover, we also search for poles in higher partial waves up to $J=7/2$ and find indications for the existence of several states with larger widths. △ Less

Submitted 4 May, 2024; originally announced May 2024.

Comments: 9 pages

LLM as Dataset Analyst: Subpopulation Structure Discovery with Large Language Model

Authors: Yulin Luo, Ruichuan An, Bocheng Zou, Yiming Tang, Jiaming Liu, Shanghang Zhang

Abstract: The distribution of subpopulations is an important property hidden within a dataset. Uncovering and analyzing the subpopulation distribution within datasets provides a comprehensive understanding of the datasets, standing as a powerful tool beneficial to various downstream tasks, including Dataset Subpopulation Organization, Subpopulation Shift, and Slice Discovery. Despite its importance, there h… ▽ More The distribution of subpopulations is an important property hidden within a dataset. Uncovering and analyzing the subpopulation distribution within datasets provides a comprehensive understanding of the datasets, standing as a powerful tool beneficial to various downstream tasks, including Dataset Subpopulation Organization, Subpopulation Shift, and Slice Discovery. Despite its importance, there has been no work that systematically explores the subpopulation distribution of datasets to our knowledge. To address the limitation and solve all the mentioned tasks in a unified way, we introduce a novel concept of subpopulation structures to represent, analyze, and utilize subpopulation distributions within datasets. To characterize the structures in an interpretable manner, we propose the Subpopulation Structure Discovery with Large Language Models (SSD-LLM) framework, which employs world knowledge and instruction-following capabilities of Large Language Models (LLMs) to linguistically analyze informative image captions and summarize the structures. Furthermore, we propose complete workflows to address downstream tasks, named Task-specific Tuning, showcasing the application of the discovered structure to a spectrum of subpopulation-related tasks, including dataset subpopulation organization, subpopulation shift, and slice discovery. Furthermore, we propose complete workflows to address downstream tasks, named Task-specific Tuning, showcasing the application of the discovered structure to a spectrum of subpopulation-related tasks, including dataset subpopulation organization, subpopulation shift, and slice discovery. △ Less

Submitted 23 July, 2024; v1 submitted 3 May, 2024; originally announced May 2024.

Comments: ECCV24 Camera Ready

Feature graph construction with static features for malware detection

Authors: Binghui Zou, Chunjie Cao, Longjuan Wang, Yinan Cheng, Jingzhang Sun

Abstract: Malware can greatly compromise the integrity and trustworthiness of information and is in a constant state of evolution. Existing feature fusion-based detection methods generally overlook the correlation between features. And mere concatenation of features will reduce the model's characterization ability, lead to low detection accuracy. Moreover, these methods are susceptible to concept drift and… ▽ More Malware can greatly compromise the integrity and trustworthiness of information and is in a constant state of evolution. Existing feature fusion-based detection methods generally overlook the correlation between features. And mere concatenation of features will reduce the model's characterization ability, lead to low detection accuracy. Moreover, these methods are susceptible to concept drift and significant degradation of the model. To address those challenges, we introduce a feature graph-based malware detection method, MFGraph, to characterize applications by learning feature-to-feature relationships to achieve improved detection accuracy while mitigating the impact of concept drift. In MFGraph, we construct a feature graph using static features extracted from binary PE files, then apply a deep graph convolutional network to learn the representation of the feature graph. Finally, we employ the representation vectors obtained from the output of a three-layer perceptron to differentiate between benign and malicious software. We evaluated our method on the EMBER dataset, and the experimental results demonstrate that it achieves an AUC score of 0.98756 on the malware detection task, outperforming other baseline models. Furthermore, the AUC score of MFGraph decreases by only 5.884% in one year, indicating that it is the least affected by concept drift. △ Less

Submitted 25 April, 2024; originally announced April 2024.

Meply: A Large-scale Dataset and Baseline Evaluations for Metastatic Perirectal Lymph Node Detection and Segmentation

Authors: Weidong Guo, Hantao Zhang, Shouhong Wan, Bingbing Zou, Wanqin Wang, Chenyang Qiu, Jun Li, Peiquan Jin

Abstract: Accurate segmentation of metastatic lymph nodes in rectal cancer is crucial for the staging and treatment of rectal cancer. However, existing segmentation approaches face challenges due to the absence of pixel-level annotated datasets tailored for lymph nodes around the rectum. Additionally, metastatic lymph nodes are characterized by their relatively small size, irregular shapes, and lower contra… ▽ More Accurate segmentation of metastatic lymph nodes in rectal cancer is crucial for the staging and treatment of rectal cancer. However, existing segmentation approaches face challenges due to the absence of pixel-level annotated datasets tailored for lymph nodes around the rectum. Additionally, metastatic lymph nodes are characterized by their relatively small size, irregular shapes, and lower contrast compared to the background, further complicating the segmentation task. To address these challenges, we present the first large-scale perirectal metastatic lymph node CT image dataset called Meply, which encompasses pixel-level annotations of 269 patients diagnosed with rectal cancer. Furthermore, we introduce a novel lymph-node segmentation model named CoSAM. The CoSAM utilizes sequence-based detection to guide the segmentation of metastatic lymph nodes in rectal cancer, contributing to improved localization performance for the segmentation model. It comprises three key components: sequence-based detection module, segmentation module, and collaborative convergence unit. To evaluate the effectiveness of CoSAM, we systematically compare its performance with several popular segmentation methods using the Meply dataset. Our code and dataset will be publicly available at: https://github.com/kanydao/CoSAM. △ Less

Submitted 13 April, 2024; originally announced April 2024.

Comments: 13 pages

RhythmMamba: Fast Remote Physiological Measurement with Arbitrary Length Videos

Authors: Bochao Zou, Zizheng Guo, Xiaocheng Hu, Huimin Ma

Abstract: Remote photoplethysmography (rPPG) is a non-contact method for detecting physiological signals from facial videos, holding great potential in various applications such as healthcare, affective computing, and anti-spoofing. Existing deep learning methods struggle to address two core issues of rPPG simultaneously: extracting weak rPPG signals from video segments with large spatiotemporal redundancy… ▽ More Remote photoplethysmography (rPPG) is a non-contact method for detecting physiological signals from facial videos, holding great potential in various applications such as healthcare, affective computing, and anti-spoofing. Existing deep learning methods struggle to address two core issues of rPPG simultaneously: extracting weak rPPG signals from video segments with large spatiotemporal redundancy and understanding the periodic patterns of rPPG among long contexts. This represents a trade-off between computational complexity and the ability to capture long-range dependencies, posing a challenge for rPPG that is suitable for deployment on mobile devices. Based on the in-depth exploration of Mamba's comprehension of spatial and temporal information, this paper introduces RhythmMamba, an end-to-end Mamba-based method that employs multi-temporal Mamba to constrain both periodic patterns and short-term trends, coupled with frequency domain feed-forward to enable Mamba to robustly understand the quasi-periodic patterns of rPPG. Extensive experiments show that RhythmMamba achieves state-of-the-art performance with reduced parameters and lower computational complexity. The proposed RhythmMamba can be applied to video segments of any length without performance degradation. The codes are available at https://github.com/zizheng-guo/RhythmMamba. △ Less

Submitted 9 April, 2024; originally announced April 2024.

Comments: arXiv admin note: text overlap with arXiv:2402.12788

Two-photon production of $f_0$ and $a_0$ resonances as hadronic molecules composed of two vector mesons

Authors: Li-Ke Yang, Zheng-Li Wang, Jia-Jun Wu, Bing-Song Zou

Abstract: Ascribed as $ρρ$ and $K^* \bar{K}^*$ molecular states, respectively, iso-scalar $f_0(1500)$ and $f_0(1710)$ states are expected to have iso-vector partners, potentially identified as $a_0(1450)$ and $a_0(1710)$. The predicted dominant decay modes for these two $a_0$ resonances are $a_0(1450) \to ωππ$ and $a_0(1710) \to ωππ,\,φππ$. We estimate cross sections for two-photon production of these four… ▽ More Ascribed as $ρρ$ and $K^* \bar{K}^*$ molecular states, respectively, iso-scalar $f_0(1500)$ and $f_0(1710)$ states are expected to have iso-vector partners, potentially identified as $a_0(1450)$ and $a_0(1710)$. The predicted dominant decay modes for these two $a_0$ resonances are $a_0(1450) \to ωππ$ and $a_0(1710) \to ωππ,\,φππ$. We estimate cross sections for two-photon production of these four resonances within the hadronic molecular picture, and demonstrate that SuperKEKB's luminosity is sufficient for their observation and more precise parameter measurements. △ Less

Submitted 19 June, 2024; v1 submitted 7 April, 2024; originally announced April 2024.

Teeth-SEG: An Efficient Instance Segmentation Framework for Orthodontic Treatment based on Anthropic Prior Knowledge

Authors: Bo Zou, Shaofeng Wang, Hao Liu, Gaoyue Sun, Yajie Wang, FeiFei Zuo, Chengbin Quan, Youjian Zhao

Abstract: Teeth localization, segmentation, and labeling in 2D images have great potential in modern dentistry to enhance dental diagnostics, treatment planning, and population-based studies on oral health. However, general instance segmentation frameworks are incompetent due to 1) the subtle differences between some teeth' shapes (e.g., maxillary first premolar and second premolar), 2) the teeth's position… ▽ More Teeth localization, segmentation, and labeling in 2D images have great potential in modern dentistry to enhance dental diagnostics, treatment planning, and population-based studies on oral health. However, general instance segmentation frameworks are incompetent due to 1) the subtle differences between some teeth' shapes (e.g., maxillary first premolar and second premolar), 2) the teeth's position and shape variation across subjects, and 3) the presence of abnormalities in the dentition (e.g., caries and edentulism). To address these problems, we propose a ViT-based framework named TeethSEG, which consists of stacked Multi-Scale Aggregation (MSA) blocks and an Anthropic Prior Knowledge (APK) layer. Specifically, to compose the two modules, we design 1) a unique permutation-based upscaler to ensure high efficiency while establishing clear segmentation boundaries with 2) multi-head self/cross-gating layers to emphasize particular semantics meanwhile maintaining the divergence between token embeddings. Besides, we collect 3) the first open-sourced intraoral image dataset IO150K, which comprises over 150k intraoral photos, and all photos are annotated by orthodontists using a human-machine hybrid algorithm. Experiments on IO150K demonstrate that our TeethSEG outperforms the state-of-the-art segmentation models on dental image segmentation. △ Less

Submitted 1 April, 2024; originally announced April 2024.

Comments: This paper has been accepted by CVPR 2024

VideoDistill: Language-aware Vision Distillation for Video Question Answering

Authors: Bo Zou, Chao Yang, Yu Qiao, Chengbin Quan, Youjian Zhao

Abstract: Significant advancements in video question answering (VideoQA) have been made thanks to thriving large image-language pretraining frameworks. Although these image-language models can efficiently represent both video and language branches, they typically employ a goal-free vision perception process and do not interact vision with language well during the answer generation, thus omitting crucial vis… ▽ More Significant advancements in video question answering (VideoQA) have been made thanks to thriving large image-language pretraining frameworks. Although these image-language models can efficiently represent both video and language branches, they typically employ a goal-free vision perception process and do not interact vision with language well during the answer generation, thus omitting crucial visual cues. In this paper, we are inspired by the human recognition and learning pattern and propose VideoDistill, a framework with language-aware (i.e., goal-driven) behavior in both vision perception and answer generation process. VideoDistill generates answers only from question-related visual embeddings and follows a thinking-observing-answering approach that closely resembles human behavior, distinguishing it from previous research. Specifically, we develop a language-aware gating mechanism to replace the standard cross-attention, avoiding language's direct fusion into visual representations. We incorporate this mechanism into two key components of the entire framework. The first component is a differentiable sparse sampling module, which selects frames containing the necessary dynamics and semantics relevant to the questions. The second component is a vision refinement module that merges existing spatial-temporal attention layers to ensure the extraction of multi-grained visual semantics associated with the questions. We conduct experimental evaluations on various challenging video question-answering benchmarks, and VideoDistill achieves state-of-the-art performance in both general and long-form VideoQA datasets. In Addition, we verify that VideoDistill can effectively alleviate the utilization of language shortcut solutions in the EgoTaskQA dataset. △ Less

Submitted 1 April, 2024; originally announced April 2024.

Comments: This paper is accepted by CVPR2024

LLaMA-Excitor: General Instruction Tuning via Indirect Feature Interaction

Authors: Bo Zou, Chao Yang, Yu Qiao, Chengbin Quan, Youjian Zhao

Abstract: Existing methods to fine-tune LLMs, like Adapter, Prefix-tuning, and LoRA, which introduce extra modules or additional input sequences to inject new skills or knowledge, may compromise the innate abilities of LLMs. In this paper, we propose LLaMA-Excitor, a lightweight method that stimulates the LLMs' potential to better follow instructions by gradually paying more attention to worthwhile informat… ▽ More Existing methods to fine-tune LLMs, like Adapter, Prefix-tuning, and LoRA, which introduce extra modules or additional input sequences to inject new skills or knowledge, may compromise the innate abilities of LLMs. In this paper, we propose LLaMA-Excitor, a lightweight method that stimulates the LLMs' potential to better follow instructions by gradually paying more attention to worthwhile information. Specifically, the LLaMA-Excitor does not directly change the intermediate hidden state during the self-attention calculation of the transformer structure. We designed the Excitor block as a bypass module for the similarity score computation in LLMs' self-attention to reconstruct keys and change the importance of values by learnable prompts. LLaMA-Excitor ensures a self-adaptive allocation of additional attention to input instructions, thus effectively preserving LLMs' pre-trained knowledge when fine-tuning LLMs on low-quality instruction-following datasets. Furthermore, we unify the modeling of multi-modal tuning and language-only tuning, extending LLaMA-Excitor to a powerful visual instruction follower without the need for complex multi-modal alignment. Our proposed approach is evaluated in language-only and multi-modal tuning experimental scenarios. Notably, LLaMA-Excitor is the only method that maintains basic capabilities while achieving a significant improvement (+6%) on the MMLU benchmark. In the visual instruction tuning, we achieve a new state-of-the-art image captioning performance of 157.5 CIDEr on MSCOCO, and a comparable performance (88.39%) on ScienceQA to cutting-edge models with more parameters and extensive vision-language pertaining. △ Less

Submitted 1 April, 2024; originally announced April 2024.

Comments: This paper is accepted by CVPR 2024

Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want

Authors: Weifeng Lin, Xinyu Wei, Ruichuan An, Peng Gao, Bocheng Zou, Yulin Luo, Siyuan Huang, Shanghang Zhang, Hongsheng Li

Abstract: The interaction between humans and artificial intelligence (AI) is a crucial factor that reflects the effectiveness of multimodal large language models (MLLMs). However, current MLLMs primarily focus on image-level comprehension and limit interaction to textual instructions, thereby constraining their flexibility in usage and depth of response. In this paper, we introduce the Draw-and-Understand p… ▽ More The interaction between humans and artificial intelligence (AI) is a crucial factor that reflects the effectiveness of multimodal large language models (MLLMs). However, current MLLMs primarily focus on image-level comprehension and limit interaction to textual instructions, thereby constraining their flexibility in usage and depth of response. In this paper, we introduce the Draw-and-Understand project: a new model, a multi-domain dataset, and a challenging benchmark for visual prompting. Specifically, we propose SPHINX-V, a new end-to-end trained Multimodal Large Language Model (MLLM) that connects a vision encoder, a visual prompt encoder and an LLM for various visual prompts (points, bounding boxes, and free-form shape) and language understanding. To advance visual prompting research for MLLMs, we introduce MDVP-Data and MDVP-Bench. MDVP-Data features a multi-domain dataset containing 1.6M unique image-visual prompt-text instruction-following samples, including natural images, document images, OCR images, mobile screenshots, web screenshots, and multi-panel images. Furthermore, we present MDVP-Bench, a comprehensive and challenging benchmark to assess a model's capability in understanding visual prompting instructions. Our experiments demonstrate SPHINX-V's impressive multimodal interaction capabilities through visual prompting, revealing significant improvements in detailed pixel-level description and question-answering abilities. △ Less

Submitted 31 March, 2024; v1 submitted 29 March, 2024; originally announced March 2024.

Comments: 16 pages, 7 figures

ChebMixer: Efficient Graph Representation Learning with MLP Mixer

Authors: Xiaoyan Kui, Haonan Yan, Qinsong Li, Liming Chen, Beiji Zou

Abstract: Graph neural networks have achieved remarkable success in learning graph representations, especially graph Transformer, which has recently shown superior performance on various graph mining tasks. However, graph Transformer generally treats nodes as tokens, which results in quadratic complexity regarding the number of nodes during self-attention computation. The graph MLP Mixer addresses this chal… ▽ More Graph neural networks have achieved remarkable success in learning graph representations, especially graph Transformer, which has recently shown superior performance on various graph mining tasks. However, graph Transformer generally treats nodes as tokens, which results in quadratic complexity regarding the number of nodes during self-attention computation. The graph MLP Mixer addresses this challenge by using the efficient MLP Mixer technique from computer vision. However, the time-consuming process of extracting graph tokens limits its performance. In this paper, we present a novel architecture named ChebMixer, a newly graph MLP Mixer that uses fast Chebyshev polynomials-based spectral filtering to extract a sequence of tokens. Firstly, we produce multiscale representations of graph nodes via fast Chebyshev polynomial-based spectral filtering. Next, we consider each node's multiscale representations as a sequence of tokens and refine the node representation with an effective MLP Mixer. Finally, we aggregate the multiscale representations of nodes through Chebyshev interpolation. Owing to the powerful representation capabilities and fast computational properties of MLP Mixer, we can quickly extract more informative node representations to improve the performance of downstream tasks. The experimental results prove our significant improvements in a variety of scenarios ranging from graph node classification to medical image segmentation. △ Less

Submitted 4 June, 2024; v1 submitted 24 March, 2024; originally announced March 2024.

Water-based Quantum Dots Liquid Scintillator for Particle Physics

Authors: M. Zhao, M. Taani, J. Cole, B. Crudele, B. Zou, N. Bhuiyan, E. Chowdhury, Y. Duan, S. Fekri, D. Harvey, D. Mitra, O. Raz, A. Thompson, T. Katori, A. Rakovich

Abstract: Liquid scintillators are typically composed from organic compounds dissolved in organic solvents. However, usage of such material is often restricted due to fire safety and environmental reasons. Because of this, R\&D of water-based liquid scintillators is of extreme relevance; yet, no such scintillators have been made commercially available as yet. Here, we investigate an alternative, water-based… ▽ More Liquid scintillators are typically composed from organic compounds dissolved in organic solvents. However, usage of such material is often restricted due to fire safety and environmental reasons. Because of this, R\&D of water-based liquid scintillators is of extreme relevance; yet, no such scintillators have been made commercially available as yet. Here, we investigate an alternative, water-based quantum dots liquid scintillator. Pre-determined and controllable optical properties of the quantum dots, as well as the existence of large libraries of established protocols for their dispersion in aqueous solutions, make them an attractive option for nuclear and particle physics applications. We characterize the optical properties of water-based quantum dots liquid scintillator and find that most of its optical properties are preserved upon quantum dots' phase transfer into water, through the addition of an oleic acid hydrophilic layer. Using the developed scintillator, the time and charge responses from atmospheric muons are measured, highlighting the practical viability of water-based quantum dots liquid scintillators for nuclear and particle physics, special interest on neutrino physics. △ Less

Submitted 26 June, 2024; v1 submitted 15 March, 2024; originally announced March 2024.

Comments: 23 pages, 9 figures, 3 tables, v3, accepted by JINST for publication

Journal ref: 2024 JINST 19 P07014

Possible $Σ_c^* \barΣ$ molecular states

Authors: Bing Wu, Xiang-Kun Dong, Feng-Kun Guo, Bing-Song Zou

Abstract: We investigate the possibility of deuteron-like $Σ_c^*\barΣ$ bound states within the one-boson-exchange model and systematically analyze the effects of the contact-range $δ^{3}(\vec{r}\,)$ potential, the tensor term from the vector-meson exchange, and nonlocal potentials due to the dependence on the sum of the initial and final state center-of-mass momenta. We find that the pion-exchange potential… ▽ More We investigate the possibility of deuteron-like $Σ_c^*\barΣ$ bound states within the one-boson-exchange model and systematically analyze the effects of the contact-range $δ^{3}(\vec{r}\,)$ potential, the tensor term from the vector-meson exchange, and nonlocal potentials due to the dependence on the sum of the initial and final state center-of-mass momenta. We find that the pion-exchange potential including the $δ^{3}(\vec{r}\,)$ term and the tensor term of the $ρ$-exchange potential exhibit comparable magnitudes but opposite signs for any $S$-wave baryon-antibaryon systems. For the $Σ_c^*\barΣ$ system, it is most likely to form bound states with mass around 3.7 GeV in the $I(J^P)=0(2^-)$ and $1(2^-)$ channels. △ Less

Submitted 6 March, 2024; originally announced March 2024.

Comments: 22 pages, 11 figures

Journal ref: Phys.Rev.D 109 (2024) 7, 074041

Hybrid$^2$ Neural ODE Causal Modeling and an Application to Glycemic Response

Authors: Bob Junyi Zou, Matthew E. Levine, Dessi P. Zaharieva, Ramesh Johari, Emily B. Fox

Abstract: Hybrid models composing mechanistic ODE-based dynamics with flexible and expressive neural network components have grown rapidly in popularity, especially in scientific domains where such ODE-based modeling offers important interpretability and validated causal grounding (e.g., for counterfactual reasoning). The incorporation of mechanistic models also provides inductive bias in standard blackbox… ▽ More Hybrid models composing mechanistic ODE-based dynamics with flexible and expressive neural network components have grown rapidly in popularity, especially in scientific domains where such ODE-based modeling offers important interpretability and validated causal grounding (e.g., for counterfactual reasoning). The incorporation of mechanistic models also provides inductive bias in standard blackbox modeling approaches, critical when learning from small datasets or partially observed, complex systems. Unfortunately, as the hybrid models become more flexible, the causal grounding provided by the mechanistic model can quickly be lost. We address this problem by leveraging another common source of domain knowledge: \emph{ranking} of treatment effects for a set of interventions, even if the precise treatment effect is unknown. We encode this information in a \emph{causal loss} that we combine with the standard predictive loss to arrive at a \emph{hybrid loss} that biases our learning towards causally valid hybrid models. We demonstrate our ability to achieve a win-win, state-of-the-art predictive performance \emph{and} causal validity, in the challenging task of modeling glucose dynamics post-exercise in individuals with type 1 diabetes. △ Less

Submitted 11 June, 2024; v1 submitted 27 February, 2024; originally announced February 2024.

RhythmFormer: Extracting rPPG Signals Based on Hierarchical Temporal Periodic Transformer

Authors: Bochao Zou, Zizheng Guo, Jiansheng Chen, Huimin Ma

Abstract: Remote photoplethysmography (rPPG) is a non-contact method for detecting physiological signals based on facial videos, holding high potential in various applications such as healthcare, affective computing, anti-spoofing, etc. Due to the periodicity nature of rPPG, the long-range dependency capturing capacity of the Transformer was assumed to be advantageous for such signals. However, existing app… ▽ More Remote photoplethysmography (rPPG) is a non-contact method for detecting physiological signals based on facial videos, holding high potential in various applications such as healthcare, affective computing, anti-spoofing, etc. Due to the periodicity nature of rPPG, the long-range dependency capturing capacity of the Transformer was assumed to be advantageous for such signals. However, existing approaches have not conclusively demonstrated the superior performance of Transformer over traditional convolutional neural network methods, this gap may stem from a lack of thorough exploration of rPPG periodicity. In this paper, we propose RhythmFormer, a fully end-to-end transformer-based method for extracting rPPG signals by explicitly leveraging the quasi-periodic nature of rPPG. The core module, Hierarchical Temporal Periodic Transformer, hierarchically extracts periodic features from multiple temporal scales. It utilizes dynamic sparse attention based on periodicity in the temporal domain, allowing for fine-grained modeling of rPPG features. Furthermore, a fusion stem is proposed to guide self-attention to rPPG features effectively, and it can be easily transferred to existing methods to enhance their performance significantly. RhythmFormer achieves state-of-the-art performance with fewer parameters and reduced computational complexity in comprehensive experiments compared to previous approaches. The codes are available at https://github.com/zizheng-guo/RhythmFormer. △ Less

Submitted 20 February, 2024; originally announced February 2024.

Intrinsic Orbital Angular Momentum Originated from Optical Catastrophe Superposition

Authors: Nana Liu, Huanpeng Liang, Liu Tan, Kaijian Chen, Xiaofang Lu, Shaozhou Jiang, Bingsuo Zou, Peilong Hong, Jingjun Xu, Yi Liang

Abstract: Conventionally, intrinsic orbital angular momentum (OAM) is associated with phase vortices. However, our investigation into the propagation dynamics of 2D superimposed catastrophe beams, termed cyclone catastrophe beams (CCBs), reveals that these beams inherently exhibit rotation and possess OAM, distinct from the typical connection to phase vortices. Our observations clearly show these beams rota… ▽ More Conventionally, intrinsic orbital angular momentum (OAM) is associated with phase vortices. However, our investigation into the propagation dynamics of 2D superimposed catastrophe beams, termed cyclone catastrophe beams (CCBs), reveals that these beams inherently exhibit rotation and possess OAM, distinct from the typical connection to phase vortices. Our observations clearly show these beams rotating during autofocusing propagation and particle manipulation, confirming the presence of OAM. Theoretical calculations affirm that the OAM of these beams is intrinsic and can be adjusted by varying the number of superimposed beams. Furthermore, our interference and phase studies indicate that, although CCBs exhibit phase vortices, they do not rotate around the singularities of phase vortices and their total topological charges are zero. This implies that the manifestation of OAM within CCBs does not rely on nonzero topological charge of the presented phase vortices within CCBs. Especially, eigenstates decomposition analysis illustrates that CCBs can be decomposed as a composite of Laguerre-Gaussian (LG) modes with uneven fidelity, where the topological charges of LG modes align with multiples of the superimposed catastrophe beams but do not equal to the value of the OAM per photon within CCBs, emphasizing the intrinsic OAM within CCBs and the absence of a connection to phase vortices. Our findings not only advance the understanding of the relationship between OAM and phase vortices but also pave the way for different applications of OAM waves, catalyzing their development in optics and other domains. △ Less

Submitted 12 February, 2024; originally announced February 2024.

Comments: 8pages, 5 figures

Hints of the $J^{PC}=0^{--}$ and $1^{--}$ $K^*\bar K_1(1270)$ Molecules in the $J/ψ\toφηη'$ Decay

Authors: Xiang-Kun Dong, Teng Ji, Feng-Kun Guo, Ulf-G. Meißner, Bing-Song Zou

Abstract: The primary objective of this study is to investigate hadronic molecules of $K^*\bar K_1(1270)$ using a one-boson-exchange model, which incorporates exchanges of vector and pseudoscalar mesons in the $t$-channel, as well as the pion exchange in the $u$-channel. Additionally, careful consideration is given to the three-body effects resulting from the on-shell pion originating from… ▽ More The primary objective of this study is to investigate hadronic molecules of $K^*\bar K_1(1270)$ using a one-boson-exchange model, which incorporates exchanges of vector and pseudoscalar mesons in the $t$-channel, as well as the pion exchange in the $u$-channel. Additionally, careful consideration is given to the three-body effects resulting from the on-shell pion originating from $K_1(1270)\to K^*π$. Then the BESIII data of the $J/ψ\toφηη'$ process is fitted using the $K^*\bar K_1(1270)$ scattering amplitude with $J^{PC}=0^{--}$ or $1^{--}$. The analysis reveals that both the $J^{PC}=0^{--}$ and $1^{--}$ assumptions for $K^*\bar K_1(1270)$ scattering provide good descriptions of the data, with similar fit qualities. Notably, the parameters obtained from the best fits indicate the existence of $K^*\bar K_1(1270)$ bound states, denoted by $φ(2100)$ and $φ_0(2100)$ for the $1^{--}$ and $0^{--}$ states, respectively. The current experimental data, including the $η$ polar angular distribution, cannot distinguish which $K^*\bar K_1(1270)$ bound state contributes to the $J/ψ\toφηη'$ process, or if both are involved. Therefore, we propose further explorations of this process, as well as other processes, in upcoming experiments with many more $J/ψ$ events to disentangle the different possibilities. △ Less

Submitted 22 April, 2024; v1 submitted 5 February, 2024; originally announced February 2024.

Comments: 11pages, 8figures and 1 table

Journal ref: Phys.Lett.B 853 (2024) 138646

Optimal Insurance to Maximize Exponential Utility when Premium is Computed by a Convex Functional

Authors: Jingyi Cao, Dongchen Li, Virginia R. Young, Bin Zou

Abstract: We find the optimal indemnity to maximize the expected utility of terminal wealth of a buyer of insurance whose preferences are modeled by an exponential utility. The insurance premium is computed by a convex functional. We obtain a necessary condition for the optimal indemnity; then, because the candidate optimal indemnity is given implicitly, we use that necessary condition to develop a numerica… ▽ More We find the optimal indemnity to maximize the expected utility of terminal wealth of a buyer of insurance whose preferences are modeled by an exponential utility. The insurance premium is computed by a convex functional. We obtain a necessary condition for the optimal indemnity; then, because the candidate optimal indemnity is given implicitly, we use that necessary condition to develop a numerical algorithm to compute it. We prove that the numerical algorithm converges to a unique indemnity that, indeed, equals the optimal policy. We also illustrate our results with numerical examples. △ Less

Submitted 15 January, 2024; originally announced January 2024.

Comments: 12 pages, 3 figures

MSC Class: 91G05; 93E20; 49M05

SAR-RARP50: Segmentation of surgical instrumentation and Action Recognition on Robot-Assisted Radical Prostatectomy Challenge

Authors: Dimitrios Psychogyios, Emanuele Colleoni, Beatrice Van Amsterdam, Chih-Yang Li, Shu-Yu Huang, Yuchong Li, Fucang Jia, Baosheng Zou, Guotai Wang, Yang Liu, Maxence Boels, Jiayu Huo, Rachel Sparks, Prokar Dasgupta, Alejandro Granados, Sebastien Ourselin, Mengya Xu, An Wang, Yanan Wu, Long Bai, Hongliang Ren, Atsushi Yamada, Yuriko Harai, Yuto Ishikawa, Kazuyuki Hayashi , et al. (25 additional authors not shown)

Abstract: Surgical tool segmentation and action recognition are fundamental building blocks in many computer-assisted intervention applications, ranging from surgical skills assessment to decision support systems. Nowadays, learning-based action recognition and segmentation approaches outperform classical methods, relying, however, on large, annotated datasets. Furthermore, action recognition and tool segme… ▽ More Surgical tool segmentation and action recognition are fundamental building blocks in many computer-assisted intervention applications, ranging from surgical skills assessment to decision support systems. Nowadays, learning-based action recognition and segmentation approaches outperform classical methods, relying, however, on large, annotated datasets. Furthermore, action recognition and tool segmentation algorithms are often trained and make predictions in isolation from each other, without exploiting potential cross-task relationships. With the EndoVis 2022 SAR-RARP50 challenge, we release the first multimodal, publicly available, in-vivo, dataset for surgical action recognition and semantic instrumentation segmentation, containing 50 suturing video segments of Robotic Assisted Radical Prostatectomy (RARP). The aim of the challenge is twofold. First, to enable researchers to leverage the scale of the provided dataset and develop robust and highly accurate single-task action recognition and tool segmentation approaches in the surgical domain. Second, to further explore the potential of multitask-based learning approaches and determine their comparative advantage against their single-task counterparts. A total of 12 teams participated in the challenge, contributing 7 action recognition methods, 9 instrument segmentation techniques, and 4 multitask approaches that integrated both action recognition and instrument segmentation. The complete SAR-RARP50 dataset is available at: https://rdr.ucl.ac.uk/projects/SARRARP50_Segmentation_of_surgical_instrumentation_and_Action_Recognition_on_Robot-Assisted_Radical_Prostatectomy_Challenge/191091 △ Less

Submitted 23 January, 2024; v1 submitted 31 December, 2023; originally announced January 2024.

Dynamical origin of universal two-pole structures and their light quark mass evolution

Authors: Jia-Ming Xie, Jun-Xu Lu, Li-Sheng Geng, Bing-Song Zou

Abstract: Two-pole structures refer to the fact that two dynamically generated states are located close to each other between two coupled channels and have a mass difference smaller than the sum of their widths. Thus, the two poles overlap in the invariant mass distribution of their decay products, creating the impression that only one state exists. This phenomenon was first noticed for the $Λ(1405)$ and th… ▽ More Two-pole structures refer to the fact that two dynamically generated states are located close to each other between two coupled channels and have a mass difference smaller than the sum of their widths. Thus, the two poles overlap in the invariant mass distribution of their decay products, creating the impression that only one state exists. This phenomenon was first noticed for the $Λ(1405)$ and the $K_1(1270)$, and then for several other states. This report explicitly shows how the two-pole structures emerge from the underlying universal chiral dynamics describing the coupled-channel interactions between a heavy matter particle and a pseudo-Nambu-Goldstone boson. Furthermore, we predict similar two-pole structures in other systems dictated by chiral symmetry, such as the isospin $1/2$ $\bar{K}Σ_c-πΞ'_c$ coupled channel, awaiting experimental discoveries. △ Less

Submitted 28 December, 2023; originally announced December 2023.

Comments: 6 pages, 2 figures; presentation given by Li-Sheng Geng at MENU2023

SCUNet++: Swin-UNet and CNN Bottleneck Hybrid Architecture with Multi-Fusion Dense Skip Connection for Pulmonary Embolism CT Image Segmentation

Authors: Yifei Chen, Binfeng Zou, Zhaoxin Guo, Yiyu Huang, Yifan Huang, Feiwei Qin, Qinhai Li, Changmiao Wang

Abstract: Pulmonary embolism (PE) is a prevalent lung disease that can lead to right ventricular hypertrophy and failure in severe cases, ranking second in severity only to myocardial infarction and sudden death. Pulmonary artery CT angiography (CTPA) is a widely used diagnostic method for PE. However, PE detection presents challenges in clinical practice due to limitations in imaging technology. CTPA can p… ▽ More Pulmonary embolism (PE) is a prevalent lung disease that can lead to right ventricular hypertrophy and failure in severe cases, ranking second in severity only to myocardial infarction and sudden death. Pulmonary artery CT angiography (CTPA) is a widely used diagnostic method for PE. However, PE detection presents challenges in clinical practice due to limitations in imaging technology. CTPA can produce noises similar to PE, making confirmation of its presence time-consuming and prone to overdiagnosis. Nevertheless, the traditional segmentation method of PE can not fully consider the hierarchical structure of features, local and global spatial features of PE CT images. In this paper, we propose an automatic PE segmentation method called SCUNet++ (Swin Conv UNet++). This method incorporates multiple fusion dense skip connections between the encoder and decoder, utilizing the Swin Transformer as the encoder. And fuses features of different scales in the decoder subnetwork to compensate for spatial information loss caused by the inevitable downsampling in Swin-UNet or other state-of-the-art methods, effectively solving the above problem. We provide a theoretical analysis of this method in detail and validate it on publicly available PE CT image datasets FUMPE and CAD-PE. The experimental results indicate that our proposed method achieved a Dice similarity coefficient (DSC) of 83.47% and a Hausdorff distance 95th percentile (HD95) of 3.83 on the FUMPE dataset, as well as a DSC of 83.42% and an HD95 of 5.10 on the CAD-PE dataset. These findings demonstrate that our method exhibits strong performance in PE segmentation tasks, potentially enhancing the accuracy of automatic segmentation of PE and providing a powerful diagnostic tool for clinical physicians. Our source code and new FUMPE dataset are available at https://github.com/JustlfC03/SCUNet-plusplus. △ Less

Submitted 2 January, 2024; v1 submitted 22 December, 2023; originally announced December 2023.

Comments: 10 pages, 7 figures, accept WACV2024

Journal ref: WACV 2024

Evidence-based Interpretable Open-domain Fact-checking with Large Language Models

Authors: Xin Tan, Bowei Zou, Ai Ti Aw

Abstract: Universal fact-checking systems for real-world claims face significant challenges in gathering valid and sufficient real-time evidence and making reasoned decisions. In this work, we introduce the Open-domain Explainable Fact-checking (OE-Fact) system for claim-checking in real-world scenarios. The OE-Fact system can leverage the powerful understanding and reasoning capabilities of large language… ▽ More Universal fact-checking systems for real-world claims face significant challenges in gathering valid and sufficient real-time evidence and making reasoned decisions. In this work, we introduce the Open-domain Explainable Fact-checking (OE-Fact) system for claim-checking in real-world scenarios. The OE-Fact system can leverage the powerful understanding and reasoning capabilities of large language models (LLMs) to validate claims and generate causal explanations for fact-checking decisions. To adapt the traditional three-module fact-checking framework to the open domain setting, we first retrieve claim-related information as relevant evidence from open websites. After that, we retain the evidence relevant to the claim through LLM and similarity calculation for subsequent verification. We evaluate the performance of our adapted three-module OE-Fact system on the Fact Extraction and Verification (FEVER) dataset. Experimental results show that our OE-Fact system outperforms general fact-checking baseline systems in both closed- and open-domain scenarios, ensuring stable and accurate verdicts while providing concise and convincing real-time explanations for fact-checking decisions. △ Less

Submitted 10 December, 2023; originally announced December 2023.

MoSA: Mixture of Sparse Adapters for Visual Efficient Tuning

Authors: Qizhe Zhang, Bocheng Zou, Ruichuan An, Jiaming Liu, Shanghang Zhang

Abstract: With the rapid growth in the scale of pre-trained foundation models, parameter-efficient fine-tuning techniques have gained significant attention, among which Adapter Tuning is the most widely used. Despite achieving efficiency, it still underperforms full fine-tuning, and the performance improves at the cost of an increase in parameters. Recent efforts have either focused on training multiple ada… ▽ More With the rapid growth in the scale of pre-trained foundation models, parameter-efficient fine-tuning techniques have gained significant attention, among which Adapter Tuning is the most widely used. Despite achieving efficiency, it still underperforms full fine-tuning, and the performance improves at the cost of an increase in parameters. Recent efforts have either focused on training multiple adapter experts to increase model capacity or on pruning adapters to achieve parameter efficiency. However, both approaches introduce more parameters compared to the original adapter, hence are not computationally efficient. Motivated by this, we propose Mixture of Sparse Adapters, or MoSA, as a novel Adapter Tuning method to fully unleash the potential of each parameter in the adapter. We first split the standard adapter into multiple non-overlapping modules, then stochastically activate them for sparse training, and finally merge them to form a complete adapter after tuning. In this way, MoSA can achieve significantly better performance than standard adapters without any additional computational or storage overhead. Furthermore, we propose a hierarchical sparse strategy to better leverage limited training data. Extensive experiments on a series of 27 visual tasks demonstrate that MoSA consistently outperforms other Adapter Tuning methods as well as other baselines by a large margin. Furthermore, MoSA brings consistent improvements across various model scales, architectures, and different PEFT methods. Code will be released. △ Less

Submitted 23 March, 2024; v1 submitted 5 December, 2023; originally announced December 2023.

Comments: 16 pages, 7 figures. Official code: https://github.com/Theia-4869/MoSA

Statistics of tens-of-photon states scattered by optical cavity, two-level atom and Jaynes-Cummings emitter

Authors: Jia-Nan Wu, Bingsuo Zou, and Yongyou Zhang

Abstract: Manipulating photon states serves as a primary requirement for various optical devices and is of high relevance for quantum information technology. Nevertheless, the fundamental theoretical framework for tens-of-photon states has not been established. This study successfully establishes the matrix-product-state theory to explore the statistics of the tens-of-photon states scattered by optical cavi… ▽ More Manipulating photon states serves as a primary requirement for various optical devices and is of high relevance for quantum information technology. Nevertheless, the fundamental theoretical framework for tens-of-photon states has not been established. This study successfully establishes the matrix-product-state theory to explore the statistics of the tens-of-photon states scattered by optical cavities (OCs), two-level atoms (TLAs), and Jaynes-Cummings emitters (JCEs) in waveguide-QED systems. Taking 10-photon states as an example, we reveal some novel physical results that differ from those for few-photon cases. We verify that OCs do not change the statistics of the incident photon states, being independent of the photon number. However, for the TLAs and JCEs, the photon number strongly impacts the photon bunching and anti-bunching behaviors. As the photon number increases, there exists a maximum strength for the photon-photon correlation induced by the JCE. Especially, the scattered waves by the TLA (or JCE) exhibit extremely different statistics behaviors for the 10-photon cases from those for the bi-photon. These distinguishable conclusions for the tens-of-photon states and the matrix-product-state theory pave the way for the multi-photon manipulation. △ Less

Submitted 26 December, 2023; v1 submitted 28 November, 2023; originally announced November 2023.

Comments: 12 pages, 4 figures

Application of Machine Learning Method to Model-Based Library Approach to Critical Dimension Measurement by CD-SEM

Authors: P. Guo, H. Miao, Y. B. Zou, S. F. Mao, Z. J. Ding

Abstract: The model-based library (MBL) method has already been established for the accurate measurement of critical dimension (CD) of semiconductor linewidth from a critical dimension scanning electron microscope (CD-SEM) image. In this work the MBL method has been further investigated by combing the CD-SEM image simulation with a neural network algorithm. The secondary electron linescan profiles were calc… ▽ More The model-based library (MBL) method has already been established for the accurate measurement of critical dimension (CD) of semiconductor linewidth from a critical dimension scanning electron microscope (CD-SEM) image. In this work the MBL method has been further investigated by combing the CD-SEM image simulation with a neural network algorithm. The secondary electron linescan profiles were calculated at first by a Monte Carlo simulation method, enabling to obtain the dependence of linescan profiles on the selected values of various geometrical parameters (e.g., top CD, sidewall angle and height) for Si and Au trapezoidal line structures. The machine learning methods have then been applied to predicate the linescan profiles from a randomly selected training set of the calculated profiles. The predicted results agree very well with the calculated profiles with the standard deviation of 0.1% and 6% for the relative error distributions of Si and Au line structures, respectively. This result shows that the machine learning methods can be practically applied to the MBL method for the purpose of reducing the library size, accelerating the construction of the MBL database and enriching the content of an available MBL database. △ Less

Submitted 25 November, 2023; originally announced November 2023.

All-Dielectric Structural Coloration Empowered by Bound States in the Continuum

Authors: Hong Zheng, Haiyang Hu, Thomas Weber, Juan Wang, Lin Nan, Bingsuo Zou, Stefan A. Maier, Andreas Tittl

Abstract: The technological requirements of low-power and high-fidelity color displays have been instrumental in driving research into advanced coloration technologies. At the forefront of these developments is the implementation of dye-free coloration techniques, which overcome previous constraints related to insufficient resolution and color fading. In this context, resonant dielectric nanostructures have… ▽ More The technological requirements of low-power and high-fidelity color displays have been instrumental in driving research into advanced coloration technologies. At the forefront of these developments is the implementation of dye-free coloration techniques, which overcome previous constraints related to insufficient resolution and color fading. In this context, resonant dielectric nanostructures have emerged as a promising paradigm, showing great potential for high efficiency, remarkably high color saturation, wide gamut palette, and realistic image reproduction. However, they still face limitations related to color accuracy, purity, and simultaneous brightness tunability. Here, we demonstrate an all-dielectric metasurface empowered by photonic bound states in the continuum (BICs), which supports sharp resonances throughout the visible spectral range, ideally suited for producing a wide range of structural colors. The metasurface design consists of titanium dioxide (TiO2) ellipses with carefully controlled sizes and geometrical asymmetry, allowing versatile and on-demand variation of the brightness and hue of the output colors, respectively. △ Less

Submitted 28 November, 2023; v1 submitted 22 November, 2023; originally announced November 2023.

Comments: Main text and supporting information, 40 pages, 4 Figures in the manuscript + 12 Figures in the supporting information

FD-Align: Feature Discrimination Alignment for Fine-tuning Pre-Trained Models in Few-Shot Learning

Authors: Kun Song, Huimin Ma, Bochao Zou, Huishuai Zhang, Weiran Huang

Abstract: Due to the limited availability of data, existing few-shot learning methods trained from scratch fail to achieve satisfactory performance. In contrast, large-scale pre-trained models such as CLIP demonstrate remarkable few-shot and zero-shot capabilities. To enhance the performance of pre-trained models for downstream tasks, fine-tuning the model on downstream data is frequently necessary. However… ▽ More Due to the limited availability of data, existing few-shot learning methods trained from scratch fail to achieve satisfactory performance. In contrast, large-scale pre-trained models such as CLIP demonstrate remarkable few-shot and zero-shot capabilities. To enhance the performance of pre-trained models for downstream tasks, fine-tuning the model on downstream data is frequently necessary. However, fine-tuning the pre-trained model leads to a decrease in its generalizability in the presence of distribution shift, while the limited number of samples in few-shot learning makes the model highly susceptible to overfitting. Consequently, existing methods for fine-tuning few-shot learning primarily focus on fine-tuning the model's classification head or introducing additional structure. In this paper, we introduce a fine-tuning approach termed Feature Discrimination Alignment (FD-Align). Our method aims to bolster the model's generalizability by preserving the consistency of spurious features across the fine-tuning process. Extensive experimental results validate the efficacy of our approach for both ID and OOD tasks. Once fine-tuned, the model can seamlessly integrate with existing methods, leading to performance improvements. Our code can be found in https://github.com/skingorz/FD-Align. △ Less

Submitted 17 November, 2023; v1 submitted 23 October, 2023; originally announced October 2023.

Comments: Accepted by NeurIPS 2023

Topologically Variable and Volumetric Morphing of 3D Architected Materials with Shape Locking

Authors: Kai Xiao, Yuhao Wang, Chao Song, Bihui Zou, Zihe Liang, Heeseung Han, Yilin Du, Hanqing Jiang, Jaehyung Ju

Abstract: The morphing of 3D structures is suitable for i) future tunable material design for customizing material properties and ii) advanced manufacturing tools for fabricating 3D structures on a 2D plane. However, there is no inverse design method for topologically variable and volumetric morphing or morphing with shape locking, which limits practical engineering applications. In this study, we construct… ▽ More The morphing of 3D structures is suitable for i) future tunable material design for customizing material properties and ii) advanced manufacturing tools for fabricating 3D structures on a 2D plane. However, there is no inverse design method for topologically variable and volumetric morphing or morphing with shape locking, which limits practical engineering applications. In this study, we construct a general inverse design method for 3D architected materials for topologically variable and volumetric morphing, whose shapes are lockable in the morphed states, which can contribute to future tunable materials, design, and advanced manufacturing. Volumetric mapping of bistable unit cells onto any 3D morphing target geometry with kinematic and kinetic modifications can produce flat-foldable and volumetric morphing structures with shape-locking. This study presents a generalized inverse design method for 3D metamaterial morphing that can be used for structural applications with shape locking. Topologically variable morphing enables the manufacture of volumetric structures on a 2D plane, saving tremendous energy and materials compared with conventional 3D printing. Volumetric morphing can significantly expand the design space with tunable physical properties without limiting the selection of base materials. △ Less

Submitted 22 October, 2023; originally announced October 2023.

Revealing the mystery of the double charm tetraquark in $pp$ collision

Authors: Xue-Li Hua, Yi-Yao Li, Qian Wang, Shuai Yang, Qiang Zhao, Bing-Song Zou

Abstract: A novel approach is proposed to probe the nature of the double charm tetraquark through the prompt production asymmetry between $T_{\bar{c}\bar{c}}^-$ and $T_{cc}^+$ in $pp$ collisions. When comparing two theoretical pictures, i.e. the compact tetraquark and hadronic molecular pictures, we find that the former one exhibits a significantly larger production asymmetry, enabling the unambiguous deter… ▽ More A novel approach is proposed to probe the nature of the double charm tetraquark through the prompt production asymmetry between $T_{\bar{c}\bar{c}}^-$ and $T_{cc}^+$ in $pp$ collisions. When comparing two theoretical pictures, i.e. the compact tetraquark and hadronic molecular pictures, we find that the former one exhibits a significantly larger production asymmetry, enabling the unambiguous determination of the tetraquark's internal structure. Additionally, distinctive differences in the transverse momentum and rapidity distributions of $T_{\bar{c}\bar{c}}^-$ and $T_{cc}^+$ cross sections emerge, particularly at $p_\mathrm{T}\approx 2~\mathrm{GeV}$ and $y\approx \pm 6$ at a center-of-mass energy of 14$~\mathrm{TeV}$. The insignificant asymmetry in hadronic molecular picture is because that hadronic molecules are produced in hadronic phase, where the phase space of their constituents needs to be taken into account rigorously. Our work can be extended to the exploration of other double heavy tetraquark candidates, offering a versatile approach to advance our understanding of exotic hadrons. △ Less

Submitted 4 August, 2024; v1 submitted 6 October, 2023; originally announced October 2023.

Comments: accepted by EPJC

Electrical Control of Two-Dimensional Electron-Hole Fluids in the Quantum Hall Regime

Authors: Bo Zou, Yongxin Zeng, A. H. MacDonald, Artem Strashko

Abstract: We study the influence of quantizing perpendicular magnetic fields on the ground state of a bilayer with electron and hole fluids separated by an opaque tunnel barrier. In the absence of a field, the ground state at low carrier densities is a condensate of s-wave excitons that has spontaneous interlayer phase coherence. We find that a series of phase transitions emerge at strong perpendicular fiel… ▽ More We study the influence of quantizing perpendicular magnetic fields on the ground state of a bilayer with electron and hole fluids separated by an opaque tunnel barrier. In the absence of a field, the ground state at low carrier densities is a condensate of s-wave excitons that has spontaneous interlayer phase coherence. We find that a series of phase transitions emerge at strong perpendicular fields between condensed states and incompressible incoherent states with full electron and hole Landau levels. When the electron and hole densities are unequal, condensation can occur in higher angular momentum electron-hole pair states and, at weak fields, break rotational symmetry. We explain how this physics is expressed in dual-gate phase diagrams, and predict transport and capacitively-probed thermodynamic signatures that distinguish different states. △ Less

Submitted 27 December, 2023; v1 submitted 8 September, 2023; originally announced September 2023.

Deep learning-based computational method for soft matter dynamics: Deep Onsager-Machlup method

Authors: Zhihao Li, Boyi Zou, Haiqin Wang, Jian Su, Dong Wang, Xinpeng Xu

Abstract: A deep learning-based computational method has been proposed for soft matter dynamics -- the deep Onsager-Machlup method (DOMM), which combines the brute forces of deep neural networks (DNNs) with the fundamental physics principle -- Onsager-Machlup variational principle (OMVP). In the DOMM, the trial solution to the dynamics is constructed by DNNs that allow us to explore a rich and complex set o… ▽ More A deep learning-based computational method has been proposed for soft matter dynamics -- the deep Onsager-Machlup method (DOMM), which combines the brute forces of deep neural networks (DNNs) with the fundamental physics principle -- Onsager-Machlup variational principle (OMVP). In the DOMM, the trial solution to the dynamics is constructed by DNNs that allow us to explore a rich and complex set of admissible functions. It outperforms the Ritz-type variational method where one has to impose carefully-chosen trial functions. This capability endows the DOMM with the potential to solve rather complex problems in soft matter dynamics that involve multiple physics with multiple slow variables, multiple scales, and multiple dissipative processes. Actually, the DOMM can be regarded as an extension of the deep Ritz method constructed using variational formulations of physics models to solve static problems in physics as discussed in our former work [Wang et al, Soft Matter, 2022, 18, 6015-6031]. In this work, as the first step, we focus on the validation of the DOMM as a useful computational method by using it to solve several typical soft matter dynamic problems: particle diffusion in dilute solutions, and two-phase dynamics with and without hydrodynamics. The predicted results agree very well with the analytical solution or numerical solution from traditional computational methods. These results show the accuracy and convergence of DOMM and justify it as an alternative computational method for solving soft matter dynamics. △ Less

Submitted 28 August, 2023; originally announced August 2023.

Comments: 15 pages, 6 figures

Robust autofocusing propagation in turbulence

Authors: Nana Liu, Liu Tan, Kaijian Chen, Peilong Hong, Xiaoming Mo, Bingsuo Zou, Yi Liang

Abstract: We conducted a comprehensive study on the robust propagation of the same spot-size Gaussian beam (SSGB), same envelope Gaussian beam (SEGB), Circular Airy beam (CAB) and Circular Pearcey beam (CPB) in complex environments. Our findings clearly demonstrate that autofocusing beams exhibit higher stability in propagation compared with the Gaussian beams. To validate our results, we statistically anal… ▽ More We conducted a comprehensive study on the robust propagation of the same spot-size Gaussian beam (SSGB), same envelope Gaussian beam (SEGB), Circular Airy beam (CAB) and Circular Pearcey beam (CPB) in complex environments. Our findings clearly demonstrate that autofocusing beams exhibit higher stability in propagation compared with the Gaussian beams. To validate our results, we statistically analyze the intensity fluctuation of autofocusing beams and Gaussian beams. The analysis reveals that the intensity fluctuations of autofocusing beams are significantly smaller than that of Gaussian beams. Furthermore, we study the variation of the coherence factor and find that the coherence of autofocusing beams is better than that of Gaussian beams under turbulence. Additionally, we observe the change of the scintillation index (SI) with the propagation distance z, and our results show that autofocusing beams exhibit less oscillation than Gaussian beams, indicating that autofocusing beams propagate in complex environments with less distortion and fewer intensity fluctuation. Overall, our results suggest that autofocusing beams are promising for applications such as optical trapping and manipulation in complex environments. Our study provides valuable insights into the selection of stable beams that exhibit high intensity and high field gradient at the focal position in complex environments. △ Less

Submitted 27 August, 2023; originally announced August 2023.

Comments: 10pages, 6figures

CARE: A Large Scale CT Image Dataset and Clinical Applicable Benchmark Model for Rectal Cancer Segmentation

Authors: Hantao Zhang, Weidong Guo, Chenyang Qiu, Shouhong Wan, Bingbing Zou, Wanqin Wang, Peiquan Jin

Abstract: Rectal cancer segmentation of CT image plays a crucial role in timely clinical diagnosis, radiotherapy treatment, and follow-up. Although current segmentation methods have shown promise in delineating cancerous tissues, they still encounter challenges in achieving high segmentation precision. These obstacles arise from the intricate anatomical structures of the rectum and the difficulties in perfo… ▽ More Rectal cancer segmentation of CT image plays a crucial role in timely clinical diagnosis, radiotherapy treatment, and follow-up. Although current segmentation methods have shown promise in delineating cancerous tissues, they still encounter challenges in achieving high segmentation precision. These obstacles arise from the intricate anatomical structures of the rectum and the difficulties in performing differential diagnosis of rectal cancer. Additionally, a major obstacle is the lack of a large-scale, finely annotated CT image dataset for rectal cancer segmentation. To address these issues, this work introduces a novel large scale rectal cancer CT image dataset CARE with pixel-level annotations for both normal and cancerous rectum, which serves as a valuable resource for algorithm research and clinical application development. Moreover, we propose a novel medical cancer lesion segmentation benchmark model named U-SAM. The model is specifically designed to tackle the challenges posed by the intricate anatomical structures of abdominal organs by incorporating prompt information. U-SAM contains three key components: promptable information (e.g., points) to aid in target area localization, a convolution module for capturing low-level lesion details, and skip-connections to preserve and recover spatial information during the encoding-decoding process. To evaluate the effectiveness of U-SAM, we systematically compare its performance with several popular segmentation methods on the CARE dataset. The generalization of the model is further verified on the WORD dataset. Extensive experiments demonstrate that the proposed U-SAM outperforms state-of-the-art methods on these two datasets. These experiments can serve as the baseline for future research and clinical application development. △ Less

Submitted 16 August, 2023; originally announced August 2023.

Comments: 8 pages