Showing 251–300 of 516 results for author: Fang, H

Compact Scintillator Array Detector (ComSAD) for sounding rocket and CubeSat missions

Authors: Pu Kai Wang, Chih-Yun Chen, Hsiang-Chieh Hsu, Mu-Hsin Chang, Wei Tai Liu, Hui-Kuan Fang, Ting-Chou Wu, Wen-Hao Chen, Chin Cheng Tsai, Alfred Bing-Chih Chen, Yi Yang

Abstract: The development of CubeSat and more frequent launch chances of sounding rockets are a total game changer to the space program, and it allows us to build space instruments to be more achievable and affordable. Therefore, it gives us a good opportunity to build a small cosmic ray detector which has capabilities to measure the flux, direction, and even energy of cosmic rays at the height above the li… ▽ More The development of CubeSat and more frequent launch chances of sounding rockets are a total game changer to the space program, and it allows us to build space instruments to be more achievable and affordable. Therefore, it gives us a good opportunity to build a small cosmic ray detector which has capabilities to measure the flux, direction, and even energy of cosmic rays at the height above the limitation of balloon experiments, and it may open a new door for building a constellation of detectors to study cosmic ray physics. Compact Scintillator Array Detector (ComSAD) is dedicated for the sounding rocket mission of Taiwan's National Space Organization. In paper, we present the idea, design, and performance of ComSAD which is also suitable for CubeSat missions in the future. △ Less

Submitted 11 February, 2022; v1 submitted 24 October, 2021; originally announced October 2021.

Journal ref: Journal of Astronomical InstrumentationVol. 11, No. 02, 2250007 (2022)

Speech Pattern based Black-box Model Watermarking for Automatic Speech Recognition

Authors: Haozhe Chen, Weiming Zhang, Kunlin Liu, Kejiang Chen, Han Fang, Nenghai Yu

Abstract: As an effective method for intellectual property (IP) protection, model watermarking technology has been applied on a wide variety of deep neural networks (DNN), including speech classification models. However, how to design a black-box watermarking scheme for automatic speech recognition (ASR) models is still an unsolved problem, which is a significant demand for protecting remote ASR Application… ▽ More As an effective method for intellectual property (IP) protection, model watermarking technology has been applied on a wide variety of deep neural networks (DNN), including speech classification models. However, how to design a black-box watermarking scheme for automatic speech recognition (ASR) models is still an unsolved problem, which is a significant demand for protecting remote ASR Application Programming Interface (API) deployed in cloud servers. Due to conditional independence assumption and label-detection-based evasion attack risk of ASR models, the black-box model watermarking scheme for speech classification models cannot apply to ASR models. In this paper, we propose the first black-box model watermarking framework for protecting the IP of ASR models. Specifically, we synthesize trigger audios by spreading the speech clips of model owners over the entire input audios and labeling the trigger audios with the stego texts, which hides the authorship information with linguistic steganography. Experiments on the state-of-the-art open-source ASR system DeepSpeech demonstrate the feasibility of the proposed watermarking scheme, which is robust against five kinds of attacks and has little impact on accuracy. △ Less

Submitted 2 May, 2022; v1 submitted 19 October, 2021; originally announced October 2021.

Comments: 5 pages, 2 figures. Acceptted by 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Improving Fairness for Data Valuation in Horizontal Federated Learning

Authors: Zhenan Fan, Huang Fang, Zirui Zhou, Jian Pei, Michael P. Friedlander, Changxin Liu, Yong Zhang

Abstract: Federated learning is an emerging decentralized machine learning scheme that allows multiple data owners to work collaboratively while ensuring data privacy. The success of federated learning depends largely on the participation of data owners. To sustain and encourage data owners' participation, it is crucial to fairly evaluate the quality of the data provided by the data owners and reward them c… ▽ More Federated learning is an emerging decentralized machine learning scheme that allows multiple data owners to work collaboratively while ensuring data privacy. The success of federated learning depends largely on the participation of data owners. To sustain and encourage data owners' participation, it is crucial to fairly evaluate the quality of the data provided by the data owners and reward them correspondingly. Federated Shapley value, recently proposed by Wang et al. [Federated Learning, 2020], is a measure for data value under the framework of federated learning that satisfies many desired properties for data valuation. However, there are still factors of potential unfairness in the design of federated Shapley value because two data owners with the same local data may not receive the same evaluation. We propose a new measure called completed federated Shapley value to improve the fairness of federated Shapley value. The design depends on completing a matrix consisting of all the possible contributions by different subsets of the data owners. It is shown under mild conditions that this matrix is approximately low-rank by leveraging concepts and tools from optimization. Both theoretical analysis and empirical evaluation verify that the proposed measure does improve fairness in many circumstances. △ Less

Submitted 23 May, 2022; v1 submitted 18 September, 2021; originally announced September 2021.

Journal ref: 2022 IEEE 38th International Conference on Data Engineering (ICDE)

Deep 3D Mesh Watermarking with Self-Adaptive Robustness

Authors: Feng Wang, Hang Zhou, Han Fang, Xiaojuan Dong, Weiming Zhang, Xi Yang, Nenghai Yu

Abstract: Robust 3D mesh watermarking is a traditional research topic in computer graphics, which provides an efficient solution to the copyright protection for 3D meshes. Traditionally, researchers need manually design watermarking algorithms to achieve sufficient robustness for the actual application scenarios. In this paper, we propose the first deep learning-based 3D mesh watermarking framework, which c… ▽ More Robust 3D mesh watermarking is a traditional research topic in computer graphics, which provides an efficient solution to the copyright protection for 3D meshes. Traditionally, researchers need manually design watermarking algorithms to achieve sufficient robustness for the actual application scenarios. In this paper, we propose the first deep learning-based 3D mesh watermarking framework, which can solve this problem once for all. In detail, we propose an end-to-end network, consisting of a watermark embedding sub-network, a watermark extracting sub-network and attack layers. We adopt the topology-agnostic graph convolutional network (GCN) as the basic convolution operation for 3D meshes, so our network is not limited by registered meshes (which share a fixed topology). For the specific application scenario, we can integrate the corresponding attack layers to guarantee adaptive robustness against possible attacks. To ensure the visual quality of watermarked 3D meshes, we design a curvature-based loss function to constrain the local geometry smoothness of watermarked meshes. Experimental results show that the proposed method can achieve more universal robustness and faster watermark embedding than baseline methods while guaranteeing comparable visual quality. △ Less

Submitted 15 September, 2021; originally announced September 2021.

MLFW: A Database for Face Recognition on Masked Faces

Authors: Chengrui Wang, Han Fang, Yaoyao Zhong, Weihong Deng

Abstract: As more and more people begin to wear masks due to current COVID-19 pandemic, existing face recognition systems may encounter severe performance degradation when recognizing masked faces. To figure out the impact of masks on face recognition model, we build a simple but effective tool to generate masked faces from unmasked faces automatically, and construct a new database called Masked LFW (MLFW)… ▽ More As more and more people begin to wear masks due to current COVID-19 pandemic, existing face recognition systems may encounter severe performance degradation when recognizing masked faces. To figure out the impact of masks on face recognition model, we build a simple but effective tool to generate masked faces from unmasked faces automatically, and construct a new database called Masked LFW (MLFW) based on Cross-Age LFW (CALFW) database. The mask on the masked face generated by our method has good visual consistency with the original face. Moreover, we collect various mask templates, covering most of the common styles appeared in the daily life, to achieve diverse generation effects. Considering realistic scenarios, we design three kinds of combinations of face pairs. The recognition accuracy of SOTA models declines 5%-16% on MLFW database compared with the accuracy on the original images. MLFW database can be viewed and downloaded at \url{http://whdeng.cn/mlfw}. △ Less

Submitted 15 September, 2021; v1 submitted 13 September, 2021; originally announced September 2021.

Potential PeVatron supernova remnant G106.3+2.7 seen in the highest-energy gamma rays

Authors: M. Amenomori, Y. W. Bao, X. J. Bi, D. Chen, T. L. Chen, W. Y. Chen, Xu Chen, Y. Chen, Cirennima, S. W. Cui, Danzengluobu, L. K. Ding, J. H. Fang, K. Fang, C. F. Feng, Zhaoyang Feng, Z. Y. Feng, Qi Gao, Q. B. Gou, Y. Q. Guo, Y. Y. Guo, H. H. He, Z. T. He, K. Hibino, N. Hotta , et al. (70 additional authors not shown)

Abstract: Cosmic rays (protons and other atomic nuclei) are believed to gain energies of petaelectronvolts (PeV) and beyond at astrophysical particle accelerators called 'PeVatrons' inside our Galaxy. Although a characteristic feature of a PeVatron is expected to be a hard gamma-ray energy spectrum that extends beyond 100 teraelectronvolts (TeV) without a cutoff, none of the currently known sources exhibits… ▽ More Cosmic rays (protons and other atomic nuclei) are believed to gain energies of petaelectronvolts (PeV) and beyond at astrophysical particle accelerators called 'PeVatrons' inside our Galaxy. Although a characteristic feature of a PeVatron is expected to be a hard gamma-ray energy spectrum that extends beyond 100 teraelectronvolts (TeV) without a cutoff, none of the currently known sources exhibits such a spectrum due to the low maximum energy of accelerated cosmic rays or insufficient detector sensitivity around 100 TeV. Here we report the observation of gamma-ray emission from the supernova remnant G106.3+2.7 above 10 TeV. This work provides flux data points up to and above 100 TeV and indicates that the very-high-energy gamma-ray emission above 10 TeV is well correlated with a molecular cloud rather than the pulsar PSR J2229+6114. Regarding the gamma-ray emission mechanism of G106.3+2.7, this morphological feature appears to favor a hadronic origin via the π0 decay caused by accelerated relativistic protons over a leptonic one via the inverse-Compton scattering by relativistic electrons. Furthermore, we point out that an X-ray flux upper limit on the synchrotron spectrum would provide important information to firmly establish the hadronic scenario as the mechanism of particle acceleration at the source. △ Less

Submitted 7 September, 2021; originally announced September 2021.

Comments: Published in Nature Astronomy

Journal ref: Nature Astronomy, 5, 460-464 (2021)

A vanishing theorem for the canonical blow-ups of Grassmann manifolds

Authors: Hanlong Fang, Songhao Zhu

Abstract: Let $\mathcal T_{s,p,n}$ be the canonical blow-up of the Grassmann manifold $G(p,n)$ constructed by blowing up the Plücker coordinate subspaces associated with the parameter $s$. We prove that the higher cohomology groups of the tangent bundle of $\mathcal T_{s,p,n}$ vanish. As an application, $\mathcal T_{s,p,n}$ is locally rigid in the sense of Kodaira-Spencer. Let $\mathcal T_{s,p,n}$ be the canonical blow-up of the Grassmann manifold $G(p,n)$ constructed by blowing up the Plücker coordinate subspaces associated with the parameter $s$. We prove that the higher cohomology groups of the tangent bundle of $\mathcal T_{s,p,n}$ vanish. As an application, $\mathcal T_{s,p,n}$ is locally rigid in the sense of Kodaira-Spencer. △ Less

Submitted 28 August, 2021; v1 submitted 25 August, 2021; originally announced August 2021.

Comments: Comments are welcome. arXiv admin note: text overlap with arXiv:2007.06200

MBRS : Enhancing Robustness of DNN-based Watermarking by Mini-Batch of Real and Simulated JPEG Compression

Authors: Zhaoyang Jia, Han Fang, Weiming Zhang

Abstract: Based on the powerful feature extraction ability of deep learning architecture, recently, deep-learning based watermarking algorithms have been widely studied. The basic framework of such algorithm is the auto-encoder like end-to-end architecture with an encoder, a noise layer and a decoder. The key to guarantee robustness is the adversarial training with the differential noise layer. However, we… ▽ More Based on the powerful feature extraction ability of deep learning architecture, recently, deep-learning based watermarking algorithms have been widely studied. The basic framework of such algorithm is the auto-encoder like end-to-end architecture with an encoder, a noise layer and a decoder. The key to guarantee robustness is the adversarial training with the differential noise layer. However, we found that none of the existing framework can well ensure the robustness against JPEG compression, which is non-differential but is an essential and important image processing operation. To address such limitations, we proposed a novel end-to-end training architecture, which utilizes Mini-Batch of Real and Simulated JPEG compression (MBRS) to enhance the JPEG robustness. Precisely, for different mini-batches, we randomly choose one of real JPEG, simulated JPEG and noise-free layer as the noise layer. Besides, we suggest to utilize the Squeeze-and-Excitation blocks which can learn better feature in embedding and extracting stage, and propose a "message processor" to expand the message in a more appreciate way. Meanwhile, to improve the robustness against crop attack, we propose an additive diffusion block into the network. The extensive experimental results have demonstrated the superior performance of the proposed scheme compared with the state-of-the-art algorithms. Under the JPEG compression with quality factor Q=50, our models achieve a bit error rate less than 0.01% for extracted messages, with PSNR larger than 36 for the encoded images, which shows the well-enhanced robustness against JPEG attack. Besides, under many other distortions such as Gaussian filter, crop, cropout and dropout, the proposed framework also obtains strong robustness. The code implemented by PyTorch \cite{2011torch7} is avaiable in https://github.com/jzyustc/MBRS. △ Less

Submitted 18 August, 2021; originally announced August 2021.

Comments: 9 pages, 6 figures, received by ACM MM'21

An Earthworm-Inspired Multi-Mode Underwater Locomotion Robot: Design, Modeling, and Experiments

Authors: Hongbin Fang, Zihan He, Jian Xu

Abstract: Faced with strong demand for robots working in underwater pipeline environments, a novel underwater multi-model locomotion robot is designed and studied in this research. By mimicking the earthworm's metameric body, the robot is segmented in the structure; by synthesizing the earthworm-like peristaltic locomotion mechanism and the propeller-driven swimming mechanism, the robot possesses unique mul… ▽ More Faced with strong demand for robots working in underwater pipeline environments, a novel underwater multi-model locomotion robot is designed and studied in this research. By mimicking the earthworm's metameric body, the robot is segmented in the structure; by synthesizing the earthworm-like peristaltic locomotion mechanism and the propeller-driven swimming mechanism, the robot possesses unique multi-mode locomotion capability. In detail, the in-pipe earthworm-like peristaltic crawling is achieved based on servomotor-driven cords and pre-bent spring-steel belts that work antagonistically, and the three-dimensional underwater swimming is realized by four independently-controlled propellers. With a robot covering made of silicon rubber, the two locomotion modes are tested in the underwater environment, through which, the rationality and the effectiveness of the robot design are demonstrated. Aiming at predicting the robotic locomotion performance, mechanical models of the robot are further developed. For the underwater swimming mode, by considering the robot as a spheroid, an equivalent dynamic model is constructed, whose validity is verified via computational fluid dynamics (CFD) simulations; for the in-pipe crawling mode, a classical kinematics model is employed to predict the average locomotion speeds under different gait controls. The outcomes of this research could offer useful design and modeling guidelines for the development of earthworm-like locomotion robots with unique underwater multi-mode locomotion capability. △ Less

Submitted 11 August, 2021; originally announced August 2021.

Comments: 25 pages, 14 figures

ContinuityLearner: Geometric Continuity Feature Learning for Lane Segmentation

Authors: Haoyu Fang, Jing Zhu, Yi Fang

Abstract: Lane segmentation is a challenging issue in autonomous driving system designing because lane marks show weak textural consistency due to occlusion or extreme illumination but strong geometric continuity in traffic images, from which general convolution neural networks (CNNs) are not capable of learning semantic objects. To empower conventional CNNs in learning geometric clues of lanes, we propose… ▽ More Lane segmentation is a challenging issue in autonomous driving system designing because lane marks show weak textural consistency due to occlusion or extreme illumination but strong geometric continuity in traffic images, from which general convolution neural networks (CNNs) are not capable of learning semantic objects. To empower conventional CNNs in learning geometric clues of lanes, we propose a deep network named ContinuityLearner to better learn geometric prior within lane. Specifically, our proposed CNN-based paradigm involves a novel Context-encoding image feature learning network to generate class-dependent image feature maps and a new encoding layer to exploit the geometric continuity feature representation by fusing both spatial and visual information of lane together. The ContinuityLearner, performing on the geometric continuity feature of lanes, is trained to directly predict the lane in traffic scenarios with integrated and continuous instance semantic. The experimental results on the CULane dataset and the Tusimple benchmark demonstrate that our ContinuityLearner has superior performance over other state-of-the-art techniques in lane segmentation. △ Less

Submitted 7 August, 2021; originally announced August 2021.

Exploring Structure Consistency for Deep Model Watermarking

Authors: Jie Zhang, Dongdong Chen, Jing Liao, Han Fang, Zehua Ma, Weiming Zhang, Gang Hua, Nenghai Yu

Abstract: The intellectual property (IP) of Deep neural networks (DNNs) can be easily ``stolen'' by surrogate model attack. There has been significant progress in solutions to protect the IP of DNN models in classification tasks. However, little attention has been devoted to the protection of DNNs in image processing tasks. By utilizing consistent invisible spatial watermarks, one recent work first consider… ▽ More The intellectual property (IP) of Deep neural networks (DNNs) can be easily ``stolen'' by surrogate model attack. There has been significant progress in solutions to protect the IP of DNN models in classification tasks. However, little attention has been devoted to the protection of DNNs in image processing tasks. By utilizing consistent invisible spatial watermarks, one recent work first considered model watermarking for deep image processing networks and demonstrated its efficacy in many downstream tasks. Nevertheless, it highly depends on the hypothesis that the embedded watermarks in the network outputs are consistent. When the attacker uses some common data augmentation attacks (e.g., rotate, crop, and resize) during surrogate model training, it will totally fail because the underlying watermark consistency is destroyed. To mitigate this issue, we propose a new watermarking methodology, namely ``structure consistency'', based on which a new deep structure-aligned model watermarking algorithm is designed. Specifically, the embedded watermarks are designed to be aligned with physically consistent image structures, such as edges or semantic regions. Experiments demonstrate that our method is much more robust than the baseline method in resisting data augmentation attacks for model IP protection. Besides that, we further test the generalization ability and robustness of our method to a broader range of circumvention attacks. △ Less

Submitted 5 August, 2021; originally announced August 2021.

Cardinality-constrained structured data-fitting problems

Authors: Zhenan Fan, Huang Fang, Michael P. Friedlander

Abstract: A memory-efficient framework is described for the cardinality-constrained structured data-fitting problem. Dual-based atom-identification rules are proposed that reveal the structure of the optimal primal solution from near-optimal dual solutions. These rules allow for a simple and computationally cheap algorithm for translating any feasible dual solution to a primal solution that satisfies the ca… ▽ More A memory-efficient framework is described for the cardinality-constrained structured data-fitting problem. Dual-based atom-identification rules are proposed that reveal the structure of the optimal primal solution from near-optimal dual solutions. These rules allow for a simple and computationally cheap algorithm for translating any feasible dual solution to a primal solution that satisfies the cardinality constraint. Rigorous guarantees are provided for obtaining a near-optimal primal solution given any dual-based method that generates dual iterates converging to an optimal dual solution. Numerical experiments on real-world datasets support confirm the analysis and demonstrate the efficiency of the proposed approach. △ Less

Submitted 19 July, 2022; v1 submitted 23 July, 2021; originally announced July 2021.

Electronic Self-passivation of Single Vacancy in Black Phosphorus via a Controlled Ionization

Authors: Hanyan Fang, Aurelio Gallardo, Dikshant Dulal, Zhizhan Qiu, Jie Su, Mykola Telychko, Harshitra Mahalingam, Pin Lyu, Yixuan Han, Yi Zheng, Yongqing Cai, Aleksandr Rodin, Pavel Jelínek, Jiong Lu

Abstract: We report that mono-elemental black phosphorus presents a new electronic self-passivation scheme of single vacancy (SV). By means of low-temperature scanning tunneling microscopy and bond-resolved non-contact atomic force microscopy, we demonstrate that the local reconstruction and ionization of SV into negatively charged $\mathrm{SV}^-$ leads to the passivation of dangling bonds and thus the quen… ▽ More We report that mono-elemental black phosphorus presents a new electronic self-passivation scheme of single vacancy (SV). By means of low-temperature scanning tunneling microscopy and bond-resolved non-contact atomic force microscopy, we demonstrate that the local reconstruction and ionization of SV into negatively charged $\mathrm{SV}^-$ leads to the passivation of dangling bonds and thus the quenching of in-gap states, which can be achieved by mild thermal annealing or STM tip manipulation. SV exhibits a strong and symmetric Friedel oscillation (FO) pattern, while $\mathrm{SV}^-$ shows an asymmetric FO pattern with local perturbation amplitude reduced by one order of magnitude and a faster decay rate. The enhanced passivation by forming $\mathrm{SV}^-$ can be attributed to its weak dipole-like perturbation, consistent with density-functional theory and numerical calculations. Therefore, self-passivated $\mathrm{SV}^-$ is electronically benign and acts as a much weaker scattering center, which may hold the key to further enhance the charge mobility of BP and its analogs. △ Less

Submitted 7 July, 2021; originally announced July 2021.

Gamma-ray Observation of the Cygnus Region in the 100 TeV Energy Region

Authors: M. Amenomori, Y. W. Bao, X. J. Bi, D. Chen, T. L. Chen, W. Y. Chen, Xu Chen, Y. Chen, Cirennima, S. W. Cui, Danzengluobu, L. K. Ding, J. H. Fang, K. Fang, C. F. Feng, Zhaoyang Feng, Z. Y. Feng, Qi Gao, A. Gomi, Q. B. Gou, Y. Q. Guo, Y. Y. Guo, H. H. He, Z. T. He, K. Hibino , et al. (88 additional authors not shown)

Abstract: We report observations of gamma-ray emissions with energies in the 100 TeV energy region from the Cygnus region in our Galaxy. Two sources are significantly detected in the directions of the Cygnus OB1 and OB2 associations. Based on their positional coincidences, we associate one with a pulsar PSR J2032+4127 and the other mainly with a pulsar wind nebula PWN G75.2+0.1 with the pulsar moving away f… ▽ More We report observations of gamma-ray emissions with energies in the 100 TeV energy region from the Cygnus region in our Galaxy. Two sources are significantly detected in the directions of the Cygnus OB1 and OB2 associations. Based on their positional coincidences, we associate one with a pulsar PSR J2032+4127 and the other mainly with a pulsar wind nebula PWN G75.2+0.1 with the pulsar moving away from its original birthplace situated around the centroid of the observed gamma-ray emission. This work would stimulate further studies of particle acceleration mechanisms at these gamma-ray sources. △ Less

Submitted 2 July, 2021; originally announced July 2021.

Comments: Accepted for publication in the Physical Review Letters

CLIP2Video: Mastering Video-Text Retrieval via Image CLIP

Authors: Han Fang, Pengfei Xiong, Luhui Xu, Yu Chen

Abstract: We present CLIP2Video network to transfer the image-language pre-training model to video-text retrieval in an end-to-end manner. Leading approaches in the domain of video-and-language learning try to distill the spatio-temporal video features and multi-modal interaction between videos and languages from a large-scale video-text dataset. Different from them, we leverage pretrained image-language mo… ▽ More We present CLIP2Video network to transfer the image-language pre-training model to video-text retrieval in an end-to-end manner. Leading approaches in the domain of video-and-language learning try to distill the spatio-temporal video features and multi-modal interaction between videos and languages from a large-scale video-text dataset. Different from them, we leverage pretrained image-language model, simplify it as a two-stage framework with co-learning of image-text and enhancing temporal relations between video frames and video-text respectively, make it able to train on comparatively small datasets. Specifically, based on the spatial semantics captured by Contrastive Language-Image Pretraining (CLIP) model, our model involves a Temporal Difference Block to capture motions at fine temporal video frames, and a Temporal Alignment Block to re-align the tokens of video clips and phrases and enhance the multi-modal correlation. We conduct thorough ablation studies, and achieve state-of-the-art performance on major text-to-video and video-to-text retrieval benchmarks, including new records of retrieval accuracy on MSR-VTT, MSVD and VATEX. △ Less

Submitted 21 June, 2021; originally announced June 2021.

Salient Object Ranking with Position-Preserved Attention

Authors: Hao Fang, Daoxin Zhang, Yi Zhang, Minghao Chen, Jiawei Li, Yao Hu, Deng Cai, Xiaofei He

Abstract: Instance segmentation can detect where the objects are in an image, but hard to understand the relationship between them. We pay attention to a typical relationship, relative saliency. A closely related task, salient object detection, predicts a binary map highlighting a visually salient region while hard to distinguish multiple objects. Directly combining two tasks by post-processing also leads t… ▽ More Instance segmentation can detect where the objects are in an image, but hard to understand the relationship between them. We pay attention to a typical relationship, relative saliency. A closely related task, salient object detection, predicts a binary map highlighting a visually salient region while hard to distinguish multiple objects. Directly combining two tasks by post-processing also leads to poor performance. There is a lack of research on relative saliency at present, limiting the practical applications such as content-aware image cropping, video summary, and image labeling. In this paper, we study the Salient Object Ranking (SOR) task, which manages to assign a ranking order of each detected object according to its visual saliency. We propose the first end-to-end framework of the SOR task and solve it in a multi-task learning fashion. The framework handles instance segmentation and salient object ranking simultaneously. In this framework, the SOR branch is independent and flexible to cooperate with different detection methods, so that easy to use as a plugin. We also introduce a Position-Preserved Attention (PPA) module tailored for the SOR branch. It consists of the position embedding stage and feature interaction stage. Considering the importance of position in saliency comparison, we preserve absolute coordinates of objects in ROI pooling operation and then fuse positional information with semantic features in the first stage. In the feature interaction stage, we apply the attention mechanism to obtain proposals' contextualized representations to predict their relative ranking orders. Extensive experiments have been conducted on the ASR dataset. Without bells and whistles, our proposed method outperforms the former state-of-the-art method significantly. The code will be released publicly available. △ Less

Submitted 9 June, 2021; v1 submitted 9 June, 2021; originally announced June 2021.

Parkinsonian Chinese Speech Analysis towards Automatic Classification of Parkinson's Disease

Authors: Hao Fang, Chen Gong, Chen Zhang, Yanan Sui, Luming Li

Abstract: Speech disorders often occur at the early stage of Parkinson's disease (PD). The speech impairments could be indicators of the disorder for early diagnosis, while motor symptoms are not obvious. In this study, we constructed a new speech corpus of Mandarin Chinese and addressed classification of patients with PD. We implemented classical machine learning methods with ranking algorithms for feature… ▽ More Speech disorders often occur at the early stage of Parkinson's disease (PD). The speech impairments could be indicators of the disorder for early diagnosis, while motor symptoms are not obvious. In this study, we constructed a new speech corpus of Mandarin Chinese and addressed classification of patients with PD. We implemented classical machine learning methods with ranking algorithms for feature selection, convolutional and recurrent deep networks, and an end to end system. Our classification accuracy significantly surpassed state-of-the-art studies. The result suggests that free talk has stronger classification power than standard speech tasks, which could help the design of future speech tasks for efficient early diagnosis of the disease. Based on existing classification methods and our natural speech study, the automatic detection of PD from daily conversation could be accessible to the majority of the clinical population. △ Less

Submitted 31 May, 2021; originally announced May 2021.

Comments: 12 pages, 5 figures, proceedings of the Machine Learning for Health NeurIPS Workshop, PMLR 136:114-125, 2020

In-Hardware Learning of Multilayer Spiking Neural Networks on a Neuromorphic Processor

Authors: Amar Shrestha, Haowen Fang, Daniel Patrick Rider, Zaidao Mei, Qinru Qiu

Abstract: Although widely used in machine learning, backpropagation cannot directly be applied to SNN training and is not feasible on a neuromorphic processor that emulates biological neuron and synapses. This work presents a spike-based backpropagation algorithm with biological plausible local update rules and adapts it to fit the constraint in a neuromorphic hardware. The algorithm is implemented on Intel… ▽ More Although widely used in machine learning, backpropagation cannot directly be applied to SNN training and is not feasible on a neuromorphic processor that emulates biological neuron and synapses. This work presents a spike-based backpropagation algorithm with biological plausible local update rules and adapts it to fit the constraint in a neuromorphic hardware. The algorithm is implemented on Intel Loihi chip enabling low power in-hardware supervised online learning of multilayered SNNs for mobile applications. We test this implementation on MNIST, Fashion-MNIST, CIFAR-10 and MSTAR datasets with promising performance and energy-efficiency, and demonstrate a possibility of incremental online learning with the implementation. △ Less

Submitted 8 May, 2021; originally announced May 2021.

Comments: 6 pages, 5 figures, accepted for Design Automation Conference (DAC) 2021

Entailment as Few-Shot Learner

Authors: Sinong Wang, Han Fang, Madian Khabsa, Hanzi Mao, Hao Ma

Abstract: Large pre-trained language models (LMs) have demonstrated remarkable ability as few-shot learners. However, their success hinges largely on scaling model parameters to a degree that makes it challenging to train and serve. In this paper, we propose a new approach, named as EFL, that can turn small LMs into better few-shot learners. The key idea of this approach is to reformulate potential NLP task… ▽ More Large pre-trained language models (LMs) have demonstrated remarkable ability as few-shot learners. However, their success hinges largely on scaling model parameters to a degree that makes it challenging to train and serve. In this paper, we propose a new approach, named as EFL, that can turn small LMs into better few-shot learners. The key idea of this approach is to reformulate potential NLP task into an entailment one, and then fine-tune the model with as little as 8 examples. We further demonstrate our proposed method can be: (i) naturally combined with an unsupervised contrastive learning-based data augmentation method; (ii) easily extended to multilingual few-shot learning. A systematic evaluation on 18 standard NLP tasks demonstrates that this approach improves the various existing SOTA few-shot learning methods by 12\%, and yields competitive few-shot performance with 500 times larger models, such as GPT-3. △ Less

Submitted 29 April, 2021; originally announced April 2021.

Neuromorphic Algorithm-hardware Codesign for Temporal Pattern Learning

Authors: Haowen Fang, Brady Taylor, Ziru Li, Zaidao Mei, Hai Li, Qinru Qiu

Abstract: Neuromorphic computing and spiking neural networks (SNN) mimic the behavior of biological systems and have drawn interest for their potential to perform cognitive tasks with high energy efficiency. However, some factors such as temporal dynamics and spike timings prove critical for information processing but are often ignored by existing works, limiting the performance and applications of neuromor… ▽ More Neuromorphic computing and spiking neural networks (SNN) mimic the behavior of biological systems and have drawn interest for their potential to perform cognitive tasks with high energy efficiency. However, some factors such as temporal dynamics and spike timings prove critical for information processing but are often ignored by existing works, limiting the performance and applications of neuromorphic computing. On one hand, due to the lack of effective SNN training algorithms, it is difficult to utilize the temporal neural dynamics. Many existing algorithms still treat neuron activation statistically. On the other hand, utilizing temporal neural dynamics also poses challenges to hardware design. Synapses exhibit temporal dynamics, serving as memory units that hold historical information, but are often simplified as a connection with weight. Most current models integrate synaptic activations in some storage medium to represent membrane potential and institute a hard reset of membrane potential after the neuron emits a spike. This is done for its simplicity in hardware, requiring only a "clear" signal to wipe the storage medium, but destroys temporal information stored in the neuron. In this work, we derive an efficient training algorithm for Leaky Integrate and Fire neurons, which is capable of training a SNN to learn complex spatial temporal patterns. We achieved competitive accuracy on two complex datasets. We also demonstrate the advantage of our model by a novel temporal pattern association task. Codesigned with this algorithm, we have developed a CMOS circuit implementation for a memristor-based network of neuron and synapses which retains critical neural dynamics with reduced complexity. This circuit implementation of the neuron model is simulated to demonstrate its ability to react to temporal spiking patterns with an adaptive threshold. △ Less

Submitted 6 May, 2021; v1 submitted 21 April, 2021; originally announced April 2021.

Rethinking Annotation Granularity for Overcoming Shortcuts in Deep Learning-based Radiograph Diagnosis: A Multicenter Study

Authors: Luyang Luo, Hao Chen, Yongjie Xiao, Yanning Zhou, Xi Wang, Varut Vardhanabhuti, Mingxiang Wu, Chu Han, Zaiyi Liu, Xin Hao Benjamin Fang, Efstratios Tsougenis, Huangjing Lin, Pheng-Ann Heng

Abstract: Two DL models were developed using radiograph-level annotations (yes or no disease) and fine-grained lesion-level annotations (lesion bounding boxes), respectively named CheXNet and CheXDet. The models' internal classification performance and lesion localization performance were compared on a testing set (n=2,922), external classification performance was compared on NIH-Google (n=4,376) and PadChe… ▽ More Two DL models were developed using radiograph-level annotations (yes or no disease) and fine-grained lesion-level annotations (lesion bounding boxes), respectively named CheXNet and CheXDet. The models' internal classification performance and lesion localization performance were compared on a testing set (n=2,922), external classification performance was compared on NIH-Google (n=4,376) and PadChest (n=24,536) datasets, and external lesion localization performance was compared on NIH-ChestX-ray14 dataset (n=880). The models were also compared to radiologists on a subset of the internal testing set (n=496). Given sufficient training data, both models performed comparably to radiologists. CheXDet achieved significant improvement for external classification, such as in classifying fracture on NIH-Google (CheXDet area under the ROC curve [AUC]: 0.67, CheXNet AUC: 0.51; p<.001) and PadChest (CheXDet AUC: 0.78, CheXNet AUC: 0.55; p<.001). CheXDet achieved higher lesion detection performance than CheXNet for most abnormalities on all datasets, such as in detecting pneumothorax on the internal set (CheXDet jacknife alternative free-response ROC-figure of merit [JAFROC-FOM]: 0.87, CheXNet JAFROC-FOM: 0.13; p<.001) and NIH-ChestX-ray14 (CheXDet JAFROC-FOM: 0.55, CheXNet JAFROC-FOM: 0.04; p<.001). To summarize, fine-grained annotations overcame shortcut learning and enabled DL models to identify correct lesion patterns, improving the models' generalizability. △ Less

Submitted 8 November, 2022; v1 submitted 21 April, 2021; originally announced April 2021.

Comments: Radiology: Artificial Intelligence

Photophysics of two-dimensional perovskites -- learning from metal halide substitution

Authors: Simon Kahmann, Herman Duim, Hong-Hua Fang, Mateusz Dyksik, Sampson Adjokatse, Martha Rivera Medina, Matteo Pitaro, Paulina Plochocka, Maria A. Loi

Abstract: Whereas their photophysics exhibits an intricate interplay of carriers with the lattice, most reports have so far relied on single compound studies. With the exception of variations of the organic spacer cations, the effect of constituent substitution on the photophysics and the nature of emitting species, in particular, has remained largely under-explored. Here PEA$_2$PbBr$_4$, PEA$_2$PbI$_4$, an… ▽ More Whereas their photophysics exhibits an intricate interplay of carriers with the lattice, most reports have so far relied on single compound studies. With the exception of variations of the organic spacer cations, the effect of constituent substitution on the photophysics and the nature of emitting species, in particular, has remained largely under-explored. Here PEA$_2$PbBr$_4$, PEA$_2$PbI$_4$, and PEA$_2$SnI$_4$ are studied through a variety of optical spectroscopy techniques to reveal a complex set of excitonic transitions at low temperature. We attribute the emergence of weak high energy features to a vibronic progression breaking Kasha's rule and highlight that the responsible phonons cannot be accessed through simple Raman spectroscopy. Bright peaks at lower energy are due to two distinct excitons, of which the upper is a convolution of a bright exciton and a localised state, whereas the lower is attributed to shallow defects. Our study offers deeper insights into the photophysics of two-dimensional perovskites through compositional substitution and highlights critical limits to the communities' current understanding of the photophysics of these compounds. △ Less

Submitted 21 April, 2021; originally announced April 2021.

Micro-Estimates of Wealth for all Low- and Middle-Income Countries

Authors: Guanghua Chi, Han Fang, Sourav Chatterjee, Joshua E. Blumenstock

Abstract: Many critical policy decisions, from strategic investments to the allocation of humanitarian aid, rely on data about the geographic distribution of wealth and poverty. Yet many poverty maps are out of date or exist only at very coarse levels of granularity. Here we develop the first micro-estimates of wealth and poverty that cover the populated surface of all 135 low and middle-income countries (L… ▽ More Many critical policy decisions, from strategic investments to the allocation of humanitarian aid, rely on data about the geographic distribution of wealth and poverty. Yet many poverty maps are out of date or exist only at very coarse levels of granularity. Here we develop the first micro-estimates of wealth and poverty that cover the populated surface of all 135 low and middle-income countries (LMICs) at 2.4km resolution. The estimates are built by applying machine learning algorithms to vast and heterogeneous data from satellites, mobile phone networks, topographic maps, as well as aggregated and de-identified connectivity data from Facebook. We train and calibrate the estimates using nationally-representative household survey data from 56 LMICs, then validate their accuracy using four independent sources of household survey data from 18 countries. We also provide confidence intervals for each micro-estimate to facilitate responsible downstream use. These estimates are provided free for public use in the hope that they enable targeted policy response to the COVID-19 pandemic, provide the foundation for new insights into the causes and consequences of economic development and growth, and promote responsible policymaking in support of the Sustainable Development Goals. △ Less

Submitted 15 April, 2021; originally announced April 2021.

ACM Class: I.2; J.4; K.4

Super strong paramagnetism induced by polar functional groups and water

Authors: Jihong Wang, Yizhou Yang, Jie Jiang, Liuhua Mu, Guosheng Shi, Yongshun Song, Haijun Yang, Peng Xiu, Haiping Fang

Abstract: We experimentally demonstrate that some commonly used materials such as cellulose acetate and chitin which are traditionally considered to be non-magnetic show super strong paramagnetism in aqueous solutions under ambient conditions when they are agglomerated by nanoparticles. Theoretical computations show that strongly polar functional groups can reduce the potential barrier for a singlet-triplet… ▽ More We experimentally demonstrate that some commonly used materials such as cellulose acetate and chitin which are traditionally considered to be non-magnetic show super strong paramagnetism in aqueous solutions under ambient conditions when they are agglomerated by nanoparticles. Theoretical computations show that strongly polar functional groups can reduce the potential barrier for a singlet-triplet interconversion with the help of surrounding water, inducing the magnetic moments. These magnetic moments distributed on the surfaces of the nanoparticles, which make a large number of magnetic moments gather in a very small space, greatly enhance the alignment of the moments along and amplify the effect of the external magnetic field, resulting in the super strong paramagnetism. Our findings suggest that the polar functional group may always induce paramagnetism and the magnetic effect may be universal as the electric effects since the polarization is very common in materials. △ Less

Submitted 15 April, 2021; originally announced April 2021.

A triple-mode mid-infrared modulator for all-surface radiative thermal management

Authors: Haoming Fang, Wanrong Xie, Xiuqiang Li, Kebin Fan, Yi-Ting Lai, Bowen Sun, Shulin Bai, Willie J. Padilla, Po-Chun Hsu

Abstract: Thermal management is ubiquitous in the modern world and indispensable for a sustainable future. Radiative heat management provides unique advantages because the heat transfer can be controlled by the surface. However, different surface emissivities require different tuning strategies. Here, we demonstrate a triple-mode mid-infrared modulator that can switch between passive heating and cooling sui… ▽ More Thermal management is ubiquitous in the modern world and indispensable for a sustainable future. Radiative heat management provides unique advantages because the heat transfer can be controlled by the surface. However, different surface emissivities require different tuning strategies. Here, we demonstrate a triple-mode mid-infrared modulator that can switch between passive heating and cooling suitable for all types of object surface emissivities. The device is composed of a surface-textured infrared-semi-transparent elastomer coated with a metallic back reflector, which is biaxially strained to sequentially achieve three fundamental modes: emission, reflection, and transmission. By analyzing and optimizing the coupling between optical and mechanical properties, we achieve a performance of emittance contrast = 0.58, transmittance contrast = 0.49, and reflectance contrast = 0.39. The device can provide a new design paradigm of radiation heat regulation to develop the next generation wearable devices, robotics, and camouflage technology. △ Less

Submitted 8 March, 2021; originally announced April 2021.

First Detection of sub-PeV Diffuse Gamma Rays from the Galactic Disk: Evidence for Ubiquitous Galactic Cosmic Rays beyond PeV Energies

Authors: M. Amenomori, Y. W. Bao, X. J. Bi, D. Chen, T. L. Chen, W. Y. Chen, Xu Chen, Y. Chen, Cirennima, S. W. Cui, Danzengluobu, L. K. Ding, J. H. Fang, K. Fang, C. F. Feng, Zhaoyang Feng, Z. Y. Feng, Qi Gao, Q. B. Gou, Y. Q. Guo, Y. Y. Guo, H. H. He, Z. T. He, K. Hibino, N. Hotta , et al. (70 additional authors not shown)

Abstract: We report, for the first time, the long-awaited detection of diffuse gamma rays with energies between 100 TeV and 1 PeV in the Galactic disk. Particularly, all gamma rays above 398 TeV are observed apart from known TeV gamma-ray sources and compatible with expectations from the hadronic emission scenario in which gamma rays originate from the decay of $π^0$'s produced through the interaction of pr… ▽ More We report, for the first time, the long-awaited detection of diffuse gamma rays with energies between 100 TeV and 1 PeV in the Galactic disk. Particularly, all gamma rays above 398 TeV are observed apart from known TeV gamma-ray sources and compatible with expectations from the hadronic emission scenario in which gamma rays originate from the decay of $π^0$'s produced through the interaction of protons with the interstellar medium in the Galaxy. This is strong evidence that cosmic rays are accelerated beyond PeV energies in our Galaxy and spread over the Galactic disk. △ Less

Submitted 17 May, 2021; v1 submitted 11 April, 2021; originally announced April 2021.

Comments: Accepted for publication in the Physical Review Letters

Journal ref: Phys. Rev. Lett. 126, 141101 (2021)

Brain Surface Reconstruction from MRI Images Based on Segmentation Networks Applying Signed Distance Maps

Authors: Heng Fang, Xi Yang, Taichi Kin, Takeo Igarashi

Abstract: Whole-brain surface extraction is an essential topic in medical imaging systems as it provides neurosurgeons with a broader view of surgical planning and abnormality detection. To solve the problem confronted in current deep learning skull stripping methods lacking prior shape information, we propose a new network architecture that incorporates knowledge of signed distance fields and introduce an… ▽ More Whole-brain surface extraction is an essential topic in medical imaging systems as it provides neurosurgeons with a broader view of surgical planning and abnormality detection. To solve the problem confronted in current deep learning skull stripping methods lacking prior shape information, we propose a new network architecture that incorporates knowledge of signed distance fields and introduce an additional Laplacian loss to ensure that the prediction results retain shape information. We validated our newly proposed method by conducting experiments on our brain magnetic resonance imaging dataset (111 patients). The evaluation results demonstrate that our approach achieves comparable dice scores and also reduces the Hausdorff distance and average symmetric surface distance, thus producing more stable and smooth brain isosurfaces. △ Less

Submitted 9 April, 2021; originally announced April 2021.

Comments: Accepted by IEEE ISBI 2021 (International Symposium on Biomedical Imaging)

SuctionNet-1Billion: A Large-Scale Benchmark for Suction Grasping

Authors: Hanwen Cao, Hao-Shu Fang, Wenhai Liu, Cewu Lu

Abstract: Suction is an important solution for the longstanding robotic grasping problem. Compared with other kinds of grasping, suction grasping is easier to represent and often more reliable in practice. Though preferred in many scenarios, it is not fully investigated and lacks sufficient training data and evaluation benchmarks. To address that, firstly, we propose a new physical model to analytically eva… ▽ More Suction is an important solution for the longstanding robotic grasping problem. Compared with other kinds of grasping, suction grasping is easier to represent and often more reliable in practice. Though preferred in many scenarios, it is not fully investigated and lacks sufficient training data and evaluation benchmarks. To address that, firstly, we propose a new physical model to analytically evaluate seal formation and wrench resistance of a suction grasping, which are two key aspects of grasp success. Secondly, a two-step methodology is adopted to generate annotations on a large-scale dataset collected in real-world cluttered scenarios. Thirdly, a standard online evaluation system is proposed to evaluate suction poses in continuous operation space, which can benchmark different algorithms fairly without the need of exhaustive labeling. Real-robot experiments are conducted to show that our annotations align well with real world. Meanwhile, we propose a method to predict numerous suction poses from an RGB-D image of a cluttered scene and demonstrate our superiority against several previous methods. Result analyses are further provided to help readers better understand the challenges in this area. Data and source code are publicly available at www.graspnet.net. △ Less

Submitted 29 October, 2021; v1 submitted 23 March, 2021; originally announced March 2021.

Journal ref: IEEE ROBOTICS AND AUTOMATION LETTERS, VOL. 6, NO. 4, 2021

Integrating Electrochemical Modeling with Machine Learning for Lithium-Ion Batteries

Authors: Hao Tu, Scott Moura, Huazhen Fang

Abstract: Mathematical modeling of lithium-ion batteries (LiBs) is a central challenge in advanced battery management. This paper presents a new approach to integrate a physics-based model with machine learning to achieve high-precision modeling for LiBs. This approach uniquely proposes to inform the machine learning model of the dynamic state of the physical model, enabling a deep integration between physi… ▽ More Mathematical modeling of lithium-ion batteries (LiBs) is a central challenge in advanced battery management. This paper presents a new approach to integrate a physics-based model with machine learning to achieve high-precision modeling for LiBs. This approach uniquely proposes to inform the machine learning model of the dynamic state of the physical model, enabling a deep integration between physics and machine learning. We propose two hybrid physics-machine learning models based on the approach, which blend a single particle model with thermal dynamics (SPMT) with a feedforward neural network (FNN) to perform physics-informed learning of a LiB's dynamic behavior. The proposed models are relatively parsimonious in structure and can provide considerable predictive accuracy even at high C-rates, as shown by extensive simulations. △ Less

Submitted 23 July, 2021; v1 submitted 22 March, 2021; originally announced March 2021.

Comments: 7 pages, 8 figures, 4 tables, 2021 American Control Conference(ACC)

Three Steps to Multimodal Trajectory Prediction: Modality Clustering, Classification and Synthesis

Authors: Jianhua Sun, Yuxuan Li, Hao-Shu Fang, Cewu Lu

Abstract: Multimodal prediction results are essential for trajectory prediction task as there is no single correct answer for the future. Previous frameworks can be divided into three categories: regression, generation and classification frameworks. However, these frameworks have weaknesses in different aspects so that they cannot model the multimodal prediction task comprehensively. In this paper, we prese… ▽ More Multimodal prediction results are essential for trajectory prediction task as there is no single correct answer for the future. Previous frameworks can be divided into three categories: regression, generation and classification frameworks. However, these frameworks have weaknesses in different aspects so that they cannot model the multimodal prediction task comprehensively. In this paper, we present a novel insight along with a brand-new prediction framework by formulating multimodal prediction into three steps: modality clustering, classification and synthesis, and address the shortcomings of earlier frameworks. Exhaustive experiments on popular benchmarks have demonstrated that our proposed method surpasses state-of-the-art works even without introducing social and map information. Specifically, we achieve 19.2% and 20.8% improvement on ADE and FDE respectively on ETH/UCY dataset. Our code will be made publicly availabe. △ Less

Submitted 22 March, 2021; v1 submitted 14 March, 2021; originally announced March 2021.

On the Lack of Consensus Among Technical Debt Detection Tools

Authors: Jason Lefever, Yuanfang Cai, Humberto Cervantes, Rick Kazman, Hongzhou Fang

Abstract: A vigorous and growing set of technical debt analysis tools have been developed in recent years -- both research tools and industrial products -- such as Structure 101, SonarQube, and DV8. Each of these tools identifies problematic files using their own definitions and measures. But to what extent do these tools agree with each other in terms of the files that they identify as problematic? If the… ▽ More A vigorous and growing set of technical debt analysis tools have been developed in recent years -- both research tools and industrial products -- such as Structure 101, SonarQube, and DV8. Each of these tools identifies problematic files using their own definitions and measures. But to what extent do these tools agree with each other in terms of the files that they identify as problematic? If the top-ranked files reported by these tools are largely consistent, then we can be confident in using any of these tools. Otherwise, a problem of accuracy arises. In this paper, we report the results of an empirical study analyzing 10 projects using multiple tools. Our results show that: 1) these tools report very different results even for the most common measures, such as size, complexity, file cycles, and package cycles. 2) These tools also differ dramatically in terms of the set of problematic files they identify, since each implements its own definitions of "problematic". After normalizing by size, the most problematic file sets that the tools identify barely overlap. 3) Our results show that code-based measures, other than size and complexity, do not even moderately correlate with a file's change-proneness or error-proneness. In contrast, co-change-related measures performed better. Our results suggest that, to identify files with true technical debt -- those that experience excessive changes or bugs -- co-change information must be considered. Code-based measures are largely ineffective at pinpointing true debt. Finally, this study reveals the need for the community to create benchmarks and data sets to assess the accuracy of software analysis tools in terms of commonly used measures. △ Less

Submitted 7 March, 2021; originally announced March 2021.

Tunnel junctions with moiré superlattice as barrier

Authors: Henan Fang, Mingwen Xiao

Abstract: Recently, moiré superlattices have attracted considerable attentions because they are found to exhibit intriguing electronic phenomena of tunable Mott insulators and unconventional superconductivity. These phenomena are highly related to the physical mechanism of the interlayer coupling. However, up to now, there has not existed any theory that can completely interpret the experimental results of… ▽ More Recently, moiré superlattices have attracted considerable attentions because they are found to exhibit intriguing electronic phenomena of tunable Mott insulators and unconventional superconductivity. These phenomena are highly related to the physical mechanism of the interlayer coupling. However, up to now, there has not existed any theory that can completely interpret the experimental results of the interlayer conductance of moiré superlattice. In order to solve this problem, the superposition of periods and the corresponding coherence, which are the essential characteristics of moiré superlattice, should be considered more sufficiently. Therefore, it is quite necessary to introduce optical methods to study moiré superlattices. Here, we develop a theory for moiré superlattices which are founded on traditional optical scattering theory. The theory can interpret both the continuously decreasing background and the peak of the interlayer conductance observed in the experiments by a unified mechanism. We show that, the decreasing background of the interlayer conductance arises from the increasing strength of the interface potential, and the peak roots from the scattering resonance of the interface potential. The present work is crucial for understanding the interlayer coupling of the moiré superlattice, and provide a solid theoretical foundation for the application of moiré superlattice. △ Less

Submitted 7 March, 2021; originally announced March 2021.

RGB Matters: Learning 7-DoF Grasp Poses on Monocular RGBD Images

Authors: Minghao Gou, Hao-Shu Fang, Zhanda Zhu, Sheng Xu, Chenxi Wang, Cewu Lu

Abstract: General object grasping is an important yet unsolved problem in the field of robotics. Most of the current methods either generate grasp poses with few DoF that fail to cover most of the success grasps, or only take the unstable depth image or point cloud as input which may lead to poor results in some cases. In this paper, we propose RGBD-Grasp, a pipeline that solves this problem by decoupling 7… ▽ More General object grasping is an important yet unsolved problem in the field of robotics. Most of the current methods either generate grasp poses with few DoF that fail to cover most of the success grasps, or only take the unstable depth image or point cloud as input which may lead to poor results in some cases. In this paper, we propose RGBD-Grasp, a pipeline that solves this problem by decoupling 7-DoF grasp detection into two sub-tasks where RGB and depth information are processed separately. In the first stage, an encoder-decoder like convolutional neural network Angle-View Net(AVN) is proposed to predict the SO(3) orientation of the gripper at every location of the image. Consequently, a Fast Analytic Searching(FAS) module calculates the opening width and the distance of the gripper to the grasp point. By decoupling the grasp detection problem and introducing the stable RGB modality, our pipeline alleviates the requirement for the high-quality depth image and is robust to depth sensor noise. We achieve state-of-the-art results on GraspNet-1Billion dataset compared with several baselines. Real robot experiments on a UR5 robot with an Intel Realsense camera and a Robotiq two-finger gripper show high success rates for both single object scenes and cluttered scenes. Our code and trained model will be made publicly available. △ Less

Submitted 3 March, 2021; originally announced March 2021.

Comments: Accepted by ICRA 2021

Community Structure Recovery and Interaction Probability Estimation for Gossip Opinion Dynamics

Authors: Yu Xing, Xingkang He, Haitao Fang, Karl H. Johansson

Abstract: We study how to jointly recover the community structure and estimate the interaction probabilities of gossip opinion dynamics. In this process, agents randomly interact pairwise, and there are stubborn agents never changing their states. Such a model illustrates how disagreement and opinion fluctuation arise in a social network. It is assumed that each agent is assigned with one of two community l… ▽ More We study how to jointly recover the community structure and estimate the interaction probabilities of gossip opinion dynamics. In this process, agents randomly interact pairwise, and there are stubborn agents never changing their states. Such a model illustrates how disagreement and opinion fluctuation arise in a social network. It is assumed that each agent is assigned with one of two community labels, and the agents interact with probabilities depending on their labels. The considered problem is to jointly recover the community labels of the agents and estimate interaction probabilities between the agents, based on a single trajectory of the model. We first study stability and limit theorems of the model, and then propose a joint recovery and estimation algorithm based on a trajectory. It is verified that the community recovery can be achieved in finite time, and the interaction estimator converges almost surely. We derive a sample-complexity result for the recovery, and analyze the estimator's convergence rate. Simulations are presented for illustration of the performance of the proposed algorithm. △ Less

Submitted 25 August, 2023; v1 submitted 18 February, 2021; originally announced February 2021.

Variational Autoencoder for Speech Enhancement with a Noise-Aware Encoder

Authors: Huajian Fang, Guillaume Carbajal, Stefan Wermter, Timo Gerkmann

Abstract: Recently, a generative variational autoencoder (VAE) has been proposed for speech enhancement to model speech statistics. However, this approach only uses clean speech in the training phase, making the estimation particularly sensitive to noise presence, especially in low signal-to-noise ratios (SNRs). To increase the robustness of the VAE, we propose to include noise information in the training p… ▽ More Recently, a generative variational autoencoder (VAE) has been proposed for speech enhancement to model speech statistics. However, this approach only uses clean speech in the training phase, making the estimation particularly sensitive to noise presence, especially in low signal-to-noise ratios (SNRs). To increase the robustness of the VAE, we propose to include noise information in the training phase by using a noise-aware encoder trained on noisy-clean speech pairs. We evaluate our approach on real recordings of different noisy environments and acoustic conditions using two different noise datasets. We show that our proposed noise-aware VAE outperforms the standard VAE in terms of overall distortion without increasing the number of model parameters. At the same time, we demonstrate that our model is capable of generalizing to unseen noise conditions better than a supervised feedforward deep neural network (DNN). Furthermore, we demonstrate the robustness of the model performance to a reduction of the noisy-clean speech training data size. △ Less

Submitted 17 February, 2021; originally announced February 2021.

Comments: ICASSP 2021. (c) 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works

Journal ref: ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Super strong paramagnetism of aromatic peptides adsorbed with monovalent cations

Authors: Shiqi Sheng, Haijun Yang, Liuhua Mu, Zixin Wang, Jihong Wang, Peng Xiu, Jun Hu, Xin Zhang, Feng Zhang, Haiping Fang

Abstract: We experimentally demonstrated that the AYFFF self-assemblies adsorbed with various monovalent cations (Na+, K+, and Li+) show unexpectedly super strong paramagnetism. The key to the super strong paramagnetism lies in the hydrated cation-π interactions between the monovalent cations and the aromatic rings in the AYFFF assemblies, which endows the AYFFF-cations complex with magnetic moments. We experimentally demonstrated that the AYFFF self-assemblies adsorbed with various monovalent cations (Na+, K+, and Li+) show unexpectedly super strong paramagnetism. The key to the super strong paramagnetism lies in the hydrated cation-π interactions between the monovalent cations and the aromatic rings in the AYFFF assemblies, which endows the AYFFF-cations complex with magnetic moments. △ Less

Submitted 22 December, 2020; originally announced December 2020.

Comments: 4 pages, 1 figure. arXiv admin note: text overlap with arXiv:2011.12797

RAMPVIS: Towards a New Methodology for Developing Visualisation Capabilities for Large-scale Emergency Responses

Authors: M. Chen, A. Abdul-Rahman, D. Archambault, J. Dykes, A. Slingsby, P. D. Ritsos, T. Torsney-Weir, C. Turkay, B. Bach, A. Brett, H. Fang, R. Jianu, S. Khan, R. S. Laramee, P. H. Nguyen, R. Reeve, J. C. Roberts, F. Vidal, Q. Wang, J. Wood, K. Xu

Abstract: The effort for combating the COVID-19 pandemic around the world has resulted in a huge amount of data, e.g., from testing, contact tracing, modelling, treatment, vaccine trials, and more. In addition to numerous challenges in epidemiology, healthcare, biosciences, and social sciences, there has been an urgent need to develop and provide visualisation and visual analytics (VIS) capacities to suppor… ▽ More The effort for combating the COVID-19 pandemic around the world has resulted in a huge amount of data, e.g., from testing, contact tracing, modelling, treatment, vaccine trials, and more. In addition to numerous challenges in epidemiology, healthcare, biosciences, and social sciences, there has been an urgent need to develop and provide visualisation and visual analytics (VIS) capacities to support emergency responses under difficult operational conditions. In this paper, we report the experience of a group of VIS volunteers who have been working in a large research and development consortium and providing VIS support to various observational, analytical, model-developmental and disseminative tasks. In particular, we describe our approaches to the challenges that we have encountered in requirements analysis, data acquisition, visual design, software design, system development, team organisation, and resource planning. By reflecting on our experience, we propose a set of recommendations as the first step towards a methodology for developing and providing rapid VIS capacities to support emergency responses. △ Less

Submitted 8 December, 2020; originally announced December 2020.

Unexpectedly super strong paramagnetism of aromatic peptides due to cations of divalent metals

Authors: Haijun Yang, Liuhua Mu, Lei Zhang, Zixin Wang, Shiqi Sheng, Yongshun Song, Peng Xiu, Jihong Wang, Guosheng Shi, Jun Hu, Xin Zhang, Feng Zhang, Haiping Fang

Abstract: The magnetism of most biological systems has not been characterized, which directly impedes our understanding of many magnetic field-related phenomena, including magnetoreception and magnetic bio-effects. Here we measured the magnetic susceptibility of aromatic peptide AYFFF self-assemblies in the presence or absence of divalent metal cations in liquid phase at room temperature. Unexpectedly, the… ▽ More The magnetism of most biological systems has not been characterized, which directly impedes our understanding of many magnetic field-related phenomena, including magnetoreception and magnetic bio-effects. Here we measured the magnetic susceptibility of aromatic peptide AYFFF self-assemblies in the presence or absence of divalent metal cations in liquid phase at room temperature. Unexpectedly, the magnetic susceptibilities of AYFFF self-assemblies in the chloride solution of various divalent cations (Mg2+, Zn2+, and Cu2+) show super strong paramagnetism. We attribute the super strong paramagnetism to existence of the magnetic moments on the cations adsorbed on aromatic rings in the AYFFF assemblies through hydrated cation-π interactions, where the adsorbed cations display non-divalent behavior with unpaired electron spins. Our results indicate the super strong paramagnetism or potential ferromagnetism in the aromatic ring-enriched biomolecules when there are enough cations of divalent metals adsorbed. The findings not only provide fundamental information for understanding the magnetism of biological systems, provoke insights for investigating the origin of magnetoreception and bio-effects of magnetic fields, but also help developing future magnetic-control techniques on aromatic ring-enriched biomolecules and drugs in living organisms, as well as biomaterial fabrication and manipulation. △ Less

Submitted 9 December, 2020; v1 submitted 24 November, 2020; originally announced November 2020.

Comments: 13 pages, 4 figures. arXiv admin note: substantial text overlap with arXiv:2010.07774

Phase Transitions in Germanium Telluride Nanoparticle Phase-Change Materials Studied by Time-Resolved X-Ray Diffraction

Authors: Ann-Katrin U. Michel, Felix Donat, Aurelia Siegfried, Olesya Yarema, Hanbing Fang, Maksym Yarema, Vanessa Wood, Christoph R. Müller, David J. Norris

Abstract: Germanium telluride (GeTe), a phase-change material, is known to exhibit four different structural phases: three at room temperature (one amorphous and two crystalline, $α$ and $γ$) and one at high temperature (crystalline $β$). Because transitions between the amorphous and crystalline phases lead to significant changes in material properties (e.g., refractive index and resistivity), GeTe has been… ▽ More Germanium telluride (GeTe), a phase-change material, is known to exhibit four different structural phases: three at room temperature (one amorphous and two crystalline, $α$ and $γ$) and one at high temperature (crystalline $β$). Because transitions between the amorphous and crystalline phases lead to significant changes in material properties (e.g., refractive index and resistivity), GeTe has been investigated as a phase-change material for photonics, thermoelectrics, ferroelectrics, and spintronics. Consequently, the temperature-dependent phase transitions in GeTe have been studied for bulk and thin-film GeTe, both fabricated by sputtering. Colloidal synthesis of nanoparticles offers a more flexible fabrication approach for amorphous and crystalline GeTe. These nanoparticles are known to exhibit size-dependent properties, such as an increased crystallization temperature for the amorphous-to-$α$ transition in sub-10\,nm GeTe particles. The $α$-to-$β$ phase transition is also expected to vary with size, but this effect has not yet been investigated for GeTe. Here, we report time-resolved X-ray diffraction of GeTe nanoparticles with different diameters and from different synthetic protocols. We observe a non-volatile amorphous-to-$α$ transition between 210$^{\circ}$C and 240$^{\circ}$C and a volatile $α$-to-$β$ transition between 370$^{\circ}$C and 420$^{\circ}$C. The latter transition was reversible and repeatable. While the transition temperatures are shifted relative to the values known for bulk GeTe, the nanoparticle-based samples still exhibit the same structural phases reported for sputtered GeTe. Thus, colloidal GeTe maintains the same general phase behavior as bulk GeTe while allowing for more flexible and accessible fabrication. Therefore, nanoparticle-based GeTe films show great potential for applications, such as in active photonics. △ Less

Submitted 20 November, 2020; originally announced November 2020.

Measurement of $^{58}$Ni($p$, $p$)$^{58}$Ni elastic scattering at low momentum transfer by using the HIRFL-CSR heavy-ion storage ring

Authors: K. Yue, J. T. Zhang, X. L. Tu, C. J. Shao, H. X. Li, P. Ma, B. Mei, X. C. Chen, Y. Y. Yang, X. Q. Liu, Y. M. Xing, K. H. Fang, X. H. Li, Z. Y. Sun, M. Wang, P. Egelhof, Yu. A. Litvinov, K. Blaum, Y. H. Zhang, X. H. Zhou

Abstract: The very first in-ring reaction experiment at the HIRFL-CSR heavy-ion storage ring, namely proton elastic scattering on stable $^{58}$Ni nuclei, is presented. The circulating $^{58}$Ni$^{19+}$ ions with an energy of 95 MeV/u were interacting repeatedly with an internal hydrogen gas target in the CSRe experimental ring. Low energy proton recoils from the elastic collisions were measured with an ult… ▽ More The very first in-ring reaction experiment at the HIRFL-CSR heavy-ion storage ring, namely proton elastic scattering on stable $^{58}$Ni nuclei, is presented. The circulating $^{58}$Ni$^{19+}$ ions with an energy of 95 MeV/u were interacting repeatedly with an internal hydrogen gas target in the CSRe experimental ring. Low energy proton recoils from the elastic collisions were measured with an ultra-high vacuum compatible silicon-strip detector. Deduced differential cross sections were normalized by measuring K-shell X-rays from $^{58}$Ni$^{19+}$ projectiles due to the $^{58}$Ni$^{19+}$-H$_2$ ionization collisions. Compared to the experimental cross sections, a good agreement has been achieved with the theoretical predictions in the measured region, which were obtained by using the global phenomenological optical model potentials. Our results enable new research opportunities for optical model potential studies on exotic nuclides by using the in-ring reaction setup at the HIRFL-CSR facility. △ Less

Submitted 26 October, 2020; originally announced October 2020.

SSUE: Simultaneous State and Uncertainty Estimation for Dynamical Systems

Authors: Hang Geng, Mulugeta A. Haile, Huazhen Fang

Abstract: Parameters of the mathematical model describing many practical dynamical systems are prone to vary due to aging or renewal, wear and tear, as well as changes in environmental or service conditions. These variabilities will adversely affect the accuracy of state estimation. In this paper, we introduce SSUE: Simultaneous State and Uncertainty Estimation for quantifying parameter uncertainty while si… ▽ More Parameters of the mathematical model describing many practical dynamical systems are prone to vary due to aging or renewal, wear and tear, as well as changes in environmental or service conditions. These variabilities will adversely affect the accuracy of state estimation. In this paper, we introduce SSUE: Simultaneous State and Uncertainty Estimation for quantifying parameter uncertainty while simultaneously estimating the internal state of a system. Our approach involves the development of a Bayesian framework that recursively updates the posterior joint density of the unknown state vector and parameter uncertainty. To execute the framework for practical implementation, we develop a computational algorithm based on maximum a posteriori estimation and the numerical Newton's method. Observability analysis is conducted for linear systems, and its relation with the consistency of the estimation of the uncertainty's location is unveiled. Additional simulation results are provided to demonstrate the effectiveness of the proposed SSUE approach. △ Less

Submitted 20 October, 2020; originally announced October 2020.

Unexpectedly super strong paramagnetism of aromatic peptides due to cations

Authors: Haijun Yang, Liuhua Mu, Lei Zhang, Zixin Wang, Shiqi Sheng, Peng Xiu, Yongshun Song, Jun Hu, Xin Zhang, Feng Zhang, Haiping Fang

Abstract: We found that the AYFFF self-assemblies in the chloride solution of some divalent cations ($Zn^{2+}, Mg^{2+},$ and $Cu^{2+}$) display super strong paramagnetism, which may approach the mass susceptibility of ferromagnetism. We attribute the observed super strong paramagnetism to the existence of the aromatic rings, which interact with the cations through cation-π interaction. We found that the AYFFF self-assemblies in the chloride solution of some divalent cations ($Zn^{2+}, Mg^{2+},$ and $Cu^{2+}$) display super strong paramagnetism, which may approach the mass susceptibility of ferromagnetism. We attribute the observed super strong paramagnetism to the existence of the aromatic rings, which interact with the cations through cation-π interaction. △ Less

Submitted 15 October, 2020; originally announced October 2020.

Comments: 6 pages, 1 figure

DecAug: Augmenting HOI Detection via Decomposition

Authors: Yichen Xie, Hao-Shu Fang, Dian Shao, Yong-Lu Li, Cewu Lu

Abstract: Human-object interaction (HOI) detection requires a large amount of annotated data. Current algorithms suffer from insufficient training samples and category imbalance within datasets. To increase data efficiency, in this paper, we propose an efficient and effective data augmentation method called DecAug for HOI detection. Based on our proposed object state similarity metric, object patterns acros… ▽ More Human-object interaction (HOI) detection requires a large amount of annotated data. Current algorithms suffer from insufficient training samples and category imbalance within datasets. To increase data efficiency, in this paper, we propose an efficient and effective data augmentation method called DecAug for HOI detection. Based on our proposed object state similarity metric, object patterns across different HOIs are shared to augment local object appearance features without changing their state. Further, we shift spatial correlation between humans and objects to other feasible configurations with the aid of a pose-guided Gaussian Mixture Model while preserving their interactions. Experiments show that our method brings up to 3.3 mAP and 1.6 mAP improvements on V-COCO and HICODET dataset for two advanced models. Specifically, interactions with fewer samples enjoy more notable improvement. Our method can be easily integrated into various HOI detection models with negligible extra computational consumption. Our code will be made publicly available. △ Less

Submitted 2 October, 2020; originally announced October 2020.

DIRV: Dense Interaction Region Voting for End-to-End Human-Object Interaction Detection

Authors: Hao-Shu Fang, Yichen Xie, Dian Shao, Cewu Lu

Abstract: Recent years, human-object interaction (HOI) detection has achieved impressive advances. However, conventional two-stage methods are usually slow in inference. On the other hand, existing one-stage methods mainly focus on the union regions of interactions, which introduce unnecessary visual information as disturbances to HOI detection. To tackle the problems above, we propose a novel one-stage HOI… ▽ More Recent years, human-object interaction (HOI) detection has achieved impressive advances. However, conventional two-stage methods are usually slow in inference. On the other hand, existing one-stage methods mainly focus on the union regions of interactions, which introduce unnecessary visual information as disturbances to HOI detection. To tackle the problems above, we propose a novel one-stage HOI detection approach DIRV in this paper, based on a new concept called interaction region for the HOI problem. Unlike previous methods, our approach concentrates on the densely sampled interaction regions across different scales for each human-object pair, so as to capture the subtle visual features that is most essential to the interaction. Moreover, in order to compensate for the detection flaws of a single interaction region, we introduce a novel voting strategy that makes full use of those overlapped interaction regions in place of conventional Non-Maximal Suppression (NMS). Extensive experiments on two popular benchmarks: V-COCO and HICO-DET show that our approach outperforms existing state-of-the-arts by a large margin with the highest inference speed and lightest network architecture. We achieved 56.1 mAP on V-COCO without addtional input. Our code is publicly available at: https://github.com/MVIG-SJTU/DIRV △ Less

Submitted 19 January, 2021; v1 submitted 2 October, 2020; originally announced October 2020.

Comments: Paper is accepted. Code available at: https://github.com/MVIG-SJTU/DIRV

What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Exams

Authors: Di Jin, Eileen Pan, Nassim Oufattole, Wei-Hung Weng, Hanyi Fang, Peter Szolovits

Abstract: Open domain question answering (OpenQA) tasks have been recently attracting more and more attention from the natural language processing (NLP) community. In this work, we present the first free-form multiple-choice OpenQA dataset for solving medical problems, MedQA, collected from the professional medical board exams. It covers three languages: English, simplified Chinese, and traditional Chinese,… ▽ More Open domain question answering (OpenQA) tasks have been recently attracting more and more attention from the natural language processing (NLP) community. In this work, we present the first free-form multiple-choice OpenQA dataset for solving medical problems, MedQA, collected from the professional medical board exams. It covers three languages: English, simplified Chinese, and traditional Chinese, and contains 12,723, 34,251, and 14,123 questions for the three languages, respectively. We implement both rule-based and popular neural methods by sequentially combining a document retriever and a machine comprehension model. Through experiments, we find that even the current best method can only achieve 36.7\%, 42.0\%, and 70.1\% of test accuracy on the English, traditional Chinese, and simplified Chinese questions, respectively. We expect MedQA to present great challenges to existing OpenQA systems and hope that it can serve as a platform to promote much stronger OpenQA models from the NLP community in the future. △ Less

Submitted 28 September, 2020; originally announced September 2020.

Comments: Submitted to AAAI 2021

Task-Oriented Dialogue as Dataflow Synthesis

Authors: Semantic Machines, Jacob Andreas, John Bufe, David Burkett, Charles Chen, Josh Clausman, Jean Crawford, Kate Crim, Jordan DeLoach, Leah Dorner, Jason Eisner, Hao Fang, Alan Guo, David Hall, Kristin Hayes, Kellie Hill, Diana Ho, Wendy Iwaszuk, Smriti Jha, Dan Klein, Jayant Krishnamurthy, Theo Lanman, Percy Liang, Christopher H Lin, Ilya Lintsbakh , et al. (21 additional authors not shown)

Abstract: We describe an approach to task-oriented dialogue in which dialogue state is represented as a dataflow graph. A dialogue agent maps each user utterance to a program that extends this graph. Programs include metacomputation operators for reference and revision that reuse dataflow fragments from previous turns. Our graph-based state enables the expression and manipulation of complex user intents, an… ▽ More We describe an approach to task-oriented dialogue in which dialogue state is represented as a dataflow graph. A dialogue agent maps each user utterance to a program that extends this graph. Programs include metacomputation operators for reference and revision that reuse dataflow fragments from previous turns. Our graph-based state enables the expression and manipulation of complex user intents, and explicit metacomputation makes these intents easier for learned models to predict. We introduce a new dataset, SMCalFlow, featuring complex dialogues about events, weather, places, and people. Experiments show that dataflow graphs and metacomputation substantially improve representability and predictability in these natural dialogues. Additional experiments on the MultiWOZ dataset show that our dataflow representation enables an otherwise off-the-shelf sequence-to-sequence model to match the best existing task-specific state tracking model. The SMCalFlow dataset and code for replicating experiments are available at https://www.microsoft.com/en-us/research/project/dataflow-based-dialogue-semantic-machines. △ Less

Submitted 10 February, 2021; v1 submitted 23 September, 2020; originally announced September 2020.

Journal ref: Transactions of the Association for Computational Linguistics 2020 Vol. 8, 556-571

Remarkable antibacterial activity of reduced graphene oxide functionalized by copper ions

Authors: Yusong Tu, Pei Li, Jiajia Sun, Jie Jiang, Fangfang Dai, Yuanyan Wu, Liang Chen, Guosheng Shi, Yanwen Tan, Haiping Fang

Abstract: Despite long-term efforts for exploring antibacterial agents or drugs, it remains challenging how to potentiate antibacterial activity and meanwhile minimize toxicity hazards to the environment. Here, we experimentally show that the functionality of reduced graphene oxide (rGO) through copper ions displays selective antibacterial activity significantly stronger than that of rGO itself and no toxic… ▽ More Despite long-term efforts for exploring antibacterial agents or drugs, it remains challenging how to potentiate antibacterial activity and meanwhile minimize toxicity hazards to the environment. Here, we experimentally show that the functionality of reduced graphene oxide (rGO) through copper ions displays selective antibacterial activity significantly stronger than that of rGO itself and no toxicity to mammalian cells. Remarkably, this antibacterial activity is two orders of magnitude greater than the activity of its surrounding copper ions. We demonstrate that the rGO is functionalized through the cation-$π$ interaction to massively adsorb copper ions to form a rGO-copper composite in solution and result in an extremely low concentration level of surrounding copper ions (less than ~0.5 $μM$). These copper ions on rGO are positively charged and strongly interact with negatively charged bacterial cells to selectively achieve antibacterial activity, while rGO exhibits the functionality to not only actuate rapid delivery of copper ions and massive assembly onto bacterial cells but also result in the valence shift in the copper ions from Cu$^{2+}$ into Cu$^{+}$ which greatly enhances the antibacterial activity. Notably, this functionality of rGO through cation-$π$ interaction with copper ions can similarly achieve algaecidal activity but does not exert cytotoxicity against neutrally charged mammalian cells. The remarkable selective antibacterial activity from the rGO functionality as well as the inherent broad-spectrum-antibacterial physical mechanism represents a significant step toward the development of a novel antibacterial material and reagent without environmental hazards for practical application. △ Less

Submitted 20 September, 2020; originally announced September 2020.

RESA: Recurrent Feature-Shift Aggregator for Lane Detection

Authors: Tu Zheng, Hao Fang, Yi Zhang, Wenjian Tang, Zheng Yang, Haifeng Liu, Deng Cai

Abstract: Lane detection is one of the most important tasks in self-driving. Due to various complex scenarios (e.g., severe occlusion, ambiguous lanes, etc.) and the sparse supervisory signals inherent in lane annotations, lane detection task is still challenging. Thus, it is difficult for the ordinary convolutional neural network (CNN) to train in general scenes to catch subtle lane feature from the raw im… ▽ More Lane detection is one of the most important tasks in self-driving. Due to various complex scenarios (e.g., severe occlusion, ambiguous lanes, etc.) and the sparse supervisory signals inherent in lane annotations, lane detection task is still challenging. Thus, it is difficult for the ordinary convolutional neural network (CNN) to train in general scenes to catch subtle lane feature from the raw image. In this paper, we present a novel module named REcurrent Feature-Shift Aggregator (RESA) to enrich lane feature after preliminary feature extraction with an ordinary CNN. RESA takes advantage of strong shape priors of lanes and captures spatial relationships of pixels across rows and columns. It shifts sliced feature map recurrently in vertical and horizontal directions and enables each pixel to gather global information. RESA can conjecture lanes accurately in challenging scenarios with weak appearance clues by aggregating sliced feature map. Moreover, we propose a Bilateral Up-Sampling Decoder that combines coarse-grained and fine-detailed features in the up-sampling stage. It can recover the low-resolution feature map into pixel-wise prediction meticulously. Our method achieves state-of-the-art results on two popular lane detection benchmarks (CULane and Tusimple). Code has been made available at: https://github.com/ZJULearning/resa. △ Less

Submitted 25 March, 2021; v1 submitted 31 August, 2020; originally announced August 2020.

Criteria for deterministic single-photon emission in two-dimensional atomic crystals

Authors: Joshua J. P. Thompson, Samuel Brem, Hanlin Fang, Joey Frey, Saroj P. Dash, Witlef Wieczorek, Ermin Malic

Abstract: The deterministic production of single-photons from two dimensional materials promises to usher in a new generation of photonic quantum devices. In this work, we outline criteria by which single-photon emission can be realised in two dimensional materials: spatial isolation, spectral filtering and low excitation of quantum emitters. We explore how these criteria can be fulfilled in atomically thin… ▽ More The deterministic production of single-photons from two dimensional materials promises to usher in a new generation of photonic quantum devices. In this work, we outline criteria by which single-photon emission can be realised in two dimensional materials: spatial isolation, spectral filtering and low excitation of quantum emitters. We explore how these criteria can be fulfilled in atomically thin transition metal dichalcogenides, where excitonic physics dictates the observed photoemission. In particular, we model the effect of defects and localised strain, in accordance with the most common experimental realisations, on the photon statistics of emitted light. Moreover, we demonstrate that an optical cavity has a negative impact on the photon statistics, suppressing the single-photon character of the emission by diminishing the effect of spectral filtering on the emitted light. Our work provides a theoretical framework revealing criteria necessary to facilitate single-photon emission in two-dimensional materials and thus can guide future experimental studies in this field. △ Less

Submitted 24 August, 2020; originally announced August 2020.

Avidity and surface mobility in multivalent ligand-receptor binding

Authors: Simon Merminod, John R. Edison, Huang Fang, Michael F. Hagan, W. Benjamin Rogers

Abstract: Targeted drug delivery relies on two physical processes: the selective binding of a therapeutic particle to receptors on a specific cell membrane, followed by transport of the particle across the membrane. In this article, we address some of the challenges in controlling the thermodynamics and dynamics of these two processes by combining a simple experimental system with a statistical mechanical m… ▽ More Targeted drug delivery relies on two physical processes: the selective binding of a therapeutic particle to receptors on a specific cell membrane, followed by transport of the particle across the membrane. In this article, we address some of the challenges in controlling the thermodynamics and dynamics of these two processes by combining a simple experimental system with a statistical mechanical model. Specifically, we characterize and model multivalent ligand-receptor binding between colloidal particles and fluid lipid bilayers, as well as the surface mobility of membrane-bound particles. We show that the mobility of the receptors within the fluid membrane is key to both the thermodynamics and dynamics of binding. First, we find that the particle-membrane binding free energy -- or avidity -- is a strongly nonlinear function of the ligand-receptor affinity. We attribute the nonlinearity to a combination of multivalency and recruitment of fluid receptors to the binding site. Our results also suggest that partial wrapping of the bound particles by the membrane enhances avidity further. Second, we demonstrate that the lateral mobility of membrane-bound particles is also strongly influenced by the recruitment of receptors. Specifically, we find that the lateral diffusion coefficient of a membrane-bound particle is dominated by the hydrodynamic drag against the aggregate of receptors within the membrane. These results provide one of the first direct validations of the working theoretical framework for multivalent interactions. They also highlight that the fluidity and elasticity of the membrane are as important as the ligand-receptor affinity in determining the binding and transport of small particles attached to membranes. △ Less

Submitted 15 April, 2021; v1 submitted 16 August, 2020; originally announced August 2020.

Comments: 40 pages, 4 figures, Supporting Information; modified figures and associated text, results unchanged