Showing 151–200 of 591 results for author: Bae, S

IOPathTune: Adaptive Online Parameter Tuning for Parallel File System I/O Path

Authors: Md. Hasanur Rashid, Youbiao He, Forrest Sheng Bao, Dong Dai

Abstract: Parallel file systems contain complicated I/O paths from clients to storage servers. An efficient I/O path requires proper settings of multiple parameters, as the default settings often fail to deliver optimal performance, especially for diverse workloads in the HPC environment. Existing tuning strategies have shortcomings in being adaptive, timely, and flexible. We propose IOPathTune, which adapt… ▽ More Parallel file systems contain complicated I/O paths from clients to storage servers. An efficient I/O path requires proper settings of multiple parameters, as the default settings often fail to deliver optimal performance, especially for diverse workloads in the HPC environment. Existing tuning strategies have shortcomings in being adaptive, timely, and flexible. We propose IOPathTune, which adaptively tunes PFS I/O Path online from the client side without characterizing the workloads, doing expensive profiling, and communicating with other machines. We implemented IOPathTune on Lustre and leveraged CloudLab to conduct the evaluations on 20 different Filebench workloads in three different scenarios. We observed either on-par or better performance than the default configuration, as high as 231% on standalone executions. IOPathTune also delivers 89.57% better overall performance than CAPES in multiple client executions. △ Less

Submitted 16 January, 2023; originally announced January 2023.

Interaction-Aware Trajectory Planning for Autonomous Vehicles with Analytic Integration of Neural Networks into Model Predictive Control

Authors: Piyush Gupta, David Isele, Donggun Lee, Sangjae Bae

Abstract: Autonomous vehicles (AVs) must share the driving space with other drivers and often employ conservative motion planning strategies to ensure safety. These conservative strategies can negatively impact AV's performance and significantly slow traffic throughput. Therefore, to avoid conservatism, we design an interaction-aware motion planner for the ego vehicle (AV) that interacts with surrounding ve… ▽ More Autonomous vehicles (AVs) must share the driving space with other drivers and often employ conservative motion planning strategies to ensure safety. These conservative strategies can negatively impact AV's performance and significantly slow traffic throughput. Therefore, to avoid conservatism, we design an interaction-aware motion planner for the ego vehicle (AV) that interacts with surrounding vehicles to perform complex maneuvers in a locally optimal manner. Our planner uses a neural network-based interactive trajectory predictor and analytically integrates it with model predictive control (MPC). We solve the MPC optimization using the alternating direction method of multipliers (ADMM) and prove the algorithm's convergence. We provide an empirical study and compare our method with a baseline heuristic method. △ Less

Submitted 1 March, 2023; v1 submitted 13 January, 2023; originally announced January 2023.

Next-to-leading-order solution to Kerr-Newman black hole superradiance

Authors: Shou-Shan Bao, Qi-Xuan Xu, Hong Zhang

Abstract: The superradiant instabilities of Kerr-Newman black holes with charged or uncharged massive spin-0 fields are calculated analytically to the next-to-leading order in the limit of $α\sim r_g μ\ll 1$. A missing factor of $1/2$ in the previous leading-order result is identified. The next-to-leading order result has a compact form and is in good agreement with existing numerical calculations. The perc… ▽ More The superradiant instabilities of Kerr-Newman black holes with charged or uncharged massive spin-0 fields are calculated analytically to the next-to-leading order in the limit of $α\sim r_g μ\ll 1$. A missing factor of $1/2$ in the previous leading-order result is identified. The next-to-leading order result has a compact form and is in good agreement with existing numerical calculations. The percentage error increases with $α$, from a few percent for $α\sim 0.1$ to about $50\%$ for $α\sim 0.4$. Massive neutral scalars too heavy to be produced with Kerr black hole superradiance may exist in the superradiant region of Kerr-Newman black holes. △ Less

Submitted 18 August, 2023; v1 submitted 12 January, 2023; originally announced January 2023.

Comments: 11 pages, 5 figures, 2 tables. Correction: The third paragraph of Sec. III A contained errors and has been replaced, along with Eq. (27). Matches Physical Review D version

Codepod: A Namespace-Aware, Hierarchical Jupyter for Interactive Development at Scale

Authors: Hebi Li, Forrest Sheng Bao, Qi Xiao, Jin Tian

Abstract: Jupyter is a browser-based interactive development environment that has been popular recently. Jupyter models programs in code blocks, and makes it easy to develop code blocks interactively by running the code blocks and attaching rich media output. However, Jupyter provides no support for module systems and namespaces. Code blocks are linear and live in the global namespace; therefore, it is hard… ▽ More Jupyter is a browser-based interactive development environment that has been popular recently. Jupyter models programs in code blocks, and makes it easy to develop code blocks interactively by running the code blocks and attaching rich media output. However, Jupyter provides no support for module systems and namespaces. Code blocks are linear and live in the global namespace; therefore, it is hard to develop large projects that require modularization in Jupyter. As a result, large-code projects are still developed in traditional text files, and Jupyter is only used as a surface presentation. We present Codepod, a namespace-aware Jupyter that is suitable for interactive development at scale. Instead of linear code blocks, Codepod models code blocks as hierarchical code pods, and provides a simple yet powerful module system for namespace-aware incremental evaluation. Codepod is open source at https://github.com/codepod-io/codepod. △ Less

Submitted 6 January, 2023; originally announced January 2023.

DocAsRef: An Empirical Study on Repurposing Reference-Based Summary Quality Metrics Reference-Freely

Authors: Forrest Sheng Bao, Ruixuan Tu, Ge Luo, Yinfei Yang, Hebi Li, Minghui Qiu, Youbiao He, Cen Chen

Abstract: Automated summary quality assessment falls into two categories: reference-based and reference-free. Reference-based metrics, historically deemed more accurate due to the additional information provided by human-written references, are limited by their reliance on human input. In this paper, we hypothesize that the comparison methodologies used by some reference-based metrics to evaluate a system s… ▽ More Automated summary quality assessment falls into two categories: reference-based and reference-free. Reference-based metrics, historically deemed more accurate due to the additional information provided by human-written references, are limited by their reliance on human input. In this paper, we hypothesize that the comparison methodologies used by some reference-based metrics to evaluate a system summary against its corresponding reference can be effectively adapted to assess it against its source document, thereby transforming these metrics into reference-free ones. Experimental results support this hypothesis. After being repurposed reference-freely, the zero-shot BERTScore using the pretrained DeBERTa-large-MNLI model of <0.5B parameters consistently outperforms its original reference-based version across various aspects on the SummEval and Newsroom datasets. It also excels in comparison to most existing reference-free metrics and closely competes with zero-shot summary evaluators based on GPT-3.5. △ Less

Submitted 26 November, 2023; v1 submitted 20 December, 2022; originally announced December 2022.

Comments: Accepted into Findings of EMNLP 2023

Query Enhanced Knowledge-Intensive Conversation via Unsupervised Joint Modeling

Authors: Mingzhu Cai, Siqi Bao, Xin Tian, Huang He, Fan Wang, Hua Wu

Abstract: In this paper, we propose an unsupervised query enhanced approach for knowledge-intensive conversations, namely QKConv. There are three modules in QKConv: a query generator, an off-the-shelf knowledge selector, and a response generator. QKConv is optimized through joint training, which produces the response by exploring multiple candidate queries and leveraging corresponding selected knowledge. Th… ▽ More In this paper, we propose an unsupervised query enhanced approach for knowledge-intensive conversations, namely QKConv. There are three modules in QKConv: a query generator, an off-the-shelf knowledge selector, and a response generator. QKConv is optimized through joint training, which produces the response by exploring multiple candidate queries and leveraging corresponding selected knowledge. The joint training solely relies on the dialogue context and target response, getting exempt from extra query annotations or knowledge provenances. To evaluate the effectiveness of the proposed QKConv, we conduct experiments on three representative knowledge-intensive conversation datasets: conversational question-answering, task-oriented dialogue, and knowledge-grounded conversation. Experimental results reveal that QKConv performs better than all unsupervised methods across three datasets and achieves competitive performance compared to supervised methods. △ Less

Submitted 26 May, 2023; v1 submitted 19 December, 2022; originally announced December 2022.

Comments: Accepted for publication at ACL2023

Subdominant Modes of Scalar Superradiant Instability and Gravitational Wave Beats

Authors: Yin-da Guo, Shou-shan Bao, Hong Zhang

Abstract: Ultralight scalars could extract energy and angular momentum from a Kerr black hole (BH) because of superradiant instability. Multiple modes labelled with $nlm$ grow while rotating around the BH, emitting continuous gravitational wave (GW). In this work, we carefully study the contribution of the subdominant modes with $n\geq 1$ in the evolution of the BH-condensate system. We find the BH still ev… ▽ More Ultralight scalars could extract energy and angular momentum from a Kerr black hole (BH) because of superradiant instability. Multiple modes labelled with $nlm$ grow while rotating around the BH, emitting continuous gravitational wave (GW). In this work, we carefully study the contribution of the subdominant modes with $n\geq 1$ in the evolution of the BH-condensate system. We find the BH still evolves along the Regge trajectory of the $n=0$ modes even with the presence of the subdominant modes. The interference of the dominant and the subdominant modes produces beats in the emitted GW, which could be used to distinguish the BH-condensate systems from other monochromatic GW sources, such as neutron stars. △ Less

Submitted 3 April, 2023; v1 submitted 14 December, 2022; originally announced December 2022.

Comments: 22 pages, 11 figures

Report number: Phys. Rev. D 107, 075009 (2023)

Automatic Classification of Galaxy Morphology: a rotationally invariant supervised machine learning method based on the UML-dataset

Authors: G. W. Fang, S. Ba, Y. Z. Gu, Z. S. Lin, Y. J. Hou, C. X. Qin, C. C. Zhou, J. Xu, Y. Dai, J. Song, X. Kong

Abstract: Classification of galaxy morphology is a challenging but meaningful task for the enormous amount of data produced by the next-generation telescope. By introducing the adaptive polar coordinate transformation, we develop a rotationally invariant supervised machine learning (SML) method that ensures consistent classifications when rotating galaxy images, which is always required to be satisfied phys… ▽ More Classification of galaxy morphology is a challenging but meaningful task for the enormous amount of data produced by the next-generation telescope. By introducing the adaptive polar coordinate transformation, we develop a rotationally invariant supervised machine learning (SML) method that ensures consistent classifications when rotating galaxy images, which is always required to be satisfied physically but difficult to achieve algorithmically. The adaptive polar coordinate transformation, compared with the conventional method of data augmentation by including additional rotated images in the training set, is proved to be an effective and efficient method in improving the robustness of the SML methods. In the previous work, we generated a catalog of galaxies with well-classified morphologies via our developed unsupervised machine learning (UML) method. By using this UML-dataset as the training set, we apply the new method to classify galaxies into five categories (unclassifiable, irregulars, late-type disks, early-type disks, and spheroids). In general, the result of our morphological classifications following the sequence from irregulars to spheroids agrees well with the expected trends of other galaxy properties, including Sérsic indices, effective radii, nonparametric statistics, and colors. Thus, we demonstrate that the rotationally invariant SML method, together with the previously developed UML method, completes the entire task of automatic classification of galaxy morphology. △ Less

Submitted 13 December, 2022; originally announced December 2022.

Comments: 18 pages, 13 figures, To be published in AJ

A note on $ξ-$Bergman kernels

Authors: Shijie Bao, Qi'an Guan, Zheng Yuan

Abstract: In the present note, we introduce the $ξ-$complex singularity exponents, which come from the asymptotic property of $ξ-$Bergman kernels on sub-level sets of plurisubharmonic functions; give some relations (including a closedness property) among $ξ-$complex singularity exponents, complex singularity exponents, and jumping numbers; generalize some properties of complex singularity exponents (such as… ▽ More In the present note, we introduce the $ξ-$complex singularity exponents, which come from the asymptotic property of $ξ-$Bergman kernels on sub-level sets of plurisubharmonic functions; give some relations (including a closedness property) among $ξ-$complex singularity exponents, complex singularity exponents, and jumping numbers; generalize some properties of complex singularity exponents (such as the restriction formula and subadditivity property) to $ξ-$complex singularity exponents. △ Less

Submitted 9 January, 2024; v1 submitted 3 December, 2022; originally announced December 2022.

Comments: 22 pages. All comments are welcome! We fixed some typos

MSC Class: [2010]32D15; 32E10; 32L10; 32U05; 32W05

Search for subsolar-mass black hole binaries in the second part of Advanced LIGO's and Advanced Virgo's third observing run

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, H. Abe, F. Acernese, K. Ackley, S. Adhicary, N. Adhikari, R. X. Adhikari, V. K. Adkins, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi, R. A. Alfaidi, C. Alléné, A. Allocca, P. A. Altin , et al. (1680 additional authors not shown)

Abstract: We describe a search for gravitational waves from compact binaries with at least one component with mass 0.2 $M_\odot$ -- $1.0 M_\odot$ and mass ratio $q \geq 0.1$ in Advanced LIGO and Advanced Virgo data collected between 1 November 2019, 15:00 UTC and 27 March 2020, 17:00 UTC. No signals were detected. The most significant candidate has a false alarm rate of 0.2 $\mathrm{yr}^{-1}$. We estimate t… ▽ More We describe a search for gravitational waves from compact binaries with at least one component with mass 0.2 $M_\odot$ -- $1.0 M_\odot$ and mass ratio $q \geq 0.1$ in Advanced LIGO and Advanced Virgo data collected between 1 November 2019, 15:00 UTC and 27 March 2020, 17:00 UTC. No signals were detected. The most significant candidate has a false alarm rate of 0.2 $\mathrm{yr}^{-1}$. We estimate the sensitivity of our search over the entirety of Advanced LIGO's and Advanced Virgo's third observing run, and present the most stringent limits to date on the merger rate of binary black holes with at least one subsolar-mass component. We use the upper limits to constrain two fiducial scenarios that could produce subsolar-mass black holes: primordial black holes (PBH) and a model of dissipative dark matter. The PBH model uses recent prescriptions for the merger rate of PBH binaries that include a rate suppression factor to effectively account for PBH early binary disruptions. If the PBHs are monochromatically distributed, we can exclude a dark matter fraction in PBHs $f_\mathrm{PBH} \gtrsim 0.6$ (at 90% confidence) in the probed subsolar-mass range. However, if we allow for broad PBH mass distributions we are unable to rule out $f_\mathrm{PBH} = 1$. For the dissipative model, where the dark matter has chemistry that allows a small fraction to cool and collapse into black holes, we find an upper bound $f_{\mathrm{DBH}} < 10^{-5}$ on the fraction of atomic dark matter collapsed into black holes. △ Less

Submitted 26 January, 2024; v1 submitted 2 December, 2022; originally announced December 2022.

Comments: https://dcc.ligo.org/P2200139

Single Slice Thigh CT Muscle Group Segmentation with Domain Adaptation and Self-Training

Authors: Qi Yang, Xin Yu, Ho Hin Lee, Leon Y. Cai, Kaiwen Xu, Shunxing Bao, Yuankai Huo, Ann Zenobia Moore, Sokratis Makrogiannis, Luigi Ferrucci, Bennett A. Landman

Abstract: Objective: Thigh muscle group segmentation is important for assessment of muscle anatomy, metabolic disease and aging. Many efforts have been put into quantifying muscle tissues with magnetic resonance (MR) imaging including manual annotation of individual muscles. However, leveraging publicly available annotations in MR images to achieve muscle group segmentation on single slice computed tomograp… ▽ More Objective: Thigh muscle group segmentation is important for assessment of muscle anatomy, metabolic disease and aging. Many efforts have been put into quantifying muscle tissues with magnetic resonance (MR) imaging including manual annotation of individual muscles. However, leveraging publicly available annotations in MR images to achieve muscle group segmentation on single slice computed tomography (CT) thigh images is challenging. Method: We propose an unsupervised domain adaptation pipeline with self-training to transfer labels from 3D MR to single CT slice. First, we transform the image appearance from MR to CT with CycleGAN and feed the synthesized CT images to a segmenter simultaneously. Single CT slices are divided into hard and easy cohorts based on the entropy of pseudo labels inferenced by the segmenter. After refining easy cohort pseudo labels based on anatomical assumption, self-training with easy and hard splits is applied to fine tune the segmenter. Results: On 152 withheld single CT thigh images, the proposed pipeline achieved a mean Dice of 0.888(0.041) across all muscle groups including sartorius, hamstrings, quadriceps femoris and gracilis. muscles Conclusion: To our best knowledge, this is the first pipeline to achieve thigh imaging domain adaptation from MR to CT. The proposed pipeline is effective and robust in extracting muscle groups on 2D single slice CT thigh images.The container is available for public use at https://github.com/MASILab/DA_CT_muscle_seg △ Less

Submitted 30 November, 2022; originally announced December 2022.

Concavity property of minimal $L^2$ integrals with Lebesgue measurable gain VI: fibrations over products of open Riemann surfaces

Authors: Shijie Bao, Qi'an Guan, Zheng Yuan

Abstract: In this article, we present characterizations of the concavity property of minimal $L^2$ integrals degenerating to linearity in the case of fibrations over products of open Riemann surfaces. As applications, we obtain characterizations of the holding of equality in optimal jets $L^2$ extension problem from fibers over products of analytic subsets to fibrations over products of open Riemann surface… ▽ More In this article, we present characterizations of the concavity property of minimal $L^2$ integrals degenerating to linearity in the case of fibrations over products of open Riemann surfaces. As applications, we obtain characterizations of the holding of equality in optimal jets $L^2$ extension problem from fibers over products of analytic subsets to fibrations over products of open Riemann surfaces, which implies characterizations of the equality parts of Suita conjecture and extended Suita conjecture for fibrations over products of open Riemann surfaces. △ Less

Submitted 13 November, 2022; v1 submitted 1 November, 2022; originally announced November 2022.

Comments: 69 pages. arXiv admin note: substantial text overlap with arXiv:2205.07512; text overlap with arXiv:2210.14579, arXiv:2211.00470

PLATO-K: Internal and External Knowledge Enhanced Dialogue Generation

Authors: Siqi Bao, Huang He, Jun Xu, Hua Lu, Fan Wang, Hua Wu, Han Zhou, Wenquan Wu, Zheng-Yu Niu, Haifeng Wang

Abstract: Recently, the practical deployment of open-domain dialogue systems has been plagued by the knowledge issue of information deficiency and factual inaccuracy. To this end, we introduce PLATO-K based on two-stage dialogic learning to strengthen internal knowledge memorization and external knowledge exploitation. In the first stage, PLATO-K learns through massive dialogue corpora and memorizes essenti… ▽ More Recently, the practical deployment of open-domain dialogue systems has been plagued by the knowledge issue of information deficiency and factual inaccuracy. To this end, we introduce PLATO-K based on two-stage dialogic learning to strengthen internal knowledge memorization and external knowledge exploitation. In the first stage, PLATO-K learns through massive dialogue corpora and memorizes essential knowledge into model parameters. In the second stage, PLATO-K mimics human beings to search for external information and to leverage the knowledge in response generation. Extensive experiments reveal that the knowledge issue is alleviated significantly in PLATO-K with such comprehensive internal and external knowledge enhancement. Compared to the existing state-of-the-art Chinese dialogue model, the overall engagingness of PLATO-K is improved remarkably by 36.2% and 49.2% on chit-chat and knowledge-intensive conversations. △ Less

Submitted 2 November, 2022; originally announced November 2022.

Comments: First four authors contributed equally to this work

Concavity property of minimal $L^2$ integrals with Lebesgue measurable gain V--fibrations over open Riemann surfaces

Authors: Shijie Bao, Qi'an Guan, Zheng Yuan

Abstract: In this article, we present characterizations of the concavity property of minimal $L^2$ integrals degenerating to linearity in the case of fibrations over open Riemann surfaces. As applications, we obtain characterizations of the holding of equality in optimal jets $L^2$ extension problem from fibers over analytic subsets to fibrations over open Riemann surfaces, which implies characterizations o… ▽ More In this article, we present characterizations of the concavity property of minimal $L^2$ integrals degenerating to linearity in the case of fibrations over open Riemann surfaces. As applications, we obtain characterizations of the holding of equality in optimal jets $L^2$ extension problem from fibers over analytic subsets to fibrations over open Riemann surfaces, which implies characterizations of the fibration versions of the equality parts of Suita conjecture and extended Suita conjecture. △ Less

Submitted 1 November, 2022; originally announced November 2022.

Comments: 60 pages. arXiv admin note: substantial text overlap with arXiv:2205.07512, arXiv:2204.07266

MSC Class: 32D15; 32E10; 32L10; 32U05; 32W05

Fiberwise Bergman kernels, vector bundles, and log-subharmonicity

Authors: Shijie Bao, Qi'an Guan

Abstract: In this article, we consider Bergman kernels related to modules at boundary points for singular hermitian metrics on holomorphic vector bundles, and obtain a log-subharmonicity property of the Bergman kernels. As applications, we obtain a lower estimate of weighted $L^2$ integrals on sublevel sets of plurisubharmonic functions, and reprove an effectiveness result of the strong openness property of… ▽ More In this article, we consider Bergman kernels related to modules at boundary points for singular hermitian metrics on holomorphic vector bundles, and obtain a log-subharmonicity property of the Bergman kernels. As applications, we obtain a lower estimate of weighted $L^2$ integrals on sublevel sets of plurisubharmonic functions, and reprove an effectiveness result of the strong openness property of the modules. △ Less

Submitted 10 May, 2023; v1 submitted 29 October, 2022; originally announced October 2022.

Comments: 32 pages, all comments are welcome! arXiv admin note: substantial text overlap with arXiv:2205.08044, arXiv:2206.00443

MSC Class: 32A36; 32D15; 32L15; 32Q28; 32W05

RT-MOT: Confidence-Aware Real-Time Scheduling Framework for Multi-Object Tracking Tasks

Authors: Donghwa Kang, Seunghoon Lee, Hoon Sung Chwa, Seung-Hwan Bae, Chang Mook Kang, Jinkyu Lee, Hyeongboo Baek

Abstract: Different from existing MOT (Multi-Object Tracking) techniques that usually aim at improving tracking accuracy and average FPS, real-time systems such as autonomous vehicles necessitate new requirements of MOT under limited computing resources: (R1) guarantee of timely execution and (R2) high tracking accuracy. In this paper, we propose RT-MOT, a novel system design for multiple MOT tasks, which a… ▽ More Different from existing MOT (Multi-Object Tracking) techniques that usually aim at improving tracking accuracy and average FPS, real-time systems such as autonomous vehicles necessitate new requirements of MOT under limited computing resources: (R1) guarantee of timely execution and (R2) high tracking accuracy. In this paper, we propose RT-MOT, a novel system design for multiple MOT tasks, which addresses R1 and R2. Focusing on multiple choices of a workload pair of detection and association, which are two main components of the tracking-by-detection approach for MOT, we tailor a measure of object confidence for RT-MOT and develop how to estimate the measure for the next frame of each MOT task. By utilizing the estimation, we make it possible to predict tracking accuracy variation according to different workload pairs to be applied to the next frame of an MOT task. Next, we develop a novel confidence-aware real-time scheduling framework, which offers an offline timing guarantee for a set of MOT tasks based on non-preemptive fixed-priority scheduling with the smallest workload pair. At run-time, the framework checks the feasibility of a priority-inversion associated with a larger workload pair, which does not compromise the timing guarantee of every task, and then chooses a feasible scenario that yields the largest tracking accuracy improvement based on the proposed prediction. Our experiment results demonstrate that RT-MOT significantly improves overall tracking accuracy by up to 1.5x, compared to existing popular tracking-by-detection approaches, while guaranteeing timely execution of all MOT tasks. △ Less

Submitted 19 October, 2022; originally announced October 2022.

Comments: Accepted to 2022 Real-Time Systems Symposium (RTSS)

Design a Sustainable Micro-mobility Future: Trends and Challenges in the United States and European Union Using Natural Language Processing Techniques

Authors: Lilit Avetisyan, Chengxin Zhang, Sue Bai, Ehsan Moradi Pari, Fred Feng, Shan Bao, Feng Zhou

Abstract: Micro-mobility is promising to contribute to sustainable cities in the future with its efficiency and low cost. To better design such a sustainable future, it is necessary to understand the trends and challenges. Thus, we examined people's opinions on micro-mobility in the US and the EU using Tweets. We used topic modeling based on advanced natural language processing techniques and categorized th… ▽ More Micro-mobility is promising to contribute to sustainable cities in the future with its efficiency and low cost. To better design such a sustainable future, it is necessary to understand the trends and challenges. Thus, we examined people's opinions on micro-mobility in the US and the EU using Tweets. We used topic modeling based on advanced natural language processing techniques and categorized the data into seven topics: promotion and service, mobility, technical features, acceptance, recreation, infrastructure and regulations. Furthermore, using sentiment analysis, we investigated people's positive and negative attitudes towards specific aspects of these topics and compared the patterns of the trends and challenges in the US and the EU. We found that 1) promotion and service included the majority of Twitter discussions in the both regions, 2) the EU had more positive opinions than the US, 3) micro-mobility devices were more widely used for utilitarian mobility and recreational purposes in the EU than in the US, and 4) compared to the EU, people in the US had many more concerns related to infrastructure and regulation issues. These findings help us understand the trends and challenges and prioritize different aspects in micro-mobility to improve their safety and experience across the two areas for designing a more sustainable micro-mobility future. △ Less

Submitted 29 October, 2022; v1 submitted 20 October, 2022; originally announced October 2022.

Comments: 33 pages, 4 figures

ACM Class: I.5

Axion Dark Matter Search around 4.55 $μ$eV with Dine-Fischler-Srednicki-Zhitnitskii Sensitivity

Authors: Andrew K. Yi, Saebyeok Ahn, Çağlar Kutlu, JinMyeong Kim, Byeong Rok Ko, Boris I. Ivanov, HeeSu Byun, Arjan F. van Loo, SeongTae Park, Junu Jeong, Ohjoon Kwon, Yasunobu Nakamura, Sergey V. Uchaikin, Jihoon Choi, Soohyung Lee, MyeongJae Lee, Yun Chang Shin, Jinsu Kim, Doyu Lee, Danho Ahn, SungJae Bae, Jiwon Lee, Younggeun Kim, Violeta Gkika, Ki Woong Lee , et al. (7 additional authors not shown)

Abstract: We report an axion dark matter search at Dine-Fischler-Srednicki-Zhitnitskii sensitivity with the CAPP-12TB haloscope, assuming axions contribute 100\% of the local dark matter density. The search excluded the axion--photon coupling $g_{aγγ}$ down to about $6.2\times10^{-16}$ GeV$^{-1}$ over the axion mass range between 4.51 and 4.59 $μ$eV at a 90\% confidence level. The achieved experimental… ▽ More We report an axion dark matter search at Dine-Fischler-Srednicki-Zhitnitskii sensitivity with the CAPP-12TB haloscope, assuming axions contribute 100\% of the local dark matter density. The search excluded the axion--photon coupling $g_{aγγ}$ down to about $6.2\times10^{-16}$ GeV$^{-1}$ over the axion mass range between 4.51 and 4.59 $μ$eV at a 90\% confidence level. The achieved experimental sensitivity can also exclude Kim-Shifman-Vainshtein-Zakharov axion dark matter that makes up just 13\% of the local dark matter density. The CAPP-12TB haloscope will continue the search over a wide range of axion masses. △ Less

Submitted 16 February, 2023; v1 submitted 19 October, 2022; originally announced October 2022.

Comments: 7 pages, 6 figures

Journal ref: Physical Review Letters 130, 071002 (2023)

Search for gravitational-wave transients associated with magnetar bursts in Advanced LIGO and Advanced Virgo data from the third observing run

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, H. Abe, F. Acernese, K. Ackley, N. Adhikari, R. X. Adhikari, V. K. Adkins, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, K. Agatsuma, N. Aggarwal, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi, R. A. Alfaidi, A. Allocca, P. A. Altin , et al. (1645 additional authors not shown)

Abstract: Gravitational waves are expected to be produced from neutron star oscillations associated with magnetar giant flares and short bursts. We present the results of a search for short-duration (milliseconds to seconds) and long-duration ($\sim$ 100 s) transient gravitational waves from 13 magnetar short bursts observed during Advanced LIGO, Advanced Virgo and KAGRA's third observation run. These 13 bu… ▽ More Gravitational waves are expected to be produced from neutron star oscillations associated with magnetar giant flares and short bursts. We present the results of a search for short-duration (milliseconds to seconds) and long-duration ($\sim$ 100 s) transient gravitational waves from 13 magnetar short bursts observed during Advanced LIGO, Advanced Virgo and KAGRA's third observation run. These 13 bursts come from two magnetars, SGR 1935$+$2154 and Swift J1818.0$-$1607. We also include three other electromagnetic burst events detected by Fermi GBM which were identified as likely coming from one or more magnetars, but they have no association with a known magnetar. No magnetar giant flares were detected during the analysis period. We find no evidence of gravitational waves associated with any of these 16 bursts. We place upper bounds on the root-sum-square of the integrated gravitational-wave strain that reach $2.2 \times 10^{-23}$ $/\sqrt{\text{Hz}}$ at 100 Hz for the short-duration search and $8.7 \times 10^{-23}$ $/\sqrt{\text{Hz}}$ at $450$ Hz for the long-duration search, given a detection efficiency of 50%. For a ringdown signal at 1590 Hz targeted by the short-duration search the limit is set to $1.8 \times 10^{-22}$ $/\sqrt{\text{Hz}}$. Using the estimated distance to each magnetar, we derive upper bounds on the emitted gravitational-wave energy of $3.2 \times 10^{43}$ erg ($7.3 \times 10^{43}$ erg) for SGR 1935$+$2154 and $8.2 \times 10^{42}$ erg ($2.8 \times 10^{43}$ erg) for Swift J1818.0$-$1607, for the short-duration (long-duration) search. Assuming isotropic emission of electromagnetic radiation of the burst fluences, we constrain the ratio of gravitational-wave energy to electromagnetic energy for bursts from SGR 1935$+$2154 with available fluence information. The lowest of these ratios is $3 \times 10^3$. △ Less

Submitted 19 October, 2022; originally announced October 2022.

Comments: 30 pages with appendices, 5 figures, 10 tables

Report number: LIGO-P2100387

ZooD: Exploiting Model Zoo for Out-of-Distribution Generalization

Authors: Qishi Dong, Awais Muhammad, Fengwei Zhou, Chuanlong Xie, Tianyang Hu, Yongxin Yang, Sung-Ho Bae, Zhenguo Li

Abstract: Recent advances on large-scale pre-training have shown great potentials of leveraging a large set of Pre-Trained Models (PTMs) for improving Out-of-Distribution (OoD) generalization, for which the goal is to perform well on possible unseen domains after fine-tuning on multiple training domains. However, maximally exploiting a zoo of PTMs is challenging since fine-tuning all possible combinations o… ▽ More Recent advances on large-scale pre-training have shown great potentials of leveraging a large set of Pre-Trained Models (PTMs) for improving Out-of-Distribution (OoD) generalization, for which the goal is to perform well on possible unseen domains after fine-tuning on multiple training domains. However, maximally exploiting a zoo of PTMs is challenging since fine-tuning all possible combinations of PTMs is computationally prohibitive while accurate selection of PTMs requires tackling the possible data distribution shift for OoD tasks. In this work, we propose ZooD, a paradigm for PTMs ranking and ensemble with feature selection. Our proposed metric ranks PTMs by quantifying inter-class discriminability and inter-domain stability of the features extracted by the PTMs in a leave-one-domain-out cross-validation manner. The top-K ranked models are then aggregated for the target OoD task. To avoid accumulating noise induced by model ensemble, we propose an efficient variational EM algorithm to select informative features. We evaluate our paradigm on a diverse model zoo consisting of 35 models for various OoD tasks and demonstrate: (i) model ranking is better correlated with fine-tuning ranking than previous methods and up to 9859x faster than brute-force fine-tuning; (ii) OoD generalization after model ensemble with feature selection outperforms the state-of-the-art methods and the accuracy on most challenging task DomainNet is improved from 46.5\% to 50.6\%. Furthermore, we provide the fine-tuning results of 35 PTMs on 7 OoD datasets, hoping to help the research of model zoo and OoD generalization. Code will be available at https://gitee.com/mindspore/models/tree/master/research/cv/zood. △ Less

Submitted 17 October, 2022; originally announced October 2022.

Keep Me Updated! Memory Management in Long-term Conversations

Authors: Sanghwan Bae, Donghyun Kwak, Soyoung Kang, Min Young Lee, Sungdong Kim, Yuin Jeong, Hyeri Kim, Sang-Woo Lee, Woomyoung Park, Nako Sung

Abstract: Remembering important information from the past and continuing to talk about it in the present are crucial in long-term conversations. However, previous literature does not deal with cases where the memorized information is outdated, which may cause confusion in later conversations. To address this issue, we present a novel task and a corresponding dataset of memory management in long-term convers… ▽ More Remembering important information from the past and continuing to talk about it in the present are crucial in long-term conversations. However, previous literature does not deal with cases where the memorized information is outdated, which may cause confusion in later conversations. To address this issue, we present a novel task and a corresponding dataset of memory management in long-term conversations, in which bots keep track of and bring up the latest information about users while conversing through multiple sessions. In order to support more precise and interpretable memory, we represent memory as unstructured text descriptions of key information and propose a new mechanism of memory management that selectively eliminates invalidated or redundant information. Experimental results show that our approach outperforms the baselines that leave the stored memory unchanged in terms of engagingness and humanness, with larger performance gap especially in the later sessions. △ Less

Submitted 17 October, 2022; originally announced October 2022.

Comments: Accepted to EMNLP2022 Findings

Adaptive Contrastive Learning with Dynamic Correlation for Multi-Phase Organ Segmentation

Authors: Ho Hin Lee, Yucheng Tang, Han Liu, Yubo Fan, Leon Y. Cai, Qi Yang, Xin Yu, Shunxing Bao, Yuankai Huo, Bennett A. Landman

Abstract: Recent studies have demonstrated the superior performance of introducing ``scan-wise" contrast labels into contrastive learning for multi-organ segmentation on multi-phase computed tomography (CT). However, such scan-wise labels are limited: (1) a coarse classification, which could not capture the fine-grained ``organ-wise" contrast variations across all organs; (2) the label (i.e., contrast phase… ▽ More Recent studies have demonstrated the superior performance of introducing ``scan-wise" contrast labels into contrastive learning for multi-organ segmentation on multi-phase computed tomography (CT). However, such scan-wise labels are limited: (1) a coarse classification, which could not capture the fine-grained ``organ-wise" contrast variations across all organs; (2) the label (i.e., contrast phase) is typically manually provided, which is error-prone and may introduce manual biases of defining phases. In this paper, we propose a novel data-driven contrastive loss function that adapts the similar/dissimilar contrast relationship between samples in each minibatch at organ-level. Specifically, as variable levels of contrast exist between organs, we hypothesis that the contrast differences in the organ-level can bring additional context for defining representations in the latent space. An organ-wise contrast correlation matrix is computed with mean organ intensities under one-hot attention maps. The goal of adapting the organ-driven correlation matrix is to model variable levels of feature separability at different phases. We evaluate our proposed approach on multi-organ segmentation with both non-contrast CT (NCCT) datasets and the MICCAI 2015 BTCV Challenge contrast-enhance CT (CECT) datasets. Compared to the state-of-the-art approaches, our proposed contrastive loss yields a substantial and significant improvement of 1.41% (from 0.923 to 0.936, p-value$<$0.01) and 2.02% (from 0.891 to 0.910, p-value$<$0.01) on mean Dice scores across all organs with respect to NCCT and CECT cohorts. We further assess the trained model performance with the MICCAI 2021 FLARE Challenge CECT datasets and achieve a substantial improvement of mean Dice score from 0.927 to 0.934 (p-value$<$0.01). The code is available at: https://github.com/MASILab/DCC_CL △ Less

Submitted 16 October, 2022; originally announced October 2022.

Comments: 11 pages

Q-TOD: A Query-driven Task-oriented Dialogue System

Authors: Xin Tian, Yingzhan Lin, Mengfei Song, Siqi Bao, Fan Wang, Huang He, Shuqi Sun, Hua Wu

Abstract: Existing pipelined task-oriented dialogue systems usually have difficulties adapting to unseen domains, whereas end-to-end systems are plagued by large-scale knowledge bases in practice. In this paper, we introduce a novel query-driven task-oriented dialogue system, namely Q-TOD. The essential information from the dialogue context is extracted into a query, which is further employed to retrieve re… ▽ More Existing pipelined task-oriented dialogue systems usually have difficulties adapting to unseen domains, whereas end-to-end systems are plagued by large-scale knowledge bases in practice. In this paper, we introduce a novel query-driven task-oriented dialogue system, namely Q-TOD. The essential information from the dialogue context is extracted into a query, which is further employed to retrieve relevant knowledge records for response generation. Firstly, as the query is in the form of natural language and not confined to the schema of the knowledge base, the issue of domain adaption is alleviated remarkably in Q-TOD. Secondly, as the query enables the decoupling of knowledge retrieval from the generation, Q-TOD gets rid of the issue of knowledge base scalability. To evaluate the effectiveness of the proposed Q-TOD, we collect query annotations for three publicly available task-oriented dialogue datasets. Comprehensive experiments verify that Q-TOD outperforms strong baselines and establishes a new state-of-the-art performance on these datasets. △ Less

Submitted 14 October, 2022; originally announced October 2022.

Comments: Accepted to EMNLP 2022

Input optics systems of the KAGRA detector during O3GK

Authors: T. Akutsu, M. Ando, K. Arai, Y. Arai, S. Araki, A. Araya, N. Aritomi, H. Asada, Y. Aso, S. Bae, Y. Bae, L. Baiotti, R. Bajpai, M. A. Barton, K. Cannon, Z. Cao, E. Capocasa, M. Chan, C. Chen, K. Chen, Y. Chen, C-I. Chiang, H. Chu, Y-K. Chu, S. Eguchi , et al. (228 additional authors not shown)

Abstract: KAGRA, the underground and cryogenic gravitational-wave detector, was operated for its solo observation from February 25th to March 10th, 2020, and its first joint observation with the GEO 600 detector from April 7th -- 21st, 2020 (O3GK). This study presents an overview of the input optics systems of the KAGRA detector, which consist of various optical systems, such as a laser source, its intensit… ▽ More KAGRA, the underground and cryogenic gravitational-wave detector, was operated for its solo observation from February 25th to March 10th, 2020, and its first joint observation with the GEO 600 detector from April 7th -- 21st, 2020 (O3GK). This study presents an overview of the input optics systems of the KAGRA detector, which consist of various optical systems, such as a laser source, its intensity and frequency stabilization systems, modulators, a Faraday isolator, mode-matching telescopes, and a high-power beam dump. These optics were successfully delivered to the KAGRA interferometer and operated stably during the observations. The laser frequency noise was observed to limit the detector sensitivity above a few kHz, whereas the laser intensity did not significantly limit the detector sensitivity. △ Less

Submitted 12 October, 2022; originally announced October 2022.

Asymptotically Unbiased Instance-wise Regularized Partial AUC Optimization: Theory and Algorithm

Authors: Huiyang Shao, Qianqian Xu, Zhiyong Yang, Shilong Bao, Qingming Huang

Abstract: The Partial Area Under the ROC Curve (PAUC), typically including One-way Partial AUC (OPAUC) and Two-way Partial AUC (TPAUC), measures the average performance of a binary classifier within a specific false positive rate and/or true positive rate interval, which is a widely adopted measure when decision constraints must be considered. Consequently, PAUC optimization has naturally attracted increasi… ▽ More The Partial Area Under the ROC Curve (PAUC), typically including One-way Partial AUC (OPAUC) and Two-way Partial AUC (TPAUC), measures the average performance of a binary classifier within a specific false positive rate and/or true positive rate interval, which is a widely adopted measure when decision constraints must be considered. Consequently, PAUC optimization has naturally attracted increasing attention in the machine learning community within the last few years. Nonetheless, most of the existing methods could only optimize PAUC approximately, leading to inevitable biases that are not controllable. Fortunately, a recent work presents an unbiased formulation of the PAUC optimization problem via distributional robust optimization. However, it is based on the pair-wise formulation of AUC, which suffers from the limited scalability w.r.t. sample size and a slow convergence rate, especially for TPAUC. To address this issue, we present a simpler reformulation of the problem in an asymptotically unbiased and instance-wise manner. For both OPAUC and TPAUC, we come to a nonconvex strongly concave minimax regularized problem of instance-wise functions. On top of this, we employ an efficient solver enjoys a linear per-iteration computational complexity w.r.t. the sample size and a time-complexity of $O(ε^{-1/3})$ to reach a $ε$ stationary point. Furthermore, we find that the minimax reformulation also facilitates the theoretical analysis of generalization error as a byproduct. Compared with the existing results, we present new error bounds that are much easier to prove and could deal with hypotheses with real-valued outputs. Finally, extensive experiments on several benchmark datasets demonstrate the effectiveness of our method. △ Less

Submitted 10 October, 2022; v1 submitted 8 October, 2022; originally announced October 2022.

Comments: NeurIPS 2022

A Closer Look at Hardware-Friendly Weight Quantization

Authors: Sungmin Bae, Piotr Zielinski, Satrajit Chatterjee

Abstract: Quantizing a Deep Neural Network (DNN) model to be used on a custom accelerator with efficient fixed-point hardware implementations, requires satisfying many stringent hardware-friendly quantization constraints to train the model. We evaluate the two main classes of hardware-friendly quantization methods in the context of weight quantization: the traditional Mean Squared Quantization Error (MSQE)-… ▽ More Quantizing a Deep Neural Network (DNN) model to be used on a custom accelerator with efficient fixed-point hardware implementations, requires satisfying many stringent hardware-friendly quantization constraints to train the model. We evaluate the two main classes of hardware-friendly quantization methods in the context of weight quantization: the traditional Mean Squared Quantization Error (MSQE)-based methods and the more recent gradient-based methods. We study the two methods on MobileNetV1 and MobileNetV2 using multiple empirical metrics to identify the sources of performance differences between the two classes, namely, sensitivity to outliers and convergence instability of the quantizer scaling factor. Using those insights, we propose various techniques to improve the performance of both quantization methods - they fix the optimization instability issues present in the MSQE-based methods during quantization of MobileNet models and allow us to improve validation performance of the gradient-based methods by 4.0% and 3.3% for MobileNetV1 and MobileNetV2 on ImageNet respectively. △ Less

Submitted 7 October, 2022; originally announced October 2022.

The Minority Matters: A Diversity-Promoting Collaborative Metric Learning Algorithm

Authors: Shilong Bao, Qianqian Xu, Zhiyong Yang, Yuan He, Xiaochun Cao, Qingming Huang

Abstract: Collaborative Metric Learning (CML) has recently emerged as a popular method in recommendation systems (RS), closing the gap between metric learning and Collaborative Filtering. Following the convention of RS, existing methods exploit unique user representation in their model design. This paper focuses on a challenging scenario where a user has multiple categories of interests. Under this setting,… ▽ More Collaborative Metric Learning (CML) has recently emerged as a popular method in recommendation systems (RS), closing the gap between metric learning and Collaborative Filtering. Following the convention of RS, existing methods exploit unique user representation in their model design. This paper focuses on a challenging scenario where a user has multiple categories of interests. Under this setting, we argue that the unique user representation might induce preference bias, especially when the item category distribution is imbalanced. To address this issue, we propose a novel method called \textit{Diversity-Promoting Collaborative Metric Learning} (DPCML), with the hope of considering the commonly ignored minority interest of the user. The key idea behind DPCML is to include a multiple set of representations for each user in the system. Based on this embedding paradigm, user preference toward an item is aggregated from different embeddings by taking the minimum item-user distance among the user embedding set. Furthermore, we observe that the diversity of the embeddings for the same user also plays an essential role in the model. To this end, we propose a \textit{diversity control regularization} term to accommodate the multi-vector representation strategy better. Theoretically, we show that DPCML could generalize well to unseen test data by tackling the challenge of the annoying operation that comes from the minimum value. Experiments over a range of benchmark datasets speak to the efficacy of DPCML. △ Less

Submitted 30 September, 2022; originally announced September 2022.

3D UX-Net: A Large Kernel Volumetric ConvNet Modernizing Hierarchical Transformer for Medical Image Segmentation

Authors: Ho Hin Lee, Shunxing Bao, Yuankai Huo, Bennett A. Landman

Abstract: The recent 3D medical ViTs (e.g., SwinUNETR) achieve the state-of-the-art performances on several 3D volumetric data benchmarks, including 3D medical image segmentation. Hierarchical transformers (e.g., Swin Transformers) reintroduced several ConvNet priors and further enhanced the practical viability of adapting volumetric segmentation in 3D medical datasets. The effectiveness of hybrid approache… ▽ More The recent 3D medical ViTs (e.g., SwinUNETR) achieve the state-of-the-art performances on several 3D volumetric data benchmarks, including 3D medical image segmentation. Hierarchical transformers (e.g., Swin Transformers) reintroduced several ConvNet priors and further enhanced the practical viability of adapting volumetric segmentation in 3D medical datasets. The effectiveness of hybrid approaches is largely credited to the large receptive field for non-local self-attention and the large number of model parameters. In this work, we propose a lightweight volumetric ConvNet, termed 3D UX-Net, which adapts the hierarchical transformer using ConvNet modules for robust volumetric segmentation. Specifically, we revisit volumetric depth-wise convolutions with large kernel size (e.g. starting from $7\times7\times7$) to enable the larger global receptive fields, inspired by Swin Transformer. We further substitute the multi-layer perceptron (MLP) in Swin Transformer blocks with pointwise depth convolutions and enhance model performances with fewer normalization and activation layers, thus reducing the number of model parameters. 3D UX-Net competes favorably with current SOTA transformers (e.g. SwinUNETR) using three challenging public datasets on volumetric brain and abdominal imaging: 1) MICCAI Challenge 2021 FLARE, 2) MICCAI Challenge 2021 FeTA, and 3) MICCAI Challenge 2022 AMOS. 3D UX-Net consistently outperforms SwinUNETR with improvement from 0.929 to 0.938 Dice (FLARE2021) and 0.867 to 0.874 Dice (Feta2021). We further evaluate the transfer learning capability of 3D UX-Net with AMOS2022 and demonstrates another improvement of $2.27\%$ Dice (from 0.880 to 0.900). The source code with our proposed model are available at https://github.com/MASILab/3DUX-Net. △ Less

Submitted 1 March, 2023; v1 submitted 29 September, 2022; originally announced September 2022.

Comments: Accepted to ICLR 2023

Reducing Positional Variance in Cross-sectional Abdominal CT Slices with Deep Conditional Generative Models

Authors: Xin Yu, Qi Yang, Yucheng Tang, Riqiang Gao, Shunxing Bao, LeonY. Cai, Ho Hin Lee, Yuankai Huo, Ann Zenobia Moore, Luigi Ferrucci, Bennett A. Landman

Abstract: 2D low-dose single-slice abdominal computed tomography (CT) slice enables direct measurements of body composition, which are critical to quantitatively characterizing health relationships on aging. However, longitudinal analysis of body composition changes using 2D abdominal slices is challenging due to positional variance between longitudinal slices acquired in different years. To reduce the posi… ▽ More 2D low-dose single-slice abdominal computed tomography (CT) slice enables direct measurements of body composition, which are critical to quantitatively characterizing health relationships on aging. However, longitudinal analysis of body composition changes using 2D abdominal slices is challenging due to positional variance between longitudinal slices acquired in different years. To reduce the positional variance, we extend the conditional generative models to our C-SliceGen that takes an arbitrary axial slice in the abdominal region as the condition and generates a defined vertebral level slice by estimating the structural changes in the latent space. Experiments on 1170 subjects from an in-house dataset and 50 subjects from BTCV MICCAI Challenge 2015 show that our model can generate high quality images in terms of realism and similarity. External experiments on 20 subjects from the Baltimore Longitudinal Study of Aging (BLSA) dataset that contains longitudinal single abdominal slices validate that our method can harmonize the slice positional variance in terms of muscle and visceral fat area. Our approach provides a promising direction of mapping slices from different vertebral levels to a target slice to reduce positional variance for single slice longitudinal analysis. The source code is available at: https://github.com/MASILab/C-SliceGen. △ Less

Submitted 28 September, 2022; originally announced September 2022.

Comments: 11 pages, 4 figures

Journal ref: Medical Image Computing and Computer Assisted Intervention MICCAI 2022, Cham, 2022, pp202,212

UNesT: Local Spatial Representation Learning with Hierarchical Transformer for Efficient Medical Segmentation

Authors: Xin Yu, Qi Yang, Yinchi Zhou, Leon Y. Cai, Riqiang Gao, Ho Hin Lee, Thomas Li, Shunxing Bao, Zhoubing Xu, Thomas A. Lasko, Richard G. Abramson, Zizhao Zhang, Yuankai Huo, Bennett A. Landman, Yucheng Tang

Abstract: Transformer-based models, capable of learning better global dependencies, have recently demonstrated exceptional representation learning capabilities in computer vision and medical image analysis. Transformer reformats the image into separate patches and realizes global communication via the self-attention mechanism. However, positional information between patches is hard to preserve in such 1D se… ▽ More Transformer-based models, capable of learning better global dependencies, have recently demonstrated exceptional representation learning capabilities in computer vision and medical image analysis. Transformer reformats the image into separate patches and realizes global communication via the self-attention mechanism. However, positional information between patches is hard to preserve in such 1D sequences, and loss of it can lead to sub-optimal performance when dealing with large amounts of heterogeneous tissues of various sizes in 3D medical image segmentation. Additionally, current methods are not robust and efficient for heavy-duty medical segmentation tasks such as predicting a large number of tissue classes or modeling globally inter-connected tissue structures. To address such challenges and inspired by the nested hierarchical structures in vision transformer, we proposed a novel 3D medical image segmentation method (UNesT), employing a simplified and faster-converging transformer encoder design that achieves local communication among spatially adjacent patch sequences by aggregating them hierarchically. We extensively validate our method on multiple challenging datasets, consisting of multiple modalities, anatomies, and a wide range of tissue classes, including 133 structures in the brain, 14 organs in the abdomen, 4 hierarchical components in the kidneys, inter-connected kidney tumors and brain tumors. We show that UNesT consistently achieves state-of-the-art performance and evaluate its generalizability and data efficiency. Particularly, the model achieves whole brain segmentation task complete ROI with 133 tissue classes in a single network, outperforming prior state-of-the-art method SLANT27 ensembled with 27 networks. △ Less

Submitted 7 September, 2023; v1 submitted 28 September, 2022; originally announced September 2022.

Comments: 19 pages, 17 figures. arXiv admin note: text overlap with arXiv:2203.02430

Longitudinal Variability Analysis on Low-dose Abdominal CT with Deep Learning-based Segmentation

Authors: Xin Yu, Yucheng Tang, Qi Yang, Ho Hin Lee, Riqiang Gao, Shunxing Bao, Ann Zenobia Moore, Luigi Ferrucci, Bennett A. Landman

Abstract: Metabolic health is increasingly implicated as a risk factor across conditions from cardiology to neurology, and efficiency assessment of body composition is critical to quantitatively characterizing these relationships. 2D low dose single slice computed tomography (CT) provides a high resolution, quantitative tissue map, albeit with a limited field of view. Although numerous potential analyses ha… ▽ More Metabolic health is increasingly implicated as a risk factor across conditions from cardiology to neurology, and efficiency assessment of body composition is critical to quantitatively characterizing these relationships. 2D low dose single slice computed tomography (CT) provides a high resolution, quantitative tissue map, albeit with a limited field of view. Although numerous potential analyses have been proposed in quantifying image context, there has been no comprehensive study for low-dose single slice CT longitudinal variability with automated segmentation. We studied a total of 1816 slices from 1469 subjects of Baltimore Longitudinal Study on Aging (BLSA) abdominal dataset using supervised deep learning-based segmentation and unsupervised clustering method. 300 out of 1469 subjects that have two year gap in their first two scans were pick out to evaluate longitudinal variability with measurements including intraclass correlation coefficient (ICC) and coefficient of variation (CV) in terms of tissues/organs size and mean intensity. We showed that our segmentation methods are stable in longitudinal settings with Dice ranged from 0.821 to 0.962 for thirteen target abdominal tissues structures. We observed high variability in most organ with ICC<0.5, low variability in the area of muscle, abdominal wall, fat and body mask with average ICC>0.8. We found that the variability in organ is highly related to the cross-sectional position of the 2D slice. Our efforts pave quantitative exploration and quality control to reduce uncertainties in longitudinal analysis. △ Less

Submitted 28 September, 2022; originally announced September 2022.

Comments: 7 pages, 3 figures

Graph Perceiver IO: A General Architecture for Graph Structured Data

Authors: Seyun Bae, Hoyoon Byun, Changdae Oh, Yoon-Sik Cho, Kyungwoo Song

Abstract: Multimodal machine learning has been widely studied for the development of general intelligence. Recently, the remarkable multimodal algorithms, the Perceiver and Perceiver IO, show competitive results for diverse dataset domains and tasks. However, recent works, Perceiver and Perceiver IO, have focused on heterogeneous modalities, including image, text, and speech, and there are few research work… ▽ More Multimodal machine learning has been widely studied for the development of general intelligence. Recently, the remarkable multimodal algorithms, the Perceiver and Perceiver IO, show competitive results for diverse dataset domains and tasks. However, recent works, Perceiver and Perceiver IO, have focused on heterogeneous modalities, including image, text, and speech, and there are few research works for graph structured datasets. A graph is one of the most generalized dataset structures, and we can represent the other dataset, including images, text, and speech, as graph structured data. A graph has an adjacency matrix different from other dataset domains such as text and image, and it is not trivial to handle the topological information, relational information, and canonical positional information. In this study, we provide a Graph Perceiver IO, the Perceiver IO for the graph structured dataset. We keep the main structure of the Graph Perceiver IO as the Perceiver IO because the Perceiver IO already handles the diverse dataset well, except for the graph structured dataset. The Graph Perceiver IO is a general method, and it can handle diverse datasets such as graph structured data as well as text and images. Comparing the graph neural networks, the Graph Perceiver IO requires a lower complexity, and it can incorporate the local and global information efficiently. We show that Graph Perceiver IO shows competitive results for diverse graph-related tasks, including node classification, graph classification, and link prediction. △ Less

Submitted 14 September, 2022; originally announced September 2022.

Model-based cross-correlation search for gravitational waves from the low-mass X-ray binary Scorpius X-1 in LIGO O3 data

Authors: The LIGO Scientific Collaboration, the Virgo Collaboration, the KAGRA Collaboration, R. Abbott, H. Abe, F. Acernese, K. Ackley, S. Adhicary, N. Adhikari, R. X. Adhikari, V. K. Adkins, V. B. Adya, C. Affeldt, D. Agarwal, M. Agathos, O. D. Aguiar, L. Aiello, A. Ain, P. Ajith, T. Akutsu, S. Albanesi, R. A. Alfaidi, C. Alléné, A. Allocca, P. A. Altin , et al. (1670 additional authors not shown)

Abstract: We present the results of a model-based search for continuous gravitational waves from the low-mass X-ray binary Scorpius X-1 using LIGO detector data from the third observing run of Advanced LIGO, Advanced Virgo and KAGRA. This is a semicoherent search which uses details of the signal model to coherently combine data separated by less than a specified coherence time, which can be adjusted to bala… ▽ More We present the results of a model-based search for continuous gravitational waves from the low-mass X-ray binary Scorpius X-1 using LIGO detector data from the third observing run of Advanced LIGO, Advanced Virgo and KAGRA. This is a semicoherent search which uses details of the signal model to coherently combine data separated by less than a specified coherence time, which can be adjusted to balance sensitivity with computing cost. The search covered a range of gravitational-wave frequencies from 25Hz to 1600Hz, as well as ranges in orbital speed, frequency and phase determined from observational constraints. No significant detection candidates were found, and upper limits were set as a function of frequency. The most stringent limits, between 100Hz and 200Hz, correspond to an amplitude h0 of about 1e-25 when marginalized isotropically over the unknown inclination angle of the neutron star's rotation axis, or less than 4e-26 assuming the optimal orientation. The sensitivity of this search is now probing amplitudes predicted by models of torque balance equilibrium. For the usual conservative model assuming accretion at the surface of the neutron star, our isotropically-marginalized upper limits are close to the predicted amplitude from about 70Hz to 100Hz; the limits assuming the neutron star spin is aligned with the most likely orbital angular momentum are below the conservative torque balance predictions from 40Hz to 200Hz. Assuming a broader range of accretion models, our direct limits on gravitational-wave amplitude delve into the relevant parameter space over a wide range of frequencies, to 500Hz or more. △ Less

Submitted 2 January, 2023; v1 submitted 6 September, 2022; originally announced September 2022.

Comments: 19 pages, Open Access Journal PDF

Report number: LIGO-P2100110-v13

Journal ref: The Astrophysical Journal Letters, 941, L30 (2022)

Compound Figure Separation of Biomedical Images: Mining Large Datasets for Self-supervised Learning

Authors: Tianyuan Yao, Chang Qu, Jun Long, Quan Liu, Ruining Deng, Yuanhan Tian, Jiachen Xu, Aadarsh Jha, Zuhayr Asad, Shunxing Bao, Mengyang Zhao, Agnes B. Fogo, Bennett A. Landman, Haichun Yang, Catie Chang, Yuankai Huo

Abstract: With the rapid development of self-supervised learning (e.g., contrastive learning), the importance of having large-scale images (even without annotations) for training a more generalizable AI model has been widely recognized in medical image analysis. However, collecting large-scale task-specific unannotated data at scale can be challenging for individual labs. Existing online resources, such as… ▽ More With the rapid development of self-supervised learning (e.g., contrastive learning), the importance of having large-scale images (even without annotations) for training a more generalizable AI model has been widely recognized in medical image analysis. However, collecting large-scale task-specific unannotated data at scale can be challenging for individual labs. Existing online resources, such as digital books, publications, and search engines, provide a new resource for obtaining large-scale images. However, published images in healthcare (e.g., radiology and pathology) consist of a considerable amount of compound figures with subplots. In order to extract and separate compound figures into usable individual images for downstream learning, we propose a simple compound figure separation (SimCFS) framework without using the traditionally required detection bounding box annotations, with a new loss function and a hard case simulation. Our technical contribution is four-fold: (1) we introduce a simulation-based training framework that minimizes the need for resource extensive bounding box annotations; (2) we propose a new side loss that is optimized for compound figure separation; (3) we propose an intra-class image augmentation method to simulate hard cases; and (4) to the best of our knowledge, this is the first study that evaluates the efficacy of leveraging self-supervised learning with compound image separation. From the results, the proposed SimCFS achieved state-of-the-art performance on the ImageCLEF 2016 Compound Figure Separation Database. The pretrained self-supervised learning model using large-scale mined figures improved the accuracy of downstream image classification tasks with a contrastive learning algorithm. The source code of SimCFS is made publicly available at https://github.com/hrlblab/ImageSeperation. △ Less

Submitted 30 August, 2022; originally announced August 2022.

Comments: Accepted for publication at the Journal of Machine Learning for Biomedical Imaging (MELBA) https://www.melba-journal.org/papers/2022:025.html. arXiv admin note: substantial text overlap with arXiv:2107.08650

Journal ref: Machine.Learning.for.Biomedical.Imaging. 1 (2022)

Towards Boosting the Open-Domain Chatbot with Human Feedback

Authors: Hua Lu, Siqi Bao, Huang He, Fan Wang, Hua Wu, Haifeng Wang

Abstract: Many open-domain dialogue models pre-trained with social media comments can generate coherent replies but have difficulties producing engaging responses when interacting with real users. This phenomenon might mainly result from the deficiency of annotated human-human conversations and the misalignment with human preference. In this paper, we propose a novel and efficient approach Diamante to boost… ▽ More Many open-domain dialogue models pre-trained with social media comments can generate coherent replies but have difficulties producing engaging responses when interacting with real users. This phenomenon might mainly result from the deficiency of annotated human-human conversations and the misalignment with human preference. In this paper, we propose a novel and efficient approach Diamante to boost the open-domain chatbot, where two kinds of human feedback (including explicit demonstration and implicit preference) are collected and leveraged. By asking annotators to select or amend the model-generated candidate responses, Diamante efficiently collects the human demonstrated responses and constructs a Chinese chit-chat dataset. To enhance the alignment with human preference, Diamante leverages the implicit preference in the data collection process and introduces the generation-evaluation joint training. Comprehensive experiments indicate that the Diamante dataset and joint training paradigm can significantly boost the performance of Chinese pre-trained dialogue models. △ Less

Submitted 30 August, 2022; originally announced August 2022.

Comments: First two authors contributed equally to this work

Cross-scale Attention Guided Multi-instance Learning for Crohn's Disease Diagnosis with Pathological Images

Authors: Ruining Deng, Can Cui, Lucas W. Remedios, Shunxing Bao, R. Michael Womick, Sophie Chiron, Jia Li, Joseph T. Roland, Ken S. Lau, Qi Liu, Keith T. Wilson, Yaohong Wang, Lori A. Coburn, Bennett A. Landman, Yuankai Huo

Abstract: Multi-instance learning (MIL) is widely used in the computer-aided interpretation of pathological Whole Slide Images (WSIs) to solve the lack of pixel-wise or patch-wise annotations. Often, this approach directly applies "natural image driven" MIL algorithms which overlook the multi-scale (i.e. pyramidal) nature of WSIs. Off-the-shelf MIL algorithms are typically deployed on a single-scale of WSIs… ▽ More Multi-instance learning (MIL) is widely used in the computer-aided interpretation of pathological Whole Slide Images (WSIs) to solve the lack of pixel-wise or patch-wise annotations. Often, this approach directly applies "natural image driven" MIL algorithms which overlook the multi-scale (i.e. pyramidal) nature of WSIs. Off-the-shelf MIL algorithms are typically deployed on a single-scale of WSIs (e.g., 20x magnification), while human pathologists usually aggregate the global and local patterns in a multi-scale manner (e.g., by zooming in and out between different magnifications). In this study, we propose a novel cross-scale attention mechanism to explicitly aggregate inter-scale interactions into a single MIL network for Crohn's Disease (CD), which is a form of inflammatory bowel disease. The contribution of this paper is two-fold: (1) a cross-scale attention mechanism is proposed to aggregate features from different resolutions with multi-scale interaction; and (2) differential multi-scale attention visualizations are generated to localize explainable lesion patterns. By training ~250,000 H&E-stained Ascending Colon (AC) patches from 20 CD patient and 30 healthy control samples at different scales, our approach achieved a superior Area under the Curve (AUC) score of 0.8924 compared with baseline models. The official implementation is publicly available at https://github.com/hrlblab/CS-MIL. △ Less

Submitted 15 August, 2022; originally announced August 2022.

Cultivating Visualization Literacy for Children Through Curiosity and Play

Authors: S. Sandra Bae, Rishi Vanukuru, Ruhan Yang, Peter Gyory, Ran Zhou, Ellen Yi-Luen Do, Danielle Albers Szafir

Abstract: Fostering data visualization literacy (DVL) as part of childhood education could lead to a more data literate society. However, most work in DVL for children relies on a more formal educational context (i.e., a teacher-led approach) that limits children's engagement with data to classroom-based environments and, consequently, children's ability to ask questions about and explore data on topics the… ▽ More Fostering data visualization literacy (DVL) as part of childhood education could lead to a more data literate society. However, most work in DVL for children relies on a more formal educational context (i.e., a teacher-led approach) that limits children's engagement with data to classroom-based environments and, consequently, children's ability to ask questions about and explore data on topics they find personally meaningful. We explore how a curiosity-driven, child-led approach can provide more agency to children when they are authoring data visualizations. This paper explores how informal learning with crafting physicalizations through play and curiosity may foster increased literacy and engagement with data. Employing a constructionist approach, we designed a do-it-yourself toolkit made out of everyday materials (e.g., paper, cardboard, mirrors) that enables children to create, customize, and personalize three different interactive visualizations (bar, line, pie). We used the toolkit as a design probe in a series of in-person workshops with 5 children (6 to 11-year-olds) and interviews with 5 educators. Our observations reveal that the toolkit helped children creatively engage and interact with visualizations. Children with prior knowledge of data visualization reported the toolkit serving as more of an authoring tool that they envision using in their daily lives, while children with little to no experience found the toolkit as an engaging introduction to data visualization. Our study demonstrates the potential of using the constructionist approach to cultivate children's DVL through curiosity and play. △ Less

Submitted 9 August, 2022; originally announced August 2022.

Comments: 11 pages, 8 figures, 1 table, accepted to IEEE Transaction on Visualization and Graphics (also appearing in the proceedings of IEEE VIS 2022)

Measurement of the Branching Fraction of the Singly Cabibbo-Suppressed Decay $Λ_{c}^{+}\toΛK^{+}$

Authors: BESIII Collaboration, M. Ablikim, M. N. Achasov, P. Adlarson, M. Albrecht, R. Aliberti, A. Amoroso, M. R. An, Q. An, X. H. Bai, Y. Bai, O. Bakina, R. Baldini Ferroli, I. Balossino, Y. Ban, S. S. Bao, V. Batozskaya, D. Becker, K. Begzsuren, N. Berger, M. Bertani, D. Bettoni, F. Bianchi, J. Bloms, A. Bortone , et al. (551 additional authors not shown)

Abstract: We report a branching fraction measurement of the singly Cabibbo-suppressed decay $Λ_{c}^{+}\toΛK^{+}$ using a data sample collected with the BESIII detector at the BEPCII storage ring. The data span center-of-mass energies from 4.599 to 4.950 GeV and correspond to an integrated luminosity of 6.44 fb$^{-1}$. The branching fraction of $Λ_{c}^{+}\toΛK^{+}$ relative to that of the Cabibbo-favored dec… ▽ More We report a branching fraction measurement of the singly Cabibbo-suppressed decay $Λ_{c}^{+}\toΛK^{+}$ using a data sample collected with the BESIII detector at the BEPCII storage ring. The data span center-of-mass energies from 4.599 to 4.950 GeV and correspond to an integrated luminosity of 6.44 fb$^{-1}$. The branching fraction of $Λ_{c}^{+}\toΛK^{+}$ relative to that of the Cabibbo-favored decay $Λ_{c}^{+}\toΛπ^{+}$ is measured to be $\mathcal{R}=\frac{\mathcal{B}(Λ_{c}^{+}\toΛK^{+})}{\mathcal{B}(Λ_{c}^{+}\toΛπ^{+})}=(4.78\pm0.34\pm0.20)\%$. Combining with the world-average value of $\mathcal{B}(Λ_{c}^{+}\toΛπ^{+})$, we obtain $\mathcal{B}(Λ_c^+\toΛK^+)=(6.21\pm0.44\pm0.26\pm0.34)\times 10^{-4}$. Here the first uncertainties are statistical, the second systematic, and the third comes from the uncertainty of the $Λ_{c}^{+}\toΛπ^{+}$ branching fraction. This result, which is more precise than previous measurements, does not agree with theoretical predictions, and suggests that non-factorizable contributions have been under-estimated in current models. △ Less

Submitted 15 December, 2022; v1 submitted 8 August, 2022; originally announced August 2022.

Comments: 8 pages, 2 figures

Journal ref: Phys. Rev. D 106, L111101 (2022)

The factorization effect in $Λ_C\to Λπ$ and $Λ_C\to ΛK$

Authors: Shou-shan Bao

Abstract: We calculated the branch ratios of $Λ_C\to ΛK$ and $Λ_C\to Λπ$ within factorization approximation. It is found that the results suffers from the uncertainties of form factors. To reduce such uncertainties, we checked the ratio of the two channels, which is obtained as $R=0.0743\pm 0.0014$. It is found that the uncertainty caused by form factors is significantly reduced. This note is prepared for t… ▽ More We calculated the branch ratios of $Λ_C\to ΛK$ and $Λ_C\to Λπ$ within factorization approximation. It is found that the results suffers from the uncertainties of form factors. To reduce such uncertainties, we checked the ratio of the two channels, which is obtained as $R=0.0743\pm 0.0014$. It is found that the uncertainty caused by form factors is significantly reduced. This note is prepared for the BESIII collaboration. △ Less

Submitted 31 July, 2022; originally announced August 2022.

Cause-and-Effect Analysis of ADAS: A Comparison Study between Literature Review and Complaint Data

Authors: Jackie Ayoub, Zifei Wang, Meitang Li, Huizhong Guo, Rini Sherony, Shan Bao, Feng Zhou

Abstract: Advanced driver assistance systems (ADAS) are designed to improve vehicle safety. However, it is difficult to achieve such benefits without understanding the causes and limitations of the current ADAS and their possible solutions. This study 1) investigated the limitations and solutions of ADAS through a literature review, 2) identified the causes and effects of ADAS through consumer complaints us… ▽ More Advanced driver assistance systems (ADAS) are designed to improve vehicle safety. However, it is difficult to achieve such benefits without understanding the causes and limitations of the current ADAS and their possible solutions. This study 1) investigated the limitations and solutions of ADAS through a literature review, 2) identified the causes and effects of ADAS through consumer complaints using natural language processing models, and 3) compared the major differences between the two. These two lines of research identified similar categories of ADAS causes, including human factors, environmental factors, and vehicle factors. However, academic research focused more on human factors of ADAS issues and proposed advanced algorithms to mitigate such issues while drivers complained more of vehicle factors of ADAS failures, which led to associated top consequences. The findings from these two sources tend to complement each other and provide important implications for the improvement of ADAS in the future. △ Less

Submitted 30 July, 2022; originally announced August 2022.

A Probabilistic Framework for Estimating the Risk of Pedestrian-Vehicle Conflicts at Intersections

Authors: Pei Li, Huizhong Guo, Shan Bao, Arpan Kusari

Abstract: Pedestrian safety has become an important research topic among various studies due to the increased number of pedestrian-involved crashes. To evaluate pedestrian safety proactively, surrogate safety measures (SSMs) have been widely used in traffic conflict-based studies as they do not require historical crashes as inputs. However, most existing SSMs were developed based on the assumption that road… ▽ More Pedestrian safety has become an important research topic among various studies due to the increased number of pedestrian-involved crashes. To evaluate pedestrian safety proactively, surrogate safety measures (SSMs) have been widely used in traffic conflict-based studies as they do not require historical crashes as inputs. However, most existing SSMs were developed based on the assumption that road users would maintain constant velocity and direction. Risk estimations based on this assumption are less unstable, more likely to be exaggerated, and unable to capture the evasive maneuvers of drivers. Considering the limitations among existing SSMs, this study proposes a probabilistic framework for estimating the risk of pedestrian-vehicle conflicts at intersections. The proposed framework loosen restrictions of constant speed by predicting trajectories using a Gaussian Process Regression and accounts for the different possible driver maneuvers with a Random Forest model. Real-world LiDAR data collected at an intersection was used to evaluate the performance of the proposed framework. The newly developed framework is able to identify all pedestrian-vehicle conflicts. Compared to the Time-to-Collision, the proposed framework provides a more stable risk estimation and captures the evasive maneuvers of vehicles. Moreover, the proposed framework does not require expensive computation resources, which makes it an ideal choice for real-time proactive pedestrian safety solutions at intersections. △ Less

Submitted 28 July, 2022; originally announced July 2022.

Keeping Less is More: Point Sparsification for Visual SLAM

Authors: Yeonsoo Park, Soohyun Bae

Abstract: When adapting Simultaneous Mapping and Localization (SLAM) to real-world applications, such as autonomous vehicles, drones, and augmented reality devices, its memory footprint and computing cost are the two main factors limiting the performance and the range of applications. In sparse feature based SLAM algorithms, one efficient way for this problem is to limit the map point size by selecting the… ▽ More When adapting Simultaneous Mapping and Localization (SLAM) to real-world applications, such as autonomous vehicles, drones, and augmented reality devices, its memory footprint and computing cost are the two main factors limiting the performance and the range of applications. In sparse feature based SLAM algorithms, one efficient way for this problem is to limit the map point size by selecting the points potentially useful for local and global bundle adjustment (BA). This study proposes an efficient graph optimization for sparsifying map points in SLAM systems. Specifically, we formulate a maximum pose-visibility and maximum spatial diversity problem as a minimum-cost maximum-flow graph optimization problem. The proposed method works as an additional step in existing SLAM systems, so it can be used in both conventional or learning based SLAM systems. By extensive experimental evaluations we demonstrate the proposed method achieves even more accurate camera poses with approximately 1/3 of the map points and 1/2 of the computation. △ Less

Submitted 3 November, 2022; v1 submitted 1 July, 2022; originally announced July 2022.

Comments: The IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2022

Link the World: Improving Open-domain Conversation with Dynamic Spatiotemporal-aware Knowledge

Authors: Han Zhou, Xinchao Xu, Wenquan Wu, Zheng-Yu Niu, Hua Wu, Siqi Bao, Fan Wang, Haifeng Wang

Abstract: Making chatbots world aware in a conversation like a human is a crucial challenge, where the world may contain dynamic knowledge and spatiotemporal state. Several recent advances have tried to link the dialog system to a static knowledge base or search engine, but they do not contain all the world information needed for conversations. In contrast, we propose a new method to improve the dialogue sy… ▽ More Making chatbots world aware in a conversation like a human is a crucial challenge, where the world may contain dynamic knowledge and spatiotemporal state. Several recent advances have tried to link the dialog system to a static knowledge base or search engine, but they do not contain all the world information needed for conversations. In contrast, we propose a new method to improve the dialogue system using spatiotemporal aware dynamic knowledge. We utilize service information as a way for the dialogue system to link the world. The system actively builds a request according to the dialog context and spatiotemporal state to get service information and then generates world aware responses. To implement this method, we collect DuSinc, an open-domain human-human dialogue dataset, where a participant can access the service to get the information needed for dialogue responses. Through automatic and human evaluations, we found that service information significantly improves the consistency, informativeness, factuality, and engagingness of the dialogue system, making it behave more like a human. Compared to the pre-trained models without spatiotemporal aware dynamic knowledge, the overall session-level score was improved by 60.87\%. The collection dataset and methods will be open-sourced. △ Less

Submitted 4 September, 2022; v1 submitted 28 June, 2022; originally announced June 2022.

Comments: 13pages, 5 figures

AdAUC: End-to-end Adversarial AUC Optimization Against Long-tail Problems

Authors: Wenzheng Hou, Qianqian Xu, Zhiyong Yang, Shilong Bao, Yuan He, Qingming Huang

Abstract: It is well-known that deep learning models are vulnerable to adversarial examples. Existing studies of adversarial training have made great progress against this challenge. As a typical trait, they often assume that the class distribution is overall balanced. However, long-tail datasets are ubiquitous in a wide spectrum of applications, where the amount of head class instances is larger than the t… ▽ More It is well-known that deep learning models are vulnerable to adversarial examples. Existing studies of adversarial training have made great progress against this challenge. As a typical trait, they often assume that the class distribution is overall balanced. However, long-tail datasets are ubiquitous in a wide spectrum of applications, where the amount of head class instances is larger than the tail classes. Under such a scenario, AUC is a much more reasonable metric than accuracy since it is insensitive toward class distribution. Motivated by this, we present an early trial to explore adversarial training methods to optimize AUC. The main challenge lies in that the positive and negative examples are tightly coupled in the objective function. As a direct result, one cannot generate adversarial examples without a full scan of the dataset. To address this issue, based on a concavity regularization scheme, we reformulate the AUC optimization problem as a saddle point problem, where the objective becomes an instance-wise function. This leads to an end-to-end training protocol. Furthermore, we provide a convergence guarantee of the proposed algorithm. Our analysis differs from the existing studies since the algorithm is asked to generate adversarial examples by calculating the gradient of a min-max problem. Finally, the extensive experimental results show the performance and robustness of our algorithm in three long-tail datasets. △ Less

Submitted 24 June, 2022; originally announced June 2022.

Enhanced low-energy magnetic excitations evidencing the Cu-induced localization in an Fe-based superconductor Fe$_{0.98}$Te$_{0.5}$Se$_{0.5}$

Authors: Jinghui Wang, Song Bao, Yanyan Shangguan, Zhengwei Cai, Yuan Gan, Shichao Li, Kejing Ran, Zhen Ma, B. L. Winn, A. D. Christianson, Ruidan Zhong, Jun Li, Genda Gu, Jinsheng Wen

Abstract: We have performed inelastic neutron scattering measurements on optimally-doped Fe$_{0.98}$Te$_{0.5}$Se$_{0.5}$ and 10% Cu-doped Fe$_{0.88}$Cu$_{0.1}$Te$_{0.5}$Se$_{0.5}$ to investigate the substitution effects on the spin excitations in the whole energy range up to 300 meV. It is found that substitution of Cu for Fe enhances the low-energy spin excitations ($\le$ 100 meV), especially around the (0… ▽ More We have performed inelastic neutron scattering measurements on optimally-doped Fe$_{0.98}$Te$_{0.5}$Se$_{0.5}$ and 10% Cu-doped Fe$_{0.88}$Cu$_{0.1}$Te$_{0.5}$Se$_{0.5}$ to investigate the substitution effects on the spin excitations in the whole energy range up to 300 meV. It is found that substitution of Cu for Fe enhances the low-energy spin excitations ($\le$ 100 meV), especially around the (0.5, 0.5) point, and leaves the high-energy magnetic excitations intact. In contrast to the expectation that Cu with spin 1/2 will dilute the magnetic moments contributed by Fe with a larger spin, we find that the 10% Cu doping enlarges the effective fluctuating moment from 2.85 to 3.13 $μ_{\rm B}$/Fe, although there is no long- or short-range magnetic order around (0.5, 0.5) and (0.5, 0). The presence of enhanced magnetic excitations in the 10% Cu doped sample which is in the insulating state indicates that the magnetic excitations must have some contributions from the local moments, reflecting the dual nature of the magnetism in iron-based superconductors. We attribute the substitution effects to the localization of the itinerant electrons induced by Cu dopants. These results also indicate that the Cu doping does not act as electron donor as in a rigid-band shift model, but more as scattering centers that localize the system. △ Less

Submitted 24 June, 2022; originally announced June 2022.

Comments: Published in PRB, 8 pages, 3 figures

Journal ref: Phys. Rev. B 105, 245129 (2022)

Optimizing Two-way Partial AUC with an End-to-end Framework

Authors: Zhiyong Yang, Qianqian Xu, Shilong Bao, Yuan He, Xiaochun Cao, Qingming Huang

Abstract: The Area Under the ROC Curve (AUC) is a crucial metric for machine learning, which evaluates the average performance over all possible True Positive Rates (TPRs) and False Positive Rates (FPRs). Based on the knowledge that a skillful classifier should simultaneously embrace a high TPR and a low FPR, we turn to study a more general variant called Two-way Partial AUC (TPAUC), where only the region w… ▽ More The Area Under the ROC Curve (AUC) is a crucial metric for machine learning, which evaluates the average performance over all possible True Positive Rates (TPRs) and False Positive Rates (FPRs). Based on the knowledge that a skillful classifier should simultaneously embrace a high TPR and a low FPR, we turn to study a more general variant called Two-way Partial AUC (TPAUC), where only the region with $\mathsf{TPR} \ge α, \mathsf{FPR} \le β$ is included in the area. Moreover, recent work shows that the TPAUC is essentially inconsistent with the existing Partial AUC metrics where only the FPR range is restricted, opening a new problem to seek solutions to leverage high TPAUC. Motivated by this, we present the first trial in this paper to optimize this new metric. The critical challenge along this course lies in the difficulty of performing gradient-based optimization with end-to-end stochastic training, even with a proper choice of surrogate loss. To address this issue, we propose a generic framework to construct surrogate optimization problems, which supports efficient end-to-end training with deep learning. Moreover, our theoretical analyses show that: 1) the objective function of the surrogate problems will achieve an upper bound of the original problem under mild conditions, and 2) optimizing the surrogate problems leads to good generalization performance in terms of TPAUC with a high probability. Finally, empirical studies over several benchmark datasets speak to the efficacy of our framework. △ Less

Submitted 23 June, 2022; originally announced June 2022.

Rethinking Collaborative Metric Learning: Toward an Efficient Alternative without Negative Sampling

Authors: Shilong Bao, Qianqian Xu, Zhiyong Yang, Xiaochun Cao, Qingming Huang

Abstract: The recently proposed Collaborative Metric Learning (CML) paradigm has aroused wide interest in the area of recommendation systems (RS) owing to its simplicity and effectiveness. Typically, the existing literature of CML depends largely on the \textit{negative sampling} strategy to alleviate the time-consuming burden of pairwise computation. However, in this work, by taking a theoretical analysis,… ▽ More The recently proposed Collaborative Metric Learning (CML) paradigm has aroused wide interest in the area of recommendation systems (RS) owing to its simplicity and effectiveness. Typically, the existing literature of CML depends largely on the \textit{negative sampling} strategy to alleviate the time-consuming burden of pairwise computation. However, in this work, by taking a theoretical analysis, we find that negative sampling would lead to a biased estimation of the generalization error. Specifically, we show that the sampling-based CML would introduce a bias term in the generalization bound, which is quantified by the per-user \textit{Total Variance} (TV) between the distribution induced by negative sampling and the ground truth distribution. This suggests that optimizing the sampling-based CML loss function does not ensure a small generalization error even with sufficiently large training data. Moreover, we show that the bias term will vanish without the negative sampling strategy. Motivated by this, we propose an efficient alternative without negative sampling for CML named \textit{Sampling-Free Collaborative Metric Learning} (SFCML), to get rid of the sampling bias in a practical sense. Finally, comprehensive experiments over seven benchmark datasets speak to the superiority of the proposed algorithm. △ Less

Submitted 23 June, 2022; originally announced June 2022.

PolyU-BPCoMa: A Dataset and Benchmark Towards Mobile Colorized Mapping Using a Backpack Multisensorial System

Authors: Wenzhong Shi, Pengxin Chen, Muyang Wang, Sheng Bao, Haodong Xiang, Yue Yu, Daping Yang

Abstract: Constructing colorized point clouds from mobile laser scanning and images is a fundamental work in surveying and mapping. It is also an essential prerequisite for building digital twins for smart cities. However, existing public datasets are either in relatively small scales or lack accurate geometrical and color ground truth. This paper documents a multisensorial dataset named PolyU-BPCoMA which… ▽ More Constructing colorized point clouds from mobile laser scanning and images is a fundamental work in surveying and mapping. It is also an essential prerequisite for building digital twins for smart cities. However, existing public datasets are either in relatively small scales or lack accurate geometrical and color ground truth. This paper documents a multisensorial dataset named PolyU-BPCoMA which is distinctively positioned towards mobile colorized mapping. The dataset incorporates resources of 3D LiDAR, spherical imaging, GNSS and IMU on a backpack platform. Color checker boards are pasted in each surveyed area as targets and ground truth data are collected by an advanced terrestrial laser scanner (TLS). 3D geometrical and color information can be recovered in the colorized point clouds produced by the backpack system and the TLS, respectively. Accordingly, we provide an opportunity to benchmark the mapping and colorization accuracy simultaneously for a mobile multisensorial system. The dataset is approximately 800 GB in size covering both indoor and outdoor environments. The dataset and development kits are available at https://github.com/chenpengxin/PolyU-BPCoMa.git. △ Less

Submitted 16 August, 2022; v1 submitted 15 June, 2022; originally announced June 2022.

Comments: 11 pages

Noise subtraction from KAGRA O3GK data using Independent Component Analysis

Authors: KAGRA collaboration, H. Abe, T. Akutsu, M. Ando, A. Araya, N. Aritomi, H. Asada, Y. Aso, S. Bae, Y. Bae, R. Bajpai, K. Cannon, Z. Cao, E. Capocasa, M. Chan, C. Chen, D. Chen, K. Chen, Y. Chen, C-Y. Chiang, Y-K. Chu, S. Eguchi, M. Eisenmann, Y. Enomoto, R. Flaminio , et al. (178 additional authors not shown)

Abstract: In April 2020, KAGRA conducted its first science observation in combination with the GEO~600 detector (O3GK) for two weeks. According to the noise budget estimation, suspension control noise in the low frequency band and acoustic noise in the middle frequency band are identified as the dominant contribution. In this study, we show that such noise can be reduced in offline data analysis by utilizin… ▽ More In April 2020, KAGRA conducted its first science observation in combination with the GEO~600 detector (O3GK) for two weeks. According to the noise budget estimation, suspension control noise in the low frequency band and acoustic noise in the middle frequency band are identified as the dominant contribution. In this study, we show that such noise can be reduced in offline data analysis by utilizing a method called Independent Component Analysis (ICA). Here the ICA model is extended from the one studied in iKAGRA data analysis by incorporating frequency dependence while linearity and stationarity of the couplings are still assumed. By using optimal witness sensors, those two dominant contributions are mitigated in the real observational data. We also analyze the stability of the transfer functions for whole two weeks data in order to investigate how the current subtraction method can be practically used in gravitational wave search. △ Less

Submitted 12 June, 2022; originally announced June 2022.

Comments: 26 pages, 10 figures

Report number: JGW-P2214018, RESCEU-5/22

Boiling and cavitation caused by transient heat transfer in superfluid helium-4

Authors: Hamid Sanavandi, Mikai Hulse, Shiran Bao, Yuan Tang, Wei Guo

Abstract: Superfluid helium-4 (He II) has been widely utilized as a coolant in various scientific and engineering applications due to its superior heat transfer capability. An important parameter required in the design of many He II based cooling systems is the peak heat flux $q^*$, which refers to the threshold heat flux above which boiling spontaneously occurs in He II. Past experimental and numerical stu… ▽ More Superfluid helium-4 (He II) has been widely utilized as a coolant in various scientific and engineering applications due to its superior heat transfer capability. An important parameter required in the design of many He II based cooling systems is the peak heat flux $q^*$, which refers to the threshold heat flux above which boiling spontaneously occurs in He II. Past experimental and numerical studies showed that $q^*$ increases when the heating time $t_h$ is reduced, which leads to an intuitive expectation that very high $q^*$ may be achievable at sufficiently small $t_h$. Knowledge on how $q^*$ actually behaves at small $t_h$ is important for applications such as laser ablation in He II. Here we present a numerical study on the evolution of the thermodynamic state of the He II in front of a planar heater by solving the He II two-fluid equations of motion. For an applied heat flux, we determine the heating time beyond which the He II near the heater transits to the vapor phase. As such, a curve correlating $q^*$ and $t_h$ can be obtained, which nicely reproduces some relevant experimental data. Surprisingly, we find that there exists a critical peak heat flux $q^*_c$, above which boiling occurs nearly instantaneously regardless of $t_h$. We reveal that the boiling in this regime is essentially cavitation caused by the combined effects of the first-sound and the second-sound waves in He II. Based on this physical picture, an analytical model for $q^*_c$ is developed, which reproduces the simulated $q^*_c$ values at various He II bath temperatures and hydrostatic head pressures. This work represents a major progress in our understanding of transient heat transfer in He II. △ Less

Submitted 11 June, 2022; originally announced June 2022.

Comments: 8 pages, 7 figures