Showing 251–300 of 622 results for author: Bao, H

Wall Modeling of Turbulent Flows with Varying Pressure Gradients Using Multi-Agent Reinforcement Learning

Authors: Di Zhou, H. Jane Bae

Abstract: We propose a framework for developing wall models for large-eddy simulation that is able to capture pressure-gradient effects using multi-agent reinforcement learning. Within this framework, the distributed reinforcement learning agents receive off-wall environmental states including pressure gradient and turbulence strain rate, ensuring adaptability to a wide range of flows characterized by press… ▽ More We propose a framework for developing wall models for large-eddy simulation that is able to capture pressure-gradient effects using multi-agent reinforcement learning. Within this framework, the distributed reinforcement learning agents receive off-wall environmental states including pressure gradient and turbulence strain rate, ensuring adaptability to a wide range of flows characterized by pressure-gradient effects and separations. Based on these states, the agents determine an action to adjust the wall eddy viscosity, and consequently the wall-shear stress. The model training is in situ with wall-modeled large-eddy simulation grid resolutions and does not rely on the instantaneous velocity fields from high-fidelity simulations. Throughout the training, the agents compute rewards from the relative error in the estimated wall-shear stress, which allows the agents to refine an optimal control policy that minimizes prediction errors. Employing this framework, wall models are trained for two distinct subgrid-scale models using low-Reynolds-number flow over periodic hills. These models are validated through simulations of flows over periodic hills at higher Reynolds numbers and flow over the Boeing Gaussian bump. The developed wall models successfully capture the acceleration and deceleration of wall-bounded turbulent flows under pressure gradients and outperform the equilibrium wall model in predicting skin friction. △ Less

Submitted 25 July, 2024; v1 submitted 4 May, 2023; originally announced May 2023.

Comments: arXiv admin note: substantial text overlap with arXiv:2211.16427

Observation of ${B\to D^{(*)} K^- K^{0}_S}$ decays using the 2019-2022 Belle II data sample

Authors: Belle II Collaboration, F. Abudinén, I. Adachi, K. Adamczyk, L. Aggarwal, P. Ahlburg, H. Ahmed, J. K. Ahn, H. Aihara, N. Akopov, A. Aloisio, L. Andricek, N. Anh Ky, D. M. Asner, H. Atmacan, V. Aulchenko, T. Aushev, V. Aushev, M. Aversano, V. Babu, S. Bacher, H. Bae, S. Bahinipati, A. M. Bakich, P. Bambade , et al. (555 additional authors not shown)

Abstract: We present a measurement of the branching fractions of four $B^{0,-}\to D^{(*)+,0} K^- K^{0}_S$ decay modes. The measurement is based on data from SuperKEKB electron-positron collisions at the $Υ(4S)$ resonance collected with the Belle II detector and corresponding to an integrated luminosity of ${362~\text{fb}^{-1}}$. The event yields are extracted from fits to the distributions of the difference… ▽ More We present a measurement of the branching fractions of four $B^{0,-}\to D^{(*)+,0} K^- K^{0}_S$ decay modes. The measurement is based on data from SuperKEKB electron-positron collisions at the $Υ(4S)$ resonance collected with the Belle II detector and corresponding to an integrated luminosity of ${362~\text{fb}^{-1}}$. The event yields are extracted from fits to the distributions of the difference between expected and observed $B$ meson energy to separate signal and background, and are efficiency-corrected as a function of the invariant mass of the $K^-K_S^0$ system. We find the branching fractions to be: \[ \text{B}(B^-\to D^0K^-K_S^0)=(1.89\pm 0.16\pm 0.10)\times 10^{-4}, \] \[ \text{B}(\overline B{}^0\to D^+K^-K_S^0)=(0.85\pm 0.11\pm 0.05)\times 10^{-4},\] \[ \text{B}(B^-\to D^{*0}K^-K_S^0)=(1.57\pm 0.27\pm 0.12)\times 10^{-4}, \] \[ \text{B}(\overline B{}^0\to D^{*+}K^-K_S^0)=(0.96\pm 0.18\pm 0.06)\times 10^{-4},\] where the first uncertainty is statistical and the second systematic. These results include the first observation of $\overline B{}^0\to D^+K^-K_S^0$, $B^-\to D^{*0}K^-K_S^0$, and $\overline B{}^0\to D^{*+}K^-K_S^0$ decays and a significant improvement in the precision of $\text{B}(B^-\to D^0K^-K_S^0)$ compared to previous measurements. △ Less

Submitted 2 May, 2023; originally announced May 2023.

Report number: BELLE2-CONF-2023-003

A Two-part Transformer Network for Controllable Motion Synthesis

Authors: Shuaiying Hou, Hongyu Tao, Hujun Bao, Weiwei Xu

Abstract: Although part-based motion synthesis networks have been investigated to reduce the complexity of modeling heterogeneous human motions, their computational cost remains prohibitive in interactive applications. To this end, we propose a novel two-part transformer network that aims to achieve high-quality, controllable motion synthesis results in real-time. Our network separates the skeleton into the… ▽ More Although part-based motion synthesis networks have been investigated to reduce the complexity of modeling heterogeneous human motions, their computational cost remains prohibitive in interactive applications. To this end, we propose a novel two-part transformer network that aims to achieve high-quality, controllable motion synthesis results in real-time. Our network separates the skeleton into the upper and lower body parts, reducing the expensive cross-part fusion operations, and models the motions of each part separately through two streams of auto-regressive modules formed by multi-head attention layers. However, such a design might not sufficiently capture the correlations between the parts. We thus intentionally let the two parts share the features of the root joint and design a consistency loss to penalize the difference in the estimated root features and motions by these two auto-regressive modules, significantly improving the quality of synthesized motions. After training on our motion dataset, our network can synthesize a wide range of heterogeneous motions, like cartwheels and twists. Experimental and user study results demonstrate that our network is superior to state-of-the-art human motion synthesis networks in the quality of generated motions. △ Less

Submitted 19 June, 2023; v1 submitted 25 April, 2023; originally announced April 2023.

Comments: 16 pages, 26 figures

Journal ref: IEEE Transactions on Visualization and Computer Graphics 2023

Mathematical modeling of trend cycle: Fad, Fashion and Classic

Authors: Hyeong-Ohk Bae, Seung Yeon Cho, Jane Yoo, Seok-Bae Yun

Abstract: In this work, we suggest a system of differential equations that quantitatively models the formulation and evolution of a trend cycle through the consideration of underlying dynamics between the trend participants. Our model captures the five stages of a trend cycle, namely, the onset, rise, peak, decline, and obsolescence. It also provides a unified mathematical criterion/condition to characteriz… ▽ More In this work, we suggest a system of differential equations that quantitatively models the formulation and evolution of a trend cycle through the consideration of underlying dynamics between the trend participants. Our model captures the five stages of a trend cycle, namely, the onset, rise, peak, decline, and obsolescence. It also provides a unified mathematical criterion/condition to characterize the fad, fashion and classic. We prove that the solution of our model can capture various trend cycles. Numerical simulations are provided to show the expressive power of our model. △ Less

Submitted 20 April, 2023; originally announced April 2023.

DeePMD-kit v2: A software package for Deep Potential models

Authors: Jinzhe Zeng, Duo Zhang, Denghui Lu, Pinghui Mo, Zeyu Li, Yixiao Chen, Marián Rynik, Li'ang Huang, Ziyao Li, Shaochen Shi, Yingze Wang, Haotian Ye, Ping Tuo, Jiabin Yang, Ye Ding, Yifan Li, Davide Tisi, Qiyu Zeng, Han Bao, Yu Xia, Jiameng Huang, Koki Muraoka, Yibo Wang, Junhan Chang, Fengbo Yuan , et al. (22 additional authors not shown)

Abstract: DeePMD-kit is a powerful open-source software package that facilitates molecular dynamics simulations using machine learning potentials (MLP) known as Deep Potential (DP) models. This package, which was released in 2017, has been widely used in the fields of physics, chemistry, biology, and material science for studying atomistic systems. The current version of DeePMD-kit offers numerous advanced… ▽ More DeePMD-kit is a powerful open-source software package that facilitates molecular dynamics simulations using machine learning potentials (MLP) known as Deep Potential (DP) models. This package, which was released in 2017, has been widely used in the fields of physics, chemistry, biology, and material science for studying atomistic systems. The current version of DeePMD-kit offers numerous advanced features such as DeepPot-SE, attention-based and hybrid descriptors, the ability to fit tensile properties, type embedding, model deviation, Deep Potential - Range Correction (DPRc), Deep Potential Long Range (DPLR), GPU support for customized operators, model compression, non-von Neumann molecular dynamics (NVNMD), and improved usability, including documentation, compiled binary packages, graphical user interfaces (GUI), and application programming interfaces (API). This article presents an overview of the current major version of the DeePMD-kit package, highlighting its features and technical details. Additionally, the article benchmarks the accuracy and efficiency of different models and discusses ongoing developments. △ Less

Submitted 18 April, 2023; originally announced April 2023.

Comments: 51 pages, 2 figures

ACM Class: J.2

Journal ref: J. Chem. Phys. 159, 054801 (2023)

Electrical transport properties driven by unique bonding configuration in gamma-GeSe

Authors: Jeongsu Jang, Joonho Kim, Dongchul Sung, Jong Hyuk Kim, Joong-Eon Jung, Sol Lee, Jinsub Park, Chaewoon Lee, Heesun Bae, Seongil Im, Kibog Park, Young Jai Choi, Suklyun Hong, Kwanpyo Kim

Abstract: Group-IV monochalcogenides have recently shown great potential for their thermoelectric, ferroelectric, and other intriguing properties. The electrical properties of group-IV monochalcogenides exhibit a strong dependence on the chalcogen type. For example, GeTe exhibits high doping concentration, whereas S/Se-based chalcogenides are semiconductors with sizable bandgaps. Here, we investigate the el… ▽ More Group-IV monochalcogenides have recently shown great potential for their thermoelectric, ferroelectric, and other intriguing properties. The electrical properties of group-IV monochalcogenides exhibit a strong dependence on the chalcogen type. For example, GeTe exhibits high doping concentration, whereas S/Se-based chalcogenides are semiconductors with sizable bandgaps. Here, we investigate the electrical and thermoelectric properties of gamma-GeSe, a recently identified polymorph of GeSe. gamma-GeSe exhibits high electrical conductivity (~106 S/m) and a relatively low Seebeck coefficient (9.4 uV/K at room temperature) owing to its high p-doping level (5x1021 cm-3), which is in stark contrast to other known GeSe polymorphs. Elemental analysis and first-principles calculations confirm that the abundant formation of Ge vacancies leads to the high p-doping concentration. The magnetoresistance measurements also reveal weak-antilocalization because of spin-orbit coupling in the crystal. Our results demonstrate that gamma-GeSe is a unique polymorph in which the modified local bonding configuration leads to substantially different physical properties. △ Less

Submitted 14 April, 2023; originally announced April 2023.

Representing Volumetric Videos as Dynamic MLP Maps

Authors: Sida Peng, Yunzhi Yan, Qing Shuai, Hujun Bao, Xiaowei Zhou

Abstract: This paper introduces a novel representation of volumetric videos for real-time view synthesis of dynamic scenes. Recent advances in neural scene representations demonstrate their remarkable capability to model and render complex static scenes, but extending them to represent dynamic scenes is not straightforward due to their slow rendering speed or high storage cost. To solve this problem, our ke… ▽ More This paper introduces a novel representation of volumetric videos for real-time view synthesis of dynamic scenes. Recent advances in neural scene representations demonstrate their remarkable capability to model and render complex static scenes, but extending them to represent dynamic scenes is not straightforward due to their slow rendering speed or high storage cost. To solve this problem, our key idea is to represent the radiance field of each frame as a set of shallow MLP networks whose parameters are stored in 2D grids, called MLP maps, and dynamically predicted by a 2D CNN decoder shared by all frames. Representing 3D scenes with shallow MLPs significantly improves the rendering speed, while dynamically predicting MLP parameters with a shared 2D CNN instead of explicitly storing them leads to low storage cost. Experiments show that the proposed approach achieves state-of-the-art rendering quality on the NHR and ZJU-MoCap datasets, while being efficient for real-time rendering with a speed of 41.7 fps for $512 \times 512$ images on an RTX 3090 GPU. The code is available at https://zju3dv.github.io/mlp_maps/. △ Less

Submitted 13 April, 2023; originally announced April 2023.

Comments: Accepted to CVPR 2023. The first two authors contributed equally to this paper. Project page: https://zju3dv.github.io/mlp_maps/

Do "bad" citations have "good" effects?

Authors: Honglin Bao, Misha Teplitskiy

Abstract: The scientific community discourages authors of research papers from citing papers that did not influence them. Such "rhetorical" citations are assumed to degrade the literature and incentives for good work. While a world where authors cite only substantively appears attractive, we argue that mandating substantive citing may have underappreciated consequences on the allocation of attention and dyn… ▽ More The scientific community discourages authors of research papers from citing papers that did not influence them. Such "rhetorical" citations are assumed to degrade the literature and incentives for good work. While a world where authors cite only substantively appears attractive, we argue that mandating substantive citing may have underappreciated consequences on the allocation of attention and dynamism in scientific literatures. We develop a novel agent-based model in which agents cite substantively and rhetorically. Agents first select papers to read based on their expected quality, read them and observe their actual quality, become influenced by those that are sufficiently good, and substantively cite them. Next, agents fill any remaining slots in the reference lists by (rhetorically) citing papers that support their narrative, regardless of whether they were actually influential. By turning rhetorical citing on-and-off, we find that rhetorical citing increases the correlation between quality and citations, increases citation churn, and reduces citation inequality. This occurs because rhetorical citing redistributes some citations from a stable set of elite-quality papers to a more dynamic set with high-to-moderate quality and high rhetorical value. Increasing the size of reference lists, often seen as an undesirable trend, amplifies the effects. In sum, rhetorical citing helps deconcentrate attention and makes it easier to displace incumbent ideas, so whether it is indeed undesirable depends on the metrics used to judge desirability. △ Less

Submitted 16 April, 2023; v1 submitted 12 April, 2023; originally announced April 2023.

Comments: Main: 28 pages, one table, 5 figures; Appendix: 11 pages, 13 figures

BEVStereo++: Accurate Depth Estimation in Multi-view 3D Object Detection via Dynamic Temporal Stereo

Authors: Yinhao Li, Jinrong Yang, Jianjian Sun, Han Bao, Zheng Ge, Li Xiao

Abstract: Bounded by the inherent ambiguity of depth perception, contemporary multi-view 3D object detection methods fall into the performance bottleneck. Intuitively, leveraging temporal multi-view stereo (MVS) technology is the natural knowledge for tackling this ambiguity. However, traditional attempts of MVS has two limitations when applying to 3D object detection scenes: 1) The affinity measurement amo… ▽ More Bounded by the inherent ambiguity of depth perception, contemporary multi-view 3D object detection methods fall into the performance bottleneck. Intuitively, leveraging temporal multi-view stereo (MVS) technology is the natural knowledge for tackling this ambiguity. However, traditional attempts of MVS has two limitations when applying to 3D object detection scenes: 1) The affinity measurement among all views suffers expensive computational cost; 2) It is difficult to deal with outdoor scenarios where objects are often mobile. To this end, we propose BEVStereo++: by introducing a dynamic temporal stereo strategy, BEVStereo++ is able to cut down the harm that is brought by introducing temporal stereo when dealing with those two scenarios. Going one step further, we apply Motion Compensation Module and long sequence Frame Fusion to BEVStereo++, which shows further performance boosting and error reduction. Without bells and whistles, BEVStereo++ achieves state-of-the-art(SOTA) on both Waymo and nuScenes dataset. △ Less

Submitted 9 April, 2023; originally announced April 2023.

Calabi-Yau structures on Rabinowitz Fukaya categories

Authors: Hanwool Bae, Wonbo Jeong, Jongmyeong Kim

Abstract: In this paper, we prove that the derived Rabinowitz Fukaya category of a Liouville domain $M$ of dimension $2n$ is $(n-1)$-Calabi--Yau assuming the wrapped Fukaya category of $M$ admits an at most countable set of Lagrangians that generate it and satisfy some finiteness condition on morphism spaces between them. In this paper, we prove that the derived Rabinowitz Fukaya category of a Liouville domain $M$ of dimension $2n$ is $(n-1)$-Calabi--Yau assuming the wrapped Fukaya category of $M$ admits an at most countable set of Lagrangians that generate it and satisfy some finiteness condition on morphism spaces between them. △ Less

Submitted 1 September, 2024; v1 submitted 5 April, 2023; originally announced April 2023.

Comments: 39 pages, 4 figures, accepted for publication by the Journal of Topology

MSC Class: 53D37; 53D40; 18G70

Novel method for the identification of the production flavor of neutral charmed mesons

Authors: Belle II Collaboration, I. Adachi, L. Aggarwal, H. Ahmed, H. Aihara, N. Akopov, A. Aloisio, N. Anh Ky, D. M. Asner, H. Atmacan, T. Aushev, V. Aushev, M. Aversano, V. Babu, H. Bae, S. Bahinipati, P. Bambade, Sw. Banerjee, M. Barrett, J. Baudot, M. Bauer, A. Baur, A. Beaubien, J. Becker, P. K. Behera , et al. (374 additional authors not shown)

Abstract: We propose a new algorithm for the identification of the production flavor of neutral $D$ mesons in the Belle II experiment. The algorithm exploits the correlation between the flavor of a reconstructed neutral $D$ meson (signal $D$ meson) and the electric charges of particles reconstructed in the rest of the $e^+e^-\to c \bar{c}$ event. These include those originating from the decay of the other c… ▽ More We propose a new algorithm for the identification of the production flavor of neutral $D$ mesons in the Belle II experiment. The algorithm exploits the correlation between the flavor of a reconstructed neutral $D$ meson (signal $D$ meson) and the electric charges of particles reconstructed in the rest of the $e^+e^-\to c \bar{c}$ event. These include those originating from the decay of the other charm hadron produced in the event, as well as those possibly produced in association with the signal $D$ meson. We develop the algorithm using simulation and calibrate it in data using decay modes that identify the flavor of the decaying neutral $D$ meson. We use a data sample of $e^+e^-$ collisions, corresponding to $362\,\mathrm{fb}^{-1}$ of integrated luminosity, collected by Belle II at center-of-mass energies near the $Υ(4S)$ mass. The effective tagging efficiency in data is $(47.91 \pm 0.07 \mathrm{(stat)} \pm 0.51 \mathrm{(syst)})\%$, independent of the neutral-$D$-meson decay mode. This charm flavor tagger will approximately double the effective sample size of many $CP$-violation and charm-mixing measurements that so far have exclusively relied on neutral $D$ mesons originating from $D^{*\pm}$ decays. While developed for Belle II, the basic principles underlying the charm flavor tagger can be used in other experiments, including those at hadron colliders. △ Less

Submitted 6 April, 2023; v1 submitted 4 April, 2023; originally announced April 2023.

Report number: Belle II Preprint 2023-005, KEK Preprint 2023-1

Journal ref: Phys. Rev. D 107, 112010 (2023)

ProductAE: Toward Deep Learning Driven Error-Correction Codes of Large Dimensions

Authors: Mohammad Vahid Jamali, Hamid Saber, Homayoon Hatami, Jung Hyun Bae

Abstract: While decades of theoretical research have led to the invention of several classes of error-correction codes, the design of such codes is an extremely challenging task, mostly driven by human ingenuity. Recent studies demonstrate that such designs can be effectively automated and accelerated via tools from machine learning (ML), thus enabling ML-driven classes of error-correction codes with promis… ▽ More While decades of theoretical research have led to the invention of several classes of error-correction codes, the design of such codes is an extremely challenging task, mostly driven by human ingenuity. Recent studies demonstrate that such designs can be effectively automated and accelerated via tools from machine learning (ML), thus enabling ML-driven classes of error-correction codes with promising performance gains compared to classical designs. A fundamental challenge, however, is that it is prohibitively complex, if not impossible, to design and train fully ML-driven encoder and decoder pairs for large code dimensions. In this paper, we propose Product Autoencoder (ProductAE) -- a computationally-efficient family of deep learning driven (encoder, decoder) pairs -- aimed at enabling the training of relatively large codes (both encoder and decoder) with a manageable training complexity. We build upon ideas from classical product codes and propose constructing large neural codes using smaller code components. ProductAE boils down the complex problem of training the encoder and decoder for a large code dimension $k$ and blocklength $n$ to less-complex sub-problems of training encoders and decoders for smaller dimensions and blocklengths. Our training results show successful training of ProductAEs of dimensions as large as $k = 300$ bits with meaningful performance gains compared to state-of-the-art classical and neural designs. Moreover, we demonstrate excellent robustness and adaptivity of ProductAEs to channel models different than the ones used for training. △ Less

Submitted 18 August, 2024; v1 submitted 28 March, 2023; originally announced March 2023.

Comments: arXiv admin note: text overlap with arXiv:2110.04466

CF-Font: Content Fusion for Few-shot Font Generation

Authors: Chi Wang, Min Zhou, Tiezheng Ge, Yuning Jiang, Hujun Bao, Weiwei Xu

Abstract: Content and style disentanglement is an effective way to achieve few-shot font generation. It allows to transfer the style of the font image in a source domain to the style defined with a few reference images in a target domain. However, the content feature extracted using a representative font might not be optimal. In light of this, we propose a content fusion module (CFM) to project the content… ▽ More Content and style disentanglement is an effective way to achieve few-shot font generation. It allows to transfer the style of the font image in a source domain to the style defined with a few reference images in a target domain. However, the content feature extracted using a representative font might not be optimal. In light of this, we propose a content fusion module (CFM) to project the content feature into a linear space defined by the content features of basis fonts, which can take the variation of content features caused by different fonts into consideration. Our method also allows to optimize the style representation vector of reference images through a lightweight iterative style-vector refinement (ISR) strategy. Moreover, we treat the 1D projection of a character image as a probability distribution and leverage the distance between two distributions as the reconstruction loss (namely projected character loss, PCL). Compared to L2 or L1 reconstruction loss, the distribution distance pays more attention to the global shape of characters. We have evaluated our method on a dataset of 300 fonts with 6.5k characters each. Experimental results verify that our method outperforms existing state-of-the-art few-shot font generation methods by a large margin. The source code can be found at https://github.com/wangchi95/CF-Font. △ Less

Submitted 15 April, 2024; v1 submitted 24 March, 2023; originally announced March 2023.

Comments: Accepted by CVPR 2023

SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Field

Authors: Chong Bao, Yinda Zhang, Bangbang Yang, Tianxing Fan, Zesong Yang, Hujun Bao, Guofeng Zhang, Zhaopeng Cui

Abstract: Despite the great success in 2D editing using user-friendly tools, such as Photoshop, semantic strokes, or even text prompts, similar capabilities in 3D areas are still limited, either relying on 3D modeling skills or allowing editing within only a few categories. In this paper, we present a novel semantic-driven NeRF editing approach, which enables users to edit a neural radiance field with a sin… ▽ More Despite the great success in 2D editing using user-friendly tools, such as Photoshop, semantic strokes, or even text prompts, similar capabilities in 3D areas are still limited, either relying on 3D modeling skills or allowing editing within only a few categories. In this paper, we present a novel semantic-driven NeRF editing approach, which enables users to edit a neural radiance field with a single image, and faithfully delivers edited novel views with high fidelity and multi-view consistency. To achieve this goal, we propose a prior-guided editing field to encode fine-grained geometric and texture editing in 3D space, and develop a series of techniques to aid the editing process, including cyclic constraints with a proxy mesh to facilitate geometric supervision, a color compositing mechanism to stabilize semantic-driven texture editing, and a feature-cluster-based regularization to preserve the irrelevant content unchanged. Extensive experiments and editing examples on both real-world and synthetic data demonstrate that our method achieves photo-realistic 3D editing using only a single edited image, pushing the bound of semantic-driven editing in 3D real-world scenes. Our project webpage: https://zju3dv.github.io/sine/. △ Less

Submitted 25 March, 2023; v1 submitted 23 March, 2023; originally announced March 2023.

Comments: Accepted to CVPR 2023. Project Page: https://zju3dv.github.io/sine/

GPT-4 Technical Report

Authors: OpenAI, Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, Red Avila, Igor Babuschkin, Suchir Balaji, Valerie Balcom, Paul Baltescu, Haiming Bao, Mohammad Bavarian, Jeff Belgum, Irwan Bello, Jake Berdine, Gabriel Bernadett-Shapiro, Christopher Berner, Lenny Bogdonoff, Oleg Boiko , et al. (256 additional authors not shown)

Abstract: We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs. While less capable than humans in many real-world scenarios, GPT-4 exhibits human-level performance on various professional and academic benchmarks, including passing a simulated bar exam with a score around the top 10% of test takers. GPT-4 is a Transformer-based mo… ▽ More We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs. While less capable than humans in many real-world scenarios, GPT-4 exhibits human-level performance on various professional and academic benchmarks, including passing a simulated bar exam with a score around the top 10% of test takers. GPT-4 is a Transformer-based model pre-trained to predict the next token in a document. The post-training alignment process results in improved performance on measures of factuality and adherence to desired behavior. A core component of this project was developing infrastructure and optimization methods that behave predictably across a wide range of scales. This allowed us to accurately predict some aspects of GPT-4's performance based on models trained with no more than 1/1,000th the compute of GPT-4. △ Less

Submitted 4 March, 2024; v1 submitted 15 March, 2023; originally announced March 2023.

Comments: 100 pages; updated authors list; fixed author names and added citation

Descriptor Distillation for Efficient Multi-Robot SLAM

Authors: Xiyue Guo, Junjie Hu, Hujun Bao, Guofeng Zhang

Abstract: Performing accurate localization while maintaining the low-level communication bandwidth is an essential challenge of multi-robot simultaneous localization and mapping (MR-SLAM). In this paper, we tackle this problem by generating a compact yet discriminative feature descriptor with minimum inference time. We propose descriptor distillation that formulates the descriptor generation into a learning… ▽ More Performing accurate localization while maintaining the low-level communication bandwidth is an essential challenge of multi-robot simultaneous localization and mapping (MR-SLAM). In this paper, we tackle this problem by generating a compact yet discriminative feature descriptor with minimum inference time. We propose descriptor distillation that formulates the descriptor generation into a learning problem under the teacher-student framework. To achieve real-time descriptor generation, we design a compact student network and learn it by transferring the knowledge from a pre-trained large teacher model. To reduce the descriptor dimensions from the teacher to the student, we propose a novel loss function that enables the knowledge transfer between two different dimensional descriptors. The experimental results demonstrate that our model is 30% lighter than the state-of-the-art model and produces better descriptors in patch matching. Moreover, we build a MR-SLAM system based on the proposed method and show that our descriptor distillation can achieve higher localization performance for MR-SLAM with lower bandwidth. △ Less

Submitted 15 March, 2023; originally announced March 2023.

Measurement of the branching fraction and $\it CP$ asymmetry of $B^{0} \rightarrow π^{0} π^{0}$ decays using $198 \times 10^6$ $B\overline{B}$ pairs in Belle II data

Authors: Belle II Collaboration, F. Abudinén, I. Adachi, K. Adamczyk, L. Aggarwal, H. Ahmed, H. Aihara, N. Akopov, A. Aloisio, N. Anh Ky, D. M. Asner, H. Atmacan, T. Aushev, V. Aushev, H. Bae, S. Bahinipati, P. Bambade, Sw. Banerjee, S. Bansal, M. Barrett, J. Baudot, M. Bauer, A. Baur, A. Beaubien, J. Becker , et al. (403 additional authors not shown)

Abstract: We report measurements of the branching fraction and $\it CP$ asymmetry in $B^{0} \to π^{0} π^{0}$ decays reconstructed at Belle II in an electron-positron collision sample containing $198 \times 10^{6}$ $B\overline{B}$ pairs. We measure a branching fraction $\mathcal{B}(\Bpipi) = (1.38 \pm 0.27 \pm 0.22) \times 10^{-6}$ and a $\it CP$ asymmetry $\Acp(\Bpipi) = 0.14 \pm 0.46 \pm 0.07$, where the f… ▽ More We report measurements of the branching fraction and $\it CP$ asymmetry in $B^{0} \to π^{0} π^{0}$ decays reconstructed at Belle II in an electron-positron collision sample containing $198 \times 10^{6}$ $B\overline{B}$ pairs. We measure a branching fraction $\mathcal{B}(\Bpipi) = (1.38 \pm 0.27 \pm 0.22) \times 10^{-6}$ and a $\it CP$ asymmetry $\Acp(\Bpipi) = 0.14 \pm 0.46 \pm 0.07$, where the first uncertainty is statistical and the second is systematic. △ Less

Submitted 25 May, 2023; v1 submitted 15 March, 2023; originally announced March 2023.

Report number: Belle II Preprint 2023-004, KEK Preprint 2022-59

BlinkFlow: A Dataset to Push the Limits of Event-based Optical Flow Estimation

Authors: Yijin Li, Zhaoyang Huang, Shuo Chen, Xiaoyu Shi, Hongsheng Li, Hujun Bao, Zhaopeng Cui, Guofeng Zhang

Abstract: Event cameras provide high temporal precision, low data rates, and high dynamic range visual perception, which are well-suited for optical flow estimation. While data-driven optical flow estimation has obtained great success in RGB cameras, its generalization performance is seriously hindered in event cameras mainly due to the limited and biased training data. In this paper, we present a novel sim… ▽ More Event cameras provide high temporal precision, low data rates, and high dynamic range visual perception, which are well-suited for optical flow estimation. While data-driven optical flow estimation has obtained great success in RGB cameras, its generalization performance is seriously hindered in event cameras mainly due to the limited and biased training data. In this paper, we present a novel simulator, BlinkSim, for the fast generation of large-scale data for event-based optical flow. BlinkSim consists of a configurable rendering engine and a flexible engine for event data simulation. By leveraging the wealth of current 3D assets, the rendering engine enables us to automatically build up thousands of scenes with different objects, textures, and motion patterns and render very high-frequency images for realistic event data simulation. Based on BlinkSim, we construct a large training dataset and evaluation benchmark BlinkFlow that contains sufficient, diversiform, and challenging event data with optical flow ground truth. Experiments show that BlinkFlow improves the generalization performance of state-of-the-art methods by more than 40% on average and up to 90%. Moreover, we further propose an Event optical Flow transFormer (E-FlowFormer) architecture. Powered by our BlinkFlow, E-FlowFormer outperforms the SOTA methods by up to 91% on MVSEC dataset and 14% on DSEC dataset and presents the best generalization performance. △ Less

Submitted 14 March, 2023; originally announced March 2023.

PATS: Patch Area Transportation with Subdivision for Local Feature Matching

Authors: Junjie Ni, Yijin Li, Zhaoyang Huang, Hongsheng Li, Hujun Bao, Zhaopeng Cui, Guofeng Zhang

Abstract: Local feature matching aims at establishing sparse correspondences between a pair of images. Recently, detector-free methods present generally better performance but are not satisfactory in image pairs with large scale differences. In this paper, we propose Patch Area Transportation with Subdivision (PATS) to tackle this issue. Instead of building an expensive image pyramid, we start by splitting… ▽ More Local feature matching aims at establishing sparse correspondences between a pair of images. Recently, detector-free methods present generally better performance but are not satisfactory in image pairs with large scale differences. In this paper, we propose Patch Area Transportation with Subdivision (PATS) to tackle this issue. Instead of building an expensive image pyramid, we start by splitting the original image pair into equal-sized patches and gradually resizing and subdividing them into smaller patches with the same scale. However, estimating scale differences between these patches is non-trivial since the scale differences are determined by both relative camera poses and scene structures, and thus spatially varying over image pairs. Moreover, it is hard to obtain the ground truth for real scenes. To this end, we propose patch area transportation, which enables learning scale differences in a self-supervised manner. In contrast to bipartite graph matching, which only handles one-to-one matching, our patch area transportation can deal with many-to-many relationships. PATS improves both matching accuracy and coverage, and shows superior performance in downstream tasks, such as relative pose estimation, visual localization, and optical flow estimation. The source code is available at \url{https://zju3dv.github.io/pats/}. △ Less

Submitted 23 January, 2024; v1 submitted 14 March, 2023; originally announced March 2023.

Comments: Accepted to CVPR 2023. Project page: https://zju3dv.github.io/pats

I$^2$-SDF: Intrinsic Indoor Scene Reconstruction and Editing via Raytracing in Neural SDFs

Authors: Jingsen Zhu, Yuchi Huo, Qi Ye, Fujun Luan, Jifan Li, Dianbing Xi, Lisha Wang, Rui Tang, Wei Hua, Hujun Bao, Rui Wang

Abstract: In this work, we present I$^2$-SDF, a new method for intrinsic indoor scene reconstruction and editing using differentiable Monte Carlo raytracing on neural signed distance fields (SDFs). Our holistic neural SDF-based framework jointly recovers the underlying shapes, incident radiance and materials from multi-view images. We introduce a novel bubble loss for fine-grained small objects and error-gu… ▽ More In this work, we present I$^2$-SDF, a new method for intrinsic indoor scene reconstruction and editing using differentiable Monte Carlo raytracing on neural signed distance fields (SDFs). Our holistic neural SDF-based framework jointly recovers the underlying shapes, incident radiance and materials from multi-view images. We introduce a novel bubble loss for fine-grained small objects and error-guided adaptive sampling scheme to largely improve the reconstruction quality on large-scale indoor scenes. Further, we propose to decompose the neural radiance field into spatially-varying material of the scene as a neural field through surface-based, differentiable Monte Carlo raytracing and emitter semantic segmentations, which enables physically based and photorealistic scene relighting and editing applications. Through a number of qualitative and quantitative experiments, we demonstrate the superior quality of our method on indoor scene reconstruction, novel view synthesis, and scene editing compared to state-of-the-art baselines. △ Less

Submitted 29 March, 2023; v1 submitted 14 March, 2023; originally announced March 2023.

Comments: Accepted by CVPR 2023, project page: https://jingsenzhu.github.io/i2-sdf

The Early Light Curve of a Type Ia Supernova 2021hpr in NGC 3147: Progenitor Constraints with the Companion Interaction Model

Authors: Gu Lim, Myungshin Im, Gregory S. H. Paek, Sung-Chul Yoon, Changsu Choi, Sophia Kim, J. Craig Wheeler, Benjamin P. Thomas, Jozsef Vinkó, Dohyeong Kim, Jinguk Seo, Wonseok Kang, Taewoo Kim, Hyun-Il Sung, Yonggi Kim, Joh-Na Yoon, Haeun Kim, Jeongmook Kim, Hana Bae, Shuhrat Ehgamberdiev, Otabek Burhonov, Davron Mirzaqulov

Abstract: The progenitor system of Type Ia supernovae (SNe Ia) is expected to be a close binary system of a carbon/oxygen white dwarf (WD) and a non-degenerate star or another WD. Here, we present results from a high-cadence monitoring observation of SN 2021hpr in a spiral galaxy, NGC 3147, and constraints on the progenitor system based on its early multi-color light curve data. First, we classify SN 2021hp… ▽ More The progenitor system of Type Ia supernovae (SNe Ia) is expected to be a close binary system of a carbon/oxygen white dwarf (WD) and a non-degenerate star or another WD. Here, we present results from a high-cadence monitoring observation of SN 2021hpr in a spiral galaxy, NGC 3147, and constraints on the progenitor system based on its early multi-color light curve data. First, we classify SN 2021hpr as a normal SN Ia from its long-term photometric and spectroscopic data. More interestingly, we found a significant "early excess" in the light curve over a simple power-law $\sim t^{2}$ evolution. The early light curve evolves from blue to red and blue during the first week. To explain this, we fitted the early part of $BVRI$-band light curves with a two-component model of the ejecta-companion interaction and a simple power-law model. The early excess and its color can be explained by shock cooling emission due to a companion star having a radius of $8.84\pm0.58$$R_{\odot}$. We also examined HST pre-explosion images with no detection of a progenitor candidate, consistent with the above result. However, we could not detect signs of a significant amount of the stripped mass from a non-degenerate companion star ($\lesssim0.003\,M_{\odot}$ for H$α$ emission). The early excess light in the multi-band light curve supports a non-degenerate companion in the progenitor system of SN 2021hpr. At the same time, the non-detection of emission lines opens a door for other methods to explain this event. △ Less

Submitted 9 March, 2023; originally announced March 2023.

Comments: 26 pages, 13 figures + appendix, Accepted for publication in ApJ

Loss-Curvature Matching for Dataset Selection and Condensation

Authors: Seungjae Shin, Heesun Bae, Donghyeok Shin, Weonyoung Joo, Il-Chul Moon

Abstract: Training neural networks on a large dataset requires substantial computational costs. Dataset reduction selects or synthesizes data instances based on the large dataset, while minimizing the degradation in generalization performance from the full dataset. Existing methods utilize the neural network during the dataset reduction procedure, so the model parameter becomes important factor in preservin… ▽ More Training neural networks on a large dataset requires substantial computational costs. Dataset reduction selects or synthesizes data instances based on the large dataset, while minimizing the degradation in generalization performance from the full dataset. Existing methods utilize the neural network during the dataset reduction procedure, so the model parameter becomes important factor in preserving the performance after reduction. By depending upon the importance of parameters, this paper introduces a new reduction objective, coined LCMat, which Matches the Loss Curvatures of the original dataset and reduced dataset over the model parameter space, more than the parameter point. This new objective induces a better adaptation of the reduced dataset on the perturbed parameter region than the exact point matching. Particularly, we identify the worst case of the loss curvature gap from the local parameter region, and we derive the implementable upper bound of such worst-case with theoretical analyses. Our experiments on both coreset selection and condensation benchmarks illustrate that LCMat shows better generalization performances than existing baselines. △ Less

Submitted 8 March, 2023; originally announced March 2023.

Comments: 26th International Conference on Artificial Intelligence and Statistics (AISTATS)

Intermediate and Future Frame Prediction of Geostationary Satellite Imagery With Warp and Refine Network

Authors: Minseok Seo, Yeji Choi, Hyungon Ry, Heesun Park, Hyungkun Bae, Hyesook Lee, Wanseok Seo

Abstract: Geostationary satellite imagery has applications in climate and weather forecasting, planning natural energy resources, and predicting extreme weather events. For precise and accurate prediction, higher spatial and temporal resolution of geostationary satellite imagery is important. Although recent geostationary satellite resolution has improved, the long-term analysis of climate applications is l… ▽ More Geostationary satellite imagery has applications in climate and weather forecasting, planning natural energy resources, and predicting extreme weather events. For precise and accurate prediction, higher spatial and temporal resolution of geostationary satellite imagery is important. Although recent geostationary satellite resolution has improved, the long-term analysis of climate applications is limited to using multiple satellites from the past to the present due to the different resolutions. To solve this problem, we proposed warp and refine network (WR-Net). WR-Net is divided into an optical flow warp component and a warp image refinement component. We used the TV-L1 algorithm instead of deep learning-based approaches to extract the optical flow warp component. The deep-learning-based model is trained on the human-centric view of the RGB channel and does not work on geostationary satellites, which is gray-scale one-channel imagery. The refinement network refines the warped image through a multi-temporal fusion layer. We evaluated WR-Net by interpolation of temporal resolution at 4 min intervals to 2 min intervals in large-scale GK2A geostationary meteorological satellite imagery. Furthermore, we applied WR-Net to the future frame prediction task and showed that the explicit use of optical flow can help future frame prediction. △ Less

Submitted 8 March, 2023; originally announced March 2023.

Comments: This paper has been accepted for the AAAI2022 Climate Change Workshop

Log-law recovery through reinforcement-learning wall model for large-eddy simulation

Authors: Aurélien Vadrot, Xiang I. A. Yang, H. Jane Bae, Mahdi Abkar

Abstract: This paper focuses on the use of reinforcement learning (RL) as a machine-learning (ML) modeling tool for near-wall turbulence. RL has demonstrated its effectiveness in solving high-dimensional problems, especially in domains such as games. Despite its potential, RL is still not widely used for turbulence modeling and is primarily used for flow control and optimization purposes. A new RL wall mode… ▽ More This paper focuses on the use of reinforcement learning (RL) as a machine-learning (ML) modeling tool for near-wall turbulence. RL has demonstrated its effectiveness in solving high-dimensional problems, especially in domains such as games. Despite its potential, RL is still not widely used for turbulence modeling and is primarily used for flow control and optimization purposes. A new RL wall model (WM) called VYBA23 is developed in this work, which uses agents dispersed in the flow near the wall. The model is trained on a single Reynolds number ($Re_τ= 10^4$) and does not rely on high-fidelity data, as the back-propagation process is based on a reward rather than output error. The states of the RLWM, which are the representation of the environment by the agents, are normalized to remove dependence on the Reynolds number. The model is tested and compared to another RLWM (BK22) and to an equilibrium wall model, in a half-channel flow at eleven different Reynolds numbers ($Re_τ\in [180;10^{10}]$). The effects of varying agents' parameters such as actions range, time-step, and spacing are also studied. The results are promising, showing little effect on the average flow field but some effect on wall-shear stress fluctuations and velocity fluctuations. This work offers positive prospects for developing RLWMs that can recover physical laws, and for extending this type of ML models to more complex flows in the future. △ Less

Submitted 2 May, 2023; v1 submitted 28 February, 2023; originally announced February 2023.

Comments: arXiv admin note: text overlap with arXiv:2211.03614

Heterogeneous Ta-dichalcogenide bilayer: heavy fermions or doped Mott physics?

Authors: Lorenzo Crippa, Hyeonhu Bae, Paul Wunderlich, Igor I. Mazin, Binghai Yan, Giorgio Sangiovanni, Tim Wehling, Roser Valentí

Abstract: Controlling and understanding electron correlations in quantum matter is one of the most challenging tasks in materials engineering. In the past years a plethora of new puzzling correlated states have been found by carefully stacking and twisting two-dimensional van der Waals materials of different kind. Unique to these stacked structures is the emergence of correlated phases not foreseeable from… ▽ More Controlling and understanding electron correlations in quantum matter is one of the most challenging tasks in materials engineering. In the past years a plethora of new puzzling correlated states have been found by carefully stacking and twisting two-dimensional van der Waals materials of different kind. Unique to these stacked structures is the emergence of correlated phases not foreseeable from the single layers alone. In Ta-dichalcogenide heterostructures made of a good metallic 1H- and a Mott-insulating 1T-layer, recent reports have evidenced a cross-breed itinerant and localized nature of the electronic excitations, similar to what is typically found in heavy fermion systems. Here, we put forward a new interpretation based on first-principles calculations which indicates a sizeable charge transfer of electrons (0.4-0.6 e) from 1T to 1H layers at an elevated interlayer distance. We accurately quantify the strength of the interlayer hybridization which allows us to unambiguously determine that the system is much closer to a doped Mott insulator than to a heavy fermion scenario. Ta-based heterolayers provide therefore a new ground for quantum-materials engineering in the regime of heavily doped Mott insulators hybridized with metallic states at a van der Waals distance. △ Less

Submitted 27 February, 2023; originally announced February 2023.

Comments: 9 pages, 5 figures

Perceiving Unseen 3D Objects by Poking the Objects

Authors: Linghao Chen, Yunzhou Song, Hujun Bao, Xiaowei Zhou

Abstract: We present a novel approach to interactive 3D object perception for robots. Unlike previous perception algorithms that rely on known object models or a large amount of annotated training data, we propose a poking-based approach that automatically discovers and reconstructs 3D objects. The poking process not only enables the robot to discover unseen 3D objects but also produces multi-view observati… ▽ More We present a novel approach to interactive 3D object perception for robots. Unlike previous perception algorithms that rely on known object models or a large amount of annotated training data, we propose a poking-based approach that automatically discovers and reconstructs 3D objects. The poking process not only enables the robot to discover unseen 3D objects but also produces multi-view observations for 3D reconstruction of the objects. The reconstructed objects are then memorized by neural networks with regular supervised learning and can be recognized in new test images. The experiments on real-world data show that our approach could unsupervisedly discover and reconstruct unseen 3D objects with high quality, and facilitate real-world applications such as robotic grasping. The code and supplementary materials are available at the project page: https://zju3dv.github.io/poking_perception. △ Less

Submitted 26 February, 2023; originally announced February 2023.

Comments: Accepted to ICRA 2023. Project page: https://zju3dv.github.io/poking_perception

Measurement of decay-time-dependent $\textit{CP}$ violation in $B^0 \to J/ψK^0_S$ decays using 2019-2021 Belle II data

Authors: Belle II Collaboration, I. Adachi, L. Aggarwal, H. Ahmed, H. Aihara, N. Akopov, A. Aloisio, N. Anh Ky, D. M. Asner, H. Atmacan, T. Aushev, V. Aushev, H. Bae, S. Bahinipati, P. Bambade, Sw. Banerjee, S. Bansal, M. Barrett, J. Baudot, M. Bauer, A. Baur, A. Beaubien, J. Becker, J. V. Bennett, E. Bernieri , et al. (370 additional authors not shown)

Abstract: We report a measurement of the mixing-induced and direct $\textit{CP}$ violation parameters $S_{\text{CP}}$ and $A_{\text{CP}}$ from $B^0 \to J/ψK^0_S$ decays reconstructed by the Belle II experiment at the SuperKEKB asymmetric-energy electron-positron collider. The data, collected at the center-of-mass energy of the $Υ(4S)$ resonance, correspond to $190\text{fb}^{-1}$ of integrated luminosity. We… ▽ More We report a measurement of the mixing-induced and direct $\textit{CP}$ violation parameters $S_{\text{CP}}$ and $A_{\text{CP}}$ from $B^0 \to J/ψK^0_S$ decays reconstructed by the Belle II experiment at the SuperKEKB asymmetric-energy electron-positron collider. The data, collected at the center-of-mass energy of the $Υ(4S)$ resonance, correspond to $190\text{fb}^{-1}$ of integrated luminosity. We measure ${S_{\text{CP}} = 0.720\pm0.062\pm0.016}$ and $A_{\text{CP}} = 0.094\pm0.044^{+0.042}_{-0.017}$, where the first uncertainties are statistical and the second systematic. In the Standard Model, $S_{\text{CP}}$ equals $\sin(2φ_1)$ to a good approximation. △ Less

Submitted 24 February, 2023; originally announced February 2023.

Measurement of the $B^0$ lifetime and flavor-oscillation frequency using hadronic decays reconstructed in 2019-2021 Belle II data

Authors: Belle II Collaboration, F. Abudinén, I. Adachi, L. Aggarwal, H. Ahmed, H. Aihara, N. Akopov, A. Aloisio, N. Anh Ky, D. M. Asner, H. Atmacan, T. Aushev, V. Aushev, H. Bae, S. Bahinipati, P. Bambade, Sw. Banerjee, S. Bansal, M. Barrett, J. Baudot, M. Bauer, A. Baur, A. Beaubien, J. Becker, J. V. Bennett , et al. (371 additional authors not shown)

Abstract: We measure the $B^0$ lifetime and flavor-oscillation frequency using $B^0\to D^{(*)-}π^+$ decays collected by the Belle II experiment in asymmetric-energy $e^+e^-$ collisions produced by the SuperKEKB collider operating at the $Υ(4S)$ resonance. We fit the decay-time distribution of signal decays, where the initial flavor is determined by identifying the flavor of the other $B$ meson in the event.… ▽ More We measure the $B^0$ lifetime and flavor-oscillation frequency using $B^0\to D^{(*)-}π^+$ decays collected by the Belle II experiment in asymmetric-energy $e^+e^-$ collisions produced by the SuperKEKB collider operating at the $Υ(4S)$ resonance. We fit the decay-time distribution of signal decays, where the initial flavor is determined by identifying the flavor of the other $B$ meson in the event. The results, based on $33000$ signal decays reconstructed in a data sample corresponding to ${190}\text{fb}^{-1}$, are $τ_{B^0} = {1.499}\pm{0.013}\pm{0.008}\;\text{ps}$, $Δm_d = {0.516}\pm{0.008}\pm{0.005}\;\text{ps}^{-1}$, where the first uncertainties are statistical and the second are systematic. These results are consistent with the world-average values. △ Less

Submitted 27 February, 2023; v1 submitted 24 February, 2023; originally announced February 2023.

Report number: Belle II Preprint 2023-001, KEK Preprint 2022-56

Learning Neural Volumetric Representations of Dynamic Humans in Minutes

Authors: Chen Geng, Sida Peng, Zhen Xu, Hujun Bao, Xiaowei Zhou

Abstract: This paper addresses the challenge of quickly reconstructing free-viewpoint videos of dynamic humans from sparse multi-view videos. Some recent works represent the dynamic human as a canonical neural radiance field (NeRF) and a motion field, which are learned from videos through differentiable rendering. But the per-scene optimization generally requires hours. Other generalizable NeRF models lever… ▽ More This paper addresses the challenge of quickly reconstructing free-viewpoint videos of dynamic humans from sparse multi-view videos. Some recent works represent the dynamic human as a canonical neural radiance field (NeRF) and a motion field, which are learned from videos through differentiable rendering. But the per-scene optimization generally requires hours. Other generalizable NeRF models leverage learned prior from datasets and reduce the optimization time by only finetuning on new scenes at the cost of visual fidelity. In this paper, we propose a novel method for learning neural volumetric videos of dynamic humans from sparse view videos in minutes with competitive visual quality. Specifically, we define a novel part-based voxelized human representation to better distribute the representational power of the network to different human parts. Furthermore, we propose a novel 2D motion parameterization scheme to increase the convergence rate of deformation field learning. Experiments demonstrate that our model can be learned 100 times faster than prior per-scene optimization methods while being competitive in the rendering quality. Training our model on a $512 \times 512$ video with 100 frames typically takes about 5 minutes on a single RTX 3090 GPU. The code will be released on our project page: https://zju3dv.github.io/instant_nvr △ Less

Submitted 23 February, 2023; v1 submitted 23 February, 2023; originally announced February 2023.

Comments: Project page: https://zju3dv.github.io/instant_nvr

EC-SfM: Efficient Covisibility-based Structure-from-Motion for Both Sequential and Unordered Images

Authors: Zhichao Ye, Chong Bao, Xin Zhou, Haomin Liu, Hujun Bao, Guofeng Zhang

Abstract: Structure-from-Motion is a technology used to obtain scene structure through image collection, which is a fundamental problem in computer vision. For unordered Internet images, SfM is very slow due to the lack of prior knowledge about image overlap. For sequential images, knowing the large overlap between adjacent frames, SfM can adopt a variety of acceleration strategies, which are only applicabl… ▽ More Structure-from-Motion is a technology used to obtain scene structure through image collection, which is a fundamental problem in computer vision. For unordered Internet images, SfM is very slow due to the lack of prior knowledge about image overlap. For sequential images, knowing the large overlap between adjacent frames, SfM can adopt a variety of acceleration strategies, which are only applicable to sequential data. To further improve the reconstruction efficiency and break the gap of strategies between these two kinds of data, this paper presents an efficient covisibility-based incremental SfM. Different from previous methods, we exploit covisibility and registration dependency to describe the image connection which is suitable to any kind of data. Based on this general image connection, we propose a unified framework to efficiently reconstruct sequential images, unordered images, and the mixture of these two. Experiments on the unordered images and mixed data verify the effectiveness of the proposed method, which is three times faster than the state of the art on feature matching, and an order of magnitude faster on reconstruction without sacrificing the accuracy. The source code is publicly available at https://github.com/openxrlab/xrsfm △ Less

Submitted 6 August, 2023; v1 submitted 21 February, 2023; originally announced February 2023.

Comments: Accepted 27 May 2023 (TCSVT)

Observation of Josephson Harmonics in Tunnel Junctions

Authors: Dennis Willsch, Dennis Rieger, Patrick Winkel, Madita Willsch, Christian Dickel, Jonas Krause, Yoichi Ando, Raphaël Lescanne, Zaki Leghtas, Nicholas T. Bronn, Pratiti Deb, Olivia Lanes, Zlatko K. Minev, Benedikt Dennig, Simon Geisert, Simon Günzler, Sören Ihssen, Patrick Paluch, Thomas Reisinger, Roudy Hanna, Jin Hee Bae, Peter Schüffelgen, Detlev Grützmacher, Luiza Buimaga-Iarinca, Cristian Morari , et al. (5 additional authors not shown)

Abstract: Superconducting quantum processors have a long road ahead to reach fault-tolerant quantum computing. One of the most daunting challenges is taming the numerous microscopic degrees of freedom ubiquitous in solid-state devices. State-of-the-art technologies, including the world's largest quantum processors, employ aluminum oxide (AlO$_x$) tunnel Josephson junctions (JJs) as sources of nonlinearity,… ▽ More Superconducting quantum processors have a long road ahead to reach fault-tolerant quantum computing. One of the most daunting challenges is taming the numerous microscopic degrees of freedom ubiquitous in solid-state devices. State-of-the-art technologies, including the world's largest quantum processors, employ aluminum oxide (AlO$_x$) tunnel Josephson junctions (JJs) as sources of nonlinearity, assuming an idealized pure $\sin\varphi$ current-phase relation (C$\varphi$R). However, this celebrated $\sin\varphi$ C$\varphi$R is only expected to occur in the limit of vanishingly low-transparency channels in the AlO$_x$ barrier. Here we show that the standard C$\varphi$R fails to accurately describe the energy spectra of transmon artificial atoms across various samples and laboratories. Instead, a mesoscopic model of tunneling through an inhomogeneous AlO$_x$ barrier predicts %-level contributions from higher Josephson harmonics. By including these in the transmon Hamiltonian, we obtain orders of magnitude better agreement between the computed and measured energy spectra. The reality of Josephson harmonics transforms qubit design and prompts a reevaluation of models for quantum gates and readout, parametric amplification and mixing, Floquet qubits, protected Josephson qubits, etc. As an example, we show that engineered Josephson harmonics can reduce the charge dispersion and the associated errors in transmon qubits by an order of magnitude, while preserving anharmonicity. △ Less

Submitted 22 August, 2023; v1 submitted 17 February, 2023; originally announced February 2023.

Journal ref: Nat. Phys. 20, 815 (2024)

New Insights for the Stability-Plasticity Dilemma in Online Continual Learning

Authors: Dahuin Jung, Dongjin Lee, Sunwon Hong, Hyemi Jang, Ho Bae, Sungroh Yoon

Abstract: The aim of continual learning is to learn new tasks continuously (i.e., plasticity) without forgetting previously learned knowledge from old tasks (i.e., stability). In the scenario of online continual learning, wherein data comes strictly in a streaming manner, the plasticity of online continual learning is more vulnerable than offline continual learning because the training signal that can be ob… ▽ More The aim of continual learning is to learn new tasks continuously (i.e., plasticity) without forgetting previously learned knowledge from old tasks (i.e., stability). In the scenario of online continual learning, wherein data comes strictly in a streaming manner, the plasticity of online continual learning is more vulnerable than offline continual learning because the training signal that can be obtained from a single data point is limited. To overcome the stability-plasticity dilemma in online continual learning, we propose an online continual learning framework named multi-scale feature adaptation network (MuFAN) that utilizes a richer context encoding extracted from different levels of a pre-trained network. Additionally, we introduce a novel structure-wise distillation loss and replace the commonly used batch normalization layer with a newly proposed stability-plasticity normalization module to train MuFAN that simultaneously maintains high plasticity and stability. MuFAN outperforms other state-of-the-art continual learning methods on the SVHN, CIFAR100, miniImageNet, and CORe50 datasets. Extensive experiments and ablation studies validate the significance and scalability of each proposed component: 1) multi-scale feature maps from a pre-trained encoder, 2) the structure-wise distillation loss, and 3) the stability-plasticity normalization module in MuFAN. Code is publicly available at https://github.com/whitesnowdrop/MuFAN. △ Less

Submitted 17 February, 2023; originally announced February 2023.

Comments: Accepted to ICLR2023

Energy Efficient Operation of Adaptive Massive MIMO 5G HetNets

Authors: Siddarth Marwaha, Eduard A. Jorswieck, Mostafa Jassim, Thomas Kuerner, David Lopez Perez, Xilnli Geng, Harvey Bao

Abstract: For energy efficient operation of the massive multiple-input multiple-output (MIMO) networks, various aspects of energy efficiency maximization have been addressed, where a careful selection of number of active antennas has shown significant gains. Moreover, switching-off physical resource blocks (PRBs) and carrier shutdown saves energy in low load scenarios. However, the joint optimization of spe… ▽ More For energy efficient operation of the massive multiple-input multiple-output (MIMO) networks, various aspects of energy efficiency maximization have been addressed, where a careful selection of number of active antennas has shown significant gains. Moreover, switching-off physical resource blocks (PRBs) and carrier shutdown saves energy in low load scenarios. However, the joint optimization of spectral PRB allocation and spatial layering in a heterogeneous network has not been completely solved yet. Therefore, we study a power consumption model for multi-cell multi-user massive MIMO 5G network, capturing the joint effects of both dimensions. We characterize the optimal resource allocation under practical constraints, i.e., limited number of available antennas, PRBs, base stations (BSs), and frequency bands. We observe a single spatial layer achieving lowest energy consumption in very low load scenarios, whereas, spatial layering is required in high load scenarios. Finally, we derive novel algorithms for energy efficient user to BS assignment and propose an adaptive algorithm for PRB assignment and power control. All results are illustrated by numerical system-level simulations, describing a realistic metropolis scenario. The results show that a higher frequency band should be used to support users with large rate requirements via spatial multiplexing and assigning each user maximum available PRBs. △ Less

Submitted 10 October, 2023; v1 submitted 16 February, 2023; originally announced February 2023.

Journal ref: IEEE Transactions on Wireless Communications, 13 Nov, 2023

An Investigation into Pre-Training Object-Centric Representations for Reinforcement Learning

Authors: Jaesik Yoon, Yi-Fu Wu, Heechul Bae, Sungjin Ahn

Abstract: Unsupervised object-centric representation (OCR) learning has recently drawn attention as a new paradigm of visual representation. This is because of its potential of being an effective pre-training technique for various downstream tasks in terms of sample efficiency, systematic generalization, and reasoning. Although image-based reinforcement learning (RL) is one of the most important and thus fr… ▽ More Unsupervised object-centric representation (OCR) learning has recently drawn attention as a new paradigm of visual representation. This is because of its potential of being an effective pre-training technique for various downstream tasks in terms of sample efficiency, systematic generalization, and reasoning. Although image-based reinforcement learning (RL) is one of the most important and thus frequently mentioned such downstream tasks, the benefit in RL has surprisingly not been investigated systematically thus far. Instead, most of the evaluations have focused on rather indirect metrics such as segmentation quality and object property prediction accuracy. In this paper, we investigate the effectiveness of OCR pre-training for image-based reinforcement learning via empirical experiments. For systematic evaluation, we introduce a simple object-centric visual RL benchmark and conduct experiments to answer questions such as ``Does OCR pre-training improve performance on object-centric tasks?'' and ``Can OCR pre-training help with out-of-distribution generalization?''. Our results provide empirical evidence for valuable insights into the effectiveness of OCR pre-training for RL and the potential limitations of its use in certain scenarios. Additionally, this study also examines the critical aspects of incorporating OCR pre-training in RL, including performance in a visually complex environment and the appropriate pooling layer to aggregate the object representations. △ Less

Submitted 12 June, 2023; v1 submitted 8 February, 2023; originally announced February 2023.

Comments: We study unsupervised object-centric representations in reinforcement learning through systematic investigation

Molybdenum Carbide MXenes as Efficient Nanosensors Towards Selected Chemical Warfare Agents

Authors: Puspamitra Panigrahi, Yash Pal, Thanayut Kaewmaraya, Hyeonhu Bae, Noushin Nasiri, Tanveer Hussain

Abstract: There has been budding demand for the fast, reliable, inexpensive, non-invasive, sensitive, and compact sensors with low power consumption in various fields, such as defence, chemical sensing, health care, and safe environment monitoring units. Particularly, an efficient detection of chemical warfare agents (CWAs) is of great importance for the safety and security of the humans. Inspired by this,… ▽ More There has been budding demand for the fast, reliable, inexpensive, non-invasive, sensitive, and compact sensors with low power consumption in various fields, such as defence, chemical sensing, health care, and safe environment monitoring units. Particularly, an efficient detection of chemical warfare agents (CWAs) is of great importance for the safety and security of the humans. Inspired by this, we explored molybdenum carbide MXenes (Mo2CTx; Tx= O, F, S) as efficient sensors towards selected CWAs, such as arsine (AsH3), mustard gas (C4H8Cl2S), cyanogen chloride (NCCl), and phosgene (COCl2) both in aqueous and non-aqueous mediums. Our van der Waals corrected density functional theory (DFT) calculations reveal that the CWAs bind with Mo2CF2, and Mo2CS2 monolayers under strong chemisorption with binding energies in the range of -2.33 to -4.05 eV, whereas Mo2CO2 results in comparatively weak bindings of -0.29 to -0.58 eV. We further report the variations in the electronic properties, electrostatic potentials and work functions of Mo2CTx upon the adsorption of CWAs, which authenticate an efficient sensing mechanism. Statistical thermodynamic analysis is applied to explore the sensing properties of Mo2CTx at various of temperatures and pressures. We believe that our findings will pave the way to an innovative class of low-cost reusable sensors for the sensitive and selective detection of highly toxic CWAs in air as well as in aqueous media. △ Less

Submitted 6 February, 2023; originally announced February 2023.

Development of deep biological ages aware of morbidity and mortality based on unsupervised and semi-supervised deep learning approaches

Authors: Seong-Eun Moon, Ji Won Yoon, Shinyoung Joo, Yoohyung Kim, Jae Hyun Bae, Seokho Yoon, Haanju Yoo, Young Min Cho

Abstract: Background: While deep learning technology, which has the capability of obtaining latent representations based on large-scale data, can be a potential solution for the discovery of a novel aging biomarker, existing deep learning methods for biological age estimation usually depend on chronological ages and lack of consideration of mortality and morbidity that are the most significant outcomes of a… ▽ More Background: While deep learning technology, which has the capability of obtaining latent representations based on large-scale data, can be a potential solution for the discovery of a novel aging biomarker, existing deep learning methods for biological age estimation usually depend on chronological ages and lack of consideration of mortality and morbidity that are the most significant outcomes of aging. Methods: This paper proposes a novel deep learning model to learn latent representations of biological aging in regard to subjects' morbidity and mortality. The model utilizes health check-up data in addition to morbidity and mortality information to learn the complex relationships between aging and measured clinical attributes. Findings: The proposed model is evaluated on a large dataset of general populations compared with KDM and other learning-based models. Results demonstrate that biological ages obtained by the proposed model have superior discriminability of subjects' morbidity and mortality. △ Less

Submitted 1 February, 2023; originally announced February 2023.

STORM-GAN: Spatio-Temporal Meta-GAN for Cross-City Estimation of Human Mobility Responses to COVID-19

Authors: Han Bao, Xun Zhou, Yiqun Xie, Yanhua Li, Xiaowei Jia

Abstract: Human mobility estimation is crucial during the COVID-19 pandemic due to its significant guidance for policymakers to make non-pharmaceutical interventions. While deep learning approaches outperform conventional estimation techniques on tasks with abundant training data, the continuously evolving pandemic poses a significant challenge to solving this problem due to data nonstationarity, limited ob… ▽ More Human mobility estimation is crucial during the COVID-19 pandemic due to its significant guidance for policymakers to make non-pharmaceutical interventions. While deep learning approaches outperform conventional estimation techniques on tasks with abundant training data, the continuously evolving pandemic poses a significant challenge to solving this problem due to data nonstationarity, limited observations, and complex social contexts. Prior works on mobility estimation either focus on a single city or lack the ability to model the spatio-temporal dependencies across cities and time periods. To address these issues, we make the first attempt to tackle the cross-city human mobility estimation problem through a deep meta-generative framework. We propose a Spatio-Temporal Meta-Generative Adversarial Network (STORM-GAN) model that estimates dynamic human mobility responses under a set of social and policy conditions related to COVID-19. Facilitated by a novel spatio-temporal task-based graph (STTG) embedding, STORM-GAN is capable of learning shared knowledge from a spatio-temporal distribution of estimation tasks and quickly adapting to new cities and time periods with limited training samples. The STTG embedding component is designed to capture the similarities among cities to mitigate cross-task heterogeneity. Experimental results on real-world data show that the proposed approach can greatly improve estimation performance and out-perform baselines. △ Less

Submitted 20 January, 2023; originally announced January 2023.

Comments: Accepted at the 22nd IEEE International Conference on Data Mining (ICDM 2022) Full Paper

ACM Class: I.2

Real-Time High-Resolution Pedestrian Detection in Crowded Scenes via Parallel Edge Offloading

Authors: Hao Wang, Hao Bao, Liekang Zeng, Ke Luo, Xu Chen

Abstract: To identify dense and small-size pedestrians in surveillance systems, high-resolution cameras are widely deployed, where high-resolution images are captured and delivered to off-the-shelf pedestrian detection models. However, given the highly computation-intensive workload brought by the high resolution, the resource-constrained cameras fail to afford accurate inference in real time. To address th… ▽ More To identify dense and small-size pedestrians in surveillance systems, high-resolution cameras are widely deployed, where high-resolution images are captured and delivered to off-the-shelf pedestrian detection models. However, given the highly computation-intensive workload brought by the high resolution, the resource-constrained cameras fail to afford accurate inference in real time. To address that, we propose Hode, an offloaded video analytic framework that utilizes multiple edge nodes in proximity to expedite pedestrian detection with high-resolution inputs. Specifically, Hode can intelligently split high-resolution images into respective regions and then offload them to distributed edge nodes to perform pedestrian detection in parallel. A spatio-temporal flow filtering method is designed to enable context-aware region partitioning, as well as a DRL-based scheduling algorithm to allow accuracy-aware load balance among heterogeneous edge nodes. Extensive evaluation results using realistic prototypes show that Hode can achieve up to 2.01% speedup with very mild accuracy loss. △ Less

Submitted 19 January, 2023; originally announced January 2023.

Comments: Accepted by IEEE ICC 2023

A test of light-lepton universality in the rates of inclusive semileptonic $B$-meson decays at Belle II

Authors: Belle II Collaboration, L. Aggarwal, H. Ahmed, H. Aihara, N. Akopov, A. Aloisio, N. Anh Ky, D. M. Asner, H. Atmacan, T. Aushev, V. Aushev, H. Bae, S. Bahinipati, P. Bambade, Sw. Banerjee, S. Bansal, M. Barrett, J. Baudot, M. Bauer, A. Baur, A. Beaubien, J. Becker, J. V. Bennett, E. Bernieri, F. U. Bernlochner , et al. (327 additional authors not shown)

Abstract: We present the first measurement of the ratio of branching fractions of inclusive semileptonic $B$-meson decays, $R(X_{e/μ}) = \mathcal{B}(B\to X \, e \, ν) / \mathcal{B}(B\to X \, μ\, ν)$, a precision test of electron-muon universality, using data corresponding to $189\,\mathrm{fb}^{-1}$ from electron-positron collisions collected with the Belle II detector. In events where the partner $B$ meson… ▽ More We present the first measurement of the ratio of branching fractions of inclusive semileptonic $B$-meson decays, $R(X_{e/μ}) = \mathcal{B}(B\to X \, e \, ν) / \mathcal{B}(B\to X \, μ\, ν)$, a precision test of electron-muon universality, using data corresponding to $189\,\mathrm{fb}^{-1}$ from electron-positron collisions collected with the Belle II detector. In events where the partner $B$ meson is fully reconstructed, we use fits to the lepton momentum spectra above $1.3\,\mathrm{GeV}/c$ to obtain $R(X_{e/μ}) = 1.007 \pm 0.009~(\mathrm{stat}) \pm 0.019~(\mathrm{syst})$, which is the most precise lepton-universality test of its kind and agrees with the standard-model expectation. △ Less

Submitted 25 May, 2023; v1 submitted 19 January, 2023; originally announced January 2023.

Report number: Belle II Preprint 2022-009 KEK Preprint 2022-45

Journal ref: Phys. Rev. Lett. 131, 051804 (2023)

OnePose++: Keypoint-Free One-Shot Object Pose Estimation without CAD Models

Authors: Xingyi He, Jiaming Sun, Yuang Wang, Di Huang, Hujun Bao, Xiaowei Zhou

Abstract: We propose a new method for object pose estimation without CAD models. The previous feature-matching-based method OnePose has shown promising results under a one-shot setting which eliminates the need for CAD models or object-specific training. However, OnePose relies on detecting repeatable image keypoints and is thus prone to failure on low-textured objects. We propose a keypoint-free pose estim… ▽ More We propose a new method for object pose estimation without CAD models. The previous feature-matching-based method OnePose has shown promising results under a one-shot setting which eliminates the need for CAD models or object-specific training. However, OnePose relies on detecting repeatable image keypoints and is thus prone to failure on low-textured objects. We propose a keypoint-free pose estimation pipeline to remove the need for repeatable keypoint detection. Built upon the detector-free feature matching method LoFTR, we devise a new keypoint-free SfM method to reconstruct a semi-dense point-cloud model for the object. Given a query image for object pose estimation, a 2D-3D matching network directly establishes 2D-3D correspondences between the query image and the reconstructed point-cloud model without first detecting keypoints in the image. Experiments show that the proposed pipeline outperforms existing one-shot CAD-model-free methods by a large margin and is comparable to CAD-model-based methods on LINEMOD even for low-textured objects. We also collect a new dataset composed of 80 sequences of 40 low-textured objects to facilitate future research on one-shot object pose estimation. The supplementary material, code and dataset are available on the project page: https://zju3dv.github.io/onepose_plus_plus/. △ Less

Submitted 18 January, 2023; originally announced January 2023.

Comments: Accepted to NeurIPS 2022

Towards real-time reconstruction of velocity fluctuations in turbulent channel flow

Authors: Rahul Arun, H. Jane Bae, Beverley J. McKeon

Abstract: We develop a framework for efficient streaming reconstructions of turbulent velocity fluctuations from limited sensor measurements with the goal of enabling real-time applications. The reconstruction process is simplified by computing linear estimators using flow statistics from an initial training period and evaluating their performance during a subsequent testing period with data obtained from d… ▽ More We develop a framework for efficient streaming reconstructions of turbulent velocity fluctuations from limited sensor measurements with the goal of enabling real-time applications. The reconstruction process is simplified by computing linear estimators using flow statistics from an initial training period and evaluating their performance during a subsequent testing period with data obtained from direct numerical simulation. We address cases where (i) no, (ii) limited, and (iii) full-field training data are available using estimators based on (i) resolvent modes, (ii) resolvent-based estimation, and (iii) spectral proper orthogonal decomposition modes. During training, we introduce blockwise inversion to accurately and efficiently compute the resolvent operator in an interpretable manner. During testing, we enable efficient streaming reconstructions by using a temporal sliding discrete Fourier transform to recursively update Fourier coefficients using incoming measurements. We use this framework to reconstruct with minimal time delay the turbulent velocity fluctuations in a minimal channel at ${\rm Re}_τ\approx 186$ from sparse planar measurements. We evaluate reconstruction accuracy in the context of the extent of data required and thereby identify potential use cases for each estimator. The reconstructions capture large portions of the dynamics from relatively few measurement planes when the linear estimators are computed with sufficient fidelity. We also evaluate the efficiency of our reconstructions and show that the present framework has the potential to help enable real-time reconstructions of turbulent velocity fluctuations in an analogous experimental setting. △ Less

Submitted 27 June, 2023; v1 submitted 17 January, 2023; originally announced January 2023.

Comments: 36 pages, 22 figures, accepted by Physical Review Fluids

Journal ref: Physical Review Fluids 8, 064612 (2023)

A Framework for the Evaluation of Network Reliability Under Periodic Demand

Authors: Ali Maatouk, Fadhel Ayed, Shi Biao, Wenjie Li, Harvey Bao, Enrico Zio

Abstract: In this paper, we study network reliability in relation to a periodic time-dependent utility function that reflects the system's functional performance. When an anomaly occurs, the system incurs a loss of utility that depends on the anomaly's timing and duration. We analyze the long-term average utility loss by considering exponential anomalies' inter-arrival times and general distributions of mai… ▽ More In this paper, we study network reliability in relation to a periodic time-dependent utility function that reflects the system's functional performance. When an anomaly occurs, the system incurs a loss of utility that depends on the anomaly's timing and duration. We analyze the long-term average utility loss by considering exponential anomalies' inter-arrival times and general distributions of maintenance duration. We show that the expected utility loss converges in probability to a simple form. We then extend our convergence results to more general distributions of anomalies' inter-arrival times and to particular families of non-periodic utility functions. To validate our results, we use data gathered from a cellular network consisting of 660 base stations and serving over 20k users. We demonstrate the quasi-periodic nature of users' traffic and the exponential distribution of the anomalies' inter-arrival times, allowing us to apply our results and provide reliability scores for the network. We also discuss the convergence speed of the long-term average utility loss, the interplay between the different network's parameters, and the impact of non-stationarity on our convergence results. △ Less

Submitted 13 January, 2023; originally announced January 2023.

Measurement of the $B^{0} \rightarrow D^{*-} \ell^{+} ν_{\ell}$ branching ratio and $|V_{cb}|$ with a fully reconstructed accompanying $B$ meson in 2019-2021 Belle II data

Authors: F. Abudinén, I. Adachi, K. Adamczyk, L. Aggarwal, P. Ahlburg, H. Ahmed, J. K. Ahn, H. Aihara, N. Akopov, A. Aloisio, F. Ameli, L. Andricek, N. Anh Ky, D. M. Asner, H. Atmacan, V. Aulchenko, T. Aushev, V. Aushev, T. Aziz, V. Babu, H. Bae, S. Baehr, S. Bahinipati, A. M. Bakich, P. Bambade , et al. (561 additional authors not shown)

Abstract: We present a measurement of the $B^{0} \rightarrow D^{*-} \ell^{+} ν_{\ell}$ ($\ell=e,μ$) branching ratio and of the CKM parameter $|V_{cb}|$ using signal decays accompanied by a fully reconstructed $B$ meson. The Belle II data set of electron-positron collisions at the $Υ(4S)$ resonance, corresponding to 189.3$\,$fb$^{-1}$ of integrated luminosity, is analyzed. With the Caprini-Lellouch-Neubert f… ▽ More We present a measurement of the $B^{0} \rightarrow D^{*-} \ell^{+} ν_{\ell}$ ($\ell=e,μ$) branching ratio and of the CKM parameter $|V_{cb}|$ using signal decays accompanied by a fully reconstructed $B$ meson. The Belle II data set of electron-positron collisions at the $Υ(4S)$ resonance, corresponding to 189.3$\,$fb$^{-1}$ of integrated luminosity, is analyzed. With the Caprini-Lellouch-Neubert form factor parameterization, the parameters $η_{\rm EW} F(1) |V_{cb}|$ and $ρ^{2}$ are extracted, where $η_{\rm EW}$ is an electroweak correction, $F(1)$ is a normalization factor and $ρ^{2}$ is a form factor shape parameter. We reconstruct 516 signal decays and thereby obtain $\mathcal{B} (B^{0} \rightarrow D^{*-} \ell^{+} ν_{\ell} ) = \left(5.27 \pm 0.22~\rm{\left(stat\right)} \pm 0.38~\rm{\left(syst\right)}\right) \%$, $η_{EW} F(1) |V_{cb}| \times 10^{3} = 34.6 \pm 1.8~\rm{\left(stat\right)} \pm 1.7~\rm{\left(syst\right)}$, and $ρ^{2} = 0.94 \pm 0.18~\rm{\left(stat\right)} \pm 0.11~\rm{\left(syst\right)}$. △ Less

Submitted 11 January, 2023; originally announced January 2023.

On the correlation between dark matter, intracluster light and globular cluster distribution in SMACS0723

Authors: J. M. Diego, M. Pascale, B. Frye, A. Zitrin, T. Broadhurst, G. Mahler, G. B. Caminha, M. Jauzac, Myung Gyoon Lee, Jang Ho Bae, In Sung Jang, Mireia Montes

Abstract: We present a free-form model of SMACS0723, the first cluster observed with JWST. This model makes no strong assumptions about the distribution of mass (mostly dark matter) in the cluster and we use it to study the possible correlation between dark matter with the intracluster light and distribution of globular clusters. To explore the uncertainty in mass modelling, we derive three lens models base… ▽ More We present a free-form model of SMACS0723, the first cluster observed with JWST. This model makes no strong assumptions about the distribution of mass (mostly dark matter) in the cluster and we use it to study the possible correlation between dark matter with the intracluster light and distribution of globular clusters. To explore the uncertainty in mass modelling, we derive three lens models based on spectroscopically confirmed systems and new candidate systems with redshifts predicted by the lens model derived from the spectroscopic systems. We find that beyond the radius of influence of the BCG, the total mass does not trace the ICL, implying the need for a dark component (dark matter). Two loop-like structures observed in the intracluster light do not have an obvious correspondence with the total mass (mostly dark matter) distribution. The radial profiles of the ICL and the distribution of globular clusters are similar to each other, but steeper than the profile of the lens model. More specifically, we find that the total mass is shallower by 1 dex in log scale than both ICL and globular cluster profiles. This is in excellent agreement with N-body simulations of cold dark matter. △ Less

Submitted 9 January, 2023; originally announced January 2023.

Comments: 12 pages, 8 figures

Journal ref: A&A 679, A159 (2023)

AdvCat: Domain-Agnostic Robustness Assessment for Cybersecurity-Critical Applications with Categorical Inputs

Authors: Helene Orsini, Hongyan Bao, Yujun Zhou, Xiangrui Xu, Yufei Han, Longyang Yi, Wei Wang, Xin Gao, Xiangliang Zhang

Abstract: Machine Learning-as-a-Service systems (MLaaS) have been largely developed for cybersecurity-critical applications, such as detecting network intrusions and fake news campaigns. Despite effectiveness, their robustness against adversarial attacks is one of the key trust concerns for MLaaS deployment. We are thus motivated to assess the adversarial robustness of the Machine Learning models residing a… ▽ More Machine Learning-as-a-Service systems (MLaaS) have been largely developed for cybersecurity-critical applications, such as detecting network intrusions and fake news campaigns. Despite effectiveness, their robustness against adversarial attacks is one of the key trust concerns for MLaaS deployment. We are thus motivated to assess the adversarial robustness of the Machine Learning models residing at the core of these security-critical applications with categorical inputs. Previous research efforts on accessing model robustness against manipulation of categorical inputs are specific to use cases and heavily depend on domain knowledge, or require white-box access to the target ML model. Such limitations prevent the robustness assessment from being as a domain-agnostic service provided to various real-world applications. We propose a provably optimal yet computationally highly efficient adversarial robustness assessment protocol for a wide band of ML-driven cybersecurity-critical applications. We demonstrate the use of the domain-agnostic robustness assessment method with substantial experimental study on fake news detection and intrusion detection problems. △ Less

Submitted 13 December, 2022; originally announced December 2022.

Comments: IEEE BigData 2022

Symmetric subgroup schemes, Frobenius splittings, and quantum symmetric pairs

Authors: Huanchen Bao, Jinfeng Song

Abstract: Let $G_k$ be a connected reductive algebraic group over an algebraically closed field $k$ of characteristic $\neq 2$. Let $K_k \subset G_k$ be a quasi-split symmetric subgroup of $G_k$ with respect to an involution $θ_k$ of $G_k$. The classification of such involutions is independent of the characteristic of $k$ (provided not $2$). We first construct a closed subgroup scheme $\mathbf{G}^\imath$… ▽ More Let $G_k$ be a connected reductive algebraic group over an algebraically closed field $k$ of characteristic $\neq 2$. Let $K_k \subset G_k$ be a quasi-split symmetric subgroup of $G_k$ with respect to an involution $θ_k$ of $G_k$. The classification of such involutions is independent of the characteristic of $k$ (provided not $2$). We first construct a closed subgroup scheme $\mathbf{G}^\imath$ of the Chevalley group scheme $\mathbf{G}$ over $\mathbb{Z}$. The pair $(\mathbf{G}, \mathbf{G}^\imath)$ parameterizes symmetric pairs of the given type over any algebraically closed field of characteristic $\neq 2$, that is, the geometric fibre of $\mathbf{G}^\imath$ becomes the reductive group $K_k \subset G_k$ over any algebraically closed field $k$ of characteristic $\neq 2$. As a consequence, we show the coordinate ring of the group $K_k$ is spanned by the dual $\imath$canonical basis of the corresponding $\imath$quantum group. We then construct a quantum Frobenius splitting for the quasi-split $\imath$quantum group at roots of $1$. This generalizes Lusztig's quantum Frobenius splitting for quantum groups at roots of $1$. Over a field of positive characteristic, our quantum Frobenius splitting induces a Frobenius splitting of the algebraic group $K_k$. Finally, we construct Frobenius splittings of the flag variety $G_k / B_k$ that compatibly split certain $K_k$-orbit closures over positive characteristics. We deduce cohomological vanishings of line bundles as well as normalities. Results apply to characteristic $0$ as well, thanks to the existence of the scheme $\mathbf{G}^\imath$. Our construction of splittings is based on the quantum Frobenius splitting of the corresponding $\imath$quantum group. △ Less

Submitted 27 December, 2022; originally announced December 2022.

Comments: 65 pages

Robust computation of optimal transport by $β$-potential regularization

Authors: Shintaro Nakamura, Han Bao, Masashi Sugiyama

Abstract: Optimal transport (OT) has become a widely used tool in the machine learning field to measure the discrepancy between probability distributions. For instance, OT is a popular loss function that quantifies the discrepancy between an empirical distribution and a parametric model. Recently, an entropic penalty term and the celebrated Sinkhorn algorithm have been commonly used to approximate the origi… ▽ More Optimal transport (OT) has become a widely used tool in the machine learning field to measure the discrepancy between probability distributions. For instance, OT is a popular loss function that quantifies the discrepancy between an empirical distribution and a parametric model. Recently, an entropic penalty term and the celebrated Sinkhorn algorithm have been commonly used to approximate the original OT in a computationally efficient way. However, since the Sinkhorn algorithm runs a projection associated with the Kullback-Leibler divergence, it is often vulnerable to outliers. To overcome this problem, we propose regularizing OT with the β-potential term associated with the so-called $β$-divergence, which was developed in robust statistics. Our theoretical analysis reveals that the $β$-potential can prevent the mass from being transported to outliers. We experimentally demonstrate that the transport matrix computed with our algorithm helps estimate a probability distribution robustly even in the presence of outliers. In addition, our proposed method can successfully detect outliers from a contaminated dataset △ Less

Submitted 26 December, 2022; originally announced December 2022.

EIT: Enhanced Interactive Transformer

Authors: Tong Zheng, Bei Li, Huiwen Bao, Tong Xiao, Jingbo Zhu

Abstract: Two principles: the complementary principle and the consensus principle are widely acknowledged in the literature of multi-view learning. However, the current design of multi-head self-attention, an instance of multi-view learning, prioritizes the complementarity while ignoring the consensus. To address this problem, we propose an enhanced multi-head self-attention (EMHA). First, to satisfy the co… ▽ More Two principles: the complementary principle and the consensus principle are widely acknowledged in the literature of multi-view learning. However, the current design of multi-head self-attention, an instance of multi-view learning, prioritizes the complementarity while ignoring the consensus. To address this problem, we propose an enhanced multi-head self-attention (EMHA). First, to satisfy the complementary principle, EMHA removes the one-to-one mapping constraint among queries and keys in multiple subspaces and allows each query to attend to multiple keys. On top of that, we develop a method to fully encourage consensus among heads by introducing two interaction models, namely inner-subspace interaction and cross-subspace interaction. Extensive experiments on a wide range of language tasks (e.g., machine translation, abstractive summarization and grammar correction, language modeling), show its superiority, with a very modest increase in model size. Our code would be available at: https://github.com/zhengkid/EIT-Enhanced-Interactive-Transformer. △ Less

Submitted 5 June, 2024; v1 submitted 20 December, 2022; originally announced December 2022.

Comments: Accepted by ACL2024 Main

Towards Efficient and Domain-Agnostic Evasion Attack with High-dimensional Categorical Inputs

Authors: Hongyan Bao, Yufei Han, Yujun Zhou, Xin Gao, Xiangliang Zhang

Abstract: Our work targets at searching feasible adversarial perturbation to attack a classifier with high-dimensional categorical inputs in a domain-agnostic setting. This is intrinsically an NP-hard knapsack problem where the exploration space becomes explosively larger as the feature dimension increases. Without the help of domain knowledge, solving this problem via heuristic method, such as Branch-and-B… ▽ More Our work targets at searching feasible adversarial perturbation to attack a classifier with high-dimensional categorical inputs in a domain-agnostic setting. This is intrinsically an NP-hard knapsack problem where the exploration space becomes explosively larger as the feature dimension increases. Without the help of domain knowledge, solving this problem via heuristic method, such as Branch-and-Bound, suffers from exponential complexity, yet can bring arbitrarily bad attack results. We address the challenge via the lens of multi-armed bandit based combinatorial search. Our proposed method, namely FEAT, treats modifying each categorical feature as pulling an arm in multi-armed bandit programming. Our objective is to achieve highly efficient and effective attack using an Orthogonal Matching Pursuit (OMP)-enhanced Upper Confidence Bound (UCB) exploration strategy. Our theoretical analysis bounding the regret gap of FEAT guarantees its practical attack performance. In empirical analysis, we compare FEAT with other state-of-the-art domain-agnostic attack methods over various real-world categorical data sets of different applications. Substantial experimental observations confirm the expected efficiency and attack effectiveness of FEAT applied in different application scenarios. Our work further hints the applicability of FEAT for assessing the adversarial vulnerability of classification systems with high-dimensional categorical inputs. △ Less

Submitted 13 December, 2022; originally announced December 2022.

Comments: AAAI 2023

Power Consumption Modeling of 5G Multi-Carrier Base Stations: A Machine Learning Approach

Authors: Nicola Piovesan, David Lopez-Perez, Antonio De Domenico, Xinli Geng, Harvey Bao

Abstract: The fifth generation of the Radio Access Network (RAN) has brought new services, technologies, and paradigms with the corresponding societal benefits. However, the energy consumption of 5G networks is today a concern. In recent years, the design of new methods for decreasing the RAN power consumption has attracted interest from both the research community and standardization bodies, and many energ… ▽ More The fifth generation of the Radio Access Network (RAN) has brought new services, technologies, and paradigms with the corresponding societal benefits. However, the energy consumption of 5G networks is today a concern. In recent years, the design of new methods for decreasing the RAN power consumption has attracted interest from both the research community and standardization bodies, and many energy savings solutions have been proposed. However, there is still a need to understand the power consumption behavior of state-ofthe-art base station architectures, such as multi-carrier active antenna units (AAUs), as well as the impact of different network parameters. In this paper, we present a power consumption model for 5G AAUs based on artificial neural networks. We demonstrate that this model achieves good estimation performance, and it is able to capture the benefits of energy saving when dealing with the complexity of multi-carrier base stations architectures. Importantly, multiple experiments are carried out to show the advantage of designing a general model able to capture the power consumption behaviors of different types of AAUs. Finally, we provide an analysis of the model scalability and the training data requirements. △ Less

Submitted 8 December, 2022; originally announced December 2022.