-
Neutron Activation Background in the NvDEx Experiment
Authors:
Qianming Wang,
Zeyu Huang,
Pengchong Hu,
Emilio Ciuffoli
Abstract:
An extremely low-background environment is a crucial requirement for any neutrinoless double beta decay experiment. Neutrons are very difficult to stop, because they can pass through the shields and activate nuclei in the detector, even inside the fiducial volume itself. Using Geant4 simulations we have studied the neutron background for N$ν$DEx-100 and the most efficient way to reduce it. Using a…
▽ More
An extremely low-background environment is a crucial requirement for any neutrinoless double beta decay experiment. Neutrons are very difficult to stop, because they can pass through the shields and activate nuclei in the detector, even inside the fiducial volume itself. Using Geant4 simulations we have studied the neutron background for N$ν$DEx-100 and the most efficient way to reduce it. Using a 60 cm thick external HDPE shield the neutron background can be reduced down to $0.24\pm 0.06$ events/year, lower than the background rate due to natural radioactivity (0.42 events/year), which was used as a benchmark for these calculations. The amount of shielding material needed can be significantly reduced by placing HDPE in the empty space between the lead shield and the steel vessel; in this way, it is sufficient to add 20 cm external HDPE shield to reduce the neutron background down to $0.15\pm0.05$ events/year.
△ Less
Submitted 24 July, 2023;
originally announced July 2023.
-
Force-free higher derivative Einstein-Maxwell theory and multi-centered black holes
Authors:
Peng-Ju Hu,
Yi Pang
Abstract:
We investigate which 4-derivative extensions of Einstein-Maxwell theory admit multi-extremal black hole solutions with gravitational force balanced by Coulomb force. We obtain a set of constraints on the 4-derivative couplings by exploring various probe limits in multi-black hole systems. It turns out that these constraints are tighter than those needed to protect the mass-charge ratio of extremal…
▽ More
We investigate which 4-derivative extensions of Einstein-Maxwell theory admit multi-extremal black hole solutions with gravitational force balanced by Coulomb force. We obtain a set of constraints on the 4-derivative couplings by exploring various probe limits in multi-black hole systems. It turns out that these constraints are tighter than those needed to protect the mass-charge ratio of extremal black holes from higher derivative corrections. In fact, they are so strong that the Majumdar-Papapetrou multi-black solutions are unmodified by the force-free combinations of the 4-derivative couplings. Explicit examples of such 4-derivative couplings are given in 4- and 5-spacetime dimensions. Interestingly these include curvature-squared supergravity actions and the quasi-topological $F^4$ term.
△ Less
Submitted 15 September, 2023; v1 submitted 12 July, 2023;
originally announced July 2023.
-
Provably Efficient Iterated CVaR Reinforcement Learning with Function Approximation and Human Feedback
Authors:
Yu Chen,
Yihan Du,
Pihe Hu,
Siwei Wang,
Desheng Wu,
Longbo Huang
Abstract:
Risk-sensitive reinforcement learning (RL) aims to optimize policies that balance the expected reward and risk. In this paper, we present a novel risk-sensitive RL framework that employs an Iterated Conditional Value-at-Risk (CVaR) objective under both linear and general function approximations, enriched by human feedback. These new formulations provide a principled way to guarantee safety in each…
▽ More
Risk-sensitive reinforcement learning (RL) aims to optimize policies that balance the expected reward and risk. In this paper, we present a novel risk-sensitive RL framework that employs an Iterated Conditional Value-at-Risk (CVaR) objective under both linear and general function approximations, enriched by human feedback. These new formulations provide a principled way to guarantee safety in each decision making step throughout the control process. Moreover, integrating human feedback into risk-sensitive RL framework bridges the gap between algorithmic decision-making and human participation, allowing us to also guarantee safety for human-in-the-loop systems. We propose provably sample-efficient algorithms for this Iterated CVaR RL and provide rigorous theoretical analysis. Furthermore, we establish a matching lower bound to corroborate the optimality of our algorithms in a linear context.
△ Less
Submitted 4 December, 2023; v1 submitted 6 July, 2023;
originally announced July 2023.
-
Single-shot 3D photoacoustic computed tomography with a densely packed array for transcranial functional imaging
Authors:
Rui Cao,
Yilin Luo,
Jinhua Xu,
Xiaofei Luo,
Ku Geng,
Yousuf Aborahama,
Manxiu Cui,
Samuel Davis,
Shuai Na,
Xin Tong,
Cindy Liu,
Karteek Sastry,
Konstantin Maslov,
Peng Hu,
Yide Zhang,
Li Lin,
Yang Zhang,
Lihong V. Wang
Abstract:
Photoacoustic computed tomography (PACT) is emerging as a new technique for functional brain imaging, primarily due to its capabilities in label-free hemodynamic imaging. Despite its potential, the transcranial application of PACT has encountered hurdles, such as acoustic attenuations and distortions by the skull and limited light penetration through the skull. To overcome these challenges, we hav…
▽ More
Photoacoustic computed tomography (PACT) is emerging as a new technique for functional brain imaging, primarily due to its capabilities in label-free hemodynamic imaging. Despite its potential, the transcranial application of PACT has encountered hurdles, such as acoustic attenuations and distortions by the skull and limited light penetration through the skull. To overcome these challenges, we have engineered a PACT system that features a densely packed hemispherical ultrasonic transducer array with 3072 channels, operating at a central frequency of 1 MHz. This system allows for single-shot 3D imaging at a rate equal to the laser repetition rate, such as 20 Hz. We have achieved a single-shot light penetration depth of approximately 9 cm in chicken breast tissue utilizing a 750 nm laser (withstanding 3295-fold light attenuation and still retaining an SNR of 74) and successfully performed transcranial imaging through an ex vivo human skull using a 1064 nm laser. Moreover, we have proven the capacity of our system to perform single-shot 3D PACT imaging in both tissue phantoms and human subjects. These results suggest that our PACT system is poised to unlock potential for real-time, in vivo transcranial functional imaging in humans.
△ Less
Submitted 26 June, 2023;
originally announced June 2023.
-
Non-Asymptotic Performance of Social Machine Learning Under Limited Data
Authors:
Ping Hu,
Virginia Bordignon,
Mert Kayaalp,
Ali H. Sayed
Abstract:
This paper studies the probability of error associated with the social machine learning framework, which involves an independent training phase followed by a cooperative decision-making phase over a graph. This framework addresses the problem of classifying a stream of unlabeled data in a distributed manner. In this work, we examine the classification task with limited observations during the deci…
▽ More
This paper studies the probability of error associated with the social machine learning framework, which involves an independent training phase followed by a cooperative decision-making phase over a graph. This framework addresses the problem of classifying a stream of unlabeled data in a distributed manner. In this work, we examine the classification task with limited observations during the decision-making phase, which requires a non-asymptotic performance analysis. We establish a condition for consistent training and derive an upper bound on the probability of error for classification. The results clarify the dependence on the statistical properties of the data and the combination policy used over the graph. They also establish the exponential decay of the probability of error with respect to the number of unlabeled samples.
△ Less
Submitted 9 July, 2024; v1 submitted 15 June, 2023;
originally announced June 2023.
-
Split Federated Learning: Speed up Model Training in Resource-Limited Wireless Networks
Authors:
Songge Zhang,
Wen Wu,
Penghui Hu,
Shaofeng Li,
Ning Zhang
Abstract:
In this paper, we propose a novel distributed learning scheme, named group-based split federated learning (GSFL), to speed up artificial intelligence (AI) model training. Specifically, the GSFL operates in a split-then-federated manner, which consists of three steps: 1) Model distribution, in which the access point (AP) splits the AI models and distributes the client-side models to clients; 2) Mod…
▽ More
In this paper, we propose a novel distributed learning scheme, named group-based split federated learning (GSFL), to speed up artificial intelligence (AI) model training. Specifically, the GSFL operates in a split-then-federated manner, which consists of three steps: 1) Model distribution, in which the access point (AP) splits the AI models and distributes the client-side models to clients; 2) Model training, in which each client executes forward propagation and transmit the smashed data to the edge server. The edge server executes forward and backward propagation and then returns the gradient to the clients for updating local client-side models; and 3) Model aggregation, in which edge servers aggregate the server-side and client-side models. Simulation results show that the GSFL outperforms vanilla split learning and federated learning schemes in terms of overall training latency while achieving satisfactory accuracy.
△ Less
Submitted 30 May, 2023;
originally announced May 2023.
-
Semantic Invariant Multi-view Clustering with Fully Incomplete Information
Authors:
Pengxin Zeng,
Mouxing Yang,
Yiding Lu,
Changqing Zhang,
Peng Hu,
Xi Peng
Abstract:
Robust multi-view learning with incomplete information has received significant attention due to issues such as incomplete correspondences and incomplete instances that commonly affect real-world multi-view applications. Existing approaches heavily rely on paired samples to realign or impute defective ones, but such preconditions cannot always be satisfied in practice due to the complexity of data…
▽ More
Robust multi-view learning with incomplete information has received significant attention due to issues such as incomplete correspondences and incomplete instances that commonly affect real-world multi-view applications. Existing approaches heavily rely on paired samples to realign or impute defective ones, but such preconditions cannot always be satisfied in practice due to the complexity of data collection and transmission. To address this problem, we present a novel framework called SeMantic Invariance LEarning (SMILE) for multi-view clustering with incomplete information that does not require any paired samples. To be specific, we discover the existence of invariant semantic distribution across different views, which enables SMILE to alleviate the cross-view discrepancy to learn consensus semantics without requiring any paired samples. The resulting consensus semantics remain unaffected by cross-view distribution shifts, making them useful for realigning/imputing defective instances and forming clusters. We demonstrate the effectiveness of SMILE through extensive comparison experiments with 13 state-of-the-art baselines on five benchmarks. Our approach improves the clustering accuracy of NoisyMNIST from 19.3\%/23.2\% to 82.7\%/69.0\% when the correspondences/instances are fully incomplete. The code could be accessed from https://pengxi.me.
△ Less
Submitted 21 December, 2023; v1 submitted 22 May, 2023;
originally announced May 2023.
-
SatAIOps: Revamping the Full Life-Cycle Satellite Network Operations
Authors:
Peng Hu
Abstract:
Recently advanced non-geostationary (NGSO) satellite networks represented by large constellations and advanced payloads provide great promises for enabling high-quality Internet connectivity to any place on Earth. However, the traditional approach to satellite operations cannot address the new challenges in the NGSO satellite networks imposed by the significant increase in complexity, security, re…
▽ More
Recently advanced non-geostationary (NGSO) satellite networks represented by large constellations and advanced payloads provide great promises for enabling high-quality Internet connectivity to any place on Earth. However, the traditional approach to satellite operations cannot address the new challenges in the NGSO satellite networks imposed by the significant increase in complexity, security, resilience, and environmental concerns. Therefore, a reliable, sustainable, and efficient approach is required for the entire life-cycle of satellite network operations. This paper provides a timely response to the new challenges and proposes a novel approach called "SatAIOps" as an overall solution. Through our discussion on the current challenges of the advanced satellite networks, SatAIOps and its functional modules in the entire life-cycle of satellites are proposed, with some example technologies given. SatAIOps provides a new perspective for addressing operational challenges with trustworthy and responsible AI technologies. It enables a new framework for evolving and collaborative efforts from research and industry communities.
△ Less
Submitted 17 May, 2023; v1 submitted 15 May, 2023;
originally announced May 2023.
-
Enhancing Datalog Reasoning with Hypertree Decompositions
Authors:
Xinyue Zhang,
Pan Hu,
Yavor Nenov,
Ian Horrocks
Abstract:
Datalog reasoning based on the seminaïve evaluation strategy evaluates rules using traditional join plans, which often leads to redundancy and inefficiency in practice, especially when the rules are complex. Hypertree decompositions help identify efficient query plans and reduce similar redundancy in query answering. However, it is unclear how this can be applied to materialisation and incremental…
▽ More
Datalog reasoning based on the seminaïve evaluation strategy evaluates rules using traditional join plans, which often leads to redundancy and inefficiency in practice, especially when the rules are complex. Hypertree decompositions help identify efficient query plans and reduce similar redundancy in query answering. However, it is unclear how this can be applied to materialisation and incremental reasoning with recursive Datalog programs. Moreover, hypertree decompositions require additional data structures and thus introduce nonnegligible overhead in both runtime and memory consumption. In this paper, we provide algorithms that exploit hypertree decompositions for the materialisation and incremental evaluation of Datalog programs. Furthermore, we combine this approach with standard Datalog reasoning algorithms in a modular fashion so that the overhead caused by the decompositions is reduced. Our empirical evaluation shows that, when the program contains complex rules, the combined approach is usually significantly faster than the baseline approach, sometimes by orders of magnitude.
△ Less
Submitted 15 May, 2023; v1 submitted 11 May, 2023;
originally announced May 2023.
-
Deep Intellectual Property Protection: A Survey
Authors:
Yuchen Sun,
Tianpeng Liu,
Panhe Hu,
Qing Liao,
Shaojing Fu,
Nenghai Yu,
Deke Guo,
Yongxiang Liu,
Li Liu
Abstract:
Deep Neural Networks (DNNs), from AlexNet to ResNet to ChatGPT, have made revolutionary progress in recent years, and are widely used in various fields. The high performance of DNNs requires a huge amount of high-quality data, expensive computing hardware, and excellent DNN architectures that are costly to obtain. Therefore, trained DNNs are becoming valuable assets and must be considered the Inte…
▽ More
Deep Neural Networks (DNNs), from AlexNet to ResNet to ChatGPT, have made revolutionary progress in recent years, and are widely used in various fields. The high performance of DNNs requires a huge amount of high-quality data, expensive computing hardware, and excellent DNN architectures that are costly to obtain. Therefore, trained DNNs are becoming valuable assets and must be considered the Intellectual Property (IP) of the legitimate owner who created them, in order to protect trained DNN models from illegal reproduction, stealing, redistribution, or abuse. Although being a new emerging and interdisciplinary field, numerous DNN model IP protection methods have been proposed. Given this period of rapid evolution, the goal of this paper is to provide a comprehensive survey of two mainstream DNN IP protection methods: deep watermarking and deep fingerprinting, with a proposed taxonomy. More than 190 research contributions are included in this survey, covering many aspects of Deep IP Protection: problem definition, main threats and challenges, merits and demerits of deep watermarking and deep fingerprinting methods, evaluation metrics, and performance discussion. We finish the survey by identifying promising directions for future research.
△ Less
Submitted 17 June, 2023; v1 submitted 27 April, 2023;
originally announced April 2023.
-
Routing Heterogeneous Traffic in Delay-Tolerant Satellite Networks
Authors:
Pablo G. Madoery,
Gunes Karabulut Kurt,
Halim Yanikomeroglu,
Peng Hu,
Khaled Ahmed,
Stéphane Martel,
Guillaume Lamontagne
Abstract:
Delay-tolerant networking (DTN) offers a novel architecture that can be used to enhance store-carry-forward routing in satellite networks. Since these networks can take advantage of scheduled contact plans, distributed algorithms like the Contact Graph Routing (CGR) can be utilized to optimize data delivery performance. However, despite the numerous improvements made to CGR, there is a lack of pro…
▽ More
Delay-tolerant networking (DTN) offers a novel architecture that can be used to enhance store-carry-forward routing in satellite networks. Since these networks can take advantage of scheduled contact plans, distributed algorithms like the Contact Graph Routing (CGR) can be utilized to optimize data delivery performance. However, despite the numerous improvements made to CGR, there is a lack of proposals to prioritize traffic with distinct quality of service (QoS) requirements. This study presents adaptations to CGR to improve QoS-compliant delivery ratio when transmitting traffic with different latency constraints, along with an integer linear programming optimization model that serves as a performance upper bound. The extensive results obtained by simulating different scenarios show that the proposed algorithms can effectively improve the delivery ratio and energy efficiency while meeting latency constraints.
△ Less
Submitted 7 May, 2023; v1 submitted 26 April, 2023;
originally announced April 2023.
-
The ACCompanion: Combining Reactivity, Robustness, and Musical Expressivity in an Automatic Piano Accompanist
Authors:
Carlos Cancino-Chacón,
Silvan Peter,
Patricia Hu,
Emmanouil Karystinaios,
Florian Henkel,
Francesco Foscarin,
Nimrod Varga,
Gerhard Widmer
Abstract:
This paper introduces the ACCompanion, an expressive accompaniment system. Similarly to a musician who accompanies a soloist playing a given musical piece, our system can produce a human-like rendition of the accompaniment part that follows the soloist's choices in terms of tempo, dynamics, and articulation. The ACCompanion works in the symbolic domain, i.e., it needs a musical instrument capable…
▽ More
This paper introduces the ACCompanion, an expressive accompaniment system. Similarly to a musician who accompanies a soloist playing a given musical piece, our system can produce a human-like rendition of the accompaniment part that follows the soloist's choices in terms of tempo, dynamics, and articulation. The ACCompanion works in the symbolic domain, i.e., it needs a musical instrument capable of producing and playing MIDI data, with explicitly encoded onset, offset, and pitch for each played note. We describe the components that go into such a system, from real-time score following and prediction to expressive performance generation and online adaptation to the expressive choices of the human player. Based on our experience with repeated live demonstrations in front of various audiences, we offer an analysis of the challenges of combining these components into a system that is highly reactive and precise, while still a reliable musical partner, robust to possible performance errors and responsive to expressive variations.
△ Less
Submitted 30 May, 2023; v1 submitted 24 April, 2023;
originally announced April 2023.
-
NvDEx-100 Conceptual Design Report
Authors:
X. Cao,
Y. Chang,
K. Chen,
E. Ciuffoli,
L. Duan,
D. Fang,
C. Gao,
S. K. Ghorui,
P. Hu,
Q. Hu,
S. Huang,
Z. Huang,
L. Lang,
Y. Li,
Z. Li,
T. Liang,
J. Liu,
C. Lu,
F. Mai,
Y. Mei,
H. Qiu,
X. Sun,
X. Tang,
H. Wang,
Q. Wang
, et al. (12 additional authors not shown)
Abstract:
Observing nuclear neutrinoless double beta (0vbb) decay would be a revolutionary result in particle physics. Observing such a decay would prove that the neutrinos are their own antiparticles, help to study the absolute mass of neutrinos, explore the origin of their mass, and may explain the matter-antimatter asymmetry in our universe by lepton number violation.
We propose developing a time proje…
▽ More
Observing nuclear neutrinoless double beta (0vbb) decay would be a revolutionary result in particle physics. Observing such a decay would prove that the neutrinos are their own antiparticles, help to study the absolute mass of neutrinos, explore the origin of their mass, and may explain the matter-antimatter asymmetry in our universe by lepton number violation.
We propose developing a time projection chamber (TPC) using high-pressure 82SeF6 gas and top-metal silicon sensors for read-out in the China Jinping Underground Laboratory (CJPL) to search for neutrinoless double beta decay of 82Se, called the NvDEx experiment. Besides being located at CJPL with the world's thickest rock shielding, NvDEx combines the advantages of the high Qbb (2.996 MeV) of 82Se and the TPC's ability to distinguish signal and background events using their different topological characteristics. This makes NvDEx unique, with great potential for low-background and high-sensitivity 0vbb searches.
NvDEx-100, a NvDEx experiment phase with 100 kg of SeF6 gas, is being built, with plans to complete installation at CJPL by 2025. This report introduces 0vbb physics, the NvDEx concept and its advantages, and the schematic design of NvDEx-100, its subsystems, and background and sensitivity estimation.
△ Less
Submitted 1 December, 2023; v1 submitted 17 April, 2023;
originally announced April 2023.
-
Gas selection for Xe-based LCP-GEM detectors onboard the CubeSat X-ray observatory NinjaSat
Authors:
T. Takeda,
T. Tamagawa,
T. Enoto,
T. Kitaguchi,
Y. Kato,
T. Mihara,
W. Iwakiri,
M. Numazawa,
Y. Zhou,
K. Uchiyama,
Y. Yoshida,
N. Ota,
S. Hayashi,
S. Watanabe,
A. Jujo,
H. Sato,
C. P. Hu,
H. Takahashi,
H. Odaka,
T. Tamba,
K. Taniguchi
Abstract:
We present a gas selection for Xe-based gas electron multiplier (GEM) detectors, Gas Multiplier Counters (GMCs) onboard the CubeSat X-ray observatory NinjaSat. To achieve an energy bandpass of 2-50 keV, we decided to use a Xe-based gas mixture at a pressure of 1.2 atm that is sensitive to high-energy X-rays. In addition, an effective gain of over 300 is required for a single GEM so that the 2 keV…
▽ More
We present a gas selection for Xe-based gas electron multiplier (GEM) detectors, Gas Multiplier Counters (GMCs) onboard the CubeSat X-ray observatory NinjaSat. To achieve an energy bandpass of 2-50 keV, we decided to use a Xe-based gas mixture at a pressure of 1.2 atm that is sensitive to high-energy X-rays. In addition, an effective gain of over 300 is required for a single GEM so that the 2 keV X-ray signal can be sufficiently larger than the electrical noise. At first, we measured the effective gains of GEM in nine Xe-based gas mixtures (combinations of Xe, Ar, CO2, CH4, and dimethyl ether; DME) at 1.0 atm. The highest gains were obtained with Xe/Ar/DME mixtures, while relatively lower gains were obtained with Xe/Ar/CO2, Xe/Ar/CH4, and Xe+quencher mixtures. Based on these results, we selected the Xe/Ar/DME (75%/24%/1%) mixture at 1.2 atm as the sealed gas for GMC. Then we investigated the dependence of an effective gain on the electric fields in the drift and induction gaps ranging from 100-650 V cm$^{-1}$ and 500-5000 V cm$^{-1}$, respectively, in the selected gas mixture. The effective gain weakly depended on the drift field while it was almost linearly proportional to the induction field: 2.4 times higher at 5000 V cm$^{-1}$ than at 1000 V cm$^{-1}$. With the optimal induction and drift fields, the flight model GMC achieves an effective gain of 460 with an applied GEM voltage of 590 V.
△ Less
Submitted 19 June, 2023; v1 submitted 17 April, 2023;
originally announced April 2023.
-
Submerse: Visualizing Storm Surge Flooding Simulations in Immersive Display Ecologies
Authors:
Saeed Boorboor,
Yoonsang Kim,
Ping Hu,
Josef M. Moses,
Brian A. Colle,
Arie E. Kaufman
Abstract:
We present Submerse, an end-to-end framework for visualizing flooding scenarios on large and immersive display ecologies. Specifically, we reconstruct a surface mesh from input flood simulation data and generate a to-scale 3D virtual scene by incorporating geographical data such as terrain, textures, buildings, and additional scene objects. To optimize computation and memory performance for large…
▽ More
We present Submerse, an end-to-end framework for visualizing flooding scenarios on large and immersive display ecologies. Specifically, we reconstruct a surface mesh from input flood simulation data and generate a to-scale 3D virtual scene by incorporating geographical data such as terrain, textures, buildings, and additional scene objects. To optimize computation and memory performance for large simulation datasets, we discretize the data on an adaptive grid using dynamic quadtrees and support level-of-detail based rendering. Moreover, to provide a perception of flooding direction for a time instance, we animate the surface mesh by synthesizing water waves. As interaction is key for effective decision-making and analysis, we introduce two novel techniques for flood visualization in immersive systems: (1) an automatic scene-navigation method using optimal camera viewpoints generated for marked points-of-interest based on the display layout, and (2) an AR-based focus+context technique using an auxiliary display system. Submerse is developed in collaboration between computer scientists and atmospheric scientists. We evaluate the effectiveness of our system and application by conducting workshops with emergency managers, domain experts, and concerned stakeholders in the Stony Brook Reality Deck, an immersive gigapixel facility, to visualize a superstorm flooding scenario in New York City.
△ Less
Submitted 13 April, 2023;
originally announced April 2023.
-
NutriFD: Proving the medicinal value of food nutrition based on food-disease association and treatment networks
Authors:
Wanting Su,
Dongwei Liu,
Feng Tan,
Lun Hu,
Pengwei Hu
Abstract:
There is rising evidence of the health benefit associated with specific dietary interventions. Current food-disease databases focus on associations and treatment relationships but haven't provided a reasonable assessment of the strength of the relationship, and lack of attention on food nutrition. There is an unmet need for a large database that can guide dietary therapy. We fill the gap with Nutr…
▽ More
There is rising evidence of the health benefit associated with specific dietary interventions. Current food-disease databases focus on associations and treatment relationships but haven't provided a reasonable assessment of the strength of the relationship, and lack of attention on food nutrition. There is an unmet need for a large database that can guide dietary therapy. We fill the gap with NutriFD, a scoring network based on associations and therapeutic relationships between foods and diseases. NutriFD integrates 9 databases including foods, nutrients, diseases, genes, miRNAs, compounds, disease ontology and their relationships. To our best knowledge, this database is the only one that can score the associations and therapeutic relationships of everyday foods and diseases by weighting inference scores of food compounds to diseases. In addition, NutriFD demonstrates the predictive nature of nutrients on the therapeutic relationships between foods and diseases through machine learning models, laying the foundation for a mechanistic understanding of food therapy.
△ Less
Submitted 17 May, 2023; v1 submitted 10 April, 2023;
originally announced April 2023.
-
Token Boosting for Robust Self-Supervised Visual Transformer Pre-training
Authors:
Tianjiao Li,
Lin Geng Foo,
Ping Hu,
Xindi Shang,
Hossein Rahmani,
Zehuan Yuan,
Jun Liu
Abstract:
Learning with large-scale unlabeled data has become a powerful tool for pre-training Visual Transformers (VTs). However, prior works tend to overlook that, in real-world scenarios, the input data may be corrupted and unreliable. Pre-training VTs on such corrupted data can be challenging, especially when we pre-train via the masked autoencoding approach, where both the inputs and masked ``ground tr…
▽ More
Learning with large-scale unlabeled data has become a powerful tool for pre-training Visual Transformers (VTs). However, prior works tend to overlook that, in real-world scenarios, the input data may be corrupted and unreliable. Pre-training VTs on such corrupted data can be challenging, especially when we pre-train via the masked autoencoding approach, where both the inputs and masked ``ground truth" targets can potentially be unreliable in this case. To address this limitation, we introduce the Token Boosting Module (TBM) as a plug-and-play component for VTs that effectively allows the VT to learn to extract clean and robust features during masked autoencoding pre-training. We provide theoretical analysis to show how TBM improves model pre-training with more robust and generalizable representations, thus benefiting downstream tasks. We conduct extensive experiments to analyze TBM's effectiveness, and results on four corrupted datasets demonstrate that TBM consistently improves performance on downstream tasks.
△ Less
Submitted 12 April, 2023; v1 submitted 9 April, 2023;
originally announced April 2023.
-
Prospects for detection rate of very-high-energy γ-ray emissions from short γ-ray bursts with the HADAR experiment
Authors:
Qi-Ling Chen,
Pei-Jin Hu,
Jing-Jing Su,
Ming-Ming Kang,
Yi-Qing Guo,
Tian-Lu Chen,
Dan-Zeng Luo-Bu,
Yu-fan Fan,
You-Liang Feng,
Qi Gao,
Quan-Bu Gou,
Hong-Bo Hu,
Hai-Jin Li,
Cheng Liu,
Mao-Yuan Liu,
Wei Liu,
Xiang-Li Qian,
Bing-Qiang Qiao,
Hui-Ying Sun,
Xu Wang,
Zhen Wang,
Guang-Guang Xin,
Yu-Hua Yao,
Qiang Yuan,
Yi Zhang
Abstract:
The observation of short gamma ray bursts (SGRBs) in the TeV energy range plays an important role in understanding the radiation mechanism and probing new areas of physics such as Lorentz invariance violation. However, no SGRB has been observed in this energy range due to the short duration of SGRBs and the weakness of current experiments. New experiments with new technology are required to detect…
▽ More
The observation of short gamma ray bursts (SGRBs) in the TeV energy range plays an important role in understanding the radiation mechanism and probing new areas of physics such as Lorentz invariance violation. However, no SGRB has been observed in this energy range due to the short duration of SGRBs and the weakness of current experiments. New experiments with new technology are required to detect sub-TeV SGRBs. In this work, we observe the very high energy (VHE) $γ$-ray emissions from SGRBs and calculate the annual detection rate with the High Altitude Detection of Astronomical Radiation HADAR (HADAR) experiment. First, a set of pseudo-SGRB samples is generated and checked using the observations of Fermi-GBM, Fermi-LAT, and SWIFT measurements. The annual detection rate is calculated from these SGRB samples based on the performance of the HADAR instrument. As a result, the HADAR experiment can detect 0.5 SGRB per year if the spectral break-off of $γ$-rays caused by the internal absorption is larger than 100 GeV. For a GRB09010-like GRB in HADAR's view, it should be possible to detect approximately 2000 photons considering the internal absorption. With a time delay assumption due to the Lorentz invariance violation effects, a simulated light curve of GRB090510 has evident energy dependence. We hope that the HADAR experiment can perform the SGRB observations and test our calculations in the future.
△ Less
Submitted 3 April, 2023; v1 submitted 27 March, 2023;
originally announced March 2023.
-
HRDoc: Dataset and Baseline Method Toward Hierarchical Reconstruction of Document Structures
Authors:
Jiefeng Ma,
Jun Du,
Pengfei Hu,
Zhenrong Zhang,
Jianshu Zhang,
Huihui Zhu,
Cong Liu
Abstract:
The problem of document structure reconstruction refers to converting digital or scanned documents into corresponding semantic structures. Most existing works mainly focus on splitting the boundary of each element in a single document page, neglecting the reconstruction of semantic structure in multi-page documents. This paper introduces hierarchical reconstruction of document structures as a nove…
▽ More
The problem of document structure reconstruction refers to converting digital or scanned documents into corresponding semantic structures. Most existing works mainly focus on splitting the boundary of each element in a single document page, neglecting the reconstruction of semantic structure in multi-page documents. This paper introduces hierarchical reconstruction of document structures as a novel task suitable for NLP and CV fields. To better evaluate the system performance on the new task, we built a large-scale dataset named HRDoc, which consists of 2,500 multi-page documents with nearly 2 million semantic units. Every document in HRDoc has line-level annotations including categories and relations obtained from rule-based extractors and human annotators. Moreover, we proposed an encoder-decoder-based hierarchical document structure parsing system (DSPS) to tackle this problem. By adopting a multi-modal bidirectional encoder and a structure-aware GRU decoder with soft-mask operation, the DSPS model surpass the baseline method by a large margin. All scripts and datasets will be made publicly available at https://github.com/jfma-USTC/HRDoc.
△ Less
Submitted 24 March, 2023;
originally announced March 2023.
-
HAPS-UAV-Enabled Heterogeneous Networks: A Deep Reinforcement Learning Approach
Authors:
Atefeh H. Arani,
Peng Hu,
Yeying Zhu
Abstract:
The integrated use of non-terrestrial network (NTN) entities such as the high-altitude platform station (HAPS) and low-altitude platform station (LAPS) has become essential elements in the space-air-ground integrated networks (SAGINs). However, the complexity, mobility, and heterogeneity of NTN entities and resources present various challenges from system design to deployment. This paper proposes…
▽ More
The integrated use of non-terrestrial network (NTN) entities such as the high-altitude platform station (HAPS) and low-altitude platform station (LAPS) has become essential elements in the space-air-ground integrated networks (SAGINs). However, the complexity, mobility, and heterogeneity of NTN entities and resources present various challenges from system design to deployment. This paper proposes a novel approach to designing a heterogeneous network consisting of HAPSs and unmanned aerial vehicles (UAVs) being LAPS entities. Our approach involves jointly optimizing the three-dimensional trajectory and channel allocation for aerial base stations, with a focus on ensuring fairness and the provision of quality of service (QoS) to ground users. Furthermore, we consider the load on base stations and incorporate this information into the optimization problem. The proposed approach utilizes a combination of deep reinforcement learning and fixed-point iteration techniques to determine the UAV locations and channel allocation strategies. Simulation results reveal that our proposed deep learning-based approach significantly outperforms learning-based and conventional benchmark models.
△ Less
Submitted 22 March, 2023;
originally announced March 2023.
-
General bound states in the continuum in momentum space
Authors:
Qiao Jiang,
Peng Hu,
Jun Wang,
Dezhuan Han,
Jian Zi
Abstract:
Polarization singularities including bound states in the continuum (BICs) and circularly polarized states have provided promising opportunities in the manipulation of light waves. Previous studies show that BICs in photonic crystal slabs are protected by $C_{2}T$ symmetry and hence normally exist on the high-symmetry lines of momentum space. Here, we propose an approach based on graph theory to st…
▽ More
Polarization singularities including bound states in the continuum (BICs) and circularly polarized states have provided promising opportunities in the manipulation of light waves. Previous studies show that BICs in photonic crystal slabs are protected by $C_{2}T$ symmetry and hence normally exist on the high-symmetry lines of momentum space. Here, we propose an approach based on graph theory to study these polarization singularities in momentum space, especially in the region off the high-symmetry lines. With a polarization graph, it is demonstrated for the first time that BICs can stably exist off the high-symmetry lines of momentum space for both one-dimensional and two-dimensional photonic crystal slabs. Furthermore, two kinds of interesting processes, including the merging involved with this newly found BICs both on and off the high-symmetry lines, are observed by merely changing the thickness of photonic crystal slab. Our findings provide a new perspective to explore polarization singularities in momentum space and render their further applications in light-matter interaction and light manipulation.
△ Less
Submitted 21 March, 2023;
originally announced March 2023.
-
Quantification of cervical elasticity during pregnancy based on transvaginal ultrasound imaging and stress measurement
Authors:
Peng Hu,
Peinan Zhao,
Yuan Qu,
Konstantin Maslov,
Jessica Chubiz,
Methodius G. Tuuli,
Molly J. Stout,
Lihong V. Wang
Abstract:
Objective: Strain elastography and shear wave elastography are two commonly used methods to quantify cervical elasticity; however, they have limitations. Strain elastography is effective in showing tissue elasticity distribution in a single image, but the absence of stress information causes difficulty in comparing the results acquired from different imaging sessions. Shear wave elastography is ef…
▽ More
Objective: Strain elastography and shear wave elastography are two commonly used methods to quantify cervical elasticity; however, they have limitations. Strain elastography is effective in showing tissue elasticity distribution in a single image, but the absence of stress information causes difficulty in comparing the results acquired from different imaging sessions. Shear wave elastography is effective in measuring shear wave speed (an intrinsic tissue property correlated with elasticity) in relatively homogeneous tissue, such as in the liver. However, for inhomogeneous tissue in the cervix, the shear wave speed measurement is less robust. To overcome these limitations, we develop a quantitative cervical elastography system by adding a stress sensor to an ultrasound imaging system.
Methods: In an imaging session for quantitative cervical elastography, we use the transvaginal ultrasound imaging system to record B-mode images of the cervix showing its deformation and use the stress sensor to record the probe-surface stress simultaneously. We develop a correlation-based automatic feature tracking algorithm to quantify the deformation, from which the strain is quantified. After each imaging session, we calibrate the stress sensor and transform its measurement to true stress. Applying a linear regression to the stress and strain, we obtain an approximation of the cervical Young's modulus.
Results: We validate the accuracy and robustness of this elastography system using phantom experiments. Applying this system to pregnant participants, we observe significant softening of the cervix during pregnancy (p-value < 0.001) with the cervical Young's modulus decreasing 3.95% per week. We estimate that geometric mean values of cervical Young's moduli during the first (11 to 13 weeks), second, and third trimesters are 13.07 kPa, 7.59 kPa, and 4.40 kPa, respectively.
△ Less
Submitted 9 March, 2023;
originally announced March 2023.
-
SEMv2: Table Separation Line Detection Based on Instance Segmentation
Authors:
Zhenrong Zhang,
Pengfei Hu,
Jiefeng Ma,
Jun Du,
Jianshu Zhang,
Huihui Zhu,
Baocai Yin,
Bing Yin,
Cong Liu
Abstract:
Table structure recognition is an indispensable element for enabling machines to comprehend tables. Its primary purpose is to identify the internal structure of a table. Nevertheless, due to the complexity and diversity of their structure and style, it is highly challenging to parse the tabular data into a structured format that machines can comprehend. In this work, we adhere to the principle of…
▽ More
Table structure recognition is an indispensable element for enabling machines to comprehend tables. Its primary purpose is to identify the internal structure of a table. Nevertheless, due to the complexity and diversity of their structure and style, it is highly challenging to parse the tabular data into a structured format that machines can comprehend. In this work, we adhere to the principle of the split-and-merge based methods and propose an accurate table structure recognizer, termed SEMv2 (SEM: Split, Embed and Merge). Unlike the previous works in the ``split'' stage, we aim to address the table separation line instance-level discrimination problem and introduce a table separation line detection strategy based on conditional convolution. Specifically, we design the ``split'' in a top-down manner that detects the table separation line instance first and then dynamically predicts the table separation line mask for each instance. The final table separation line shape can be accurately obtained by processing the table separation line mask in a row-wise/column-wise manner. To comprehensively evaluate the SEMv2, we also present a more challenging dataset for table structure recognition, dubbed iFLYTAB, which encompasses multiple style tables in various scenarios such as photos, scanned documents, etc. Extensive experiments on publicly available datasets (e.g. SciTSR, PubTabNet and iFLYTAB) demonstrate the efficacy of our proposed approach. The code and iFLYTAB dataset are available at https://github.com/ZZR8066/SEMv2.
△ Less
Submitted 12 January, 2024; v1 submitted 8 March, 2023;
originally announced March 2023.
-
End-to-end Face-swapping via Adaptive Latent Representation Learning
Authors:
Chenhao Lin,
Pengbin Hu,
Chao Shen,
Qian Li
Abstract:
Taking full advantage of the excellent performance of StyleGAN, style transfer-based face swapping methods have been extensively investigated recently. However, these studies require separate face segmentation and blending modules for successful face swapping, and the fixed selection of the manipulated latent code in these works is reckless, thus degrading face swapping quality, generalizability,…
▽ More
Taking full advantage of the excellent performance of StyleGAN, style transfer-based face swapping methods have been extensively investigated recently. However, these studies require separate face segmentation and blending modules for successful face swapping, and the fixed selection of the manipulated latent code in these works is reckless, thus degrading face swapping quality, generalizability, and practicability. This paper proposes a novel and end-to-end integrated framework for high resolution and attribute preservation face swapping via Adaptive Latent Representation Learning. Specifically, we first design a multi-task dual-space face encoder by sharing the underlying feature extraction network to simultaneously complete the facial region perception and face encoding. This encoder enables us to control the face pose and attribute individually, thus enhancing the face swapping quality. Next, we propose an adaptive latent codes swapping module to adaptively learn the mapping between the facial attributes and the latent codes and select effective latent codes for improved retention of facial attributes. Finally, the initial face swapping image generated by StyleGAN2 is blended with the facial region mask generated by our encoder to address the background blur problem. Our framework integrating facial perceiving and blending into the end-to-end training and testing process can achieve high realistic face-swapping on wild faces without segmentation masks. Experimental results demonstrate the superior performance of our approach over state-of-the-art methods.
△ Less
Submitted 7 March, 2023;
originally announced March 2023.
-
Point Cloud Forecasting as a Proxy for 4D Occupancy Forecasting
Authors:
Tarasha Khurana,
Peiyun Hu,
David Held,
Deva Ramanan
Abstract:
Predicting how the world can evolve in the future is crucial for motion planning in autonomous systems. Classical methods are limited because they rely on costly human annotations in the form of semantic class labels, bounding boxes, and tracks or HD maps of cities to plan their motion and thus are difficult to scale to large unlabeled datasets. One promising self-supervised task is 3D point cloud…
▽ More
Predicting how the world can evolve in the future is crucial for motion planning in autonomous systems. Classical methods are limited because they rely on costly human annotations in the form of semantic class labels, bounding boxes, and tracks or HD maps of cities to plan their motion and thus are difficult to scale to large unlabeled datasets. One promising self-supervised task is 3D point cloud forecasting from unannotated LiDAR sequences. We show that this task requires algorithms to implicitly capture (1) sensor extrinsics (i.e., the egomotion of the autonomous vehicle), (2) sensor intrinsics (i.e., the sampling pattern specific to the particular LiDAR sensor), and (3) the shape and motion of other objects in the scene. But autonomous systems should make predictions about the world and not their sensors. To this end, we factor out (1) and (2) by recasting the task as one of spacetime (4D) occupancy forecasting. But because it is expensive to obtain ground-truth 4D occupancy, we render point cloud data from 4D occupancy predictions given sensor extrinsics and intrinsics, allowing one to train and test occupancy algorithms with unannotated LiDAR sequences. This also allows one to evaluate and compare point cloud forecasting algorithms across diverse datasets, sensors, and vehicles.
△ Less
Submitted 30 April, 2023; v1 submitted 25 February, 2023;
originally announced February 2023.
-
Correspondence-Free Domain Alignment for Unsupervised Cross-Domain Image Retrieval
Authors:
Xu Wang,
Dezhong Peng,
Ming Yan,
Peng Hu
Abstract:
Cross-domain image retrieval aims at retrieving images across different domains to excavate cross-domain classificatory or correspondence relationships. This paper studies a less-touched problem of cross-domain image retrieval, i.e., unsupervised cross-domain image retrieval, considering the following practical assumptions: (i) no correspondence relationship, and (ii) no category annotations. It i…
▽ More
Cross-domain image retrieval aims at retrieving images across different domains to excavate cross-domain classificatory or correspondence relationships. This paper studies a less-touched problem of cross-domain image retrieval, i.e., unsupervised cross-domain image retrieval, considering the following practical assumptions: (i) no correspondence relationship, and (ii) no category annotations. It is challenging to align and bridge distinct domains without cross-domain correspondence. To tackle the challenge, we present a novel Correspondence-free Domain Alignment (CoDA) method to effectively eliminate the cross-domain gap through In-domain Self-matching Supervision (ISS) and Cross-domain Classifier Alignment (CCA). To be specific, ISS is presented to encapsulate discriminative information into the latent common space by elaborating a novel self-matching supervision mechanism. To alleviate the cross-domain discrepancy, CCA is proposed to align distinct domain-specific classifiers. Thanks to the ISS and CCA, our method could encode the discrimination into the domain-invariant embedding space for unsupervised cross-domain image retrieval. To verify the effectiveness of the proposed method, extensive experiments are conducted on four benchmark datasets compared with six state-of-the-art methods.
△ Less
Submitted 23 March, 2023; v1 submitted 12 February, 2023;
originally announced February 2023.
-
Satellite Anomaly Detection Using Variance Based Genetic Ensemble of Neural Networks
Authors:
Mohammad Amin Maleki Sadr,
Yeying Zhu,
Peng Hu
Abstract:
In this paper, we use a variance-based genetic ensemble (VGE) of Neural Networks (NNs) to detect anomalies in the satellite's historical data. We use an efficient ensemble of the predictions from multiple Recurrent Neural Networks (RNNs) by leveraging each model's uncertainty level (variance). For prediction, each RNN is guided by a Genetic Algorithm (GA) which constructs the optimal structure for…
▽ More
In this paper, we use a variance-based genetic ensemble (VGE) of Neural Networks (NNs) to detect anomalies in the satellite's historical data. We use an efficient ensemble of the predictions from multiple Recurrent Neural Networks (RNNs) by leveraging each model's uncertainty level (variance). For prediction, each RNN is guided by a Genetic Algorithm (GA) which constructs the optimal structure for each RNN model. However, finding the model uncertainty level is challenging in many cases. Although the Bayesian NNs (BNNs)-based methods are popular for providing the confidence bound of the models, they cannot be employed in complex NN structures as they are computationally intractable. This paper uses the Monte Carlo (MC) dropout as an approximation version of BNNs. Then these uncertainty levels and each predictive model suggested by GA are used to generate a new model, which is then used for forecasting the TS and AD. Simulation results show that the forecasting and AD capability of the ensemble model outperforms existing approaches.
△ Less
Submitted 10 February, 2023;
originally announced February 2023.
-
Open data from the third observing run of LIGO, Virgo, KAGRA and GEO
Authors:
The LIGO Scientific Collaboration,
the Virgo Collaboration,
the KAGRA Collaboration,
R. Abbott,
H. Abe,
F. Acernese,
K. Ackley,
S. Adhicary,
N. Adhikari,
R. X. Adhikari,
V. K. Adkins,
V. B. Adya,
C. Affeldt,
D. Agarwal,
M. Agathos,
O. D. Aguiar,
L. Aiello,
A. Ain,
P. Ajith,
T. Akutsu,
S. Albanesi,
R. A. Alfaidi,
A. Al-Jodah,
C. Alléné,
A. Allocca
, et al. (1719 additional authors not shown)
Abstract:
The global network of gravitational-wave observatories now includes five detectors, namely LIGO Hanford, LIGO Livingston, Virgo, KAGRA, and GEO 600. These detectors collected data during their third observing run, O3, composed of three phases: O3a starting in April of 2019 and lasting six months, O3b starting in November of 2019 and lasting five months, and O3GK starting in April of 2020 and lasti…
▽ More
The global network of gravitational-wave observatories now includes five detectors, namely LIGO Hanford, LIGO Livingston, Virgo, KAGRA, and GEO 600. These detectors collected data during their third observing run, O3, composed of three phases: O3a starting in April of 2019 and lasting six months, O3b starting in November of 2019 and lasting five months, and O3GK starting in April of 2020 and lasting 2 weeks. In this paper we describe these data and various other science products that can be freely accessed through the Gravitational Wave Open Science Center at https://gwosc.org. The main dataset, consisting of the gravitational-wave strain time series that contains the astrophysical signals, is released together with supporting data useful for their analysis and documentation, tutorials, as well as analysis software packages.
△ Less
Submitted 7 February, 2023;
originally announced February 2023.
-
Turbidity currents propagating down an inclined slope: particle auto-suspension
Authors:
Jiafeng Xie,
Peng Hu,
Chenlin Zhu,
Zhaosheng Yu,
Thomas Pähtz
Abstract:
The Turbidity current (TC), a ubiquitous fluid-particle coupled phenomenon in the natural environment and engineering, can transport over long distances on an inclined terrain due to the suspension mechanism. A large-eddy simulation and discrete element method coupled model is employed to simulate the particle-laden gravity currents over the inclined slope in order to investigate the auto-suspensi…
▽ More
The Turbidity current (TC), a ubiquitous fluid-particle coupled phenomenon in the natural environment and engineering, can transport over long distances on an inclined terrain due to the suspension mechanism. A large-eddy simulation and discrete element method coupled model is employed to simulate the particle-laden gravity currents over the inclined slope in order to investigate the auto-suspension mechanism from a Lagrangian perspective. The particle Reynolds number in our TC simulation is $0.01\sim0.1$ and the slope angle is $1/20 \sim 1/5$. The influences of initial particle concentration and terrain slope on the particle flow regimes, particle movement patterns, fluid-particle interactions, energy budget and auto-suspension index are explored. The results indicate that the auto-suspension particles predominantly appear near the current head and their number increases and then decreases during the current evolution, which is positively correlated with the coherent structures around the head. When the turbidity current propagates downstream, the average particle Reynolds number of the auto-suspension particles remains basically unchanged, and is higher than that of other transported particles. The average particle Reynolds number of the transported particles exhibits a negative correlation with the Reynolds number of the current. Furthermore, the increase in particle concentration will enhance the particle velocity, which allows the turbidity current to advance faster and improves the perpendicular support, thereby increasing the turbidity current auto-suspension capacity. Increasing slope angle will result in a slightly larger front velocity, while the effect of that on the total force is insignificant.
△ Less
Submitted 3 February, 2023;
originally announced February 2023.
-
Incomplete Multi-view Clustering via Prototype-based Imputation
Authors:
Haobin Li,
Yunfan Li,
Mouxing Yang,
Peng Hu,
Dezhong Peng,
Xi Peng
Abstract:
In this paper, we study how to achieve two characteristics highly-expected by incomplete multi-view clustering (IMvC). Namely, i) instance commonality refers to that within-cluster instances should share a common pattern, and ii) view versatility refers to that cross-view samples should own view-specific patterns. To this end, we design a novel dual-stream model which employs a dual attention laye…
▽ More
In this paper, we study how to achieve two characteristics highly-expected by incomplete multi-view clustering (IMvC). Namely, i) instance commonality refers to that within-cluster instances should share a common pattern, and ii) view versatility refers to that cross-view samples should own view-specific patterns. To this end, we design a novel dual-stream model which employs a dual attention layer and a dual contrastive learning loss to learn view-specific prototypes and model the sample-prototype relationship. When the view is missed, our model performs data recovery using the prototypes in the missing view and the sample-prototype relationship inherited from the observed view. Thanks to our dual-stream model, both cluster- and view-specific information could be captured, and thus the instance commonality and view versatility could be preserved to facilitate IMvC. Extensive experiments demonstrate the superiority of our method on six challenging benchmarks compared with 11 approaches. The code will be released.
△ Less
Submitted 29 January, 2023; v1 submitted 26 January, 2023;
originally announced January 2023.
-
Laser Inter-Satellite Link Setup Delay: Quantification, Impact, and Tolerable Value
Authors:
Dhiraj Bhattacharjee,
Aizaz U. Chaudhry,
Halim Yanikomeroglu,
Peng Hu,
Guillaume Lamontagne
Abstract:
Dynamic laser inter-satellite links (LISLs) provide the flexibility of connecting a pair of satellites as required (dynamically) while static LISLs need to be active continuously between the energy-constrained satellites. However, due to the LISL establishment time (termed herein as LISL setup delay) being in the order of seconds, realizing dynamic LISLs is currently unfeasible. Towards the realiz…
▽ More
Dynamic laser inter-satellite links (LISLs) provide the flexibility of connecting a pair of satellites as required (dynamically) while static LISLs need to be active continuously between the energy-constrained satellites. However, due to the LISL establishment time (termed herein as LISL setup delay) being in the order of seconds, realizing dynamic LISLs is currently unfeasible. Towards the realization of dynamic LISLs, we first study the quantification of LISL setup delay; then we calculate the end-to-end latency of a free-space optical satellite network (FSOSN) with the LISL setup delay; subsequently, we analyze the impact of LISL setup delay on the end-to-end latency of the FSOSN. We also provide design guidelines for the laser communication terminal manufacturers in the form of maximum tolerable value of LISL setup delay for which the FSOSN based on Starlink's Phase I satellite constellation will be meaningful to use for low-latency long-distance inter-continental data communications.
△ Less
Submitted 12 January, 2023;
originally announced January 2023.
-
SatNetOps: Toward Multi-Layer Networking for Satellite Network Operations
Authors:
Peng Hu
Abstract:
Recent advancements in low-Earth-orbit (LEO) satellites aim to bring resilience, ubiquitous, and high-quality service to future Internet infrastructure. However, the soaring number of space assets, increasing dynamics of LEO satellites and expanding dimensions of network threats call for an enhanced approach to efficient satellite operations. To address these pressing challenges, we propose an app…
▽ More
Recent advancements in low-Earth-orbit (LEO) satellites aim to bring resilience, ubiquitous, and high-quality service to future Internet infrastructure. However, the soaring number of space assets, increasing dynamics of LEO satellites and expanding dimensions of network threats call for an enhanced approach to efficient satellite operations. To address these pressing challenges, we propose an approach for satellite network operations based on multi-layer satellite networking (MLSN), called "SatNetOps". Two SatNetOps schemes are proposed, referred to as LEO-LEO MLSN (LLM) and GEO-LEO MLSN (GLM). The performance of the proposed schemes is evaluated in 24-hr satellite scenarios with typical payload setups in simulations, where the key metrics such as latency and reliability are discussed with the consideration of the Consultative Committee for Space Data Systems (CCSDS) standard-compliant telemetry and telecommand missions. Although the SatNetOps approach is promising, we analyze the factors affecting the performance of the LLM and GLM schemes. The discussions on the results and conclusive remarks are made in the end.
△ Less
Submitted 9 January, 2023;
originally announced January 2023.
-
Boosting Neural Networks to Decompile Optimized Binaries
Authors:
Ying Cao,
Ruigang Liang,
Kai Chen,
Peiwei Hu
Abstract:
Decompilation aims to transform a low-level program language (LPL) (eg., binary file) into its functionally-equivalent high-level program language (HPL) (e.g., C/C++). It is a core technology in software security, especially in vulnerability discovery and malware analysis. In recent years, with the successful application of neural machine translation (NMT) models in natural language processing (NL…
▽ More
Decompilation aims to transform a low-level program language (LPL) (eg., binary file) into its functionally-equivalent high-level program language (HPL) (e.g., C/C++). It is a core technology in software security, especially in vulnerability discovery and malware analysis. In recent years, with the successful application of neural machine translation (NMT) models in natural language processing (NLP), researchers have tried to build neural decompilers by borrowing the idea of NMT. They formulate the decompilation process as a translation problem between LPL and HPL, aiming to reduce the human cost required to develop decompilation tools and improve their generalizability. However, state-of-the-art learning-based decompilers do not cope well with compiler-optimized binaries. Since real-world binaries are mostly compiler-optimized, decompilers that do not consider optimized binaries have limited practical significance. In this paper, we propose a novel learning-based approach named NeurDP, that targets compiler-optimized binaries. NeurDP uses a graph neural network (GNN) model to convert LPL to an intermediate representation (IR), which bridges the gap between source code and optimized binary. We also design an Optimized Translation Unit (OTU) to split functions into smaller code fragments for better translation performance. Evaluation results on datasets containing various types of statements show that NeurDP can decompile optimized binaries with 45.21% higher accuracy than state-of-the-art neural decompilation frameworks.
△ Less
Submitted 3 January, 2023;
originally announced January 2023.
-
A Cross-Layer Descent Approach for Resilient Network Operations of Proliferated LEO Satellites
Authors:
Peng Hu
Abstract:
With the proliferated low-Earth-orbit (LEO) satellites in mega-constellations, the future Internet will be able to reach any place on Earth, providing high-quality services to everyone. However, high-quality operations in terms of timeliness and resilience are lacking in the current solutions. This paper proposes a multi-layer networking approach called "Cross-Layer Descent (CLD)". Based on the pr…
▽ More
With the proliferated low-Earth-orbit (LEO) satellites in mega-constellations, the future Internet will be able to reach any place on Earth, providing high-quality services to everyone. However, high-quality operations in terms of timeliness and resilience are lacking in the current solutions. This paper proposes a multi-layer networking approach called "Cross-Layer Descent (CLD)". Based on the proposed system model, principles, and measures, CLD can support foundational services such as telecommand (TC) transmissions for various network operation missions for LEO satellites compliant with the Consultative Committee for Space Data Systems (CCSDS) standards. The CLD approach enhances timing and resilience requirements using advanced communication payloads. From the simulation-based analysis, the proposed scheme outperforms other classical ones in resilience and latency for typical TC missions. The future work and conclusive remarks are discussed at the end.
△ Less
Submitted 12 December, 2022;
originally announced December 2022.
-
Relationship Quantification of Image Degradations
Authors:
Wenxin Wang,
Boyun Li,
Yuanbiao Gou,
Peng Hu,
Wangmeng Zuo,
Xi Peng
Abstract:
In this paper, we study two challenging but less-touched problems in image restoration, namely, i) how to quantify the relationship between image degradations and ii) how to improve the performance of a specific restoration task using the quantified relationship. To tackle the first challenge, we proposed a Degradation Relationship Index (DRI) which is defined as the mean drop rate difference in t…
▽ More
In this paper, we study two challenging but less-touched problems in image restoration, namely, i) how to quantify the relationship between image degradations and ii) how to improve the performance of a specific restoration task using the quantified relationship. To tackle the first challenge, we proposed a Degradation Relationship Index (DRI) which is defined as the mean drop rate difference in the validation loss between two models which are respectively trained using the anchor degradation and the mixture of the anchor and the auxiliary degradations. Through quantifying the degradation relationship using DRI, we reveal that i) a positive DRI always predicts performance improvement by using the specific degradation as an auxiliary to train models; ii) the degradation proportion is crucial to the image restoration performance. In other words, the restoration performance is improved only if the anchor and the auxiliary degradations are mixed with an appropriate proportion. Based on the observations, we further propose a simple but effective method (dubbed DPD) to estimate whether the given degradation combinations could improve the performance on the anchor degradation with the assistance of the auxiliary degradation. Extensive experimental results verify the effectiveness of our method in dehazing, denoising, deraining, and desnowing. The code will be released after acceptance.
△ Less
Submitted 5 August, 2023; v1 submitted 8 December, 2022;
originally announced December 2022.
-
Graph Matching with Bi-level Noisy Correspondence
Authors:
Yijie Lin,
Mouxing Yang,
Jun Yu,
Peng Hu,
Changqing Zhang,
Xi Peng
Abstract:
In this paper, we study a novel and widely existing problem in graph matching (GM), namely, Bi-level Noisy Correspondence (BNC), which refers to node-level noisy correspondence (NNC) and edge-level noisy correspondence (ENC). In brief, on the one hand, due to the poor recognizability and viewpoint differences between images, it is inevitable to inaccurately annotate some keypoints with offset and…
▽ More
In this paper, we study a novel and widely existing problem in graph matching (GM), namely, Bi-level Noisy Correspondence (BNC), which refers to node-level noisy correspondence (NNC) and edge-level noisy correspondence (ENC). In brief, on the one hand, due to the poor recognizability and viewpoint differences between images, it is inevitable to inaccurately annotate some keypoints with offset and confusion, leading to the mismatch between two associated nodes, i.e., NNC. On the other hand, the noisy node-to-node correspondence will further contaminate the edge-to-edge correspondence, thus leading to ENC. For the BNC challenge, we propose a novel method termed Contrastive Matching with Momentum Distillation. Specifically, the proposed method is with a robust quadratic contrastive loss which enjoys the following merits: i) better exploring the node-to-node and edge-to-edge correlations through a GM customized quadratic contrastive learning paradigm; ii) adaptively penalizing the noisy assignments based on the confidence estimated by the momentum teacher. Extensive experiments on three real-world datasets show the robustness of our model compared with 12 competitive baselines. The code is available at https://github.com/XLearning-SCU/2023-ICCV-COMMON.
△ Less
Submitted 5 August, 2023; v1 submitted 8 December, 2022;
originally announced December 2022.
-
Enabling Resilient and Real-Time Network Operations in Space: A Novel Multi-Layer Satellite Networking Scheme
Authors:
Peng Hu
Abstract:
Recently advanced low-Earth-orbit (LEO) satellite networks represented by large constellations and advanced payloads provide great promises for enabling high-quality Internet connectivity to any place on Earth. However, the traditional access-based approach to satellite operations cannot meet the pressing requirements of real-time, reliable, and resilient operations for LEO satellites. A new schem…
▽ More
Recently advanced low-Earth-orbit (LEO) satellite networks represented by large constellations and advanced payloads provide great promises for enabling high-quality Internet connectivity to any place on Earth. However, the traditional access-based approach to satellite operations cannot meet the pressing requirements of real-time, reliable, and resilient operations for LEO satellites. A new scheme is proposed based on multi-layer satellite networking considering the advanced Ka-band and optical communications payloads on a satellite platform. The proposed scheme can enable efficient and resilient message transmissions for critical telecommand and telemetry missions through different layers of satellite networks, which consist of LEO, medium-Earth-orbit (MEO), and geostationary (GEO) satellites. The proposed scheme is evaluated in a 24-hr satellite mission and shows superior performance improvements compared to the traditional operations approach.
△ Less
Submitted 7 December, 2022;
originally announced December 2022.
-
Multimodal Tree Decoder for Table of Contents Extraction in Document Images
Authors:
Pengfei Hu,
Zhenrong Zhang,
Jianshu Zhang,
Jun Du,
Jiajia Wu
Abstract:
Table of contents (ToC) extraction aims to extract headings of different levels in documents to better understand the outline of the contents, which can be widely used for document understanding and information retrieval. Existing works often use hand-crafted features and predefined rule-based functions to detect headings and resolve the hierarchical relationship between headings. Both the benchma…
▽ More
Table of contents (ToC) extraction aims to extract headings of different levels in documents to better understand the outline of the contents, which can be widely used for document understanding and information retrieval. Existing works often use hand-crafted features and predefined rule-based functions to detect headings and resolve the hierarchical relationship between headings. Both the benchmark and research based on deep learning are still limited. Accordingly, in this paper, we first introduce a standard dataset, HierDoc, including image samples from 650 documents of scientific papers with their content labels. Then we propose a novel end-to-end model by using the multimodal tree decoder (MTD) for ToC as a benchmark for HierDoc. The MTD model is mainly composed of three parts, namely encoder, classifier, and decoder. The encoder fuses the multimodality features of vision, text, and layout information for each entity of the document. Then the classifier recognizes and selects the heading entities. Next, to parse the hierarchical relationship between the heading entities, a tree-structured decoder is designed. To evaluate the performance, both the metric of tree-edit-distance similarity (TEDS) and F1-Measure are adopted. Finally, our MTD approach achieves an average TEDS of 87.2% and an average F1-Measure of 88.1% on the test set of HierDoc. The code and dataset will be released at: https://github.com/Pengfei-Hu/MTD.
△ Less
Submitted 6 December, 2022;
originally announced December 2022.
-
AccEar: Accelerometer Acoustic Eavesdropping with Unconstrained Vocabulary
Authors:
Pengfei Hu,
Hui Zhuang,
Panneer Selvam Santhalingamy,
Riccardo Spolaor,
Parth Pathaky,
Guoming Zhang,
Xiuzhen Cheng
Abstract:
With the increasing popularity of voice-based applications, acoustic eavesdropping has become a serious threat to users' privacy. While on smartphones the access to microphones needs an explicit user permission, acoustic eavesdropping attacks can rely on motion sensors (such as accelerometer and gyroscope), which access is unrestricted. However, previous instances of such attacks can only recogniz…
▽ More
With the increasing popularity of voice-based applications, acoustic eavesdropping has become a serious threat to users' privacy. While on smartphones the access to microphones needs an explicit user permission, acoustic eavesdropping attacks can rely on motion sensors (such as accelerometer and gyroscope), which access is unrestricted. However, previous instances of such attacks can only recognize a limited set of pre-trained words or phrases. In this paper, we present AccEar, an accelerometerbased acoustic eavesdropping attack that can reconstruct any audio played on the smartphone's loudspeaker with unconstrained vocabulary. We show that an attacker can employ a conditional Generative Adversarial Network (cGAN) to reconstruct highfidelity audio from low-frequency accelerometer signals. The presented cGAN model learns to recreate high-frequency components of the user's voice from low-frequency accelerometer signals through spectrogram enhancement. We assess the feasibility and effectiveness of AccEar attack in a thorough set of experiments using audio from 16 public personalities. As shown by the results in both objective and subjective evaluations, AccEar successfully reconstructs user speeches from accelerometer signals in different scenarios including varying sampling rate, audio volume, device model, etc.
△ Less
Submitted 2 December, 2022;
originally announced December 2022.
-
Evidence of a decreasing trend for the Hubble constant
Authors:
X. D. Jia,
J. P. Hu,
F. Y. Wang
Abstract:
The current discrepancy between the Hubble constant $H_0$ derived from the local distance ladder and from the cosmic microwave background is one of the most crucial issues in cosmology, as it possibly indicates unknown systematics or new physics. Here we present a novel non-parametric method to estimate Hubble constant as a function of redshift. We establish independent estimates of the evolution…
▽ More
The current discrepancy between the Hubble constant $H_0$ derived from the local distance ladder and from the cosmic microwave background is one of the most crucial issues in cosmology, as it possibly indicates unknown systematics or new physics. Here we present a novel non-parametric method to estimate Hubble constant as a function of redshift. We establish independent estimates of the evolution of Hubble constant by diagonalizing the covariance matrix. From type Ia supernovae and the observed Hubble parameter data, a decreasing trend of Hubble constant with a significance of 5.6$σ$ confidence level is found. At low redshift, its value is dramatically consistent with that measured from the local distance ladder, and it drops to the value measured from the cosmic microwave background at high redshift. Our results can relieve the Hubble tension, and prefer the late-time solutions of it, especially the new physics.
△ Less
Submitted 14 April, 2023; v1 submitted 30 November, 2022;
originally announced December 2022.
-
An Anomaly Detection Method for Satellites Using Monte Carlo Dropout
Authors:
Mohammad Amin Maleki Sadr,
Yeying Zhu,
Peng Hu
Abstract:
Recently, there has been a significant amount of interest in satellite telemetry anomaly detection (AD) using neural networks (NN). For AD purposes, the current approaches focus on either forecasting or reconstruction of the time series, and they cannot measure the level of reliability or the probability of correct detection. Although the Bayesian neural network (BNN)-based approaches are well kno…
▽ More
Recently, there has been a significant amount of interest in satellite telemetry anomaly detection (AD) using neural networks (NN). For AD purposes, the current approaches focus on either forecasting or reconstruction of the time series, and they cannot measure the level of reliability or the probability of correct detection. Although the Bayesian neural network (BNN)-based approaches are well known for time series uncertainty estimation, they are computationally intractable. In this paper, we present a tractable approximation for BNN based on the Monte Carlo (MC) dropout method for capturing the uncertainty in the satellite telemetry time series, without sacrificing accuracy. For time series forecasting, we employ an NN, which consists of several Long Short-Term Memory (LSTM) layers followed by various dense layers. We employ the MC dropout inside each LSTM layer and before the dense layers for uncertainty estimation. With the proposed uncertainty region and by utilizing a post-processing filter, we can effectively capture the anomaly points. Numerical results show that our proposed time series AD approach outperforms the existing methods from both prediction accuracy and AD perspectives.
△ Less
Submitted 27 November, 2022;
originally announced November 2022.
-
UAV-Assisted Space-Air-Ground Integrated Networks: A Technical Review of Recent Learning Algorithms
Authors:
Atefeh H. Arani,
Peng Hu,
Yeying Zhu
Abstract:
Recent technological advancements in space, air, and ground components have made possible a new network paradigm called space-air-ground integrated network (SAGIN). Unmanned aerial vehicles (UAVs) play a key role in SAGINs. However, due to UAVs' high dynamics and complexity, real-world deployment of a SAGIN becomes a significant barrier to realizing such SAGINs. UAVs are expected to meet key perfo…
▽ More
Recent technological advancements in space, air, and ground components have made possible a new network paradigm called space-air-ground integrated network (SAGIN). Unmanned aerial vehicles (UAVs) play a key role in SAGINs. However, due to UAVs' high dynamics and complexity, real-world deployment of a SAGIN becomes a significant barrier to realizing such SAGINs. UAVs are expected to meet key performance requirements with limited maneuverability and resources with space and terrestrial components. Therefore, employing UAVs in various usage scenarios requires well-designed planning in algorithmic approaches. This paper provides an essential review and analysis of recent learning algorithms in a UAV-assisted SAGIN. We consider possible reward functions and discuss the state-of-the-art algorithms for optimizing the reward functions, including Q-learning, deep Q-learning, multi-armed bandit, particle swarm optimization, and satisfaction-based learning algorithms. Unlike other survey papers, we focus on the methodological perspective of the optimization problem, applicable to various missions on a SAGIN. We consider real-world configurations and the 2-dimensional (2D) and 3-dimensional (3D) UAV trajectories to reflect deployment cases. Our simulations suggest the 3D satisfaction-based learning algorithm outperforms other approaches in most cases. With open challenges discussed at the end, we aim to provide design and deployment guidelines for UAV-assisted SAGINs.
△ Less
Submitted 16 July, 2024; v1 submitted 27 November, 2022;
originally announced November 2022.
-
Federated Learning Hyper-Parameter Tuning from a System Perspective
Authors:
Huanle Zhang,
Lei Fu,
Mi Zhang,
Pengfei Hu,
Xiuzhen Cheng,
Prasant Mohapatra,
Xin Liu
Abstract:
Federated learning (FL) is a distributed model training paradigm that preserves clients' data privacy. It has gained tremendous attention from both academia and industry. FL hyper-parameters (e.g., the number of selected clients and the number of training passes) significantly affect the training overhead in terms of computation time, transmission time, computation load, and transmission load. How…
▽ More
Federated learning (FL) is a distributed model training paradigm that preserves clients' data privacy. It has gained tremendous attention from both academia and industry. FL hyper-parameters (e.g., the number of selected clients and the number of training passes) significantly affect the training overhead in terms of computation time, transmission time, computation load, and transmission load. However, the current practice of manually selecting FL hyper-parameters imposes a heavy burden on FL practitioners because applications have different training preferences. In this paper, we propose FedTune, an automatic FL hyper-parameter tuning algorithm tailored to applications' diverse system requirements in FL training. FedTune iteratively adjusts FL hyper-parameters during FL training and can be easily integrated into existing FL systems. Through extensive evaluations of FedTune for diverse applications and FL aggregation algorithms, we show that FedTune is lightweight and effective, achieving 8.48%-26.75% system overhead reduction compared to using fixed FL hyper-parameters. This paper assists FL practitioners in designing high-performance FL training solutions. The source code of FedTune is available at https://github.com/DataSysTech/FedTune.
△ Less
Submitted 24 November, 2022;
originally announced November 2022.
-
Learning Invariant Rules from Data for Interpretable Anomaly Detection
Authors:
Cheng Feng,
Pingge Hu
Abstract:
In the research area of anomaly detection, novel and promising methods are frequently developed. However, most existing studies exclusively focus on the detection task only and ignore the interpretability of the underlying models as well as their detection results. Nevertheless, anomaly interpretation, which aims to provide explanation of why specific data instances are identified as anomalies, is…
▽ More
In the research area of anomaly detection, novel and promising methods are frequently developed. However, most existing studies exclusively focus on the detection task only and ignore the interpretability of the underlying models as well as their detection results. Nevertheless, anomaly interpretation, which aims to provide explanation of why specific data instances are identified as anomalies, is an equally important task in many real-world applications. In this work, we propose a novel framework which synergizes several machine learning and data mining techniques to automatically learn invariant rules that are consistently satisfied in a given dataset. The learned invariant rules can provide explicit explanation of anomaly detection results in the inference phase and thus are extremely useful for subsequent decision-making regarding reported anomalies. Furthermore, our empirical evaluation shows that the proposed method can also achieve comparable or even better performance in terms of AUC and partial AUC on public benchmark datasets across various application domains compared with start-of-the-art anomaly detection models.
△ Less
Submitted 12 January, 2023; v1 submitted 24 November, 2022;
originally announced November 2022.
-
On the equivariant motivic filtration of the topological Hochschild homology of polynomial algebras
Authors:
Po Hu,
Igor Kriz,
Petr Somberg
Abstract:
We identify the equivariant structure of the filtered pieces of the motivic filtration defined by Bhatt, Morrow and Scholze on the topological Hochschild cohomology spectrum of polynomial algebras over $\mathbb{F}_p$.
We identify the equivariant structure of the filtered pieces of the motivic filtration defined by Bhatt, Morrow and Scholze on the topological Hochschild cohomology spectrum of polynomial algebras over $\mathbb{F}_p$.
△ Less
Submitted 22 November, 2022;
originally announced November 2022.
-
HigeNet: A Highly Efficient Modeling for Long Sequence Time Series Prediction in AIOps
Authors:
Jiajia Li,
Feng Tan,
Cheng He,
Zikai Wang,
Haitao Song,
Lingfei Wu,
Pengwei Hu
Abstract:
Modern IT system operation demands the integration of system software and hardware metrics. As a result, it generates a massive amount of data, which can be potentially used to make data-driven operational decisions. In the basic form, the decision model needs to monitor a large set of machine data, such as CPU utilization, allocated memory, disk and network latency, and predicts the system metric…
▽ More
Modern IT system operation demands the integration of system software and hardware metrics. As a result, it generates a massive amount of data, which can be potentially used to make data-driven operational decisions. In the basic form, the decision model needs to monitor a large set of machine data, such as CPU utilization, allocated memory, disk and network latency, and predicts the system metrics to prevent performance degradation. Nevertheless, building an effective prediction model in this scenario is rather challenging as the model has to accurately capture the long-range coupling dependency in the Multivariate Time-Series (MTS). Moreover, this model needs to have low computational complexity and can scale efficiently to the dimension of data available. In this paper, we propose a highly efficient model named HigeNet to predict the long-time sequence time series. We have deployed the HigeNet on production in the D-matrix platform. We also provide offline evaluations on several publicly available datasets as well as one online dataset to demonstrate the model's efficacy. The extensive experiments show that training time, resource usage and accuracy of the model are found to be significantly better than five state-of-the-art competing models.
△ Less
Submitted 13 November, 2022;
originally announced November 2022.
-
Laboratory observation of ion acceleration via reflection off laser-produced magnetized collisionless shocks
Authors:
Hui-bo Tang,
Yu-fei,
Hao,
Guang-yue Hu,
Quan-ming Lu,
Chuang Ren,
Yu Zhang,
Ao Guo,
Peng Hu,
Yu-lin Wang,
Xiang-bing Wang,
Zhen-chi Zhang,
Peng Yuan,
Wei Liu,
Hua-chong Si,
Chun-kai Yu,
Jia-yi Zhao,
Jin-can Wang,
Zhe Zhang,
Xiao-hui Yuan,
Da-wei Yuan,
Zhi-yong Xie,
Jun Xiong,
Zhi-heng Fang,
Jian-cai Xu
, et al. (7 additional authors not shown)
Abstract:
Fermi acceleration by collisionless shocks is believed to be the primary mechanism to produce high energy charged particles in the Universe,where charged particles gain energy successively from multiple reflections off the shock front.Here,we present the first direct experimental evidence of ion energization from reflection off a supercritical quasi perpendicular collisionless shock,an essential c…
▽ More
Fermi acceleration by collisionless shocks is believed to be the primary mechanism to produce high energy charged particles in the Universe,where charged particles gain energy successively from multiple reflections off the shock front.Here,we present the first direct experimental evidence of ion energization from reflection off a supercritical quasi perpendicular collisionless shock,an essential component of Fermi acceleration in a laser produced magnetized plasma. We observed a quasi monoenergetic ion beam with 2,4 times the shock velocity in the upstream flow using time of flight method. Our related kinetic simulations reproduced the energy gain and showed that these ions were first reflected and then accelerated mainly by the motional electric field associated with the shock. This mechanism can also explain the quasi monoenergetic fast ion component observed in the Earth's bow shock.
△ Less
Submitted 25 August, 2023; v1 submitted 6 November, 2022;
originally announced November 2022.
-
TPU-MLIR: A Compiler For TPU Using MLIR
Authors:
Pengchao Hu,
Man Lu,
Lei Wang,
Guoyue Jiang
Abstract:
Multi-level intermediate representations (MLIR) show great promise for reducing the cost of building domain-specific compilers by providing a reusable and extensible compiler infrastructure. This work presents TPU-MLIR, an end-to-end compiler based on MLIR that deploys pre-trained neural network (NN) models to a custom ASIC called a Tensor Processing Unit (TPU). TPU-MLIR defines two new dialects t…
▽ More
Multi-level intermediate representations (MLIR) show great promise for reducing the cost of building domain-specific compilers by providing a reusable and extensible compiler infrastructure. This work presents TPU-MLIR, an end-to-end compiler based on MLIR that deploys pre-trained neural network (NN) models to a custom ASIC called a Tensor Processing Unit (TPU). TPU-MLIR defines two new dialects to implement its functionality: 1. a Tensor operation (TOP) dialect that encodes the deep learning graph semantics and independent of the deep learning framework and 2. a TPU kernel dialect to provide a standard kernel computation on TPU. A NN model is translated to the TOP dialect and then lowered to the TPU dialect for different TPUs according to the chip's configuration. We demonstrate how to use the MLIR pass pipeline to organize and perform optimization on TPU to generate machine code. The paper also presents a verification procedure to ensure the correctness of each transform stage.
△ Less
Submitted 9 February, 2023; v1 submitted 23 October, 2022;
originally announced October 2022.
-
Travel the Same Path: A Novel TSP Solving Strategy
Authors:
Pingbang Hu
Abstract:
In this paper, we provide a novel strategy for solving Traveling Salesman Problem, which is a famous combinatorial optimization problem studied intensely in the TCS community. In particular, we consider the imitation learning framework, which helps a deterministic algorithm making good choices whenever it needs to, resulting in a speed up while maintaining the exactness of the solution without suf…
▽ More
In this paper, we provide a novel strategy for solving Traveling Salesman Problem, which is a famous combinatorial optimization problem studied intensely in the TCS community. In particular, we consider the imitation learning framework, which helps a deterministic algorithm making good choices whenever it needs to, resulting in a speed up while maintaining the exactness of the solution without suffering from the unpredictability and a potential large deviation.
Furthermore, we demonstrate a strong generalization ability of a graph neural network trained under the imitation learning framework. Specifically, the model is capable of solving a large instance of TSP faster than the baseline while has only seen small TSP instances when training.
△ Less
Submitted 11 October, 2022;
originally announced October 2022.
-
Differentiable Raycasting for Self-supervised Occupancy Forecasting
Authors:
Tarasha Khurana,
Peiyun Hu,
Achal Dave,
Jason Ziglar,
David Held,
Deva Ramanan
Abstract:
Motion planning for safe autonomous driving requires learning how the environment around an ego-vehicle evolves with time. Ego-centric perception of driveable regions in a scene not only changes with the motion of actors in the environment, but also with the movement of the ego-vehicle itself. Self-supervised representations proposed for large-scale planning, such as ego-centric freespace, confoun…
▽ More
Motion planning for safe autonomous driving requires learning how the environment around an ego-vehicle evolves with time. Ego-centric perception of driveable regions in a scene not only changes with the motion of actors in the environment, but also with the movement of the ego-vehicle itself. Self-supervised representations proposed for large-scale planning, such as ego-centric freespace, confound these two motions, making the representation difficult to use for downstream motion planners. In this paper, we use geometric occupancy as a natural alternative to view-dependent representations such as freespace. Occupancy maps naturally disentangle the motion of the environment from the motion of the ego-vehicle. However, one cannot directly observe the full 3D occupancy of a scene (due to occlusion), making it difficult to use as a signal for learning. Our key insight is to use differentiable raycasting to "render" future occupancy predictions into future LiDAR sweep predictions, which can be compared with ground-truth sweeps for self-supervised learning. The use of differentiable raycasting allows occupancy to emerge as an internal representation within the forecasting network. In the absence of groundtruth occupancy, we quantitatively evaluate the forecasting of raycasted LiDAR sweeps and show improvements of upto 15 F1 points. For downstream motion planners, where emergent occupancy can be directly used to guide non-driveable regions, this representation relatively reduces the number of collisions with objects by up to 17% as compared to freespace-centric motion planners.
△ Less
Submitted 18 October, 2022; v1 submitted 4 October, 2022;
originally announced October 2022.