-
Exploring the Impact of Hand Pose and Shadow on Hand-washing Action Recognition
Authors:
Shengtai Ju,
Amy R. Reibman
Abstract:
In the real world, camera-based application systems can face many challenges, including environmental factors and distribution shift. In this paper, we investigate how pose and shadow impact a classifier's performance, using the specific application of handwashing action recognition. To accomplish this, we generate synthetic data with desired variations to introduce controlled distribution shift.…
▽ More
In the real world, camera-based application systems can face many challenges, including environmental factors and distribution shift. In this paper, we investigate how pose and shadow impact a classifier's performance, using the specific application of handwashing action recognition. To accomplish this, we generate synthetic data with desired variations to introduce controlled distribution shift. Using our synthetic dataset, we define a classifier's breakdown points to be where the system's performance starts to degrade sharply, and we show these are heavily impacted by pose and shadow conditions. In particular, heavier and larger shadows create earlier breakdown points. Also, it is intriguing to observe model accuracy drop to almost zero with bigger changes in pose. Moreover, we propose a simple mitigation strategy for pose-induced breakdown points by utilizing additional training data from non-canonical poses. Results show that the optimal choices of additional training poses are those with moderate deviations from the canonical poses with 50-60 degrees of rotation.
△ Less
Submitted 19 June, 2024;
originally announced July 2024.
-
Exploiting Emotion-Semantic Correlations for Empathetic Response Generation
Authors:
Zhou Yang,
Zhaochun Ren,
Yufeng Wang,
Xiaofei Zhu,
Zhihao Chen,
Tiecheng Cai,
Yunbing Wu,
Yisong Su,
Sibo Ju,
Xiangwen Liao
Abstract:
Empathetic response generation aims to generate empathetic responses by understanding the speaker's emotional feelings from the language of dialogue. Recent methods capture emotional words in the language of communicators and construct them as static vectors to perceive nuanced emotions. However, linguistic research has shown that emotional words in language are dynamic and have correlations with…
▽ More
Empathetic response generation aims to generate empathetic responses by understanding the speaker's emotional feelings from the language of dialogue. Recent methods capture emotional words in the language of communicators and construct them as static vectors to perceive nuanced emotions. However, linguistic research has shown that emotional words in language are dynamic and have correlations with other grammar semantic roles, i.e., words with semantic meanings, in grammar. Previous methods overlook these two characteristics, which easily lead to misunderstandings of emotions and neglect of key semantics. To address this issue, we propose a dynamical Emotion-Semantic Correlation Model (ESCM) for empathetic dialogue generation tasks. ESCM constructs dynamic emotion-semantic vectors through the interaction of context and emotions. We introduce dependency trees to reflect the correlations between emotions and semantics. Based on dynamic emotion-semantic vectors and dependency trees, we propose a dynamic correlation graph convolutional network to guide the model in learning context meanings in dialogue and generating empathetic responses. Experimental results on the EMPATHETIC-DIALOGUES dataset show that ESCM understands semantics and emotions more accurately and expresses fluent and informative empathetic responses. Our analysis results also indicate that the correlations between emotions and semantics are frequently used in dialogues, which is of great significance for empathetic perception and expression.
△ Less
Submitted 27 February, 2024;
originally announced February 2024.
-
Trustworthy Multi-phase Liver Tumor Segmentation via Evidence-based Uncertainty
Authors:
Chuanfei Hu,
Tianyi Xia,
Ying Cui,
Quchen Zou,
Yuancheng Wang,
Wenbo Xiao,
Shenghong Ju,
Xinde Li
Abstract:
Multi-phase liver contrast-enhanced computed tomography (CECT) images convey the complementary multi-phase information for liver tumor segmentation (LiTS), which are crucial to assist the diagnosis of liver cancer clinically. However, the performances of existing multi-phase liver tumor segmentation (MPLiTS)-based methods suffer from redundancy and weak interpretability, % of the fused result, res…
▽ More
Multi-phase liver contrast-enhanced computed tomography (CECT) images convey the complementary multi-phase information for liver tumor segmentation (LiTS), which are crucial to assist the diagnosis of liver cancer clinically. However, the performances of existing multi-phase liver tumor segmentation (MPLiTS)-based methods suffer from redundancy and weak interpretability, % of the fused result, resulting in the implicit unreliability of clinical applications. In this paper, we propose a novel trustworthy multi-phase liver tumor segmentation (TMPLiTS), which is a unified framework jointly conducting segmentation and uncertainty estimation. The trustworthy results could assist the clinicians to make a reliable diagnosis. Specifically, Dempster-Shafer Evidence Theory (DST) is introduced to parameterize the segmentation and uncertainty as evidence following Dirichlet distribution. The reliability of segmentation results among multi-phase CECT images is quantified explicitly. Meanwhile, a multi-expert mixture scheme (MEMS) is proposed to fuse the multi-phase evidences, which can guarantee the effect of fusion procedure based on theoretical analysis. Experimental results demonstrate the superiority of TMPLiTS compared with the state-of-the-art methods. Meanwhile, the robustness of TMPLiTS is verified, where the reliable performance can be guaranteed against the perturbations.
△ Less
Submitted 20 June, 2023; v1 submitted 9 May, 2023;
originally announced May 2023.
-
When SAM Meets Medical Images: An Investigation of Segment Anything Model (SAM) on Multi-phase Liver Tumor Segmentation
Authors:
Chuanfei Hu,
Tianyi Xia,
Shenghong Ju,
Xinde Li
Abstract:
Learning to segmentation without large-scale samples is an inherent capability of human. Recently, Segment Anything Model (SAM) performs the significant zero-shot image segmentation, attracting considerable attention from the computer vision community. Here, we investigate the capability of SAM for medical image analysis, especially for multi-phase liver tumor segmentation (MPLiTS), in terms of pr…
▽ More
Learning to segmentation without large-scale samples is an inherent capability of human. Recently, Segment Anything Model (SAM) performs the significant zero-shot image segmentation, attracting considerable attention from the computer vision community. Here, we investigate the capability of SAM for medical image analysis, especially for multi-phase liver tumor segmentation (MPLiTS), in terms of prompts, data resolution, phases. Experimental results demonstrate that there might be a large gap between SAM and expected performance. Fortunately, the qualitative results show that SAM is a powerful annotation tool for the community of interactive medical image segmentation.
△ Less
Submitted 21 December, 2023; v1 submitted 17 April, 2023;
originally announced April 2023.
-
Preparing Unprepared Students For Future Learning
Authors:
Mark Abdelshiheed,
Mehak Maniktala,
Song Ju,
Ayush Jain,
Tiffany Barnes,
Min Chi
Abstract:
Based on strategy-awareness (knowing which problem-solving strategy to use) and time-awareness (knowing when to use it), students are categorized into Rote (neither type of awareness), Dabbler (strategy-aware only) or Selective (both types of awareness). It was shown that Selective is often significantly more prepared for future learning than Rote and Dabbler (Abdelshiheed et al., 2020). In this w…
▽ More
Based on strategy-awareness (knowing which problem-solving strategy to use) and time-awareness (knowing when to use it), students are categorized into Rote (neither type of awareness), Dabbler (strategy-aware only) or Selective (both types of awareness). It was shown that Selective is often significantly more prepared for future learning than Rote and Dabbler (Abdelshiheed et al., 2020). In this work, we explore the impact of explicit strategy instruction on Rote and Dabbler students across two domains: logic and probability. During the logic instruction, our logic tutor handles both Forward-Chaining (FC) and Backward-Chaining (BC) strategies, with FC being the default; the Experimental condition is taught how to use BC via worked examples and when to use it via prompts. Six weeks later, all students are trained on a probability tutor that supports BC only. Our results show that Experimental significantly outperforms Control in both domains, and Experimental Rote catches up with Selective.
△ Less
Submitted 18 March, 2023;
originally announced March 2023.
-
142 GHz Multipath Propagation Measurements and Path Loss Channel Modeling in Factory Buildings
Authors:
Shihao Ju,
Theodore S. Rappaport
Abstract:
This paper presents sub-Terahertz (THz) radio propagation measurements at 142 GHz conducted in four factories with various layouts and facilities to explore sub-THz wireless channels for smart factories in 6G and beyond. Here we study spatial and temporal channel responses at 82 transmitter-receiver (TX-RX) locations across four factories in the New York City area and over distances from 5 m to 85…
▽ More
This paper presents sub-Terahertz (THz) radio propagation measurements at 142 GHz conducted in four factories with various layouts and facilities to explore sub-THz wireless channels for smart factories in 6G and beyond. Here we study spatial and temporal channel responses at 82 transmitter-receiver (TX-RX) locations across four factories in the New York City area and over distances from 5 m to 85 m in both line-of-sight (LOS) and non-LOS (NLOS) environments. The measurements were performed with a sliding-correlation-based channel sounder with 1 GHz RF bandwidth with steerable directional horn antennas with 27 dBi gain and 8\degree~half-power beamwidth at both TX and RX, using both vertical and horizontal antenna polarizations, yielding over 75,000 directional power delay profiles. Channel measurements of two RX heights at 1.5 m (high) emulating handheld devices and at 0.5 m (low) emulating automated guided vehicles (AGVs) were conducted for automated industrial scenarios with various clutter densities. Results yield the first path loss models for indoor factory (InF) environments at 142 GHz and show the low RX height experiences a mean path loss increase of 10.7 dB and 6.0 dB when compared with the high RX height at LOS and NLOS locations, respectively. Furthermore, flat and rotatable metal plates were leveraged as passive reflecting surfaces (PRSs) in channel enhancement measurements to explore the potential power gain on sub-THz propagation channels, demonstrating a range from 0.5 to 22 dB improvement with a mean of 6.5 dB in omnidirectional channel gain as compared to when no PRSs are present.
△ Less
Submitted 23 February, 2023;
originally announced February 2023.
-
HOPE: Human-Centric Off-Policy Evaluation for E-Learning and Healthcare
Authors:
Ge Gao,
Song Ju,
Markel Sanz Ausin,
Min Chi
Abstract:
Reinforcement learning (RL) has been extensively researched for enhancing human-environment interactions in various human-centric tasks, including e-learning and healthcare. Since deploying and evaluating policies online are high-stakes in such tasks, off-policy evaluation (OPE) is crucial for inducing effective policies. In human-centric environments, however, OPE is challenging because the under…
▽ More
Reinforcement learning (RL) has been extensively researched for enhancing human-environment interactions in various human-centric tasks, including e-learning and healthcare. Since deploying and evaluating policies online are high-stakes in such tasks, off-policy evaluation (OPE) is crucial for inducing effective policies. In human-centric environments, however, OPE is challenging because the underlying state is often unobservable, while only aggregate rewards can be observed (students' test scores or whether a patient is released from the hospital eventually). In this work, we propose a human-centric OPE (HOPE) to handle partial observability and aggregated rewards in such environments. Specifically, we reconstruct immediate rewards from the aggregated rewards considering partial observability to estimate expected total returns. We provide a theoretical bound for the proposed method, and we have conducted extensive experiments in real-world human-centric tasks, including sepsis treatments and an intelligent tutoring system. Our approach reliably predicts the returns of different policies and outperforms state-of-the-art benchmarks using both standard validation methods and human-centric significance tests.
△ Less
Submitted 17 February, 2023;
originally announced February 2023.
-
A Power Efficiency Metric for Comparing Energy Consumption in Future Wireless Networks in the Millimeter Wave and Terahertz bands
Authors:
O. Kanhere,
H. Poddar,
Y. Xing,
D. Shakya,
S. Ju,
T. S. Rappaport
Abstract:
Future wireless cellular networks will utilize millimeter-wave and sub-THz frequencies and deploy small-cell base stations to achieve data rates on the order of hundreds of Gigabits per second per user. The move to sub-THz frequencies will require attention to sustainability and reduction of power whenever possible to reduce the carbon footprint while maintaining adequate battery life for the mass…
▽ More
Future wireless cellular networks will utilize millimeter-wave and sub-THz frequencies and deploy small-cell base stations to achieve data rates on the order of hundreds of Gigabits per second per user. The move to sub-THz frequencies will require attention to sustainability and reduction of power whenever possible to reduce the carbon footprint while maintaining adequate battery life for the massive number of resource-constrained devices to be deployed. This article analyzes power consumption of future wireless networks using a new metric, the power waste factor ($ W $), which shows promise for the study and development of "green G" - green technology for future wireless networks. Using $ W $, power efficiency can be considered by quantifying the power wasted by all devices on a signal path in a cascade. We then show that the consumption efficiency factor ($CEF$), defined as the ratio of the maximum data rate achieved to the total power consumed, is a novel and powerful measure of power efficiency that shows less energy per bit is expended as the cell size shrinks and carrier frequency and channel bandwidth increase. Our findings offer a standard approach to calculating and comparing power consumption and energy efficiency.
△ Less
Submitted 14 January, 2023; v1 submitted 10 September, 2022;
originally announced September 2022.
-
Designing thermal radiation metamaterials via hybrid adversarial autoencoder and Bayesian optimization
Authors:
Dezhao Zhu,
Jiang Guo,
Gang Yu,
C. Y. Zhao,
Hong Wang,
Shenghong Ju
Abstract:
Designing thermal radiation metamaterials is challenging especially for problems with high degrees of freedom and complex objective. In this letter, we have developed a hybrid materials informatics approach which combines the adversarial autoencoder and Bayesian optimization to design narrowband thermal emitters at different target wavelengths. With only several hundreds of training data sets, new…
▽ More
Designing thermal radiation metamaterials is challenging especially for problems with high degrees of freedom and complex objective. In this letter, we have developed a hybrid materials informatics approach which combines the adversarial autoencoder and Bayesian optimization to design narrowband thermal emitters at different target wavelengths. With only several hundreds of training data sets, new structures with optimal properties can be quickly figured out in a compressed 2-dimensional latent space. This enables the optimal design by calculating far less than 0.001\% of the total candidate structures, which greatly decreases the design period and cost. The proposed design framework can be easily extended to other thermal radiation metamaterials design with higher dimensional features.
△ Less
Submitted 26 April, 2022;
originally announced May 2022.
-
Sub-Terahertz Wireless Coverage Analysis at 142 GHz in Urban Microcell
Authors:
Yunchou Xing,
Ojas Kanhere,
Shihao Ju,
Theodore S. Rappaport
Abstract:
Small-cell cellular base stations are going to be used for mmWave and sub-THz communication systems to provide multi-Gbps data rates and reliable coverage to mobile users. This paper analyzes the base station coverage of sub-THz communication systems and the system performance in terms of spectral efficiency through Monte Carlo simulations for both single-cell and multi-cell cases. The simulations…
▽ More
Small-cell cellular base stations are going to be used for mmWave and sub-THz communication systems to provide multi-Gbps data rates and reliable coverage to mobile users. This paper analyzes the base station coverage of sub-THz communication systems and the system performance in terms of spectral efficiency through Monte Carlo simulations for both single-cell and multi-cell cases. The simulations are based on realistic channel models derived from outdoor field measurements at 142 GHz in urban microcell (UMi) environments conducted in downtown Brooklyn, New York. The single-cell base station can provide a downlink coverage area with a radius of 200 m and the 7-cell system can provide a downlink coverage area with a radius of 400 m at 142 GHz. Using a 1 GHz downlink bandwidth and 100 MHz uplink bandwidth, the 7-cell system can provide about 4.5 Gbps downlink average data rate and 410 Mbps uplink average data rate at 142 GHz.
△ Less
Submitted 16 March, 2022;
originally announced March 2022.
-
An Adaptive Human Driver Model for Realistic Race Car Simulations
Authors:
Stefan Löckel,
Siwei Ju,
Maximilian Schaller,
Peter van Vliet,
Jan Peters
Abstract:
Engineering a high-performance race car requires a direct consideration of the human driver using real-world tests or Human-Driver-in-the-Loop simulations. Apart from that, offline simulations with human-like race driver models could make this vehicle development process more effective and efficient but are hard to obtain due to various challenges. With this work, we intend to provide a better und…
▽ More
Engineering a high-performance race car requires a direct consideration of the human driver using real-world tests or Human-Driver-in-the-Loop simulations. Apart from that, offline simulations with human-like race driver models could make this vehicle development process more effective and efficient but are hard to obtain due to various challenges. With this work, we intend to provide a better understanding of race driver behavior and introduce an adaptive human race driver model based on imitation learning. Using existing findings and an interview with a professional race engineer, we identify fundamental adaptation mechanisms and how drivers learn to optimize lap time on a new track. Subsequently, we use these insights to develop generalization and adaptation techniques for a recently presented probabilistic driver modeling approach and evaluate it using data from professional race drivers and a state-of-the-art race car simulator. We show that our framework can create realistic driving line distributions on unseen race tracks with almost human-like performance. Moreover, our driver model optimizes its driving lap by lap, correcting driving errors from previous laps while achieving faster lap times. This work contributes to a better understanding and modeling of the human driver, aiming to expedite simulation methods in the modern vehicle development process and potentially supporting automated driving and racing technologies.
△ Less
Submitted 20 July, 2022; v1 submitted 3 March, 2022;
originally announced March 2022.
-
Sub-Terahertz Spatial Statistical MIMO Channel Model for Urban Microcells at 142 GHz
Authors:
Shihao Ju,
Theodore S. Rappaport
Abstract:
Sixth generation (6G) cellular systems are expected to extend the operational range to sub-Terahertz (THz) frequencies between 100 and 300 GHz due to the broad unexploited spectrum therein. A proper channel model is needed to accurately describe spatial and temporal channel characteristics and faithfully create channel impulse responses at sub-THz frequencies. This paper studies the channel spatia…
▽ More
Sixth generation (6G) cellular systems are expected to extend the operational range to sub-Terahertz (THz) frequencies between 100 and 300 GHz due to the broad unexploited spectrum therein. A proper channel model is needed to accurately describe spatial and temporal channel characteristics and faithfully create channel impulse responses at sub-THz frequencies. This paper studies the channel spatial statistics such as the number of spatial clusters and cluster power distribution based on recent radio propagation measurements conducted at 142 GHz in an urban microcell (UMi) scenario. For the 28 measured locations, we observe one to four spatial clusters at most locations. A detailed spatial statistical multiple input multiple output (MIMO) channel generation procedure is introduced based on the derived empirical channel statistics. We find that beamforming provides better spectral efficiency than spatial multiplexing in the LOS scenario due to the boresight path, and two spatial streams usually offer the highest spectral efficiency at most NLOS locations due to the limited number of spatial clusters.
△ Less
Submitted 12 October, 2021;
originally announced October 2021.
-
InferNet for Delayed Reinforcement Tasks: Addressing the Temporal Credit Assignment Problem
Authors:
Markel Sanz Ausin,
Hamoon Azizsoltani,
Song Ju,
Yeo Jin Kim,
Min Chi
Abstract:
The temporal Credit Assignment Problem (CAP) is a well-known and challenging task in AI. While Reinforcement Learning (RL), especially Deep RL, works well when immediate rewards are available, it can fail when only delayed rewards are available or when the reward function is noisy. In this work, we propose delegating the CAP to a Neural Network-based algorithm named InferNet that explicitly learns…
▽ More
The temporal Credit Assignment Problem (CAP) is a well-known and challenging task in AI. While Reinforcement Learning (RL), especially Deep RL, works well when immediate rewards are available, it can fail when only delayed rewards are available or when the reward function is noisy. In this work, we propose delegating the CAP to a Neural Network-based algorithm named InferNet that explicitly learns to infer the immediate rewards from the delayed rewards. The effectiveness of InferNet was evaluated on two online RL tasks: a simple GridWorld and 40 Atari games; and two offline RL tasks: GridWorld and a real-life Sepsis treatment task. For all tasks, the effectiveness of using the InferNet inferred rewards is compared against the immediate and the delayed rewards with two settings: with noisy rewards and without noise. Overall, our results show that the effectiveness of InferNet is robust against noisy reward functions and is an effective add-on mechanism for solving temporal CAP in a wide range of RL tasks, from classic RL simulation environments to a real-world RL problem and for both online and offline learning.
△ Less
Submitted 2 May, 2021;
originally announced May 2021.
-
Millimeter Wave and Sub-Terahertz Spatial Statistical Channel Model for an Indoor Office Building
Authors:
Shihao Ju,
Yunchou Xing,
Ojas Kanhere,
Theodore S. Rappaport
Abstract:
Millimeter-wave (mmWave) and sub-Terahertz (THz) frequencies are expected to play a vital role in 6G wireless systems and beyond due to the vast available bandwidth of many tens of GHz. This paper presents an indoor 3-D spatial statistical channel model for mmWave and sub-THz frequencies based on extensive radio propagation measurements at 28 and 140 GHz conducted in an indoor office environment f…
▽ More
Millimeter-wave (mmWave) and sub-Terahertz (THz) frequencies are expected to play a vital role in 6G wireless systems and beyond due to the vast available bandwidth of many tens of GHz. This paper presents an indoor 3-D spatial statistical channel model for mmWave and sub-THz frequencies based on extensive radio propagation measurements at 28 and 140 GHz conducted in an indoor office environment from 2014 to 2020. Omnidirectional and directional path loss models and channel statistics such as the number of time clusters, cluster delays, and cluster powers were derived from over 15,000 measured power delay profiles. The resulting channel statistics show that the number of time clusters follows a Poisson distribution and the number of subpaths within each cluster follows a composite exponential distribution for both LOS and NLOS environments at 28 and 140 GHz. This paper proposes a unified indoor statistical channel model for mmWave and sub-Terahertz frequencies following the mathematical framework of the previous outdoor NYUSIM channel models. A corresponding indoor channel simulator is developed, which can recreate 3-D omnidirectional, directional, and multiple input multiple output (MIMO) channels for arbitrary mmWave and sub-THz carrier frequency up to 150 GHz, signal bandwidth, and antenna beamwidth. The presented statistical channel model and simulator will guide future air-interface, beamforming, and transceiver designs for 6G and beyond.
△ Less
Submitted 31 March, 2021;
originally announced March 2021.
-
140 GHz Urban Microcell Propagation Measurements for Spatial Consistency Modeling
Authors:
Shihao Ju,
Theodore S. Rappaport
Abstract:
Sub-Terahertz frequencies (frequencies above 100 GHz) have the potential to satisfy the unprecedented demand on data rate on the order of hundreds of Gbps for sixth-generation (6G) wireless communications and beyond. Accurate beam tracking and rapid beam selection are increasingly important since antenna arrays with more elements generate narrower beams to compensate for additional path loss withi…
▽ More
Sub-Terahertz frequencies (frequencies above 100 GHz) have the potential to satisfy the unprecedented demand on data rate on the order of hundreds of Gbps for sixth-generation (6G) wireless communications and beyond. Accurate beam tracking and rapid beam selection are increasingly important since antenna arrays with more elements generate narrower beams to compensate for additional path loss within the first meter of propagation distance at sub-THz frequencies. Realistic channel models for above 100 GHz are needed, and should include spatial consistency to model the spatial and temporal channel evolution along the user trajectory. This paper introduces recent outdoor urban microcell (UMi) propagation measurements at 142 GHz along a 39 m $\times$ 12 m rectangular route (102 m long), where each consecutive and adjacent receiver location is 3 m apart from each other. The measured power delay profiles and angular power spectrum at each receiver location are used to study spatial autocorrelation properties of various channel parameters such as shadow fading, delay spread, and angular spread along the track. Compared to the correlation distances reported in the 3GPP TR 38.901 for frequencies below 100 GHz, the measured correlation distance of shadow fading at 142 GHz (3.8 m) is much shorter than the 10-13 m as specified in 3GPP; the measured correlation distances of delay spread and angular spread at 142 GHz (both 12 m) are comparable to the 7-10 m as specified in 3GPP. This result may guide the development of a statistical spatially consistent channel model for frequencies above 100 GHz in the UMi street canyon environment.
△ Less
Submitted 9 March, 2021;
originally announced March 2021.
-
3-D Statistical Indoor Channel Model for Millimeter-Wave and Sub-Terahertz Bands
Authors:
Shihao Ju,
Yunchou Xing,
Ojas Kanhere,
Theodore S. Rappaport
Abstract:
Millimeter-wave (mmWave) and Terahertz (THz) will be used in the sixth-generation (6G) wireless systems, especially for indoor scenarios. This paper presents an indoor three-dimensional (3-D) statistical channel model for mmWave and sub-THz frequencies, which is developed from extensive channel propagation measurements conducted in an office building at 28 GHz and 140 GHz in 2014 and 2019. Over 15…
▽ More
Millimeter-wave (mmWave) and Terahertz (THz) will be used in the sixth-generation (6G) wireless systems, especially for indoor scenarios. This paper presents an indoor three-dimensional (3-D) statistical channel model for mmWave and sub-THz frequencies, which is developed from extensive channel propagation measurements conducted in an office building at 28 GHz and 140 GHz in 2014 and 2019. Over 15,000 power delay profiles (PDPs) were recorded to study channel statistics such as the number of time clusters, cluster delays, and cluster powers. All the parameters required in the channel generation procedure are derived from empirical measurement data for 28 GHz and 140 GHz line-of-sight (LOS) and non-line-of-sight (NLOS) scenarios. The channel model is validated by showing that the simulated root mean square (RMS) delay spread and RMS angular spread yield good agreements with measured values. An indoor channel simulation software is built upon the popular NYUSIM outdoor channel simulator, which can generate realistic channel impulse response, PDP, and power angular spectrum.
△ Less
Submitted 27 September, 2020;
originally announced September 2020.
-
Ensemble Wrapper Subsampling for Deep Modulation Classification
Authors:
Sharan Ramjee,
Shengtai Ju,
Diyu Yang,
Xiaoyu Liu,
Aly El Gamal,
Yonina C. Eldar
Abstract:
Subsampling of received wireless signals is important for relaxing hardware requirements as well as the computational cost of signal processing algorithms that rely on the output samples. We propose a subsampling technique to facilitate the use of deep learning for automatic modulation classification in wireless communication systems. Unlike traditional approaches that rely on pre-designed strateg…
▽ More
Subsampling of received wireless signals is important for relaxing hardware requirements as well as the computational cost of signal processing algorithms that rely on the output samples. We propose a subsampling technique to facilitate the use of deep learning for automatic modulation classification in wireless communication systems. Unlike traditional approaches that rely on pre-designed strategies that are solely based on expert knowledge, the proposed data-driven subsampling strategy employs deep neural network architectures to simulate the effect of removing candidate combinations of samples from each training input vector, in a manner inspired by how wrapper feature selection models work. The subsampled data is then processed by another deep learning classifier that recognizes each of the considered 10 modulation types. We show that the proposed subsampling strategy not only introduces drastic reduction in the classifier training time, but can also improve the classification accuracy to higher levels than those reached before for the considered dataset. An important feature herein is exploiting the transferability property of deep neural networks to avoid retraining the wrapper models and obtain superior performance through an ensemble of wrappers over that possible through solely relying on any of them.
△ Less
Submitted 10 May, 2020;
originally announced May 2020.
-
Efficient Training of Deep Classifiers for Wireless Source Identification using Test SNR Estimates
Authors:
Xingchen Wang,
Shengtai Ju,
Xiwen Zhang,
Sharan Ramjee,
Aly El Gamal
Abstract:
We study efficient deep learning training algorithms that process received wireless signals, if a test Signal to Noise Ratio (SNR) estimate is available. We focus on two tasks that facilitate source identification: 1- Identifying the modulation type, 2- Identifying the wireless technology and channel in the 2.4 GHz ISM band. For benchmarking, we rely on recent literature on testing deep learning a…
▽ More
We study efficient deep learning training algorithms that process received wireless signals, if a test Signal to Noise Ratio (SNR) estimate is available. We focus on two tasks that facilitate source identification: 1- Identifying the modulation type, 2- Identifying the wireless technology and channel in the 2.4 GHz ISM band. For benchmarking, we rely on recent literature on testing deep learning algorithms against two well-known datasets. We first demonstrate that using training data corresponding only to the test SNR value leads to dramatic reductions in training time while incurring a small loss in average test accuracy, as it improves the accuracy for low SNR values. Further, we show that an erroneous test SNR estimate with a small positive offset is better for training than another having the same error magnitude with a negative offset. Secondly, we introduce a greedy training SNR Boosting algorithm that leads to uniform improvement in accuracy across all tested SNR values, while using a small subset of training SNR values at each test SNR. Finally, we demonstrate the potential of bootstrap aggregating (Bagging) based on training SNR values to improve generalization at low test SNR values with scarcity of training data.
△ Less
Submitted 18 April, 2020; v1 submitted 26 December, 2019;
originally announced December 2019.
-
A near-linear time minimum Steiner cut algorithm for planar graphs
Authors:
Stephen Jue,
Philip N. Klein
Abstract:
We consider the Minimum Steiner Cut problem on undirected planar graphs with non-negative edge weights. This problem involves finding the minimum cut of the graph that separates a specified subset $X$ of vertices (terminals) into two parts. This problem is of theoretical interest because it generalizes two classical optimization problems, Minimum $s$-$t$ Cut and Minimum Cut, and of practical impor…
▽ More
We consider the Minimum Steiner Cut problem on undirected planar graphs with non-negative edge weights. This problem involves finding the minimum cut of the graph that separates a specified subset $X$ of vertices (terminals) into two parts. This problem is of theoretical interest because it generalizes two classical optimization problems, Minimum $s$-$t$ Cut and Minimum Cut, and of practical importance because of its application to computing a lower bound for Steiner (Subset) TSP. Our algorithm has running time $O(n\log{n}\log{k})$ where $k$ is the number of terminals.
△ Less
Submitted 31 December, 2019; v1 submitted 23 December, 2019;
originally announced December 2019.
-
Map-Assisted Millimeter Wave Localization for Accurate Position Location
Authors:
Ojas Kanhere,
Shihao Ju,
Yunchou Xing,
Theodore S. Rappaport
Abstract:
Accurate precise positioning at millimeter wave frequencies is possible due to the large available bandwidth that permits precise on-the-fly time of flight measurements using conventional air interface standards. In addition, narrow antenna beamwidths may be used to determine the angles of arrival and departure of the multipath components between the base station and mobile users. By combining acc…
▽ More
Accurate precise positioning at millimeter wave frequencies is possible due to the large available bandwidth that permits precise on-the-fly time of flight measurements using conventional air interface standards. In addition, narrow antenna beamwidths may be used to determine the angles of arrival and departure of the multipath components between the base station and mobile users. By combining accurate temporal and angular information of multipath components with a 3-D map of the environment (that may be built by each user or downloaded a-priori), robust localization is possible, even in non-line-of-sight environments. In this work, we develop an accurate 3-D ray tracer for an indoor office environment and demonstrate how the fusion of angle of departure and time of flight information in concert with a 3-D map of a typical large office environment provides a mean accuracy of 12.6 cm in line-of-sight and 16.3 cm in non-line-of-sight, over 100 receiver distances ranging from 1.5 m to 24.5 m using a single base station. We show how increasing the number of base stations improves the average non-line-of-sight position location accuracy to 5.5 cm at 21 locations with a maximum propagation distance of 24.5 m.
△ Less
Submitted 26 August, 2019;
originally announced August 2019.
-
Indoor Wireless Channel Properties at Millimeter Wave and Sub-Terahertz Frequencies
Authors:
Yunchou Xing,
Ojas Kanhere,
Shihao Ju,
Theodore S. Rappaport
Abstract:
This paper provides indoor reflection, scattering, transmission, and large-scale path loss measurements and models, which describe the main propagation mechanisms at millimeter wave and Terahertz frequencies. Channel properties for common building materials (drywall and clear glass) are carefully studied at 28, 73, and 140 GHz using a wideband sliding correlation based channel sounder system with…
▽ More
This paper provides indoor reflection, scattering, transmission, and large-scale path loss measurements and models, which describe the main propagation mechanisms at millimeter wave and Terahertz frequencies. Channel properties for common building materials (drywall and clear glass) are carefully studied at 28, 73, and 140 GHz using a wideband sliding correlation based channel sounder system with rotatable narrow-beam horn antennas. Reflection coefficient is shown to linearly increase as the incident angle increases, and lower reflection loss (e.g., stronger reflections) are observed as frequencies increase for a given incident angle. Although backscatter from drywall is present at 28, 73, and 140 GHz, smooth surfaces (like drywall) are shown to be modeled as a simple reflected surface, since the scattered power is 20 dB or more below the reflected power over the measured range of frequency and angles. Partition loss tends to increase with frequency, but the amount of loss is material dependent. Both clear glass and drywall are shown to induce a depolarizing effect, which becomes more prominent as frequency increases. Indoor propagation measurements and large-scale indoor path loss models at 140 GHz are provided, revealing similar path loss exponent and shadow fading as observed at 28 and 73 GHz. The measurements and models in this paper can be used for future wireless system design and other applications within buildings for frequencies above 100 GHz.
△ Less
Submitted 3 December, 2019; v1 submitted 26 August, 2019;
originally announced August 2019.
-
A Millimeter-Wave Channel Simulator NYUSIM with Spatial Consistency and Human Blockage
Authors:
Shihao Ju,
Ojas Kanhere,
Yunchou Xing,
Theodore S. Rappaport
Abstract:
Accurate channel modeling and simulation are indispensable for millimeter-wave wideband communication systems that employ electrically-steerable and narrow beam antenna arrays. Three important channel modeling components, spatial consistency, human blockage, and outdoor-to-indoor penetration loss, were proposed in the 3rd Generation Partnership Project Release 14 for mmWave communication system de…
▽ More
Accurate channel modeling and simulation are indispensable for millimeter-wave wideband communication systems that employ electrically-steerable and narrow beam antenna arrays. Three important channel modeling components, spatial consistency, human blockage, and outdoor-to-indoor penetration loss, were proposed in the 3rd Generation Partnership Project Release 14 for mmWave communication system design. This paper presents NYUSIM 2.0, an improved channel simulator which can simulate spatially consistent channel realizations based on the existing drop-based channel simulator NYUSIM 1.6.1. A geometry-based approach using multiple reflection surfaces is proposed to generate spatially correlated and time-variant channel coefficients. Using results from 73 GHz pedestrian measurements for human blockage, a four-state Markov model has been implemented in NYUSIM to simulate dynamic human blockage shadowing loss. To model the excess path loss due to penetration into buildings, a parabolic model for outdoor-to-indoor penetration loss has been adopted from the 5G Channel Modeling special interest group and implemented in NYUSIM 2.0. This paper demonstrates how these new modeling capabilities reproduce realistic data when implemented in Monte Carlo fashion using NYUSIM 2.0, making it a valuable measurement-based channel simulator for fifth-generation and beyond mmWave communication system design and evaluation.
△ Less
Submitted 26 August, 2019;
originally announced August 2019.
-
Deep Learning for Interference Identification: Band, Training SNR, and Sample Selection
Authors:
Xiwen Zhang,
Tolunay Seyfi,
Shengtai Ju,
Sharan Ramjee,
Aly El Gamal,
Yonina C. Eldar
Abstract:
We study the problem of interference source identification, through the lens of recognizing one of 15 different channels that belong to 3 different wireless technologies: Bluetooth, Zigbee, and WiFi. We employ deep learning algorithms trained on received samples taken from a 10 MHz band in the 2.4 GHz ISM Band. We obtain a classification accuracy of around 89.5% using any of four different deep ne…
▽ More
We study the problem of interference source identification, through the lens of recognizing one of 15 different channels that belong to 3 different wireless technologies: Bluetooth, Zigbee, and WiFi. We employ deep learning algorithms trained on received samples taken from a 10 MHz band in the 2.4 GHz ISM Band. We obtain a classification accuracy of around 89.5% using any of four different deep neural network architectures: CNN, ResNet, CLDNN, and LSTM, which demonstrate the generality of the effectiveness of deep learning at the considered task. Interestingly, our proposed CNN architecture requires approximately 60% of the training time required by the state of the art while achieving slightly larger classification accuracy. We then focus on the CNN architecture and further optimize its training time while incurring minimal loss in classification accuracy using three different approaches: 1- Band Selection, where we only use samples belonging to the lower and uppermost 2 MHz bands, 2- SNR Selection, where we only use training samples belonging to a single SNR value, and 3- Sample Selection, where we try various sub-Nyquist sampling methods to select the subset of samples most relevant to the classification task. Our results confirm the feasibility of fast deep learning for wireless interference identification, by showing that the training time can be reduced by as much as 30x with minimal loss in accuracy.
△ Less
Submitted 16 May, 2019;
originally announced May 2019.
-
Scattering Mechanisms and Modeling for Terahertz Wireless Communications
Authors:
Shihao Ju,
Syed Hashim Ali Shah,
Muhammad Affan Javed,
Jun Li,
Girish Palteru,
Jyotish Robin,
Yunchou Xing,
Ojas Kanhere,
Theodore S. Rappaport
Abstract:
This paper provides an analysis of radio wave scattering for frequencies ranging from the microwave to the Terahertz band (e.g., 1 GHz - 1 THz), by studying the scattering power reradiated from various types of materials with different surface roughnesses. First, fundamentals of scattering and reflection are developed and explained for use in wireless mobile radio, and the effect of scattering on…
▽ More
This paper provides an analysis of radio wave scattering for frequencies ranging from the microwave to the Terahertz band (e.g., 1 GHz - 1 THz), by studying the scattering power reradiated from various types of materials with different surface roughnesses. First, fundamentals of scattering and reflection are developed and explained for use in wireless mobile radio, and the effect of scattering on the reflection coefficient for rough surfaces is investigated. Received power is derived using two popular scattering models - the directive scattering (DS) model and the radar cross section (RCS) model through simulations over a wide range of frequencies, materials, and orientations for the two models, and measurements confirm the accuracy of the DS model at 140 GHz. This paper shows that scattering can become a prominent propagation mechanism as frequencies extend to millimeter-wave (mmWave) and beyond, but at other times can be treated like simple reflection. Knowledge of scattering effects is critical for appropriate and realistic channel models, which further support the development of massive multiple input-multiple output (MIMO) techniques, localization, ray tracing tool design, and imaging for future 5G and 6G wireless systems.
△ Less
Submitted 8 March, 2019; v1 submitted 6 March, 2019;
originally announced March 2019.
-
Fast Deep Learning for Automatic Modulation Classification
Authors:
Sharan Ramjee,
Shengtai Ju,
Diyu Yang,
Xiaoyu Liu,
Aly El Gamal,
Yonina C. Eldar
Abstract:
In this work, we investigate the feasibility and effectiveness of employing deep learning algorithms for automatic recognition of the modulation type of received wireless communication signals from subsampled data. Recent work considered a GNU radio-based data set that mimics the imperfections in a real wireless channel and uses 10 different modulation types. A Convolutional Neural Network (CNN) a…
▽ More
In this work, we investigate the feasibility and effectiveness of employing deep learning algorithms for automatic recognition of the modulation type of received wireless communication signals from subsampled data. Recent work considered a GNU radio-based data set that mimics the imperfections in a real wireless channel and uses 10 different modulation types. A Convolutional Neural Network (CNN) architecture was then developed and shown to achieve performance that exceeds that of expert-based approaches. Here, we continue this line of work and investigate deep neural network architectures that deliver high classification accuracy. We identify three architectures - namely, a Convolutional Long Short-term Deep Neural Network (CLDNN), a Long Short-Term Memory neural network (LSTM), and a deep Residual Network (ResNet) - that lead to typical classification accuracy values around 90% at high SNR. We then study algorithms to reduce the training time by minimizing the size of the training data set, while incurring a minimal loss in classification accuracy. To this end, we demonstrate the performance of Principal Component Analysis in significantly reducing the training time, while maintaining good performance at low SNR. We also investigate subsampling techniques that further reduce the training time, and pave the way for online classification at high SNR. Finally, we identify representative SNR values for training each of the candidate architectures, and consequently, realize drastic reductions of the training time, with negligible loss in classification accuracy.
△ Less
Submitted 15 January, 2019;
originally announced January 2019.
-
Millimeter-wave Extended NYUSIM Channel Model for Spatial Consistency
Authors:
Shihao Ju,
Theodore S. Rappaport
Abstract:
Commonly used drop-based channel models cannot satisfy the requirements of spatial consistency for millimeter-wave (mmWave) channel modeling where transient motion or closely-spaced users need to be considered. A channel model having \textit{spatial consistency} can capture the smooth variations of channels, when a user moves, or when multiple users are close to each other in a local area within,…
▽ More
Commonly used drop-based channel models cannot satisfy the requirements of spatial consistency for millimeter-wave (mmWave) channel modeling where transient motion or closely-spaced users need to be considered. A channel model having \textit{spatial consistency} can capture the smooth variations of channels, when a user moves, or when multiple users are close to each other in a local area within, say, 10 m in an outdoor scenario. Spatial consistency is needed to support the testing of beamforming and beam tracking for massive multiple-input and multiple-output (MIMO) and multi-user MIMO in fifth-generation (5G) mmWave mobile networks. This paper presents a channel model extension and an associated implementation of spatial consistency in the NYUSIM channel simulation platform. Along with a mathematical model, we use measurements where the user moved along a street and turned at a corner over a path length of 75 m in order to derive realistic values of several key parameters such as correlation distance and the rate of cluster birth and death, that are shown to provide spatial consistency for NYUSIM in an urban microcell street canyon scenario.
△ Less
Submitted 21 August, 2018;
originally announced August 2018.
-
CT Super-resolution GAN Constrained by the Identical, Residual, and Cycle Learning Ensemble(GAN-CIRCLE)
Authors:
Chenyu You,
Guang Li,
Yi Zhang,
Xiaoliu Zhang,
Hongming Shan,
Shenghong Ju,
Zhen Zhao,
Zhuiyang Zhang,
Wenxiang Cong,
Michael W. Vannier,
Punam K. Saha,
Ge Wang
Abstract:
Computed tomography (CT) is widely used in screening, diagnosis, and image-guided therapy for both clinical and research purposes. Since CT involves ionizing radiation, an overarching thrust of related technical research is development of novel methods enabling ultrahigh quality imaging with fine structural details while reducing the X-ray radiation. In this paper, we present a semi-supervised dee…
▽ More
Computed tomography (CT) is widely used in screening, diagnosis, and image-guided therapy for both clinical and research purposes. Since CT involves ionizing radiation, an overarching thrust of related technical research is development of novel methods enabling ultrahigh quality imaging with fine structural details while reducing the X-ray radiation. In this paper, we present a semi-supervised deep learning approach to accurately recover high-resolution (HR) CT images from low-resolution (LR) counterparts. Specifically, with the generative adversarial network (GAN) as the building block, we enforce the cycle-consistency in terms of the Wasserstein distance to establish a nonlinear end-to-end mapping from noisy LR input images to denoised and deblurred HR outputs. We also include the joint constraints in the loss function to facilitate structural preservation. In this deep imaging process, we incorporate deep convolutional neural network (CNN), residual learning, and network in network techniques for feature extraction and restoration. In contrast to the current trend of increasing network depth and complexity to boost the CT imaging performance, which limit its real-world applications by imposing considerable computational and memory overheads, we apply a parallel $1\times1$ CNN to compress the output of the hidden layer and optimize the number of layers and the number of filters for each convolutional layer. Quantitative and qualitative evaluations demonstrate that our proposed model is accurate, efficient and robust for super-resolution (SR) image restoration from noisy LR input images. In particular, we validate our composite SR networks on three large-scale CT datasets, and obtain promising results as compared to the other state-of-the-art methods.
△ Less
Submitted 6 September, 2018; v1 submitted 10 August, 2018;
originally announced August 2018.
-
Simulating Motion - Incorporating Spatial Consistency into the NYUSIM Channel Model
Authors:
Shihao Ju,
Theodore S. Rappaport
Abstract:
This paper describes an implementation of spatial consistency in the NYUSIM channel simulation platform. NYUSIM is a millimeter wave (mmWave) channel simulator that realizes measurement-based channel models based on a wide range of multipath channel parameters, including realistic multipath time delays and multipath components that arrive at different 3-D angles in space, and generates life-like s…
▽ More
This paper describes an implementation of spatial consistency in the NYUSIM channel simulation platform. NYUSIM is a millimeter wave (mmWave) channel simulator that realizes measurement-based channel models based on a wide range of multipath channel parameters, including realistic multipath time delays and multipath components that arrive at different 3-D angles in space, and generates life-like samples of channel impulse responses (CIRs) that statistically match those measured in the real world. To properly simulate channel impairments and variations for adaptive antenna algorithms or channel state feedback, channel models should implement spatial consistency which ensures correlated channel responses over short time and distance epochs. The ability to incorporate spatial consistency into channel simulators will be essential to explore the ability to train and deploy massive multiple-input and multiple-output (MIMO) and multi-user beamforming in next-generation mobile communication systems. This paper reviews existing modeling approaches to spatial consistency, and describes an implementation of spatial consistency in NYUSIM for when a user is moving in a square area having a side length of 15 m. The spatial consistency extension will enable NYUSIM to generate realistic evolutions of temporal and spatial characteristics of the wideband CIRs for mobile users in motion, or for multiple users who are relatively close to one another.
△ Less
Submitted 3 September, 2018; v1 submitted 11 July, 2018;
originally announced July 2018.
-
Verification and Calibration of Antenna Cross-Polarization Discrimination and Penetration Loss for Millimeter Wave Communications
Authors:
Yunchou Xing,
Ojas Kanhere,
Shihao Ju,
Theodore S. Rappaport,
George R. MacCartney Jr
Abstract:
This article presents measurement guidelines and verification procedures for antenna cross-polarization discrimination (XPD) and penetration loss measurements for millimeter wave (mmWave) channel sounder systems. These techniques are needed to ensure accurate and consistent measurements by different researchers at different frequencies and bandwidths. Measurements at 73 GHz are used to demonstrate…
▽ More
This article presents measurement guidelines and verification procedures for antenna cross-polarization discrimination (XPD) and penetration loss measurements for millimeter wave (mmWave) channel sounder systems. These techniques are needed to ensure accurate and consistent measurements by different researchers at different frequencies and bandwidths. Measurements at 73 GHz are used to demonstrate and verify the guidelines, and show the consistency of the antenna XPD factor and the penetration loss at different transmitter-receiver (T-R) separation distances, thus providing a systematic method that may be used at any frequency for reliable field measurements.
△ Less
Submitted 11 July, 2018;
originally announced July 2018.
-
Structure-sensitive Multi-scale Deep Neural Network for Low-Dose CT Denoising
Authors:
Chenyu You,
Qingsong Yang,
Hongming Shan,
Lars Gjesteby,
Guang Li,
Shenghong Ju,
Zhuiyang Zhang,
Zhen Zhao,
Yi Zhang,
Wenxiang Cong,
Ge Wang
Abstract:
Computed tomography (CT) is a popular medical imaging modality in clinical applications. At the same time, the x-ray radiation dose associated with CT scans raises public concerns due to its potential risks to the patients. Over the past years, major efforts have been dedicated to the development of Low-Dose CT (LDCT) methods. However, the radiation dose reduction compromises the signal-to-noise r…
▽ More
Computed tomography (CT) is a popular medical imaging modality in clinical applications. At the same time, the x-ray radiation dose associated with CT scans raises public concerns due to its potential risks to the patients. Over the past years, major efforts have been dedicated to the development of Low-Dose CT (LDCT) methods. However, the radiation dose reduction compromises the signal-to-noise ratio (SNR), leading to strong noise and artifacts that down-grade CT image quality. In this paper, we propose a novel 3D noise reduction method, called Structure-sensitive Multi-scale Generative Adversarial Net (SMGAN), to improve the LDCT image quality. Specifically, we incorporate three-dimensional (3D) volumetric information to improve the image quality. Also, different loss functions for training denoising models are investigated. Experiments show that the proposed method can effectively preserve structural and texture information from normal-dose CT (NDCT) images, and significantly suppress noise and artifacts. Qualitative visual assessments by three experienced radiologists demonstrate that the proposed method retrieves more detailed information, and outperforms competing methods.
△ Less
Submitted 10 August, 2018; v1 submitted 1 May, 2018;
originally announced May 2018.
-
Design and Implementation of a General Decision-making Model in RoboCup Simulation
Authors:
Changda Wang,
Xianyi Chen,
Xibin Zhao,
Shiguang Ju
Abstract:
The study of the collaboration, coordination and negotiation among different agents in a multi-agent system (MAS) has always been the most challenging yet popular in the research of distributed artificial intelligence. In this paper, we will suggest for RoboCup simulation, a typical MAS, a general decision-making model, rather than define a different algorithm for each tactic (e.g. ball handling…
▽ More
The study of the collaboration, coordination and negotiation among different agents in a multi-agent system (MAS) has always been the most challenging yet popular in the research of distributed artificial intelligence. In this paper, we will suggest for RoboCup simulation, a typical MAS, a general decision-making model, rather than define a different algorithm for each tactic (e.g. ball handling, pass, shoot and interception, etc.) in soccer games as most RoboCup simulation teams did. The general decision-making model is based on two critical factors in soccer games: the vertical distance to the goal line and the visual angle for the goalpost. We have used these two parameters to formalize the defensive and offensive decisions in RoboCup simulation and the results mentioned above had been applied in NOVAURO, original name is UJDB, a RoboCup simulation team of Jiangsu University, whose decision-making model, compared with that of Tsinghua University, the world champion team in 2001, is a universal model and easier to be implemented.
△ Less
Submitted 8 November, 2004;
originally announced November 2004.
