-
Massive MIMO-ISAC System With 1-Bit ADCs/DACs
Authors:
Bowen Wang,
Hongyu Li,
Bin Liao,
Ziyang Cheng
Abstract:
This paper investigates a hardware-efficient massive multiple-input multiple-output integrated sensing and communication (MIMO-ISAC) system with 1-bit analog-to-digital converters (ADCs)/digital-to-analog converters (DACs). The proposed system, referred to as 1BitISAC, employs 1-bit DACs at the ISAC transmitter and 1-bit ADCs at the sensing receiver, achieving significant reductions in power consu…
▽ More
This paper investigates a hardware-efficient massive multiple-input multiple-output integrated sensing and communication (MIMO-ISAC) system with 1-bit analog-to-digital converters (ADCs)/digital-to-analog converters (DACs). The proposed system, referred to as 1BitISAC, employs 1-bit DACs at the ISAC transmitter and 1-bit ADCs at the sensing receiver, achieving significant reductions in power consumption and hardware costs. For such kind of systems, two 1BitISAC joint transceiver designs, i.e., i) quality of service constrained 1BitISAC design and ii) quality of detection constrained design, are considered and the corresponding problems are formulated. In order to address these problems, we thoroughly analyze the radar detection performance after 1-bit ADCs quantization and the communication bit error rate. This analysis yields new design insights and leads to unique radar and communication metrics, which enables us to simplify the original problems and employ majorization-minimization and integer linear programming methods to solve the problems. Numerical results are provided to validate the performance analysis of the proposed 1BitISAC and to compare with other ISAC configurations. The superiority of the proposed 1BitISAC system in terms of balancing ISAC performance and energy efficiency is also demonstrated.
△ Less
Submitted 24 May, 2024;
originally announced May 2024.
-
Real-Time 4K Super-Resolution of Compressed AVIF Images. AIS 2024 Challenge Survey
Authors:
Marcos V. Conde,
Zhijun Lei,
Wen Li,
Cosmin Stejerean,
Ioannis Katsavounidis,
Radu Timofte,
Kihwan Yoon,
Ganzorig Gankhuyag,
Jiangtao Lv,
Long Sun,
Jinshan Pan,
Jiangxin Dong,
Jinhui Tang,
Zhiyuan Li,
Hao Wei,
Chenyang Ge,
Dongyang Zhang,
Tianle Liu,
Huaian Chen,
Yi Jin,
Menghan Zhou,
Yiqiang Yan,
Si Gao,
Biao Wu,
Shaoli Liu
, et al. (50 additional authors not shown)
Abstract:
This paper introduces a novel benchmark as part of the AIS 2024 Real-Time Image Super-Resolution (RTSR) Challenge, which aims to upscale compressed images from 540p to 4K resolution (4x factor) in real-time on commercial GPUs. For this, we use a diverse test set containing a variety of 4K images ranging from digital art to gaming and photography. The images are compressed using the modern AVIF cod…
▽ More
This paper introduces a novel benchmark as part of the AIS 2024 Real-Time Image Super-Resolution (RTSR) Challenge, which aims to upscale compressed images from 540p to 4K resolution (4x factor) in real-time on commercial GPUs. For this, we use a diverse test set containing a variety of 4K images ranging from digital art to gaming and photography. The images are compressed using the modern AVIF codec, instead of JPEG. All the proposed methods improve PSNR fidelity over Lanczos interpolation, and process images under 10ms. Out of the 160 participants, 25 teams submitted their code and models. The solutions present novel designs tailored for memory-efficiency and runtime on edge devices. This survey describes the best solutions for real-time SR of compressed high-resolution images.
△ Less
Submitted 25 April, 2024;
originally announced April 2024.
-
The Ninth NTIRE 2024 Efficient Super-Resolution Challenge Report
Authors:
Bin Ren,
Yawei Li,
Nancy Mehta,
Radu Timofte,
Hongyuan Yu,
Cheng Wan,
Yuxin Hong,
Bingnan Han,
Zhuoyuan Wu,
Yajun Zou,
Yuqing Liu,
Jizhe Li,
Keji He,
Chao Fan,
Heng Zhang,
Xiaolin Zhang,
Xuanwu Yin,
Kunlong Zuo,
Bohao Liao,
Peizhe Xia,
Long Peng,
Zhibo Du,
Xin Di,
Wangkai Li,
Yang Wang
, et al. (109 additional authors not shown)
Abstract:
This paper provides a comprehensive review of the NTIRE 2024 challenge, focusing on efficient single-image super-resolution (ESR) solutions and their outcomes. The task of this challenge is to super-resolve an input image with a magnification factor of x4 based on pairs of low and corresponding high-resolution images. The primary objective is to develop networks that optimize various aspects such…
▽ More
This paper provides a comprehensive review of the NTIRE 2024 challenge, focusing on efficient single-image super-resolution (ESR) solutions and their outcomes. The task of this challenge is to super-resolve an input image with a magnification factor of x4 based on pairs of low and corresponding high-resolution images. The primary objective is to develop networks that optimize various aspects such as runtime, parameters, and FLOPs, while still maintaining a peak signal-to-noise ratio (PSNR) of approximately 26.90 dB on the DIV2K_LSDIR_valid dataset and 26.99 dB on the DIV2K_LSDIR_test dataset. In addition, this challenge has 4 tracks including the main track (overall performance), sub-track 1 (runtime), sub-track 2 (FLOPs), and sub-track 3 (parameters). In the main track, all three metrics (ie runtime, FLOPs, and parameter count) were considered. The ranking of the main track is calculated based on a weighted sum-up of the scores of all other sub-tracks. In sub-track 1, the practical runtime performance of the submissions was evaluated, and the corresponding score was used to determine the ranking. In sub-track 2, the number of FLOPs was considered. The score calculated based on the corresponding FLOPs was used to determine the ranking. In sub-track 3, the number of parameters was considered. The score calculated based on the corresponding parameters was used to determine the ranking. RLFN is set as the baseline for efficiency measurement. The challenge had 262 registered participants, and 34 teams made valid submissions. They gauge the state-of-the-art in efficient single-image super-resolution. To facilitate the reproducibility of the challenge and enable other researchers to build upon these findings, the code and the pre-trained model of validated solutions are made publicly available at https://github.com/Amazingren/NTIRE2024_ESR/.
△ Less
Submitted 25 June, 2024; v1 submitted 16 April, 2024;
originally announced April 2024.
-
Uncertainty-driven and Adversarial Calibration Learning for Epicardial Adipose Tissue Segmentation
Authors:
Kai Zhao,
Zhiming Liu,
Jiaqi Liu,
Jingbiao Zhou,
Bihong Liao,
Huifang Tang,
Qiuyu Wang,
Chunquan Li
Abstract:
Epicardial adipose tissue (EAT) is a type of visceral fat that can secrete large amounts of adipokines to affect the myocardium and coronary arteries. EAT volume and density can be used as independent risk markers measurement of volume by noninvasive magnetic resonance images is the best method of assessing EAT. However, segmenting EAT is challenging due to the low contrast between EAT and pericar…
▽ More
Epicardial adipose tissue (EAT) is a type of visceral fat that can secrete large amounts of adipokines to affect the myocardium and coronary arteries. EAT volume and density can be used as independent risk markers measurement of volume by noninvasive magnetic resonance images is the best method of assessing EAT. However, segmenting EAT is challenging due to the low contrast between EAT and pericardial effusion and the presence of motion artifacts. we propose a novel feature latent space multilevel supervision network (SPDNet) with uncertainty-driven and adversarial calibration learning to enhance segmentation for more accurate EAT volume estimation. The network first addresses the blurring of EAT edges due to the medical images in the open medical environments with low quality or out-of-distribution by modeling the uncertainty as a Gaussian distribution in the feature latent space, which using its Bayesian estimation as a regularization constraint to optimize SwinUNETR. Second, an adversarial training strategy is introduced to calibrate the segmentation feature map and consider the multi-scale feature differences between the uncertainty-guided predictive segmentation and the ground truth segmentation, synthesizing the multi-scale adversarial loss directly improves the ability to discriminate the similarity between organizations. Experiments on both the cardiac public MRI dataset (ACDC) and the real-world clinical cohort EAT dataset show that the proposed network outperforms mainstream models, validating that uncertainty-driven and adversarial calibration learning can be used to provide additional information for modeling multi-scale ambiguities.
△ Less
Submitted 23 February, 2024; v1 submitted 22 February, 2024;
originally announced February 2024.
-
Joint DOA estimation and distorted sensor detection under entangled low-rank and row-sparse constraints
Authors:
Huiping Huang,
Tianjian Zhang,
Feng Yin,
Bin Liao,
Henk Wymeersch
Abstract:
The problem of joint direction-of-arrival estimation and distorted sensor detection has received a lot of attention in recent decades. Most state-of-the-art work formulated such a problem via low-rank and row-sparse decomposition, where the low-rank and row-sparse components were treated in an isolated manner. Such a formulation results in a performance loss. Differently, in this paper, we entangl…
▽ More
The problem of joint direction-of-arrival estimation and distorted sensor detection has received a lot of attention in recent decades. Most state-of-the-art work formulated such a problem via low-rank and row-sparse decomposition, where the low-rank and row-sparse components were treated in an isolated manner. Such a formulation results in a performance loss. Differently, in this paper, we entangle the low-rank and row-sparse components by exploring their inherent connection. Furthermore, we take into account the maximal distortion level of the sensors. An alternating optimization scheme is proposed to solve the low-rank component and the sparse component, where a closed-form solution is derived for the low-rank component and a quadratic programming is developed for the sparse component. Numerical results exhibit the effectiveness and superiority of the proposed method.
△ Less
Submitted 21 December, 2023; v1 submitted 19 December, 2023;
originally announced December 2023.
-
A Comparative Study on 1.5T-3T MRI Conversion through Deep Neural Network Models
Authors:
Binhua Liao,
Yani Chen,
Zhewei Wang,
Charles D. Smith,
Jundong Liu
Abstract:
In this paper, we explore the capabilities of a number of deep neural network models in generating whole-brain 3T-like MR images from clinical 1.5T MRIs. The models include a fully convolutional network (FCN) method and three state-of-the-art super-resolution solutions, ESPCN [26], SRGAN [17] and PRSR [7]. The FCN solution, U-Convert-Net, carries out mapping of 1.5T-to-3T slices through a U-Net-li…
▽ More
In this paper, we explore the capabilities of a number of deep neural network models in generating whole-brain 3T-like MR images from clinical 1.5T MRIs. The models include a fully convolutional network (FCN) method and three state-of-the-art super-resolution solutions, ESPCN [26], SRGAN [17] and PRSR [7]. The FCN solution, U-Convert-Net, carries out mapping of 1.5T-to-3T slices through a U-Net-like architecture, with 3D neighborhood information integrated through a multi-view ensemble. The pros and cons of the models, as well the associated evaluation metrics, are measured with experiments and discussed in depth. To the best of our knowledge, this study is the first work to evaluate multiple deep learning solutions for whole-brain MRI conversion, as well as the first attempt to utilize FCN/U-Net-like structure for this purpose.
△ Less
Submitted 12 October, 2022;
originally announced October 2022.
-
Hybrid Beamforming in mmWave Dual-Function Radar-Communication Systems: Models, Technologies, and Challenges
Authors:
Ziyang Cheng,
Linlong Wu,
Bowen Wang,
Bhavani Shankar,
Bin Liao,
Björn Ottersten
Abstract:
As a promising technology in beyond-5G (B5G) and 6G, dual-function radar-communication (DFRC) aims to ensure both radar sensing and communication on a single integrated platform with unified signaling schemes. To achieve accurate sensing and reliable communication, large-scale arrays are anticipated to be implemented in such systems, which brings out the prominent issues on hardware cost and power…
▽ More
As a promising technology in beyond-5G (B5G) and 6G, dual-function radar-communication (DFRC) aims to ensure both radar sensing and communication on a single integrated platform with unified signaling schemes. To achieve accurate sensing and reliable communication, large-scale arrays are anticipated to be implemented in such systems, which brings out the prominent issues on hardware cost and power consumption. To address these issues, hybrid beamforming (HBF), beyond its successful deployment in communication-only systems, could be a promising approach in the emerging DFRC ones. In this article, we investigate the development of the HBF techniques on the DFRC system in a self-contained manner. Specifically, we first introduce the basics of the HBF based DFRC system, where the system model and different receive modes are discussed with focus. Then we illustrate the corresponding design principles, which span from the performance metrics and optimization formulations to the design approaches and our preliminary results. Finally, potential extension and key research opportunities, such as the combination with the reconfigurable intelligent surface, are discussed concisely.
△ Less
Submitted 4 March, 2024; v1 submitted 10 September, 2022;
originally announced September 2022.
-
A Robust Deep Unfolded Network for Sparse Signal Recovery from Noisy Binary Measurements
Authors:
Y. Yang,
P. Xiao,
B. Liao,
N. Deligiannis
Abstract:
We propose a novel deep neural network, coined DeepFPC-$\ell_2$, for solving the 1-bit compressed sensing problem. The network is designed by unfolding the iterations of the fixed-point continuation (FPC) algorithm with one-sided $\ell_2$-norm (FPC-$\ell_2$). The DeepFPC-$\ell_2$ method shows higher signal reconstruction accuracy and convergence speed than the traditional FPC-$\ell_2$ algorithm. F…
▽ More
We propose a novel deep neural network, coined DeepFPC-$\ell_2$, for solving the 1-bit compressed sensing problem. The network is designed by unfolding the iterations of the fixed-point continuation (FPC) algorithm with one-sided $\ell_2$-norm (FPC-$\ell_2$). The DeepFPC-$\ell_2$ method shows higher signal reconstruction accuracy and convergence speed than the traditional FPC-$\ell_2$ algorithm. Furthermore, we compare its robustness to noise with the previously proposed DeepFPC network---which stemmed from unfolding the FPC-$\ell_1$ algorithm---for different signal to noise ratio (SNR) and sign-flipped ratio (flip ratio) scenarios. We show that the proposed network has better noise immunity than the previous DeepFPC method. This result indicates that the robustness of a deep-unfolded neural network is related with that of the algorithm it stems from.
△ Less
Submitted 15 October, 2020;
originally announced October 2020.
-
Ocean Reverberation Suppression via Matrix Completion with Sensor Failure
Authors:
Li-ya Xu,
Bin Liao,
Hao Zhang,
Peng Xiao,
Jian-jun Huang
Abstract:
In the ocean environment, reverberation is a common and strong interference which significantly degrades the performance of target bearing estimation. Meanwhile, sensor failure is inevitable in actual sonar deployment as the underwater scene is complicated. Therefore, it is a challenge for target detection in the ocean reverberation with sensor failure. To address this issue, we propose an improve…
▽ More
In the ocean environment, reverberation is a common and strong interference which significantly degrades the performance of target bearing estimation. Meanwhile, sensor failure is inevitable in actual sonar deployment as the underwater scene is complicated. Therefore, it is a challenge for target detection in the ocean reverberation with sensor failure. To address this issue, we propose an improved approach based on the principle of low rank characteristics of matrix in this paper. Firstly, we utilize Hankel structured matrix to counteract the problem of sensor failure. Then, the algorithm of matrix completion (MC) based on l1-norm and l2-norm are exploited to recover the true signal matrix from the corrupted received matrix. Numerical results demonstrate that compared with other related methods, the l1-norm provides better capability in the probability of recovery and shows the best robustness of bearing estimation with the narrow beam width and low sidelobe. Moreover, the proposed approach verifies the performances of reverberation suppression and achieves high resolution of target detection.
△ Less
Submitted 1 July, 2020; v1 submitted 26 April, 2020;
originally announced April 2020.
-
DeepFPC: Deep Unfolding of a Fixed-Point Continuation Algorithm for Sparse Signal Recovery from Quantized Measurements
Authors:
Peng Xiao,
Bin Liao,
Nikos Deligiannis
Abstract:
We present DeepFPC, a novel deep neural network designed by unfolding the iterations of the fixed-point continuation algorithm with one-sided l1-norm (FPC-l1), which has been proposed for solving the 1-bit compressed sensing problem. The network architecture resembles that of deep residual learning and incorporates prior knowledge about the signal structure (i.e., sparsity), thereby offering inter…
▽ More
We present DeepFPC, a novel deep neural network designed by unfolding the iterations of the fixed-point continuation algorithm with one-sided l1-norm (FPC-l1), which has been proposed for solving the 1-bit compressed sensing problem. The network architecture resembles that of deep residual learning and incorporates prior knowledge about the signal structure (i.e., sparsity), thereby offering interpretability by design. Once DeepFPC is properly trained, a sparse signal can be recovered fast and accurately from quantized measurements. The proposed model is evaluated in the task of direction-of-arrival (DOA) estimation and is shown to outperform state-of-the-art algorithms, namely, the iterative FPC-l1 algorithm and the 1-bit MUSIC method.
△ Less
Submitted 4 December, 2019; v1 submitted 2 December, 2019;
originally announced December 2019.
-
One-Bit MUSIC
Authors:
Xiaodong Huang,
Bin Liao
Abstract:
In this letter, we consider the problem of direction-of-arrival (DOA) estimation with one-bit quantized array measurements. With analysis, it is shown that, under mild conditions the one-bit covariance matrix can be approximated by the sum of a scaled unquantized covariance matrix and a scaled identity matrix. Although the scaling parameters unknown because of the extreme quantization, they do not…
▽ More
In this letter, we consider the problem of direction-of-arrival (DOA) estimation with one-bit quantized array measurements. With analysis, it is shown that, under mild conditions the one-bit covariance matrix can be approximated by the sum of a scaled unquantized covariance matrix and a scaled identity matrix. Although the scaling parameters unknown because of the extreme quantization, they do not affect the subspace-based DOA estimators. Specifically, the signal and noise subspaces can be straightforwardly determined through the eigendecomposition of the one-bit covariance matrix, without pre-processing such as unquantized covariance matrix reconstruction. With so-obtained subspaces, the most classical multiple signal classification (MUSIC) technique can be applied to determine the signal DOAs. The resulting method is thus termed as one-bit MUSIC. Thanks to the simplicity of this method, it can be very easily implemented in practical applications, whereas the DOA estimation performance is comparable to the case with unquantized covariance matrix reconstruction, as demonstrated by various simulations.
△ Less
Submitted 15 January, 2019;
originally announced January 2019.
-
A Fast Method for Array Response Adjustment with Phase-Only Constraint
Authors:
Xuejing Zhang,
Zishu He,
Bin Liao,
Xuepan Zhang,
Yue Yang
Abstract:
In this paper, we propose a fast method for array response adjustment with phase-only constraint. This method can precisely and rapidly adjust the array response of a given point by only varying the entry phases of a pre-assigned weight vector. We show that phase-only array response adjustment can be formulated as a polygon construction problem, which can be solved by edge rotation in complex plai…
▽ More
In this paper, we propose a fast method for array response adjustment with phase-only constraint. This method can precisely and rapidly adjust the array response of a given point by only varying the entry phases of a pre-assigned weight vector. We show that phase-only array response adjustment can be formulated as a polygon construction problem, which can be solved by edge rotation in complex plain. Unlike the existing approaches, the proposed algorithm provides an analytical solution and guarantees a precise phase-only adjustment without pattern distortion. Moreover, the proposed method is suitable for an arbitrarily given weight vector and has a low computational complexity. Representative examples are presented to demonstrate the effectiveness of the proposed algorithm.
△ Less
Submitted 14 November, 2018;
originally announced November 2018.
-
Computation of Optimal Control Problems with Terminal Constraint via Variation Evolution
Authors:
Sheng Zhang,
Bo Liao,
Fei Liao
Abstract:
Enlightened from the inverse consideration of the stable continuous-time dynamics evolution, the Variation Evolving Method (VEM) analogizes the optimal solution to the equilibrium point of an infinite-dimensional dynamic system and solves it in an asymptotically evolving way. In this paper, the compact version of the VEM is further developed for the computation of Optimal Control Problems (OCPs) w…
▽ More
Enlightened from the inverse consideration of the stable continuous-time dynamics evolution, the Variation Evolving Method (VEM) analogizes the optimal solution to the equilibrium point of an infinite-dimensional dynamic system and solves it in an asymptotically evolving way. In this paper, the compact version of the VEM is further developed for the computation of Optimal Control Problems (OCPs) with terminal constraint. The corresponding Evolution Partial Differential Equation (EPDE), which describes the variation motion towards the optimal solution, is derived, and the costate-free optimality conditions are established. The explicit analytic expressions of the costates and the Lagrange multipliers adjoining the terminal constraint, related to the states and the control variables, are presented. With the semi-discrete method in the field of PDE numerical calculation, the EPDE is discretized as finite-dimensional Initial-value Problems (IVPs) to be solved, with common Ordinary Differential Equation (ODE) numerical integration methods.
△ Less
Submitted 2 January, 2018;
originally announced January 2018.
-
A novel array response control algorithm via oblique projection
Authors:
Xuejing Zhang,
Zishu He,
Bin Liao,
Xuepan Zhang,
Weilai Peng
Abstract:
This paper presents a novel array response control algorithm and its application to array pattern synthesis. The proposed algorithm considers how to flexibly and precisely adjust the array responses at multiple points, on the basis of one given weight vector. With the principle of adaptive beamforming, it is shown that the optimal weight vector for array response control can be equivalently obtain…
▽ More
This paper presents a novel array response control algorithm and its application to array pattern synthesis. The proposed algorithm considers how to flexibly and precisely adjust the array responses at multiple points, on the basis of one given weight vector. With the principle of adaptive beamforming, it is shown that the optimal weight vector for array response control can be equivalently obtained with a different manner, in which a linear transformation is conducted on the quiescent weight. This new strategy is utilized to realize multi-point precise array response control from one given weight vector, and it obtains a closed-form solution. A careful analysis shows that the response levels at given points can be independently, flexibly and accurately adjusted by simply varying the parameter vector, and that the uncontrolled region remains almost unchanged. By applying the proposed algorithm, an effective pattern synthesis approach is devised. Simulation results are provided to demonstrate the performance of the proposed algorithm.
△ Less
Submitted 29 January, 2018; v1 submitted 28 December, 2017;
originally announced December 2017.
-
OPARC: Optimal and Precise Array Response Control Algorithm -- Part II: Multi-points and Applications
Authors:
Xuejing Zhang,
Zishu He,
Xiang-Gen Xia,
Bin Liao,
Xuepan Zhang,
Yue Yang
Abstract:
In this paper, the optimal and precise array response control (OPARC) algorithm proposed in Part I of this two paper series is extended from single point to multi-points. Two computationally attractive parameter determination approaches are provided to maximize the array gain under certain constraints. In addition, the applications of the multi-point OPARC algorithm to array signal processing are…
▽ More
In this paper, the optimal and precise array response control (OPARC) algorithm proposed in Part I of this two paper series is extended from single point to multi-points. Two computationally attractive parameter determination approaches are provided to maximize the array gain under certain constraints. In addition, the applications of the multi-point OPARC algorithm to array signal processing are studied. It is applied to realize array pattern synthesis (including the general array case and the large array case), multi-constraint adaptive beamforming and quiescent pattern control, where an innovative concept of normalized covariance matrix loading (NCL) is proposed. Finally, simulation results are presented to validate the superiority and effectiveness of the multi-point OPARC algorithm.
△ Less
Submitted 28 December, 2017;
originally announced December 2017.
-
OPARC: Optimal and Precise Array Response Control Algorithm -- Part I: Fundamentals
Authors:
Xuejing Zhang,
Zishu He,
Xiang-Gen Xia,
Bin Liao,
Xuepan Zhang,
Yue Yang
Abstract:
In this paper, the problem of how to optimally and precisely control array response levels is addressed. By using the concept of the optimal weight vector from the adaptive array theory and adding virtual interferences one by one, the change rule of the optimal weight vector is found and a new formulation of the weight vector update is thus devised. Then, the issue of how to precisely control the…
▽ More
In this paper, the problem of how to optimally and precisely control array response levels is addressed. By using the concept of the optimal weight vector from the adaptive array theory and adding virtual interferences one by one, the change rule of the optimal weight vector is found and a new formulation of the weight vector update is thus devised. Then, the issue of how to precisely control the response level of one single direction is investigated. More specifically, we assign a virtual interference to a direction such that the response level can be precisely controlled. Moreover, the parameters, such as, the interference-to-noise ratio (INR), can be figured out according to the desired level. Additionally, the parameter optimization is carried out to obtain the maximal array gain. The resulting scheme is called optimal and precise array response control (OPARC) in this paper. To understand it better, its properties are given, and its comparison with the existing accurate array response control ($ {\textrm A}^2\textrm{RC} $) algorithm is provided. Finally, simulation results are presented to verify the effectiveness and superiority of the proposed OPARC.
△ Less
Submitted 28 December, 2017;
originally announced December 2017.