-
The Ninth NTIRE 2024 Efficient Super-Resolution Challenge Report
Authors:
Bin Ren,
Yawei Li,
Nancy Mehta,
Radu Timofte,
Hongyuan Yu,
Cheng Wan,
Yuxin Hong,
Bingnan Han,
Zhuoyuan Wu,
Yajun Zou,
Yuqing Liu,
Jizhe Li,
Keji He,
Chao Fan,
Heng Zhang,
Xiaolin Zhang,
Xuanwu Yin,
Kunlong Zuo,
Bohao Liao,
Peizhe Xia,
Long Peng,
Zhibo Du,
Xin Di,
Wangkai Li,
Yang Wang
, et al. (109 additional authors not shown)
Abstract:
This paper provides a comprehensive review of the NTIRE 2024 challenge, focusing on efficient single-image super-resolution (ESR) solutions and their outcomes. The task of this challenge is to super-resolve an input image with a magnification factor of x4 based on pairs of low and corresponding high-resolution images. The primary objective is to develop networks that optimize various aspects such…
▽ More
This paper provides a comprehensive review of the NTIRE 2024 challenge, focusing on efficient single-image super-resolution (ESR) solutions and their outcomes. The task of this challenge is to super-resolve an input image with a magnification factor of x4 based on pairs of low and corresponding high-resolution images. The primary objective is to develop networks that optimize various aspects such as runtime, parameters, and FLOPs, while still maintaining a peak signal-to-noise ratio (PSNR) of approximately 26.90 dB on the DIV2K_LSDIR_valid dataset and 26.99 dB on the DIV2K_LSDIR_test dataset. In addition, this challenge has 4 tracks including the main track (overall performance), sub-track 1 (runtime), sub-track 2 (FLOPs), and sub-track 3 (parameters). In the main track, all three metrics (ie runtime, FLOPs, and parameter count) were considered. The ranking of the main track is calculated based on a weighted sum-up of the scores of all other sub-tracks. In sub-track 1, the practical runtime performance of the submissions was evaluated, and the corresponding score was used to determine the ranking. In sub-track 2, the number of FLOPs was considered. The score calculated based on the corresponding FLOPs was used to determine the ranking. In sub-track 3, the number of parameters was considered. The score calculated based on the corresponding parameters was used to determine the ranking. RLFN is set as the baseline for efficiency measurement. The challenge had 262 registered participants, and 34 teams made valid submissions. They gauge the state-of-the-art in efficient single-image super-resolution. To facilitate the reproducibility of the challenge and enable other researchers to build upon these findings, the code and the pre-trained model of validated solutions are made publicly available at https://github.com/Amazingren/NTIRE2024_ESR/.
△ Less
Submitted 25 June, 2024; v1 submitted 16 April, 2024;
originally announced April 2024.
-
Event-based Asynchronous HDR Imaging by Temporal Incident Light Modulation
Authors:
Yuliang Wu,
Ganchao Tan,
Jinze Chen,
Wei Zhai,
Yang Cao,
Zheng-Jun Zha
Abstract:
Dynamic Range (DR) is a pivotal characteristic of imaging systems. Current frame-based cameras struggle to achieve high dynamic range imaging due to the conflict between globally uniform exposure and spatially variant scene illumination. In this paper, we propose AsynHDR, a Pixel-Asynchronous HDR imaging system, based on key insights into the challenges in HDR imaging and the unique event-generati…
▽ More
Dynamic Range (DR) is a pivotal characteristic of imaging systems. Current frame-based cameras struggle to achieve high dynamic range imaging due to the conflict between globally uniform exposure and spatially variant scene illumination. In this paper, we propose AsynHDR, a Pixel-Asynchronous HDR imaging system, based on key insights into the challenges in HDR imaging and the unique event-generating mechanism of Dynamic Vision Sensors (DVS). Our proposed AsynHDR system integrates the DVS with a set of LCD panels. The LCD panels modulate the irradiance incident upon the DVS by altering their transparency, thereby triggering the pixel-independent event streams. The HDR image is subsequently decoded from the event streams through our temporal-weighted algorithm. Experiments under standard test platform and several challenging scenes have verified the feasibility of the system in HDR imaging task.
△ Less
Submitted 14 March, 2024;
originally announced March 2024.
-
A Scalable 256-Elements E-Band Phased-Array Transceiver for Broadband Communication
Authors:
Xu Li,
Wenyao Zhai,
Morris Repeta,
Hua Cai,
Tyler Ross,
Kimia Ansari,
Sam Tiller,
Hari Krishna Pothula,
Dong Liang,
Fan Yang,
Yibo Lyu,
Songlin Shuai,
Guangjian Wang,
Wen Tong
Abstract:
For E-band wireless communications, a high gain steerable antenna with sub-arrays is desired to reduce the implementation complexity. This paper presents an E-band communication link with 256-elements antennas based on 8-elements sub-arrays and four beam-forming chips in silicon germanium (SiGe) bipolar complementary metal-oxide-semiconductor (BiCMOS), which is packaged on a 19-layer low temperatu…
▽ More
For E-band wireless communications, a high gain steerable antenna with sub-arrays is desired to reduce the implementation complexity. This paper presents an E-band communication link with 256-elements antennas based on 8-elements sub-arrays and four beam-forming chips in silicon germanium (SiGe) bipolar complementary metal-oxide-semiconductor (BiCMOS), which is packaged on a 19-layer low temperature co-fired ceramic (LTCC) substrate. After the design and manufacture of the 256-elements antenna, a fast near-field calibration method is proposed for calibration, where a single near-field measurement is required. Then near-field to far-field (NFFF) transform and far-field to near-field (FFNF) transform are used for the bore-sight calibration. The comparison with high frequency structure simulator (HFSS) is utilized for the non-bore-sight calibration. Verified on the 256-elements antenna, the beam-forming performance measured in the chamber is in good agreement with the simulations. The communication in the office environment is also realized using a fifth generation (5G) new radio (NR) system, whose bandwidth is 400 megahertz (MHz) and waveform format is orthogonal frequency division multiplexing (OFDM) with 120 kilohertz (kHz) sub-carrier spacing.
△ Less
Submitted 20 June, 2021;
originally announced June 2021.
-
Cognitive-Driven Optimization of Sparse Array Transceiver for MIMO Radar Beamforming
Authors:
Weitong Zhai,
Xiangrong Wang,
Syed A. Hamza,
Moeness G. Amin
Abstract:
Cognitive multiple-input multiple-output (MIMO) radar is capable of adjusting system parameters adaptively by sensing and learning in complex dynamic environment. Beamforming performance of MIMO radar is guided by both beamforming weight coefficients and the transceiver configuration. We propose a cognitive-driven MIMO array design where both the beamforming weights and the transceiver configurati…
▽ More
Cognitive multiple-input multiple-output (MIMO) radar is capable of adjusting system parameters adaptively by sensing and learning in complex dynamic environment. Beamforming performance of MIMO radar is guided by both beamforming weight coefficients and the transceiver configuration. We propose a cognitive-driven MIMO array design where both the beamforming weights and the transceiver configuration are adaptively and concurrently optimized under different environmental conditions. The perception-action cycle involves data collection of full virtual array, covariance reconstruction and joint design of the transmit and receive arrays by antenna selection.The optimal transceiver array design is realized by promoting two-dimensional group sparsity via iteratively minimizing reweighted mixed L21-norm, with constraints imposed on transceiver antenna spacing for proper transmit/receive isolation. Simulations are provided to demonstrate the "perception-action" capability of the proposed cognitive sparse MIMO array in achieving enhanced beamforming and anti-jamming in dynamic target and interference environment.
△ Less
Submitted 4 March, 2021;
originally announced March 2021.
-
6G Downlink Transmission via Rate Splitting Space Division Multiple Access Based on Grouped Code Index Modulation
Authors:
Wenchao Zhai,
Yishan Wu,
Jun Zhao,
Huimei Han
Abstract:
A novel rate splitting space division multiple access (SDMA) scheme based on grouped code index modulation (GrCIM) is proposed for the sixth generation (6G) downlink transmission. The proposed RSMA-GrCIM scheme transmits information to multiple user equipments (UEs) through the space division multiple access (SDMA) technique, and exploits code index modulation for rate splitting. Since the CIM sch…
▽ More
A novel rate splitting space division multiple access (SDMA) scheme based on grouped code index modulation (GrCIM) is proposed for the sixth generation (6G) downlink transmission. The proposed RSMA-GrCIM scheme transmits information to multiple user equipments (UEs) through the space division multiple access (SDMA) technique, and exploits code index modulation for rate splitting. Since the CIM scheme conveys information bits via the index of the selected Walsh code and binary phase shift keying (BPSK) signal, our RSMA scheme transmits the private messages of each user through the indices, and the common messages via the BPSK signal. Moreover, the Walsh code set is grouped into several orthogonal subsets to eliminate the interference from other users. A maximum likelihood (ML) detector is used to recovery the source bits, and a mathematical analysis is provided for the upper bound bit error ratio (BER) of each user. Comparisons are also made between our proposed scheme and the traditional SDMA scheme in spectrum utilization, number of available UEs, etc. Numerical results are given to verify the effectiveness of the proposed SDMA-GrCIM scheme.
△ Less
Submitted 1 March, 2021;
originally announced March 2021.
-
Sparse Array Transceiver Design for Enhanced Adaptive Beamforming in MIMO Radar
Authors:
Syed A. Hamza,
Weitong Zhai,
Xiangrong Wang,
Moeness G. Amin
Abstract:
Sparse array design aided by emerging fast sensor switching technologies can lower the overall system overhead by reducing the number of expensive transceiver chains. In this paper, we examine the active sparse array design enabling the maximum signal to interference plus noise ratio (MaxSINR) beamforming at the MIMO radar receiver. The proposed approach entails an entwined design, i.e., jointly s…
▽ More
Sparse array design aided by emerging fast sensor switching technologies can lower the overall system overhead by reducing the number of expensive transceiver chains. In this paper, we examine the active sparse array design enabling the maximum signal to interference plus noise ratio (MaxSINR) beamforming at the MIMO radar receiver. The proposed approach entails an entwined design, i.e., jointly selecting the optimum transmit and receive sensor locations for accomplishing MaxSINR receive beamforming. Specifically, we consider a co-located multiple-input multiple-output (MIMO) radar platform with orthogonal transmitted waveforms, and examine antenna selections at the transmit and receive arrays. The optimum active sparse array transceiver design problem is formulated as successive convex approximation (SCA) alongside the two-dimensional group sparsity promoting regularization. Several examples are provided to demonstrate the effectiveness of the proposed approach in utilizing the given transmit/receive array aperture and degrees of freedom for achieving MaxSINR beamforming.
△ Less
Submitted 19 February, 2021;
originally announced February 2021.
-
Smart City Enabled by 5G/6G Networks: An Intelligent Hybrid Random Access Scheme
Authors:
Huimei Han,
Wenchao Zhai,
Jun Zhao
Abstract:
The Internet of Things (IoT) is the enabler for smart city to achieve the envision of the "Internet of Everything" by intelligently connecting devices without human interventions. The explosive growth of IoT devices makes the amount of business data generated by machine-type communications (MTC) account for a great proportion in all communication services. The fifth-generation (5G) specification f…
▽ More
The Internet of Things (IoT) is the enabler for smart city to achieve the envision of the "Internet of Everything" by intelligently connecting devices without human interventions. The explosive growth of IoT devices makes the amount of business data generated by machine-type communications (MTC) account for a great proportion in all communication services. The fifth-generation (5G) specification for cellular networks defines two types of application scenarios for MTC: One is massive machine type communications (mMTC) requiring massive connections, while the other is ultra-reliable low latency communications (URLLC) requiring high reliability and low latency communications. 6G, as the next generation beyond 5G, will have even stronger scales of mMTC and URLLC. mMTC and URLLC will co-exist in MTC networks for 5G 6G-enabled smart city. To enable massive and reliable LLC access to such heterogeneous MTC networks where mMTC and URLLC co-exist, in this article, we introduce the network architecture of heterogeneous MTC networks, and propose an intelligent hybrid random access scheme for 5G/6G-enabled smart city. Numerical results show that, compared to the benchmark schemes, the proposed scheme significantly improves the successful access probability, and satisfies the diverse quality of services requirements of URLLC and mMTC devices.
△ Less
Submitted 5 May, 2022; v1 submitted 16 January, 2021;
originally announced January 2021.
-
A Comprehensive Survey of 6G Wireless Communications
Authors:
Yang Zhao,
Wenchao Zhai,
Jun Zhao,
Tinghao Zhang,
Sumei Sun,
Dusit Niyato,
Kwok-Yan Lam
Abstract:
While fifth-generation (5G) communications are being rolled out worldwide, sixth-generation (6G) communications have attracted much attention from both the industry and the academia. Compared with 5G, 6G will have a wider frequency band, higher transmission rate, spectrum efficiency, greater connection capacity, shorter delay, broader coverage, and more robust anti-interference capability to satis…
▽ More
While fifth-generation (5G) communications are being rolled out worldwide, sixth-generation (6G) communications have attracted much attention from both the industry and the academia. Compared with 5G, 6G will have a wider frequency band, higher transmission rate, spectrum efficiency, greater connection capacity, shorter delay, broader coverage, and more robust anti-interference capability to satisfy various network requirements. This survey presents an insightful understanding of 6G wireless communications by introducing requirements, features, critical technologies, challenges, and applications. First, we give an overview of 6G from perspectives of technologies, security and privacy, and applications. Subsequently, we introduce various 6G technologies and their existing challenges in detail, e.g., artificial intelligence (AI), intelligent surfaces, THz, space-air-ground-sea integrated network, cell-free massive MIMO, etc. Because of these technologies, 6G is expected to outperform existing wireless communication systems regarding the transmission rate, latency, global coverage, etc. Next, we discuss security and privacy techniques that can be applied to protect data in 6G. Since edge devices are expected to gain popularity soon, the vast amount of generated data and frequent data exchange make the leakage of data easily. Finally, we predict real-world applications built on the technologies and features of 6G; for example, smart healthcare, smart city, and smart manufacturing will be implemented by taking advantage of AI.
△ Less
Submitted 16 February, 2021; v1 submitted 21 December, 2020;
originally announced January 2021.
-
A GCICA Grant-Free Random Access Scheme for M2M Communications in Crowded Massive MIMO Systems
Authors:
Huimei Han,
Lushun Fang,
Weidang Lu,
Wenchao Zhai,
Ying Li,
Jun Zhao
Abstract:
A high success rate of grant-free random access scheme is proposed to support massive access for machine-to-machine communications in massive multipleinput multiple-output systems. This scheme allows active user equipments (UEs) to transmit their modulated uplink messages along with super pilots consisting of multiple sub-pilots to a base station (BS). Then, the BS performs channel state informati…
▽ More
A high success rate of grant-free random access scheme is proposed to support massive access for machine-to-machine communications in massive multipleinput multiple-output systems. This scheme allows active user equipments (UEs) to transmit their modulated uplink messages along with super pilots consisting of multiple sub-pilots to a base station (BS). Then, the BS performs channel state information (CSI) estimation and uplink message decoding by utilizing a proposed graph combined clustering independent component analysis (GCICA) decoding algorithm, and then employs the estimated CSIs to detect active UEs by utilizing the characteristic of asymptotic favorable propagation of massive MIMO channel. We call this proposed scheme as GCICA based random access (GCICA-RA) scheme. We analyze the successful access probability, missed detection probability, and uplink throughput of the GCICA-RA scheme. Numerical results show that, the GCICA-RA scheme significantly improves the successful access probability and uplink throughput, decreases missed detection probability, and provides low CSI estimation error at the same time.
△ Less
Submitted 25 December, 2020;
originally announced December 2020.
-
An LSTM-Aided Hybrid Random Access Scheme for 6G Machine Type Communication Networks
Authors:
Wenchao Zhai,
Huimei Han,
Lei Liu,
Jun Zhao
Abstract:
In this paper, an LSTM-aided hybrid random access scheme (LSTMH-RA) is proposed to support diverse quality of service (QoS) requirements in 6G machine-type communication (MTC) networks, where massive MTC (mMTC) devices and ultra-reliable low latency communications (URLLC) devices coexist. In the proposed LSTMH-RA scheme, mMTC devices access the network via a timing advance (TA)-aided four-step pro…
▽ More
In this paper, an LSTM-aided hybrid random access scheme (LSTMH-RA) is proposed to support diverse quality of service (QoS) requirements in 6G machine-type communication (MTC) networks, where massive MTC (mMTC) devices and ultra-reliable low latency communications (URLLC) devices coexist. In the proposed LSTMH-RA scheme, mMTC devices access the network via a timing advance (TA)-aided four-step procedure to meet massive access requirement, while the access procedure of the URLLC devices is completed in two steps coupled with the mMTC devices' access procedure to reduce latency. Furthermore, we propose an attention-based LSTM prediction model to predict the number of active URLLC devices, thereby determining the parameters of the multi-user detection algorithm to guarantee the latency and reliability access requirements of URLLC devices. We analyze the successful access probability of the LSTMH-RA scheme. Numerical results show that, compared with the benchmark schemes, the proposed LSTMH-RA scheme can significantly improve the successful access probability, and thus satisfy the diverse QoS requirements of URLLC and mMTC devices.
△ Less
Submitted 29 July, 2022; v1 submitted 25 December, 2020;
originally announced December 2020.
-
A novel random access scheme for M2M communication in crowded asynchronous massive MIMO systems
Authors:
Huimei Han,
Wenchao Zhai,
Zhefu Wu,
Ying Li,
Jun Zhao,
Mingda Chen
Abstract:
A new random access scheme is proposed to solve the intra-cell pilot collision for M2M communication in crowded asynchronous massive multiple-input multiple-output (MIMO) systems. The proposed scheme utilizes the proposed estimation of signal parameters via rotational invariance technique enhanced (ESPRIT-E) method to estimate the effective timing offsets, and then active UEs obtain their timing e…
▽ More
A new random access scheme is proposed to solve the intra-cell pilot collision for M2M communication in crowded asynchronous massive multiple-input multiple-output (MIMO) systems. The proposed scheme utilizes the proposed estimation of signal parameters via rotational invariance technique enhanced (ESPRIT-E) method to estimate the effective timing offsets, and then active UEs obtain their timing errors from the effective timing offsets for uplink message transmission. We analyze the mean squared error of the estimated effective timing offsets of UEs, and the uplink throughput. Simulation results show that, compared to the exiting random access scheme for the crowded asynchronous massive MIMO systems, the proposed scheme can improve the uplink throughput and estimate the effective timing offsets accurately at the same time.
△ Less
Submitted 13 July, 2020;
originally announced July 2020.
-
A Survey of 6G Wireless Communications: Emerging Technologies
Authors:
Yang Zhao,
Jun Zhao,
Wenchao Zhai,
Sumei Sun,
Dusit Niyato,
Kwok-Yan Lam
Abstract:
While fifth-generation (5G) communications are being rolled out around the world, sixth-generation (6G) communications have attracted much attention from both the industry and academia. Compared with 5G, 6G will have a wider frequency band, higher transmission rate, spectrum efficiency, greater connection capacity, shorter delay, wider coverage and stronger anti-interference capability, so as to m…
▽ More
While fifth-generation (5G) communications are being rolled out around the world, sixth-generation (6G) communications have attracted much attention from both the industry and academia. Compared with 5G, 6G will have a wider frequency band, higher transmission rate, spectrum efficiency, greater connection capacity, shorter delay, wider coverage and stronger anti-interference capability, so as to meet the various network requirements for industries. In this paper, we present a survey of potential essential technologies in 6G. In particular, we will introduce artificial intelligence, intelligent surfaces, terahertz communications technologies in detail, while giving a brief introduction to other potential technologies, including visible light communications, Blockchain-enabled wireless network, advanced duplex and holographic radio.
△ Less
Submitted 23 December, 2020; v1 submitted 18 April, 2020;
originally announced April 2020.
-
Reconfigurable Intelligent Surface Aided Power Control for Physical-Layer Broadcasting
Authors:
Huimei Han,
Jun Zhao,
Zehui Xiong,
Dusit Niyato,
Wenchao Zhai,
Marco Di Renzo,
Quoc-Viet Pham,
Weidang Lu
Abstract:
Reconfigurable intelligent surface (RIS), a recently introduced technology for future wireless com-munication systems, enhances the spectral and energy efficiency by intelligently adjusting the propaga-tion conditions between a base station (BS) and mobile equipments (MEs). An RIS consists of manylow-cost passive reflecting elements to improve the quality of the received signal. In this paper, wes…
▽ More
Reconfigurable intelligent surface (RIS), a recently introduced technology for future wireless com-munication systems, enhances the spectral and energy efficiency by intelligently adjusting the propaga-tion conditions between a base station (BS) and mobile equipments (MEs). An RIS consists of manylow-cost passive reflecting elements to improve the quality of the received signal. In this paper, westudy the problem of power control at the BS for the RIS aided physical-layer broadcasting. Our goalis to minimize the transmit power at the BS by jointly designing the transmit beamforming at the BSand the phase shifts of the passive elements at the RIS. Furthermore, to help validate the proposedoptimization methods, we derive lower bounds to quantify the average transmit power at the BS as afunction of the number of MEs, the number of RIS elements, and the number of antennas at the BS.The simulation results demonstrated that the average transmit power at the BS is close to the lowerbound in an RIS aided system, and is significantly lower than the average transmit power in conventionalschemes without the RIS.
△ Less
Submitted 5 March, 2022; v1 submitted 7 December, 2019;
originally announced December 2019.