Showing 1–11 of 11 results for author: Kong, G

Stochastic Parrots or ICU Experts? Large Language Models in Critical Care Medicine: A Scoping Review

Authors: Tongyue Shi, Jun Ma, Zihan Yu, Haowei Xu, Minqi Xiong, Meirong Xiao, Yilin Li, Huiying Zhao, Guilan Kong

Abstract: With the rapid development of artificial intelligence (AI), large language models (LLMs) have shown strong capabilities in natural language understanding, reasoning, and generation, attracting amounts of research interest in applying LLMs to health and medicine. Critical care medicine (CCM) provides diagnosis and treatment for critically ill patients who often require intensive monitoring and inte… ▽ More With the rapid development of artificial intelligence (AI), large language models (LLMs) have shown strong capabilities in natural language understanding, reasoning, and generation, attracting amounts of research interest in applying LLMs to health and medicine. Critical care medicine (CCM) provides diagnosis and treatment for critically ill patients who often require intensive monitoring and interventions in intensive care units (ICUs). Can LLMs be applied to CCM? Are LLMs just like stochastic parrots or ICU experts in assisting clinical decision-making? This scoping review aims to provide a panoramic portrait of the application of LLMs in CCM. Literature in seven databases, including PubMed, Embase, Scopus, Web of Science, CINAHL, IEEE Xplore, and ACM Digital Library, were searched from January 1, 2019, to June 10, 2024. Peer-reviewed journal and conference articles that discussed the application of LLMs in critical care settings were included. From an initial 619 articles, 24 were selected for final review. This review grouped applications of LLMs in CCM into three categories: clinical decision support, medical documentation and reporting, and medical education and doctor-patient communication. LLMs have advantages in handling unstructured data and do not require manual feature engineering. Meanwhile, applying LLMs to CCM faces challenges, including hallucinations, poor interpretability, bias and alignment challenges, and privacy and ethics issues. Future research should enhance model reliability and interpretability, integrate up-to-date medical knowledge, and strengthen privacy and ethical guidelines. As LLMs evolve, they could become key tools in CCM to help improve patient outcomes and optimize healthcare delivery. This study is the first review of LLMs in CCM, aiding researchers, clinicians, and policymakers to understand the current status and future potentials of LLMs in CCM. △ Less

Submitted 27 July, 2024; originally announced July 2024.

Comments: 28 pages, 5 figures

Inter and Intra Prior Learning-based Hyperspectral Image Reconstruction Using Snapshot SWIR Metasurface

Authors: Linqiang Li, Jinglei Hao, Yongqiang Zhao, Pan Liu, Haofang Yan, Ziqin Zhang, Seong G. Kong

Abstract: Shortwave-infrared(SWIR) spectral information, ranging from 1 μm to 2.5μm, overcomes the limitations of traditional color cameras in acquiring scene information. However, conventional SWIR hyperspectral imaging systems face challenges due to their bulky setups and low acquisition speeds. This work introduces a snapshot SWIR hyperspectral imaging system based on a metasurface filter and a correspon… ▽ More Shortwave-infrared(SWIR) spectral information, ranging from 1 μm to 2.5μm, overcomes the limitations of traditional color cameras in acquiring scene information. However, conventional SWIR hyperspectral imaging systems face challenges due to their bulky setups and low acquisition speeds. This work introduces a snapshot SWIR hyperspectral imaging system based on a metasurface filter and a corresponding filter selection method to achieve the lowest correlation coefficient among these filters. This system offers the advantages of compact size and snapshot imaging. We propose a novel inter and intra prior learning unfolding framework to achieve high-quality SWIR hyperspectral image reconstruction, which bridges the gap between prior learning and cross-stage information interaction. Additionally, We design an adaptive feature transfer mechanism to adaptively transfer the contextual correlation of multi-scale encoder features to prevent detailed information loss in the decoder. Experiment results demonstrate that our method can reconstruct hyperspectral images with high speed and superior performance over existing methods. △ Less

Submitted 24 July, 2024; v1 submitted 10 July, 2024; originally announced July 2024.

Comments: 12 pages,9 figures

Semi-supervised Learning from Street-View Images and OpenStreetMap for Automatic Building Height Estimation

Authors: Hao Li, Zhendong Yuan, Gabriel Dax, Gefei Kong, Hongchao Fan, Alexander Zipf, Martin Werner

Abstract: Accurate building height estimation is key to the automatic derivation of 3D city models from emerging big geospatial data, including Volunteered Geographical Information (VGI). However, an automatic solution for large-scale building height estimation based on low-cost VGI data is currently missing. The fast development of VGI data platforms, especially OpenStreetMap (OSM) and crowdsourced street-… ▽ More Accurate building height estimation is key to the automatic derivation of 3D city models from emerging big geospatial data, including Volunteered Geographical Information (VGI). However, an automatic solution for large-scale building height estimation based on low-cost VGI data is currently missing. The fast development of VGI data platforms, especially OpenStreetMap (OSM) and crowdsourced street-view images (SVI), offers a stimulating opportunity to fill this research gap. In this work, we propose a semi-supervised learning (SSL) method of automatically estimating building height from Mapillary SVI and OSM data to generate low-cost and open-source 3D city modeling in LoD1. The proposed method consists of three parts: first, we propose an SSL schema with the option of setting a different ratio of "pseudo label" during the supervised regression; second, we extract multi-level morphometric features from OSM data (i.e., buildings and streets) for the purposed of inferring building height; last, we design a building floor estimation workflow with a pre-trained facade object detection network to generate "pseudo label" from SVI and assign it to the corresponding OSM building footprint. In a case study, we validate the proposed SSL method in the city of Heidelberg, Germany and evaluate the model performance against the reference data of building heights. Based on three different regression models, namely Random Forest (RF), Support Vector Machine (SVM), and Convolutional Neural Network (CNN), the SSL method leads to a clear performance boosting in estimating building heights with a Mean Absolute Error (MAE) around 2.1 meters, which is competitive to state-of-the-art approaches. The preliminary result is promising and motivates our future work in scaling up the proposed method based on low-cost VGI data, with possibilities in even regions and areas with diverse data quality and availability. △ Less

Submitted 5 July, 2023; originally announced July 2023.

Comments: Accepted for GIScience 2023

Unsupervised Spectral Demosaicing with Lightweight Spectral Attention Networks

Authors: Kai Feng, Yongqiang Zhao, Seong G. Kong, Haijin Zeng

Abstract: This paper presents a deep learning-based spectral demosaicing technique trained in an unsupervised manner. Many existing deep learning-based techniques relying on supervised learning with synthetic images, often underperform on real-world images especially when the number of spectral bands increases. According to the characteristics of the spectral mosaic image, this paper proposes a mosaic loss… ▽ More This paper presents a deep learning-based spectral demosaicing technique trained in an unsupervised manner. Many existing deep learning-based techniques relying on supervised learning with synthetic images, often underperform on real-world images especially when the number of spectral bands increases. According to the characteristics of the spectral mosaic image, this paper proposes a mosaic loss function, the corresponding model structure, a transformation strategy, and an early stopping strategy, which form a complete unsupervised spectral demosaicing framework. A challenge in real-world spectral demosaicing is inconsistency between the model parameters and the computational resources of the imager. We reduce the complexity and parameters of the spectral attention module by dividing the spectral attention tensor into spectral attention matrices in the spatial dimension and spectral attention vector in the channel dimension, which is more suitable for unsupervised framework. This paper also presents Mosaic25, a real 25-band hyperspectral mosaic image dataset of various objects, illuminations, and materials for benchmarking. Extensive experiments on synthetic and real-world datasets demonstrate that the proposed method outperforms conventional unsupervised methods in terms of spatial distortion suppression, spectral fidelity, robustness, and computational cost. △ Less

Submitted 4 July, 2023; originally announced July 2023.

Identifying Subgroups of ICU Patients Using End-to-End Multivariate Time-Series Clustering Algorithm Based on Real-World Vital Signs Data

Authors: Tongyue Shi, Zhilong Zhang, Wentie Liu, Junhua Fang, Jianguo Hao, Shuai Jin, Huiying Zhao, Guilan Kong

Abstract: This study employed the MIMIC-IV database as data source to investigate the use of dynamic, high-frequency, multivariate time-series vital signs data, including temperature, heart rate, mean blood pressure, respiratory rate, and SpO2, monitored first 8 hours data in the ICU stay. Various clustering algorithms were compared, and an end-to-end multivariate time series clustering system called Time2F… ▽ More This study employed the MIMIC-IV database as data source to investigate the use of dynamic, high-frequency, multivariate time-series vital signs data, including temperature, heart rate, mean blood pressure, respiratory rate, and SpO2, monitored first 8 hours data in the ICU stay. Various clustering algorithms were compared, and an end-to-end multivariate time series clustering system called Time2Feat, combined with K-Means, was chosen as the most effective method to cluster patients in the ICU. In clustering analysis, data of 8,080 patients admitted between 2008 and 2016 was used for model development and 2,038 patients admitted between 2017 and 2019 for model validation. By analyzing the differences in clinical mortality prognosis among different categories, varying risks of ICU mortality and hospital mortality were found between different subgroups. Furthermore, the study visualized the trajectory of vital signs changes. The findings of this study provide valuable insights into the potential use of multivariate time-series clustering systems in patient management and monitoring in the ICU setting. △ Less

Submitted 11 July, 2023; v1 submitted 3 June, 2023; originally announced June 2023.

Real-time division-of-focal-plane polarization imaging system with progressive networks

Authors: Rongyuan Wu, Yongqiang Zhao, Ning Li, Seong G. Kong

Abstract: Division-of-focal-plane (DoFP) polarization imaging technical recently has been applied in many fields. However, the images captured by such sensors cannot be used directly because they suffer from instantaneous field-of-view errors and low resolution problem. This paper builds a fast DoFP demosaicing system with proposed progressive polarization demosaicing convolutional neural network (PPDN), wh… ▽ More Division-of-focal-plane (DoFP) polarization imaging technical recently has been applied in many fields. However, the images captured by such sensors cannot be used directly because they suffer from instantaneous field-of-view errors and low resolution problem. This paper builds a fast DoFP demosaicing system with proposed progressive polarization demosaicing convolutional neural network (PPDN), which is specifically designed for edge-side GPU devices like Navidia Jetson TX2. The proposed network consists of two parts: reconstruction stage and refining stage. The former recovers four polarization channels from a single DoFP image. The latter fine-tune the four channels to obtain more accurate polarization information. PPDN can be implemented in another version: PPDN-L (large), for the platforms of high computing resources. Experiments show that PPDN can compete with the best existing methods with fewer parameters and faster inference speed and meet the real-time demands of imaging system. △ Less

Submitted 26 October, 2021; originally announced October 2021.

Comments: Submit to IEEE Sensors Journal

Performance Analysis of Active Large Intelligent Surfaces (LISs): Uplink Spectral Efficiency and Pilot Training

Authors: Minchae Jung, Walid Saad, Gyuyeol Kong

Abstract: Large intelligent surfaces (LISs) constitute a new and promising wireless communication paradigm that relies on the integration of a massive number of antenna elements over the entire surfaces of man-made structures. The LIS concept provides many advantages, such as the capability to provide reliable and space-intensive communications by effectively establishing line-of-sight (LOS) channels. In th… ▽ More Large intelligent surfaces (LISs) constitute a new and promising wireless communication paradigm that relies on the integration of a massive number of antenna elements over the entire surfaces of man-made structures. The LIS concept provides many advantages, such as the capability to provide reliable and space-intensive communications by effectively establishing line-of-sight (LOS) channels. In this paper, the system spectral efficiency (SSE) of an uplink LIS system is asymptotically analyzed under a practical LIS environment with a well-defined uplink frame structure. In order to verify the impact on the SSE of pilot contamination, the SSE of a multi-LIS system is asymptotically studied and a theoretical bound on its performance is derived. Given this performance bound, an optimal pilot training length for multi-LIS systems subjected to pilot contamination is characterized and, subsequently, the performance-maximizing number of devices that the LIS system must service is derived. Simulation results show that the derived analyses are in close agreement with the exact mutual information in presence of a large number of antennas, and the achievable SSE is limited by the effect of pilot contamination and intra/inter-LIS interference through the LOS path, even if the LIS is equipped with an infinite number of antennas. Additionally, the SSE obtained with the proposed pilot training length and number of scheduled devices is shown to reach the one obtained via a brute-force search for the optimal solution. △ Less

Submitted 28 January, 2021; v1 submitted 31 March, 2019; originally announced April 2019.

Reliability Analysis of Large Intelligent Surfaces (LISs): Rate Distribution and Outage Probability

Authors: Minchae Jung, Walid Saad, Youngrok Jang, Gyuyeol Kong, Sooyong Choi

Abstract: Large intelligent surfaces (LISs) have been recently proposed as an effective wireless communication solution that can leverage antenna arrays deployed on the entirety of man-made structures such as walls. An LIS can provide space-intensive and reliable communication, enabling the desired wireless channel to exhibit a perfect line-of-sight. However, the outage probability of LIS, which is an impor… ▽ More Large intelligent surfaces (LISs) have been recently proposed as an effective wireless communication solution that can leverage antenna arrays deployed on the entirety of man-made structures such as walls. An LIS can provide space-intensive and reliable communication, enabling the desired wireless channel to exhibit a perfect line-of-sight. However, the outage probability of LIS, which is an important performance metric to evaluate the system reliability, remains uncharacterized. In this paper, the distribution of uplink sum-rate is asymptotically analyzed for an LIS system. Given the derived asymptotic distribution, the outage probability is derived for the considered LIS system. Simulation results show that the results of the proposed asymptotic analyses are in close agreement to the exact mutual information in the presence of a large number of antennas and devices. △ Less

Submitted 24 August, 2019; v1 submitted 27 March, 2019; originally announced March 2019.

Comments: to appear, IEEE Wireless Communications Letters

Performance Analysis of Large Intelligent Surfaces (LISs): Asymptotic Data Rate and Channel Hardening Effects

Authors: Minchae Jung, Walid Saad, Youngrok Jang, Gyuyeol Kong, Sooyong Choi

Abstract: The concept of a large intelligent surface (LIS) has recently emerged as a promising wireless communication paradigm that can exploit the entire surface of man-made structures for transmitting and receiving information. An LIS is expected to go beyond massive multiple-input multiple-output (MIMO) system, insofar as the desired channel can be modeled as a perfect line-of-sight. To understand the fu… ▽ More The concept of a large intelligent surface (LIS) has recently emerged as a promising wireless communication paradigm that can exploit the entire surface of man-made structures for transmitting and receiving information. An LIS is expected to go beyond massive multiple-input multiple-output (MIMO) system, insofar as the desired channel can be modeled as a perfect line-of-sight. To understand the fundamental performance benefits, it is imperative to analyze its achievable data rate, under practical LIS environments and limitations. In this paper, an asymptotic analysis of the uplink data rate in an LIS-based large antenna-array system is presented. In particular, the asymptotic LIS rate is derived in a practical wireless environment where the estimated channel on LIS is subject to estimation errors and interference channels are spatially correlated Rician fading channels. Moreover, the occurrence of the channel hardening effect is analyzed and the performance bound is asymptotically derived for the considered LIS system. The analytical asymptotic results are then shown to be in close agreement with the exact mutual information as the numbers of antennas and devices increases without bounds. Moreover, the derived ergodic rates show that noise and interference from estimation errors and the non-line-of-sight path become negligible as the number of antennas increases. Simulation results show that an LIS can achieve a performance that is comparable to conventional massive MIMO with improved reliability and a significantly reduced area for antenna deployment. △ Less

Submitted 26 December, 2019; v1 submitted 12 October, 2018; originally announced October 2018.

Comments: to appear, IEEE Transactions on Wireless Communications

CUNet: A Compact Unsupervised Network for Image Classification

Authors: Le Dong, Ling He, Gaipeng Kong, Qianni Zhang, Xiaochun Cao, Ebroul Izquierdo

Abstract: In this paper, we propose a compact network called CUNet (compact unsupervised network) to counter the image classification challenge. Different from the traditional convolutional neural networks learning filters by the time-consuming stochastic gradient descent, CUNet learns the filter bank from diverse image patches with the simple K-means, which significantly avoids the requirement of scarce la… ▽ More In this paper, we propose a compact network called CUNet (compact unsupervised network) to counter the image classification challenge. Different from the traditional convolutional neural networks learning filters by the time-consuming stochastic gradient descent, CUNet learns the filter bank from diverse image patches with the simple K-means, which significantly avoids the requirement of scarce labeled training images, reduces the training consumption, and maintains the high discriminative ability. Besides, we propose a new pooling method named weighted pooling considering the different weight values of adjacent neurons, which helps to improve the robustness to small image distortions. In the output layer, CUNet integrates the feature maps gained in the last hidden layer, and straightforwardly computes histograms in non-overlapped blocks. To reduce feature redundancy, we implement the max-pooling operation on adjacent blocks to select the most competitive features. Comprehensive experiments are conducted to demonstrate the state-of-the-art classification performances with CUNet on CIFAR-10, STL-10, MNIST and Caltech101 benchmark datasets. △ Less

Submitted 6 July, 2016; originally announced July 2016.

Coarse2Fine: Two-Layer Fusion For Image Retrieval

Authors: Gaipeng Kong, Le Dong, Wenpu Dong, Liang Zheng, Qi Tian

Abstract: This paper addresses the problem of large-scale image retrieval. We propose a two-layer fusion method which takes advantage of global and local cues and ranks database images from coarse to fine (C2F). Departing from the previous methods fusing multiple image descriptors simultaneously, C2F is featured by a layered procedure composed by filtering and refining. In particular, C2F consists of three… ▽ More This paper addresses the problem of large-scale image retrieval. We propose a two-layer fusion method which takes advantage of global and local cues and ranks database images from coarse to fine (C2F). Departing from the previous methods fusing multiple image descriptors simultaneously, C2F is featured by a layered procedure composed by filtering and refining. In particular, C2F consists of three components. 1) Distractor filtering. With holistic representations, noise images are filtered out from the database, so the number of candidate images to be used for comparison with the query can be greatly reduced. 2) Adaptive weighting. For a certain query, the similarity of candidate images can be estimated by holistic similarity scores in complementary to the local ones. 3) Candidate refining. Accurate retrieval is conducted via local features, combining the pre-computed adaptive weights. Experiments are presented on two benchmarks, \emph{i.e.,} Holidays and Ukbench datasets. We show that our method outperforms recent fusion methods in terms of storage consumption and computation complexity, and that the accuracy is competitive to the state-of-the-arts. △ Less

Submitted 3 July, 2016; originally announced July 2016.