-
Leveraging Large Language Models to Extract Information on Substance Use Disorder Severity from Clinical Notes: A Zero-shot Learning Approach
Authors:
Maria Mahbub,
Gregory M. Dams,
Sudarshan Srinivasan,
Caitlin Rizy,
Ioana Danciu,
Jodie Trafton,
Kathryn Knight
Abstract:
Substance use disorder (SUD) poses a major concern due to its detrimental effects on health and society. SUD identification and treatment depend on a variety of factors such as severity, co-determinants (e.g., withdrawal symptoms), and social determinants of health. Existing diagnostic coding systems used by American insurance providers, like the International Classification of Diseases (ICD-10),…
▽ More
Substance use disorder (SUD) poses a major concern due to its detrimental effects on health and society. SUD identification and treatment depend on a variety of factors such as severity, co-determinants (e.g., withdrawal symptoms), and social determinants of health. Existing diagnostic coding systems used by American insurance providers, like the International Classification of Diseases (ICD-10), lack granularity for certain diagnoses, but clinicians will add this granularity (as that found within the Diagnostic and Statistical Manual of Mental Disorders classification or DSM-5) as supplemental unstructured text in clinical notes. Traditional natural language processing (NLP) methods face limitations in accurately parsing such diverse clinical language. Large Language Models (LLMs) offer promise in overcoming these challenges by adapting to diverse language patterns. This study investigates the application of LLMs for extracting severity-related information for various SUD diagnoses from clinical notes. We propose a workflow employing zero-shot learning of LLMs with carefully crafted prompts and post-processing techniques. Through experimentation with Flan-T5, an open-source LLM, we demonstrate its superior recall compared to the rule-based approach. Focusing on 11 categories of SUD diagnoses, we show the effectiveness of LLMs in extracting severity information, contributing to improved risk assessment and treatment planning for SUD patients.
△ Less
Submitted 18 March, 2024;
originally announced March 2024.
-
Dynamic Q&A of Clinical Documents with Large Language Models
Authors:
Ran Elgedawy,
Ioana Danciu,
Maria Mahbub,
Sudarshan Srinivasan
Abstract:
Electronic health records (EHRs) house crucial patient data in clinical notes. As these notes grow in volume and complexity, manual extraction becomes challenging. This work introduces a natural language interface using large language models (LLMs) for dynamic question-answering on clinical notes. Our chatbot, powered by Langchain and transformer-based LLMs, allows users to query in natural langua…
▽ More
Electronic health records (EHRs) house crucial patient data in clinical notes. As these notes grow in volume and complexity, manual extraction becomes challenging. This work introduces a natural language interface using large language models (LLMs) for dynamic question-answering on clinical notes. Our chatbot, powered by Langchain and transformer-based LLMs, allows users to query in natural language, receiving relevant answers from clinical notes. Experiments, utilizing various embedding models and advanced LLMs, show Wizard Vicuna's superior accuracy, albeit with high compute demands. Model optimization, including weight quantization, improves latency by approximately 48 times. Promising results indicate potential, yet challenges such as model hallucinations and limited diverse medical case evaluations remain. Addressing these gaps is crucial for unlocking the value in clinical notes and advancing AI-driven clinical decision-making.
△ Less
Submitted 2 July, 2024; v1 submitted 19 January, 2024;
originally announced January 2024.
-
Bengali Fake Reviews: A Benchmark Dataset and Detection System
Authors:
G. M. Shahariar,
Md. Tanvir Rouf Shawon,
Faisal Muhammad Shah,
Mohammad Shafiul Alam,
Md. Shahriar Mahbub
Abstract:
The proliferation of fake reviews on various online platforms has created a major concern for both consumers and businesses. Such reviews can deceive customers and cause damage to the reputation of products or services, making it crucial to identify them. Although the detection of fake reviews has been extensively studied in English language, detecting fake reviews in non-English languages such as…
▽ More
The proliferation of fake reviews on various online platforms has created a major concern for both consumers and businesses. Such reviews can deceive customers and cause damage to the reputation of products or services, making it crucial to identify them. Although the detection of fake reviews has been extensively studied in English language, detecting fake reviews in non-English languages such as Bengali is still a relatively unexplored research area. This paper introduces the Bengali Fake Review Detection (BFRD) dataset, the first publicly available dataset for identifying fake reviews in Bengali. The dataset consists of 7710 non-fake and 1339 fake food-related reviews collected from social media posts. To convert non-Bengali words in a review, a unique pipeline has been proposed that translates English words to their corresponding Bengali meaning and also back transliterates Romanized Bengali to Bengali. We have conducted rigorous experimentation using multiple deep learning and pre-trained transformer language models to develop a reliable detection system. Finally, we propose a weighted ensemble model that combines four pre-trained transformers: BanglaBERT, BanglaBERT Base, BanglaBERT Large, and BanglaBERT Generator . According to the experiment results, the proposed ensemble model obtained a weighted F1-score of 0.9843 on 13390 reviews, including 1339 actual fake reviews and 5356 augmented fake reviews generated with the nlpaug library. The remaining 6695 reviews were randomly selected from the 7710 non-fake instances. The model achieved a 0.9558 weighted F1-score when the fake reviews were augmented using the bnaug library.
△ Less
Submitted 4 May, 2024; v1 submitted 3 August, 2023;
originally announced August 2023.
-
Question-Answering System Extracts Information on Injection Drug Use from Clinical Notes
Authors:
Maria Mahbub,
Ian Goethert,
Ioana Danciu,
Kathryn Knight,
Sudarshan Srinivasan,
Suzanne Tamang,
Karine Rozenberg-Ben-Dror,
Hugo Solares,
Susana Martins,
Jodie Trafton,
Edmon Begoli,
Gregory Peterson
Abstract:
Background: Injection drug use (IDU) is a dangerous health behavior that increases mortality and morbidity. Identifying IDU early and initiating harm reduction interventions can benefit individuals at risk. However, extracting IDU behaviors from patients' electronic health records (EHR) is difficult because there is no International Classification of Disease (ICD) code and the only place IDU infor…
▽ More
Background: Injection drug use (IDU) is a dangerous health behavior that increases mortality and morbidity. Identifying IDU early and initiating harm reduction interventions can benefit individuals at risk. However, extracting IDU behaviors from patients' electronic health records (EHR) is difficult because there is no International Classification of Disease (ICD) code and the only place IDU information can be indicated is unstructured free-text clinical notes. Although natural language processing can efficiently extract this information from unstructured data, there are no validated tools. Methods: To address this gap in clinical information, we design and demonstrate a question-answering (QA) framework to extract information on IDU from clinical notes. Our framework involves two main steps: (1) generating a gold-standard QA dataset and (2) developing and testing the QA model. We utilize 2323 clinical notes of 1145 patients sourced from the VA Corporate Data Warehouse to construct the gold-standard dataset for developing and evaluating the QA model. We also demonstrate the QA model's ability to extract IDU-related information on temporally out-of-distribution data. Results: Here we show that for a strict match between gold-standard and predicted answers, the QA model achieves 51.65% F1 score. For a relaxed match between the gold-standard and predicted answers, the QA model obtains 78.03% F1 score, along with 85.38% Precision and 79.02% Recall scores. Moreover, the QA model demonstrates consistent performance when subjected to temporally out-of-distribution data. Conclusions: Our study introduces a QA framework designed to extract IDU information from clinical notes, aiming to enhance the accurate and efficient detection of people who inject drugs, extract relevant information, and ultimately facilitate informed patient care.
△ Less
Submitted 28 December, 2023; v1 submitted 15 May, 2023;
originally announced May 2023.
-
Bengali Fake Review Detection using Semi-supervised Generative Adversarial Networks
Authors:
Md. Tanvir Rouf Shawon,
G. M. Shahariar,
Faisal Muhammad Shah,
Mohammad Shafiul Alam,
Md. Shahriar Mahbub
Abstract:
This paper investigates the potential of semi-supervised Generative Adversarial Networks (GANs) to fine-tune pretrained language models in order to classify Bengali fake reviews from real reviews with a few annotated data. With the rise of social media and e-commerce, the ability to detect fake or deceptive reviews is becoming increasingly important in order to protect consumers from being misled…
▽ More
This paper investigates the potential of semi-supervised Generative Adversarial Networks (GANs) to fine-tune pretrained language models in order to classify Bengali fake reviews from real reviews with a few annotated data. With the rise of social media and e-commerce, the ability to detect fake or deceptive reviews is becoming increasingly important in order to protect consumers from being misled by false information. Any machine learning model will have trouble identifying a fake review, especially for a low resource language like Bengali. We have demonstrated that the proposed semi-supervised GAN-LM architecture (generative adversarial network on top of a pretrained language model) is a viable solution in classifying Bengali fake reviews as the experimental results suggest that even with only 1024 annotated samples, BanglaBERT with semi-supervised GAN (SSGAN) achieved an accuracy of 83.59% and a f1-score of 84.89% outperforming other pretrained language models - BanglaBERT generator, Bangla BERT Base and Bangla-Electra by almost 3%, 4% and 10% respectively in terms of accuracy. The experiments were conducted on a manually labeled food review dataset consisting of total 6014 real and fake reviews collected from various social media groups. Researchers that are experiencing difficulty recognizing not just fake reviews but other classification issues owing to a lack of labeled data may find a solution in our proposed methodology.
△ Less
Submitted 5 April, 2023;
originally announced April 2023.
-
Capacity Maximization of the 6G Networks Deploying IRS
Authors:
Mobasshir Mahbub,
Raed M. Shubair
Abstract:
The objective of the work is to improve the capacity of the micro cell, i.e., enabling the micro cell base station of a two-tier network to serve an increased number of devices. Therefore, the work deployed an IRS in a micro cell and achieved significant improvements in the performance with a reduced transmit power of the micro base station.
The objective of the work is to improve the capacity of the micro cell, i.e., enabling the micro cell base station of a two-tier network to serve an increased number of devices. Therefore, the work deployed an IRS in a micro cell and achieved significant improvements in the performance with a reduced transmit power of the micro base station.
△ Less
Submitted 21 March, 2023;
originally announced March 2023.
-
SINR Coverage Enhancement of 6G UAV-Assisted Networks Deploying IRS
Authors:
Mobasshir Mahbub,
Raed M. Shubair
Abstract:
The objective of the work is to enhance the signal-to-interference-plus-noise ratio (SINR) coverage probability in UAV-assisted 6G wireless networks. Therefore, the work analyzed and compared the coverage probability of conventional and IRS-assisted UAV communications models. The research obtained that the employment of IRS in UAV-assisted wireless networks enhances the SINR coverage probability s…
▽ More
The objective of the work is to enhance the signal-to-interference-plus-noise ratio (SINR) coverage probability in UAV-assisted 6G wireless networks. Therefore, the work analyzed and compared the coverage probability of conventional and IRS-assisted UAV communications models. The research obtained that the employment of IRS in UAV-assisted wireless networks enhances the SINR coverage probability significantly. Moreover, the installment of IRS in UAV networks reduces the energy consumption of the network.
△ Less
Submitted 3 December, 2022;
originally announced December 2022.
-
Analysis of IRS-Assisted NOMA for 6G Wireless Communications
Authors:
Mobasshir Mahbub,
Raed M. Shubair
Abstract:
Non-orthogonal multiple access (NOMA) scheme enables serving users with the same resource block i.e. frequency or time by multiplexing the signal of the users. Intelligent reflecting surfaces (IRS) or reconfigurable intelligent surfaces (RIS) is a potential approach for increasing transmission efficiency by modifying signal propagation by tweaking typically passive reflective components. IRS recon…
▽ More
Non-orthogonal multiple access (NOMA) scheme enables serving users with the same resource block i.e. frequency or time by multiplexing the signal of the users. Intelligent reflecting surfaces (IRS) or reconfigurable intelligent surfaces (RIS) is a potential approach for increasing transmission efficiency by modifying signal propagation by tweaking typically passive reflective components. IRS reconfigures the wireless network in this manner to improve system performance. The research considered an IRS-assisted downlink NOMA system. This work modified the reference model by adopting an IRS-specific frequency-distance-dependent path loss model for IRS-NOMA downlink received power and signal-to-interference plus noise ratio (SINR) measurement instead of a typical or conventional distance-dependant path loss model. The incorporation of an IRS-specific path loss model provides a more convenient and better measurement compared to the conventional path loss model. Furthermore, this work figures out an improvement scope in the reference model.
△ Less
Submitted 12 November, 2022;
originally announced November 2022.
-
A Survey: Credit Sentiment Score Prediction
Authors:
A. N. M. Sajedul Alam,
Junaid Bin Kibria,
Arnob Kumar Dey,
Zawad Alam,
Shifat Zaman,
Motahar Mahtab,
Mohammed Julfikar Ali Mahbub,
Annajiat Alim Rasel
Abstract:
Manual approvals are still used by banks and other NGOs to approve loans. It takes time and is prone to mistakes because it is controlled by a bank employee. Several fields of machine learning mining technologies have been utilized to enhance various areas of credit rating forecast. A major goal of this research is to look at current sentiment analysis techniques that are being used to generate cr…
▽ More
Manual approvals are still used by banks and other NGOs to approve loans. It takes time and is prone to mistakes because it is controlled by a bank employee. Several fields of machine learning mining technologies have been utilized to enhance various areas of credit rating forecast. A major goal of this research is to look at current sentiment analysis techniques that are being used to generate creditworthiness.
△ Less
Submitted 30 September, 2022;
originally announced September 2022.
-
Intelligent Reflecting Surfaces for the Enhancement of 6G Internet of Things
Authors:
Mobasshir Mahbub,
Raed M. Shubair
Abstract:
With the advancement of sensing technologies over the years, it has become critical to ensure the seamless connectivity of the Internet of Things (IoT) gadgets. With the advancement of communication technology, cellular networks are increasingly being utilized to link IoT systems. An IRS is a rectangular metasurface made up of a vast number of reflecting components that has recently gained researc…
▽ More
With the advancement of sensing technologies over the years, it has become critical to ensure the seamless connectivity of the Internet of Things (IoT) gadgets. With the advancement of communication technology, cellular networks are increasingly being utilized to link IoT systems. An IRS is a rectangular metasurface made up of a vast number of reflecting components that has recently gained research attention due to its ability to significantly improve the energy and spectral efficiencies of communication networks by modifying wireless transmission environments.
△ Less
Submitted 16 July, 2022;
originally announced July 2022.
-
IRS for Multi-Access Edge Computing in 6G Networks
Authors:
Mobasshir Mahbub,
Raed M. Shubair
Abstract:
Computation offloading in multi-access edge computing (MEC) is an effective paradigm for enabling resource-intensive smart applications. However, when the wireless channel utilized for offloading computing activities is hostile, the proper advantages of MEC may not be completely realized. Intelligent reflecting surface (IRS) is a new technology that has recently attracted significant interest can…
▽ More
Computation offloading in multi-access edge computing (MEC) is an effective paradigm for enabling resource-intensive smart applications. However, when the wireless channel utilized for offloading computing activities is hostile, the proper advantages of MEC may not be completely realized. Intelligent reflecting surface (IRS) is a new technology that has recently attracted significant interest can optimize the wireless transmission environment in a programmable way and improving the connectivity between user equipment (UE) and base station (BS). In this paper, the performance of MEC architecture is analyzed considering both IRS-assisted and without IRS communication scenarios in the context of the urban micro cellular scenarios. The research obtained that the deployment of IRS can reduce the spectrum and energy consumption significantly.
△ Less
Submitted 10 June, 2022;
originally announced June 2022.
-
The Deployment of IRS in UAV-Empowered 6G Networks
Authors:
Mobasshir Mahbub,
Raed M. Shubair
Abstract:
Intelligent reflecting surfaces (IRSs) with the ability to reconfigure inherent electromagnetic reflection and absorption characteristics in real-time provide unparalleled prospects to improve wireless connectivity in adverse circumstances. Unmanned aerial vehicles (UAV)-assisted wireless networks are evolved as a reliable solution to combat non-line of sight (NLoS) scenarios. Thereby, the IRS-emp…
▽ More
Intelligent reflecting surfaces (IRSs) with the ability to reconfigure inherent electromagnetic reflection and absorption characteristics in real-time provide unparalleled prospects to improve wireless connectivity in adverse circumstances. Unmanned aerial vehicles (UAV)-assisted wireless networks are evolved as a reliable solution to combat non-line of sight (NLoS) scenarios. Thereby, the IRS-empowered UAV-assisted cellular networks will be a significant role-player to improve the coverage and user experiences. The paper aimed to minimize the path loss and maximize the achievable data rate in IRS-UAV-assisted networks. In this context, the work analyzed path loss and achievable rate utilizing millimeter wave (mmWave) carrier considering the conventional UAV model and IRS-empowered UAV communication model. The research obtained that the IRSempowered UAV communications model can significantly minimize path loss and maximize the achievable data rate compared to the conventional UAV-assisted model.
△ Less
Submitted 7 May, 2022;
originally announced May 2022.
-
BioADAPT-MRC: Adversarial Learning-based Domain Adaptation Improves Biomedical Machine Reading Comprehension Task
Authors:
Maria Mahbub,
Sudarshan Srinivasan,
Edmon Begoli,
Gregory D Peterson
Abstract:
Biomedical machine reading comprehension (biomedical-MRC) aims to comprehend complex biomedical narratives and assist healthcare professionals in retrieving information from them. The high performance of modern neural network-based MRC systems depends on high-quality, large-scale, human-annotated training datasets. In the biomedical domain, a crucial challenge in creating such datasets is the requ…
▽ More
Biomedical machine reading comprehension (biomedical-MRC) aims to comprehend complex biomedical narratives and assist healthcare professionals in retrieving information from them. The high performance of modern neural network-based MRC systems depends on high-quality, large-scale, human-annotated training datasets. In the biomedical domain, a crucial challenge in creating such datasets is the requirement for domain knowledge, inducing the scarcity of labeled data and the need for transfer learning from the labeled general-purpose (source) domain to the biomedical (target) domain. However, there is a discrepancy in marginal distributions between the general-purpose and biomedical domains due to the variances in topics. Therefore, direct-transferring of learned representations from a model trained on a general-purpose domain to the biomedical domain can hurt the model's performance. We present an adversarial learning-based domain adaptation framework for the biomedical machine reading comprehension task (BioADAPT-MRC), a neural network-based method to address the discrepancies in the marginal distributions between the general and biomedical domain datasets. BioADAPT-MRC relaxes the need for generating pseudo labels for training a well-performing biomedical-MRC model. We extensively evaluate the performance of BioADAPT-MRC by comparing it with the best existing methods on three widely used benchmark biomedical-MRC datasets -- BioASQ-7b, BioASQ-8b, and BioASQ-9b. Our results suggest that without using any synthetic or human-annotated data from the biomedical domain, BioADAPT-MRC can achieve state-of-the-art performance on these datasets. Availability: BioADAPT-MRC is freely available as an open-source project at \url{https://github.com/mmahbub/BioADAPT-MRC}.
△ Less
Submitted 26 July, 2022; v1 submitted 26 February, 2022;
originally announced February 2022.
-
The Sensitivity of Word Embeddings-based Author Detection Models to Semantic-preserving Adversarial Perturbations
Authors:
Jeremiah Duncan,
Fabian Fallas,
Chris Gropp,
Emily Herron,
Maria Mahbub,
Paula Olaya,
Eduardo Ponce,
Tabitha K. Samuel,
Daniel Schultz,
Sudarshan Srinivasan,
Maofeng Tang,
Viktor Zenkov,
Quan Zhou,
Edmon Begoli
Abstract:
Authorship analysis is an important subject in the field of natural language processing. It allows the detection of the most likely writer of articles, news, books, or messages. This technique has multiple uses in tasks related to authorship attribution, detection of plagiarism, style analysis, sources of misinformation, etc. The focus of this paper is to explore the limitations and sensitiveness…
▽ More
Authorship analysis is an important subject in the field of natural language processing. It allows the detection of the most likely writer of articles, news, books, or messages. This technique has multiple uses in tasks related to authorship attribution, detection of plagiarism, style analysis, sources of misinformation, etc. The focus of this paper is to explore the limitations and sensitiveness of established approaches to adversarial manipulations of inputs. To this end, and using those established techniques, we first developed an experimental frame-work for author detection and input perturbations. Next, we experimentally evaluated the performance of the authorship detection model to a collection of semantic-preserving adversarial perturbations of input narratives. Finally, we compare and analyze the effects of different perturbation strategies, input and model configurations, and the effects of these on the author detection model.
△ Less
Submitted 23 February, 2021;
originally announced February 2021.
-
Demonstration of a Time-Efficient Mobility System Using a Scaled Smart City
Authors:
Logan E. Beaver,
Behdad Chalaki,
AM Ishtiaque Mahbub,
Liuhui Zhao,
Ray Zayas,
Andreas A. Malikopoulos
Abstract:
The implementation of connected and automated vehicle (CAV) technologies enables a novel computational framework to deliver real-time control actions that optimize travel time, energy, and safety. Hardware is an integral part of any practical implementation of CAVs, and as such, it should be incorporated in any validation method. However, high costs associated with full scale, field testing of CAV…
▽ More
The implementation of connected and automated vehicle (CAV) technologies enables a novel computational framework to deliver real-time control actions that optimize travel time, energy, and safety. Hardware is an integral part of any practical implementation of CAVs, and as such, it should be incorporated in any validation method. However, high costs associated with full scale, field testing of CAVs have proven to be a significant barrier. In this paper, we present the implementation of a decentralized control framework, which was developed previously, in a scaled-city using robotic CAVs, and discuss the implications of CAVs on travel time. Supplemental information and videos can be found at https://sites.google.com/view/ud-ids-lab/tfms.
△ Less
Submitted 21 November, 2019; v1 submitted 4 March, 2019;
originally announced March 2019.