Showing 1–15 of 15 results for author: Mahbub, M

Leveraging Large Language Models to Extract Information on Substance Use Disorder Severity from Clinical Notes: A Zero-shot Learning Approach

Authors: Maria Mahbub, Gregory M. Dams, Sudarshan Srinivasan, Caitlin Rizy, Ioana Danciu, Jodie Trafton, Kathryn Knight

Abstract: Substance use disorder (SUD) poses a major concern due to its detrimental effects on health and society. SUD identification and treatment depend on a variety of factors such as severity, co-determinants (e.g., withdrawal symptoms), and social determinants of health. Existing diagnostic coding systems used by American insurance providers, like the International Classification of Diseases (ICD-10),… ▽ More Substance use disorder (SUD) poses a major concern due to its detrimental effects on health and society. SUD identification and treatment depend on a variety of factors such as severity, co-determinants (e.g., withdrawal symptoms), and social determinants of health. Existing diagnostic coding systems used by American insurance providers, like the International Classification of Diseases (ICD-10), lack granularity for certain diagnoses, but clinicians will add this granularity (as that found within the Diagnostic and Statistical Manual of Mental Disorders classification or DSM-5) as supplemental unstructured text in clinical notes. Traditional natural language processing (NLP) methods face limitations in accurately parsing such diverse clinical language. Large Language Models (LLMs) offer promise in overcoming these challenges by adapting to diverse language patterns. This study investigates the application of LLMs for extracting severity-related information for various SUD diagnoses from clinical notes. We propose a workflow employing zero-shot learning of LLMs with carefully crafted prompts and post-processing techniques. Through experimentation with Flan-T5, an open-source LLM, we demonstrate its superior recall compared to the rule-based approach. Focusing on 11 categories of SUD diagnoses, we show the effectiveness of LLMs in extracting severity information, contributing to improved risk assessment and treatment planning for SUD patients. △ Less

Submitted 18 March, 2024; originally announced March 2024.

Comments: 10 pages, 4 figures, 2 tables

Dynamic Q&A of Clinical Documents with Large Language Models

Authors: Ran Elgedawy, Ioana Danciu, Maria Mahbub, Sudarshan Srinivasan

Abstract: Electronic health records (EHRs) house crucial patient data in clinical notes. As these notes grow in volume and complexity, manual extraction becomes challenging. This work introduces a natural language interface using large language models (LLMs) for dynamic question-answering on clinical notes. Our chatbot, powered by Langchain and transformer-based LLMs, allows users to query in natural langua… ▽ More Electronic health records (EHRs) house crucial patient data in clinical notes. As these notes grow in volume and complexity, manual extraction becomes challenging. This work introduces a natural language interface using large language models (LLMs) for dynamic question-answering on clinical notes. Our chatbot, powered by Langchain and transformer-based LLMs, allows users to query in natural language, receiving relevant answers from clinical notes. Experiments, utilizing various embedding models and advanced LLMs, show Wizard Vicuna's superior accuracy, albeit with high compute demands. Model optimization, including weight quantization, improves latency by approximately 48 times. Promising results indicate potential, yet challenges such as model hallucinations and limited diverse medical case evaluations remain. Addressing these gaps is crucial for unlocking the value in clinical notes and advancing AI-driven clinical decision-making. △ Less

Submitted 2 July, 2024; v1 submitted 19 January, 2024; originally announced January 2024.

Comments: 15 pages, 4 figures

Bengali Fake Reviews: A Benchmark Dataset and Detection System

Authors: G. M. Shahariar, Md. Tanvir Rouf Shawon, Faisal Muhammad Shah, Mohammad Shafiul Alam, Md. Shahriar Mahbub

Abstract: The proliferation of fake reviews on various online platforms has created a major concern for both consumers and businesses. Such reviews can deceive customers and cause damage to the reputation of products or services, making it crucial to identify them. Although the detection of fake reviews has been extensively studied in English language, detecting fake reviews in non-English languages such as… ▽ More The proliferation of fake reviews on various online platforms has created a major concern for both consumers and businesses. Such reviews can deceive customers and cause damage to the reputation of products or services, making it crucial to identify them. Although the detection of fake reviews has been extensively studied in English language, detecting fake reviews in non-English languages such as Bengali is still a relatively unexplored research area. This paper introduces the Bengali Fake Review Detection (BFRD) dataset, the first publicly available dataset for identifying fake reviews in Bengali. The dataset consists of 7710 non-fake and 1339 fake food-related reviews collected from social media posts. To convert non-Bengali words in a review, a unique pipeline has been proposed that translates English words to their corresponding Bengali meaning and also back transliterates Romanized Bengali to Bengali. We have conducted rigorous experimentation using multiple deep learning and pre-trained transformer language models to develop a reliable detection system. Finally, we propose a weighted ensemble model that combines four pre-trained transformers: BanglaBERT, BanglaBERT Base, BanglaBERT Large, and BanglaBERT Generator . According to the experiment results, the proposed ensemble model obtained a weighted F1-score of 0.9843 on 13390 reviews, including 1339 actual fake reviews and 5356 augmented fake reviews generated with the nlpaug library. The remaining 6695 reviews were randomly selected from the 7710 non-fake instances. The model achieved a 0.9558 weighted F1-score when the fake reviews were augmented using the bnaug library. △ Less

Submitted 4 May, 2024; v1 submitted 3 August, 2023; originally announced August 2023.

Question-Answering System Extracts Information on Injection Drug Use from Clinical Notes

Authors: Maria Mahbub, Ian Goethert, Ioana Danciu, Kathryn Knight, Sudarshan Srinivasan, Suzanne Tamang, Karine Rozenberg-Ben-Dror, Hugo Solares, Susana Martins, Jodie Trafton, Edmon Begoli, Gregory Peterson

Abstract: Background: Injection drug use (IDU) is a dangerous health behavior that increases mortality and morbidity. Identifying IDU early and initiating harm reduction interventions can benefit individuals at risk. However, extracting IDU behaviors from patients' electronic health records (EHR) is difficult because there is no International Classification of Disease (ICD) code and the only place IDU infor… ▽ More Background: Injection drug use (IDU) is a dangerous health behavior that increases mortality and morbidity. Identifying IDU early and initiating harm reduction interventions can benefit individuals at risk. However, extracting IDU behaviors from patients' electronic health records (EHR) is difficult because there is no International Classification of Disease (ICD) code and the only place IDU information can be indicated is unstructured free-text clinical notes. Although natural language processing can efficiently extract this information from unstructured data, there are no validated tools. Methods: To address this gap in clinical information, we design and demonstrate a question-answering (QA) framework to extract information on IDU from clinical notes. Our framework involves two main steps: (1) generating a gold-standard QA dataset and (2) developing and testing the QA model. We utilize 2323 clinical notes of 1145 patients sourced from the VA Corporate Data Warehouse to construct the gold-standard dataset for developing and evaluating the QA model. We also demonstrate the QA model's ability to extract IDU-related information on temporally out-of-distribution data. Results: Here we show that for a strict match between gold-standard and predicted answers, the QA model achieves 51.65% F1 score. For a relaxed match between the gold-standard and predicted answers, the QA model obtains 78.03% F1 score, along with 85.38% Precision and 79.02% Recall scores. Moreover, the QA model demonstrates consistent performance when subjected to temporally out-of-distribution data. Conclusions: Our study introduces a QA framework designed to extract IDU information from clinical notes, aiming to enhance the accurate and efficient detection of people who inject drugs, extract relevant information, and ultimately facilitate informed patient care. △ Less

Submitted 28 December, 2023; v1 submitted 15 May, 2023; originally announced May 2023.

Comments: 31 pages, 11 tables, 7 figures

Bengali Fake Review Detection using Semi-supervised Generative Adversarial Networks

Authors: Md. Tanvir Rouf Shawon, G. M. Shahariar, Faisal Muhammad Shah, Mohammad Shafiul Alam, Md. Shahriar Mahbub

Abstract: This paper investigates the potential of semi-supervised Generative Adversarial Networks (GANs) to fine-tune pretrained language models in order to classify Bengali fake reviews from real reviews with a few annotated data. With the rise of social media and e-commerce, the ability to detect fake or deceptive reviews is becoming increasingly important in order to protect consumers from being misled… ▽ More This paper investigates the potential of semi-supervised Generative Adversarial Networks (GANs) to fine-tune pretrained language models in order to classify Bengali fake reviews from real reviews with a few annotated data. With the rise of social media and e-commerce, the ability to detect fake or deceptive reviews is becoming increasingly important in order to protect consumers from being misled by false information. Any machine learning model will have trouble identifying a fake review, especially for a low resource language like Bengali. We have demonstrated that the proposed semi-supervised GAN-LM architecture (generative adversarial network on top of a pretrained language model) is a viable solution in classifying Bengali fake reviews as the experimental results suggest that even with only 1024 annotated samples, BanglaBERT with semi-supervised GAN (SSGAN) achieved an accuracy of 83.59% and a f1-score of 84.89% outperforming other pretrained language models - BanglaBERT generator, Bangla BERT Base and Bangla-Electra by almost 3%, 4% and 10% respectively in terms of accuracy. The experiments were conducted on a manually labeled food review dataset consisting of total 6014 real and fake reviews collected from various social media groups. Researchers that are experiencing difficulty recognizing not just fake reviews but other classification issues owing to a lack of labeled data may find a solution in our proposed methodology. △ Less

Submitted 5 April, 2023; originally announced April 2023.

Capacity Maximization of the 6G Networks Deploying IRS

Authors: Mobasshir Mahbub, Raed M. Shubair

Abstract: The objective of the work is to improve the capacity of the micro cell, i.e., enabling the micro cell base station of a two-tier network to serve an increased number of devices. Therefore, the work deployed an IRS in a micro cell and achieved significant improvements in the performance with a reduced transmit power of the micro base station. The objective of the work is to improve the capacity of the micro cell, i.e., enabling the micro cell base station of a two-tier network to serve an increased number of devices. Therefore, the work deployed an IRS in a micro cell and achieved significant improvements in the performance with a reduced transmit power of the micro base station. △ Less

Submitted 21 March, 2023; originally announced March 2023.

SINR Coverage Enhancement of 6G UAV-Assisted Networks Deploying IRS

Authors: Mobasshir Mahbub, Raed M. Shubair

Abstract: The objective of the work is to enhance the signal-to-interference-plus-noise ratio (SINR) coverage probability in UAV-assisted 6G wireless networks. Therefore, the work analyzed and compared the coverage probability of conventional and IRS-assisted UAV communications models. The research obtained that the employment of IRS in UAV-assisted wireless networks enhances the SINR coverage probability s… ▽ More The objective of the work is to enhance the signal-to-interference-plus-noise ratio (SINR) coverage probability in UAV-assisted 6G wireless networks. Therefore, the work analyzed and compared the coverage probability of conventional and IRS-assisted UAV communications models. The research obtained that the employment of IRS in UAV-assisted wireless networks enhances the SINR coverage probability significantly. Moreover, the installment of IRS in UAV networks reduces the energy consumption of the network. △ Less

Submitted 3 December, 2022; originally announced December 2022.

Analysis of IRS-Assisted NOMA for 6G Wireless Communications

Authors: Mobasshir Mahbub, Raed M. Shubair

Abstract: Non-orthogonal multiple access (NOMA) scheme enables serving users with the same resource block i.e. frequency or time by multiplexing the signal of the users. Intelligent reflecting surfaces (IRS) or reconfigurable intelligent surfaces (RIS) is a potential approach for increasing transmission efficiency by modifying signal propagation by tweaking typically passive reflective components. IRS recon… ▽ More Non-orthogonal multiple access (NOMA) scheme enables serving users with the same resource block i.e. frequency or time by multiplexing the signal of the users. Intelligent reflecting surfaces (IRS) or reconfigurable intelligent surfaces (RIS) is a potential approach for increasing transmission efficiency by modifying signal propagation by tweaking typically passive reflective components. IRS reconfigures the wireless network in this manner to improve system performance. The research considered an IRS-assisted downlink NOMA system. This work modified the reference model by adopting an IRS-specific frequency-distance-dependent path loss model for IRS-NOMA downlink received power and signal-to-interference plus noise ratio (SINR) measurement instead of a typical or conventional distance-dependant path loss model. The incorporation of an IRS-specific path loss model provides a more convenient and better measurement compared to the conventional path loss model. Furthermore, this work figures out an improvement scope in the reference model. △ Less

Submitted 12 November, 2022; originally announced November 2022.

A Survey: Credit Sentiment Score Prediction

Authors: A. N. M. Sajedul Alam, Junaid Bin Kibria, Arnob Kumar Dey, Zawad Alam, Shifat Zaman, Motahar Mahtab, Mohammed Julfikar Ali Mahbub, Annajiat Alim Rasel

Abstract: Manual approvals are still used by banks and other NGOs to approve loans. It takes time and is prone to mistakes because it is controlled by a bank employee. Several fields of machine learning mining technologies have been utilized to enhance various areas of credit rating forecast. A major goal of this research is to look at current sentiment analysis techniques that are being used to generate cr… ▽ More Manual approvals are still used by banks and other NGOs to approve loans. It takes time and is prone to mistakes because it is controlled by a bank employee. Several fields of machine learning mining technologies have been utilized to enhance various areas of credit rating forecast. A major goal of this research is to look at current sentiment analysis techniques that are being used to generate creditworthiness. △ Less

Submitted 30 September, 2022; originally announced September 2022.

Comments: 16 pages, 3 figures, 3 tables

Intelligent Reflecting Surfaces for the Enhancement of 6G Internet of Things

Authors: Mobasshir Mahbub, Raed M. Shubair

Abstract: With the advancement of sensing technologies over the years, it has become critical to ensure the seamless connectivity of the Internet of Things (IoT) gadgets. With the advancement of communication technology, cellular networks are increasingly being utilized to link IoT systems. An IRS is a rectangular metasurface made up of a vast number of reflecting components that has recently gained researc… ▽ More With the advancement of sensing technologies over the years, it has become critical to ensure the seamless connectivity of the Internet of Things (IoT) gadgets. With the advancement of communication technology, cellular networks are increasingly being utilized to link IoT systems. An IRS is a rectangular metasurface made up of a vast number of reflecting components that has recently gained research attention due to its ability to significantly improve the energy and spectral efficiencies of communication networks by modifying wireless transmission environments. △ Less

Submitted 16 July, 2022; originally announced July 2022.

IRS for Multi-Access Edge Computing in 6G Networks

Authors: Mobasshir Mahbub, Raed M. Shubair

Abstract: Computation offloading in multi-access edge computing (MEC) is an effective paradigm for enabling resource-intensive smart applications. However, when the wireless channel utilized for offloading computing activities is hostile, the proper advantages of MEC may not be completely realized. Intelligent reflecting surface (IRS) is a new technology that has recently attracted significant interest can… ▽ More Computation offloading in multi-access edge computing (MEC) is an effective paradigm for enabling resource-intensive smart applications. However, when the wireless channel utilized for offloading computing activities is hostile, the proper advantages of MEC may not be completely realized. Intelligent reflecting surface (IRS) is a new technology that has recently attracted significant interest can optimize the wireless transmission environment in a programmable way and improving the connectivity between user equipment (UE) and base station (BS). In this paper, the performance of MEC architecture is analyzed considering both IRS-assisted and without IRS communication scenarios in the context of the urban micro cellular scenarios. The research obtained that the deployment of IRS can reduce the spectrum and energy consumption significantly. △ Less

Submitted 10 June, 2022; originally announced June 2022.

The Deployment of IRS in UAV-Empowered 6G Networks

Authors: Mobasshir Mahbub, Raed M. Shubair

Abstract: Intelligent reflecting surfaces (IRSs) with the ability to reconfigure inherent electromagnetic reflection and absorption characteristics in real-time provide unparalleled prospects to improve wireless connectivity in adverse circumstances. Unmanned aerial vehicles (UAV)-assisted wireless networks are evolved as a reliable solution to combat non-line of sight (NLoS) scenarios. Thereby, the IRS-emp… ▽ More Intelligent reflecting surfaces (IRSs) with the ability to reconfigure inherent electromagnetic reflection and absorption characteristics in real-time provide unparalleled prospects to improve wireless connectivity in adverse circumstances. Unmanned aerial vehicles (UAV)-assisted wireless networks are evolved as a reliable solution to combat non-line of sight (NLoS) scenarios. Thereby, the IRS-empowered UAV-assisted cellular networks will be a significant role-player to improve the coverage and user experiences. The paper aimed to minimize the path loss and maximize the achievable data rate in IRS-UAV-assisted networks. In this context, the work analyzed path loss and achievable rate utilizing millimeter wave (mmWave) carrier considering the conventional UAV model and IRS-empowered UAV communication model. The research obtained that the IRSempowered UAV communications model can significantly minimize path loss and maximize the achievable data rate compared to the conventional UAV-assisted model. △ Less

Submitted 7 May, 2022; originally announced May 2022.

BioADAPT-MRC: Adversarial Learning-based Domain Adaptation Improves Biomedical Machine Reading Comprehension Task

Authors: Maria Mahbub, Sudarshan Srinivasan, Edmon Begoli, Gregory D Peterson

Abstract: Biomedical machine reading comprehension (biomedical-MRC) aims to comprehend complex biomedical narratives and assist healthcare professionals in retrieving information from them. The high performance of modern neural network-based MRC systems depends on high-quality, large-scale, human-annotated training datasets. In the biomedical domain, a crucial challenge in creating such datasets is the requ… ▽ More Biomedical machine reading comprehension (biomedical-MRC) aims to comprehend complex biomedical narratives and assist healthcare professionals in retrieving information from them. The high performance of modern neural network-based MRC systems depends on high-quality, large-scale, human-annotated training datasets. In the biomedical domain, a crucial challenge in creating such datasets is the requirement for domain knowledge, inducing the scarcity of labeled data and the need for transfer learning from the labeled general-purpose (source) domain to the biomedical (target) domain. However, there is a discrepancy in marginal distributions between the general-purpose and biomedical domains due to the variances in topics. Therefore, direct-transferring of learned representations from a model trained on a general-purpose domain to the biomedical domain can hurt the model's performance. We present an adversarial learning-based domain adaptation framework for the biomedical machine reading comprehension task (BioADAPT-MRC), a neural network-based method to address the discrepancies in the marginal distributions between the general and biomedical domain datasets. BioADAPT-MRC relaxes the need for generating pseudo labels for training a well-performing biomedical-MRC model. We extensively evaluate the performance of BioADAPT-MRC by comparing it with the best existing methods on three widely used benchmark biomedical-MRC datasets -- BioASQ-7b, BioASQ-8b, and BioASQ-9b. Our results suggest that without using any synthetic or human-annotated data from the biomedical domain, BioADAPT-MRC can achieve state-of-the-art performance on these datasets. Availability: BioADAPT-MRC is freely available as an open-source project at \url{https://github.com/mmahbub/BioADAPT-MRC}. △ Less

Submitted 26 July, 2022; v1 submitted 26 February, 2022; originally announced February 2022.

Comments: 31 pages, 9 figures. This is the Authors' Original Version of the article, which has been accepted for publication in Bioinformatics 2022

The Sensitivity of Word Embeddings-based Author Detection Models to Semantic-preserving Adversarial Perturbations

Authors: Jeremiah Duncan, Fabian Fallas, Chris Gropp, Emily Herron, Maria Mahbub, Paula Olaya, Eduardo Ponce, Tabitha K. Samuel, Daniel Schultz, Sudarshan Srinivasan, Maofeng Tang, Viktor Zenkov, Quan Zhou, Edmon Begoli

Abstract: Authorship analysis is an important subject in the field of natural language processing. It allows the detection of the most likely writer of articles, news, books, or messages. This technique has multiple uses in tasks related to authorship attribution, detection of plagiarism, style analysis, sources of misinformation, etc. The focus of this paper is to explore the limitations and sensitiveness… ▽ More Authorship analysis is an important subject in the field of natural language processing. It allows the detection of the most likely writer of articles, news, books, or messages. This technique has multiple uses in tasks related to authorship attribution, detection of plagiarism, style analysis, sources of misinformation, etc. The focus of this paper is to explore the limitations and sensitiveness of established approaches to adversarial manipulations of inputs. To this end, and using those established techniques, we first developed an experimental frame-work for author detection and input perturbations. Next, we experimentally evaluated the performance of the authorship detection model to a collection of semantic-preserving adversarial perturbations of input narratives. Finally, we compare and analyze the effects of different perturbation strategies, input and model configurations, and the effects of these on the author detection model. △ Less

Submitted 23 February, 2021; originally announced February 2021.

Demonstration of a Time-Efficient Mobility System Using a Scaled Smart City

Authors: Logan E. Beaver, Behdad Chalaki, AM Ishtiaque Mahbub, Liuhui Zhao, Ray Zayas, Andreas A. Malikopoulos

Abstract: The implementation of connected and automated vehicle (CAV) technologies enables a novel computational framework to deliver real-time control actions that optimize travel time, energy, and safety. Hardware is an integral part of any practical implementation of CAVs, and as such, it should be incorporated in any validation method. However, high costs associated with full scale, field testing of CAV… ▽ More The implementation of connected and automated vehicle (CAV) technologies enables a novel computational framework to deliver real-time control actions that optimize travel time, energy, and safety. Hardware is an integral part of any practical implementation of CAVs, and as such, it should be incorporated in any validation method. However, high costs associated with full scale, field testing of CAVs have proven to be a significant barrier. In this paper, we present the implementation of a decentralized control framework, which was developed previously, in a scaled-city using robotic CAVs, and discuss the implications of CAVs on travel time. Supplemental information and videos can be found at https://sites.google.com/view/ud-ids-lab/tfms. △ Less

Submitted 21 November, 2019; v1 submitted 4 March, 2019; originally announced March 2019.

Journal ref: Vehicle System Dynamics 58 (2020) 787-804