-
Exploring the Impact of Environmental Pollutants on Multiple Sclerosis Progression
Authors:
Elena Marinello,
Erica Tavazzi,
Enrico Longato,
Pietro Bosoni,
Arianna Dagliati,
Mahin Vazifehdan,
Riccardo Bellazzi,
Isotta Trescato,
Alessandro Guazzo,
Martina Vettoretti,
Eleonora Tavazzi,
Lara Ahmad,
Roberto Bergamaschi,
Paola Cavalla,
Umberto Manera,
Adriano Chio,
Barbara Di Camillo
Abstract:
Multiple Sclerosis (MS) is a chronic autoimmune and inflammatory neurological disorder characterised by episodes of symptom exacerbation, known as relapses. In this study, we investigate the role of environmental factors in relapse occurrence among MS patients, using data from the H2020 BRAINTEASER project. We employed predictive models, including Random Forest (RF) and Logistic Regression (LR), w…
▽ More
Multiple Sclerosis (MS) is a chronic autoimmune and inflammatory neurological disorder characterised by episodes of symptom exacerbation, known as relapses. In this study, we investigate the role of environmental factors in relapse occurrence among MS patients, using data from the H2020 BRAINTEASER project. We employed predictive models, including Random Forest (RF) and Logistic Regression (LR), with varying sets of input features to predict the occurrence of relapses based on clinical and pollutant data collected over a week. The RF yielded the best result, with an AUC-ROC score of 0.713. Environmental variables, such as precipitation, NO2, PM2.5, humidity, and temperature, were found to be relevant to the prediction.
△ Less
Submitted 30 August, 2024;
originally announced August 2024.
-
Towards improving Alzheimer's intervention: a machine learning approach for biomarker detection through combining MEG and MRI pipelines
Authors:
Alwani Liyana Ahmad,
Jose Sanchez-Bornot,
Roberto C. Sotero,
Damien Coyle,
Zamzuri Idris,
Ibrahima Faye
Abstract:
MEG are non invasive neuroimaging techniques with excellent temporal and spatial resolution, crucial for studying brain function in dementia and Alzheimer Disease. They identify changes in brain activity at various Alzheimer stages, including preclinical and prodromal phases. MEG may detect pathological changes before clinical symptoms, offering potential biomarkers for intervention. This study ev…
▽ More
MEG are non invasive neuroimaging techniques with excellent temporal and spatial resolution, crucial for studying brain function in dementia and Alzheimer Disease. They identify changes in brain activity at various Alzheimer stages, including preclinical and prodromal phases. MEG may detect pathological changes before clinical symptoms, offering potential biomarkers for intervention. This study evaluates classification techniques using MEG features to distinguish between healthy controls and mild cognitive impairment participants from the BioFIND study. We compare MEG based biomarkers with MRI based anatomical features, both independently and combined. We used 3 Tesla MRI and MEG data from 324 BioFIND participants;158 MCI and 166 HC. Analyses were performed using MATLAB with SPM12 and OSL toolboxes. Machine learning analyses, including 100 Monte Carlo replications of 10 fold cross validation, were conducted on sensor and source spaces. Combining MRI with MEG features achieved the best performance; 0.76 accuracy and AUC of 0.82 for GLMNET using LCMV source based MEG. MEG only analyses using LCMV and eLORETA also performed well, suggesting that combining uncorrected MEG with z-score-corrected MRI features is optimal.
△ Less
Submitted 8 August, 2024;
originally announced August 2024.
-
The Human Factor in AI Red Teaming: Perspectives from Social and Collaborative Computing
Authors:
Alice Qian Zhang,
Ryland Shaw,
Jacy Reese Anthis,
Ashlee Milton,
Emily Tseng,
Jina Suh,
Lama Ahmad,
Ram Shankar Siva Kumar,
Julian Posada,
Benjamin Shestakofsky,
Sarah T. Roberts,
Mary L. Gray
Abstract:
Rapid progress in general-purpose AI has sparked significant interest in "red teaming," a practice of adversarial testing originating in military and cybersecurity applications. AI red teaming raises many questions about the human factor, such as how red teamers are selected, biases and blindspots in how tests are conducted, and harmful content's psychological effects on red teamers. A growing bod…
▽ More
Rapid progress in general-purpose AI has sparked significant interest in "red teaming," a practice of adversarial testing originating in military and cybersecurity applications. AI red teaming raises many questions about the human factor, such as how red teamers are selected, biases and blindspots in how tests are conducted, and harmful content's psychological effects on red teamers. A growing body of HCI and CSCW literature examines related practices-including data labeling, content moderation, and algorithmic auditing. However, few, if any, have investigated red teaming itself. This workshop seeks to consider the conceptual and empirical challenges associated with this practice, often rendered opaque by non-disclosure agreements. Future studies may explore topics ranging from fairness to mental health and other areas of potential harm. We aim to facilitate a community of researchers and practitioners who can begin to meet these challenges with creativity, innovation, and thoughtful reflection.
△ Less
Submitted 10 July, 2024;
originally announced July 2024.
-
A Machine Learning Approach for Identifying Anatomical Biomarkers of Early Mild Cognitive Impairment
Authors:
Alwani Liyana Ahmad,
Jose Sanchez-Bornot,
Roberto C. Sotero,
Damien Coyle,
Zamzuri Idris,
Ibrahima Faye
Abstract:
Alzheimer Disease poses a significant challenge, necessitating early detection for effective intervention. MRI is a key neuroimaging tool due to its ease of use and cost effectiveness. This study analyzes machine learning methods for MRI based biomarker selection and classification to distinguish between healthy controls and those who develop mild cognitive impairment within five years. Using 3 Te…
▽ More
Alzheimer Disease poses a significant challenge, necessitating early detection for effective intervention. MRI is a key neuroimaging tool due to its ease of use and cost effectiveness. This study analyzes machine learning methods for MRI based biomarker selection and classification to distinguish between healthy controls and those who develop mild cognitive impairment within five years. Using 3 Tesla MRI data from ADNI and OASIS 3, we applied various machine learning techniques, including MATLAB Classification Learner app, nested cross validation, and Bayesian optimization. Data harmonization with polynomial regression improved performance. Consistent features identified were the entorhinal, hippocampus, lateral ventricle, and lateral orbitofrontal regions. For balanced ADNI data, Naive Bayes with z score harmonization performed best. For balanced OASIS 3, SVM with z score correction excelled. In imbalanced data, RUSBoost showed strong performance on ADNI and OASIS 3. Z score harmonization highlighted the potential of a semi automatic pipeline for early AD detection using MRI.
△ Less
Submitted 8 August, 2024; v1 submitted 29 May, 2024;
originally announced July 2024.
-
Beyond static AI evaluations: advancing human interaction evaluations for LLM harms and risks
Authors:
Lujain Ibrahim,
Saffron Huang,
Lama Ahmad,
Markus Anderljung
Abstract:
Model evaluations are central to understanding the safety, risks, and societal impacts of AI systems. While most real-world AI applications involve human-AI interaction, most current evaluations (e.g., common benchmarks) of AI models do not. Instead, they incorporate human factors in limited ways, assessing the safety of models in isolation, thereby falling short of capturing the complexity of hum…
▽ More
Model evaluations are central to understanding the safety, risks, and societal impacts of AI systems. While most real-world AI applications involve human-AI interaction, most current evaluations (e.g., common benchmarks) of AI models do not. Instead, they incorporate human factors in limited ways, assessing the safety of models in isolation, thereby falling short of capturing the complexity of human-model interactions. In this paper, we discuss and operationalize a definition of an emerging category of evaluations -- "human interaction evaluations" (HIEs) -- which focus on the assessment of human-model interactions or the process and the outcomes of humans using models. First, we argue that HIEs can be used to increase the validity of safety evaluations, assess direct human impact and interaction-specific harms, and guide future assessments of models' societal impact. Second, we propose a safety-focused HIE design framework -- containing a human-LLM interaction taxonomy -- with three stages: (1) identifying the risk or harm area, (2) characterizing the use context, and (3) choosing the evaluation parameters. Third, we apply our framework to two potential evaluations for overreliance and persuasion risks. Finally, we conclude with tangible recommendations for addressing concerns over costs, replicability, and unrepresentativeness of HIEs.
△ Less
Submitted 12 July, 2024; v1 submitted 17 May, 2024;
originally announced May 2024.
-
Evaluating the Social Impact of Generative AI Systems in Systems and Society
Authors:
Irene Solaiman,
Zeerak Talat,
William Agnew,
Lama Ahmad,
Dylan Baker,
Su Lin Blodgett,
Canyu Chen,
Hal Daumé III,
Jesse Dodge,
Isabella Duan,
Ellie Evans,
Felix Friedrich,
Avijit Ghosh,
Usman Gohar,
Sara Hooker,
Yacine Jernite,
Ria Kalluri,
Alberto Lusoli,
Alina Leidinger,
Michelle Lin,
Xiuzhu Lin,
Sasha Luccioni,
Jennifer Mickel,
Margaret Mitchell,
Jessica Newman
, et al. (6 additional authors not shown)
Abstract:
Generative AI systems across modalities, ranging from text (including code), image, audio, and video, have broad social impacts, but there is no official standard for means of evaluating those impacts or for which impacts should be evaluated. In this paper, we present a guide that moves toward a standard approach in evaluating a base generative AI system for any modality in two overarching categor…
▽ More
Generative AI systems across modalities, ranging from text (including code), image, audio, and video, have broad social impacts, but there is no official standard for means of evaluating those impacts or for which impacts should be evaluated. In this paper, we present a guide that moves toward a standard approach in evaluating a base generative AI system for any modality in two overarching categories: what can be evaluated in a base system independent of context and what can be evaluated in a societal context. Importantly, this refers to base systems that have no predetermined application or deployment context, including a model itself, as well as system components, such as training data. Our framework for a base system defines seven categories of social impact: bias, stereotypes, and representational harms; cultural values and sensitive content; disparate performance; privacy and data protection; financial costs; environmental costs; and data and content moderation labor costs. Suggested methods for evaluation apply to listed generative modalities and analyses of the limitations of existing evaluations serve as a starting point for necessary investment in future evaluations. We offer five overarching categories for what can be evaluated in a broader societal context, each with its own subcategories: trustworthiness and autonomy; inequality, marginalization, and violence; concentration of authority; labor and creativity; and ecosystem and environment. Each subcategory includes recommendations for mitigating harm.
△ Less
Submitted 28 June, 2024; v1 submitted 9 June, 2023;
originally announced June 2023.
-
GPT-4 Technical Report
Authors:
OpenAI,
Josh Achiam,
Steven Adler,
Sandhini Agarwal,
Lama Ahmad,
Ilge Akkaya,
Florencia Leoni Aleman,
Diogo Almeida,
Janko Altenschmidt,
Sam Altman,
Shyamal Anadkat,
Red Avila,
Igor Babuschkin,
Suchir Balaji,
Valerie Balcom,
Paul Baltescu,
Haiming Bao,
Mohammad Bavarian,
Jeff Belgum,
Irwan Bello,
Jake Berdine,
Gabriel Bernadett-Shapiro,
Christopher Berner,
Lenny Bogdonoff,
Oleg Boiko
, et al. (256 additional authors not shown)
Abstract:
We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs. While less capable than humans in many real-world scenarios, GPT-4 exhibits human-level performance on various professional and academic benchmarks, including passing a simulated bar exam with a score around the top 10% of test takers. GPT-4 is a Transformer-based mo…
▽ More
We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs. While less capable than humans in many real-world scenarios, GPT-4 exhibits human-level performance on various professional and academic benchmarks, including passing a simulated bar exam with a score around the top 10% of test takers. GPT-4 is a Transformer-based model pre-trained to predict the next token in a document. The post-training alignment process results in improved performance on measures of factuality and adherence to desired behavior. A core component of this project was developing infrastructure and optimization methods that behave predictably across a wide range of scales. This allowed us to accurately predict some aspects of GPT-4's performance based on models trained with no more than 1/1,000th the compute of GPT-4.
△ Less
Submitted 4 March, 2024; v1 submitted 15 March, 2023;
originally announced March 2023.
-
Application of fuzzy Laplace transforms for solving fuzzy partial Volterra integro-differential equations
Authors:
Saif Ullah,
Muhammad Farooq,
Latif Ahmad,
Saleem Abdullah
Abstract:
Fuzzy partial integro-differential equations have a major role in the fields of science and engineering. In this paper, we propose the solution of fuzzy partial Volterra integro-differential equation with convolution type kernel using fuzzy Laplace transform method (FLTM) under Hukuhara differentiability. It is shown that FLTM is a simple and reliable approach for solving such equations analytical…
▽ More
Fuzzy partial integro-differential equations have a major role in the fields of science and engineering. In this paper, we propose the solution of fuzzy partial Volterra integro-differential equation with convolution type kernel using fuzzy Laplace transform method (FLTM) under Hukuhara differentiability. It is shown that FLTM is a simple and reliable approach for solving such equations analytically. Finally, the method is illustrated with few examples to show the ability of the proposed method.
△ Less
Submitted 8 May, 2014;
originally announced May 2014.
-
Solving fuzzy convolution Volterra integro-differential equation via fuzzy Laplace transforms
Authors:
Saif Ullah,
Latif Ahmad,
Muhammad Farooq,
Saleem Abdullah
Abstract:
The solution of integro-differential equations have a major role in the fields of science and engineering. Different approaches both numerical and analytic are used to solve these type of equations. In this paper, the solution of fuzzy convolution Volterra integro-differential equation is investigated using fuzzy Laplace transform method under generalized Hukuhara differentiability. Finally, the m…
▽ More
The solution of integro-differential equations have a major role in the fields of science and engineering. Different approaches both numerical and analytic are used to solve these type of equations. In this paper, the solution of fuzzy convolution Volterra integro-differential equation is investigated using fuzzy Laplace transform method under generalized Hukuhara differentiability. Finally, the method is illustrated with few examples to show the ability of the proposed method.
△ Less
Submitted 2 April, 2014; v1 submitted 31 March, 2014;
originally announced March 2014.
-
Solving fuzzy two-point boundary value problem using fuzzy Laplace transform
Authors:
Latif Ahmad,
Muhammad Farooq,
Saif Ullah,
Saleem Abdullah
Abstract:
A natural way to model dynamic systems under uncertainty is to use fuzzy boundary value problems (FBVPs) and related uncertain systems. In this paper we use fuzzy Laplace transform to find the solution of two-point boundary value under generalized Hukuhara differentiability. We illustrate the method for the solution of the well known two-point boundary value problem Schrodinger equation, and homo…
▽ More
A natural way to model dynamic systems under uncertainty is to use fuzzy boundary value problems (FBVPs) and related uncertain systems. In this paper we use fuzzy Laplace transform to find the solution of two-point boundary value under generalized Hukuhara differentiability. We illustrate the method for the solution of the well known two-point boundary value problem Schrodinger equation, and homogeneous boundary value problem. Consequently, we investigate the solutions of FBVPs under as a new application of fuzzy Laplace transform.
△ Less
Submitted 2 March, 2014;
originally announced March 2014.
-
Solving nth order fuzzy differential equation by fuzzy Laplace transform
Authors:
Latif Ahmad,
Muhammad Farooq,
Saleem Abdullah
Abstract:
In this paper, we generalize the fuzzy Laplace transformation (FLT) for the nth derivative of a fuzzy-valued function named as nth derivative theorem and under the strongly generalized differentiability concept, we use it in an analytical solution method for the solution of an nth order fuzzy initial value problem (FIVP). This is a simple approach toward the solution of nth order fuzzy initial val…
▽ More
In this paper, we generalize the fuzzy Laplace transformation (FLT) for the nth derivative of a fuzzy-valued function named as nth derivative theorem and under the strongly generalized differentiability concept, we use it in an analytical solution method for the solution of an nth order fuzzy initial value problem (FIVP). This is a simple approach toward the solution of nth order fuzzy initial value problem (FIVP) by the nth generalized (FLT) form, and then we can use it to solve any order of FIVP. The related theorems and properties are proved. The method is illustrated with the help of some examples. We use MATLAB to evaluate the inverse Laplace transform.
△ Less
Submitted 2 March, 2014;
originally announced March 2014.