-
Quantifying Influencer Effects on Affective Polarization
Authors:
Rezaur Rashid,
Joshua Melton,
Ouldouz Ghorbani,
Siddharth Krishnan,
Shannon Reid,
Gabriel Terejanu
Abstract:
In an era where digital platforms increasingly mediate public discourse, grasping the complexities and nuances in affective polarization--especially as influenced by key figures on social media--has never been more vital. This study delves into the intricate web of interactions on Twitter, now rebranded as 'X', to unravel how influencer-led conversations catalyze shifts in public sentiment, laying…
▽ More
In an era where digital platforms increasingly mediate public discourse, grasping the complexities and nuances in affective polarization--especially as influenced by key figures on social media--has never been more vital. This study delves into the intricate web of interactions on Twitter, now rebranded as 'X', to unravel how influencer-led conversations catalyze shifts in public sentiment, laying bare the complex dynamics that underpin online polarization. Employing a novel methodological framework that includes counterfactual analysis, we analyze scenarios with and without specific influencer-led conversations. Our findings illuminate the significant role influencers play in shaping public discourse, offering insights into the mechanisms of online polarization and suggesting pathways for future research to mitigate divisiveness and explore new methods for quantifying affective polarization. This research contributes to the broader understanding of digital communication's impact on societal polarization, underscoring the importance of detailed analysis in developing strategies to foster a more cohesive digital public sphere.
△ Less
Submitted 24 May, 2024;
originally announced May 2024.
-
Two-Stage Stance Labeling: User-Hashtag Heuristics with Graph Neural Networks
Authors:
Joshua Melton,
Shannon Reid,
Gabriel Terejanu,
Siddharth Krishnan
Abstract:
The high volume and rapid evolution of content on social media present major challenges for studying the stance of social media users. In this work, we develop a two stage stance labeling method that utilizes the user-hashtag bipartite graph and the user-user interaction graph. In the first stage, a simple and efficient heuristic for stance labeling uses the user-hashtag bipartite graph to iterati…
▽ More
The high volume and rapid evolution of content on social media present major challenges for studying the stance of social media users. In this work, we develop a two stage stance labeling method that utilizes the user-hashtag bipartite graph and the user-user interaction graph. In the first stage, a simple and efficient heuristic for stance labeling uses the user-hashtag bipartite graph to iteratively update the stance association of user and hashtag nodes via a label propagation mechanism. This set of soft labels is then integrated with the user-user interaction graph to train a graph neural network (GNN) model using semi-supervised learning. We evaluate this method on two large-scale datasets containing tweets related to climate change from June 2021 to June 2022 and gun control from January 2022 to January 2023. Our experiments demonstrate that enriching text-based embeddings of users with network information from the user interaction graph using our semi-supervised GNN method outperforms both classifiers trained on user textual embeddings and zero-shot classification using LLMs such as GPT4. We discuss the need for integrating nuanced understanding from social science with the scalability of computational methods to better understand how polarization on social media occurs for divisive issues such as climate change and gun control.
△ Less
Submitted 17 May, 2024; v1 submitted 15 April, 2024;
originally announced April 2024.
-
Machine Fault Classification using Hamiltonian Neural Networks
Authors:
Jeremy Shen,
Jawad Chowdhury,
Sourav Banerjee,
Gabriel Terejanu
Abstract:
A new approach is introduced to classify faults in rotating machinery based on the total energy signature estimated from sensor measurements. The overall goal is to go beyond using black-box models and incorporate additional physical constraints that govern the behavior of mechanical systems. Observational data is used to train Hamiltonian neural networks that describe the conserved energy of the…
▽ More
A new approach is introduced to classify faults in rotating machinery based on the total energy signature estimated from sensor measurements. The overall goal is to go beyond using black-box models and incorporate additional physical constraints that govern the behavior of mechanical systems. Observational data is used to train Hamiltonian neural networks that describe the conserved energy of the system for normal and various abnormal regimes. The estimated total energy function, in the form of the weights of the Hamiltonian neural network, serves as the new feature vector to discriminate between the faults using off-the-shelf classification models. The experimental results are obtained using the MaFaulDa database, where the proposed model yields a promising area under the curve (AUC) of $0.78$ for the binary classification (normal vs abnormal) and $0.84$ for the multi-class problem (normal, and $5$ different abnormal regimes).
△ Less
Submitted 4 January, 2023;
originally announced January 2023.
-
Evaluation of Induced Expert Knowledge in Causal Structure Learning by NOTEARS
Authors:
Jawad Chowdhury,
Rezaur Rashid,
Gabriel Terejanu
Abstract:
Causal modeling provides us with powerful counterfactual reasoning and interventional mechanism to generate predictions and reason under various what-if scenarios. However, causal discovery using observation data remains a nontrivial task due to unobserved confounding factors, finite sampling, and changes in the data distribution. These can lead to spurious cause-effect relationships. To mitigate…
▽ More
Causal modeling provides us with powerful counterfactual reasoning and interventional mechanism to generate predictions and reason under various what-if scenarios. However, causal discovery using observation data remains a nontrivial task due to unobserved confounding factors, finite sampling, and changes in the data distribution. These can lead to spurious cause-effect relationships. To mitigate these challenges in practice, researchers augment causal learning with known causal relations. The goal of the paper is to study the impact of expert knowledge on causal relations in the form of additional constraints used in the formulation of the nonparametric NOTEARS. We provide a comprehensive set of comparative analyses of biasing the model using different types of knowledge. We found that (i) knowledge that corrects the mistakes of the NOTEARS model can lead to statistically significant improvements, (ii) constraints on active edges have a larger positive impact on causal discovery than inactive edges, and surprisingly, (iii) the induced knowledge does not correct on average more incorrect active and/or inactive edges than expected. We also demonstrate the behavior of the model and the effectiveness of domain knowledge on a real-world dataset.
△ Less
Submitted 4 January, 2023;
originally announced January 2023.
-
From Causal Pairs to Causal Graphs
Authors:
Rezaur Rashid,
Jawad Chowdhury,
Gabriel Terejanu
Abstract:
Causal structure learning from observational data remains a non-trivial task due to various factors such as finite sampling, unobserved confounding factors, and measurement errors. Constraint-based and score-based methods tend to suffer from high computational complexity due to the combinatorial nature of estimating the directed acyclic graph (DAG). Motivated by the `Cause-Effect Pair' NIPS 2013 W…
▽ More
Causal structure learning from observational data remains a non-trivial task due to various factors such as finite sampling, unobserved confounding factors, and measurement errors. Constraint-based and score-based methods tend to suffer from high computational complexity due to the combinatorial nature of estimating the directed acyclic graph (DAG). Motivated by the `Cause-Effect Pair' NIPS 2013 Workshop on Causality Challenge, in this paper, we take a different approach and generate a probability distribution over all possible graphs informed by the cause-effect pair features proposed in response to the workshop challenge. The goal of the paper is to propose new methods based on this probabilistic information and compare their performance with traditional and state-of-the-art approaches. Our experiments, on both synthetic and real datasets, show that our proposed methods not only have statistically similar or better performances than some traditional approaches but also are computationally faster.
△ Less
Submitted 8 November, 2022;
originally announced November 2022.
-
Explainable Deep Modeling of Tabular Data using TableGraphNet
Authors:
Gabriel Terejanu,
Jawad Chowdhury,
Rezaur Rashid,
Asif Chowdhury
Abstract:
The vast majority of research on explainability focuses on post-explainability rather than explainable modeling. Namely, an explanation model is derived to explain a complex black box model built with the sole purpose of achieving the highest performance possible. In part, this trend might be driven by the misconception that there is a trade-off between explainability and accuracy. Furthermore, th…
▽ More
The vast majority of research on explainability focuses on post-explainability rather than explainable modeling. Namely, an explanation model is derived to explain a complex black box model built with the sole purpose of achieving the highest performance possible. In part, this trend might be driven by the misconception that there is a trade-off between explainability and accuracy. Furthermore, the consequential work on Shapely values, grounded in game theory, has also contributed to a new wave of post-explainability research on better approximations for various machine learning models, including deep learning models. We propose a new architecture that inherently produces explainable predictions in the form of additive feature attributions. Our approach learns a graph representation for each record in the dataset. Attribute centric features are then derived from the graph and fed into a contribution deep set model to produce the final predictions. We show that our explainable model attains the same level of performance as black box models. Finally, we provide an augmented model training approach that leverages the missingness property and yields high levels of consistency (as required for the Shapely values) without loss of accuracy.
△ Less
Submitted 12 February, 2020;
originally announced February 2020.
-
Approximate Sampling using an Accelerated Metropolis-Hastings based on Bayesian Optimization and Gaussian Processes
Authors:
Asif J. Chowdhury,
Gabriel Terejanu
Abstract:
Markov Chain Monte Carlo (MCMC) methods have a drawback when working with a target distribution or likelihood function that is computationally expensive to evaluate, specially when working with big data. This paper focuses on Metropolis-Hastings (MH) algorithm for unimodal distributions. Here, an enhanced MH algorithm is proposed that requires less number of expensive function evaluations, has sho…
▽ More
Markov Chain Monte Carlo (MCMC) methods have a drawback when working with a target distribution or likelihood function that is computationally expensive to evaluate, specially when working with big data. This paper focuses on Metropolis-Hastings (MH) algorithm for unimodal distributions. Here, an enhanced MH algorithm is proposed that requires less number of expensive function evaluations, has shorter burn-in period, and uses a better proposal distribution. The main innovations include the use of Bayesian optimization to reach the high probability region quickly, emulating the target distribution using Gaussian processes (GP), and using Laplace approximation of the GP to build a proposal distribution that captures the underlying correlation better. The experiments show significant improvement over the regular MH. Statistical comparison between the results from two algorithms is presented.
△ Less
Submitted 21 October, 2019;
originally announced October 2019.
-
A Multiple Filter Based Neural Network Approach to the Extrapolation of Adsorption Energies on Metal Surfaces for Catalysis Applications
Authors:
Asif J. Chowdhury,
Wenqiang Yang,
Kareem E. Abdelfatah,
Mehdi Zare,
Andreas Heyden,
Gabriel Terejanu
Abstract:
Computational catalyst discovery involves the development of microkinetic reactor models based on estimated parameters determined from density functional theory (DFT). For complex surface chemistries, the cost of calculating the adsorption energies by DFT for a large number of reaction intermediates can become prohibitive. Here, we have identified appropriate descriptors and machine learning model…
▽ More
Computational catalyst discovery involves the development of microkinetic reactor models based on estimated parameters determined from density functional theory (DFT). For complex surface chemistries, the cost of calculating the adsorption energies by DFT for a large number of reaction intermediates can become prohibitive. Here, we have identified appropriate descriptors and machine learning models that can be used to predict part of these adsorption energies given data on the rest of them. Our investigations also included the case when the species data used to train the predictive model is of different size relative to the species the model tries to predict - an extrapolation in the data space which is typically difficult with regular machine learning models. We have developed a neural network based predictive model that combines an established model with the concepts of a convolutional neural network that, when extrapolating, achieves significant improvement over the previous models.
△ Less
Submitted 1 October, 2019;
originally announced October 2019.
-
An Approximate Bayesian Long Short-Term Memory Algorithm for Outlier Detection
Authors:
Chao Chen,
Xiao Lin,
Gabriel Terejanu
Abstract:
Long Short-Term Memory networks trained with gradient descent and back-propagation have received great success in various applications. However, point estimation of the weights of the networks is prone to over-fitting problems and lacks important uncertainty information associated with the estimation. However, exact Bayesian neural network methods are intractable and non-applicable for real-world…
▽ More
Long Short-Term Memory networks trained with gradient descent and back-propagation have received great success in various applications. However, point estimation of the weights of the networks is prone to over-fitting problems and lacks important uncertainty information associated with the estimation. However, exact Bayesian neural network methods are intractable and non-applicable for real-world applications. In this study, we propose an approximate estimation of the weights uncertainty using Ensemble Kalman Filter, which is easily scalable to a large number of weights. Furthermore, we optimize the covariance of the noise distribution in the ensemble update step using maximum likelihood estimation. To assess the proposed algorithm, we apply it to outlier detection in five real-world events retrieved from the Twitter platform.
△ Less
Submitted 3 June, 2019; v1 submitted 23 December, 2017;
originally announced December 2017.
-
Identifying Active Sites of the Water-Gas Shift Reaction over Titania Supported Platinum Catalysts under Uncertainty
Authors:
Eric A. Walker,
Donald Mitchell,
Gabriel A. Terejanu,
Andreas Heyden
Abstract:
A comprehensive uncertainty quantification framework has been developed for integrating computational and experimental kinetic data and to identify active sites and reaction mechanisms in catalysis. Three hypotheses regarding the active site for the water-gas shift reaction on Pt/TiO2 catalysts are tested - Pt(111), an edge interface site, and a corner interface site. Uncertainties associated with…
▽ More
A comprehensive uncertainty quantification framework has been developed for integrating computational and experimental kinetic data and to identify active sites and reaction mechanisms in catalysis. Three hypotheses regarding the active site for the water-gas shift reaction on Pt/TiO2 catalysts are tested - Pt(111), an edge interface site, and a corner interface site. Uncertainties associated with DFT calculations and model errors of microkinetic models of the active sites are informed and verified using Bayesian inference and predictive validation. Significant evidence is found for the role of the oxide support in the mechanism. Positive evidence is found in support of the edge interface active site over the corner interface site. For the edge interface site, the CO-promoted redox mechanism is found to be the dominant pathway and only at temperatures above 573 K does the classical redox mechanism contribute significantly to the overall rate. At all reaction conditions, water and surface O-H bond dissociation steps at the Pt/TiO2 interface are the main rate controlling steps.
△ Less
Submitted 10 October, 2017;
originally announced October 2017.
-
EnLLVM: Ensemble Based Nonlinear Bayesian Filtering Using Linear Latent Variable Models
Authors:
Xiao Lin,
Gabriel Terejanu
Abstract:
Real-time nonlinear Bayesian filtering algorithms are overwhelmed by data volume, velocity and increasing complexity of computational models. In this paper, we propose a novel ensemble based nonlinear Bayesian filtering approach which only requires a small number of simulations and can be applied to high-dimensional systems in the presence of intractable likelihood functions. The proposed approach…
▽ More
Real-time nonlinear Bayesian filtering algorithms are overwhelmed by data volume, velocity and increasing complexity of computational models. In this paper, we propose a novel ensemble based nonlinear Bayesian filtering approach which only requires a small number of simulations and can be applied to high-dimensional systems in the presence of intractable likelihood functions. The proposed approach uses linear latent projections to estimate the joint probability distribution between states, parameters, and observables using a mixture of Gaussian components generated by the reconstruction error for each ensemble member. Since it leverages the computational machinery behind linear latent variable models, it can achieve fast implementations without the need to compute high-dimensional sample covariance matrices. The performance of the proposed approach is compared with the performance of ensemble Kalman filter on a high-dimensional Lorenz nonlinear dynamical system.
△ Less
Submitted 30 May, 2019; v1 submitted 7 August, 2017;
originally announced August 2017.
-
Approximate Computational Approaches for Bayesian Sensor Placement in High Dimensions
Authors:
Xiao Lin,
Asif Chowdhury,
Xiaofan Wang,
Gabriel Terejanu
Abstract:
Since the cost of installing and maintaining sensors is usually high, sensor locations are always strategically selected. For those aiming at inferring certain quantities of interest (QoI), it is desirable to explore the dependency between sensor measurements and QoI. One of the most popular metric for the dependency is mutual information which naturally measures how much information about one var…
▽ More
Since the cost of installing and maintaining sensors is usually high, sensor locations are always strategically selected. For those aiming at inferring certain quantities of interest (QoI), it is desirable to explore the dependency between sensor measurements and QoI. One of the most popular metric for the dependency is mutual information which naturally measures how much information about one variable can be obtained given the other. However, computing mutual information is always challenging, and the result is unreliable in high dimension. In this paper, we propose an approach to find an approximate lower bound of mutual information and compute it in a lower dimension. Then, sensors are placed where highest mutual information (lower bound) is achieved and QoI is inferred via Bayes rule given sensor measurements. In addition, Bayesian optimization is introduced to provide a continuous mutual information surface over the domain and thus reduce the number of evaluations. A chemical release accident is simulated where multiple sensors are placed to locate the source of the release. The result shows that the proposed approach is both effective and efficient in inferring QoI.
△ Less
Submitted 19 March, 2017; v1 submitted 1 March, 2017;
originally announced March 2017.
-
Environmental Modeling Framework using Stacked Gaussian Processes
Authors:
Kareem Abdelfatah,
Junshu Bao,
Gabriel Terejanu
Abstract:
A network of independently trained Gaussian processes (StackedGP) is introduced to obtain predictions of quantities of interest with quantified uncertainties. The main applications of the StackedGP framework are to integrate different datasets through model composition, enhance predictions of quantities of interest through a cascade of intermediate predictions, and to propagate uncertainties throu…
▽ More
A network of independently trained Gaussian processes (StackedGP) is introduced to obtain predictions of quantities of interest with quantified uncertainties. The main applications of the StackedGP framework are to integrate different datasets through model composition, enhance predictions of quantities of interest through a cascade of intermediate predictions, and to propagate uncertainties through emulated dynamical systems driven by uncertain forcing variables. By using analytical first and second-order moments of a Gaussian process with uncertain inputs using squared exponential and polynomial kernels, approximated expectations of quantities of interests that require an arbitrary composition of functions can be obtained. The StackedGP model is extended to any number of layers and nodes per layer, and it provides flexibility in kernel selection for the input nodes. The proposed nonparametric stacked model is validated using synthetic datasets, and its performance in model composition and cascading predictions is measured in two applications using real data.
△ Less
Submitted 18 June, 2017; v1 submitted 8 December, 2016;
originally announced December 2016.
-
Model-Driven Data Collection for Biological Systems
Authors:
Xiao Lin,
Gabriel Terejanu
Abstract:
For biological experiments aiming at calibrating models with unknown parameters, a good experimental design is crucial, especially for those subject to various constraints, such as financial limitations, time consumption and physical practicability. In this paper, we discuss a sequential experimental design based on information theory for parameter estimation and apply it to two biological systems…
▽ More
For biological experiments aiming at calibrating models with unknown parameters, a good experimental design is crucial, especially for those subject to various constraints, such as financial limitations, time consumption and physical practicability. In this paper, we discuss a sequential experimental design based on information theory for parameter estimation and apply it to two biological systems. Two specific issues are addressed in the proposed applications, namely the determination of the optimal sampling time and the optimal choice of observable. The optimal design, either sampling time or observable, is achieved by an information-theoretic sensitivity analysis. It is shown that this is equivalent with maximizing the mutual information and contrasted with non-adaptive designs, this information theoretic strategy provides the fastest reduction of uncertainty.
△ Less
Submitted 18 July, 2014;
originally announced July 2014.
-
Validating Predictions of Unobserved Quantities
Authors:
Todd A. Oliver,
Gabriel Terejanu,
Christopher S. Simmons,
Robert D. Moser
Abstract:
The ultimate purpose of most computational models is to make predictions, commonly in support of some decision-making process (e.g., for design or operation of some system). The quantities that need to be predicted (the quantities of interest or QoIs) are generally not experimentally observable before the prediction, since otherwise no prediction would be needed. Assessing the validity of such ext…
▽ More
The ultimate purpose of most computational models is to make predictions, commonly in support of some decision-making process (e.g., for design or operation of some system). The quantities that need to be predicted (the quantities of interest or QoIs) are generally not experimentally observable before the prediction, since otherwise no prediction would be needed. Assessing the validity of such extrapolative predictions, which is critical to informed decision-making, is challenging. In classical approaches to validation, model outputs for observed quantities are compared to observations to determine if they are consistent. By itself, this consistency only ensures that the model can predict the observed quantities under the conditions of the observations. This limitation dramatically reduces the utility of the validation effort for decision making because it implies nothing about predictions of unobserved QoIs or for scenarios outside of the range of observations. However, there is no agreement in the scientific community today regarding best practices for validation of extrapolative predictions made using computational models. The purpose of this paper is to propose and explore a validation and predictive assessment process that supports extrapolative predictions for models with known sources of error. The process includes stochastic modeling, calibration, validation, and predictive assessment phases where representations of known sources of uncertainty and error are built, informed, and tested. The proposed methodology is applied to an illustrative extrapolation problem involving a misspecified nonlinear oscillator.
△ Less
Submitted 29 April, 2014;
originally announced April 2014.
-
Optimal Data Split Methodology for Model Validation
Authors:
Rebecca Morrison,
Corey Bryant,
Gabriel Terejanu,
Kenji Miki,
Serge Prudhomme
Abstract:
The decision to incorporate cross-validation into validation processes of mathematical models raises an immediate question - how should one partition the data into calibration and validation sets? We answer this question systematically: we present an algorithm to find the optimal partition of the data subject to certain constraints. While doing this, we address two critical issues: 1) that the mod…
▽ More
The decision to incorporate cross-validation into validation processes of mathematical models raises an immediate question - how should one partition the data into calibration and validation sets? We answer this question systematically: we present an algorithm to find the optimal partition of the data subject to certain constraints. While doing this, we address two critical issues: 1) that the model be evaluated with respect to predictions of a given quantity of interest and its ability to reproduce the data, and 2) that the model be highly challenged by the validation set, assuming it is properly informed by the calibration set. This framework also relies on the interaction between the experimentalist and/or modeler, who understand the physical system and the limitations of the model; the decision-maker, who understands and can quantify the cost of model failure; and the computational scientists, who strive to determine if the model satisfies both the modeler's and decision maker's requirements. We also note that our framework is quite general, and may be applied to a wide range of problems. Here, we illustrate it through a specific example involving a data reduction model for an ICCD camera from a shock-tube experiment located at the NASA Ames Research Center (ARC).
△ Less
Submitted 30 August, 2011;
originally announced August 2011.
-
Approximate Propagation of both Epistemic and Aleatory Uncertainty through Dynamic Systems
Authors:
Gabriel Terejanu,
Puneet Singla,
Tarunraj Singh,
Peter D. Scott
Abstract:
When ignorance due to the lack of knowledge, modeled as epistemic uncertainty using Dempster-Shafer structures on closed intervals, is present in the model parameters, a new uncertainty propagation method is necessary to propagate both aleatory and epistemic uncertainty. The new framework proposed here, combines both epistemic and aleatory uncertainty into a second-order uncertainty representation…
▽ More
When ignorance due to the lack of knowledge, modeled as epistemic uncertainty using Dempster-Shafer structures on closed intervals, is present in the model parameters, a new uncertainty propagation method is necessary to propagate both aleatory and epistemic uncertainty. The new framework proposed here, combines both epistemic and aleatory uncertainty into a second-order uncertainty representation which is propagated through a dynamic system driven by white noise. First, a finite parametrization is chosen to model the aleatory uncertainty by choosing a representative approximation to the probability density function conditioned on epistemic variables. The epistemic uncertainty is then propagated through the moment evolution equations of the conditional probability density function. This way we are able to model the ignorance when the knowledge about the system is incomplete. The output of the system is a Dempster-Shafer structure on sets of cumulative distributions which can be combined using different rules of combination and eventually transformed into a singleton cumulative distribution function using Smets' pignistic transformation when decision making is needed.
△ Less
Submitted 7 July, 2011;
originally announced July 2011.
-
Approximate Interval Method for Epistemic Uncertainty Propagation using Polynomial Chaos and Evidence Theory
Authors:
Gabriel Terejanu,
Puneet Singla,
Tarunraj Singh,
Peter D. Scott
Abstract:
The paper builds upon a recent approach to find the approximate bounds of a real function using Polynomial Chaos expansions. Given a function of random variables with compact support probability distributions, the intuition is to quantify the uncertainty in the response using Polynomial Chaos expansion and discard all the information provided about the randomness of the output and extract only the…
▽ More
The paper builds upon a recent approach to find the approximate bounds of a real function using Polynomial Chaos expansions. Given a function of random variables with compact support probability distributions, the intuition is to quantify the uncertainty in the response using Polynomial Chaos expansion and discard all the information provided about the randomness of the output and extract only the bounds of its compact support. To solve for the bounding range of polynomials, we transform the Polynomial Chaos expansion in the Bernstein form, and use the range enclosure property of Bernstein polynomials to find the minimum and maximum value of the response. This procedure is used to propagate Dempster-Shafer structures on closed intervals through nonlinear functions and it is applied on an algebraic challenge problem.
△ Less
Submitted 7 July, 2011;
originally announced July 2011.
-
Decision Based Uncertainty Propagation Using Adaptive Gaussian Mixtures
Authors:
Gabriel Terejanu,
Puneet Singla,
Tarunraj Singh,
Peter D. Scott
Abstract:
Given a decision process based on the approximate probability density function returned by a data assimilation algorithm, an interaction level between the decision making level and the data assimilation level is designed to incorporate the information held by the decision maker into the data assimilation process. Here the information held by the decision maker is a loss function at a decision time…
▽ More
Given a decision process based on the approximate probability density function returned by a data assimilation algorithm, an interaction level between the decision making level and the data assimilation level is designed to incorporate the information held by the decision maker into the data assimilation process. Here the information held by the decision maker is a loss function at a decision time which maps the state space onto real numbers which represent the threat associated with different possible outcomes or states. The new probability density function obtained will address the region of interest, the area in the state space with the highest threat, and will provide overall a better approximation to the true conditional probability density function within it. The approximation used for the probability density function is a Gaussian mixture and a numerical example is presented to illustrate the concept.
△ Less
Submitted 7 July, 2011;
originally announced July 2011.
-
Comparison of SCIPUFF Plume Prediction with Particle Filter Assimilated Prediction for Dipole Pride 26 Data
Authors:
Gabriel Terejanu,
Yang Cheng,
Tarunraj Singh,
Peter D. Scott
Abstract:
This paper presents the application of a particle filter for data assimilation in the context of puff-based dispersion models. Particle filters provide estimates of the higher moments, and are well suited for strongly nonlinear and/or non-Gaussian models. The Gaussian puff model SCIPUFF, is used in predicting the chemical concentration field after a chemical incident. This model is highly nonlinea…
▽ More
This paper presents the application of a particle filter for data assimilation in the context of puff-based dispersion models. Particle filters provide estimates of the higher moments, and are well suited for strongly nonlinear and/or non-Gaussian models. The Gaussian puff model SCIPUFF, is used in predicting the chemical concentration field after a chemical incident. This model is highly nonlinear and evolves with variable state dimension and, after sufficient time, high dimensionality. While the particle filter formalism naturally supports variable state dimensionality high dimensionality represents a challenge in selecting an adequate number of particles, especially for the Bootstrap version. We present an implementation of the Bootstrap particle filter and compare its performance with the SCIPUFF predictions. Both the model and the Particle Filter are evaluated on the Dipole Pride 26 experimental data. Since there is no available ground truth, the data has been divided in two sets: training and testing. We show that even with a modest number of particles, the Bootstrap particle filter provides better estimates of the concentration field compared with the process model, without excessive increase in computational complexity.
△ Less
Submitted 7 July, 2011;
originally announced July 2011.
-
Bayesian experimental design for the active nitridation of graphite by atomic nitrogen
Authors:
Gabriel Terejanu,
Rochan R. Upadhyay,
Kenji Miki
Abstract:
The problem of optimal data collection to efficiently learn the model parameters of a graphite nitridation experiment is studied in the context of Bayesian analysis using both synthetic and real experimental data. The paper emphasizes that the optimal design can be obtained as a result of an information theoretic sensitivity analysis. Thus, the preferred design is where the statistical dependence…
▽ More
The problem of optimal data collection to efficiently learn the model parameters of a graphite nitridation experiment is studied in the context of Bayesian analysis using both synthetic and real experimental data. The paper emphasizes that the optimal design can be obtained as a result of an information theoretic sensitivity analysis. Thus, the preferred design is where the statistical dependence between the model parameters and observables is the highest possible. In this paper, the statistical dependence between random variables is quantified by mutual information and estimated using a k-nearest neighbor based approximation. It is shown, that by monitoring the inference process via measures such as entropy or Kullback-Leibler divergence, one can determine when to stop the data collection process. The methodology is applied to select the most informative designs on both a simulated data set and on an experimental data set, previously published in the literature. It is also shown that the sequential Bayesian analysis used in the experimental design can also be useful in detecting conflicting information between measurements and model predictions.
△ Less
Submitted 7 July, 2011;
originally announced July 2011.
-
Application of Predictive Model Selection to Coupled Models
Authors:
Gabriel Terejanu,
Todd Oliver,
Chris Simmons
Abstract:
A predictive Bayesian model selection approach is presented to discriminate coupled models used to predict an unobserved quantity of interest (QoI). The need for accurate predictions arises in a variety of critical applications such as climate, aerospace and defense. A model problem is introduced to study the prediction yielded by the coupling of two physics/sub-components. For each single physics…
▽ More
A predictive Bayesian model selection approach is presented to discriminate coupled models used to predict an unobserved quantity of interest (QoI). The need for accurate predictions arises in a variety of critical applications such as climate, aerospace and defense. A model problem is introduced to study the prediction yielded by the coupling of two physics/sub-components. For each single physics domain, a set of model classes and a set of sensor observations are available. A goal-oriented algorithm using a predictive approach to Bayesian model selection is then used to select the combination of single physics models that best predict the QoI. It is shown that the best coupled model for prediction is the one that provides the most robust predictive distribution for the QoI.
△ Less
Submitted 5 July, 2011;
originally announced July 2011.