-
Density regression via Dirichlet process mixtures of normal structured additive regression models
Authors:
María Xosé Rodríguez-Álvarez,
Vanda Inácio,
Nadja Klein
Abstract:
Within Bayesian nonparametrics, dependent Dirichlet process mixture models provide a highly flexible approach for conducting inference about the conditional density function. However, several formulations of this class make either rather restrictive modelling assumptions or involve intricate algorithms for posterior inference, thus preventing their widespread use. In response to these challenges,…
▽ More
Within Bayesian nonparametrics, dependent Dirichlet process mixture models provide a highly flexible approach for conducting inference about the conditional density function. However, several formulations of this class make either rather restrictive modelling assumptions or involve intricate algorithms for posterior inference, thus preventing their widespread use. In response to these challenges, we present a flexible, versatile, and computationally tractable model for density regression based on a single-weights dependent Dirichlet process mixture of normal distributions model for univariate continuous responses. We assume an additive structure for the mean of each mixture component and incorporate the effects of continuous covariates through smooth nonlinear functions. The key components of our modelling approach are penalised B-splines and their bivariate tensor product extension. Our proposed method also seamlessly accommodates parametric effects of categorical covariates, linear effects of continuous covariates, interactions between categorical and/or continuous covariates, varying coefficient terms, and random effects, which is why we refer our model as a Dirichlet process mixture of normal structured additive regression models. A noteworthy feature of our method is its efficiency in posterior simulation through Gibbs sampling, as closed-form full conditional distributions for all model parameters are available. Results from a simulation study demonstrate that our approach successfully recovers true conditional densities and other regression functionals in various challenging scenarios. Applications to a toxicology, disease diagnosis, and agricultural study are provided and further underpin the broad applicability of our modelling framework. An R package, DDPstar, implementing the proposed method is publicly available at https://bitbucket.org/mxrodriguez/ddpstar.
△ Less
Submitted 13 May, 2024; v1 submitted 8 January, 2024;
originally announced January 2024.
-
A study on group fairness in healthcare outcomes for nursing home residents during the COVID-19 pandemic in the Basque Country
Authors:
Hristo Inouzhe,
Irantzu Barrio,
Paula Gordaliza,
María Xosé Rodríguez-Álvarez,
Itxaso Bengoechea,
José María Quintana
Abstract:
We explore the effect of nursing home status on healthcare outcomes such as hospitalisation, mortality and in-hospital mortality during the COVID-19 pandemic. Some claim that in specific Autonomous Communities (geopolitical divisions) in Spain, elderly people in nursing homes had restrictions on access to hospitals and treatments, which raised a public outcry about the fairness of such measures. I…
▽ More
We explore the effect of nursing home status on healthcare outcomes such as hospitalisation, mortality and in-hospital mortality during the COVID-19 pandemic. Some claim that in specific Autonomous Communities (geopolitical divisions) in Spain, elderly people in nursing homes had restrictions on access to hospitals and treatments, which raised a public outcry about the fairness of such measures. In this work, the case of the Basque Country is studied under a rigorous statistical approach and a physician's perspective. As fairness/unfairness is hard to model mathematically and has strong real-world implications, this work concentrates on the following simplification: establishing if the nursing home status had a direct effect on healthcare outcomes once accounted for other meaningful patients' information such as age, health status and period of the pandemic, among others. The methods followed here are a combination of established techniques as well as new proposals from the fields of causality and fair learning. The current analysis suggests that as a group, people in nursing homes were significantly less likely to be hospitalised, and considerably more likely to die, even in hospitals, compared to their non-residents counterparts during most of the pandemic. Further data collection and analysis are needed to guarantee that this is solely/mainly due to nursing home status.
△ Less
Submitted 16 June, 2023;
originally announced June 2023.
-
Dynamic SIR/SEIR-like models comprising a time-dependent transmission rate: Hamiltonian Monte Carlo approach with applications to COVID-19
Authors:
Hristo Inouzhe,
María Xosé Rodríguez-Álvarez,
Lorenzo Nagar,
Elena Akhmatskaya
Abstract:
A study of changes in the transmission of a disease, in particular, a new disease like COVID-19, requires very flexible models which can capture, among others, the effects of non-pharmacological and pharmacological measures, changes in population behaviour and random events. In this work, we give priority to data-driven approaches and choose to avoid a priori and ad-hoc methods. We introduce a gen…
▽ More
A study of changes in the transmission of a disease, in particular, a new disease like COVID-19, requires very flexible models which can capture, among others, the effects of non-pharmacological and pharmacological measures, changes in population behaviour and random events. In this work, we give priority to data-driven approaches and choose to avoid a priori and ad-hoc methods. We introduce a generalised family of epidemiologically informed mechanistic models, guided by Ordinary Differential Equations and embedded in a probabilistic model. The mechanistic models SIKR and SEMIKR with K Infectious and M Exposed sub-compartments (resulting in non-exponential infectious and exposed periods) are enriched with a time-dependent transmission rate, parametrized using Bayesian P-splines. This enables an extensive flexibility in the transmission dynamics, with no ad-hoc intervention, while maintaining good differentiability properties. Our probabilistic model relies on the solutions of the mechanistic model and benefits from access to the information about under-reporting of new infected cases, a crucial property when studying diseases with a large fraction of asymptomatic infections. Such a model can be efficiently differentiated, which facilitates the use of Hamiltonian Monte Carlo for sampling from the posterior distribution of the model parameters. The features and advantages of the proposed approach are demonstrated through comparison with state-of-the-art methods using a synthetic dataset. Furthermore, we successfully apply our methodology to the study of the transmission dynamics of COVID-19 in the Basque Country (Spain) for almost a year, from mid February 2020 to the end of January 2021.
△ Less
Submitted 16 January, 2023;
originally announced January 2023.
-
Multidimensional Adaptive Penalised Splines with Application to Neurons' Activity Studies
Authors:
María Xosé Rodríguez-Álvarez,
María Durbán,
Paul H. C. Eilers,
Dae-Jin Lee,
Francisco Gonzalez
Abstract:
P-spline models have achieved great popularity both in statistical and in applied research. A possible drawback of P-spline is that they assume a smooth transition of the covariate effect across its whole domain. In some practical applications, however, it is desirable and needed to adapt smoothness locally to the data, and adaptive P-splines have been suggested. Yet, the extra flexibility afforde…
▽ More
P-spline models have achieved great popularity both in statistical and in applied research. A possible drawback of P-spline is that they assume a smooth transition of the covariate effect across its whole domain. In some practical applications, however, it is desirable and needed to adapt smoothness locally to the data, and adaptive P-splines have been suggested. Yet, the extra flexibility afforded by adaptive P-spline models is obtained at the cost of a high computational burden, especially in a multidimensional setting. Furthermore, to the best of our knowledge, the literature lacks proposals for adaptive P-splines in more than two dimensions. Motivated by the need for analysing data derived from experiments conducted to study neurons' activity in the visual cortex, this work presents a novel locally adaptive anisotropic P-spline model in two (e.g., space) and three (space and time) dimensions. Estimation is based on the recently proposed SOP (Separation of Overlapping Precision matrices) method, which provides the speed we look for. The practical performance of the proposal is evaluated through simulations, and comparisons with alternative methods are reported. In addition to the spatio-temporal analysis of the data that motivated this work, we also discuss an application in two dimensions on the absenteeism of workers.
△ Less
Submitted 1 December, 2020; v1 submitted 8 October, 2020;
originally announced October 2020.
-
Statistical Evaluation of Medical Tests
Authors:
Vanda Inacio,
Maria Xose Rodriguez-Alvarez,
Pilar Gayoso-Diz
Abstract:
In this review, we present an overview of the main aspects related to the statistical evaluation of medical tests for diagnosis and prognosis. Measures of diagnostic performance for binary tests, such as sensitivity, specificity, and predictive values, are introduced, and extensions to the case of continuous-outcome tests are detailed. Special focus is placed on the receiver operating characterist…
▽ More
In this review, we present an overview of the main aspects related to the statistical evaluation of medical tests for diagnosis and prognosis. Measures of diagnostic performance for binary tests, such as sensitivity, specificity, and predictive values, are introduced, and extensions to the case of continuous-outcome tests are detailed. Special focus is placed on the receiver operating characteristic (ROC) curve and its estimation, with the topic of covariate adjustment receiving a great deal of attention. The extension to the case of time-dependent ROC curves for evaluating prognostic accuracy is also touched upon. We apply several of the approaches described to a dataset derived from a study aimed to evaluate the ability of HOMA-IR (homeostasis model assessment of insulin resistance) levels to identify individuals at high cardio-metabolic risk and how such discriminatory ability might be influenced by age and gender. We also outline software available for the implementation of the methods.
△ Less
Submitted 15 July, 2020;
originally announced July 2020.
-
ROCnReg: An R Package for Receiver Operating Characteristic Curve Inference with and without Covariate Information
Authors:
Maria Xose Rodriguez-Alvarez,
Vanda Inacio
Abstract:
The receiver operating characteristic (ROC) curve is the most popular tool used to evaluate the discriminatory capability of diagnostic tests/biomarkers measured on a continuous scale when distinguishing between two alternative disease states (e.g, diseased and nondiseased). In some circumstances, the test's performance and its discriminatory ability may vary according to subject-specific characte…
▽ More
The receiver operating characteristic (ROC) curve is the most popular tool used to evaluate the discriminatory capability of diagnostic tests/biomarkers measured on a continuous scale when distinguishing between two alternative disease states (e.g, diseased and nondiseased). In some circumstances, the test's performance and its discriminatory ability may vary according to subject-specific characteristics or different test settings. In such cases, information-specific accuracy measures, such as the covariate-specific and the covariate-adjusted ROC curve are needed, as ignoring covariate information may lead to biased or erroneous results. This paper introduces the R package ROCnReg that allows estimating the pooled (unadjusted) ROC curve, the covariate-specific ROC curve, and the covariate-adjusted ROC curve by different methods, both from (semi) parametric and nonparametric perspectives and within Bayesian and frequentist paradigms. From the estimated ROC curve (pooled, covariate-specific or covariate-adjusted), several summary measures of accuracy, such as the (partial) area under the ROC curve and the Youden index, can be obtained. The package also provides functions to obtain ROC-based optimal threshold values using several criteria, namely, the Youden Index criterion and the criterion that sets a target value for the false positive fraction. For the Bayesian methods, we provide tools for assessing model fit via posterior predictive checks, while model choice can be carried out via several information criteria. Numerical and graphical outputs are provided for all methods. The package is illustrated through the analyses of data from an endocrine study where the aim is to assess the capability of the body mass index to detect the presence or absence of cardiovascular disease risk factors. The package is available from CRAN at https://CRAN.R-project.org/package=ROCnReg.
△ Less
Submitted 19 March, 2021; v1 submitted 29 March, 2020;
originally announced March 2020.
-
Bayesian nonparametric inference for the covariate-adjusted ROC curve
Authors:
Vanda Inacio de Carvalho,
Maria Xose Rodriguez-Alvarez
Abstract:
Accurate diagnosis of disease is of fundamental importance in clinical practice and medical research. Before a medical diagnostic test is routinely used in practice, its ability to distinguish between diseased and nondiseased states must be rigorously assessed through statistical analysis. The receiver operating characteristic (ROC) curve is the most popular used tool for evaluating the discrimina…
▽ More
Accurate diagnosis of disease is of fundamental importance in clinical practice and medical research. Before a medical diagnostic test is routinely used in practice, its ability to distinguish between diseased and nondiseased states must be rigorously assessed through statistical analysis. The receiver operating characteristic (ROC) curve is the most popular used tool for evaluating the discriminatory ability of continuous-outcome diagnostic tests. It has been acknowledged that several factors (e.g., subject-specific characteristics, such as age and/or gender) can affect the test's accuracy beyond disease status. Recently, the covariate-adjusted ROC curve has been proposed and successfully applied as a global summary measure of diagnostic accuracy that takes covariate information into account. We motivate the use of the covariate-adjusted ROC curve and develop a highly robust model based on a combination of B-splines dependent Dirichlet process mixture models and the Bayesian bootstrap. Multiple simulation studies demonstrate the ability of our model to successfully recover the true covariate-adjusted ROC curve and to produce valid inferences in a variety of complex scenarios. Our methods are motivated by and applied to an endocrine study where the main goal is to assess the accuracy of the body mass index, adjusted for age and gender, for predicting clusters of cardiovascular disease risk factors. The R-package AROC, implementing our proposed methods, is provided.
△ Less
Submitted 30 May, 2018;
originally announced June 2018.
-
On the estimation of variance parameters in non-standard generalised linear mixed models: Application to penalised smoothing
Authors:
María Xosé Rodríguez-Álvarez,
Maria Durban,
Dae-Jin Lee,
Paul H. C. Eilers
Abstract:
We present a novel method for the estimation of variance parameters in generalised linear mixed models. The method has its roots in Harville (1977)'s work, but it is able to deal with models that have a precision matrix for the random-effect vector that is linear in the inverse of the variance parameters (i.e., the precision parameters). We call the method SOP (Separation of Overlapping Precision…
▽ More
We present a novel method for the estimation of variance parameters in generalised linear mixed models. The method has its roots in Harville (1977)'s work, but it is able to deal with models that have a precision matrix for the random-effect vector that is linear in the inverse of the variance parameters (i.e., the precision parameters). We call the method SOP (Separation of Overlapping Precision matrices). SOP is based on applying the method of successive approximations to easy-to-compute estimate updates of the variance parameters. These estimate updates have an appealing form: they are the ratio of a (weighted) sum of squares to a quantity related to effective degrees of freedom. We provide the sufficient and necessary conditions for these estimates to be strictly positive. An important application field of SOP is penalised regression estimation of models where multiple quadratic penalties act on the same regression coefficients. We discuss in detail two of those models: penalised splines for locally adaptive smoothness and for hierarchical curve data. Several data examples in these settings are presented.
△ Less
Submitted 12 June, 2018; v1 submitted 22 January, 2018;
originally announced January 2018.
-
Fast estimation of multidimensional adaptive P-spline models
Authors:
María Xosé Rodríguez-Álvarez,
María Durbán,
Dae-Jin Lee,
Paul H. C. Eilers
Abstract:
A fast and stable algorithm for estimating multidimensional adaptive P-spline models is presented. We call it as Separation of Overlapping Penalties (SOP) as it is an extension of the \textit{Separation of Anisotropic Penalties} (SAP) algorithm. SAP was originally derived for the estimation of the smoothing parameters of a multidimensional tensor product P-spline model with anisotropic penalties.
A fast and stable algorithm for estimating multidimensional adaptive P-spline models is presented. We call it as Separation of Overlapping Penalties (SOP) as it is an extension of the \textit{Separation of Anisotropic Penalties} (SAP) algorithm. SAP was originally derived for the estimation of the smoothing parameters of a multidimensional tensor product P-spline model with anisotropic penalties.
△ Less
Submitted 21 October, 2016;
originally announced October 2016.
-
Spatio-temporal adaptive penalized splines with application to Neuroscience
Authors:
María Xosé Rodríguez-Álvarez,
María Durbán,
Dae-Jin Lee,
Paul H. C. Eilers
Abstract:
Data analysed here derive from experiments conducted to study neurons' activity in the visual cortex of behaving monkeys. We consider a spatio-temporal adaptive penalized spline (P-spline) approach for modelling the firing rate of visual neurons. To the best of our knowledge, this is the first attempt in the statistical literature for locally adaptive smoothing in three dimensions. Estimation is b…
▽ More
Data analysed here derive from experiments conducted to study neurons' activity in the visual cortex of behaving monkeys. We consider a spatio-temporal adaptive penalized spline (P-spline) approach for modelling the firing rate of visual neurons. To the best of our knowledge, this is the first attempt in the statistical literature for locally adaptive smoothing in three dimensions. Estimation is based on the Separation of Overlapping Penalties (SOP) algorithm, which provides the stability and speed we look for.
△ Less
Submitted 30 December, 2016; v1 submitted 21 October, 2016;
originally announced October 2016.
-
Spatial Models for Field Trials
Authors:
María Xosé Rodríguez-Álvarez,
Martin P. Boer,
Fred A. van Eeuwijk,
Paul H. C. Eilers
Abstract:
An important aim of the analysis of agricultural field trials is to obtain good predictions for genotypic performance, by correcting for spatial effects. In practice these corrections turn out to be complicated, since there can be different types of spatial effects; those due to management interventions applied to the field plots and those due to various kinds of erratic spatial trends. This paper…
▽ More
An important aim of the analysis of agricultural field trials is to obtain good predictions for genotypic performance, by correcting for spatial effects. In practice these corrections turn out to be complicated, since there can be different types of spatial effects; those due to management interventions applied to the field plots and those due to various kinds of erratic spatial trends. This paper presents models for field trials in which the random spatial component consists of tensor product Penalized splines (P-splines). A special ANOVA-type reformulation leads to five smooth additive spatial components, which form the basis of a mixed model with five unknown variance components. On top of this spatial field, effects of genotypes, blocks, replicates, and/or other sources of spatial variation are described by a mixed model in a standard way. We show the relation between several definitions of heritability and the effective dimension or the effective degrees of freedom associated to the genetic component. The approach is illustrated with large-scale field trial experiments. An R-package is provided.
△ Less
Submitted 27 July, 2016;
originally announced July 2016.