-
$μ$GUIDE: a framework for quantitative imaging via generalized uncertainty-driven inference using deep learning
Authors:
Maëliss Jallais,
Marco Palombo
Abstract:
This work proposes $μ$GUIDE: a general Bayesian framework to estimate posterior distributions of tissue microstructure parameters from any given biophysical model or MRI signal representation, with exemplar demonstration in diffusion-weighted MRI. Harnessing a new deep learning architecture for automatic signal feature selection combined with simulation-based inference and efficient sampling of th…
▽ More
This work proposes $μ$GUIDE: a general Bayesian framework to estimate posterior distributions of tissue microstructure parameters from any given biophysical model or MRI signal representation, with exemplar demonstration in diffusion-weighted MRI. Harnessing a new deep learning architecture for automatic signal feature selection combined with simulation-based inference and efficient sampling of the posterior distributions, $μ$GUIDE bypasses the high computational and time cost of conventional Bayesian approaches and does not rely on acquisition constraints to define model-specific summary statistics. The obtained posterior distributions allow to highlight degeneracies present in the model definition and quantify the uncertainty and ambiguity of the estimated parameters.
△ Less
Submitted 27 June, 2024; v1 submitted 28 December, 2023;
originally announced December 2023.
-
Fitting a Directional Microstructure Model to Diffusion-Relaxation MRI Data with Self-Supervised Machine Learning
Authors:
Jason P. Lim,
Stefano B. Blumberg,
Neil Narayan,
Sean C. Epstein,
Daniel C. Alexander,
Marco Palombo,
Paddy J. Slator
Abstract:
Machine learning is a powerful approach for fitting microstructural models to diffusion MRI data. Early machine learning microstructure imaging implementations trained regressors to estimate model parameters in a supervised way, using synthetic training data with known ground truth. However, a drawback of this approach is that the choice of training data impacts fitted parameter values. Self-super…
▽ More
Machine learning is a powerful approach for fitting microstructural models to diffusion MRI data. Early machine learning microstructure imaging implementations trained regressors to estimate model parameters in a supervised way, using synthetic training data with known ground truth. However, a drawback of this approach is that the choice of training data impacts fitted parameter values. Self-supervised learning is emerging as an attractive alternative to supervised learning in this context. Thus far, both supervised and self-supervised learning have typically been applied to isotropic models, such as intravoxel incoherent motion (IVIM), as opposed to models where the directionality of anisotropic structures is also estimated. In this paper, we demonstrate self-supervised machine learning model fitting for a directional microstructural model. In particular, we fit a combined T1-ball-stick model to the multidimensional diffusion (MUDI) challenge diffusion-relaxation dataset. Our self-supervised approach shows clear improvements in parameter estimation and computational time, for both simulated and in-vivo brain data, compared to standard non-linear least squares fitting. Code for the artificial neural net constructed for this study is available for public use from the following GitHub repository: https://github.com/jplte/deep-T1-ball-stick
△ Less
Submitted 5 October, 2022;
originally announced October 2022.
-
Lossy compression of multidimensional medical images using sinusoidal activation networks: an evaluation study
Authors:
Matteo Mancini,
Derek K. Jones,
Marco Palombo
Abstract:
In this work, we evaluate how neural networks with periodic activation functions can be leveraged to reliably compress large multidimensional medical image datasets, with proof-of-concept application to 4D diffusion-weighted MRI (dMRI). In the medical imaging landscape, multidimensional MRI is a key area of research for developing biomarkers that are both sensitive and specific to the underlying t…
▽ More
In this work, we evaluate how neural networks with periodic activation functions can be leveraged to reliably compress large multidimensional medical image datasets, with proof-of-concept application to 4D diffusion-weighted MRI (dMRI). In the medical imaging landscape, multidimensional MRI is a key area of research for developing biomarkers that are both sensitive and specific to the underlying tissue microstructure. However, the high-dimensional nature of these data poses a challenge in terms of both storage and sharing capabilities and associated costs, requiring appropriate algorithms able to represent the information in a low-dimensional space. Recent theoretical developments in deep learning have shown how periodic activation functions are a powerful tool for implicit neural representation of images and can be used for compression of 2D images. Here we extend this approach to 4D images and show how any given 4D dMRI dataset can be accurately represented through the parameters of a sinusoidal activation network, achieving a data compression rate about 10 times higher than the standard DEFLATE algorithm. Our results show that the proposed approach outperforms benchmark ReLU and Tanh activation perceptron architectures in terms of mean squared error, peak signal-to-noise ratio and structural similarity index. Subsequent analyses using the tensor and spherical harmonics representations demonstrate that the proposed lossy compression reproduces accurately the characteristics of the original data, leading to relative errors about 5 to 10 times lower than the benchmark JPEG2000 lossy compression and similar to standard pre-processing steps such as MP-PCA denosing, suggesting a loss of information within the currently accepted levels for clinical application.
△ Less
Submitted 3 August, 2022; v1 submitted 2 August, 2022;
originally announced August 2022.
-
Multi-Stage Prediction Networks for Data Harmonization
Authors:
Stefano B. Blumberg,
Marco Palombo,
Can Son Khoo,
Chantal M. W. Tax,
Ryutaro Tanno,
Daniel C. Alexander
Abstract:
In this paper, we introduce multi-task learning (MTL) to data harmonization (DH); where we aim to harmonize images across different acquisition platforms and sites. This allows us to integrate information from multiple acquisitions and improve the predictive performance and learning efficiency of the harmonization model. Specifically, we introduce the Multi Stage Prediction (MSP) Network, a MTL fr…
▽ More
In this paper, we introduce multi-task learning (MTL) to data harmonization (DH); where we aim to harmonize images across different acquisition platforms and sites. This allows us to integrate information from multiple acquisitions and improve the predictive performance and learning efficiency of the harmonization model. Specifically, we introduce the Multi Stage Prediction (MSP) Network, a MTL framework that incorporates neural networks of potentially disparate architectures, trained for different individual acquisition platforms, into a larger architecture that is refined in unison. The MSP utilizes high-level features of single networks for individual tasks, as inputs of additional neural networks to inform the final prediction, therefore exploiting redundancy across tasks to make the most of limited training data. We validate our methods on a dMRI harmonization challenge dataset, where we predict three modern platform types, from one obtained from an old scanner. We show how MTL architectures, such as the MSP, produce around 20\% improvement of patch-based mean-squared error over current state-of-the-art methods and that our MSP outperforms off-the-shelf MTL networks. Our code is available https://github.com/sbb-gh/ .
△ Less
Submitted 26 July, 2019;
originally announced July 2019.
-
A generative model of realistic brain cells with application to numerical simulation of diffusion-weighted MR signal
Authors:
Marco Palombo,
Daniel C. Alexander,
Hui Zhang
Abstract:
In this work, we introduce a novel computational framework that we developed to use numerical simulations to investigate the complexity of brain tissue at a microscopic level with a detail never realised before. Directly inspired by the advances in computational neuroscience for modelling brain cells, we propose a generative model that enables us to simulate molecular diffusion within realistic di…
▽ More
In this work, we introduce a novel computational framework that we developed to use numerical simulations to investigate the complexity of brain tissue at a microscopic level with a detail never realised before. Directly inspired by the advances in computational neuroscience for modelling brain cells, we propose a generative model that enables us to simulate molecular diffusion within realistic digitalised brain cells, such as neurons and glia, in a completely controlled and flexible fashion. We validate our new approach by showing an excellent match between the morphology and simulated DW-MR signal of the generated digital model of brain cells and those of digital reconstruction of real brain cells from available open-access databases. We demonstrate the versatility and potentiality of the framework by showing a select set of examples of relevance for the DW-MR community. Further development is ongoing, which will support even more realistic conditions like dense packing of numerous 3D complex cell structures and varying cell surface permeability.
△ Less
Submitted 19 June, 2018;
originally announced June 2018.
