-
Task-Driven Uncertainty Quantification in Inverse Problems via Conformal Prediction
Authors:
Jeffrey Wen,
Rizwan Ahmad,
Philip Schniter
Abstract:
In imaging inverse problems, one seeks to recover an image from missing/corrupted measurements. Because such problems are ill-posed, there is great motivation to quantify the uncertainty induced by the measurement-and-recovery process. Motivated by applications where the recovered image is used for a downstream task, such as soft-output classification, we propose a task-centered approach to uncert…
▽ More
In imaging inverse problems, one seeks to recover an image from missing/corrupted measurements. Because such problems are ill-posed, there is great motivation to quantify the uncertainty induced by the measurement-and-recovery process. Motivated by applications where the recovered image is used for a downstream task, such as soft-output classification, we propose a task-centered approach to uncertainty quantification. In particular, we use conformal prediction to construct an interval that is guaranteed to contain the task output from the true image up to a user-specified probability, and we use the width of that interval to quantify the uncertainty contributed by measurement-and-recovery. For posterior-sampling-based image recovery, we construct locally adaptive prediction intervals. Furthermore, we propose to collect measurements over multiple rounds, stopping as soon as the task uncertainty falls below an acceptable level. We demonstrate our methodology on accelerated magnetic resonance imaging (MRI): https://github.com/jwen307/TaskUQ.
△ Less
Submitted 11 July, 2024; v1 submitted 28 May, 2024;
originally announced May 2024.
-
Coil Reweighting to Suppress Motion Artifacts in Real-Time Exercise Cine Imaging
Authors:
Chong Chen,
Yingmin Liu,
Yu Ding,
Matthew Tong,
Preethi Chandrasekaran,
Christopher Crabtree,
Syed M. Arshad,
Yuchi Han,
Rizwan Ahmad
Abstract:
Background: Accelerated real-time cine (RT-Cine) imaging enables cardiac function assessment without the need for breath-holding. However, when performed during in-magnet exercise, RT-Cine images may exhibit significant motion artifacts. Methods: By projecting the time-averaged images to the subspace spanned by the coil sensitivity maps, we propose a coil reweighting (CR) method to automatically s…
▽ More
Background: Accelerated real-time cine (RT-Cine) imaging enables cardiac function assessment without the need for breath-holding. However, when performed during in-magnet exercise, RT-Cine images may exhibit significant motion artifacts. Methods: By projecting the time-averaged images to the subspace spanned by the coil sensitivity maps, we propose a coil reweighting (CR) method to automatically suppress a subset of receive coils that introduces a high level of artifacts in the reconstructed image. RT-Cine data collected at rest and during exercise from ten healthy volunteers and six patients were utilized to assess the performance of the proposed method. One short-axis and one two-chamber RT-Cine series reconstructed with and without CR from each subject were visually scored by two cardiologists in terms of the level of artifacts on a scale of 1 (worst) to 5 (best). Results: For healthy volunteers, applying CR to RT-Cine images collected at rest did not significantly change the image quality score (p=1). In contrast, for RT-Cine images collected during exercise, CR significantly improved the score from 3.9 to 4.68 (p<0.001). Similarly, in patients, CR did not significantly change the score for images collected at rest (p=0.031) but markedly improved the score from 3.15 to 4.42 (p<0.001) for images taken during exercise. Despite lower image quality scores in the patient cohort compared to healthy subjects, likely due to larger body habitus and the difficulty of limiting body motion during exercise, CR effectively suppressed motion artifacts, with all image series from the patient cohort receiving a score of four or higher. Conclusion: Using data from healthy subjects and patients, we demonstrate that the motion artifacts in the reconstructed RT-Cine images can be effectively suppressed significantly with the proposed CR method.
△ Less
Submitted 26 May, 2024;
originally announced May 2024.
-
Accelerated Real-time Cine and Flow under In-magnet Staged Exercise
Authors:
Preethi Chandrasekaran,
Chong Chen,
Yingmin Liu,
Syed Murtaza Arshad,
Christopher Crabtree,
Matthew Tong,
Yuchi Han,
Rizwan Ahmad
Abstract:
Background: Cardiovascular magnetic resonance imaging (CMR) is a wellestablished imaging tool for diagnosing and managing cardiac conditions. The integration of exercise stress with CMR (ExCMR) can enhance its diagnostic capacity. Despite recent advances in CMR technology, quantitative ExCMR during exercise remains technically challenging due to motion artifacts and limited spatial and temporal re…
▽ More
Background: Cardiovascular magnetic resonance imaging (CMR) is a wellestablished imaging tool for diagnosing and managing cardiac conditions. The integration of exercise stress with CMR (ExCMR) can enhance its diagnostic capacity. Despite recent advances in CMR technology, quantitative ExCMR during exercise remains technically challenging due to motion artifacts and limited spatial and temporal resolution. Methods: This study investigated the feasibility of biventricular functional and hemodynamic assessment using real-time (RT) ExCMR during a staged exercise protocol in 24 healthy volunteers. We applied a coil reweighting technique and employed high acceleration rates to minimize motion blurring and artifacts. We further applied a beat-selection technique that identified beats from the endexpiratory phase to minimize the impact of respiration-induced through-plane motion. Additionally, results from six patients were presented to demonstrate clinical feasibility. Results: Our findings indicated a consistent decrease in end-systolic volume and stable end-diastolic volume across exercise intensities, leading to increased stroke volume and ejection fraction. The selection of end-expiratory beats enhanced the repeatability of cardiac function parameters, as shown by scan-rescan tests in nine volunteers. High scores from a blinded image quality assessment indicated that coil reweighting effectively minimized motion artifacts. Conclusions: This study demonstrated the feasibility of RT ExCMR with inmagnet exercise in healthy subjects and patients. Our results indicate that high acceleration rates, coil reweighting, and selection of respiratory phase-specific heartbeats enhance image quality and repeatability of quantitative RT ExCMR.
△ Less
Submitted 21 May, 2024; v1 submitted 27 February, 2024;
originally announced February 2024.
-
Progressive unsupervised domain adaptation for ASR using ensemble models and multi-stage training
Authors:
Rehan Ahmad,
Muhammad Umar Farooq,
Thomas Hain
Abstract:
In Automatic Speech Recognition (ASR), teacher-student (T/S) training has shown to perform well for domain adaptation with small amount of training data. However, adaption without ground-truth labels is still challenging. A previous study has shown the effectiveness of using ensemble teacher models in T/S training for unsupervised domain adaptation (UDA) but its performance still lags behind compa…
▽ More
In Automatic Speech Recognition (ASR), teacher-student (T/S) training has shown to perform well for domain adaptation with small amount of training data. However, adaption without ground-truth labels is still challenging. A previous study has shown the effectiveness of using ensemble teacher models in T/S training for unsupervised domain adaptation (UDA) but its performance still lags behind compared to the model trained on in-domain data. This paper proposes a method to yield better UDA by training multi-stage students with ensemble teacher models. Initially, multiple teacher models are trained on labelled data from read and meeting domains. These teachers are used to train a student model on unlabelled out-of-domain telephone speech data. To improve the adaptation, subsequent student models are trained sequentially considering previously trained model as their teacher. Experiments are conducted with three teachers trained on AMI, WSJ and LibriSpeech and three stages of students on SwitchBoard data. Results shown on eval00 test set show significant WER improvement with multi-stage training with an absolute gain of 9.8%, 7.7% and 3.3% at each stage.
△ Less
Submitted 7 February, 2024;
originally announced February 2024.
-
Deep Image prior with StruCtUred Sparsity (DISCUS) for dynamic MRI reconstruction
Authors:
Muhammad A. Sultan,
Chong Chen,
Yingmin Liu,
Xuan Lei,
Rizwan Ahmad
Abstract:
High-quality training data are not always available in dynamic MRI. To address this, we propose a self-supervised deep learning method called deep image prior with structured sparsity (DISCUS) for reconstructing dynamic images. DISCUS is inspired by deep image prior (DIP) and recovers a series of images through joint optimization of network parameters and input code vectors. However, DISCUS additi…
▽ More
High-quality training data are not always available in dynamic MRI. To address this, we propose a self-supervised deep learning method called deep image prior with structured sparsity (DISCUS) for reconstructing dynamic images. DISCUS is inspired by deep image prior (DIP) and recovers a series of images through joint optimization of network parameters and input code vectors. However, DISCUS additionally encourages group sparsity on frame-specific code vectors to discover the low-dimensional manifold that describes temporal variations across frames. Compared to prior work on manifold learning, DISCUS does not require specifying the manifold dimensionality. We validate DISCUS using three numerical studies. In the first study, we simulate a dynamic Shepp-Logan phantom with frames undergoing random rotations, translations, or both, and demonstrate that DISCUS can discover the dimensionality of the underlying manifold. In the second study, we use data from a realistic late gadolinium enhancement (LGE) phantom to compare DISCUS with compressed sensing (CS) and DIP, and to demonstrate the positive impact of group sparsity. In the third study, we use retrospectively undersampled single-shot LGE data from five patients to compare DISCUS with CS reconstructions. The results from these studies demonstrate that DISCUS outperforms CS and DIP, and that enforcing group sparsity on the code vectors helps discover true manifold dimensionality and provides additional performance gain.
△ Less
Submitted 24 May, 2024; v1 submitted 1 December, 2023;
originally announced December 2023.
-
Surface Coil Intensity Correction for MRI
Authors:
Xuan Lei,
Philip Schniter,
Chong Chen,
Muhammad A. Sultan,
Rizwan Ahmad
Abstract:
Modern MRI scanners utilize one or more arrays of small receive-only coils to collect k-space data. The sensitivity maps of the coils, when estimated using traditional methods, differ from the true sensitivity maps, which are generally unknown. Consequently, the reconstructed MR images exhibit undesired spatial variation in intensity. These intensity variations can be at least partially corrected…
▽ More
Modern MRI scanners utilize one or more arrays of small receive-only coils to collect k-space data. The sensitivity maps of the coils, when estimated using traditional methods, differ from the true sensitivity maps, which are generally unknown. Consequently, the reconstructed MR images exhibit undesired spatial variation in intensity. These intensity variations can be at least partially corrected using pre-scan data. In this work, we propose an intensity correction method that utilizes pre-scan data. For demonstration, we apply our method to a digital phantom, as well as to cardiac MRI data collected on a commercial scanner by Siemens Healthineers. The code is available at https://github.com/OSU-MR/SCC.
△ Less
Submitted 24 May, 2024; v1 submitted 1 December, 2023;
originally announced December 2023.
-
MUST: A Multilingual Student-Teacher Learning approach for low-resource speech recognition
Authors:
Muhammad Umar Farooq,
Rehan Ahmad,
Thomas Hain
Abstract:
Student-teacher learning or knowledge distillation (KD) has been previously used to address data scarcity issue for training of speech recognition (ASR) systems. However, a limitation of KD training is that the student model classes must be a proper or improper subset of the teacher model classes. It prevents distillation from even acoustically similar languages if the character sets are not same.…
▽ More
Student-teacher learning or knowledge distillation (KD) has been previously used to address data scarcity issue for training of speech recognition (ASR) systems. However, a limitation of KD training is that the student model classes must be a proper or improper subset of the teacher model classes. It prevents distillation from even acoustically similar languages if the character sets are not same. In this work, the aforementioned limitation is addressed by proposing a MUltilingual Student-Teacher (MUST) learning which exploits a posteriors mapping approach. A pre-trained mapping model is used to map posteriors from a teacher language to the student language ASR. These mapped posteriors are used as soft labels for KD learning. Various teacher ensemble schemes are experimented to train an ASR model for low-resource languages. A model trained with MUST learning reduces relative character error rate (CER) up to 9.5% in comparison with a baseline monolingual ASR.
△ Less
Submitted 28 October, 2023;
originally announced October 2023.
-
Motion-robust free-running volumetric cardiovascular MRI
Authors:
Syed M. Arshad,
Lee C. Potter,
Chong Chen,
Yingmin Liu,
Preethi Chandrasekaran,
Christopher Crabtree,
Matthew S. Tong,
Orlando P. Simonetti,
Yuchi Han,
Rizwan Ahmad
Abstract:
PURPOSE: To present and assess an outlier mitigation method that makes free-running volumetric cardiovascular MRI (CMR) more robust to motion.
METHODS: The proposed method, called compressive recovery with outlier rejection (CORe), models outliers in the measured data as an additive auxiliary variable. We enforce MR physics-guided group sparsity on the auxiliary variable, and jointly estimate it…
▽ More
PURPOSE: To present and assess an outlier mitigation method that makes free-running volumetric cardiovascular MRI (CMR) more robust to motion.
METHODS: The proposed method, called compressive recovery with outlier rejection (CORe), models outliers in the measured data as an additive auxiliary variable. We enforce MR physics-guided group sparsity on the auxiliary variable, and jointly estimate it along with the image using an iterative algorithm. For evaluation, CORe is first compared to traditional compressed sensing (CS), robust regression (RR), and an existing outlier rejection method using two simulation studies. Then, CORe is compared to CS using seven three-dimensional (3D) cine, 12 rest four-dimensional (4D) flow, and eight stress 4D flow imaging datasets.
RESULTS: Our simulation studies show that CORe outperforms CS, RR, and the existing outlier rejection method in terms of normalized mean square error and structural similarity index across 55 different realizations. The expert reader evaluation of 3D cine images demonstrates that CORe is more effective in suppressing artifacts while maintaining or improving image sharpness. Finally, 4D flow images show that CORe yields more reliable and consistent flow measurements, especially in the presence of involuntary subject motion or exercise stress.
CONCLUSION: An outlier rejection method is presented and tested using simulated and measured data. This method can help suppress motion artifacts in a wide range of free-running CMR applications.
CODE & DATA: Implementation code and datasets are available on GitHub at http://github.com/OSU-MR/motion-robust-CMR
△ Less
Submitted 24 June, 2024; v1 submitted 3 August, 2023;
originally announced August 2023.
-
A Conditional Normalizing Flow for Accelerated Multi-Coil MR Imaging
Authors:
Jeffrey Wen,
Rizwan Ahmad,
Philip Schniter
Abstract:
Accelerated magnetic resonance (MR) imaging attempts to reduce acquisition time by collecting data below the Nyquist rate. As an ill-posed inverse problem, many plausible solutions exist, yet the majority of deep learning approaches generate only a single solution. We instead focus on sampling from the posterior distribution, which provides more comprehensive information for downstream inference t…
▽ More
Accelerated magnetic resonance (MR) imaging attempts to reduce acquisition time by collecting data below the Nyquist rate. As an ill-posed inverse problem, many plausible solutions exist, yet the majority of deep learning approaches generate only a single solution. We instead focus on sampling from the posterior distribution, which provides more comprehensive information for downstream inference tasks. To do this, we design a novel conditional normalizing flow (CNF) that infers the signal component in the measurement operator's nullspace, which is later combined with measured data to form complete images. Using fastMRI brain and knee data, we demonstrate fast inference and accuracy that surpasses recent posterior sampling techniques for MRI. Code is available at https://github.com/jwen307/mri_cnf/
△ Less
Submitted 2 June, 2023;
originally announced June 2023.
-
Programmable Transimpedance Amplifier with Integrated Bandgap Reference for Glucose Concentration Measurement
Authors:
Riyaz Ahmad,
Amit M. Joshi,
Dharmendra Boolchandani
Abstract:
For glucose electrochemical sensors, a comprehensive electronics interface is designed and constructed in 0.18 um, CMOS process technology, and 1.5 V supply voltage. This interface includes a programmable readout amplifier and bandgap reference voltage potentiostat circuit. The programmable transimpedance amplifier (PTIA), the proposed readout circuit, provides a large dynamic range and low noise.…
▽ More
For glucose electrochemical sensors, a comprehensive electronics interface is designed and constructed in 0.18 um, CMOS process technology, and 1.5 V supply voltage. This interface includes a programmable readout amplifier and bandgap reference voltage potentiostat circuit. The programmable transimpedance amplifier (PTIA), the proposed readout circuit, provides a large dynamic range and low noise. The overall transimpedance increase for the PTIA is 17.3-50.5 kohm. For an input current range of 4.2-180 uA, the PTIA response has a linear output voltage range of 0.55-1.44 V. The output rms noise value is calculated to be 5.101 Vrms, and the overall power consumption of the design is 2.33 mW. The THD percentage spans from 7.6 to 10.2 in the current range mentioned above. All bandgap reference voltage potentiostat measurements are made using the reference potential of 0.6 V. The working electrode was a glassy carbon electrode (GCE) loaded with a CuO/Cu0:76CO2:25O4 (copper cobaltite) coating. An electrochemical glucose sensing setup has been used to measure glucose concentrations between 1 and 10 mM, and an emulated circuit has been used to verify the viability of the proposed glucose sensing design. The suggested glucose sensor architecture has a total size of 0.0684 mm2.
△ Less
Submitted 21 May, 2023;
originally announced May 2023.
-
Homogenizing elastic properties of large digital rock images by combining CNN with hierarchical homogenization method
Authors:
Rasool Ahmad,
Mingliang Liu,
Michael Ortiz,
Tapan Mukerji,
Wei Cai
Abstract:
Determining effective elastic properties of rocks from their pore-scale digital images is a key goal of digital rock physics (DRP). Direct numerical simulation (DNS) of elastic behavior, however, incurs high computational cost; and surrogate machine learning (ML) model, particularly convolutional neural network (CNN), show promises to accelerate homogenization process. 3D CNN models, however, are…
▽ More
Determining effective elastic properties of rocks from their pore-scale digital images is a key goal of digital rock physics (DRP). Direct numerical simulation (DNS) of elastic behavior, however, incurs high computational cost; and surrogate machine learning (ML) model, particularly convolutional neural network (CNN), show promises to accelerate homogenization process. 3D CNN models, however, are unable to handle large images due to memory issues. To address this challenge, we propose a novel method that combines 3D CNN with hierarchical homogenization method (HHM). The surrogate 3D CNN model homogenizes only small subimages, and a DNS is used to homogenize the intermediate image obtained by assembling small subimages. The 3D CNN model is designed to output the homogenized elastic constants within the Hashin-Shtrikman (HS) bounds of the input images. The 3D CNN model is first trained on data comprising equal proportions of five sandstone (quartz mineralogy) images, and, subsequently, fine-tuned for specific rocks using transfer learning. The proposed method is applied to homogenize the rock images of size 300x300x300 and 600x600x600 voxels, and the predicted homogenized elastic moduli are shown to agree with that obtained from the brute-force DNS. The transferability of the trained 3D CNN model (using transfer learning) is further demonstrated by predicting the homogenized elastic moduli of a limestone rock with calcite mineralogy. The surrogate 3D CNN model in combination with the HHM is thus shown to be a promising tool for the homogenization of large 3D digital rock images and other random media
△ Less
Submitted 10 May, 2023;
originally announced May 2023.
-
MRI Recovery with Self-Calibrated Denoisers without Fully-Sampled Data
Authors:
Sizhuo Liu,
Muhammad Shafique,
Philip Schniter,
Rizwan Ahmad
Abstract:
Objective: Acquiring fully sampled training data is challenging for many MRI applications. We present a self-supervised image reconstruction method, termed ReSiDe, capable of recovering images solely from undersampled data.
Materials and Methods: ReSiDe is inspired by plug-and-play (PnP) methods, but unlike traditional PnP approaches that utilize pre-trained denoisers, ReSiDe iteratively trains…
▽ More
Objective: Acquiring fully sampled training data is challenging for many MRI applications. We present a self-supervised image reconstruction method, termed ReSiDe, capable of recovering images solely from undersampled data.
Materials and Methods: ReSiDe is inspired by plug-and-play (PnP) methods, but unlike traditional PnP approaches that utilize pre-trained denoisers, ReSiDe iteratively trains the denoiser on the image or images that are being reconstructed. We introduce two variations of our method: ReSiDe-S and ReSiDe-M. ReSiDe-S is scan-specific and works with a single set of undersampled measurements, while ReSiDe-M operates on multiple sets of undersampled measurements and provides faster inference. Studies I, II, and III compare ReSiDe-S and ReSiDe-M against other self-supervised or unsupervised methods using data from T1- and T2-weighted brain MRI, MRXCAT digital perfusion phantom, and first-pass cardiac perfusion, respectively.
Results: ReSiDe-S and ReSiDe-M outperform other methods in terms of reconstruction signal-to-noise ratio and structural similarity index measure for Studies I and II, and in terms of expert scoring for Study III.
Discussion: We present a self-supervised image reconstruction method and validate it in both static and dynamic MRI applications. These developments can benefit MRI applications where the availability of fully sampled training data is limited.
△ Less
Submitted 30 May, 2024; v1 submitted 25 April, 2023;
originally announced April 2023.
-
Towards domain generalisation in ASR with elitist sampling and ensemble knowledge distillation
Authors:
Rehan Ahmad,
Md Asif Jalal,
Muhammad Umar Farooq,
Anna Ollerenshaw,
Thomas Hain
Abstract:
Knowledge distillation has widely been used for model compression and domain adaptation for speech applications. In the presence of multiple teachers, knowledge can easily be transferred to the student by averaging the models output. However, previous research shows that the student do not adapt well with such combination. This paper propose to use an elitist sampling strategy at the output of ens…
▽ More
Knowledge distillation has widely been used for model compression and domain adaptation for speech applications. In the presence of multiple teachers, knowledge can easily be transferred to the student by averaging the models output. However, previous research shows that the student do not adapt well with such combination. This paper propose to use an elitist sampling strategy at the output of ensemble teacher models to select the best-decoded utterance generated by completely out-of-domain teacher models for generalizing unseen domain. The teacher models are trained on AMI, LibriSpeech and WSJ while the student is adapted for the Switchboard data. The results show that with the selection strategy based on the individual models posteriors the student model achieves a better WER compared to all the teachers and baselines with a minimum absolute improvement of about 8.4 percent. Furthermore, an insights on the model adaptation with out-of-domain data has also been studied via correlation analysis.
△ Less
Submitted 1 March, 2023;
originally announced March 2023.
-
Unsupervised data selection for Speech Recognition with contrastive loss ratios
Authors:
Chanho Park,
Rehan Ahmad,
Thomas Hain
Abstract:
This paper proposes an unsupervised data selection method by using a submodular function based on contrastive loss ratios of target and training data sets. A model using a contrastive loss function is trained on both sets. Then the ratio of frame-level losses for each model is used by a submodular function. By using the submodular function, a training set for automatic speech recognition matching…
▽ More
This paper proposes an unsupervised data selection method by using a submodular function based on contrastive loss ratios of target and training data sets. A model using a contrastive loss function is trained on both sets. Then the ratio of frame-level losses for each model is used by a submodular function. By using the submodular function, a training set for automatic speech recognition matching the target data set is selected. Experiments show that models trained on the data sets selected by the proposed method outperform the selection method based on log-likelihoods produced by GMM-HMM models, in terms of word error rate (WER). When selecting a fixed amount, e.g. 10 hours of data, the difference between the results of two methods on Tedtalks was 20.23% WER relative. The method can also be used to select data with the aim of minimising negative transfer, while maintaining or improving on performance of models trained on the whole training set. Results show that the WER on the WSJCAM0 data set was reduced by 6.26% relative when selecting 85% from the whole data set.
△ Less
Submitted 25 July, 2022;
originally announced July 2022.
-
Denoising Generalized Expectation-Consistent Approximation for MR Image Recovery
Authors:
Saurav K. Shastri,
Rizwan Ahmad,
Christopher A. Metzler,
Philip Schniter
Abstract:
To solve inverse problems, plug-and-play (PnP) methods replace the proximal step in a convex optimization algorithm with a call to an application-specific denoiser, often implemented using a deep neural network (DNN). Although such methods yield accurate solutions, they can be improved. For example, denoisers are usually designed/trained to remove white Gaussian noise, but the denoiser input error…
▽ More
To solve inverse problems, plug-and-play (PnP) methods replace the proximal step in a convex optimization algorithm with a call to an application-specific denoiser, often implemented using a deep neural network (DNN). Although such methods yield accurate solutions, they can be improved. For example, denoisers are usually designed/trained to remove white Gaussian noise, but the denoiser input error in PnP algorithms is usually far from white or Gaussian. Approximate message passing (AMP) methods provide white and Gaussian denoiser input error, but only when the forward operator is sufficiently random. In this work, for Fourier-based forward operators, we propose a PnP algorithm based on generalized expectation-consistent (GEC) approximation -- a close cousin of AMP -- that offers predictable error statistics at each iteration, as well as a new DNN denoiser that leverages those statistics. We apply our approach to magnetic resonance (MR) image recovery and demonstrate its advantages over existing PnP and AMP methods.
△ Less
Submitted 7 September, 2022; v1 submitted 8 June, 2022;
originally announced June 2022.
-
Technical Report (v1.0)--Pseudo-random Cartesian Sampling for Dynamic MRI
Authors:
Mihir Joshi,
Aaron Pruitt,
Chong Chen,
Yingmin Liu,
Rizwan Ahmad
Abstract:
For an effective application of compressed sensing (CS), which exploits the underlying compressibility of an image, one of the requirements is that the undersampling artifact be incoherent (noise-like) in the sparsifying transform domain. For cardiovascular MRI (CMR), several pseudo-random sampling methods have been proposed that yield a high level of incoherence. In this technical report, we pres…
▽ More
For an effective application of compressed sensing (CS), which exploits the underlying compressibility of an image, one of the requirements is that the undersampling artifact be incoherent (noise-like) in the sparsifying transform domain. For cardiovascular MRI (CMR), several pseudo-random sampling methods have been proposed that yield a high level of incoherence. In this technical report, we present a collection of five pseudo-random Cartesian sampling methods that can be applied to 2D cine and flow, 3D volumetric cine, and 4D flow imaging. Four out of the five presented methods yield fast computation for on-the-fly generation of the sampling mask, without the need to create and store pre-computed look-up tables. In addition, the sampling distribution is parameterized, providing control over the sampling density. For each sampling method in the report, (i) we briefly describe the methodology, (ii) list default values of the pertinent parameters, and (iii) provide a publicly available MATLAB implementation.
△ Less
Submitted 7 June, 2022;
originally announced June 2022.
-
Cardiac and respiratory motion extraction for MRI using Pilot Tone-a patient study
Authors:
Chong Chen,
Yingmin Liu,
Orlando P. Simonetti,
Matthew Tong,
Ning Jin,
Mario Bacher,
Peter Speier,
Rizwan Ahmad
Abstract:
Background: Several studies have shown that both respiratory and cardiac motion can be extracted from the Pilot Tone (PT) signal successfully. However, most of these studies were performed in healthy volunteers. In addition, validating PT using ECG as a reference can be problematic because both PT and ECG tend to be unreliable in patients with arrhythmias. Purpose: We seek to evaluate the accuracy…
▽ More
Background: Several studies have shown that both respiratory and cardiac motion can be extracted from the Pilot Tone (PT) signal successfully. However, most of these studies were performed in healthy volunteers. In addition, validating PT using ECG as a reference can be problematic because both PT and ECG tend to be unreliable in patients with arrhythmias. Purpose: We seek to evaluate the accuracy and reliability of the cardiac and respiratory signals extracted from PT in patients clinically referred for cardiovascular MRI with the image-derived signals as the reference. Methods: Twenty-three patients were scanned on a 1.5 T scanner using balanced steady-state free-precession real-time (RT) cine sequence. The PT signal was generated by a built-in PT transmitter integrated within the body array coil. For comparison, commercial ECG and BioMatrix (BM) respiratory sensor signals were synchronously recorded. Results: The respiratory motion extracted from PT correlated positively with the image-derived respiratory signal in all cases and showed a stronger correlation (absolute coefficient: 0.95+-0.09) than BM (0.72+-0.24). For the cardiac signal, PT trigger jitter (standard deviation of PT trigger locations relative to ECG triggers) ranged from 6.6 to 83.3 ms, with a median of 21.8 ms. The mean absolute difference between the PT and corresponding ECG cardiac cycle duration was less than 5% of the averaged ECG RR interval for 21 out of 23 patients. Overall, the performance of PT-based trigger extraction was comparable to that of ECG. We did not observe significant linear dependence (p>0.28) of PT delay and PT jitter on the patients' BMI or cardiac cycle duration. Conclusions: This study demonstrates the potential of PT to monitor both respiratory and cardiac motion in patients clinically referred for cardiovascular MRI.
△ Less
Submitted 9 May, 2023; v1 submitted 31 January, 2022;
originally announced February 2022.
-
Maximizing Unambiguous Velocity Range in Phase-contrast MRI with Multipoint Encoding
Authors:
Shen Zhao,
Rizwan Ahmad,
Lee C. Potter
Abstract:
In phase-contrast magnetic resonance imaging (PC-MRI), the velocity of spins at a voxel is encoded in the image phase. The strength of the velocity encoding gradient offers a trade-off between the velocity-to-noise ratio (VNR) and the extent of phase aliasing. Phase differences provide invariance to an unknown background phase. Existing literature proposes processing a reduced set of phase differe…
▽ More
In phase-contrast magnetic resonance imaging (PC-MRI), the velocity of spins at a voxel is encoded in the image phase. The strength of the velocity encoding gradient offers a trade-off between the velocity-to-noise ratio (VNR) and the extent of phase aliasing. Phase differences provide invariance to an unknown background phase. Existing literature proposes processing a reduced set of phase difference equations, simplifying the phase unwrapping problem at the expense of VNR or unaliased range of velocities, or both. Here, we demonstrate that the fullest unambiguous range of velocities is a parallelepiped, which can be accessed by jointly processing all phase differences. The joint processing also minimizes the velocity-to-noise ratio. The simple understanding of the unambiguous parallelepiped provides the potential for analyzing new multi-point acquisitions for an enhanced range of unaliased velocities; two examples are given.
△ Less
Submitted 25 January, 2022; v1 submitted 6 November, 2021;
originally announced November 2021.
-
MRI Recovery with A Self-calibrated Denoiser
Authors:
Sizhuo Liu,
Philip Schniter,
Rizwan Ahmad
Abstract:
Plug-and-play (PnP) methods that employ application-specific denoisers have been proposed to solve inverse problems, including MRI reconstruction. However, training application-specific denoisers is not feasible for many applications due to the lack of training data. In this work, we propose a PnP-inspired recovery method that does not require data beyond the single, incomplete set of measurements…
▽ More
Plug-and-play (PnP) methods that employ application-specific denoisers have been proposed to solve inverse problems, including MRI reconstruction. However, training application-specific denoisers is not feasible for many applications due to the lack of training data. In this work, we propose a PnP-inspired recovery method that does not require data beyond the single, incomplete set of measurements. The proposed method, called recovery with a self-calibrated denoiser (ReSiDe), trains the denoiser from the patches of the image being recovered. The denoiser training and a call to the denoising subroutine are performed in each iteration of a PnP algorithm, leading to a progressive refinement of the reconstructed image. For validation, we compare ReSiDe with a compressed sensing-based method and a PnP method with BM3D denoising using single-coil MRI brain data.
△ Less
Submitted 18 October, 2021;
originally announced October 2021.
-
Venc Design and Velocity Estimation for Phase Contrast MRI
Authors:
Shen Zhao,
Rizwan Ahmad,
Lee C. Potter
Abstract:
In phase-contrast magnetic resonance imaging (PC-MRI), spin velocity contributes to the phase measured at each voxel. Therefore, estimating velocity from potentially wrapped phase measurements is the task of solving a system of noisy congruence equations. We propose Phase Recovery from Multiple Wrapped Measurements (PRoM) as a fast, approximate maximum likelihood estimator of velocity from multi-c…
▽ More
In phase-contrast magnetic resonance imaging (PC-MRI), spin velocity contributes to the phase measured at each voxel. Therefore, estimating velocity from potentially wrapped phase measurements is the task of solving a system of noisy congruence equations. We propose Phase Recovery from Multiple Wrapped Measurements (PRoM) as a fast, approximate maximum likelihood estimator of velocity from multi-coil data with possible amplitude attenuation due to dephasing. The estimator can recover the fullest possible extent of unambiguous velocities, which can greatly exceed twice the highest venc. The estimator uses all pairwise phase differences and the inherent correlations among them to minimize the estimation error. Correlations are directly estimated from multi-coil data without requiring knowledge of coil sensitivity maps, dephasing factors, or the actual per-voxel signal-to-noise ratio. Derivation of the estimator yields explicit probabilities of unwrapping errors and the probability distribution for the velocity estimate; this, in turn, allows for optimized design of the phase-encoded acquisition. These probabilities are also incorporated into spatial post-processing to further mitigate wrapping errors. Simulation, phantom, and in vivo results for three-point PC-MRI acquisitions validate the benefits of reduced estimation error, increased recovered velocity range, optimized acquisition, and fast computation. A phantom study at 1.5T demonstrates 48.5% decrease in root mean squared error using PRoM with post-processing versus a conventional "dual-venc" technique. Simulation and 3T in vivo results likewise demonstrate the proposed benefits.
△ Less
Submitted 20 July, 2022; v1 submitted 25 September, 2021;
originally announced September 2021.
-
Calibrationless MRI Reconstruction with a Plug-in Denoiser
Authors:
Shen Zhao,
Lee C. Potter,
Rizwan Ahmad
Abstract:
Magnetic Resonance Imaging (MRI) is a noninvasive imaging technique that provides excellent soft-tissue contrast without using ionizing radiation. MRI's clinical application may be limited by long data acquisition time; therefore, MR image reconstruction from highly under-sampled k-space data has been an active research area. Calibrationless MRI not only enables a higher acceleration rate but also…
▽ More
Magnetic Resonance Imaging (MRI) is a noninvasive imaging technique that provides excellent soft-tissue contrast without using ionizing radiation. MRI's clinical application may be limited by long data acquisition time; therefore, MR image reconstruction from highly under-sampled k-space data has been an active research area. Calibrationless MRI not only enables a higher acceleration rate but also increases flexibility for sampling pattern design. To leverage non-linear machine learning priors, we pair our High-dimensional Fast Convolutional Framework (HICU) with a plug-in denoiser and demonstrate its feasibility using 2D brain data.
△ Less
Submitted 9 December, 2020;
originally announced December 2020.
-
Automatic image-based respiratory signal extraction in real-time CMR
Authors:
Chong Chen,
Yingmin Liu,
Orlando P. Simonetti,
Rizwan Ahmad
Abstract:
Purpose: To develop a fully automatic method for extraction and directionality determination of respiratory signal in free-breathing, real-time (RT) cardiac MRI.
Methods: The respiratory signal is extracted by a principal component analysis method from RT cine images. Then, a two-step procedure is used to determine the directionality (sign) of the respiratory signal. First, the signal polarity o…
▽ More
Purpose: To develop a fully automatic method for extraction and directionality determination of respiratory signal in free-breathing, real-time (RT) cardiac MRI.
Methods: The respiratory signal is extracted by a principal component analysis method from RT cine images. Then, a two-step procedure is used to determine the directionality (sign) of the respiratory signal. First, the signal polarity of all slices is made consistent with a reference slice. Second, a global sign correction is performed by maximizing the correlation of the respiratory signal with the zeroth-moment center curve. The proposed method is evaluated in multi-slice RT cine from eleven volunteers and two patients. The motion in a manually selected region-of-interest is used as reference.
Results: The extracted respiratory signal using the proposed method exhibits high, positive correlation with the reference in all cases and is more robust compared to a recently proposed method. To demonstrate its clinical utility, the method is used to identify heartbeats from inspiratory and expiratory phases and, in turn, to account for respiration-induced changes in the cardiac output.
Conclusions: The proposed method enables fully automatic extraction and directionality determinations of respiratory signal from RT cardiac cine images, allowing accurate cardiac function quantification.
△ Less
Submitted 4 December, 2020;
originally announced December 2020.
-
OCMR (v1.0)--Open-Access Multi-Coil k-Space Dataset for Cardiovascular Magnetic Resonance Imaging
Authors:
Chong Chen,
Yingmin Liu,
Philip Schniter,
Matthew Tong,
Karolina Zareba,
Orlando Simonetti,
Lee Potter,
Rizwan Ahmad
Abstract:
Cardiovascular MRI (CMR) is a non-invasive imaging modality that provides excellent soft-tissue contrast without the use of ionizing radiation. Physiological motions and limited speed of MRI data acquisition necessitate development of accelerated methods, which typically rely on undersampling. Recovering diagnostic quality CMR images from highly undersampled data has been an active area of researc…
▽ More
Cardiovascular MRI (CMR) is a non-invasive imaging modality that provides excellent soft-tissue contrast without the use of ionizing radiation. Physiological motions and limited speed of MRI data acquisition necessitate development of accelerated methods, which typically rely on undersampling. Recovering diagnostic quality CMR images from highly undersampled data has been an active area of research. Recently, several data acquisition and processing methods have been proposed to accelerate CMR. The availability of data to objectively evaluate and compare different reconstruction methods could expedite innovation and promote clinical translation of these methods. In this work, we introduce an open-access dataset, called OCMR, that provides multi-coil k-space data from 53 fully sampled and 212 prospectively undersampled cardiac cine series.
△ Less
Submitted 12 August, 2020; v1 submitted 7 August, 2020;
originally announced August 2020.
-
Lightning Mapping: Techniques, Challenges, and Opportunities
Authors:
Ammar Alammari,
Ammar Ahmed Alkahtani,
Mohd Riduan Ahmad,
Fuad M. Noman,
Mona Riza Mohd Esa,
Zen Kawasaki,
Sieh Kiong Tiong
Abstract:
Despite the significant progress made in studying the lightning phenomenon, precise location and mapping of its occurrence remain a challenge. Lightning mapping can be determined by studying the electromagnetic radiation accompanying the lightning discharges. It can contribute substantially to efforts made to protect lives and valuable assets. There are three main methods used to locate lightning,…
▽ More
Despite the significant progress made in studying the lightning phenomenon, precise location and mapping of its occurrence remain a challenge. Lightning mapping can be determined by studying the electromagnetic radiation accompanying the lightning discharges. It can contribute substantially to efforts made to protect lives and valuable assets. There are three main methods used to locate lightning, which are Magnetic Direction Finder (MDF), Time of Arrival (TOA), and Interferometer (ITF). A thorough study of these methods provides researchers with a guide to better understand and progress in this field. This paper reviews existing approaches used to locate and map lightning within these three methods. We study the implemented techniques, analyze their merits and demerits, and sort them in a way that facilitates extracting opportunities for further improvements. We conclude that for better development in determining the location and map of lightning, improving the processing of lightning signals and filtering the associated noise with it is essential. This includes introducing new processing methods such as wavelet transformation instead of the traditional cross-correlation. The use of artificial intelligence may also contribute a lot, particularly deep learning, to determining the type of lightning, which enables better mapping for the lightning and its occurrence. We also could conclude that unlike MDF and TOA, which can locate the lightning strike points, ITF can produce lightning discharge propagation images that can unveil the mechanism of lightning discharges. Finally, this paper serves as a reference for researchers focusing on lightning mapping to give them insight into the field.
△ Less
Submitted 31 May, 2020;
originally announced June 2020.
-
Fully Self-Gated Whole-Heart 4D Flow Imaging from a Five-Minute Scan
Authors:
Aaron Pruitt,
Adam Rich,
Yingmin Liu,
Ning Jin,
Lee Potter,
Matthew Tong,
Saurabh Rajpal,
Orlando Simonetti,
Rizwan Ahmad
Abstract:
Purpose: To develop and validate an acquisition and processing technique that enables fully self-gated 4D flow imaging with whole-heart coverage in a fixed five-minute scan.
Theory and Methods: The data are acquired continuously using Cartesian sampling and sorted into respiratory and cardiac bins using the self-gating signal. The reconstruction is performed using a recently proposed Bayesian me…
▽ More
Purpose: To develop and validate an acquisition and processing technique that enables fully self-gated 4D flow imaging with whole-heart coverage in a fixed five-minute scan.
Theory and Methods: The data are acquired continuously using Cartesian sampling and sorted into respiratory and cardiac bins using the self-gating signal. The reconstruction is performed using a recently proposed Bayesian method called ReVEAL4D. ReVEAL4D is validated using data from eight healthy volunteers and two patients and compared with a compressed sensing technique, L1-SENSE.
Results: Healthy subjects -- Compared to 2D phase-contrast MRI (2D-PC), flow quantification from ReVEAL4D shows no significant bias. In contrast, the peak velocity and peak flow rate for L1-SENSE are significantly underestimated. Compared to traditional parallel MRI-based 4D flow imaging, ReVEAL4D demonstrates small but significant biases in net flow and peak flow rate, with no significant bias in peak velocity. All three indices are significantly and more markedly underestimated by L1-SENSE. Patients -- Flow quantification from ReVEAL4D agrees well with the 2D-PC reference. In contrast, L1-SENSE markedly underestimated peak velocity.
Conclusions: The combination of highly accelerated five-minute Cartesian acquisition, self-gating, and ReVEAL4D enables whole-heart 4D flow imaging with accurate flow quantification.
△ Less
Submitted 5 August, 2020; v1 submitted 19 April, 2020;
originally announced April 2020.
-
High-dimensional Fast Convolutional Framework (HICU) for Calibrationless MRI
Authors:
Shen Zhao,
Lee C. Potter,
Rizwan Ahmad
Abstract:
Purpose: To present a computational procedure for accelerated, calibrationless magnetic resonance image (Cl-MRI) reconstruction that is fast, memory efficient, and scales to high-dimensional imaging.
Theory and Methods: Cl-MRI methods can enable high acceleration rates and flexible sampling patterns, but their clinical application is limited by computational complexity and large memory footprint…
▽ More
Purpose: To present a computational procedure for accelerated, calibrationless magnetic resonance image (Cl-MRI) reconstruction that is fast, memory efficient, and scales to high-dimensional imaging.
Theory and Methods: Cl-MRI methods can enable high acceleration rates and flexible sampling patterns, but their clinical application is limited by computational complexity and large memory footprint. The proposed computational procedure, HIgh-dimensional fast ConvolU-tional framework (HICU), provides fast, memory-efficient recovery of unsampled k-space points. For demonstration, HICU is applied to six 2D T2-weighted brain, seven 2D cardiac cine, five 3D knee, and one multi-shot diffusion weighted imaging (MSDWI) datasets.
Results: The 2D imaging results show that HICU can offer one to two orders of magnitude computation speedup compared to other Cl-MRI methods without sacrificing imaging quality. The 2D cine and 3D imaging results show that the computational acceleration techniques included in HICU yield computing time on par with SENSE-based compressed sensing methods with up to 3 dB improvement in signal-to-error ratio and better perceptual quality. The MSDWI results demonstrate the feasibility of HICU for a challenging multi-shot echo-planar imaging application.
Conclusions: The presented method, HICU, offers efficient computation and scalability as well as extendibility to a wide variety of MRI applications.
△ Less
Submitted 22 July, 2021; v1 submitted 19 April, 2020;
originally announced April 2020.
-
Free-breathing Cardiovascular MRI Using a Plug-and-Play Method with Learned Denoiser
Authors:
Sizhuo Liu,
Edward Reehorst,
Philip Schniter,
Rizwan Ahmad
Abstract:
Cardiac magnetic resonance imaging (CMR) is a noninvasive imaging modality that provides a comprehensive evaluation of the cardiovascular system. The clinical utility of CMR is hampered by long acquisition times, however. In this work, we propose and validate a plug-and-play (PnP) method for CMR reconstruction from undersampled multi-coil data. To fully exploit the rich image structure inherent in…
▽ More
Cardiac magnetic resonance imaging (CMR) is a noninvasive imaging modality that provides a comprehensive evaluation of the cardiovascular system. The clinical utility of CMR is hampered by long acquisition times, however. In this work, we propose and validate a plug-and-play (PnP) method for CMR reconstruction from undersampled multi-coil data. To fully exploit the rich image structure inherent in CMR, we pair the PnP framework with a deep learning (DL)-based denoiser that is trained using spatiotemporal patches from high-quality, breath-held cardiac cine images. The resulting "PnP-DL" method iterates over data consistency and denoising subroutines. We compare the reconstruction performance of PnP-DL to that of compressed sensing (CS) using eight breath-held and ten real-time (RT) free-breathing cardiac cine datasets. We find that, for breath-held datasets, PnP-DL offers more than one dB advantage over commonly used CS methods. For RT free-breathing datasets, where ground truth is not available, PnP-DL receives higher scores in qualitative evaluation. The results highlight the potential of PnP-DL to accelerate RT CMR.
△ Less
Submitted 8 February, 2020;
originally announced February 2020.
-
Convolutional Framework for Accelerated Magnetic Resonance Imaging
Authors:
Shen Zhao,
Lee C. Potter,
Kiryung Lee,
Rizwan Ahmad
Abstract:
Magnetic Resonance Imaging (MRI) is a noninvasive imaging technique that provides exquisite soft-tissue contrast without using ionizing radiation. The clinical application of MRI may be limited by long data acquisition times; therefore, MR image reconstruction from highly undersampled k-space data has been an active area of research. Many works exploit rank deficiency in a Hankel data matrix to re…
▽ More
Magnetic Resonance Imaging (MRI) is a noninvasive imaging technique that provides exquisite soft-tissue contrast without using ionizing radiation. The clinical application of MRI may be limited by long data acquisition times; therefore, MR image reconstruction from highly undersampled k-space data has been an active area of research. Many works exploit rank deficiency in a Hankel data matrix to recover unobserved k-space samples; the resulting problem is non-convex, so the choice of numerical algorithm can significantly affect performance, computation, and memory. We present a simple, scalable approach called Convolutional Framework (CF). We demonstrate the feasibility and versatility of CF using measured data from 2D, 3D, and dynamic applications.
△ Less
Submitted 8 February, 2020;
originally announced February 2020.
-
Automatic Extraction and Sign Determination of Respiratory Signal in Real-time Cardiac Magnetic Resonance imaging
Authors:
Chong Chen,
Yingmin Liu,
Orlando P. Simonetti,
Rizwan Ahmad
Abstract:
In real-time (RT) cardiac cine imaging, a stack of 2D slices is collected sequentially under free-breathing conditions. A complete heartbeat from each slice is then used for cardiac function quantification. The inter-slice respiratory mismatch can compromise accurate quantification of cardiac function. Methods based on principal components analysis (PCA) have been proposed to extract the respirato…
▽ More
In real-time (RT) cardiac cine imaging, a stack of 2D slices is collected sequentially under free-breathing conditions. A complete heartbeat from each slice is then used for cardiac function quantification. The inter-slice respiratory mismatch can compromise accurate quantification of cardiac function. Methods based on principal components analysis (PCA) have been proposed to extract the respiratory signal from RT cardiac cine, but these methods cannot resolve the inter-slice sign ambiguity of the respiratory signal. In this work, we propose a fully automatic sign correction procedure based on the similarity of neighboring slices and correlation to the center-of-mass curve. The proposed method is evaluated in eleven volunteers, with ten slices per volunteer. The motion in a manually selected region-of-interest (ROI) is used as a reference. The results show that the extracted respiratory signal has a high, positive correlation with the reference in all cases. The qualitative assessment of images also shows that the proposed approach can accurately identify heartbeats, one from each slice, belonging to the same respiratory phase. This approach can improve cardiac function quantification for RT cine without manual intervention.
△ Less
Submitted 8 February, 2020;
originally announced February 2020.
-
Leakage Localisation Using Cross Correlation for Wireless Three-Axis Vibration Sensors
Authors:
Airull Azizi Awang Lah,
Rudzidatul Akmam Dzyauddin,
Nelidya Md Yusoff,
Mohd Ismifaizul Mohd Ismail,
Noor Azurati Ahmad Salleh,
Robiah Ahmad
Abstract:
The objective of this paper is to investigate the application of the cross-correlation technique in localizing the leakage in Acrylonitrile Butadiene Styrene (ABS) pipeline using wireless three-axis vibration sensors. Most of the existing leak localization techniques that utilized the cross-correlation method is using acoustic and pressure sensors. This study explored the impact of using three-axi…
▽ More
The objective of this paper is to investigate the application of the cross-correlation technique in localizing the leakage in Acrylonitrile Butadiene Styrene (ABS) pipeline using wireless three-axis vibration sensors. Most of the existing leak localization techniques that utilized the cross-correlation method is using acoustic and pressure sensors. This study explored the impact of using three-axis vibration sensor ADXL335 to localize the leakages in ABS pipeline. The study focused on the small leak size of 1 mm and the effect of sensor distance and different water pressure is studied. The vibration data used in the cross-correlation data were filtered against the noise interference from the water pipeline. The source of noise interference from the water pipeline are motor, water pump, and valve. The computed leak localization accuracy against the actual leak distance from the three-axis was analyzed. The leakage localization formula is improvised by adding buffer time to have an accurate result. From the experiment, it was discovered that three-axis vibration sensor can be used to localize the leakages in plastic water pipeline and it is suitable for deployment in small to medium water distribution network or within a building.
△ Less
Submitted 16 December, 2019;
originally announced December 2019.