Label- and slide-free tissue histology using 3D epi-mode quantitative phase imaging and virtual H&E staining
Authors:
Tanishq Mathew Abraham,
Paloma Casteleiro Costa,
Caroline Filan,
Zhe Guang,
Zhaobin Zhang,
Stewart Neill,
Jeffrey J. Olson,
Richard Levenson,
Francisco E. Robles
Abstract:
Histological staining of tissue biopsies, especially hematoxylin and eosin (H&E) staining, serves as the benchmark for disease diagnosis and comprehensive clinical assessment of tissue. However, the process is laborious and time-consuming, often limiting its usage in crucial applications such as surgical margin assessment. To address these challenges, we combine an emerging 3D quantitative phase i…
▽ More
Histological staining of tissue biopsies, especially hematoxylin and eosin (H&E) staining, serves as the benchmark for disease diagnosis and comprehensive clinical assessment of tissue. However, the process is laborious and time-consuming, often limiting its usage in crucial applications such as surgical margin assessment. To address these challenges, we combine an emerging 3D quantitative phase imaging technology, termed quantitative oblique back illumination microscopy (qOBM), with an unsupervised generative adversarial network pipeline to map qOBM phase images of unaltered thick tissues (i.e., label- and slide-free) to virtually stained H&E-like (vH&E) images. We demonstrate that the approach achieves high-fidelity conversions to H&E with subcellular detail using fresh tissue specimens from mouse liver, rat gliosarcoma, and human gliomas. We also show that the framework directly enables additional capabilities such as H&E-like contrast for volumetric imaging. The quality and fidelity of the vH&E images are validated using both a neural network classifier trained on real H&E images and tested on virtual H&E images, and a user study with neuropathologists. Given its simple and low-cost embodiment and ability to provide real-time feedback in vivo, this deep learning-enabled qOBM approach could enable new workflows for histopathology with the potential to significantly save time, labor, and costs in cancer screening, detection, treatment guidance, and more.
△ Less
Submitted 1 June, 2023;
originally announced June 2023.
Lung-Originated Tumor Segmentation from Computed Tomography Scan (LOTUS) Benchmark
Authors:
Parnian Afshar,
Arash Mohammadi,
Konstantinos N. Plataniotis,
Keyvan Farahani,
Justin Kirby,
Anastasia Oikonomou,
Amir Asif,
Leonard Wee,
Andre Dekker,
Xin Wu,
Mohammad Ariful Haque,
Shahruk Hossain,
Md. Kamrul Hasan,
Uday Kamal,
Winston Hsu,
Jhih-Yuan Lin,
M. Sohel Rahman,
Nabil Ibtehaz,
Sh. M. Amir Foisol,
Kin-Man Lam,
Zhong Guang,
Runze Zhang,
Sumohana S. Channappayya,
Shashank Gupta,
Chander Dev
Abstract:
Lung cancer is one of the deadliest cancers, and in part its effective diagnosis and treatment depend on the accurate delineation of the tumor. Human-centered segmentation, which is currently the most common approach, is subject to inter-observer variability, and is also time-consuming, considering the fact that only experts are capable of providing annotations. Automatic and semi-automatic tumor…
▽ More
Lung cancer is one of the deadliest cancers, and in part its effective diagnosis and treatment depend on the accurate delineation of the tumor. Human-centered segmentation, which is currently the most common approach, is subject to inter-observer variability, and is also time-consuming, considering the fact that only experts are capable of providing annotations. Automatic and semi-automatic tumor segmentation methods have recently shown promising results. However, as different researchers have validated their algorithms using various datasets and performance metrics, reliably evaluating these methods is still an open challenge. The goal of the Lung-Originated Tumor Segmentation from Computed Tomography Scan (LOTUS) Benchmark created through 2018 IEEE Video and Image Processing (VIP) Cup competition, is to provide a unique dataset and pre-defined metrics, so that different researchers can develop and evaluate their methods in a unified fashion. The 2018 VIP Cup started with a global engagement from 42 countries to access the competition data. At the registration stage, there were 129 members clustered into 28 teams from 10 countries, out of which 9 teams made it to the final stage and 6 teams successfully completed all the required tasks. In a nutshell, all the algorithms proposed during the competition, are based on deep learning models combined with a false positive reduction technique. Methods developed by the three finalists show promising results in tumor segmentation, however, more effort should be put into reducing the false positive rate. This competition manuscript presents an overview of the VIP-Cup challenge, along with the proposed algorithms and results.
△ Less
Submitted 2 January, 2022;
originally announced January 2022.
