Regional registration of whole slide image stacks containing major histological artifacts

BMC Bioinformatics. 2020 Dec 4;21(1):558. doi: 10.1186/s12859-020-03907-6.

Abstract

Background: High resolution 2D whole slide imaging provides rich information about the tissue structure. This information can be a lot richer if these 2D images can be stacked into a 3D tissue volume. A 3D analysis, however, requires accurate reconstruction of the tissue volume from the 2D image stack. This task is not trivial due to the distortions such as tissue tearing, folding and missing at each slide. Performing registration for the whole tissue slices may be adversely affected by distorted tissue regions. Consequently, regional registration is found to be more effective. In this paper, we propose a new approach to an accurate and robust registration of regions of interest for whole slide images. We introduce the idea of multi-scale attention for registration.

Results: Using mean similarity index as the metric, the proposed algorithm (mean ± SD [Formula: see text]) followed by a fine registration algorithm ([Formula: see text]) outperformed the state-of-the-art linear whole tissue registration algorithm ([Formula: see text]) and the regional version of this algorithm ([Formula: see text]). The proposed algorithm also outperforms the state-of-the-art nonlinear registration algorithm (original: [Formula: see text], regional: [Formula: see text]) for whole slide images and a recently proposed patch-based registration algorithm (patch size 256: [Formula: see text] , patch size 512: [Formula: see text]) for medical images.

Conclusion: Using multi-scale attention mechanism leads to a more robust and accurate solution to the problem of regional registration of whole slide images corrupted in some parts by major histological artifacts in the imaged tissue.

Keywords: Blood vessel 3D reconstruction; Immunohistochemistry images; Multi-scale attention; Rigid registration; Whole slide images.

MeSH terms

  • Algorithms*
  • Artifacts*
  • Blood Vessels / diagnostic imaging
  • Blood Vessels / pathology*
  • Carcinoma, Renal Cell / blood supply
  • Humans
  • Image Processing, Computer-Assisted / methods*
  • Imaging, Three-Dimensional / methods*
  • Immunohistochemistry / methods
  • Microscopy