A dense multi-path decoder for tissue segmentation in histopathology images

Comput Methods Programs Biomed. 2019 May:173:119-129. doi: 10.1016/j.cmpb.2019.03.007. Epub 2019 Mar 14.

Abstract

Background and objective: Segmenting different tissue components in histopathological images is of great importance for analyzing tissues and tumor environments. In recent years, an encoder-decoder family of convolutional neural networks has increasingly adopted to develop automated segmentation tools. While an encoder has been the main focus of most investigations, the role of a decoder so far has not been well studied and understood. Herein, we proposed an improved design of a decoder for the segmentation of epithelium and stroma components in histopathology images.

Methods: The proposed decoder is built upon a multi-path layout and dense shortcut connections between layers to maximize the learning and inference capability. Equipped with the proposed decoder, neural networks are built using three types of encoders (VGG, ResNet and preactived ResNet). To assess the proposed method, breast and prostate tissue datasets are utilized, including 108 and 52 hematoxylin and eosin (H&E) breast tissues images and 224 H&E prostate tissue images.

Results: Combining the pre-activated ResNet encoder and the proposed decoder, we achieved a pixel wise accuracy (ACC) of 0.9122, a rand index (RAND) score of 0.8398, an area under receiver operating characteristic curve (AUC) of 0.9716, Dice coefficient for stroma (DICE_STR) of 0.9092 and Dice coefficient for epithelium (DICE_EPI) of 0.9150 on the breast tissue dataset. The same network obtained 0.9074 ACC, 0.8320 Rand index, 0.9719 AUC, 0.9021 DICE_EPI and 0.9121 DICE_STR on the prostate dataset.

Conclusions: In general, the experimental results confirmed that the proposed network is superior to the networks combined with the conventional decoder. Therefore, the proposed decoder could aid in improving tissue analysis in histopathology images.

Keywords: Convolutional neural networks; Dense decoder; Digital pathology; Tissue segmentation.

MeSH terms

  • Algorithms
  • Area Under Curve
  • Breast / diagnostic imaging*
  • Epithelium / diagnostic imaging
  • Female
  • Histology*
  • Humans
  • Image Processing, Computer-Assisted / methods*
  • Male
  • Neural Networks, Computer*
  • Pattern Recognition, Automated
  • Prostate / diagnostic imaging*
  • ROC Curve
  • Reproducibility of Results
  • Software