DeepCut: Object Segmentation From Bounding Box Annotations Using Convolutional Neural Networks

IEEE Trans Med Imaging. 2017 Feb;36(2):674-683. doi: 10.1109/TMI.2016.2621185. Epub 2016 Nov 9.

Abstract

In this paper, we propose DeepCut, a method to obtain pixelwise object segmentations given an image dataset labelled weak annotations, in our case bounding boxes. It extends the approach of the well-known GrabCut [1] method to include machine learning by training a neural network classifier from bounding box annotations. We formulate the problem as an energy minimisation problem over a densely-connected conditional random field and iteratively update the training targets to obtain pixelwise object segmentations. Additionally, we propose variants of the DeepCut method and compare those to a naïve approach to CNN training under weak supervision. We test its applicability to solve brain and lung segmentation problems on a challenging fetal magnetic resonance dataset and obtain encouraging results in terms of accuracy.

MeSH terms

  • Algorithms
  • Brain
  • Humans
  • Image Enhancement
  • Image Interpretation, Computer-Assisted
  • Machine Learning
  • Magnetic Resonance Imaging
  • Monte Carlo Method
  • Neural Networks, Computer*