Fusing visual and clinical information for lung tissue classification in high-resolution computed tomography

Artif Intell Med. 2010 Sep;50(1):13-21. doi: 10.1016/j.artmed.2010.04.006. Epub 2010 May 23.

Abstract

Objective: We investigate the influence of the clinical context of high-resolution computed tomography (HRCT) images of the chest on tissue classification.

Methods and materials: 2D regions of interest in HRCT axial slices from patients affected with an interstitial lung disease are automatically classified into five classes of lung tissue. Relevance of the clinical parameters is studied before fusing them with visual attributes. Two multimedia fusion techniques are compared: early versus late fusion. Early fusion concatenates features in one single vector, yielding a true multimedia feature space. Late fusion consisting of the combination of the probability outputs of two support vector machines.

Results and conclusion: The late fusion scheme allowed a maximum of 84% correct predictions of testing instances among the five classes of lung tissue. This represents a significant improvement of 10% compared to a pure visual-based classification. Moreover, the late fusion scheme showed high robustness to the number of clinical parameters used, which suggests that it is appropriate for mining clinical attributes with missing values in clinical routine.

Publication types

  • Comparative Study
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adult
  • Aged
  • Aged, 80 and over
  • Algorithms
  • Artificial Intelligence*
  • Data Mining
  • Decision Support Systems, Clinical*
  • Decision Support Techniques*
  • Female
  • Humans
  • Lung / diagnostic imaging*
  • Lung Diseases, Interstitial / diagnostic imaging*
  • Male
  • Medical Informatics*
  • Middle Aged
  • Models, Statistical
  • Pattern Recognition, Automated
  • Predictive Value of Tests
  • Prognosis
  • Radiographic Image Interpretation, Computer-Assisted / methods*
  • Retrospective Studies
  • Severity of Illness Index
  • Tomography, X-Ray Computed*