Active learning for noisy oracle via density power divergence

Neural Netw. 2013 Oct:46:133-43. doi: 10.1016/j.neunet.2013.05.007. Epub 2013 May 15.

Abstract

The accuracy of active learning is critically influenced by the existence of noisy labels given by a noisy oracle. In this paper, we propose a novel pool-based active learning framework through robust measures based on density power divergence. By minimizing density power divergence, such as β-divergence and γ-divergence, one can estimate the model accurately even under the existence of noisy labels within data. Accordingly, we develop query selecting measures for pool-based active learning using these divergences. In addition, we propose an evaluation scheme for these measures based on asymptotic statistical analyses, which enables us to perform active learning by evaluating an estimation error directly. Experiments with benchmark datasets and real-world image datasets show that our active learning scheme performs better than several baseline methods.

Keywords: Active learning; Density power divergence; Noisy oracle.

MeSH terms

  • Algorithms
  • Artificial Intelligence
  • Computer Simulation
  • Models, Theoretical
  • Pattern Recognition, Automated* / methods
  • Problem-Based Learning* / methods