The effect of noise on a class of energy-based learning rules

Neural Comput. 2003 Jul;15(7):1621-40. doi: 10.1162/089976603321891837.

Abstract

Westudy the selectivity properties of neurons based on BCM and kurtosis energy functions in a general case of noisy high-dimensional input space. The proposed approach, which is used for characterization of the stable states, can be generalized to a whole class of energy functions. We characterize the critical noise levels beyond which the selectivity is destroyed. We also perform a quantitative analysis of such transitions, which shows interesting dependency on data set size. We observe that the robustness to noise of the BCM neuron (Bienenstock, Cooper, & Munro, 1982; Intrator & Cooper, 1992) increases as a function of dimensionality. We explicitly compute the separability limit of BCM and kurtosis learning rules in the case of a bimodal input distribution. Numerical simulations show a stronger robustness of the BCM rule for practical data set size when compared with kurtosis.

MeSH terms

  • Electricity*
  • Energy Metabolism / physiology*
  • Learning / physiology*
  • Models, Neurological*
  • Normal Distribution