Sleeping our way to weight normalization and stable learning

Neural Comput. 2008 Dec;20(12):3111-30. doi: 10.1162/neco.2008.04-07-502.

Abstract

The functions of sleep have been an enduring mystery. Tononi and Cirelli (2003) hypothesized that one of the functions of slow-wave sleep is to scale down synapses in the cortex that have strengthened during awake learning. We create a computational model to test the functionality of this idea and examine some of its implications. We show that synaptic scaling during slow-wave sleep is capable of keeping Hebbian learning in check and that it enables stable development. We also show theoretically how it implements classical weight normalization, which has been in common use in neural models for decades. Finally, a significant computational limitation of this form of synaptic scaling is revealed through computer simulations.

Publication types

  • Letter
  • Research Support, U.S. Gov't, Non-P.H.S.

MeSH terms

  • Animals
  • Cerebral Cortex / cytology
  • Computer Simulation
  • Humans
  • Learning / physiology*
  • Models, Neurological*
  • Neurons / physiology
  • Sleep / physiology*
  • Synapses / physiology
  • Weights and Measures*