Falling towards forgetfulness : synaptic decay prevents spontaneous recovery of memory
MetadataShow full item record
Long after a new language has been learned and forgotten, relearning a few words seems to trigger the recall of other words. This "free-lunch learning'' (FLL) effect has been demonstrated both in humans and in neural network models. Specifically, previous work proved that linear networks that learn a set of associations, then partially forget them all, and finally relearn some of the associations, show improved performance on the remaining (i.e., nonrelearned) associations. Here, we prove that relearning forgotten associations decreases performance on nonrelearned associations; an effect we call negative free-lunch learning. The difference between free-lunch learning and the negative free-lunch learning presented here is due to the particular method used to induce forgetting. Specifically, if forgetting is induced by isotropic drifting of weight vectors (i.e., by adding isotropic noise), then free-lunch learning is observed. However, as proved here, if forgetting is induced by weight values that simply decay or fall towards zero, then negative free-lunch learning is observed. From a biological perspective, and assuming that nervous systems are analogous to the networks used here, this suggests that evolution may have selected physiological mechanisms that involve forgetting using a form of synaptic drift rather than synaptic decay, because synaptic drift, but not synaptic decay, yields free-lunch learning.
Stone , J V & Jupp , P E 2008 , ' Falling towards forgetfulness : synaptic decay prevents spontaneous recovery of memory ' PLoS Computational Biology , vol 4 , no. 8 , e1000143 . , 10.1371/journal.pcbi.1000143
PLoS Computational Biology
© 2008 Stone, Jupp. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
No funding was received for this work.
Items in the St Andrews Research Repository are protected by copyright, with all rights reserved, unless otherwise indicated.