Show simple item record

Files in this item


Item metadata

dc.contributor.authorSharma, Rohit
dc.contributor.authorArandelovic, Ognjen
dc.identifier.citationSharma , R & Arandelovic , O 2017 , Information and knowing when to forget it . in 2017 IEEE International Joint Conference on Neural Networks (IJCNN) . , 7966253 , IEEE , pp. 3184-3190 , 2017 International Joint Conference on Neural Networks , Anchorage , United States , 14/05/17 .
dc.identifier.otherPURE: 249318673
dc.identifier.otherPURE UUID: 15ab490e-4722-4e7a-96e8-adc70c12250c
dc.identifier.otherScopus: 85030981664
dc.identifier.otherWOS: 000426968703059
dc.description.abstractIn this paper we propose several novel approaches for incorporating forgetting mechanisms into sequential prediction based machine learning algorithms. The broad premise of our work, supported and motivated in part by recent findings stemming from neurology research on the development of human brains, is that knowledge acquisition and forgetting are complementary processes, and that learning can (perhaps unintuitively) benefit from the latter too. We demonstrate that if forgetting is implemented in a purposeful and date driven manner, there are a number of benefits which can be gained from discarding information. The framework we introduce is a general one and can be used with any baseline predictor of choice. Hence in this sense it is best described as a meta-algorithm. The method we described was developed through a series of steps which increase the adaptability of the model, while being data driven.We first discussed a weakly adaptive forgetting process which we termed passive forgetting. A fully adaptive framework, which we termed active forgetting was developed by enveloping a passive forgetting process with a monitoring, self-aware module which detects contextual changes and makes a statistically informed choice when the model parameters should be abruptly rather than gradually updated. The effectiveness of the proposed metaframework was demonstrated on a real world data set concerned with a challenge of major practical importance: that of predicting currency exchange rates. Our approach was shown to be highly effective, reducing prediction errors by nearly 40%.
dc.relation.ispartof2017 IEEE International Joint Conference on Neural Networks (IJCNN)en
dc.rights© 2017, IEEE. This work has been made available online in accordance with the publisher’s policies. This is the author created, accepted version manuscript following peer review and may differ slightly from the final published version. The final published version of this work is available at /
dc.subjectQA75 Electronic computers. Computer scienceen
dc.titleInformation and knowing when to forget iten
dc.typeConference itemen
dc.contributor.institutionUniversity of St Andrews.School of Computer Scienceen

This item appears in the following Collection(s)

Show simple item record