Show simple item record

Files in this item

Thumbnail

Item metadata

dc.contributor.authorSharma, Rohit
dc.contributor.authorArandelovic, Ognjen
dc.date.accessioned2017-03-22T12:32:30Z
dc.date.available2017-03-22T12:32:30Z
dc.date.issued2017-05-14
dc.identifier.citationSharma , R & Arandelovic , O 2017 , Information and knowing when to forget it . in 2017 IEEE International Joint Conference on Neural Networks (IJCNN) . , 7966253 , IEEE , pp. 3184-3190 , 2017 International Joint Conference on Neural Networks , Anchorage , United States , 14/05/17 . https://doi.org/10.1109/IJCNN.2017.7966253en
dc.identifier.citationconferenceen
dc.identifier.isbn9781509061839
dc.identifier.isbn9781509061822
dc.identifier.otherPURE: 249318673
dc.identifier.otherPURE UUID: 15ab490e-4722-4e7a-96e8-adc70c12250c
dc.identifier.otherScopus: 85030981664
dc.identifier.otherWOS: 000426968703059
dc.identifier.urihttp://hdl.handle.net/10023/10505
dc.description.abstractIn this paper we propose several novel approaches for incorporating forgetting mechanisms into sequential prediction based machine learning algorithms. The broad premise of our work, supported and motivated in part by recent findings stemming from neurology research on the development of human brains, is that knowledge acquisition and forgetting are complementary processes, and that learning can (perhaps unintuitively) benefit from the latter too. We demonstrate that if forgetting is implemented in a purposeful and date driven manner, there are a number of benefits which can be gained from discarding information. The framework we introduce is a general one and can be used with any baseline predictor of choice. Hence in this sense it is best described as a meta-algorithm. The method we described was developed through a series of steps which increase the adaptability of the model, while being data driven.We first discussed a weakly adaptive forgetting process which we termed passive forgetting. A fully adaptive framework, which we termed active forgetting was developed by enveloping a passive forgetting process with a monitoring, self-aware module which detects contextual changes and makes a statistically informed choice when the model parameters should be abruptly rather than gradually updated. The effectiveness of the proposed metaframework was demonstrated on a real world data set concerned with a challenge of major practical importance: that of predicting currency exchange rates. Our approach was shown to be highly effective, reducing prediction errors by nearly 40%.
dc.language.isoeng
dc.publisherIEEE
dc.relation.ispartof2017 IEEE International Joint Conference on Neural Networks (IJCNN)en
dc.rights© 2017, IEEE. This work has been made available online in accordance with the publisher’s policies. This is the author created, accepted version manuscript following peer review and may differ slightly from the final published version. The final published version of this work is available at ieeexplore.ieee.org / https://doi.org/10.1109/IJCNN.2017.7966253en
dc.subjectQA75 Electronic computers. Computer scienceen
dc.subject3rd-DASen
dc.subject.lccQA75en
dc.titleInformation and knowing when to forget iten
dc.typeConference itemen
dc.description.versionPostprinten
dc.contributor.institutionUniversity of St Andrews.School of Computer Scienceen
dc.identifier.doihttps://doi.org/10.1109/IJCNN.2017.7966253


This item appears in the following Collection(s)

Show simple item record