Online continual learning for human activity recognition
Abstract
Sensor-based human activity recognition (HAR), with the ability to recognise human activities from wearable or embedded sensors, has been playing an important role in many applications including personal health monitoring, smart home, and manufacturing. The real-world, long-term deployment of these HAR systems drives a critical research question: how to evolve the HAR model automatically over time to accommodate changes in an environment or activity patterns. This paper presents an online continual learning (OCL) scenario for HAR, where sensor data arrives in a streaming manner which contains unlabelled samples from already learnt activities or new activities. We propose a technique, OCL-HAR, making a real-time prediction on the streaming sensor data while at the same time discovering and learning new activities. We have empirically evaluated OCL-HAR on four third-party, publicly available HAR datasets. Our results have shown that this OCL scenario is challenging to state-of-the-art continual learning techniques that have significantly underperformed. Our technique OCL-HAR has consistently outperformed them in all experiment setups, leading up to 0.17 and 0.23 improvements in micro and macro F1 scores.
Citation
Schiemer , M , Fang , L , Dobson , S & Ye , J 2023 , ' Online continual learning for human activity recognition ' , Pervasive and Mobile Computing , vol. 93 , 101817 . https://doi.org/10.1016/j.pmcj.2023.101817
Publication
Pervasive and Mobile Computing
Status
Peer reviewed
ISSN
1574-1192Type
Journal article
Rights
Copyright © 2023 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
Description
Funding: This work is partly funded by Leverhulme Research Project Grant RPG-2021-355.Collections
Items in the St Andrews Research Repository are protected by copyright, with all rights reserved, unless otherwise indicated.