Files in this item
Visualization as Intermediate Representations (VLAIR) for human activity recognition
Item metadata
dc.contributor.author | Jiang, Ai | |
dc.contributor.author | Nacenta, Miguel | |
dc.contributor.author | Terzić, Kasim | |
dc.contributor.author | Ye, Juan | |
dc.contributor.editor | Munson, Sean A. | |
dc.contributor.editor | Schueller, Stephen M. | |
dc.date.accessioned | 2021-03-03T16:30:14Z | |
dc.date.available | 2021-03-03T16:30:14Z | |
dc.date.issued | 2020-05-18 | |
dc.identifier | 267071323 | |
dc.identifier | 87933f86-3c09-40f5-82e5-0a886f97b33b | |
dc.identifier | 85100742565 | |
dc.identifier.citation | Jiang , A , Nacenta , M , Terzić , K & Ye , J 2020 , Visualization as Intermediate Representations (VLAIR) for human activity recognition . in S A Munson & S M Schueller (eds) , PervasiveHealth '20: Proceedings of the 14th EAI International Conference on Pervasive Computing Technologies for Healthcare . ACM , pp. 201-210 , 14th EAI International Conference on Pervasive Computing Technologies for Healthcare (EAI PervasiveHealth 2020) , Atlanta , Georgia , United States , 6/10/20 . https://doi.org/10.1145/3421937.3422015 | en |
dc.identifier.citation | conference | en |
dc.identifier.isbn | 9781450375320 | |
dc.identifier.other | ORCID: /0000-0002-9864-9654/work/90112146 | |
dc.identifier.other | ORCID: /0000-0002-2838-6836/work/90112778 | |
dc.identifier.uri | https://hdl.handle.net/10023/21551 | |
dc.description.abstract | Ambient, binary, event-driven sensor data is useful for many human activity recognition applications such as smart homes and ambient-assisted living. These sensors are privacy-preserving, unobtrusive, inexpensive and easy to deploy in scenarios that require detection of simple activities such as going to sleep, and leaving the house. However, classification performance is still a challenge, especially when multiple people share the same space or when different activities take place in the same areas. To improve classification performance we develop what we call a Visualization as Intermediate Representations (VLAIR) approach. The main idea is to re-represent the data as visualizations (generated pixel images) in a similar way as how visualizations are created for humans to analyze and communicate data. Then we can feed these images to a convolutional neural network whose strength resides in extracting effective visual features. We have tested five variants (mappings) of the VLAIR approach and compared them to a collection of classifiers commonly used in classic human activity recognition. The best of the VLAIR approaches outperforms the best baseline, with strong advantage in recognising less frequent activities and distinguishing users and activities in common areas. We conclude the paper with a discussion on why and how VLAIR can be useful in human activity recognition scenarios and beyond. | |
dc.format.extent | 10 | |
dc.format.extent | 1802390 | |
dc.language.iso | eng | |
dc.publisher | ACM | |
dc.relation.ispartof | PervasiveHealth '20: | en |
dc.subject | Information visualization | en |
dc.subject | Intermediate representations | en |
dc.subject | Human activity recognition | en |
dc.subject | Convolutional neural networks | en |
dc.subject | Smart homes | en |
dc.subject | QA75 Electronic computers. Computer science | en |
dc.subject | T Technology | en |
dc.subject | NDAS | en |
dc.subject | BDU | en |
dc.subject.lcc | QA75 | en |
dc.subject.lcc | T | en |
dc.title | Visualization as Intermediate Representations (VLAIR) for human activity recognition | en |
dc.type | Conference item | en |
dc.contributor.institution | University of St Andrews. School of Computer Science | en |
dc.contributor.institution | University of St Andrews. Coastal Resources Management Group | en |
dc.identifier.doi | 10.1145/3421937.3422015 | |
dc.date.embargoedUntil | 2020-05-18 |
This item appears in the following Collection(s)
Items in the St Andrews Research Repository are protected by copyright, with all rights reserved, unless otherwise indicated.