SWAG demo : smart watch assisted gesture interaction for mixed reality head-mounted displays
Abstract
In this demonstration, we will show a prototype system with sensor fusion approach to robustly track 6 degrees of freedom of hand movement and support intuitive hand gesture interaction and 3D object manipulation for Mixed Reality head-mounted displays. Robust tracking of hand and finger with egocentric camera remains a challenging problem, especially with self-occlusion – for example, when user tries to grab a virtual object in midair by closing the palm. Our approach leverages the use of a common smart watch worn on the wrist to provide a more reliable palm and wrist orientation data, while fusing the data with camera to achieve robust hand motion and orientation for interaction.
Citation
Kim , H , Lee , J , Yeo , H S , Quigley , A J & Woo , W 2019 , SWAG demo : smart watch assisted gesture interaction for mixed reality head-mounted displays . in Adjunct Proceedings - 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018 . , 8699201 , Institute of Electrical and Electronics Engineers Inc. , pp. 428-429 , 17th IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018 , Munich , Germany , 16/10/18 . https://doi.org/10.1109/ISMAR-Adjunct.2018.00130 conference
Publication
Adjunct Proceedings - 2018 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2018
Type
Conference item
Collections
Items in the St Andrews Research Repository are protected by copyright, with all rights reserved, unless otherwise indicated.