Exploring in-the-Wild Game-Based Gesture Data Collection

Kiyoshi Oka, Weiquan Lu, Kasım Özacar, Kazuki Takashima, Yoshifumi Kitamura

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)


This paper presents an automatic 3D gesture collection concept and architecture based on a rhythm game for public displays. The system was implemented using an off-the-shelf gesture controller, was deployed on a public vertical screen, and was used to study the effects of alternative gesture guidance conditions. In the evaluation presented, we examined how alternative gesture guidance conditions affect users’ engagement. The study showed that demonstration animation (CDA) and tracking state feedback (TSI) each encourages sustained game engagement. The underlying concept and architecture presented here offer actionable UI design insight to help creating large gesture corpus from diverse populations.

Original languageEnglish
Title of host publicationHuman-Computer Interaction - INTERACT 2017 - 16th IFIP TC 13 International Conference, Proceedings
EditorsGirish Dalvi, Anirudha Joshi, Devanuj K. Balkrishan, Jacki O'Neill, Marco Winckler, Regina Bernhaupt
PublisherSpringer Verlag
Number of pages10
ISBN (Print)9783319676838
Publication statusPublished - 2017
Event16th IFIP TC13 International Conference on Human–Computer Interaction, INTERACT 2017 - Mumbai, India
Duration: 2017 Sept 252017 Sept 29

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10514 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference16th IFIP TC13 International Conference on Human–Computer Interaction, INTERACT 2017


Dive into the research topics of 'Exploring in-the-Wild Game-Based Gesture Data Collection'. Together they form a unique fingerprint.

Cite this