Acoustic+Pose: Adding Input Modality to Smartphones with Near-Surface Hand-Pose Recognition using Acoustic Surface

Kunihiro Kato, Kaori Ikematsu

研究成果: 書籍の章/レポート/Proceedings会議への寄与査読

1 被引用数 (Scopus)

抄録

To achieve mid-air interactions for smartphones, acoustic-sensing, a technique using the built-in speaker and microphone of smartphones, is promising. However, detecting hand poses on the near-surface of touchscreens remains challenging due to the arrangement of the built-in speaker and microphone. To address this, we present Acoustic+Pose, a novel approach for combining conventional touch interactions with near-surface hand-pose estimation to enable a wide range of interactions. We focused on smartphones incorporating Acoustic Surface, a technology that vibrates the entire smartphone screen to emit sound over a wide area. We used this technology to extend the input space to the near surface of touchscreens. We trained machine-learning models to recognize hand poses in the near-surface area and demonstrated interaction techniques to use the recognized poses for a new modality of smartphone input. Through an evaluation, we confirmed that the trained models recognized 10 hand poses with 90.2% accuracy.

本文言語英語
ホスト出版物のタイトルISWC 2023 - Proceedings of the 2023 International Symposium on Wearable Computers
出版社Association for Computing Machinery, Inc
ページ44-49
ページ数6
ISBN(電子版)9798400701993
DOI
出版ステータス出版済み - 2023 10月 8
イベント2023 International Symposium on Wearable Computers, ISWC 2023 - Cancun, メキシコ
継続期間: 2023 10月 82023 10月 12

出版物シリーズ

名前ISWC 2023 - Proceedings of the 2023 International Symposium on Wearable Computers

会議

会議2023 International Symposium on Wearable Computers, ISWC 2023
国/地域メキシコ
CityCancun
Period23/10/823/10/12

フィンガープリント

「Acoustic+Pose: Adding Input Modality to Smartphones with Near-Surface Hand-Pose Recognition using Acoustic Surface」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル