Comparison of multimodal interactions in perspective-corrected multi-display environment

Ryo Fukazawa; Kazuki Takashima; Garth Shoemaker; Yoshifumi Kitamura; Yuichi Itoh; Fumio Kishino

doi:10.1109/3DUI.2010.5444711

Comparison of multimodal interactions in perspective-corrected multi-display environment

Ryo Fukazawa, Kazuki Takashima, Garth Shoemaker, Yoshifumi Kitamura, Yuichi Itoh, Fumio Kishino

RIEC - Human and Bio Information Systems Division

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

7 Citations (Scopus)

Abstract

This paper compares multi-modal interaction techniques in a perspective-corrected multi-display environment (MDE). The performance of multimodal interactions using gestures, eye gaze, and head direction are experimentally examined in an object manipulation task in MDEs and compared with a mouse operated perspective cursor. Experimental results showed that gesture-based multimodal interactions provide performance equivalent in task completion time to mouse-based perspective cursors. A technique utilizing user head direction received positive comments from subjects even though it was not as fast. Based on the experimental results and observations, we discuss the potential of multimodal interaction techniques in MDEs.

Original language	English
Title of host publication	3DUI 2010 - IEEE Symposium on 3D User Interfaces 2010, Proceedings
Pages	103-110
Number of pages	8
DOIs	https://doi.org/10.1109/3DUI.2010.5444711
Publication status	Published - 2010
Event	IEEE Symposium on 3D User Interfaces 2010, 3DUI 2010 - Waltham, MA, United States Duration: 2010 Mar 20 → 2010 Mar 21

Publication series

Name	3DUI 2010 - IEEE Symposium on 3D User Interfaces 2010, Proceedings

Conference

Conference	IEEE Symposium on 3D User Interfaces 2010, 3DUI 2010
Country/Territory	United States
City	Waltham, MA
Period	10/3/20 → 10/3/21

Keywords

Gaze
Gestural interaction
H5.2 [Information interfaces and presentation]: User Interfaces - Graphical user interfaces
Multi-display environments
Perspective-aware interfaces
Pointing

Access to Document

10.1109/3DUI.2010.5444711

Cite this

Fukazawa, R., Takashima, K., Shoemaker, G., Kitamura, Y., Itoh, Y., & Kishino, F. (2010). Comparison of multimodal interactions in perspective-corrected multi-display environment. In 3DUI 2010 - IEEE Symposium on 3D User Interfaces 2010, Proceedings (pp. 103-110). Article 5444711 (3DUI 2010 - IEEE Symposium on 3D User Interfaces 2010, Proceedings). https://doi.org/10.1109/3DUI.2010.5444711

@inproceedings{6cad65abcb8b44b78ab32ba8cbc2a434,

title = "Comparison of multimodal interactions in perspective-corrected multi-display environment",

abstract = "This paper compares multi-modal interaction techniques in a perspective-corrected multi-display environment (MDE). The performance of multimodal interactions using gestures, eye gaze, and head direction are experimentally examined in an object manipulation task in MDEs and compared with a mouse operated perspective cursor. Experimental results showed that gesture-based multimodal interactions provide performance equivalent in task completion time to mouse-based perspective cursors. A technique utilizing user head direction received positive comments from subjects even though it was not as fast. Based on the experimental results and observations, we discuss the potential of multimodal interaction techniques in MDEs.",

keywords = "Gaze, Gestural interaction, H5.2 [Information interfaces and presentation]: User Interfaces - Graphical user interfaces, Multi-display environments, Perspective-aware interfaces, Pointing",

author = "Ryo Fukazawa and Kazuki Takashima and Garth Shoemaker and Yoshifumi Kitamura and Yuichi Itoh and Fumio Kishino",

year = "2010",

doi = "10.1109/3DUI.2010.5444711",

language = "English",

isbn = "9781424468447",

series = "3DUI 2010 - IEEE Symposium on 3D User Interfaces 2010, Proceedings",

pages = "103--110",

booktitle = "3DUI 2010 - IEEE Symposium on 3D User Interfaces 2010, Proceedings",

note = "IEEE Symposium on 3D User Interfaces 2010, 3DUI 2010 ; Conference date: 20-03-2010 Through 21-03-2010",

}

Fukazawa, R, Takashima, K, Shoemaker, G, Kitamura, Y, Itoh, Y & Kishino, F 2010, Comparison of multimodal interactions in perspective-corrected multi-display environment. in 3DUI 2010 - IEEE Symposium on 3D User Interfaces 2010, Proceedings., 5444711, 3DUI 2010 - IEEE Symposium on 3D User Interfaces 2010, Proceedings, pp. 103-110, IEEE Symposium on 3D User Interfaces 2010, 3DUI 2010, Waltham, MA, United States, 10/3/20. https://doi.org/10.1109/3DUI.2010.5444711

Comparison of multimodal interactions in perspective-corrected multi-display environment. / Fukazawa, Ryo; Takashima, Kazuki; Shoemaker, Garth et al.
3DUI 2010 - IEEE Symposium on 3D User Interfaces 2010, Proceedings. 2010. p. 103-110 5444711 (3DUI 2010 - IEEE Symposium on 3D User Interfaces 2010, Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Comparison of multimodal interactions in perspective-corrected multi-display environment

AU - Fukazawa, Ryo

AU - Takashima, Kazuki

AU - Shoemaker, Garth

AU - Kitamura, Yoshifumi

AU - Itoh, Yuichi

AU - Kishino, Fumio

PY - 2010

Y1 - 2010

N2 - This paper compares multi-modal interaction techniques in a perspective-corrected multi-display environment (MDE). The performance of multimodal interactions using gestures, eye gaze, and head direction are experimentally examined in an object manipulation task in MDEs and compared with a mouse operated perspective cursor. Experimental results showed that gesture-based multimodal interactions provide performance equivalent in task completion time to mouse-based perspective cursors. A technique utilizing user head direction received positive comments from subjects even though it was not as fast. Based on the experimental results and observations, we discuss the potential of multimodal interaction techniques in MDEs.

AB - This paper compares multi-modal interaction techniques in a perspective-corrected multi-display environment (MDE). The performance of multimodal interactions using gestures, eye gaze, and head direction are experimentally examined in an object manipulation task in MDEs and compared with a mouse operated perspective cursor. Experimental results showed that gesture-based multimodal interactions provide performance equivalent in task completion time to mouse-based perspective cursors. A technique utilizing user head direction received positive comments from subjects even though it was not as fast. Based on the experimental results and observations, we discuss the potential of multimodal interaction techniques in MDEs.

KW - Gaze

KW - Gestural interaction

KW - H5.2 [Information interfaces and presentation]: User Interfaces - Graphical user interfaces

KW - Multi-display environments

KW - Perspective-aware interfaces

KW - Pointing

UR - http://www.scopus.com/inward/record.url?scp=77953038749&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77953038749&partnerID=8YFLogxK

U2 - 10.1109/3DUI.2010.5444711

DO - 10.1109/3DUI.2010.5444711

M3 - Conference contribution

AN - SCOPUS:77953038749

SN - 9781424468447

T3 - 3DUI 2010 - IEEE Symposium on 3D User Interfaces 2010, Proceedings

SP - 103

EP - 110

BT - 3DUI 2010 - IEEE Symposium on 3D User Interfaces 2010, Proceedings

T2 - IEEE Symposium on 3D User Interfaces 2010, 3DUI 2010

Y2 - 20 March 2010 through 21 March 2010

ER -

Comparison of multimodal interactions in perspective-corrected multi-display environment

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this