Gaze-directed hands-free interface for mobile interaction

Gie Seo Park; Jong Gil Ahn; Gerard J. Kim

doi:10.1007/978-3-642-21605-3_34

Gaze-directed hands-free interface for mobile interaction

Gie Seo Park, Jong Gil Ahn, Gerard J. Kim

Department of Computer Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

2 Citations (Scopus)

Abstract

While mobile devices have allowed people to carry out various computing and communication tasks everywhere, it has generally lacked the support for task execution while the user is in motion. This is because the interaction schemes of most mobile applications are centered around the device visual display and when in motion (with the important body parts, such as the head and hands, moving), it is difficult for the user to recognize the visual output on the small hand-carried device display and respond to make the timely and proper input. In this paper, we propose an interface which allows the user to interact with the mobile devices during motion without having to look at it or use one's hands. More specifically, the user interacts, by gaze and head motion gestures, with an invisible virtual interface panel with the help of a head-worn gyro sensor and aural feedback. Since the menu is one of the most prevailing methods of interaction, we investigate and focus on the various forms of menu presentation such as the layout and the number of comfortably selectable menu items. With head motion, it turns out 4×2 or 3×3 grid menu is more effective. The results of this study can be further extended for developing a more sophisticated non-visual oriented mobile interface.

Original language	English
Title of host publication	Human-Computer Interaction
Subtitle of host publication	Interaction Techniques and Environments - 14th International Conference, HCI International 2011, Proceedings
Pages	304-313
Number of pages	10
Edition	PART 2
DOIs	https://doi.org/10.1007/978-3-642-21605-3_34
Publication status	Published - 2011
Event	14th International Conference on Human-Computer Interaction, HCI International 2011 - Orlando, FL, United States Duration: 2011 Jul 9 → 2011 Jul 14

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Number	PART 2
Volume	6762 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Other

Other	14th International Conference on Human-Computer Interaction, HCI International 2011
Country/Territory	United States
City	Orlando, FL
Period	11/7/9 → 11/7/14

Bibliographical note

Funding Information:
This research was supported in part by the Strategic Technology Lab. Program (Multimodal Entertainment Platform area) and the Core Industrial Tech. Development Program (Digital Textile based Around Body Computing area) of the Korea Ministry of Knowledge Economy (MKE).

Keywords

Gaze
Hands-free
Head-controlled
Mobile interface
Non-visual interface

ASJC Scopus subject areas

Theoretical Computer Science
General Computer Science

Access to Document

10.1007/978-3-642-21605-3_34

Cite this

Park, G. S., Ahn, J. G., & Kim, G. J. (2011). Gaze-directed hands-free interface for mobile interaction. In Human-Computer Interaction: Interaction Techniques and Environments - 14th International Conference, HCI International 2011, Proceedings (PART 2 ed., pp. 304-313). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6762 LNCS, No. PART 2). https://doi.org/10.1007/978-3-642-21605-3_34

Gaze-directed hands-free interface for mobile interaction. / Park, Gie Seo; Ahn, Jong Gil; Kim, Gerard J.
Human-Computer Interaction: Interaction Techniques and Environments - 14th International Conference, HCI International 2011, Proceedings. PART 2. ed. 2011. p. 304-313 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6762 LNCS, No. PART 2).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Park, GS, Ahn, JG & Kim, GJ 2011, Gaze-directed hands-free interface for mobile interaction. in Human-Computer Interaction: Interaction Techniques and Environments - 14th International Conference, HCI International 2011, Proceedings. PART 2 edn, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 2, vol. 6762 LNCS, pp. 304-313, 14th International Conference on Human-Computer Interaction, HCI International 2011, Orlando, FL, United States, 11/7/9. https://doi.org/10.1007/978-3-642-21605-3_34

Park GS, Ahn JG, Kim GJ. Gaze-directed hands-free interface for mobile interaction. In Human-Computer Interaction: Interaction Techniques and Environments - 14th International Conference, HCI International 2011, Proceedings. PART 2 ed. 2011. p. 304-313. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 2). doi: 10.1007/978-3-642-21605-3_34

Park, Gie Seo ; Ahn, Jong Gil ; Kim, Gerard J. / Gaze-directed hands-free interface for mobile interaction. Human-Computer Interaction: Interaction Techniques and Environments - 14th International Conference, HCI International 2011, Proceedings. PART 2. ed. 2011. pp. 304-313 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 2).

@inproceedings{26b76241f73a465a910795d8ffab25ff,

title = "Gaze-directed hands-free interface for mobile interaction",

abstract = "While mobile devices have allowed people to carry out various computing and communication tasks everywhere, it has generally lacked the support for task execution while the user is in motion. This is because the interaction schemes of most mobile applications are centered around the device visual display and when in motion (with the important body parts, such as the head and hands, moving), it is difficult for the user to recognize the visual output on the small hand-carried device display and respond to make the timely and proper input. In this paper, we propose an interface which allows the user to interact with the mobile devices during motion without having to look at it or use one's hands. More specifically, the user interacts, by gaze and head motion gestures, with an invisible virtual interface panel with the help of a head-worn gyro sensor and aural feedback. Since the menu is one of the most prevailing methods of interaction, we investigate and focus on the various forms of menu presentation such as the layout and the number of comfortably selectable menu items. With head motion, it turns out 4×2 or 3×3 grid menu is more effective. The results of this study can be further extended for developing a more sophisticated non-visual oriented mobile interface.",

keywords = "Gaze, Hands-free, Head-controlled, Mobile interface, Non-visual interface",

author = "Park, {Gie Seo} and Ahn, {Jong Gil} and Kim, {Gerard J.}",

note = "Funding Information: This research was supported in part by the Strategic Technology Lab. Program (Multimodal Entertainment Platform area) and the Core Industrial Tech. Development Program (Digital Textile based Around Body Computing area) of the Korea Ministry of Knowledge Economy (MKE).; 14th International Conference on Human-Computer Interaction, HCI International 2011 ; Conference date: 09-07-2011 Through 14-07-2011",

year = "2011",

doi = "10.1007/978-3-642-21605-3_34",

language = "English",

isbn = "9783642216046",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

number = "PART 2",

pages = "304--313",

booktitle = "Human-Computer Interaction",

edition = "PART 2",

}

TY - GEN

T1 - Gaze-directed hands-free interface for mobile interaction

AU - Park, Gie Seo

AU - Ahn, Jong Gil

AU - Kim, Gerard J.

N1 - Funding Information: This research was supported in part by the Strategic Technology Lab. Program (Multimodal Entertainment Platform area) and the Core Industrial Tech. Development Program (Digital Textile based Around Body Computing area) of the Korea Ministry of Knowledge Economy (MKE).

PY - 2011

Y1 - 2011

N2 - While mobile devices have allowed people to carry out various computing and communication tasks everywhere, it has generally lacked the support for task execution while the user is in motion. This is because the interaction schemes of most mobile applications are centered around the device visual display and when in motion (with the important body parts, such as the head and hands, moving), it is difficult for the user to recognize the visual output on the small hand-carried device display and respond to make the timely and proper input. In this paper, we propose an interface which allows the user to interact with the mobile devices during motion without having to look at it or use one's hands. More specifically, the user interacts, by gaze and head motion gestures, with an invisible virtual interface panel with the help of a head-worn gyro sensor and aural feedback. Since the menu is one of the most prevailing methods of interaction, we investigate and focus on the various forms of menu presentation such as the layout and the number of comfortably selectable menu items. With head motion, it turns out 4×2 or 3×3 grid menu is more effective. The results of this study can be further extended for developing a more sophisticated non-visual oriented mobile interface.

AB - While mobile devices have allowed people to carry out various computing and communication tasks everywhere, it has generally lacked the support for task execution while the user is in motion. This is because the interaction schemes of most mobile applications are centered around the device visual display and when in motion (with the important body parts, such as the head and hands, moving), it is difficult for the user to recognize the visual output on the small hand-carried device display and respond to make the timely and proper input. In this paper, we propose an interface which allows the user to interact with the mobile devices during motion without having to look at it or use one's hands. More specifically, the user interacts, by gaze and head motion gestures, with an invisible virtual interface panel with the help of a head-worn gyro sensor and aural feedback. Since the menu is one of the most prevailing methods of interaction, we investigate and focus on the various forms of menu presentation such as the layout and the number of comfortably selectable menu items. With head motion, it turns out 4×2 or 3×3 grid menu is more effective. The results of this study can be further extended for developing a more sophisticated non-visual oriented mobile interface.

KW - Gaze

KW - Hands-free

KW - Head-controlled

KW - Mobile interface

KW - Non-visual interface

UR - http://www.scopus.com/inward/record.url?scp=79960323446&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-21605-3_34

DO - 10.1007/978-3-642-21605-3_34

M3 - Conference contribution

AN - SCOPUS:79960323446

SN - 9783642216046

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 304

EP - 313

BT - Human-Computer Interaction

T2 - 14th International Conference on Human-Computer Interaction, HCI International 2011

Y2 - 9 July 2011 through 14 July 2011

ER -

Gaze-directed hands-free interface for mobile interaction

Abstract

Publication series

Other

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this