HandyTool: Object Manipulation Through Metaphorical Hand/Fingers-to-Tool Mapping

Eunbi Seol; Gerard J. Kim

doi:10.1007/978-3-030-23528-4_58

HandyTool: Object Manipulation Through Metaphorical Hand/Fingers-to-Tool Mapping

Eunbi Seol, Gerard J. Kim

Department of Computer Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

4 Citations (Scopus)

Abstract

In this paper, we introduce “HandyTool” a method (and an interface) for virtual object manipulation based on a metaphorical/structural mapping of various everyday tools to our hands and fingers. The basic idea is to virtually transform the hand/fingers into a proper tool (e.g. a fist becoming a hammer head) and gesturally apply it (e.g. hammer in to insert) to and manipulate the target object (e.g. a nail) directly. The main intended objective of HandyTool is to enhance the tool usage experience by one (or one’s body part) becoming the tool itself and thereby also possibly improving the task performance. A usability experiment was carried out to assess the projected merits, comparing HandyTool to the case of the as-is emulation of the tool usage (i.e. the tracked hand/finger controlling the tool to apply it to the target object) and to the case of using the controller. Our experiment was not able to show the clear and full potential of HandyTool because of the current performance limitation of the hand/fingers tracking sensor and due to the simplicity in the structural mapping between the tool and hand/fingers. The structural metaphor itself was still shown to be helpful when the controller was used (i.e. stable sensing).

Original language	English
Title of host publication	HCI International 2019 - Posters - 21st International Conference, HCII 2019, Proceedings
Editors	Constantine Stephanidis
Publisher	Springer Verlag
Pages	432-439
Number of pages	8
ISBN (Print)	9783030235277
DOIs	https://doi.org/10.1007/978-3-030-23528-4_58
Publication status	Published - 2019
Event	21st International Conference on Human-Computer Interaction, HCI International 2019 - Orlando, United States Duration: 2019 Jul 26 → 2019 Jul 31

Publication series

Name	Communications in Computer and Information Science
Volume	1033
ISSN (Print)	1865-0929
ISSN (Electronic)	1865-0937

Conference

Conference	21st International Conference on Human-Computer Interaction, HCI International 2019
Country/Territory	United States
City	Orlando
Period	19/7/26 → 19/7/31

Bibliographical note

Funding Information:
Acknowledgments. This work was partially supported by the Global Frontier R&D Program on <Human-centered Interaction for Coexistence> funded by the National Research Foundation of Korea grant funded by the Korean Government (MEST) (NRF-2015M3A6A3076490), and by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) (NRF-2017M3C1B6070980).

Publisher Copyright:
© Springer Nature Switzerland AG 2019.

Keywords

Interactive learning environments
Mixed/augmented reality
Virtual reality

ASJC Scopus subject areas

Computer Science(all)
Mathematics(all)

Access to Document

10.1007/978-3-030-23528-4_58

Cite this

HandyTool: Object Manipulation Through Metaphorical Hand/Fingers-to-Tool Mapping. / Seol, Eunbi; Kim, Gerard J.
HCI International 2019 - Posters - 21st International Conference, HCII 2019, Proceedings. ed. / Constantine Stephanidis. Springer Verlag, 2019. p. 432-439 (Communications in Computer and Information Science; Vol. 1033).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Seol, E & Kim, GJ 2019, HandyTool: Object Manipulation Through Metaphorical Hand/Fingers-to-Tool Mapping. in C Stephanidis (ed.), HCI International 2019 - Posters - 21st International Conference, HCII 2019, Proceedings. Communications in Computer and Information Science, vol. 1033, Springer Verlag, pp. 432-439, 21st International Conference on Human-Computer Interaction, HCI International 2019, Orlando, United States, 19/7/26. https://doi.org/10.1007/978-3-030-23528-4_58

@inproceedings{cdd54b02a62f422cbfdbb6fa9d0f1b61,

title = "HandyTool: Object Manipulation Through Metaphorical Hand/Fingers-to-Tool Mapping",

abstract = "In this paper, we introduce “HandyTool” a method (and an interface) for virtual object manipulation based on a metaphorical/structural mapping of various everyday tools to our hands and fingers. The basic idea is to virtually transform the hand/fingers into a proper tool (e.g. a fist becoming a hammer head) and gesturally apply it (e.g. hammer in to insert) to and manipulate the target object (e.g. a nail) directly. The main intended objective of HandyTool is to enhance the tool usage experience by one (or one{\textquoteright}s body part) becoming the tool itself and thereby also possibly improving the task performance. A usability experiment was carried out to assess the projected merits, comparing HandyTool to the case of the as-is emulation of the tool usage (i.e. the tracked hand/finger controlling the tool to apply it to the target object) and to the case of using the controller. Our experiment was not able to show the clear and full potential of HandyTool because of the current performance limitation of the hand/fingers tracking sensor and due to the simplicity in the structural mapping between the tool and hand/fingers. The structural metaphor itself was still shown to be helpful when the controller was used (i.e. stable sensing).",

keywords = "Interactive learning environments, Mixed/augmented reality, Virtual reality",

author = "Eunbi Seol and Kim, {Gerard J.}",

note = "Funding Information: Acknowledgments. This work was partially supported by the Global Frontier R&D Program on <Human-centered Interaction for Coexistence> funded by the National Research Foundation of Korea grant funded by the Korean Government (MEST) (NRF-2015M3A6A3076490), and by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) (NRF-2017M3C1B6070980). Publisher Copyright: {\textcopyright} Springer Nature Switzerland AG 2019.; 21st International Conference on Human-Computer Interaction, HCI International 2019 ; Conference date: 26-07-2019 Through 31-07-2019",

year = "2019",

doi = "10.1007/978-3-030-23528-4_58",

language = "English",

isbn = "9783030235277",

series = "Communications in Computer and Information Science",

publisher = "Springer Verlag",

pages = "432--439",

editor = "Constantine Stephanidis",

booktitle = "HCI International 2019 - Posters - 21st International Conference, HCII 2019, Proceedings",

}

TY - GEN

T1 - HandyTool

T2 - 21st International Conference on Human-Computer Interaction, HCI International 2019

AU - Seol, Eunbi

AU - Kim, Gerard J.

N1 - Funding Information: Acknowledgments. This work was partially supported by the Global Frontier R&D Program on <Human-centered Interaction for Coexistence> funded by the National Research Foundation of Korea grant funded by the Korean Government (MEST) (NRF-2015M3A6A3076490), and by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) (NRF-2017M3C1B6070980). Publisher Copyright: © Springer Nature Switzerland AG 2019.

PY - 2019

Y1 - 2019

N2 - In this paper, we introduce “HandyTool” a method (and an interface) for virtual object manipulation based on a metaphorical/structural mapping of various everyday tools to our hands and fingers. The basic idea is to virtually transform the hand/fingers into a proper tool (e.g. a fist becoming a hammer head) and gesturally apply it (e.g. hammer in to insert) to and manipulate the target object (e.g. a nail) directly. The main intended objective of HandyTool is to enhance the tool usage experience by one (or one’s body part) becoming the tool itself and thereby also possibly improving the task performance. A usability experiment was carried out to assess the projected merits, comparing HandyTool to the case of the as-is emulation of the tool usage (i.e. the tracked hand/finger controlling the tool to apply it to the target object) and to the case of using the controller. Our experiment was not able to show the clear and full potential of HandyTool because of the current performance limitation of the hand/fingers tracking sensor and due to the simplicity in the structural mapping between the tool and hand/fingers. The structural metaphor itself was still shown to be helpful when the controller was used (i.e. stable sensing).

AB - In this paper, we introduce “HandyTool” a method (and an interface) for virtual object manipulation based on a metaphorical/structural mapping of various everyday tools to our hands and fingers. The basic idea is to virtually transform the hand/fingers into a proper tool (e.g. a fist becoming a hammer head) and gesturally apply it (e.g. hammer in to insert) to and manipulate the target object (e.g. a nail) directly. The main intended objective of HandyTool is to enhance the tool usage experience by one (or one’s body part) becoming the tool itself and thereby also possibly improving the task performance. A usability experiment was carried out to assess the projected merits, comparing HandyTool to the case of the as-is emulation of the tool usage (i.e. the tracked hand/finger controlling the tool to apply it to the target object) and to the case of using the controller. Our experiment was not able to show the clear and full potential of HandyTool because of the current performance limitation of the hand/fingers tracking sensor and due to the simplicity in the structural mapping between the tool and hand/fingers. The structural metaphor itself was still shown to be helpful when the controller was used (i.e. stable sensing).

KW - Interactive learning environments

KW - Mixed/augmented reality

KW - Virtual reality

UR - http://www.scopus.com/inward/record.url?scp=85069644910&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-23528-4_58

DO - 10.1007/978-3-030-23528-4_58

M3 - Conference contribution

AN - SCOPUS:85069644910

SN - 9783030235277

T3 - Communications in Computer and Information Science

SP - 432

EP - 439

BT - HCI International 2019 - Posters - 21st International Conference, HCII 2019, Proceedings

A2 - Stephanidis, Constantine

PB - Springer Verlag

Y2 - 26 July 2019 through 31 July 2019

ER -

HandyTool: Object Manipulation Through Metaphorical Hand/Fingers-to-Tool Mapping

Abstract

Publication series

Conference

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this